2024-08-01T06:35:14.073 INFO:root:teuthology version: 0.0.1.dev379+g53ce146 2024-08-01T06:35:14.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-01T06:35:14.192 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-07-31_21:24:16-fs-squid-distro-default-smithi/7829256 branch: squid description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7829256' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/reef ' name: teuthology-2024-07-31_21:24:16-fs-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: f9911e17b12222fbe598fff73cd3ad10d20c5776 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f9911e17b12222fbe598fff73cd3ad10d20c5776 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: d99c9769be1521395979e8c23d9073adbf1ff43f owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 4805 sha1: f9911e17b12222fbe598fff73cd3ad10d20c5776 sleep_before_teardown: 0 subset: 91/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_d99c9769be1521395979e8c23d9073adbf1ff43f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: d99c9769be1521395979e8c23d9073adbf1ff43f targets: smithi016.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFalmle8vBTAdfQwTEHulIr6nZIaLUqDdSf6j8Pg2+eO+izMLIBlFhoHx2RRrgQaeq6wc+1qtpHez50+Mf4Xs00= smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKsUmEc0ALZ4UP6A8u+xCoDaz2zenkVIWaNbpaVrzLiAMsze43UCiIO/uDnFlglq5EpDF24yA35WUAUdwocXCpI= tasks: - install: branch: reef exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:reef roleless: true - print: '**** done end installing reef cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /home/teuthology/src/git.ceph.com_ceph_squid/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 53ce1462e129f6eb4071986336534c740fdebd31 timestamp: 2024-07-31_21:24:16 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.4074525 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-08-01T06:35:14.192 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_d99c9769be1521395979e8c23d9073adbf1ff43f/qa; will attempt to use it 2024-08-01T06:35:14.193 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_d99c9769be1521395979e8c23d9073adbf1ff43f/qa/tasks 2024-08-01T06:35:14.193 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-01T06:35:14.194 INFO:teuthology.task.internal:Checking packages... 2024-08-01T06:35:14.216 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f9911e17b12222fbe598fff73cd3ad10d20c5776' 2024-08-01T06:35:14.216 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-01T06:35:14.216 INFO:teuthology.packaging:ref: None 2024-08-01T06:35:14.216 INFO:teuthology.packaging:tag: None 2024-08-01T06:35:14.216 INFO:teuthology.packaging:branch: squid 2024-08-01T06:35:14.217 INFO:teuthology.packaging:sha1: f9911e17b12222fbe598fff73cd3ad10d20c5776 2024-08-01T06:35:14.217 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-08-01T06:35:14.420 INFO:teuthology.task.internal:Found packages for ceph version 19.1.0-1246.gd99c9769 2024-08-01T06:35:14.421 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-01T06:35:14.428 INFO:teuthology.task.internal:no buildpackages task found 2024-08-01T06:35:14.428 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-01T06:35:14.435 INFO:teuthology.task.internal:Saving configuration 2024-08-01T06:35:14.455 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-01T06:35:14.462 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-01T06:35:14.488 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-07-31_21:24:16-fs-squid-distro-default-smithi/7829256', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-01 06:29:39.855269', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFalmle8vBTAdfQwTEHulIr6nZIaLUqDdSf6j8Pg2+eO+izMLIBlFhoHx2RRrgQaeq6wc+1qtpHez50+Mf4Xs00='} 2024-08-01T06:35:14.511 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-07-31_21:24:16-fs-squid-distro-default-smithi/7829256', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-01 06:29:39.857248', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKsUmEc0ALZ4UP6A8u+xCoDaz2zenkVIWaNbpaVrzLiAMsze43UCiIO/uDnFlglq5EpDF24yA35WUAUdwocXCpI='} 2024-08-01T06:35:14.511 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-01T06:35:14.517 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-08-01T06:35:14.518 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-08-01T06:35:14.518 INFO:teuthology.run_tasks:Running task console_log... 2024-08-01T06:35:14.578 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9b460cfbe0>, signals=[15]) 2024-08-01T06:35:14.578 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-01T06:35:14.584 INFO:teuthology.task.internal:Opening connections... 2024-08-01T06:35:14.584 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2024-08-01T06:35:14.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-01T06:35:14.671 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2024-08-01T06:35:14.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-01T06:35:14.753 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-01T06:35:14.760 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2024-08-01T06:35:14.780 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2024-08-01T06:35:14.780 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-08-01T06:35:14.838 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream" 2024-08-01T06:35:14.838 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="9" 2024-08-01T06:35:14.839 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2024-08-01T06:35:14.839 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2024-08-01T06:35:14.839 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="9" 2024-08-01T06:35:14.839 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el9" 2024-08-01T06:35:14.839 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-01T06:35:14.839 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2024-08-01T06:35:14.839 INFO:teuthology.orchestra.run.smithi016.stdout:LOGO="fedora-logo-icon" 2024-08-01T06:35:14.839 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-01T06:35:14.839 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2024-08-01T06:35:14.839 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-01T06:35:14.839 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-01T06:35:14.839 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-01T06:35:14.840 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-08-01T06:35:14.867 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2024-08-01T06:35:14.884 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2024-08-01T06:35:14.884 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2024-08-01T06:35:14.941 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2024-08-01T06:35:14.941 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2024-08-01T06:35:14.942 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2024-08-01T06:35:14.942 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2024-08-01T06:35:14.942 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2024-08-01T06:35:14.942 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2024-08-01T06:35:14.942 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-01T06:35:14.942 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2024-08-01T06:35:14.942 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2024-08-01T06:35:14.942 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-01T06:35:14.942 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2024-08-01T06:35:14.942 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-01T06:35:14.942 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-01T06:35:14.942 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-01T06:35:14.943 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2024-08-01T06:35:14.967 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-01T06:35:14.976 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-01T06:35:14.982 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-01T06:35:14.982 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2024-08-01T06:35:14.985 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2024-08-01T06:35:15.001 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-01T06:35:15.009 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-01T06:35:15.009 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2024-08-01T06:35:15.043 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2024-08-01T06:35:15.123 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-01T06:35:15.179 INFO:teuthology.run_tasks:Running task kernel... 2024-08-01T06:35:15.194 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-01T06:35:15.194 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-01T06:35:15.194 DEBUG:teuthology.orchestra.run.smithi016:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-01T06:35:15.195 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-01T06:35:15.211 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-01T06:35:15.212 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-08-01T06:35:15.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-01T06:35:15.213 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-08-01T06:35:15.269 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-437.el9.x86_64 2024-08-01T06:35:15.270 INFO:teuthology.task.kernel:Running kernel on smithi089: 5.14.0-437.el9.x86_64 2024-08-01T06:35:15.270 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum install -y kernel 2024-08-01T06:35:15.271 INFO:teuthology.orchestra.run.smithi016.stdout:5.14.0-437.el9.x86_64 2024-08-01T06:35:15.271 INFO:teuthology.task.kernel:Running kernel on smithi016: 5.14.0-437.el9.x86_64 2024-08-01T06:35:15.271 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum install -y kernel 2024-08-01T06:35:17.690 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-08-01T06:35:18.938 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.2 MB 00:02 2024-08-01T06:35:20.619 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-08-01T06:35:22.572 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - AppStream 8.0 MB/s | 20 MB 00:02 2024-08-01T06:35:27.123 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 6.6 MB 00:00 2024-08-01T06:35:27.175 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.6 MB 00:02 2024-08-01T06:35:28.823 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 18 kB 00:00 2024-08-01T06:35:29.050 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 18 kB 00:00 2024-08-01T06:35:29.694 INFO:teuthology.orchestra.run.smithi016.stdout:Extra Packages for Enterprise Linux 30 MB/s | 22 MB 00:00 2024-08-01T06:35:30.063 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 25 MB/s | 22 MB 00:00 2024-08-01T06:35:35.284 INFO:teuthology.orchestra.run.smithi016.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-01T06:35:35.393 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-01T06:35:37.373 INFO:teuthology.orchestra.run.smithi016.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-01T06:35:37.373 INFO:teuthology.orchestra.run.smithi016.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-08-01T06:35:37.408 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-01T06:35:37.408 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-08-01T06:35:37.481 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:35:37.488 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:35:37.489 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:35:37.489 INFO:teuthology.orchestra.run.smithi016.stdout: Package Architecture Version Repository Size 2024-08-01T06:35:37.489 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:35:37.489 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-08-01T06:35:37.489 INFO:teuthology.orchestra.run.smithi016.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-01T06:35:37.489 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-08-01T06:35:37.489 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-core x86_64 5.14.0-480.el9 baseos 17 M 2024-08-01T06:35:37.489 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules x86_64 5.14.0-480.el9 baseos 36 M 2024-08-01T06:35:37.489 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules-core x86_64 5.14.0-480.el9 baseos 30 M 2024-08-01T06:35:37.489 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:35:37.490 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-08-01T06:35:37.490 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:35:37.490 INFO:teuthology.orchestra.run.smithi016.stdout:Install 4 Packages 2024-08-01T06:35:37.490 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:35:37.490 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 84 M 2024-08-01T06:35:37.491 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 126 M 2024-08-01T06:35:37.491 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-08-01T06:35:37.500 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:35:37.500 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-08-01T06:35:37.500 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:35:37.500 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-08-01T06:35:37.500 INFO:teuthology.orchestra.run.smithi089.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-01T06:35:37.500 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-08-01T06:35:37.500 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core x86_64 5.14.0-480.el9 baseos 17 M 2024-08-01T06:35:37.501 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules x86_64 5.14.0-480.el9 baseos 36 M 2024-08-01T06:35:37.501 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core x86_64 5.14.0-480.el9 baseos 30 M 2024-08-01T06:35:37.501 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:35:37.501 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-08-01T06:35:37.501 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:35:37.501 INFO:teuthology.orchestra.run.smithi089.stdout:Install 4 Packages 2024-08-01T06:35:37.501 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:35:37.502 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 84 M 2024-08-01T06:35:37.502 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 126 M 2024-08-01T06:35:37.502 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-08-01T06:35:38.135 INFO:teuthology.orchestra.run.smithi016.stdout:(1/4): kernel-5.14.0-480.el9.x86_64.rpm 2.6 MB/s | 1.5 MB 00:00 2024-08-01T06:35:38.653 INFO:teuthology.orchestra.run.smithi089.stdout:(1/4): kernel-5.14.0-480.el9.x86_64.rpm 1.5 MB/s | 1.5 MB 00:01 2024-08-01T06:35:39.087 INFO:teuthology.orchestra.run.smithi089.stdout:(2/4): kernel-core-5.14.0-480.el9.x86_64.rpm 12 MB/s | 17 MB 00:01 2024-08-01T06:35:39.829 INFO:teuthology.orchestra.run.smithi089.stdout:(3/4): kernel-modules-5.14.0-480.el9.x86_64.rpm 16 MB/s | 36 MB 00:02 2024-08-01T06:35:41.335 INFO:teuthology.orchestra.run.smithi016.stdout:(2/4): kernel-core-5.14.0-480.el9.x86_64.rpm 4.5 MB/s | 17 MB 00:03 2024-08-01T06:35:41.404 INFO:teuthology.orchestra.run.smithi089.stdout:(4/4): kernel-modules-core-5.14.0-480.el9.x86_6 11 MB/s | 30 MB 00:02 2024-08-01T06:35:41.404 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:35:41.404 INFO:teuthology.orchestra.run.smithi089.stdout:Total 22 MB/s | 84 MB 00:03 2024-08-01T06:35:42.143 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-08-01T06:35:42.493 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-08-01T06:35:42.494 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-08-01T06:35:42.551 INFO:teuthology.orchestra.run.smithi016.stdout:(3/4): kernel-modules-core-5.14.0-480.el9.x86_6 6.8 MB/s | 30 MB 00:04 2024-08-01T06:35:42.943 INFO:teuthology.orchestra.run.smithi016.stdout:(4/4): kernel-modules-5.14.0-480.el9.x86_64.rpm 6.7 MB/s | 36 MB 00:05 2024-08-01T06:35:42.944 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:35:42.944 INFO:teuthology.orchestra.run.smithi016.stdout:Total 15 MB/s | 84 MB 00:05 2024-08-01T06:35:43.488 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-08-01T06:35:43.489 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-08-01T06:35:43.706 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-08-01T06:35:44.129 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-08-01T06:35:44.129 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-08-01T06:35:45.176 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-08-01T06:35:45.176 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-08-01T06:35:45.980 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-08-01T06:35:46.654 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-core-5.14.0-480.el9.x86_64 1/4 2024-08-01T06:35:46.804 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-core-5.14.0-480.el9.x86_64 2/4 2024-08-01T06:35:47.743 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-08-01T06:35:48.453 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-modules-core-5.14.0-480.el9.x86_64 1/4 2024-08-01T06:35:48.560 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-core-5.14.0-480.el9.x86_64 2/4 2024-08-01T06:35:49.455 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-480.el9.x86_64 2/4 2024-08-01T06:35:49.592 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-08-01T06:35:51.359 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-core-5.14.0-480.el9.x86_64 2/4 2024-08-01T06:35:51.531 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-08-01T06:35:54.381 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-08-01T06:35:54.518 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-5.14.0-480.el9.x86_64 4/4 2024-08-01T06:35:56.743 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-08-01T06:35:56.799 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-5.14.0-480.el9.x86_64 4/4 2024-08-01T06:35:59.347 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-core-5.14.0-480.el9.x86_64 4/4 2024-08-01T06:36:02.029 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-modules-core-5.14.0-480.el9.x86_64 4/4 2024-08-01T06:36:29.118 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-480.el9.x86_64 4/4 2024-08-01T06:36:29.158 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-480.el9.x86_64 4/4 2024-08-01T06:36:29.466 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-5.14.0-480.el9.x86_64 4/4 2024-08-01T06:36:29.466 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 1/4 2024-08-01T06:36:29.466 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-core-5.14.0-480.el9.x86_64 2/4 2024-08-01T06:36:29.466 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-08-01T06:36:30.366 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-core-5.14.0-480.el9.x86_64 4/4 2024-08-01T06:36:30.367 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:36:30.367 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-08-01T06:36:30.367 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-5.14.0-480.el9.x86_64 2024-08-01T06:36:30.367 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core-5.14.0-480.el9.x86_64 2024-08-01T06:36:30.367 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-5.14.0-480.el9.x86_64 2024-08-01T06:36:30.367 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core-5.14.0-480.el9.x86_64 2024-08-01T06:36:30.367 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:36:30.367 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:36:30.755 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-08-01T06:36:30.834 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-480.el9.x86_64 2024-08-01T06:36:30.834 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-08-01T06:36:30.834 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-480.el9.x86_64 2024-08-01T06:36:30.834 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-01T06:36:30.834 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-01T06:36:30.835 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-08-01T06:36:30.835 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=None, version=distro) 2024-08-01T06:36:30.835 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-08-01T06:36:30.891 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-480.el9.x86_64 2024-08-01T06:36:30.892 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-08-01T06:36:30.892 DEBUG:teuthology.orchestra.run.smithi089:> sudo rpm -qi grub2-tools 2024-08-01T06:36:30.929 INFO:teuthology.orchestra.run.smithi089.stdout:Name : grub2-tools 2024-08-01T06:36:30.929 INFO:teuthology.orchestra.run.smithi089.stdout:Epoch : 1 2024-08-01T06:36:30.929 INFO:teuthology.orchestra.run.smithi089.stdout:Version : 2.06 2024-08-01T06:36:30.929 INFO:teuthology.orchestra.run.smithi089.stdout:Release : 68.el9 2024-08-01T06:36:30.929 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: x86_64 2024-08-01T06:36:30.929 INFO:teuthology.orchestra.run.smithi089.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-01T06:36:30.929 INFO:teuthology.orchestra.run.smithi089.stdout:Group : Unspecified 2024-08-01T06:36:30.929 INFO:teuthology.orchestra.run.smithi089.stdout:Size : 8264254 2024-08-01T06:36:30.930 INFO:teuthology.orchestra.run.smithi089.stdout:License : GPLv3+ 2024-08-01T06:36:30.930 INFO:teuthology.orchestra.run.smithi089.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-01T06:36:30.930 INFO:teuthology.orchestra.run.smithi089.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-01T06:36:30.930 INFO:teuthology.orchestra.run.smithi089.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-01T06:36:30.930 INFO:teuthology.orchestra.run.smithi089.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-01T06:36:30.930 INFO:teuthology.orchestra.run.smithi089.stdout:Packager : builder@centos.org 2024-08-01T06:36:30.930 INFO:teuthology.orchestra.run.smithi089.stdout:Vendor : CentOS 2024-08-01T06:36:30.930 INFO:teuthology.orchestra.run.smithi089.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-01T06:36:30.930 INFO:teuthology.orchestra.run.smithi089.stdout:Summary : Support tools for GRUB. 2024-08-01T06:36:30.930 INFO:teuthology.orchestra.run.smithi089.stdout:Description : 2024-08-01T06:36:30.930 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:36:30.930 INFO:teuthology.orchestra.run.smithi089.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-01T06:36:30.930 INFO:teuthology.orchestra.run.smithi089.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-01T06:36:30.931 INFO:teuthology.orchestra.run.smithi089.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-01T06:36:30.931 INFO:teuthology.orchestra.run.smithi089.stdout:hardware devices. 2024-08-01T06:36:30.931 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:36:30.931 INFO:teuthology.orchestra.run.smithi089.stdout:This subpackage provides tools for support of all platforms. 2024-08-01T06:36:30.932 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-01T06:36:30.932 INFO:teuthology.task.kernel:Updating grub on smithi089 to boot 5.14.0-480.el9.x86_64 2024-08-01T06:36:30.932 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-01T06:36:31.579 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2024-08-01T06:36:32.904 INFO:teuthology.orchestra.run.smithi089.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-01T06:36:32.929 INFO:teuthology.orchestra.run.smithi089.stderr:done 2024-08-01T06:36:32.935 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-08-01T06:36:32.952 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.KbSfYxgYxE 2024-08-01T06:36:32.952 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.KbSfYxgYxE 2024-08-01T06:36:33.017 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.KbSfYxgYxE 2024-08-01T06:36:33.163 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.KbSfYxgYxE is 6KB 2024-08-01T06:36:33.182 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.KbSfYxgYxE 2024-08-01T06:36:33.196 DEBUG:teuthology.orchestra.run.smithi089:> sudo /bin/ls /boot/loader/entries || true 2024-08-01T06:36:33.258 INFO:teuthology.orchestra.run.smithi089.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-01T06:36:33.258 INFO:teuthology.orchestra.run.smithi089.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-01T06:36:33.258 INFO:teuthology.orchestra.run.smithi089.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-01T06:36:33.258 INFO:teuthology.orchestra.run.smithi089.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-480.el9.x86_64.conf 2024-08-01T06:36:33.259 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-480.el9.x86_64 2024-08-01T06:36:33.364 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-core-5.14.0-480.el9.x86_64 4/4 2024-08-01T06:36:33.399 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2024-08-01T06:36:33.406 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-modules-5.14.0-480.el9.x86_64 4/4 2024-08-01T06:36:33.793 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-5.14.0-480.el9.x86_64 4/4 2024-08-01T06:36:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 1/4 2024-08-01T06:36:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-core-5.14.0-480.el9.x86_64 2/4 2024-08-01T06:36:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-08-01T06:36:34.610 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-modules-core-5.14.0-480.el9.x86_64 4/4 2024-08-01T06:36:34.610 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:36:34.610 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-08-01T06:36:34.611 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-5.14.0-480.el9.x86_64 2024-08-01T06:36:34.611 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-core-5.14.0-480.el9.x86_64 2024-08-01T06:36:34.611 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules-5.14.0-480.el9.x86_64 2024-08-01T06:36:34.611 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules-core-5.14.0-480.el9.x86_64 2024-08-01T06:36:34.611 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:36:34.611 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:36:35.016 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q kernel | sort -rV | head -n 1 2024-08-01T06:36:35.093 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-5.14.0-480.el9.x86_64 2024-08-01T06:36:35.093 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-08-01T06:36:35.094 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-480.el9.x86_64 2024-08-01T06:36:35.094 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-01T06:36:35.094 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-01T06:36:35.094 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-08-01T06:36:35.094 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi016.front.sepia.ceph.com, path=None, version=distro) 2024-08-01T06:36:35.094 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q kernel | sort -rV | head -n 1 2024-08-01T06:36:35.152 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-5.14.0-480.el9.x86_64 2024-08-01T06:36:35.152 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-08-01T06:36:35.152 DEBUG:teuthology.orchestra.run.smithi016:> sudo rpm -qi grub2-tools 2024-08-01T06:36:35.195 INFO:teuthology.orchestra.run.smithi016.stdout:Name : grub2-tools 2024-08-01T06:36:35.195 INFO:teuthology.orchestra.run.smithi016.stdout:Epoch : 1 2024-08-01T06:36:35.195 INFO:teuthology.orchestra.run.smithi016.stdout:Version : 2.06 2024-08-01T06:36:35.195 INFO:teuthology.orchestra.run.smithi016.stdout:Release : 68.el9 2024-08-01T06:36:35.195 INFO:teuthology.orchestra.run.smithi016.stdout:Architecture: x86_64 2024-08-01T06:36:35.195 INFO:teuthology.orchestra.run.smithi016.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-01T06:36:35.195 INFO:teuthology.orchestra.run.smithi016.stdout:Group : Unspecified 2024-08-01T06:36:35.195 INFO:teuthology.orchestra.run.smithi016.stdout:Size : 8264254 2024-08-01T06:36:35.195 INFO:teuthology.orchestra.run.smithi016.stdout:License : GPLv3+ 2024-08-01T06:36:35.195 INFO:teuthology.orchestra.run.smithi016.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-01T06:36:35.196 INFO:teuthology.orchestra.run.smithi016.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-01T06:36:35.196 INFO:teuthology.orchestra.run.smithi016.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-01T06:36:35.196 INFO:teuthology.orchestra.run.smithi016.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-01T06:36:35.196 INFO:teuthology.orchestra.run.smithi016.stdout:Packager : builder@centos.org 2024-08-01T06:36:35.196 INFO:teuthology.orchestra.run.smithi016.stdout:Vendor : CentOS 2024-08-01T06:36:35.196 INFO:teuthology.orchestra.run.smithi016.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-01T06:36:35.196 INFO:teuthology.orchestra.run.smithi016.stdout:Summary : Support tools for GRUB. 2024-08-01T06:36:35.196 INFO:teuthology.orchestra.run.smithi016.stdout:Description : 2024-08-01T06:36:35.196 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:36:35.196 INFO:teuthology.orchestra.run.smithi016.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-01T06:36:35.196 INFO:teuthology.orchestra.run.smithi016.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-01T06:36:35.196 INFO:teuthology.orchestra.run.smithi016.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-01T06:36:35.196 INFO:teuthology.orchestra.run.smithi016.stdout:hardware devices. 2024-08-01T06:36:35.196 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:36:35.196 INFO:teuthology.orchestra.run.smithi016.stdout:This subpackage provides tools for support of all platforms. 2024-08-01T06:36:35.197 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-01T06:36:35.197 INFO:teuthology.task.kernel:Updating grub on smithi016 to boot 5.14.0-480.el9.x86_64 2024-08-01T06:36:35.198 DEBUG:teuthology.orchestra.run.smithi016:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-01T06:36:35.843 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2024-08-01T06:36:37.234 INFO:teuthology.orchestra.run.smithi016.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-01T06:36:37.265 INFO:teuthology.orchestra.run.smithi016.stderr:done 2024-08-01T06:36:37.267 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-08-01T06:36:37.283 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.4w1rPVBf5D 2024-08-01T06:36:37.284 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4w1rPVBf5D 2024-08-01T06:36:37.348 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.4w1rPVBf5D 2024-08-01T06:36:37.493 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.4w1rPVBf5D is 6KB 2024-08-01T06:36:37.542 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.4w1rPVBf5D 2024-08-01T06:36:37.557 DEBUG:teuthology.orchestra.run.smithi016:> sudo /bin/ls /boot/loader/entries || true 2024-08-01T06:36:37.620 INFO:teuthology.orchestra.run.smithi016.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-01T06:36:37.620 INFO:teuthology.orchestra.run.smithi016.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-01T06:36:37.620 INFO:teuthology.orchestra.run.smithi016.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-01T06:36:37.620 INFO:teuthology.orchestra.run.smithi016.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-480.el9.x86_64.conf 2024-08-01T06:36:37.621 DEBUG:teuthology.orchestra.run.smithi016:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-480.el9.x86_64 2024-08-01T06:36:37.764 DEBUG:teuthology.orchestra.run.smithi016:> sudo shutdown -r now 2024-08-01T06:37:03.427 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-08-01T06:37:03.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-08-01T06:37:03.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-01T06:37:07.772 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-08-01T06:37:07.772 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-08-01T06:37:07.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-01T06:37:21.762 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-08-01T06:37:26.110 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-08-01T06:37:30.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-08-01T06:37:30.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-01T06:37:33.826 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-08-01T06:37:35.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-08-01T06:37:35.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-01T06:37:38.175 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-08-01T06:37:45.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-08-01T06:37:45.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-01T06:37:50.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-08-01T06:37:50.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-01T06:38:17.779 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-08-01T06:38:18.309 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-08-01T06:38:18.309 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-480.el9.x86_64"... 2024-08-01T06:38:18.310 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-08-01T06:38:18.324 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-480.el9.x86_64 2024-08-01T06:38:18.324 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-480.el9.x86_64 vs 5.14.0-480.el9.x86_64 2024-08-01T06:38:18.324 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-01T06:38:18.325 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-01T06:38:19.325 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-08-01T06:38:19.325 DEBUG:teuthology.orchestra.run.smithi089:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-01T06:38:19.438 INFO:teuthology.orchestra.run.smithi089.stdout:ttyS1 2024-08-01T06:38:19.506 DEBUG:teuthology.parallel:result is None 2024-08-01T06:38:22.279 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-08-01T06:38:22.830 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-08-01T06:38:22.830 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-480.el9.x86_64"... 2024-08-01T06:38:22.830 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-08-01T06:38:22.876 INFO:teuthology.orchestra.run.smithi016.stdout:5.14.0-480.el9.x86_64 2024-08-01T06:38:22.876 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-480.el9.x86_64 vs 5.14.0-480.el9.x86_64 2024-08-01T06:38:22.876 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-01T06:38:22.876 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-01T06:38:23.877 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-08-01T06:38:23.877 DEBUG:teuthology.orchestra.run.smithi016:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-01T06:38:23.936 INFO:teuthology.orchestra.run.smithi016.stdout:ttyS1 2024-08-01T06:38:24.038 DEBUG:teuthology.parallel:result is None 2024-08-01T06:38:24.039 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-01T06:38:24.047 INFO:teuthology.task.internal:Creating test directory... 2024-08-01T06:38:24.047 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-01T06:38:24.050 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-01T06:38:24.069 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-01T06:38:24.080 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-01T06:38:24.094 INFO:teuthology.task.internal:Creating archive directory... 2024-08-01T06:38:24.094 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-01T06:38:24.107 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-01T06:38:24.238 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-01T06:38:24.250 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-01T06:38:24.299 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-01T06:38:24.304 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-01T06:38:24.330 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-01T06:38:24.340 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-01T06:38:24.348 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-01T06:38:24.360 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-01T06:38:24.362 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-01T06:38:24.376 INFO:teuthology.task.internal:Configuring sudo... 2024-08-01T06:38:24.376 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-01T06:38:24.386 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-01T06:38:24.431 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-01T06:38:24.447 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-01T06:38:24.447 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-01T06:38:24.452 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-01T06:38:24.489 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-01T06:38:24.548 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-01T06:38:24.595 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-01T06:38:24.678 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-01T06:38:24.719 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-08-01T06:38:24.719 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-01T06:38:24.785 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-01T06:38:24.830 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-01T06:38:24.879 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-01T06:38:24.960 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-01T06:38:25.005 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-01T06:38:25.005 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-01T06:38:25.072 DEBUG:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2024-08-01T06:38:25.074 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2024-08-01T06:38:25.109 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-01T06:38:25.157 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-01T06:38:25.672 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-01T06:38:25.679 INFO:teuthology.task.internal:Starting timer... 2024-08-01T06:38:25.679 INFO:teuthology.run_tasks:Running task pcp... 2024-08-01T06:38:25.702 INFO:teuthology.run_tasks:Running task selinux... 2024-08-01T06:38:25.711 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-08-01T06:38:25.712 DEBUG:teuthology.orchestra.run.smithi016:> sudo service auditd rotate 2024-08-01T06:38:25.766 INFO:teuthology.orchestra.run.smithi016.stdout:Rotating logs: 2024-08-01T06:38:25.768 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2024-08-01T06:38:25.836 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2024-08-01T06:38:25.838 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-01T06:38:25.838 DEBUG:teuthology.orchestra.run.smithi016:> /usr/sbin/getenforce 2024-08-01T06:38:25.864 INFO:teuthology.orchestra.run.smithi016.stdout:Permissive 2024-08-01T06:38:25.865 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2024-08-01T06:38:25.889 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2024-08-01T06:38:25.889 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi016.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi089.front.sepia.ceph.com': 'permissive'} 2024-08-01T06:38:25.890 DEBUG:teuthology.orchestra.run.smithi016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-01T06:38:25.931 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-01T06:38:25.932 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-01T06:38:25.958 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-01T06:38:25.959 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-01T06:38:25.959 DEBUG:teuthology.orchestra.run.smithi016:> sudo /usr/sbin/setenforce permissive 2024-08-01T06:38:25.998 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2024-08-01T06:38:26.034 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-01T06:38:26.044 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-01T06:38:26.057 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-01T06:38:26.058 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi016.front.sepia.ceph.com,smithi089.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-01T06:43:13.411 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi089.front.sepia.ceph.com')] 2024-08-01T06:43:13.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-08-01T06:43:13.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-01T06:43:13.493 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-08-01T06:43:13.571 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-08-01T06:43:13.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-08-01T06:43:13.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-01T06:43:13.653 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-08-01T06:43:13.731 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-08-01T06:43:13.732 INFO:teuthology.run_tasks:Running task clock... 2024-08-01T06:43:13.742 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-01T06:43:13.742 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-01T06:43:13.743 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-01T06:43:13.745 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-01T06:43:13.745 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-01T06:43:13.774 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-01T06:43:13.789 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-01T06:43:13.804 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-01T06:43:13.815 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: ntpd: command not found 2024-08-01T06:43:13.819 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-01T06:43:13.826 INFO:teuthology.orchestra.run.smithi016.stdout:506 Cannot talk to daemon 2024-08-01T06:43:13.841 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-01T06:43:13.844 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2024-08-01T06:43:13.856 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-01T06:43:13.856 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2024-08-01T06:43:13.870 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-01T06:43:13.884 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-01T06:43:13.914 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: ntpq: command not found 2024-08-01T06:43:13.917 INFO:teuthology.orchestra.run.smithi016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-01T06:43:13.917 INFO:teuthology.orchestra.run.smithi016.stdout:=============================================================================== 2024-08-01T06:43:13.917 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-01T06:43:13.917 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-01T06:43:13.917 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-01T06:43:13.917 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-01T06:43:13.941 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-08-01T06:43:13.944 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-01T06:43:13.944 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-08-01T06:43:13.944 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-01T06:43:13.944 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-01T06:43:13.944 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-01T06:43:13.944 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-01T06:43:13.945 INFO:teuthology.run_tasks:Running task install... 2024-08-01T06:43:13.953 DEBUG:teuthology.task.install:project ceph 2024-08-01T06:43:13.954 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f9911e17b12222fbe598fff73cd3ad10d20c5776'}} 2024-08-01T06:43:13.954 DEBUG:teuthology.task.install:config {'branch': 'reef', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'f9911e17b12222fbe598fff73cd3ad10d20c5776'} 2024-08-01T06:43:13.954 INFO:teuthology.task.install:Using flavor: default 2024-08-01T06:43:13.960 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-01T06:43:13.960 INFO:teuthology.task.install:extra packages: [] 2024-08-01T06:43:13.960 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f9911e17b12222fbe598fff73cd3ad10d20c5776', 'tag': None, 'wait_for_package': False} 2024-08-01T06:43:13.960 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-01T06:43:13.961 INFO:teuthology.packaging:ref: None 2024-08-01T06:43:13.961 INFO:teuthology.packaging:tag: None 2024-08-01T06:43:13.961 INFO:teuthology.packaging:branch: reef 2024-08-01T06:43:13.961 INFO:teuthology.packaging:sha1: f9911e17b12222fbe598fff73cd3ad10d20c5776 2024-08-01T06:43:13.961 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-08-01T06:43:13.963 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f9911e17b12222fbe598fff73cd3ad10d20c5776', 'tag': None, 'wait_for_package': False} 2024-08-01T06:43:13.963 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-01T06:43:13.963 INFO:teuthology.packaging:ref: None 2024-08-01T06:43:13.963 INFO:teuthology.packaging:tag: None 2024-08-01T06:43:13.963 INFO:teuthology.packaging:branch: reef 2024-08-01T06:43:13.964 INFO:teuthology.packaging:sha1: f9911e17b12222fbe598fff73cd3ad10d20c5776 2024-08-01T06:43:13.964 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-08-01T06:43:14.191 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/a3bbd7289877bdcce87fd1f79da1a2d6578dde36/centos/9/flavors/default/ 2024-08-01T06:43:14.192 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1767.ga3bbd728 2024-08-01T06:43:14.225 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/a3bbd7289877bdcce87fd1f79da1a2d6578dde36/centos/9/flavors/default/ 2024-08-01T06:43:14.226 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1767.ga3bbd728 2024-08-01T06:43:14.306 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/a3bbd7289877bdcce87fd1f79da1a2d6578dde36/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/a3bbd7289877bdcce87fd1f79da1a2d6578dde36/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/a3bbd7289877bdcce87fd1f79da1a2d6578dde36/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-01T06:43:14.306 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-01T06:43:14.306 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-01T06:43:14.331 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-08-01T06:43:14.331 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-01T06:43:14.331 INFO:teuthology.packaging:ref: None 2024-08-01T06:43:14.332 INFO:teuthology.packaging:tag: None 2024-08-01T06:43:14.332 INFO:teuthology.packaging:branch: reef 2024-08-01T06:43:14.332 INFO:teuthology.packaging:sha1: f9911e17b12222fbe598fff73cd3ad10d20c5776 2024-08-01T06:43:14.332 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-01T06:43:14.344 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/a3bbd7289877bdcce87fd1f79da1a2d6578dde36/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/a3bbd7289877bdcce87fd1f79da1a2d6578dde36/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/a3bbd7289877bdcce87fd1f79da1a2d6578dde36/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-01T06:43:14.344 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-08-01T06:43:14.344 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-01T06:43:14.372 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-08-01T06:43:14.372 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-01T06:43:14.372 INFO:teuthology.packaging:ref: None 2024-08-01T06:43:14.372 INFO:teuthology.packaging:tag: None 2024-08-01T06:43:14.372 INFO:teuthology.packaging:branch: reef 2024-08-01T06:43:14.372 INFO:teuthology.packaging:sha1: f9911e17b12222fbe598fff73cd3ad10d20c5776 2024-08-01T06:43:14.372 DEBUG:teuthology.orchestra.run.smithi016:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-01T06:43:14.398 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-01T06:43:14.440 DEBUG:teuthology.orchestra.run.smithi016:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-01T06:43:14.473 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-01T06:43:14.517 DEBUG:teuthology.orchestra.run.smithi016:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-01T06:43:14.538 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2024-08-01T06:43:14.540 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2024-08-01T06:43:14.582 INFO:teuthology.orchestra.run.smithi016.stdout:check_obsoletes = 1 2024-08-01T06:43:14.587 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum clean all 2024-08-01T06:43:14.765 INFO:teuthology.orchestra.run.smithi089.stdout:45 files removed 2024-08-01T06:43:14.794 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw 2024-08-01T06:43:14.829 INFO:teuthology.orchestra.run.smithi016.stdout:45 files removed 2024-08-01T06:43:14.856 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-radosgw 2024-08-01T06:43:15.395 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 240 kB/s | 77 kB 00:00 2024-08-01T06:43:15.464 INFO:teuthology.orchestra.run.smithi016.stdout:ceph packages for x86_64 246 kB/s | 77 kB 00:00 2024-08-01T06:43:15.720 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 42 kB/s | 11 kB 00:00 2024-08-01T06:43:15.806 INFO:teuthology.orchestra.run.smithi016.stdout:ceph noarch packages 39 kB/s | 11 kB 00:00 2024-08-01T06:43:16.054 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 6.5 kB/s | 1.9 kB 00:00 2024-08-01T06:43:16.115 INFO:teuthology.orchestra.run.smithi016.stdout:ceph source packages 7.2 kB/s | 1.9 kB 00:00 2024-08-01T06:43:17.618 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.2 MB 00:01 2024-08-01T06:43:17.640 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.2 MB 00:01 2024-08-01T06:43:25.688 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 2.9 MB/s | 20 MB 00:06 2024-08-01T06:43:26.891 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - AppStream 2.5 MB/s | 20 MB 00:08 2024-08-01T06:43:29.989 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.6 MB 00:00 2024-08-01T06:43:31.362 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.6 MB 00:00 2024-08-01T06:43:31.873 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 18 kB 00:00 2024-08-01T06:43:32.719 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 31 MB/s | 22 MB 00:00 2024-08-01T06:43:33.185 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 18 kB 00:00 2024-08-01T06:43:34.097 INFO:teuthology.orchestra.run.smithi016.stdout:Extra Packages for Enterprise Linux 29 MB/s | 22 MB 00:00 2024-08-01T06:43:38.083 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-08-01T06:43:39.711 INFO:teuthology.orchestra.run.smithi016.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-08-01T06:43:40.486 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:43:40.501 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:43:40.501 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-08-01T06:43:40.502 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:43:40.502 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-08-01T06:43:40.502 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 7.7 M 2024-08-01T06:43:40.502 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2024-08-01T06:43:40.502 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 3.3 M 2024-08-01T06:43:40.502 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 3.0 M 2024-08-01T06:43:40.502 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-08-01T06:43:40.502 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-01T06:43:40.502 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 5.1 M 2024-08-01T06:43:40.502 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 18 M 2024-08-01T06:43:40.503 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 25 k 2024-08-01T06:43:40.503 INFO:teuthology.orchestra.run.smithi089.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-08-01T06:43:40.503 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-01T06:43:40.503 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-01T06:43:40.503 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-01T06:43:40.503 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 711 k 2024-08-01T06:43:40.503 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-01T06:43:40.503 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-01T06:43:40.503 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-01T06:43:40.503 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 477 k 2024-08-01T06:43:40.503 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-01T06:43:40.503 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 4.5 M 2024-08-01T06:43:40.504 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-01T06:43:40.504 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-01T06:43:40.504 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-01T06:43:40.504 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 45 k 2024-08-01T06:43:40.504 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 129 k 2024-08-01T06:43:40.504 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 188 k 2024-08-01T06:43:40.504 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-01T06:43:40.504 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 369 k 2024-08-01T06:43:40.504 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 348 k 2024-08-01T06:43:40.504 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 116 k 2024-08-01T06:43:40.504 INFO:teuthology.orchestra.run.smithi089.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-01T06:43:40.504 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-01T06:43:40.504 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:43:40.505 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-08-01T06:43:40.505 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:43:40.505 INFO:teuthology.orchestra.run.smithi089.stdout:Install 28 Packages 2024-08-01T06:43:40.505 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 2 Packages 2024-08-01T06:43:40.505 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:43:40.505 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 53 M 2024-08-01T06:43:40.505 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-08-01T06:43:41.101 INFO:teuthology.orchestra.run.smithi089.stdout:(1/30): ceph-base-18.2.2-1767.ga3bbd728.el9.x86 11 MB/s | 5.1 MB 00:00 2024-08-01T06:43:41.159 INFO:teuthology.orchestra.run.smithi089.stdout:(2/30): ceph-selinux-18.2.2-1767.ga3bbd728.el9. 434 kB/s | 25 kB 00:00 2024-08-01T06:43:41.268 INFO:teuthology.orchestra.run.smithi089.stdout:(3/30): libcephfs2-18.2.2-1767.ga3bbd728.el9.x8 6.4 MB/s | 711 kB 00:00 2024-08-01T06:43:41.377 INFO:teuthology.orchestra.run.smithi089.stdout:(4/30): ceph-radosgw-18.2.2-1767.ga3bbd728.el9. 10 MB/s | 7.7 MB 00:00 2024-08-01T06:43:41.402 INFO:teuthology.orchestra.run.smithi089.stdout:(5/30): libradosstriper1-18.2.2-1767.ga3bbd728. 3.5 MB/s | 477 kB 00:00 2024-08-01T06:43:41.469 INFO:teuthology.orchestra.run.smithi089.stdout:(6/30): python3-ceph-argparse-18.2.2-1767.ga3bb 675 kB/s | 45 kB 00:00 2024-08-01T06:43:41.545 INFO:teuthology.orchestra.run.smithi089.stdout:(7/30): python3-ceph-common-18.2.2-1767.ga3bbd7 1.7 MB/s | 129 kB 00:00 2024-08-01T06:43:41.611 INFO:teuthology.orchestra.run.smithi089.stdout:(8/30): librgw2-18.2.2-1767.ga3bbd728.el9.x86_6 19 MB/s | 4.5 MB 00:00 2024-08-01T06:43:41.636 INFO:teuthology.orchestra.run.smithi089.stdout:(9/30): python3-cephfs-18.2.2-1767.ga3bbd728.el 2.0 MB/s | 188 kB 00:00 2024-08-01T06:43:41.662 INFO:teuthology.orchestra.run.smithi089.stdout:(10/30): python3-rados-18.2.2-1767.ga3bbd728.el 7.2 MB/s | 369 kB 00:00 2024-08-01T06:43:41.687 INFO:teuthology.orchestra.run.smithi089.stdout:(11/30): python3-rbd-18.2.2-1767.ga3bbd728.el9. 6.8 MB/s | 348 kB 00:00 2024-08-01T06:43:41.712 INFO:teuthology.orchestra.run.smithi089.stdout:(12/30): python3-rgw-18.2.2-1767.ga3bbd728.el9. 2.3 MB/s | 116 kB 00:00 2024-08-01T06:43:41.896 INFO:teuthology.orchestra.run.smithi089.stdout:(13/30): ceph-common-18.2.2-1767.ga3bbd728.el9. 15 MB/s | 18 MB 00:01 2024-08-01T06:43:42.163 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:43:42.176 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:43:42.176 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-08-01T06:43:42.176 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:43:42.176 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-08-01T06:43:42.176 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 7.7 M 2024-08-01T06:43:42.176 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrading: 2024-08-01T06:43:42.176 INFO:teuthology.orchestra.run.smithi016.stdout: librados2 x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 3.3 M 2024-08-01T06:43:42.176 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1 x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 3.0 M 2024-08-01T06:43:42.176 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-08-01T06:43:42.176 INFO:teuthology.orchestra.run.smithi016.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-01T06:43:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 5.1 M 2024-08-01T06:43:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 18 M 2024-08-01T06:43:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 25 k 2024-08-01T06:43:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-08-01T06:43:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-01T06:43:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-01T06:43:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-01T06:43:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2 x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 711 k 2024-08-01T06:43:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-01T06:43:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-01T06:43:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-01T06:43:42.177 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1 x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 477 k 2024-08-01T06:43:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-01T06:43:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2 x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 4.5 M 2024-08-01T06:43:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-01T06:43:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-01T06:43:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-01T06:43:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 45 k 2024-08-01T06:43:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 129 k 2024-08-01T06:43:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cephfs x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 188 k 2024-08-01T06:43:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-01T06:43:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 369 k 2024-08-01T06:43:42.178 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rbd x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 348 k 2024-08-01T06:43:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rgw x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 116 k 2024-08-01T06:43:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-01T06:43:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-01T06:43:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:43:42.179 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-08-01T06:43:42.179 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:43:42.179 INFO:teuthology.orchestra.run.smithi016.stdout:Install 28 Packages 2024-08-01T06:43:42.179 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrade 2 Packages 2024-08-01T06:43:42.179 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:43:42.180 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 53 M 2024-08-01T06:43:42.180 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-08-01T06:43:42.496 INFO:teuthology.orchestra.run.smithi089.stdout:(14/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 75 kB/s | 45 kB 00:00 2024-08-01T06:43:42.521 INFO:teuthology.orchestra.run.smithi089.stdout:(15/30): boost-program-options-1.75.0-8.el9.x86 128 kB/s | 107 kB 00:00 2024-08-01T06:43:42.580 INFO:teuthology.orchestra.run.smithi089.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 185 kB/s | 160 kB 00:00 2024-08-01T06:43:42.947 INFO:teuthology.orchestra.run.smithi016.stdout:(1/30): ceph-base-18.2.2-1767.ga3bbd728.el9.x86 11 MB/s | 5.1 MB 00:00 2024-08-01T06:43:42.996 INFO:teuthology.orchestra.run.smithi016.stdout:(2/30): ceph-selinux-18.2.2-1767.ga3bbd728.el9. 506 kB/s | 25 kB 00:00 2024-08-01T06:43:43.088 INFO:teuthology.orchestra.run.smithi016.stdout:(3/30): libcephfs2-18.2.2-1767.ga3bbd728.el9.x8 7.6 MB/s | 711 kB 00:00 2024-08-01T06:43:43.172 INFO:teuthology.orchestra.run.smithi089.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 71 kB/s | 42 kB 00:00 2024-08-01T06:43:43.180 INFO:teuthology.orchestra.run.smithi016.stdout:(4/30): libradosstriper1-18.2.2-1767.ga3bbd728. 5.1 MB/s | 477 kB 00:00 2024-08-01T06:43:43.239 INFO:teuthology.orchestra.run.smithi089.stdout:(18/30): fmt-8.1.1-5.el9.x86_64.rpm 1.6 MB/s | 111 kB 00:00 2024-08-01T06:43:43.273 INFO:teuthology.orchestra.run.smithi089.stdout:(19/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 9.1 MB/s | 309 kB 00:00 2024-08-01T06:43:43.314 INFO:teuthology.orchestra.run.smithi016.stdout:(5/30): ceph-radosgw-18.2.2-1767.ga3bbd728.el9. 9.1 MB/s | 7.7 MB 00:00 2024-08-01T06:43:43.381 INFO:teuthology.orchestra.run.smithi089.stdout:(20/30): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-08-01T06:43:43.406 INFO:teuthology.orchestra.run.smithi089.stdout:(21/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 330 kB/s | 292 kB 00:00 2024-08-01T06:43:43.423 INFO:teuthology.orchestra.run.smithi089.stdout:(22/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 618 kB/s | 26 kB 00:00 2024-08-01T06:43:43.482 INFO:teuthology.orchestra.run.smithi089.stdout:(23/30): librdkafka-1.6.1-102.el9.x86_64.rpm 672 kB/s | 662 kB 00:00 2024-08-01T06:43:43.507 INFO:teuthology.orchestra.run.smithi089.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-08-01T06:43:43.522 INFO:teuthology.orchestra.run.smithi016.stdout:(6/30): ceph-common-18.2.2-1767.ga3bbd728.el9.x 17 MB/s | 18 MB 00:01 2024-08-01T06:43:43.548 INFO:teuthology.orchestra.run.smithi016.stdout:(7/30): python3-ceph-argparse-18.2.2-1767.ga3bb 193 kB/s | 45 kB 00:00 2024-08-01T06:43:43.549 INFO:teuthology.orchestra.run.smithi089.stdout:(25/30): liboath-2.6.7-2.el9.x86_64.rpm 341 kB/s | 49 kB 00:00 2024-08-01T06:43:43.573 INFO:teuthology.orchestra.run.smithi016.stdout:(8/30): python3-ceph-common-18.2.2-1767.ga3bbd7 2.5 MB/s | 129 kB 00:00 2024-08-01T06:43:43.583 INFO:teuthology.orchestra.run.smithi089.stdout:(26/30): re2-20211101-3.el9.x86_64.rpm 2.6 MB/s | 192 kB 00:00 2024-08-01T06:43:43.598 INFO:teuthology.orchestra.run.smithi016.stdout:(9/30): python3-cephfs-18.2.2-1767.ga3bbd728.el 3.7 MB/s | 188 kB 00:00 2024-08-01T06:43:43.623 INFO:teuthology.orchestra.run.smithi016.stdout:(10/30): python3-rados-18.2.2-1767.ga3bbd728.el 7.2 MB/s | 369 kB 00:00 2024-08-01T06:43:43.624 INFO:teuthology.orchestra.run.smithi089.stdout:(27/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.1 MB/s | 839 kB 00:00 2024-08-01T06:43:43.649 INFO:teuthology.orchestra.run.smithi016.stdout:(11/30): python3-rbd-18.2.2-1767.ga3bbd728.el9. 6.8 MB/s | 348 kB 00:00 2024-08-01T06:43:43.666 INFO:teuthology.orchestra.run.smithi089.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-08-01T06:43:43.674 INFO:teuthology.orchestra.run.smithi016.stdout:(12/30): python3-rgw-18.2.2-1767.ga3bbd728.el9. 2.3 MB/s | 116 kB 00:00 2024-08-01T06:43:43.749 INFO:teuthology.orchestra.run.smithi016.stdout:(13/30): librgw2-18.2.2-1767.ga3bbd728.el9.x86_ 7.8 MB/s | 4.5 MB 00:00 2024-08-01T06:43:43.850 INFO:teuthology.orchestra.run.smithi016.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 533 kB/s | 107 kB 00:00 2024-08-01T06:43:43.875 INFO:teuthology.orchestra.run.smithi016.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 361 kB/s | 45 kB 00:00 2024-08-01T06:43:43.883 INFO:teuthology.orchestra.run.smithi089.stdout:(29/30): librados2-18.2.2-1767.ga3bbd728.el9.x8 11 MB/s | 3.3 MB 00:00 2024-08-01T06:43:43.900 INFO:teuthology.orchestra.run.smithi016.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 710 kB/s | 160 kB 00:00 2024-08-01T06:43:43.934 INFO:teuthology.orchestra.run.smithi089.stdout:(30/30): librbd1-18.2.2-1767.ga3bbd728.el9.x86_ 9.7 MB/s | 3.0 MB 00:00 2024-08-01T06:43:43.939 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:43:43.939 INFO:teuthology.orchestra.run.smithi089.stdout:Total 15 MB/s | 53 MB 00:03 2024-08-01T06:43:43.950 INFO:teuthology.orchestra.run.smithi016.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 845 kB/s | 42 kB 00:00 2024-08-01T06:43:44.007 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-08-01T06:43:44.009 INFO:teuthology.orchestra.run.smithi016.stdout:(18/30): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-08-01T06:43:44.034 INFO:teuthology.orchestra.run.smithi016.stdout:(19/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-08-01T06:43:44.042 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-08-01T06:43:44.042 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-08-01T06:43:44.085 INFO:teuthology.orchestra.run.smithi016.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 826 kB/s | 111 kB 00:00 2024-08-01T06:43:44.135 INFO:teuthology.orchestra.run.smithi016.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.2 MB/s | 26 kB 00:00 2024-08-01T06:43:44.160 INFO:teuthology.orchestra.run.smithi016.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-08-01T06:43:44.185 INFO:teuthology.orchestra.run.smithi016.stdout:(23/30): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-01T06:43:44.211 INFO:teuthology.orchestra.run.smithi016.stdout:(24/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.5 MB/s | 309 kB 00:00 2024-08-01T06:43:44.244 INFO:teuthology.orchestra.run.smithi016.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 5.6 MB/s | 192 kB 00:00 2024-08-01T06:43:44.278 INFO:teuthology.orchestra.run.smithi016.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-08-01T06:43:44.328 INFO:teuthology.orchestra.run.smithi016.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-08-01T06:43:44.412 INFO:teuthology.orchestra.run.smithi016.stdout:(28/30): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-08-01T06:43:44.479 INFO:teuthology.orchestra.run.smithi016.stdout:(29/30): librados2-18.2.2-1767.ga3bbd728.el9.x8 16 MB/s | 3.3 MB 00:00 2024-08-01T06:43:44.537 INFO:teuthology.orchestra.run.smithi016.stdout:(30/30): librbd1-18.2.2-1767.ga3bbd728.el9.x86_ 14 MB/s | 3.0 MB 00:00 2024-08-01T06:43:44.542 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:43:44.542 INFO:teuthology.orchestra.run.smithi016.stdout:Total 22 MB/s | 53 MB 00:02 2024-08-01T06:43:44.588 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-08-01T06:43:44.588 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-08-01T06:43:44.611 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-08-01T06:43:44.650 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-08-01T06:43:44.650 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-08-01T06:43:45.196 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-08-01T06:43:45.196 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-08-01T06:43:45.934 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-08-01T06:43:46.026 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-08-01T06:43:46.064 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-08-01T06:43:46.123 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-08-01T06:43:46.509 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-08-01T06:43:46.563 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:18.2.2-1767.ga3bbd728.el9.x86_64 5/32 2024-08-01T06:43:46.576 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-08-01T06:43:46.642 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:18.2.2-1767.ga3bbd728.el9.x86_64 5/32 2024-08-01T06:43:46.658 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-08-01T06:43:46.693 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-08-01T06:43:46.739 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:18.2.2-1767.ga3bbd728.el9.x86_64 6/32 2024-08-01T06:43:46.749 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-08-01T06:43:46.764 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:18.2.2-1767.ga3bbd728.el9.x86_64 7/32 2024-08-01T06:43:46.827 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:18.2.2-1767.ga3bbd728.el9.x86_64 7/32 2024-08-01T06:43:46.856 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-08-01T06:43:46.901 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:18.2.2-1767.ga3bbd728.el9. 9/32 2024-08-01T06:43:46.957 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:18.2.2-1767.ga3bbd728.el9.x86_64 10/32 2024-08-01T06:43:46.984 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:18.2.2-1767.ga3bbd728.el9.x86_6 11/32 2024-08-01T06:43:47.033 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1767.ga3bbd728.el9.x86_6 11/32 2024-08-01T06:43:47.109 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-08-01T06:43:47.140 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-08-01T06:43:47.174 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-08-01T06:43:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : librados2-2:18.2.2-1767.ga3bbd728.el9.x86_64 5/32 2024-08-01T06:43:47.215 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-08-01T06:43:47.247 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-08-01T06:43:47.275 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-08-01T06:43:47.297 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados2-2:18.2.2-1767.ga3bbd728.el9.x86_64 5/32 2024-08-01T06:43:47.311 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-08-01T06:43:47.343 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-08-01T06:43:47.430 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rados-2:18.2.2-1767.ga3bbd728.el9.x86_64 6/32 2024-08-01T06:43:47.460 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephfs2-2:18.2.2-1767.ga3bbd728.el9.x86_64 7/32 2024-08-01T06:43:47.506 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephfs2-2:18.2.2-1767.ga3bbd728.el9.x86_64 7/32 2024-08-01T06:43:47.535 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-08-01T06:43:47.573 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ceph-argparse-2:18.2.2-1767.ga3bbd728.el9. 9/32 2024-08-01T06:43:47.633 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-08-01T06:43:47.637 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cephfs-2:18.2.2-1767.ga3bbd728.el9.x86_64 10/32 2024-08-01T06:43:47.671 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libradosstriper1-2:18.2.2-1767.ga3bbd728.el9.x86_6 11/32 2024-08-01T06:43:47.681 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:18.2.2-1767.ga3bbd728.el9.x86_64 20/32 2024-08-01T06:43:47.737 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1767.ga3bbd728.el9.x86_6 11/32 2024-08-01T06:43:47.758 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:18.2.2-1767.ga3bbd728.el9.x86_64 20/32 2024-08-01T06:43:47.786 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:18.2.2-1767.ga3bbd728.el9.x86_64 21/32 2024-08-01T06:43:47.822 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-08-01T06:43:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-08-01T06:43:47.886 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-08-01T06:43:47.928 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-08-01T06:43:47.960 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-08-01T06:43:47.987 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-08-01T06:43:48.023 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-08-01T06:43:48.056 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-08-01T06:43:48.221 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-08-01T06:43:48.251 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:18.2.2-1767.ga3bbd728.el9.x86_64 24/32 2024-08-01T06:43:48.307 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:18.2.2-1767.ga3bbd728.el9.x86_64 24/32 2024-08-01T06:43:48.371 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-08-01T06:43:48.382 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:18.2.2-1767.ga3bbd728.el9.x86_64 25/32 2024-08-01T06:43:48.411 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : librbd1-2:18.2.2-1767.ga3bbd728.el9.x86_64 20/32 2024-08-01T06:43:48.411 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:18.2.2-1767.ga3bbd728.el9.x8 26/32 2024-08-01T06:43:48.497 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librbd1-2:18.2.2-1767.ga3bbd728.el9.x86_64 20/32 2024-08-01T06:43:48.524 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rbd-2:18.2.2-1767.ga3bbd728.el9.x86_64 21/32 2024-08-01T06:43:48.568 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-08-01T06:43:48.990 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-08-01T06:43:49.021 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librgw2-2:18.2.2-1767.ga3bbd728.el9.x86_64 24/32 2024-08-01T06:43:49.087 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librgw2-2:18.2.2-1767.ga3bbd728.el9.x86_64 24/32 2024-08-01T06:43:49.164 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rgw-2:18.2.2-1767.ga3bbd728.el9.x86_64 25/32 2024-08-01T06:43:49.191 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ceph-common-2:18.2.2-1767.ga3bbd728.el9.x8 26/32 2024-08-01T06:43:50.469 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.2.2-1767.ga3bbd728.el9.x86_64 27/32 2024-08-01T06:43:50.509 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:18.2.2-1767.ga3bbd728.el9.x86_64 27/32 2024-08-01T06:43:51.034 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.2.2-1767.ga3bbd728.el9.x86_64 27/32 2024-08-01T06:43:51.080 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:18.2.2-1767.ga3bbd728.el9.x86_64 28/32 2024-08-01T06:43:51.178 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:18.2.2-1767.ga3bbd728.el9.x86_64 28/32 2024-08-01T06:43:51.178 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-01T06:43:51.178 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-01T06:43:51.178 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:43:51.214 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:18.2.2-1767.ga3bbd728.el9.x86_64 29/32 2024-08-01T06:43:51.361 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-common-2:18.2.2-1767.ga3bbd728.el9.x86_64 27/32 2024-08-01T06:43:51.399 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-common-2:18.2.2-1767.ga3bbd728.el9.x86_64 27/32 2024-08-01T06:43:51.957 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-common-2:18.2.2-1767.ga3bbd728.el9.x86_64 27/32 2024-08-01T06:43:52.011 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-base-2:18.2.2-1767.ga3bbd728.el9.x86_64 28/32 2024-08-01T06:43:52.116 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-base-2:18.2.2-1767.ga3bbd728.el9.x86_64 28/32 2024-08-01T06:43:52.116 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-01T06:43:52.116 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-01T06:43:52.117 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:43:52.146 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-selinux-2:18.2.2-1767.ga3bbd728.el9.x86_64 29/32 2024-08-01T06:44:00.865 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1767.ga3bbd728.el9.x86_64 29/32 2024-08-01T06:44:00.865 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2024-08-01T06:44:00.865 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2024-08-01T06:44:00.865 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2024-08-01T06:44:00.865 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2024-08-01T06:44:00.866 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2024-08-01T06:44:00.866 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /root 2024-08-01T06:44:00.866 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2024-08-01T06:44:00.866 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:01.607 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:18.2.2-1767.ga3bbd728.el9.x86_64 30/32 2024-08-01T06:44:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1767.ga3bbd728.el9.x86_64 30/32 2024-08-01T06:44:01.633 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-01T06:44:01.633 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-01T06:44:01.633 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-01T06:44:01.633 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-01T06:44:01.633 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:01.636 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-08-01T06:44:01.711 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-08-01T06:44:01.711 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-08-01T06:44:02.331 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1767.ga3bbd728.el9.x86_64 29/32 2024-08-01T06:44:02.332 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /sys 2024-08-01T06:44:02.332 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /proc 2024-08-01T06:44:02.332 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /mnt 2024-08-01T06:44:02.332 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /var/tmp 2024-08-01T06:44:02.332 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /home 2024-08-01T06:44:02.332 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /root 2024-08-01T06:44:02.332 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /tmp 2024-08-01T06:44:02.332 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:02.812 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-08-01T06:44:02.812 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/32 2024-08-01T06:44:02.812 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:18.2.2-1767.ga3bbd728.el9.x86_64 2/32 2024-08-01T06:44:02.812 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:18.2.2-1767.ga3bbd728.el9.x86_64 3/32 2024-08-01T06:44:02.812 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:18.2.2-1767.ga3bbd728.el9.x86_64 4/32 2024-08-01T06:44:02.812 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:18.2.2-1767.ga3bbd728.el9.x86_64 5/32 2024-08-01T06:44:02.812 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:18.2.2-1767.ga3bbd728.el9.x86_6 6/32 2024-08-01T06:44:02.812 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:18.2.2-1767.ga3bbd728.el9.x86_64 7/32 2024-08-01T06:44:02.812 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1767.ga3bbd728.el9. 8/32 2024-08-01T06:44:02.813 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:18.2.2-1767.ga3bbd728.el9.x8 9/32 2024-08-01T06:44:02.813 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:18.2.2-1767.ga3bbd728.el9.x86_64 10/32 2024-08-01T06:44:02.813 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:18.2.2-1767.ga3bbd728.el9.x86_64 11/32 2024-08-01T06:44:02.813 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:18.2.2-1767.ga3bbd728.el9.x86_64 12/32 2024-08-01T06:44:02.813 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:18.2.2-1767.ga3bbd728.el9.x86_64 13/32 2024-08-01T06:44:02.813 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-08-01T06:44:02.813 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-08-01T06:44:02.813 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-08-01T06:44:02.813 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-08-01T06:44:02.813 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-08-01T06:44:02.814 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-08-01T06:44:02.814 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-08-01T06:44:02.814 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-08-01T06:44:02.814 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-08-01T06:44:02.814 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-08-01T06:44:02.814 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-08-01T06:44:02.814 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-08-01T06:44:02.814 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-08-01T06:44:02.814 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-08-01T06:44:02.814 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-08-01T06:44:02.814 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:18.2.2-1767.ga3bbd728.el9.x86_64 29/32 2024-08-01T06:44:02.815 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-08-01T06:44:02.815 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:18.2.2-1767.ga3bbd728.el9.x86_64 31/32 2024-08-01T06:44:03.107 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-radosgw-2:18.2.2-1767.ga3bbd728.el9.x86_64 30/32 2024-08-01T06:44:03.139 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1767.ga3bbd728.el9.x86_64 30/32 2024-08-01T06:44:03.139 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-01T06:44:03.139 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-01T06:44:03.140 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-01T06:44:03.140 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-01T06:44:03.140 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:03.141 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-08-01T06:44:03.226 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-08-01T06:44:03.226 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-08-01T06:44:03.581 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-08-01T06:44:03.581 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:03.581 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2024-08-01T06:44:03.581 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:03.582 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:03.582 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-08-01T06:44:03.582 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-01T06:44:03.582 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:03.582 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:03.582 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:03.582 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:03.582 INFO:teuthology.orchestra.run.smithi089.stdout: fmt-8.1.1-5.el9.x86_64 2024-08-01T06:44:03.582 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-01T06:44:03.582 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-01T06:44:03.582 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-01T06:44:03.582 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:03.583 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-01T06:44:03.583 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-01T06:44:03.583 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-01T06:44:03.583 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:03.583 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-01T06:44:03.583 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:03.583 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-01T06:44:03.583 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-01T06:44:03.583 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-01T06:44:03.583 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:03.583 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:03.583 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:03.583 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-01T06:44:03.584 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:03.584 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:03.584 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:03.584 INFO:teuthology.orchestra.run.smithi089.stdout: re2-1:20211101-3.el9.x86_64 2024-08-01T06:44:03.584 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-01T06:44:03.584 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:03.584 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:44:03.963 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-test 2024-08-01T06:44:04.397 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-08-01T06:44:04.397 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-base-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/32 2024-08-01T06:44:04.397 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-common-2:18.2.2-1767.ga3bbd728.el9.x86_64 2/32 2024-08-01T06:44:04.397 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-radosgw-2:18.2.2-1767.ga3bbd728.el9.x86_64 3/32 2024-08-01T06:44:04.397 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-selinux-2:18.2.2-1767.ga3bbd728.el9.x86_64 4/32 2024-08-01T06:44:04.397 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephfs2-2:18.2.2-1767.ga3bbd728.el9.x86_64 5/32 2024-08-01T06:44:04.397 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libradosstriper1-2:18.2.2-1767.ga3bbd728.el9.x86_6 6/32 2024-08-01T06:44:04.397 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librgw2-2:18.2.2-1767.ga3bbd728.el9.x86_64 7/32 2024-08-01T06:44:04.397 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1767.ga3bbd728.el9. 8/32 2024-08-01T06:44:04.398 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ceph-common-2:18.2.2-1767.ga3bbd728.el9.x8 9/32 2024-08-01T06:44:04.398 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cephfs-2:18.2.2-1767.ga3bbd728.el9.x86_64 10/32 2024-08-01T06:44:04.398 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rados-2:18.2.2-1767.ga3bbd728.el9.x86_64 11/32 2024-08-01T06:44:04.398 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rbd-2:18.2.2-1767.ga3bbd728.el9.x86_64 12/32 2024-08-01T06:44:04.398 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rgw-2:18.2.2-1767.ga3bbd728.el9.x86_64 13/32 2024-08-01T06:44:04.398 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-08-01T06:44:04.398 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-08-01T06:44:04.398 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-08-01T06:44:04.398 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-08-01T06:44:04.398 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-08-01T06:44:04.398 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-08-01T06:44:04.398 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-08-01T06:44:04.398 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-08-01T06:44:04.399 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-08-01T06:44:04.399 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-08-01T06:44:04.399 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-08-01T06:44:04.399 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-08-01T06:44:04.399 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-08-01T06:44:04.399 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-08-01T06:44:04.399 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-08-01T06:44:04.399 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados2-2:18.2.2-1767.ga3bbd728.el9.x86_64 29/32 2024-08-01T06:44:04.399 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-08-01T06:44:04.399 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librbd1-2:18.2.2-1767.ga3bbd728.el9.x86_64 31/32 2024-08-01T06:44:04.515 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:26 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:44:04.641 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:44:04.642 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:04.642 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-08-01T06:44:04.642 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:04.642 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-08-01T06:44:04.642 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 40 M 2024-08-01T06:44:04.642 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-08-01T06:44:04.643 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 166 k 2024-08-01T06:44:04.643 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-01T06:44:04.643 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-01T06:44:04.643 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:04.643 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-08-01T06:44:04.643 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:04.643 INFO:teuthology.orchestra.run.smithi089.stdout:Install 4 Packages 2024-08-01T06:44:04.643 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:04.644 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 40 M 2024-08-01T06:44:04.644 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 163 M 2024-08-01T06:44:04.644 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-08-01T06:44:05.001 INFO:teuthology.orchestra.run.smithi089.stdout:(1/4): libcephsqlite-18.2.2-1767.ga3bbd728.el9. 697 kB/s | 166 kB 00:00 2024-08-01T06:44:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-08-01T06:44:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:05.236 INFO:teuthology.orchestra.run.smithi016.stdout:Upgraded: 2024-08-01T06:44:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: librados2-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:05.236 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-08-01T06:44:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-01T06:44:05.236 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: fmt-8.1.1-5.el9.x86_64 2024-08-01T06:44:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-01T06:44:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-01T06:44:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-01T06:44:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-01T06:44:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-01T06:44:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-01T06:44:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:05.237 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-01T06:44:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-01T06:44:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-01T06:44:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-01T06:44:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cephfs-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-01T06:44:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rbd-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rgw-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:05.238 INFO:teuthology.orchestra.run.smithi016.stdout: re2-1:20211101-3.el9.x86_64 2024-08-01T06:44:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-01T06:44:05.239 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:05.239 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:44:05.402 INFO:teuthology.orchestra.run.smithi089.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 476 kB/s | 304 kB 00:00 2024-08-01T06:44:05.427 INFO:teuthology.orchestra.run.smithi089.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 150 kB/s | 64 kB 00:00 2024-08-01T06:44:05.611 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-test 2024-08-01T06:44:06.102 INFO:teuthology.orchestra.run.smithi089.stdout:(4/4): ceph-test-18.2.2-1767.ga3bbd728.el9.x86_ 30 MB/s | 40 MB 00:01 2024-08-01T06:44:06.105 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:44:06.105 INFO:teuthology.orchestra.run.smithi089.stdout:Total 28 MB/s | 40 MB 00:01 2024-08-01T06:44:06.132 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-08-01T06:44:06.153 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-08-01T06:44:06.153 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-08-01T06:44:06.181 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:00:27 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:44:06.313 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:44:06.314 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:44:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-08-01T06:44:06.314 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:44:06.314 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-08-01T06:44:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 40 M 2024-08-01T06:44:06.314 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-08-01T06:44:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: libcephsqlite x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 166 k 2024-08-01T06:44:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-01T06:44:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-01T06:44:06.315 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:06.315 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-08-01T06:44:06.315 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:44:06.315 INFO:teuthology.orchestra.run.smithi016.stdout:Install 4 Packages 2024-08-01T06:44:06.315 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:06.315 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 40 M 2024-08-01T06:44:06.315 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 163 M 2024-08-01T06:44:06.315 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-08-01T06:44:06.479 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-08-01T06:44:06.479 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-08-01T06:44:06.598 INFO:teuthology.orchestra.run.smithi016.stdout:(1/4): libcephsqlite-18.2.2-1767.ga3bbd728.el9. 690 kB/s | 166 kB 00:00 2024-08-01T06:44:06.623 INFO:teuthology.orchestra.run.smithi016.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.1 MB/s | 304 kB 00:00 2024-08-01T06:44:06.955 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-08-01T06:44:06.965 INFO:teuthology.orchestra.run.smithi016.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 174 kB/s | 64 kB 00:00 2024-08-01T06:44:07.045 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-08-01T06:44:07.085 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-08-01T06:44:07.121 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:18.2.2-1767.ga3bbd728.el9.x86_64 3/4 2024-08-01T06:44:07.699 INFO:teuthology.orchestra.run.smithi016.stdout:(4/4): ceph-test-18.2.2-1767.ga3bbd728.el9.x86_ 30 MB/s | 40 MB 00:01 2024-08-01T06:44:07.701 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:44:07.701 INFO:teuthology.orchestra.run.smithi016.stdout:Total 29 MB/s | 40 MB 00:01 2024-08-01T06:44:07.727 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-08-01T06:44:07.749 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-08-01T06:44:07.749 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-08-01T06:44:08.095 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-08-01T06:44:08.095 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-08-01T06:44:08.585 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-08-01T06:44:08.672 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-08-01T06:44:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-08-01T06:44:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephsqlite-2:18.2.2-1767.ga3bbd728.el9.x86_64 3/4 2024-08-01T06:44:10.828 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1767.ga3bbd728.el9.x86_64 3/4 2024-08-01T06:44:10.902 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:18.2.2-1767.ga3bbd728.el9.x86_64 4/4 2024-08-01T06:44:12.688 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1767.ga3bbd728.el9.x86_64 3/4 2024-08-01T06:44:12.763 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-test-2:18.2.2-1767.ga3bbd728.el9.x86_64 4/4 2024-08-01T06:44:13.095 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-test-2:18.2.2-1767.ga3bbd728.el9.x86_64 4/4 2024-08-01T06:44:13.095 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/4 2024-08-01T06:44:13.095 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:18.2.2-1767.ga3bbd728.el9.x86_64 2/4 2024-08-01T06:44:13.095 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-08-01T06:44:13.424 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-08-01T06:44:13.424 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:13.424 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-08-01T06:44:13.424 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:13.424 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:13.424 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-01T06:44:13.424 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-01T06:44:13.424 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:13.424 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:44:13.677 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph 2024-08-01T06:44:14.231 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:36 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:44:14.363 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:44:14.365 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:14.366 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-08-01T06:44:14.366 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:14.366 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-08-01T06:44:14.366 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 6.5 k 2024-08-01T06:44:14.367 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-08-01T06:44:14.367 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 2.1 M 2024-08-01T06:44:14.367 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 1.5 M 2024-08-01T06:44:14.367 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1767.ga3bbd728.el9 ceph-noarch 246 k 2024-08-01T06:44:14.367 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 4.7 M 2024-08-01T06:44:14.367 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 17 M 2024-08-01T06:44:14.367 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-01T06:44:14.368 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-01T06:44:14.368 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-01T06:44:14.368 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-01T06:44:14.368 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-01T06:44:14.368 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-01T06:44:14.368 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-01T06:44:14.368 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections 2024-08-01T06:44:14.369 INFO:teuthology.orchestra.run.smithi089.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-08-01T06:44:14.369 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-01T06:44:14.369 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-01T06:44:14.369 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-01T06:44:14.369 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-01T06:44:14.369 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-01T06:44:14.370 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-01T06:44:14.370 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-01T06:44:14.370 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-01T06:44:14.370 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-01T06:44:14.370 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-01T06:44:14.371 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-01T06:44:14.371 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-01T06:44:14.371 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-01T06:44:14.371 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-01T06:44:14.371 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-01T06:44:14.371 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-01T06:44:14.372 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-01T06:44:14.372 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-01T06:44:14.372 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-01T06:44:14.372 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:14.372 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-08-01T06:44:14.372 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:14.372 INFO:teuthology.orchestra.run.smithi089.stdout:Install 33 Packages 2024-08-01T06:44:14.373 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:14.374 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 29 M 2024-08-01T06:44:14.374 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 104 M 2024-08-01T06:44:14.374 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-08-01T06:44:14.786 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-test-2:18.2.2-1767.ga3bbd728.el9.x86_64 4/4 2024-08-01T06:44:14.786 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-test-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/4 2024-08-01T06:44:14.787 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephsqlite-2:18.2.2-1767.ga3bbd728.el9.x86_64 2/4 2024-08-01T06:44:14.787 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-08-01T06:44:14.862 INFO:teuthology.orchestra.run.smithi089.stdout:(1/33): ceph-18.2.2-1767.ga3bbd728.el9.x86_64.r 36 kB/s | 6.5 kB 00:00 2024-08-01T06:44:15.046 INFO:teuthology.orchestra.run.smithi089.stdout:(2/33): ceph-mds-18.2.2-1767.ga3bbd728.el9.x86_ 5.7 MB/s | 2.1 MB 00:00 2024-08-01T06:44:15.048 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-08-01T06:44:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:15.049 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-08-01T06:44:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: libcephsqlite-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-01T06:44:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-01T06:44:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:15.049 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:44:15.104 INFO:teuthology.orchestra.run.smithi089.stdout:(3/33): ceph-mgr-18.2.2-1767.ga3bbd728.el9.x86_ 3.4 MB/s | 1.5 MB 00:00 2024-08-01T06:44:15.180 INFO:teuthology.orchestra.run.smithi089.stdout:(4/33): ceph-mgr-modules-core-18.2.2-1767.ga3bb 3.2 MB/s | 246 kB 00:00 2024-08-01T06:44:15.297 INFO:teuthology.orchestra.run.smithi089.stdout:(5/33): ceph-mon-18.2.2-1767.ga3bbd728.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-08-01T06:44:15.326 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph 2024-08-01T06:44:15.355 INFO:teuthology.orchestra.run.smithi089.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-08-01T06:44:15.389 INFO:teuthology.orchestra.run.smithi089.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 106 kB 00:00 2024-08-01T06:44:15.430 INFO:teuthology.orchestra.run.smithi089.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-08-01T06:44:15.614 INFO:teuthology.orchestra.run.smithi089.stdout:(9/33): ceph-osd-18.2.2-1767.ga3bbd728.el9.x86_ 29 MB/s | 17 MB 00:00 2024-08-01T06:44:15.640 INFO:teuthology.orchestra.run.smithi089.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 598 kB/s | 125 kB 00:00 2024-08-01T06:44:15.673 INFO:teuthology.orchestra.run.smithi089.stdout:(11/33): python3-cryptography-36.0.1-4.el9.x86_ 3.3 MB/s | 1.2 MB 00:00 2024-08-01T06:44:15.757 INFO:teuthology.orchestra.run.smithi089.stdout:(12/33): python3-urllib3-1.26.5-6.el9.noarch.rp 1.5 MB/s | 215 kB 00:00 2024-08-01T06:44:15.896 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:00:36 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:44:15.940 INFO:teuthology.orchestra.run.smithi089.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 130 kB/s | 35 kB 00:00 2024-08-01T06:44:16.032 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:44:16.034 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:44:16.035 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-08-01T06:44:16.035 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:44:16.035 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-08-01T06:44:16.035 INFO:teuthology.orchestra.run.smithi016.stdout: ceph x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 6.5 k 2024-08-01T06:44:16.035 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-08-01T06:44:16.036 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 2.1 M 2024-08-01T06:44:16.036 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 1.5 M 2024-08-01T06:44:16.036 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1767.ga3bbd728.el9 ceph-noarch 246 k 2024-08-01T06:44:16.036 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 4.7 M 2024-08-01T06:44:16.036 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 17 M 2024-08-01T06:44:16.036 INFO:teuthology.orchestra.run.smithi016.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-01T06:44:16.037 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-01T06:44:16.037 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-01T06:44:16.037 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-01T06:44:16.037 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-01T06:44:16.037 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-01T06:44:16.037 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-01T06:44:16.038 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-collections 2024-08-01T06:44:16.038 INFO:teuthology.orchestra.run.smithi016.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-08-01T06:44:16.038 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-01T06:44:16.038 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-01T06:44:16.038 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-01T06:44:16.038 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-01T06:44:16.039 INFO:teuthology.orchestra.run.smithi016.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-01T06:44:16.039 INFO:teuthology.orchestra.run.smithi016.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-01T06:44:16.039 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-01T06:44:16.039 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-01T06:44:16.039 INFO:teuthology.orchestra.run.smithi016.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-01T06:44:16.039 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-01T06:44:16.039 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-01T06:44:16.039 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-01T06:44:16.039 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-01T06:44:16.039 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-01T06:44:16.039 INFO:teuthology.orchestra.run.smithi016.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-01T06:44:16.039 INFO:teuthology.orchestra.run.smithi016.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-01T06:44:16.039 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-01T06:44:16.040 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-01T06:44:16.040 INFO:teuthology.orchestra.run.smithi016.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-01T06:44:16.040 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:16.040 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-08-01T06:44:16.040 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:44:16.040 INFO:teuthology.orchestra.run.smithi016.stdout:Install 33 Packages 2024-08-01T06:44:16.040 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:16.041 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 29 M 2024-08-01T06:44:16.041 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 104 M 2024-08-01T06:44:16.041 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-08-01T06:44:16.099 INFO:teuthology.orchestra.run.smithi089.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 149 kB/s | 51 kB 00:00 2024-08-01T06:44:16.149 INFO:teuthology.orchestra.run.smithi089.stdout:(15/33): python3-mako-1.1.4-6.el9.noarch.rpm 338 kB/s | 172 kB 00:00 2024-08-01T06:44:16.200 INFO:teuthology.orchestra.run.smithi089.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 433 kB/s | 43 kB 00:00 2024-08-01T06:44:16.225 INFO:teuthology.orchestra.run.smithi089.stdout:(17/33): python3-toml-0.10.2-6.el9.noarch.rpm 146 kB/s | 42 kB 00:00 2024-08-01T06:44:16.275 INFO:teuthology.orchestra.run.smithi089.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-08-01T06:44:16.301 INFO:teuthology.orchestra.run.smithi089.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 775 kB/s | 18 kB 00:00 2024-08-01T06:44:16.326 INFO:teuthology.orchestra.run.smithi089.stdout:(20/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 106 kB/s | 11 kB 00:00 2024-08-01T06:44:16.351 INFO:teuthology.orchestra.run.smithi089.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-08-01T06:44:16.376 INFO:teuthology.orchestra.run.smithi089.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-08-01T06:44:16.402 INFO:teuthology.orchestra.run.smithi089.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-08-01T06:44:16.427 INFO:teuthology.orchestra.run.smithi089.stdout:(24/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.6 MB/s | 358 kB 00:00 2024-08-01T06:44:16.452 INFO:teuthology.orchestra.run.smithi089.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 614 kB/s | 46 kB 00:00 2024-08-01T06:44:16.477 INFO:teuthology.orchestra.run.smithi089.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-08-01T06:44:16.503 INFO:teuthology.orchestra.run.smithi089.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-08-01T06:44:16.528 INFO:teuthology.orchestra.run.smithi089.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-08-01T06:44:16.553 INFO:teuthology.orchestra.run.smithi089.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-08-01T06:44:16.579 INFO:teuthology.orchestra.run.smithi089.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-08-01T06:44:16.595 INFO:teuthology.orchestra.run.smithi089.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-08-01T06:44:16.621 INFO:teuthology.orchestra.run.smithi089.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-08-01T06:44:16.646 INFO:teuthology.orchestra.run.smithi089.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.5 MB/s | 427 kB 00:00 2024-08-01T06:44:16.649 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:44:16.650 INFO:teuthology.orchestra.run.smithi089.stdout:Total 13 MB/s | 29 MB 00:02 2024-08-01T06:44:16.744 INFO:teuthology.orchestra.run.smithi016.stdout:(1/33): ceph-18.2.2-1767.ga3bbd728.el9.x86_64.r 34 kB/s | 6.5 kB 00:00 2024-08-01T06:44:16.766 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-08-01T06:44:16.803 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-08-01T06:44:16.803 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-08-01T06:44:16.911 INFO:teuthology.orchestra.run.smithi016.stdout:(2/33): ceph-mds-18.2.2-1767.ga3bbd728.el9.x86_ 5.9 MB/s | 2.1 MB 00:00 2024-08-01T06:44:16.952 INFO:teuthology.orchestra.run.smithi016.stdout:(3/33): ceph-mgr-18.2.2-1767.ga3bbd728.el9.x86_ 3.7 MB/s | 1.5 MB 00:00 2024-08-01T06:44:17.036 INFO:teuthology.orchestra.run.smithi016.stdout:(4/33): ceph-mgr-modules-core-18.2.2-1767.ga3bb 2.9 MB/s | 246 kB 00:00 2024-08-01T06:44:17.194 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-08-01T06:44:17.194 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-08-01T06:44:17.337 INFO:teuthology.orchestra.run.smithi016.stdout:(5/33): ceph-mon-18.2.2-1767.ga3bbd728.el9.x86_ 7.9 MB/s | 4.7 MB 00:00 2024-08-01T06:44:17.512 INFO:teuthology.orchestra.run.smithi016.stdout:(6/33): ceph-osd-18.2.2-1767.ga3bbd728.el9.x86_ 28 MB/s | 17 MB 00:00 2024-08-01T06:44:18.012 INFO:teuthology.orchestra.run.smithi016.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 260 kB/s | 253 kB 00:00 2024-08-01T06:44:18.237 INFO:teuthology.orchestra.run.smithi016.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 147 kB/s | 106 kB 00:00 2024-08-01T06:44:18.404 INFO:teuthology.orchestra.run.smithi016.stdout:(9/33): python3-cryptography-36.0.1-4.el9.x86_6 1.1 MB/s | 1.2 MB 00:01 2024-08-01T06:44:18.405 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-08-01T06:44:18.490 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-08-01T06:44:18.522 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-08-01T06:44:18.555 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-08-01T06:44:18.648 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-08-01T06:44:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-08-01T06:44:18.746 INFO:teuthology.orchestra.run.smithi016.stdout:(10/33): python3-pycparser-2.20-6.el9.noarch.rp 184 kB/s | 135 kB 00:00 2024-08-01T06:44:18.767 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-08-01T06:44:18.810 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-08-01T06:44:18.848 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-08-01T06:44:18.872 INFO:teuthology.orchestra.run.smithi016.stdout:(11/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-08-01T06:44:18.882 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-08-01T06:44:18.905 INFO:teuthology.orchestra.run.smithi016.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 1.0 MB/s | 35 kB 00:00 2024-08-01T06:44:18.916 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-08-01T06:44:18.939 INFO:teuthology.orchestra.run.smithi016.stdout:(13/33): python3-pytz-2021.1-5.el9.noarch.rpm 1.5 MB/s | 51 kB 00:00 2024-08-01T06:44:18.956 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-08-01T06:44:18.973 INFO:teuthology.orchestra.run.smithi016.stdout:(14/33): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-08-01T06:44:18.991 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-08-01T06:44:19.031 INFO:teuthology.orchestra.run.smithi016.stdout:(15/33): python3-requests-2.25.1-8.el9.noarch.r 163 kB/s | 125 kB 00:00 2024-08-01T06:44:19.034 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-08-01T06:44:19.072 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-08-01T06:44:19.081 INFO:teuthology.orchestra.run.smithi016.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 401 kB/s | 43 kB 00:00 2024-08-01T06:44:19.115 INFO:teuthology.orchestra.run.smithi016.stdout:(17/33): python3-cherrypy-18.6.1-2.el9.noarch.r 11 MB/s | 358 kB 00:00 2024-08-01T06:44:19.140 INFO:teuthology.orchestra.run.smithi016.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-08-01T06:44:19.146 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-08-01T06:44:19.165 INFO:teuthology.orchestra.run.smithi016.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 213 kB/s | 11 kB 00:00 2024-08-01T06:44:19.207 INFO:teuthology.orchestra.run.smithi016.stdout:(20/33): python3-urllib3-1.26.5-6.el9.noarch.rp 268 kB/s | 215 kB 00:00 2024-08-01T06:44:19.233 INFO:teuthology.orchestra.run.smithi016.stdout:(21/33): python3-jaraco-classes-3.2.1-5.el9.noa 191 kB/s | 18 kB 00:00 2024-08-01T06:44:19.249 INFO:teuthology.orchestra.run.smithi016.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 276 kB/s | 23 kB 00:00 2024-08-01T06:44:19.292 INFO:teuthology.orchestra.run.smithi016.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 231 kB/s | 19 kB 00:00 2024-08-01T06:44:19.293 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-08-01T06:44:19.308 INFO:teuthology.orchestra.run.smithi016.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 1.5 MB/s | 46 kB 00:00 2024-08-01T06:44:19.325 INFO:teuthology.orchestra.run.smithi016.stdout:(25/33): python3-jaraco-text-3.2.0-6.el9.noarch 213 kB/s | 20 kB 00:00 2024-08-01T06:44:19.351 INFO:teuthology.orchestra.run.smithi016.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.4 MB/s | 79 kB 00:00 2024-08-01T06:44:19.368 INFO:teuthology.orchestra.run.smithi016.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 394 kB/s | 16 kB 00:00 2024-08-01T06:44:19.372 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-08-01T06:44:19.393 INFO:teuthology.orchestra.run.smithi016.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-08-01T06:44:19.418 INFO:teuthology.orchestra.run.smithi016.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-08-01T06:44:19.434 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-08-01T06:44:19.443 INFO:teuthology.orchestra.run.smithi016.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-08-01T06:44:19.469 INFO:teuthology.orchestra.run.smithi016.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 802 kB/s | 20 kB 00:00 2024-08-01T06:44:19.472 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-08-01T06:44:19.494 INFO:teuthology.orchestra.run.smithi016.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-08-01T06:44:19.519 INFO:teuthology.orchestra.run.smithi016.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-08-01T06:44:19.525 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:44:19.525 INFO:teuthology.orchestra.run.smithi016.stdout:Total 8.4 MB/s | 29 MB 00:03 2024-08-01T06:44:19.530 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-08-01T06:44:19.585 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-08-01T06:44:19.649 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-08-01T06:44:19.690 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-08-01T06:44:19.690 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-08-01T06:44:19.776 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-08-01T06:44:19.827 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-08-01T06:44:19.904 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-08-01T06:44:19.993 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-08-01T06:44:20.039 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-08-01T06:44:20.079 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-08-01T06:44:20.080 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-08-01T06:44:20.157 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-08-01T06:44:20.308 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1767.ga3bbd728.el9. 28/33 2024-08-01T06:44:20.336 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:18.2.2-1767.ga3bbd728.el9.x86_64 29/33 2024-08-01T06:44:20.361 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1767.ga3bbd728.el9.x86_64 29/33 2024-08-01T06:44:20.361 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-01T06:44:20.361 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-01T06:44:20.361 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-01T06:44:20.361 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-01T06:44:20.362 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:21.289 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-08-01T06:44:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-08-01T06:44:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-08-01T06:44:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-08-01T06:44:21.527 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-08-01T06:44:21.604 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-08-01T06:44:21.658 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-08-01T06:44:21.692 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-08-01T06:44:21.722 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-08-01T06:44:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-08-01T06:44:21.770 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:18.2.2-1767.ga3bbd728.el9.x86_64 30/33 2024-08-01T06:44:21.789 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-08-01T06:44:21.798 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:18.2.2-1767.ga3bbd728.el9.x86_64 30/33 2024-08-01T06:44:21.798 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-01T06:44:21.798 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-01T06:44:21.798 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-01T06:44:21.798 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-01T06:44:21.798 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:21.831 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-08-01T06:44:21.874 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-08-01T06:44:21.908 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-08-01T06:44:21.947 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-08-01T06:44:22.142 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-08-01T06:44:22.238 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:18.2.2-1767.ga3bbd728.el9.x86_64 31/33 2024-08-01T06:44:22.262 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:18.2.2-1767.ga3bbd728.el9.x86_64 31/33 2024-08-01T06:44:22.262 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-01T06:44:22.262 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-01T06:44:22.262 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-01T06:44:22.262 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-01T06:44:22.262 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-08-01T06:44:22.392 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-08-01T06:44:22.463 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:18.2.2-1767.ga3bbd728.el9.x86_64 32/33 2024-08-01T06:44:22.486 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:18.2.2-1767.ga3bbd728.el9.x86_64 32/33 2024-08-01T06:44:22.487 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-01T06:44:22.487 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-01T06:44:22.487 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-01T06:44:22.487 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-01T06:44:22.487 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:22.552 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:18.2.2-1767.ga3bbd728.el9.x86_64 33/33 2024-08-01T06:44:22.584 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-08-01T06:44:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-08-01T06:44:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-08-01T06:44:22.752 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-08-01T06:44:22.961 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-08-01T06:44:23.009 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-08-01T06:44:23.090 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-08-01T06:44:23.297 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-08-01T06:44:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-08-01T06:44:23.474 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-08-01T06:44:23.631 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1767.ga3bbd728.el9. 28/33 2024-08-01T06:44:23.659 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-2:18.2.2-1767.ga3bbd728.el9.x86_64 29/33 2024-08-01T06:44:23.686 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1767.ga3bbd728.el9.x86_64 29/33 2024-08-01T06:44:23.686 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-01T06:44:23.686 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-01T06:44:23.686 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-01T06:44:23.686 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-01T06:44:23.686 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:24.251 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-2:18.2.2-1767.ga3bbd728.el9.x86_64 33/33 2024-08-01T06:44:24.251 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/33 2024-08-01T06:44:24.251 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:18.2.2-1767.ga3bbd728.el9.x86_64 2/33 2024-08-01T06:44:24.251 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:18.2.2-1767.ga3bbd728.el9.x86_64 3/33 2024-08-01T06:44:24.251 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:18.2.2-1767.ga3bbd728.el9.x86_64 4/33 2024-08-01T06:44:24.252 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:18.2.2-1767.ga3bbd728.el9.x86_64 5/33 2024-08-01T06:44:24.252 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1767.ga3bbd728.el9. 6/33 2024-08-01T06:44:24.252 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-08-01T06:44:24.252 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-08-01T06:44:24.252 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-08-01T06:44:24.252 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-08-01T06:44:24.252 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-08-01T06:44:24.252 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-08-01T06:44:24.252 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-08-01T06:44:24.252 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-08-01T06:44:24.252 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-08-01T06:44:24.252 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-08-01T06:44:24.252 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-08-01T06:44:24.253 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-08-01T06:44:24.253 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-08-01T06:44:24.253 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-08-01T06:44:24.253 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-08-01T06:44:24.253 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-08-01T06:44:24.253 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-08-01T06:44:24.253 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-08-01T06:44:24.253 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-08-01T06:44:24.253 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-08-01T06:44:24.253 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-08-01T06:44:24.254 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-08-01T06:44:24.254 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-08-01T06:44:24.254 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-08-01T06:44:24.254 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-08-01T06:44:24.254 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-08-01T06:44:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-08-01T06:44:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:25.198 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-08-01T06:44:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:18.2.2-1767.ga3bbd728.el9.noarch 2024-08-01T06:44:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-01T06:44:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-01T06:44:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-01T06:44:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-01T06:44:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-01T06:44:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-01T06:44:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-01T06:44:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-01T06:44:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-01T06:44:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-01T06:44:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-01T06:44:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-01T06:44:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-01T06:44:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-01T06:44:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-01T06:44:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply-3.11-14.el9.noarch 2024-08-01T06:44:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-01T06:44:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-01T06:44:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-01T06:44:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-01T06:44:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-01T06:44:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-01T06:44:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-01T06:44:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-01T06:44:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-01T06:44:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-01T06:44:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-01T06:44:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:25.201 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:44:25.210 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-osd-2:18.2.2-1767.ga3bbd728.el9.x86_64 30/33 2024-08-01T06:44:25.241 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-osd-2:18.2.2-1767.ga3bbd728.el9.x86_64 30/33 2024-08-01T06:44:25.241 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-01T06:44:25.241 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-01T06:44:25.241 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-01T06:44:25.241 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-01T06:44:25.241 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:25.587 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-base 2024-08-01T06:44:25.711 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mon-2:18.2.2-1767.ga3bbd728.el9.x86_64 31/33 2024-08-01T06:44:25.737 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mon-2:18.2.2-1767.ga3bbd728.el9.x86_64 31/33 2024-08-01T06:44:25.737 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-01T06:44:25.737 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-01T06:44:25.737 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-01T06:44:25.738 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-01T06:44:25.738 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:25.954 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mds-2:18.2.2-1767.ga3bbd728.el9.x86_64 32/33 2024-08-01T06:44:25.979 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mds-2:18.2.2-1767.ga3bbd728.el9.x86_64 32/33 2024-08-01T06:44:25.979 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-01T06:44:25.979 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-01T06:44:25.979 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-01T06:44:25.979 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-01T06:44:25.979 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:26.045 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-2:18.2.2-1767.ga3bbd728.el9.x86_64 33/33 2024-08-01T06:44:26.139 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:48 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:44:26.225 INFO:teuthology.orchestra.run.smithi089.stdout:Package ceph-base-2:18.2.2-1767.ga3bbd728.el9.x86_64 is already installed. 2024-08-01T06:44:26.267 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:44:26.268 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-08-01T06:44:26.268 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:44:26.337 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install cephadm 2024-08-01T06:44:26.878 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:48 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:44:27.008 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:44:27.009 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:27.009 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-08-01T06:44:27.009 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:27.009 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-08-01T06:44:27.009 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:18.2.2-1767.ga3bbd728.el9 ceph-noarch 224 k 2024-08-01T06:44:27.009 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:27.009 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-08-01T06:44:27.010 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:27.010 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-08-01T06:44:27.010 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:27.010 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 224 k 2024-08-01T06:44:27.010 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 216 k 2024-08-01T06:44:27.010 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-08-01T06:44:27.271 INFO:teuthology.orchestra.run.smithi089.stdout:cephadm-18.2.2-1767.ga3bbd728.el9.noarch.rpm 861 kB/s | 224 kB 00:00 2024-08-01T06:44:27.271 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:44:27.272 INFO:teuthology.orchestra.run.smithi089.stdout:Total 856 kB/s | 224 kB 00:00 2024-08-01T06:44:27.272 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-08-01T06:44:27.276 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-08-01T06:44:27.277 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-08-01T06:44:27.279 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-08-01T06:44:27.280 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-08-01T06:44:27.347 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-08-01T06:44:27.733 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:18.2.2-1767.ga3bbd728.el9.noarch 1/1 2024-08-01T06:44:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-2:18.2.2-1767.ga3bbd728.el9.x86_64 33/33 2024-08-01T06:44:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/33 2024-08-01T06:44:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mds-2:18.2.2-1767.ga3bbd728.el9.x86_64 2/33 2024-08-01T06:44:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-2:18.2.2-1767.ga3bbd728.el9.x86_64 3/33 2024-08-01T06:44:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mon-2:18.2.2-1767.ga3bbd728.el9.x86_64 4/33 2024-08-01T06:44:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-osd-2:18.2.2-1767.ga3bbd728.el9.x86_64 5/33 2024-08-01T06:44:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1767.ga3bbd728.el9. 6/33 2024-08-01T06:44:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-08-01T06:44:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-08-01T06:44:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-08-01T06:44:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-08-01T06:44:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-08-01T06:44:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-08-01T06:44:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-08-01T06:44:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-08-01T06:44:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-08-01T06:44:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-08-01T06:44:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-08-01T06:44:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-08-01T06:44:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-08-01T06:44:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-08-01T06:44:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-08-01T06:44:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-08-01T06:44:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-08-01T06:44:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-08-01T06:44:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-08-01T06:44:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-08-01T06:44:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-08-01T06:44:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-08-01T06:44:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-08-01T06:44:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-08-01T06:44:27.823 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-08-01T06:44:27.823 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-08-01T06:44:27.824 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:18.2.2-1767.ga3bbd728.el9.noarch 1/1 2024-08-01T06:44:28.168 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:18.2.2-1767.ga3bbd728.el9.noarch 1/1 2024-08-01T06:44:28.439 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:18.2.2-1767.ga3bbd728.el9.noarch 1/1 2024-08-01T06:44:28.439 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:28.439 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-08-01T06:44:28.440 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:18.2.2-1767.ga3bbd728.el9.noarch 2024-08-01T06:44:28.440 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:28.440 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:44:28.658 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-immutable-object-cache 2024-08-01T06:44:28.765 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-08-01T06:44:28.765 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:28.765 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-08-01T06:44:28.765 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:28.766 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:28.766 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:28.766 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core-2:18.2.2-1767.ga3bbd728.el9.noarch 2024-08-01T06:44:28.766 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:28.766 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:28.766 INFO:teuthology.orchestra.run.smithi016.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-01T06:44:28.766 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-01T06:44:28.766 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-01T06:44:28.766 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-01T06:44:28.766 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-01T06:44:28.766 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-01T06:44:28.766 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-01T06:44:28.766 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-01T06:44:28.767 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-01T06:44:28.767 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-01T06:44:28.767 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-01T06:44:28.767 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-01T06:44:28.767 INFO:teuthology.orchestra.run.smithi016.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-01T06:44:28.767 INFO:teuthology.orchestra.run.smithi016.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-01T06:44:28.767 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-01T06:44:28.767 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ply-3.11-14.el9.noarch 2024-08-01T06:44:28.767 INFO:teuthology.orchestra.run.smithi016.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-01T06:44:28.767 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-01T06:44:28.767 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-01T06:44:28.767 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-01T06:44:28.767 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-01T06:44:28.768 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-01T06:44:28.768 INFO:teuthology.orchestra.run.smithi016.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-01T06:44:28.768 INFO:teuthology.orchestra.run.smithi016.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-01T06:44:28.768 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-01T06:44:28.768 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-01T06:44:28.768 INFO:teuthology.orchestra.run.smithi016.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-01T06:44:28.768 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:28.768 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:44:29.103 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-base 2024-08-01T06:44:29.217 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:51 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:44:29.349 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:44:29.349 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:29.349 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2024-08-01T06:44:29.349 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:29.349 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-08-01T06:44:29.349 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 143 k 2024-08-01T06:44:29.349 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:29.349 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-08-01T06:44:29.349 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:29.349 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-08-01T06:44:29.350 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:29.350 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 143 k 2024-08-01T06:44:29.350 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 395 k 2024-08-01T06:44:29.350 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-08-01T06:44:29.577 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-immutable-object-cache-18.2.2-1767.ga3bbd7 629 kB/s | 143 kB 00:00 2024-08-01T06:44:29.578 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:44:29.578 INFO:teuthology.orchestra.run.smithi089.stdout:Total 624 kB/s | 143 kB 00:00 2024-08-01T06:44:29.578 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-08-01T06:44:29.586 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-08-01T06:44:29.586 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-08-01T06:44:29.642 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-08-01T06:44:29.642 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-08-01T06:44:29.703 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:00:50 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:44:29.783 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-08-01T06:44:29.792 INFO:teuthology.orchestra.run.smithi016.stdout:Package ceph-base-2:18.2.2-1767.ga3bbd728.el9.x86_64 is already installed. 2024-08-01T06:44:29.837 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:44:29.838 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-08-01T06:44:29.838 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:44:29.887 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1767.ga3bbd728. 1/1 2024-08-01T06:44:29.901 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install cephadm 2024-08-01T06:44:29.912 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1767.ga3bbd728. 1/1 2024-08-01T06:44:29.912 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-01T06:44:29.913 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-01T06:44:29.913 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:30.474 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:00:51 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:44:30.607 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:44:30.608 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:44:30.608 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-08-01T06:44:30.608 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:44:30.608 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-08-01T06:44:30.608 INFO:teuthology.orchestra.run.smithi016.stdout: cephadm noarch 2:18.2.2-1767.ga3bbd728.el9 ceph-noarch 224 k 2024-08-01T06:44:30.608 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:30.608 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-08-01T06:44:30.609 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:44:30.609 INFO:teuthology.orchestra.run.smithi016.stdout:Install 1 Package 2024-08-01T06:44:30.609 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:30.609 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 224 k 2024-08-01T06:44:30.609 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 216 k 2024-08-01T06:44:30.609 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-08-01T06:44:30.830 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1767.ga3bbd728. 1/1 2024-08-01T06:44:30.830 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:30.830 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-08-01T06:44:30.830 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:30.831 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:30.831 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:44:30.861 INFO:teuthology.orchestra.run.smithi016.stdout:cephadm-18.2.2-1767.ga3bbd728.el9.noarch.rpm 891 kB/s | 224 kB 00:00 2024-08-01T06:44:30.862 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:44:30.862 INFO:teuthology.orchestra.run.smithi016.stdout:Total 885 kB/s | 224 kB 00:00 2024-08-01T06:44:30.862 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-08-01T06:44:30.867 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-08-01T06:44:30.868 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-08-01T06:44:30.870 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-08-01T06:44:30.871 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-08-01T06:44:30.943 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-08-01T06:44:31.030 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr 2024-08-01T06:44:31.341 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: cephadm-2:18.2.2-1767.ga3bbd728.el9.noarch 1/1 2024-08-01T06:44:31.417 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephadm-2:18.2.2-1767.ga3bbd728.el9.noarch 1/1 2024-08-01T06:44:31.586 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:53 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:44:31.674 INFO:teuthology.orchestra.run.smithi089.stdout:Package ceph-mgr-2:18.2.2-1767.ga3bbd728.el9.x86_64 is already installed. 2024-08-01T06:44:31.718 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:44:31.720 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-08-01T06:44:31.720 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:44:31.762 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: cephadm-2:18.2.2-1767.ga3bbd728.el9.noarch 1/1 2024-08-01T06:44:31.786 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-dashboard 2024-08-01T06:44:32.017 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephadm-2:18.2.2-1767.ga3bbd728.el9.noarch 1/1 2024-08-01T06:44:32.017 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:32.017 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-08-01T06:44:32.017 INFO:teuthology.orchestra.run.smithi016.stdout: cephadm-2:18.2.2-1767.ga3bbd728.el9.noarch 2024-08-01T06:44:32.017 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:32.017 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:44:32.208 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-immutable-object-cache 2024-08-01T06:44:32.326 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:54 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:44:32.454 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:44:32.455 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:32.455 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-08-01T06:44:32.455 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:32.455 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-08-01T06:44:32.455 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1767.ga3bbd728.el9 ceph-noarch 3.5 M 2024-08-01T06:44:32.455 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-08-01T06:44:32.455 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1767.ga3bbd728.el9 ceph-noarch 24 k 2024-08-01T06:44:32.455 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1767.ga3bbd728.el9 ceph-noarch 16 k 2024-08-01T06:44:32.456 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-01T06:44:32.456 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-01T06:44:32.456 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:32.456 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-08-01T06:44:32.456 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:32.456 INFO:teuthology.orchestra.run.smithi089.stdout:Install 5 Packages 2024-08-01T06:44:32.456 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:32.457 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 3.8 M 2024-08-01T06:44:32.457 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 87 M 2024-08-01T06:44:32.457 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-08-01T06:44:32.780 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:00:53 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:44:32.915 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:44:32.916 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:44:32.916 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repo Size 2024-08-01T06:44:32.916 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:44:32.916 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-08-01T06:44:32.917 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 143 k 2024-08-01T06:44:32.917 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:32.917 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-08-01T06:44:32.917 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:44:32.917 INFO:teuthology.orchestra.run.smithi016.stdout:Install 1 Package 2024-08-01T06:44:32.917 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:32.917 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 143 k 2024-08-01T06:44:32.917 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 395 k 2024-08-01T06:44:32.917 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-08-01T06:44:33.131 INFO:teuthology.orchestra.run.smithi089.stdout:(1/5): ceph-prometheus-alerts-18.2.2-1767.ga3bb 66 kB/s | 16 kB 00:00 2024-08-01T06:44:33.156 INFO:teuthology.orchestra.run.smithi089.stdout:(2/5): ceph-grafana-dashboards-18.2.2-1767.ga3b 89 kB/s | 24 kB 00:00 2024-08-01T06:44:33.217 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-immutable-object-cache-18.2.2-1767.ga3bbd7 476 kB/s | 143 kB 00:00 2024-08-01T06:44:33.218 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:44:33.218 INFO:teuthology.orchestra.run.smithi016.stdout:Total 473 kB/s | 143 kB 00:00 2024-08-01T06:44:33.218 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-08-01T06:44:33.226 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-08-01T06:44:33.226 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-08-01T06:44:33.256 INFO:teuthology.orchestra.run.smithi089.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 246 kB/s | 31 kB 00:00 2024-08-01T06:44:33.287 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-08-01T06:44:33.288 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-08-01T06:44:33.289 INFO:teuthology.orchestra.run.smithi089.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 1.4 MB/s | 188 kB 00:00 2024-08-01T06:44:33.357 INFO:teuthology.orchestra.run.smithi089.stdout:(5/5): ceph-mgr-dashboard-18.2.2-1767.ga3bbd728 7.4 MB/s | 3.5 MB 00:00 2024-08-01T06:44:33.360 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:44:33.360 INFO:teuthology.orchestra.run.smithi089.stdout:Total 4.2 MB/s | 3.8 MB 00:00 2024-08-01T06:44:33.361 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-08-01T06:44:33.367 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-08-01T06:44:33.367 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-08-01T06:44:33.428 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-08-01T06:44:33.429 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-08-01T06:44:33.436 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-08-01T06:44:33.510 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1767.ga3bbd728. 1/1 2024-08-01T06:44:33.536 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1767.ga3bbd728. 1/1 2024-08-01T06:44:33.536 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-01T06:44:33.536 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-01T06:44:33.536 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:33.752 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-08-01T06:44:33.838 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-08-01T06:44:33.879 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-08-01T06:44:33.916 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1767.ga3bbd728.el9.n 3/5 2024-08-01T06:44:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1767.ga3bbd728. 1/1 2024-08-01T06:44:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:34.512 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-08-01T06:44:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-immutable-object-cache-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:44:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:34.513 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:44:34.715 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-mgr 2024-08-01T06:44:34.966 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1767.ga3bbd728.el9. 4/5 2024-08-01T06:44:35.003 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1767.ga3bbd728.el9.noarc 5/5 2024-08-01T06:44:35.292 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:00:56 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:44:35.383 INFO:teuthology.orchestra.run.smithi016.stdout:Package ceph-mgr-2:18.2.2-1767.ga3bbd728.el9.x86_64 is already installed. 2024-08-01T06:44:35.430 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:44:35.431 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-08-01T06:44:35.431 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:44:35.489 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-mgr-dashboard 2024-08-01T06:44:36.058 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:00:57 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:44:36.071 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1767.ga3bbd728.el9.noarc 5/5 2024-08-01T06:44:36.071 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1767.ga3bbd728.el9. 1/5 2024-08-01T06:44:36.071 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1767.ga3bbd728.el9.noarc 2/5 2024-08-01T06:44:36.071 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1767.ga3bbd728.el9.n 3/5 2024-08-01T06:44:36.071 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-08-01T06:44:36.193 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:44:36.194 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:44:36.194 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-08-01T06:44:36.194 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:44:36.194 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-08-01T06:44:36.194 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1767.ga3bbd728.el9 ceph-noarch 3.5 M 2024-08-01T06:44:36.194 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-08-01T06:44:36.194 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1767.ga3bbd728.el9 ceph-noarch 24 k 2024-08-01T06:44:36.194 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1767.ga3bbd728.el9 ceph-noarch 16 k 2024-08-01T06:44:36.194 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-01T06:44:36.195 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-01T06:44:36.195 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:36.195 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-08-01T06:44:36.195 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:44:36.195 INFO:teuthology.orchestra.run.smithi016.stdout:Install 5 Packages 2024-08-01T06:44:36.195 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:36.195 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 3.8 M 2024-08-01T06:44:36.196 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 87 M 2024-08-01T06:44:36.196 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-08-01T06:44:36.337 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-08-01T06:44:36.337 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:36.337 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-08-01T06:44:36.338 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:18.2.2-1767.ga3bbd728.el9.noarch 2024-08-01T06:44:36.338 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:18.2.2-1767.ga3bbd728.el9.noarch 2024-08-01T06:44:36.338 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:18.2.2-1767.ga3bbd728.el9.noarch 2024-08-01T06:44:36.338 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-01T06:44:36.338 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-01T06:44:36.338 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:36.338 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:44:36.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-diskprediction-local 2024-08-01T06:44:36.571 INFO:teuthology.orchestra.run.smithi016.stdout:(1/5): ceph-grafana-dashboards-18.2.2-1767.ga3b 127 kB/s | 24 kB 00:00 2024-08-01T06:44:36.596 INFO:teuthology.orchestra.run.smithi016.stdout:(2/5): ceph-prometheus-alerts-18.2.2-1767.ga3bb 76 kB/s | 16 kB 00:00 2024-08-01T06:44:36.680 INFO:teuthology.orchestra.run.smithi016.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 282 kB/s | 31 kB 00:00 2024-08-01T06:44:36.713 INFO:teuthology.orchestra.run.smithi016.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 1.6 MB/s | 188 kB 00:00 2024-08-01T06:44:36.822 INFO:teuthology.orchestra.run.smithi016.stdout:(5/5): ceph-mgr-dashboard-18.2.2-1767.ga3bbd728 8.0 MB/s | 3.5 MB 00:00 2024-08-01T06:44:36.826 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:44:36.826 INFO:teuthology.orchestra.run.smithi016.stdout:Total 6.0 MB/s | 3.8 MB 00:00 2024-08-01T06:44:36.826 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-08-01T06:44:36.834 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-08-01T06:44:36.834 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-08-01T06:44:36.898 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-08-01T06:44:36.898 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-08-01T06:44:37.078 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:59 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:44:37.208 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:44:37.209 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2024-08-01T06:44:37.209 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-08-01T06:44:37.210 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2024-08-01T06:44:37.210 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-08-01T06:44:37.210 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1767.ga3bbd728.el9 ceph-noarch 7.4 M 2024-08-01T06:44:37.210 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-08-01T06:44:37.210 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-01T06:44:37.210 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-01T06:44:37.210 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-01T06:44:37.210 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-01T06:44:37.210 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-01T06:44:37.210 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-01T06:44:37.210 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-01T06:44:37.210 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-01T06:44:37.211 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-01T06:44:37.211 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-01T06:44:37.211 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-01T06:44:37.211 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:37.211 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-08-01T06:44:37.211 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2024-08-01T06:44:37.211 INFO:teuthology.orchestra.run.smithi089.stdout:Install 12 Packages 2024-08-01T06:44:37.211 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:37.212 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 38 M 2024-08-01T06:44:37.212 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 209 M 2024-08-01T06:44:37.212 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-08-01T06:44:37.221 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-08-01T06:44:37.305 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-08-01T06:44:37.336 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-08-01T06:44:37.365 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1767.ga3bbd728.el9.n 3/5 2024-08-01T06:44:37.539 INFO:teuthology.orchestra.run.smithi089.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-08-01T06:44:37.589 INFO:teuthology.orchestra.run.smithi089.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 4.1 MB/s | 803 kB 00:00 2024-08-01T06:44:37.665 INFO:teuthology.orchestra.run.smithi089.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-08-01T06:44:37.723 INFO:teuthology.orchestra.run.smithi089.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 313 kB/s | 18 kB 00:00 2024-08-01T06:44:37.782 INFO:teuthology.orchestra.run.smithi089.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 604 kB/s | 35 kB 00:00 2024-08-01T06:44:37.899 INFO:teuthology.orchestra.run.smithi089.stdout:(6/12): ceph-mgr-diskprediction-local-18.2.2-17 15 MB/s | 7.4 MB 00:00 2024-08-01T06:44:38.015 INFO:teuthology.orchestra.run.smithi089.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 7.0 MB/s | 3.0 MB 00:00 2024-08-01T06:44:38.157 INFO:teuthology.orchestra.run.smithi089.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 13 MB/s | 4.7 MB 00:00 2024-08-01T06:44:38.183 INFO:teuthology.orchestra.run.smithi089.stdout:(9/12): python3-devel-3.9.18-3.el9.x86_64.rpm 861 kB/s | 244 kB 00:00 2024-08-01T06:44:38.216 INFO:teuthology.orchestra.run.smithi089.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 4.2 MB/s | 250 kB 00:00 2024-08-01T06:44:38.283 INFO:teuthology.orchestra.run.smithi089.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2024-08-01T06:44:38.479 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1767.ga3bbd728.el9. 4/5 2024-08-01T06:44:38.518 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1767.ga3bbd728.el9.noarc 5/5 2024-08-01T06:44:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1767.ga3bbd728.el9.noarc 5/5 2024-08-01T06:44:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1767.ga3bbd728.el9. 1/5 2024-08-01T06:44:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1767.ga3bbd728.el9.noarc 2/5 2024-08-01T06:44:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1767.ga3bbd728.el9.n 3/5 2024-08-01T06:44:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-08-01T06:44:39.836 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-08-01T06:44:39.836 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:39.837 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-08-01T06:44:39.837 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards-2:18.2.2-1767.ga3bbd728.el9.noarch 2024-08-01T06:44:39.837 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard-2:18.2.2-1767.ga3bbd728.el9.noarch 2024-08-01T06:44:39.837 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-prometheus-alerts-2:18.2.2-1767.ga3bbd728.el9.noarch 2024-08-01T06:44:39.837 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-01T06:44:39.837 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-01T06:44:39.837 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:39.837 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:44:40.034 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-mgr-diskprediction-local 2024-08-01T06:44:40.605 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:01 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:44:40.739 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:44:40.740 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================= 2024-08-01T06:44:40.740 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-08-01T06:44:40.740 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================= 2024-08-01T06:44:40.740 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-08-01T06:44:40.740 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1767.ga3bbd728.el9 ceph-noarch 7.4 M 2024-08-01T06:44:40.741 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-08-01T06:44:40.741 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-01T06:44:40.741 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-01T06:44:40.741 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-01T06:44:40.741 INFO:teuthology.orchestra.run.smithi016.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-01T06:44:40.741 INFO:teuthology.orchestra.run.smithi016.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-01T06:44:40.741 INFO:teuthology.orchestra.run.smithi016.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-01T06:44:40.741 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-01T06:44:40.741 INFO:teuthology.orchestra.run.smithi016.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-01T06:44:40.741 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-01T06:44:40.741 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-01T06:44:40.741 INFO:teuthology.orchestra.run.smithi016.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-01T06:44:40.741 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:40.742 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-08-01T06:44:40.742 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================= 2024-08-01T06:44:40.742 INFO:teuthology.orchestra.run.smithi016.stdout:Install 12 Packages 2024-08-01T06:44:40.742 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:40.742 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 38 M 2024-08-01T06:44:40.742 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 209 M 2024-08-01T06:44:40.743 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-08-01T06:44:41.646 INFO:teuthology.orchestra.run.smithi016.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.2-17 15 MB/s | 7.4 MB 00:00 2024-08-01T06:44:41.754 INFO:teuthology.orchestra.run.smithi016.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 303 kB/s | 33 kB 00:00 2024-08-01T06:44:41.780 INFO:teuthology.orchestra.run.smithi016.stdout:(3/12): libquadmath-11.4.1-3.el9.x86_64.rpm 305 kB/s | 195 kB 00:00 2024-08-01T06:44:41.897 INFO:teuthology.orchestra.run.smithi016.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 156 kB/s | 18 kB 00:00 2024-08-01T06:44:41.964 INFO:teuthology.orchestra.run.smithi016.stdout:(5/12): libgfortran-11.4.1-3.el9.x86_64.rpm 973 kB/s | 803 kB 00:00 2024-08-01T06:44:42.106 INFO:teuthology.orchestra.run.smithi016.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 169 kB/s | 35 kB 00:00 2024-08-01T06:44:42.256 INFO:teuthology.orchestra.run.smithi016.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.6 MB/s | 244 kB 00:00 2024-08-01T06:44:42.656 INFO:teuthology.orchestra.run.smithi016.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.3 MB/s | 3.0 MB 00:00 2024-08-01T06:44:42.815 INFO:teuthology.orchestra.run.smithi016.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.5 MB/s | 250 kB 00:00 2024-08-01T06:44:43.150 INFO:teuthology.orchestra.run.smithi089.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.3 MB/s | 16 MB 00:04 2024-08-01T06:44:43.151 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:44:43.151 INFO:teuthology.orchestra.run.smithi089.stdout:Total 6.4 MB/s | 38 MB 00:05 2024-08-01T06:44:43.506 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-08-01T06:44:43.533 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-08-01T06:44:43.533 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-08-01T06:44:44.017 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-08-01T06:44:44.017 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-08-01T06:44:44.115 INFO:teuthology.orchestra.run.smithi016.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 2.2 MB/s | 4.7 MB 00:02 2024-08-01T06:44:44.273 INFO:teuthology.orchestra.run.smithi016.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.5 MB/s | 5.1 MB 00:02 2024-08-01T06:44:44.767 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-08-01T06:44:44.855 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-08-01T06:44:44.903 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-08-01T06:44:44.999 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-08-01T06:44:45.050 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-08-01T06:44:45.227 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-08-01T06:44:45.257 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-08-01T06:44:45.334 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-08-01T06:44:46.004 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-08-01T06:44:46.213 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-08-01T06:44:47.468 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-08-01T06:44:48.496 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-08-01T06:44:48.526 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1767.ga3bbd 12/12 2024-08-01T06:44:50.682 INFO:teuthology.orchestra.run.smithi016.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.1 MB/s | 16 MB 00:07 2024-08-01T06:44:50.684 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:44:50.684 INFO:teuthology.orchestra.run.smithi016.stdout:Total 3.8 MB/s | 38 MB 00:09 2024-08-01T06:44:51.041 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1767.ga3bbd 12/12 2024-08-01T06:44:51.041 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1767.ga3bbd 1/12 2024-08-01T06:44:51.041 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-08-01T06:44:51.041 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-08-01T06:44:51.041 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-08-01T06:44:51.041 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-08-01T06:44:51.041 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-08-01T06:44:51.042 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-08-01T06:44:51.042 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-08-01T06:44:51.042 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-08-01T06:44:51.042 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-08-01T06:44:51.042 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-08-01T06:44:51.052 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-08-01T06:44:51.080 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-08-01T06:44:51.080 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-08-01T06:44:51.421 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-08-01T06:44:51.421 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:51.421 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-08-01T06:44:51.421 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1767.ga3bbd728.el9.noarch 2024-08-01T06:44:51.422 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-01T06:44:51.422 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-01T06:44:51.422 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-01T06:44:51.422 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-01T06:44:51.422 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-01T06:44:51.422 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-01T06:44:51.422 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-01T06:44:51.422 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-01T06:44:51.422 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-01T06:44:51.422 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-01T06:44:51.422 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-01T06:44:51.422 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:51.422 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:44:51.609 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-08-01T06:44:51.610 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-08-01T06:44:51.842 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-rook 2024-08-01T06:44:52.384 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-08-01T06:44:52.417 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:14 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:44:52.449 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-08-01T06:44:52.498 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-08-01T06:44:52.557 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:44:52.559 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-08-01T06:44:52.559 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:52.559 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-08-01T06:44:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:18.2.2-1767.ga3bbd728.el9 ceph-noarch 49 k 2024-08-01T06:44:52.559 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-08-01T06:44:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-01T06:44:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-01T06:44:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:2.32.0-1.el9 epel 216 k 2024-08-01T06:44:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-01T06:44:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-01T06:44:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-01T06:44:52.559 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-01T06:44:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-01T06:44:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-01T06:44:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-01T06:44:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-01T06:44:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-01T06:44:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:52.560 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-08-01T06:44:52.560 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:52.560 INFO:teuthology.orchestra.run.smithi089.stdout:Install 13 Packages 2024-08-01T06:44:52.560 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:52.561 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 2.2 M 2024-08-01T06:44:52.561 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 26 M 2024-08-01T06:44:52.561 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-08-01T06:44:52.600 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-08-01T06:44:52.639 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-08-01T06:44:52.816 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-08-01T06:44:52.846 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-08-01T06:44:52.926 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-08-01T06:44:53.346 INFO:teuthology.orchestra.run.smithi089.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 299 kB/s | 26 kB 00:00 2024-08-01T06:44:53.371 INFO:teuthology.orchestra.run.smithi089.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 173 kB/s | 19 kB 00:00 2024-08-01T06:44:53.446 INFO:teuthology.orchestra.run.smithi089.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-08-01T06:44:53.471 INFO:teuthology.orchestra.run.smithi089.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.2 MB/s | 222 kB 00:00 2024-08-01T06:44:53.497 INFO:teuthology.orchestra.run.smithi089.stdout:(5/13): ceph-mgr-rook-18.2.2-1767.ga3bbd728.el9 208 kB/s | 49 kB 00:00 2024-08-01T06:44:53.522 INFO:teuthology.orchestra.run.smithi089.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-08-01T06:44:53.548 INFO:teuthology.orchestra.run.smithi089.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 279 kB 00:00 2024-08-01T06:44:53.648 INFO:teuthology.orchestra.run.smithi089.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 214 kB/s | 32 kB 00:00 2024-08-01T06:44:53.650 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-08-01T06:44:53.673 INFO:teuthology.orchestra.run.smithi089.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 94 kB/s | 14 kB 00:00 2024-08-01T06:44:53.699 INFO:teuthology.orchestra.run.smithi089.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-01T06:44:53.716 INFO:teuthology.orchestra.run.smithi089.stdout:(11/13): python3-google-auth-2.32.0-1.el9.noarc 1.8 MB/s | 216 kB 00:00 2024-08-01T06:44:53.749 INFO:teuthology.orchestra.run.smithi089.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-08-01T06:44:53.767 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-08-01T06:44:53.782 INFO:teuthology.orchestra.run.smithi089.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.7 MB/s | 1.0 MB 00:00 2024-08-01T06:44:53.785 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:44:53.785 INFO:teuthology.orchestra.run.smithi089.stdout:Total 1.8 MB/s | 2.2 MB 00:01 2024-08-01T06:44:53.850 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-08-01T06:44:53.865 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-08-01T06:44:53.865 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-08-01T06:44:53.951 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-08-01T06:44:53.952 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-08-01T06:44:54.458 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-08-01T06:44:54.628 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-08-01T06:44:54.692 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-08-01T06:44:54.756 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-08-01T06:44:54.793 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-08-01T06:44:54.843 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-08-01T06:44:54.948 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-08-01T06:44:55.054 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:2.32.0-1.el9.noarch 7/13 2024-08-01T06:44:55.105 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-08-01T06:44:55.119 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-08-01T06:44:55.851 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-08-01T06:44:55.902 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-08-01T06:44:55.935 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-08-01T06:44:55.983 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-08-01T06:44:56.005 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:18.2.2-1767.ga3bbd728.el9.noarch 13/13 2024-08-01T06:44:56.181 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-08-01T06:44:56.208 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1767.ga3bbd 12/12 2024-08-01T06:44:56.829 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1767.ga3bbd728.el9.noarch 13/13 2024-08-01T06:44:56.829 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1767.ga3bbd728.el9.noarch 1/13 2024-08-01T06:44:56.830 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-08-01T06:44:56.830 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-08-01T06:44:56.830 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-08-01T06:44:56.830 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-08-01T06:44:56.830 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-08-01T06:44:56.830 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-08-01T06:44:56.830 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-08-01T06:44:56.831 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-08-01T06:44:56.831 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:2.32.0-1.el9.noarch 10/13 2024-08-01T06:44:56.831 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-08-01T06:44:56.831 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-08-01T06:44:57.176 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-08-01T06:44:57.177 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:57.177 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-08-01T06:44:57.177 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:18.2.2-1767.ga3bbd728.el9.noarch 2024-08-01T06:44:57.177 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-01T06:44:57.177 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-01T06:44:57.177 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:2.32.0-1.el9.noarch 2024-08-01T06:44:57.177 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-01T06:44:57.177 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-01T06:44:57.177 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-01T06:44:57.177 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-01T06:44:57.177 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-01T06:44:57.178 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-01T06:44:57.178 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-01T06:44:57.178 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-01T06:44:57.178 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-01T06:44:57.178 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:57.178 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:44:57.442 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-cephadm 2024-08-01T06:44:57.993 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:19 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:44:58.120 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:44:58.121 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:58.121 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-08-01T06:44:58.121 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:58.121 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-08-01T06:44:58.121 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1767.ga3bbd728.el9 ceph-noarch 139 k 2024-08-01T06:44:58.122 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-08-01T06:44:58.122 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-01T06:44:58.122 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-01T06:44:58.122 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-01T06:44:58.122 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-01T06:44:58.122 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-01T06:44:58.123 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:58.123 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-08-01T06:44:58.123 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:44:58.123 INFO:teuthology.orchestra.run.smithi089.stdout:Install 6 Packages 2024-08-01T06:44:58.123 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:44:58.124 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 7.0 M 2024-08-01T06:44:58.124 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 33 M 2024-08-01T06:44:58.124 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-08-01T06:44:58.554 INFO:teuthology.orchestra.run.smithi089.stdout:(1/6): ceph-mgr-cephadm-18.2.2-1767.ga3bbd728.e 611 kB/s | 139 kB 00:00 2024-08-01T06:44:58.579 INFO:teuthology.orchestra.run.smithi089.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 986 kB/s | 248 kB 00:00 2024-08-01T06:44:58.679 INFO:teuthology.orchestra.run.smithi089.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.3 MB/s | 548 kB 00:00 2024-08-01T06:44:58.704 INFO:teuthology.orchestra.run.smithi089.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 461 kB/s | 58 kB 00:00 2024-08-01T06:44:58.730 INFO:teuthology.orchestra.run.smithi089.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-08-01T06:44:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1767.ga3bbd 12/12 2024-08-01T06:44:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1767.ga3bbd 1/12 2024-08-01T06:44:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-08-01T06:44:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-08-01T06:44:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-08-01T06:44:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-08-01T06:44:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-08-01T06:44:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-08-01T06:44:58.828 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-08-01T06:44:58.829 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-08-01T06:44:58.829 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-08-01T06:44:58.829 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-08-01T06:44:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-08-01T06:44:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:59.251 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-08-01T06:44:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1767.ga3bbd728.el9.noarch 2024-08-01T06:44:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-01T06:44:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-01T06:44:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-01T06:44:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-01T06:44:59.251 INFO:teuthology.orchestra.run.smithi016.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-01T06:44:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-01T06:44:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-01T06:44:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-01T06:44:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-01T06:44:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-01T06:44:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-01T06:44:59.252 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:44:59.252 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:44:59.632 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-mgr-rook 2024-08-01T06:45:00.210 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:21 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:45:00.345 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:45:00.346 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:00.346 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-08-01T06:45:00.347 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:00.347 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-08-01T06:45:00.347 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook noarch 2:18.2.2-1767.ga3bbd728.el9 ceph-noarch 49 k 2024-08-01T06:45:00.347 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-08-01T06:45:00.347 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-01T06:45:00.347 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-01T06:45:00.348 INFO:teuthology.orchestra.run.smithi016.stdout: python3-google-auth noarch 1:2.32.0-1.el9 epel 216 k 2024-08-01T06:45:00.348 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-01T06:45:00.348 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-01T06:45:00.348 INFO:teuthology.orchestra.run.smithi016.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-01T06:45:00.348 INFO:teuthology.orchestra.run.smithi016.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-01T06:45:00.348 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-01T06:45:00.349 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-01T06:45:00.349 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-01T06:45:00.349 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-01T06:45:00.349 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-01T06:45:00.349 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:00.349 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-08-01T06:45:00.350 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:00.350 INFO:teuthology.orchestra.run.smithi016.stdout:Install 13 Packages 2024-08-01T06:45:00.350 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:00.351 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 2.2 M 2024-08-01T06:45:00.351 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 26 M 2024-08-01T06:45:00.351 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-08-01T06:45:00.813 INFO:teuthology.orchestra.run.smithi089.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.4 MB/s | 6.0 MB 00:02 2024-08-01T06:45:00.815 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:45:00.816 INFO:teuthology.orchestra.run.smithi089.stdout:Total 2.6 MB/s | 7.0 MB 00:02 2024-08-01T06:45:00.888 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-08-01T06:45:00.900 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-08-01T06:45:00.901 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-08-01T06:45:00.934 INFO:teuthology.orchestra.run.smithi016.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 135 kB/s | 19 kB 00:00 2024-08-01T06:45:00.959 INFO:teuthology.orchestra.run.smithi016.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 153 kB/s | 26 kB 00:00 2024-08-01T06:45:00.985 INFO:teuthology.orchestra.run.smithi016.stdout:(3/13): ceph-mgr-rook-18.2.2-1767.ga3bbd728.el9 256 kB/s | 49 kB 00:00 2024-08-01T06:45:00.998 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-08-01T06:45:00.998 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-08-01T06:45:01.119 INFO:teuthology.orchestra.run.smithi016.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.2 MB/s | 222 kB 00:00 2024-08-01T06:45:01.144 INFO:teuthology.orchestra.run.smithi016.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 863 kB/s | 159 kB 00:00 2024-08-01T06:45:01.194 INFO:teuthology.orchestra.run.smithi016.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 715 kB/s | 54 kB 00:00 2024-08-01T06:45:01.244 INFO:teuthology.orchestra.run.smithi016.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.1 MB/s | 279 kB 00:00 2024-08-01T06:45:01.270 INFO:teuthology.orchestra.run.smithi016.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 256 kB/s | 32 kB 00:00 2024-08-01T06:45:01.295 INFO:teuthology.orchestra.run.smithi016.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 143 kB/s | 14 kB 00:00 2024-08-01T06:45:01.304 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-08-01T06:45:01.345 INFO:teuthology.orchestra.run.smithi016.stdout:(10/13): python3-google-auth-2.32.0-1.el9.noarc 2.9 MB/s | 216 kB 00:00 2024-08-01T06:45:01.370 INFO:teuthology.orchestra.run.smithi016.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-08-01T06:45:01.396 INFO:teuthology.orchestra.run.smithi016.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-08-01T06:45:01.446 INFO:teuthology.orchestra.run.smithi016.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.9 MB/s | 1.0 MB 00:00 2024-08-01T06:45:01.448 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:45:01.449 INFO:teuthology.orchestra.run.smithi016.stdout:Total 2.0 MB/s | 2.2 MB 00:01 2024-08-01T06:45:01.467 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-08-01T06:45:01.514 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-08-01T06:45:01.515 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-08-01T06:45:01.530 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-08-01T06:45:01.530 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-08-01T06:45:01.625 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-08-01T06:45:01.626 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-08-01T06:45:02.027 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-08-01T06:45:02.119 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-08-01T06:45:02.180 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-08-01T06:45:02.211 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1767.ga3bbd728.el9.noarch 6/6 2024-08-01T06:45:02.296 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-08-01T06:45:02.467 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-08-01T06:45:02.532 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-08-01T06:45:02.589 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-08-01T06:45:02.632 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-08-01T06:45:02.674 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-08-01T06:45:02.783 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-08-01T06:45:02.889 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-google-auth-1:2.32.0-1.el9.noarch 7/13 2024-08-01T06:45:02.943 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1767.ga3bbd728.el9.noarch 6/6 2024-08-01T06:45:02.943 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1767.ga3bbd728.el9.noarch 1/6 2024-08-01T06:45:02.943 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-08-01T06:45:02.943 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-08-01T06:45:02.943 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-08-01T06:45:02.943 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-08-01T06:45:02.943 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-08-01T06:45:03.206 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-08-01T06:45:03.207 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:03.207 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-08-01T06:45:03.207 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:18.2.2-1767.ga3bbd728.el9.noarch 2024-08-01T06:45:03.207 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-01T06:45:03.207 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-01T06:45:03.207 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-01T06:45:03.207 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-01T06:45:03.207 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-01T06:45:03.207 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:03.207 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:45:03.443 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-fuse 2024-08-01T06:45:03.699 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-08-01T06:45:03.748 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-08-01T06:45:03.781 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-08-01T06:45:03.830 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-08-01T06:45:03.859 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-rook-2:18.2.2-1767.ga3bbd728.el9.noarch 13/13 2024-08-01T06:45:03.991 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:25 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:45:04.119 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:45:04.119 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:45:04.120 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-08-01T06:45:04.120 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:45:04.120 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-08-01T06:45:04.120 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 852 k 2024-08-01T06:45:04.120 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-08-01T06:45:04.120 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-01T06:45:04.120 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:04.120 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-08-01T06:45:04.120 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:45:04.120 INFO:teuthology.orchestra.run.smithi089.stdout:Install 2 Packages 2024-08-01T06:45:04.120 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:04.120 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 932 k 2024-08-01T06:45:04.121 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 2.7 M 2024-08-01T06:45:04.121 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-08-01T06:45:04.308 INFO:teuthology.orchestra.run.smithi089.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 639 kB/s | 80 kB 00:00 2024-08-01T06:45:04.483 INFO:teuthology.orchestra.run.smithi089.stdout:(2/2): ceph-fuse-18.2.2-1767.ga3bbd728.el9.x86_ 2.8 MB/s | 852 kB 00:00 2024-08-01T06:45:04.483 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:45:04.484 INFO:teuthology.orchestra.run.smithi089.stdout:Total 2.5 MB/s | 932 kB 00:00 2024-08-01T06:45:04.495 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-08-01T06:45:04.516 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-08-01T06:45:04.517 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-08-01T06:45:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1767.ga3bbd728.el9.noarch 13/13 2024-08-01T06:45:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1767.ga3bbd728.el9.noarch 1/13 2024-08-01T06:45:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-08-01T06:45:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-08-01T06:45:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-08-01T06:45:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-08-01T06:45:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-08-01T06:45:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-08-01T06:45:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-08-01T06:45:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-08-01T06:45:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-google-auth-1:2.32.0-1.el9.noarch 10/13 2024-08-01T06:45:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-08-01T06:45:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-08-01T06:45:04.594 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-08-01T06:45:04.594 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-08-01T06:45:04.789 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-08-01T06:45:04.923 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-08-01T06:45:04.990 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:18.2.2-1767.ga3bbd728.el9.x86_64 2/2 2024-08-01T06:45:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-08-01T06:45:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:05.018 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-08-01T06:45:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook-2:18.2.2-1767.ga3bbd728.el9.noarch 2024-08-01T06:45:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-01T06:45:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-01T06:45:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: python3-google-auth-1:2.32.0-1.el9.noarch 2024-08-01T06:45:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-01T06:45:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-01T06:45:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-01T06:45:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-01T06:45:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-01T06:45:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-01T06:45:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-01T06:45:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-01T06:45:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-01T06:45:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:05.019 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:45:05.284 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-mgr-cephadm 2024-08-01T06:45:05.636 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-fuse-2:18.2.2-1767.ga3bbd728.el9.x86_64 2/2 2024-08-01T06:45:05.636 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/2 2024-08-01T06:45:05.860 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:26 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:45:05.910 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-08-01T06:45:05.910 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:05.910 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-08-01T06:45:05.910 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:18.2.2-1767.ga3bbd728.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-08-01T06:45:05.910 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:05.910 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:45:05.993 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:45:05.993 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:05.994 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-08-01T06:45:05.994 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:05.994 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-08-01T06:45:05.994 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1767.ga3bbd728.el9 ceph-noarch 139 k 2024-08-01T06:45:05.994 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-08-01T06:45:05.994 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-01T06:45:05.994 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-01T06:45:05.994 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-01T06:45:05.994 INFO:teuthology.orchestra.run.smithi016.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-01T06:45:05.994 INFO:teuthology.orchestra.run.smithi016.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-01T06:45:05.994 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:05.994 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-08-01T06:45:05.995 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:05.995 INFO:teuthology.orchestra.run.smithi016.stdout:Install 6 Packages 2024-08-01T06:45:05.995 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:05.995 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 7.0 M 2024-08-01T06:45:05.995 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 33 M 2024-08-01T06:45:05.995 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-08-01T06:45:06.192 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librados-devel 2024-08-01T06:45:06.424 INFO:teuthology.orchestra.run.smithi016.stdout:(1/6): ceph-mgr-cephadm-18.2.2-1767.ga3bbd728.e 597 kB/s | 139 kB 00:00 2024-08-01T06:45:06.491 INFO:teuthology.orchestra.run.smithi016.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 8.0 MB/s | 548 kB 00:00 2024-08-01T06:45:06.516 INFO:teuthology.orchestra.run.smithi016.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-08-01T06:45:06.541 INFO:teuthology.orchestra.run.smithi016.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-08-01T06:45:06.752 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:28 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:45:06.775 INFO:teuthology.orchestra.run.smithi016.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 426 kB/s | 248 kB 00:00 2024-08-01T06:45:06.884 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:45:06.885 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:45:06.885 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2024-08-01T06:45:06.885 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:45:06.885 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-08-01T06:45:06.885 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 126 k 2024-08-01T06:45:06.886 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:06.886 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-08-01T06:45:06.886 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:45:06.886 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-08-01T06:45:06.886 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:06.886 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 126 k 2024-08-01T06:45:06.886 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 456 k 2024-08-01T06:45:06.886 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-08-01T06:45:07.089 INFO:teuthology.orchestra.run.smithi089.stdout:librados-devel-18.2.2-1767.ga3bbd728.el9.x86_64 622 kB/s | 126 kB 00:00 2024-08-01T06:45:07.090 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:45:07.090 INFO:teuthology.orchestra.run.smithi089.stdout:Total 617 kB/s | 126 kB 00:00 2024-08-01T06:45:07.090 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-08-01T06:45:07.096 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-08-01T06:45:07.096 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-08-01T06:45:07.159 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-08-01T06:45:07.160 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-08-01T06:45:07.305 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-08-01T06:45:07.412 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:07.865 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados-devel-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:08.139 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:08.139 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:08.139 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-08-01T06:45:08.140 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:45:08.140 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:08.140 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:45:08.383 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install libcephfs2 2024-08-01T06:45:08.943 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:30 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:45:09.029 INFO:teuthology.orchestra.run.smithi089.stdout:Package libcephfs2-2:18.2.2-1767.ga3bbd728.el9.x86_64 is already installed. 2024-08-01T06:45:09.071 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:45:09.072 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-08-01T06:45:09.072 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:45:09.152 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install libcephfs-devel 2024-08-01T06:45:09.706 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:31 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:45:09.834 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:45:09.835 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:45:09.835 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2024-08-01T06:45:09.835 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:45:09.835 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-08-01T06:45:09.835 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 31 k 2024-08-01T06:45:09.835 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:09.835 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-08-01T06:45:09.835 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:45:09.835 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-08-01T06:45:09.835 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:09.835 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 31 k 2024-08-01T06:45:09.835 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 139 k 2024-08-01T06:45:09.836 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-08-01T06:45:09.942 INFO:teuthology.orchestra.run.smithi016.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 1.6 MB/s | 6.0 MB 00:03 2024-08-01T06:45:09.944 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:45:09.944 INFO:teuthology.orchestra.run.smithi016.stdout:Total 1.8 MB/s | 7.0 MB 00:03 2024-08-01T06:45:10.011 INFO:teuthology.orchestra.run.smithi089.stdout:libcephfs-devel-18.2.2-1767.ga3bbd728.el9.x86_6 177 kB/s | 31 kB 00:00 2024-08-01T06:45:10.011 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:45:10.011 INFO:teuthology.orchestra.run.smithi089.stdout:Total 176 kB/s | 31 kB 00:00 2024-08-01T06:45:10.011 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-08-01T06:45:10.015 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-08-01T06:45:10.015 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-08-01T06:45:10.020 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-08-01T06:45:10.025 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-08-01T06:45:10.025 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-08-01T06:45:10.033 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-08-01T06:45:10.033 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-08-01T06:45:10.104 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-08-01T06:45:10.139 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-08-01T06:45:10.140 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-08-01T06:45:10.232 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:10.452 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-08-01T06:45:10.588 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs-devel-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:10.630 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-08-01T06:45:10.681 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-08-01T06:45:10.840 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:10.840 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:10.840 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-08-01T06:45:10.840 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:45:10.840 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:10.840 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:45:11.038 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librados2 2024-08-01T06:45:11.239 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-08-01T06:45:11.324 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-08-01T06:45:11.394 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-08-01T06:45:11.423 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1767.ga3bbd728.el9.noarch 6/6 2024-08-01T06:45:11.587 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:33 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:45:11.673 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-2:18.2.2-1767.ga3bbd728.el9.x86_64 is already installed. 2024-08-01T06:45:11.715 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:45:11.716 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-08-01T06:45:11.716 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:45:11.788 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librbd1 2024-08-01T06:45:12.185 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1767.ga3bbd728.el9.noarch 6/6 2024-08-01T06:45:12.185 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1767.ga3bbd728.el9.noarch 1/6 2024-08-01T06:45:12.185 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-08-01T06:45:12.185 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-08-01T06:45:12.185 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-08-01T06:45:12.185 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-08-01T06:45:12.333 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:34 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:45:12.420 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-2:18.2.2-1767.ga3bbd728.el9.x86_64 is already installed. 2024-08-01T06:45:12.456 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-08-01T06:45:12.456 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:12.456 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-08-01T06:45:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-cephadm-2:18.2.2-1767.ga3bbd728.el9.noarch 2024-08-01T06:45:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-01T06:45:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-01T06:45:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-01T06:45:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-01T06:45:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-01T06:45:12.457 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:12.457 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:45:12.460 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:45:12.462 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-08-01T06:45:12.462 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:45:12.540 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rados 2024-08-01T06:45:12.706 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-fuse 2024-08-01T06:45:13.090 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:35 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:45:13.176 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rados-2:18.2.2-1767.ga3bbd728.el9.x86_64 is already installed. 2024-08-01T06:45:13.217 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:45:13.218 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-08-01T06:45:13.218 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:45:13.280 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:34 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:45:13.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rgw 2024-08-01T06:45:13.414 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:45:13.415 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:13.415 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-08-01T06:45:13.415 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:13.415 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-08-01T06:45:13.415 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 852 k 2024-08-01T06:45:13.415 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-08-01T06:45:13.415 INFO:teuthology.orchestra.run.smithi016.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-01T06:45:13.415 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:13.415 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-08-01T06:45:13.416 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:13.416 INFO:teuthology.orchestra.run.smithi016.stdout:Install 2 Packages 2024-08-01T06:45:13.416 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:13.416 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 932 k 2024-08-01T06:45:13.416 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 2.7 M 2024-08-01T06:45:13.416 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-08-01T06:45:13.786 INFO:teuthology.orchestra.run.smithi016.stdout:(1/2): ceph-fuse-18.2.2-1767.ga3bbd728.el9.x86_ 2.7 MB/s | 852 kB 00:00 2024-08-01T06:45:13.841 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:35 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:45:13.927 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rgw-2:18.2.2-1767.ga3bbd728.el9.x86_64 is already installed. 2024-08-01T06:45:13.969 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:45:13.970 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-08-01T06:45:13.970 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:45:14.048 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-cephfs 2024-08-01T06:45:14.597 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:36 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:45:14.682 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-cephfs-2:18.2.2-1767.ga3bbd728.el9.x86_64 is already installed. 2024-08-01T06:45:14.725 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:45:14.726 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-08-01T06:45:14.726 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:45:14.797 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rbd 2024-08-01T06:45:15.340 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:37 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:45:15.427 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rbd-2:18.2.2-1767.ga3bbd728.el9.x86_64 is already installed. 2024-08-01T06:45:15.466 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:45:15.467 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-08-01T06:45:15.467 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:45:15.537 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-fuse 2024-08-01T06:45:16.084 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:38 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:45:16.212 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:45:16.213 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:45:16.213 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-08-01T06:45:16.213 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:45:16.213 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-08-01T06:45:16.213 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 87 k 2024-08-01T06:45:16.213 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:16.213 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-08-01T06:45:16.213 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:45:16.213 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-08-01T06:45:16.213 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:16.214 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 87 k 2024-08-01T06:45:16.214 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 227 k 2024-08-01T06:45:16.214 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-08-01T06:45:16.432 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-fuse-18.2.2-1767.ga3bbd728.el9.x86_64.rpm 396 kB/s | 87 kB 00:00 2024-08-01T06:45:16.433 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:45:16.433 INFO:teuthology.orchestra.run.smithi089.stdout:Total 394 kB/s | 87 kB 00:00 2024-08-01T06:45:16.433 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-08-01T06:45:16.440 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-08-01T06:45:16.440 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-08-01T06:45:16.502 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-08-01T06:45:16.502 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-08-01T06:45:16.640 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-08-01T06:45:16.711 INFO:teuthology.orchestra.run.smithi016.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 25 kB/s | 80 kB 00:03 2024-08-01T06:45:16.711 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:45:16.712 INFO:teuthology.orchestra.run.smithi016.stdout:Total 283 kB/s | 932 kB 00:03 2024-08-01T06:45:16.726 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-08-01T06:45:16.739 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:16.752 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-08-01T06:45:16.752 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-08-01T06:45:16.840 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-08-01T06:45:16.840 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-08-01T06:45:17.036 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-08-01T06:45:17.123 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-fuse-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-08-01T06:45:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-fuse-2:18.2.2-1767.ga3bbd728.el9.x86_64 2/2 2024-08-01T06:45:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:17.389 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-08-01T06:45:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:45:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:17.390 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:45:17.647 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-mirror 2024-08-01T06:45:17.849 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-fuse-2:18.2.2-1767.ga3bbd728.el9.x86_64 2/2 2024-08-01T06:45:17.849 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-fuse-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/2 2024-08-01T06:45:18.116 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-08-01T06:45:18.117 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:18.117 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-08-01T06:45:18.117 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse-2:18.2.2-1767.ga3bbd728.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-08-01T06:45:18.117 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:18.117 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:45:18.212 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:40 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:45:18.343 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:45:18.344 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:45:18.344 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2024-08-01T06:45:18.344 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:45:18.344 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-08-01T06:45:18.344 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 3.0 M 2024-08-01T06:45:18.344 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:18.344 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-08-01T06:45:18.344 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:45:18.345 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-08-01T06:45:18.345 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:18.345 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 3.0 M 2024-08-01T06:45:18.345 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 12 M 2024-08-01T06:45:18.345 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-08-01T06:45:18.393 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install librados-devel 2024-08-01T06:45:18.713 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-mirror-18.2.2-1767.ga3bbd728.el9.x86_64.rpm 8.1 MB/s | 3.0 MB 00:00 2024-08-01T06:45:18.713 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:45:18.714 INFO:teuthology.orchestra.run.smithi089.stdout:Total 8.1 MB/s | 3.0 MB 00:00 2024-08-01T06:45:18.714 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-08-01T06:45:18.723 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-08-01T06:45:18.723 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-08-01T06:45:18.802 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-08-01T06:45:18.802 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-08-01T06:45:18.972 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:39 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:45:19.108 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:45:19.108 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:19.108 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repo Size 2024-08-01T06:45:19.108 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:19.109 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-08-01T06:45:19.109 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 126 k 2024-08-01T06:45:19.109 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:19.109 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-08-01T06:45:19.109 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:19.109 INFO:teuthology.orchestra.run.smithi016.stdout:Install 1 Package 2024-08-01T06:45:19.109 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:19.109 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 126 k 2024-08-01T06:45:19.109 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 456 k 2024-08-01T06:45:19.109 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-08-01T06:45:19.241 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-08-01T06:45:19.308 INFO:teuthology.orchestra.run.smithi016.stdout:librados-devel-18.2.2-1767.ga3bbd728.el9.x86_64 638 kB/s | 126 kB 00:00 2024-08-01T06:45:19.308 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:45:19.308 INFO:teuthology.orchestra.run.smithi016.stdout:Total 634 kB/s | 126 kB 00:00 2024-08-01T06:45:19.309 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-08-01T06:45:19.314 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:19.315 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-08-01T06:45:19.315 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-08-01T06:45:19.339 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:19.339 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-01T06:45:19.339 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-01T06:45:19.339 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-01T06:45:19.339 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-01T06:45:19.339 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:19.381 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-08-01T06:45:19.381 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-08-01T06:45:19.541 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-08-01T06:45:19.642 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librados-devel-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:20.045 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados-devel-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:20.405 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados-devel-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:20.405 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:20.406 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-08-01T06:45:20.406 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:45:20.406 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:20.406 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:45:20.481 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:20.481 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:20.481 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-08-01T06:45:20.481 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:45:20.481 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:20.481 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:45:20.643 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install libcephfs2 2024-08-01T06:45:20.692 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-nbd 2024-08-01T06:45:21.225 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:42 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:45:21.257 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:43 ago on Thu 01 Aug 2024 06:43:38 AM UTC. 2024-08-01T06:45:21.314 INFO:teuthology.orchestra.run.smithi016.stdout:Package libcephfs2-2:18.2.2-1767.ga3bbd728.el9.x86_64 is already installed. 2024-08-01T06:45:21.359 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:45:21.360 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-08-01T06:45:21.360 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:45:21.386 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-08-01T06:45:21.386 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:45:21.387 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-08-01T06:45:21.387 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:45:21.387 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-08-01T06:45:21.387 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 172 k 2024-08-01T06:45:21.387 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:21.387 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-08-01T06:45:21.387 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-08-01T06:45:21.387 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-08-01T06:45:21.387 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:21.387 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 172 k 2024-08-01T06:45:21.387 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 494 k 2024-08-01T06:45:21.387 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-08-01T06:45:21.419 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install libcephfs-devel 2024-08-01T06:45:21.615 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-nbd-18.2.2-1767.ga3bbd728.el9.x86_64.rpm 757 kB/s | 172 kB 00:00 2024-08-01T06:45:21.615 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:45:21.616 INFO:teuthology.orchestra.run.smithi089.stdout:Total 751 kB/s | 172 kB 00:00 2024-08-01T06:45:21.616 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-08-01T06:45:21.623 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-08-01T06:45:21.623 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-08-01T06:45:21.686 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-08-01T06:45:21.686 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-08-01T06:45:21.848 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-08-01T06:45:21.947 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:21.997 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:42 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:45:22.134 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:45:22.134 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:22.134 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repo Size 2024-08-01T06:45:22.134 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:22.134 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-08-01T06:45:22.134 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 31 k 2024-08-01T06:45:22.134 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:22.134 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-08-01T06:45:22.134 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:22.135 INFO:teuthology.orchestra.run.smithi016.stdout:Install 1 Package 2024-08-01T06:45:22.135 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:22.135 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 31 k 2024-08-01T06:45:22.135 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 139 k 2024-08-01T06:45:22.135 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-08-01T06:45:22.300 INFO:teuthology.orchestra.run.smithi016.stdout:libcephfs-devel-18.2.2-1767.ga3bbd728.el9.x86_6 186 kB/s | 31 kB 00:00 2024-08-01T06:45:22.373 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-nbd-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:22.373 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:45:22.374 INFO:teuthology.orchestra.run.smithi016.stdout:Total 184 kB/s | 31 kB 00:00 2024-08-01T06:45:22.374 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-08-01T06:45:22.374 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-08-01T06:45:22.374 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-08-01T06:45:22.374 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-08-01T06:45:22.374 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-08-01T06:45:22.401 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-08-01T06:45:22.509 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephfs-devel-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:22.615 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:22.615 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:22.615 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-08-01T06:45:22.615 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:45:22.615 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:45:22.615 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-08-01T06:45:22.875 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephfs-devel-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:22.886 DEBUG:teuthology.parallel:result is None 2024-08-01T06:45:23.096 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephfs-devel-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:23.096 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:23.096 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-08-01T06:45:23.096 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:45:23.096 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:23.097 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:45:23.299 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install librados2 2024-08-01T06:45:23.890 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:44 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:45:23.978 INFO:teuthology.orchestra.run.smithi016.stdout:Package librados2-2:18.2.2-1767.ga3bbd728.el9.x86_64 is already installed. 2024-08-01T06:45:24.022 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:45:24.023 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-08-01T06:45:24.023 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:45:24.087 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install librbd1 2024-08-01T06:45:24.660 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:45 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:45:24.749 INFO:teuthology.orchestra.run.smithi016.stdout:Package librbd1-2:18.2.2-1767.ga3bbd728.el9.x86_64 is already installed. 2024-08-01T06:45:24.793 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:45:24.795 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-08-01T06:45:24.795 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:45:24.859 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install python3-rados 2024-08-01T06:45:25.429 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:46 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:45:25.517 INFO:teuthology.orchestra.run.smithi016.stdout:Package python3-rados-2:18.2.2-1767.ga3bbd728.el9.x86_64 is already installed. 2024-08-01T06:45:25.561 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:45:25.562 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-08-01T06:45:25.562 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:45:25.625 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install python3-rgw 2024-08-01T06:45:26.202 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:47 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:45:26.290 INFO:teuthology.orchestra.run.smithi016.stdout:Package python3-rgw-2:18.2.2-1767.ga3bbd728.el9.x86_64 is already installed. 2024-08-01T06:45:26.335 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:45:26.336 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-08-01T06:45:26.337 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:45:26.401 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install python3-cephfs 2024-08-01T06:45:26.979 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:47 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:45:27.071 INFO:teuthology.orchestra.run.smithi016.stdout:Package python3-cephfs-2:18.2.2-1767.ga3bbd728.el9.x86_64 is already installed. 2024-08-01T06:45:27.119 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:45:27.120 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-08-01T06:45:27.120 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:45:27.195 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install python3-rbd 2024-08-01T06:45:27.778 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:48 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:45:27.866 INFO:teuthology.orchestra.run.smithi016.stdout:Package python3-rbd-2:18.2.2-1767.ga3bbd728.el9.x86_64 is already installed. 2024-08-01T06:45:27.911 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:45:27.912 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-08-01T06:45:27.912 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:45:27.977 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install rbd-fuse 2024-08-01T06:45:28.549 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:49 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:45:28.685 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:45:28.686 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:28.686 INFO:teuthology.orchestra.run.smithi016.stdout: Package Architecture Version Repository Size 2024-08-01T06:45:28.686 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:28.686 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-08-01T06:45:28.686 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 87 k 2024-08-01T06:45:28.686 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:28.686 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-08-01T06:45:28.686 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:28.686 INFO:teuthology.orchestra.run.smithi016.stdout:Install 1 Package 2024-08-01T06:45:28.686 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:28.686 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 87 k 2024-08-01T06:45:28.687 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 227 k 2024-08-01T06:45:28.687 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-08-01T06:45:28.897 INFO:teuthology.orchestra.run.smithi016.stdout:rbd-fuse-18.2.2-1767.ga3bbd728.el9.x86_64.rpm 412 kB/s | 87 kB 00:00 2024-08-01T06:45:28.898 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:45:28.898 INFO:teuthology.orchestra.run.smithi016.stdout:Total 409 kB/s | 87 kB 00:00 2024-08-01T06:45:28.898 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-08-01T06:45:28.906 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-08-01T06:45:28.906 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-08-01T06:45:28.974 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-08-01T06:45:28.975 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-08-01T06:45:29.119 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-08-01T06:45:29.239 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-fuse-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:29.642 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: rbd-fuse-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:29.883 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-fuse-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:29.883 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:29.883 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-08-01T06:45:29.883 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:45:29.883 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:29.883 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:45:30.099 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install rbd-mirror 2024-08-01T06:45:30.677 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:51 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:45:30.809 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:45:30.810 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:30.810 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repo Size 2024-08-01T06:45:30.810 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:30.810 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-08-01T06:45:30.810 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-mirror x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 3.0 M 2024-08-01T06:45:30.810 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:30.811 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-08-01T06:45:30.811 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:30.811 INFO:teuthology.orchestra.run.smithi016.stdout:Install 1 Package 2024-08-01T06:45:30.811 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:30.811 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 3.0 M 2024-08-01T06:45:30.811 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 12 M 2024-08-01T06:45:30.811 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-08-01T06:45:31.169 INFO:teuthology.orchestra.run.smithi016.stdout:rbd-mirror-18.2.2-1767.ga3bbd728.el9.x86_64.rpm 8.4 MB/s | 3.0 MB 00:00 2024-08-01T06:45:31.170 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:45:31.170 INFO:teuthology.orchestra.run.smithi016.stdout:Total 8.3 MB/s | 3.0 MB 00:00 2024-08-01T06:45:31.171 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-08-01T06:45:31.181 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-08-01T06:45:31.181 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-08-01T06:45:31.266 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-08-01T06:45:31.266 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-08-01T06:45:31.716 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-08-01T06:45:31.775 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-mirror-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:31.802 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:31.802 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-01T06:45:31.802 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-01T06:45:31.802 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-01T06:45:31.802 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-01T06:45:31.803 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:32.880 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-mirror-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:32.880 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:32.880 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-08-01T06:45:32.880 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-mirror-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:45:32.880 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:32.880 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:45:33.097 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install rbd-nbd 2024-08-01T06:45:33.678 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:54 ago on Thu 01 Aug 2024 06:43:39 AM UTC. 2024-08-01T06:45:33.812 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-08-01T06:45:33.812 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:33.812 INFO:teuthology.orchestra.run.smithi016.stdout: Package Architecture Version Repository Size 2024-08-01T06:45:33.812 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:33.812 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-08-01T06:45:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-nbd x86_64 2:18.2.2-1767.ga3bbd728.el9 ceph 172 k 2024-08-01T06:45:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:33.813 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-08-01T06:45:33.813 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-08-01T06:45:33.813 INFO:teuthology.orchestra.run.smithi016.stdout:Install 1 Package 2024-08-01T06:45:33.813 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:33.813 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 172 k 2024-08-01T06:45:33.814 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 494 k 2024-08-01T06:45:33.814 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-08-01T06:45:34.047 INFO:teuthology.orchestra.run.smithi016.stdout:rbd-nbd-18.2.2-1767.ga3bbd728.el9.x86_64.rpm 738 kB/s | 172 kB 00:00 2024-08-01T06:45:34.047 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:45:34.048 INFO:teuthology.orchestra.run.smithi016.stdout:Total 734 kB/s | 172 kB 00:00 2024-08-01T06:45:34.048 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-08-01T06:45:34.057 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-08-01T06:45:34.057 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-08-01T06:45:34.123 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-08-01T06:45:34.123 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-08-01T06:45:34.294 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-08-01T06:45:34.397 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-nbd-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:34.816 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: rbd-nbd-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:35.052 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-nbd-2:18.2.2-1767.ga3bbd728.el9.x86_64 1/1 2024-08-01T06:45:35.052 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:35.052 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-08-01T06:45:35.052 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-nbd-2:18.2.2-1767.ga3bbd728.el9.x86_64 2024-08-01T06:45:35.052 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:45:35.053 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-08-01T06:45:35.299 DEBUG:teuthology.parallel:result is None 2024-08-01T06:45:35.300 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-01T06:45:35.300 INFO:teuthology.packaging:ref: None 2024-08-01T06:45:35.300 INFO:teuthology.packaging:tag: None 2024-08-01T06:45:35.300 INFO:teuthology.packaging:branch: reef 2024-08-01T06:45:35.300 INFO:teuthology.packaging:sha1: f9911e17b12222fbe598fff73cd3ad10d20c5776 2024-08-01T06:45:35.300 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-08-01T06:45:35.531 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-01T06:45:35.555 INFO:teuthology.orchestra.run.smithi016.stdout:18.2.2-1767.ga3bbd728.el9 2024-08-01T06:45:35.556 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1767.ga3bbd728.el9 2024-08-01T06:45:35.556 INFO:teuthology.task.install:The correct ceph version 18.2.2-1767.ga3bbd728 is installed. 2024-08-01T06:45:35.558 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-01T06:45:35.558 INFO:teuthology.packaging:ref: None 2024-08-01T06:45:35.558 INFO:teuthology.packaging:tag: None 2024-08-01T06:45:35.558 INFO:teuthology.packaging:branch: reef 2024-08-01T06:45:35.558 INFO:teuthology.packaging:sha1: f9911e17b12222fbe598fff73cd3ad10d20c5776 2024-08-01T06:45:35.558 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-08-01T06:45:35.769 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-01T06:45:35.796 INFO:teuthology.orchestra.run.smithi089.stdout:18.2.2-1767.ga3bbd728.el9 2024-08-01T06:45:35.796 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1767.ga3bbd728.el9 2024-08-01T06:45:35.796 INFO:teuthology.task.install:The correct ceph version 18.2.2-1767.ga3bbd728 is installed. 2024-08-01T06:45:35.798 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-01T06:45:35.798 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-08-01T06:45:35.799 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-01T06:45:35.831 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-01T06:45:35.831 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-01T06:45:35.866 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-01T06:45:35.867 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-08-01T06:45:35.867 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/daemon-helper 2024-08-01T06:45:35.902 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-01T06:45:35.973 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-01T06:45:35.974 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2024-08-01T06:45:36.002 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-01T06:45:36.070 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-01T06:45:36.070 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-08-01T06:45:36.071 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-01T06:45:36.100 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-01T06:45:36.169 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-01T06:45:36.169 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-01T06:45:36.197 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-01T06:45:36.264 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-01T06:45:36.265 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-08-01T06:45:36.265 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/stdin-killer 2024-08-01T06:45:36.293 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-01T06:45:36.362 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-01T06:45:36.362 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2024-08-01T06:45:36.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-01T06:45:36.455 INFO:teuthology.run_tasks:Running task print... 2024-08-01T06:45:36.465 INFO:teuthology.task.print:**** done install task... 2024-08-01T06:45:36.465 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-01T06:45:36.576 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:reef', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'f9911e17b12222fbe598fff73cd3ad10d20c5776'} 2024-08-01T06:45:36.576 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:reef 2024-08-01T06:45:36.576 INFO:tasks.cephadm:Cluster fsid is a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:45:36.576 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-01T06:45:36.577 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-08-01T06:45:36.577 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi016': '172.21.15.16', 'mon.smithi089': '172.21.15.89'} 2024-08-01T06:45:36.577 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-01T06:45:36.577 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname $(hostname -s) 2024-08-01T06:45:36.607 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname $(hostname -s) 2024-08-01T06:45:36.634 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-08-01T06:45:36.635 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f9911e17b12222fbe598fff73cd3ad10d20c5776 2024-08-01T06:45:36.774 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'f9911e17b12222fbe598fff73cd3ad10d20c5776', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/55731/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.0-1223-gf9911e17', 'node_name': '172.21.2.4+braggi04', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.0-1223.gf9911e17'}, 'url': 'https://4.chacra.ceph.com/r/ceph/squid/f9911e17b12222fbe598fff73cd3ad10d20c5776/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-07-30 22:03:49.797843', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/squid/f9911e17b12222fbe598fff73cd3ad10d20c5776/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-08-01T06:45:36.996 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref reef, sha1 a3bbd7289877bdcce87fd1f79da1a2d6578dde36 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-08-01T06:45:36.997 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/reef/a3bbd7289877bdcce87fd1f79da1a2d6578dde36/centos/9/x86_64/flavors/default/cephadm 2024-08-01T06:45:36.997 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/reef/a3bbd7289877bdcce87fd1f79da1a2d6578dde36/centos/9/x86_64/flavors/default/cephadm 2024-08-01T06:45:36.998 DEBUG:teuthology.orchestra.run.smithi016:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/a3bbd7289877bdcce87fd1f79da1a2d6578dde36/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-01T06:45:37.374 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r--. 1 ubuntu ubuntu 215594 Aug 1 06:45 /home/ubuntu/cephtest/cephadm 2024-08-01T06:45:37.374 DEBUG:teuthology.orchestra.run.smithi089:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/a3bbd7289877bdcce87fd1f79da1a2d6578dde36/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-01T06:45:37.741 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r--. 1 ubuntu ubuntu 215594 Aug 1 06:45 /home/ubuntu/cephtest/cephadm 2024-08-01T06:45:37.741 DEBUG:teuthology.orchestra.run.smithi016:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-01T06:45:37.762 DEBUG:teuthology.orchestra.run.smithi089:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-01T06:45:37.793 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:reef on all hosts... 2024-08-01T06:45:37.794 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-08-01T06:45:37.805 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-08-01T06:45:38.660 INFO:teuthology.orchestra.run.smithi016.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-08-01T06:45:38.735 INFO:teuthology.orchestra.run.smithi089.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-08-01T06:46:07.988 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:46:07.989 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_version": "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)", 2024-08-01T06:46:07.989 INFO:teuthology.orchestra.run.smithi016.stdout: "image_id": "d280790d1980f9ccca1416b0016ae8076dfdf14ec2e6b48f73b6dd2bb635bf63", 2024-08-01T06:46:07.989 INFO:teuthology.orchestra.run.smithi016.stdout: "repo_digests": [ 2024-08-01T06:46:07.989 INFO:teuthology.orchestra.run.smithi016.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448" 2024-08-01T06:46:07.989 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-08-01T06:46:07.989 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:46:13.573 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-01T06:46:13.574 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_version": "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)", 2024-08-01T06:46:13.574 INFO:teuthology.orchestra.run.smithi089.stdout: "image_id": "d280790d1980f9ccca1416b0016ae8076dfdf14ec2e6b48f73b6dd2bb635bf63", 2024-08-01T06:46:13.574 INFO:teuthology.orchestra.run.smithi089.stdout: "repo_digests": [ 2024-08-01T06:46:13.574 INFO:teuthology.orchestra.run.smithi089.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448" 2024-08-01T06:46:13.574 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-08-01T06:46:13.574 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-01T06:46:13.594 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph 2024-08-01T06:46:13.628 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph 2024-08-01T06:46:13.656 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 777 /etc/ceph 2024-08-01T06:46:13.698 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /etc/ceph 2024-08-01T06:46:13.723 INFO:tasks.cephadm:Writing seed config... 2024-08-01T06:46:13.724 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-08-01T06:46:13.725 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-08-01T06:46:13.725 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-08-01T06:46:13.725 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-08-01T06:46:13.725 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-08-01T06:46:13.725 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-08-01T06:46:13.725 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-08-01T06:46:13.725 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-08-01T06:46:13.725 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-08-01T06:46:13.725 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-01T06:46:13.725 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-01T06:46:13.725 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-08-01T06:46:13.726 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-08-01T06:46:13.726 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-08-01T06:46:13.726 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-08-01T06:46:13.726 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-08-01T06:46:13.726 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-08-01T06:46:13.726 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-08-01T06:46:13.726 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-08-01T06:46:13.726 INFO:tasks.cephadm: override: [client] debug client = 20 2024-08-01T06:46:13.726 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-08-01T06:46:13.726 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-08-01T06:46:13.726 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-08-01T06:46:13.726 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-08-01T06:46:13.726 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-08-01T06:46:13.727 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-08-01T06:46:13.727 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-08-01T06:46:13.727 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-08-01T06:46:13.727 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-08-01T06:46:13.727 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-08-01T06:46:13.727 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-08-01T06:46:13.727 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-08-01T06:46:13.727 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-08-01T06:46:13.727 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-08-01T06:46:13.727 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-08-01T06:46:13.727 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-01T06:46:13.727 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-01T06:46:13.727 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-01T06:46:13.727 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-01T06:46:13.727 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-01T06:46:13.728 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-08-01T06:46:13.728 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-08-01T06:46:13.728 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-08-01T06:46:13.728 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-08-01T06:46:13.729 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-01T06:46:13.756 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = a88427da-4fd1-11ef-bcca-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-08-01T06:46:13.756 DEBUG:teuthology.orchestra.run.smithi016:mon.smithi016> sudo journalctl -f -n 0 -u ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mon.smithi016.service 2024-08-01T06:46:13.803 INFO:tasks.cephadm:Bootstrapping... 2024-08-01T06:46:13.804 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef -v bootstrap --fsid a88427da-4fd1-11ef-bcca-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.16 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-01T06:46:13.972 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-08-01T06:46:13.972 INFO:teuthology.orchestra.run.smithi016.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:reef', '-v', 'bootstrap', '--fsid', 'a88427da-4fd1-11ef-bcca-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.16', '--skip-admin-label'] 2024-08-01T06:46:13.998 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stdout 5.1.2 2024-08-01T06:46:13.998 INFO:teuthology.orchestra.run.smithi016.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-01T06:46:13.999 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying podman|docker is present... 2024-08-01T06:46:14.023 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stdout 5.1.2 2024-08-01T06:46:14.023 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying lvm2 is present... 2024-08-01T06:46:14.023 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying time synchronization is in place... 2024-08-01T06:46:14.030 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-01T06:46:14.031 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-01T06:46:14.037 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-01T06:46:14.037 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout inactive 2024-08-01T06:46:14.044 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout enabled 2024-08-01T06:46:14.051 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout active 2024-08-01T06:46:14.051 INFO:teuthology.orchestra.run.smithi016.stdout:Unit chronyd.service is enabled and running 2024-08-01T06:46:14.051 INFO:teuthology.orchestra.run.smithi016.stdout:Repeating the final host check... 2024-08-01T06:46:14.075 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stdout 5.1.2 2024-08-01T06:46:14.075 INFO:teuthology.orchestra.run.smithi016.stdout:podman (/bin/podman) version 5.1.2 is present 2024-08-01T06:46:14.075 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl is present 2024-08-01T06:46:14.075 INFO:teuthology.orchestra.run.smithi016.stdout:lvcreate is present 2024-08-01T06:46:14.082 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-01T06:46:14.082 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-01T06:46:14.088 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-01T06:46:14.088 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout inactive 2024-08-01T06:46:14.095 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout enabled 2024-08-01T06:46:14.101 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout active 2024-08-01T06:46:14.101 INFO:teuthology.orchestra.run.smithi016.stdout:Unit chronyd.service is enabled and running 2024-08-01T06:46:14.101 INFO:teuthology.orchestra.run.smithi016.stdout:Host looks OK 2024-08-01T06:46:14.102 INFO:teuthology.orchestra.run.smithi016.stdout:Cluster fsid: a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:46:14.102 INFO:teuthology.orchestra.run.smithi016.stdout:Acquiring lock 140550720606512 on /run/cephadm/a88427da-4fd1-11ef-bcca-c7b262605968.lock 2024-08-01T06:46:14.102 INFO:teuthology.orchestra.run.smithi016.stdout:Lock 140550720606512 acquired on /run/cephadm/a88427da-4fd1-11ef-bcca-c7b262605968.lock 2024-08-01T06:46:14.102 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying IP 172.21.15.16 port 3300 ... 2024-08-01T06:46:14.102 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying IP 172.21.15.16 port 6789 ... 2024-08-01T06:46:14.103 INFO:teuthology.orchestra.run.smithi016.stdout:Base mon IP(s) is [172.21.15.16:3300, 172.21.15.16:6789], mon addrv is [v2:172.21.15.16:3300,v1:172.21.15.16:6789] 2024-08-01T06:46:14.106 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.16 metric 100 2024-08-01T06:46:14.106 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.16 metric 100 2024-08-01T06:46:14.108 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-01T06:46:14.109 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-08-01T06:46:14.109 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-08-01T06:46:14.111 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-01T06:46:14.111 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-01T06:46:14.111 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-01T06:46:14.111 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout 3: ens1f0: mtu 1500 state UP qlen 1000 2024-08-01T06:46:14.111 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1564/64 scope link noprefixroute 2024-08-01T06:46:14.112 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-01T06:46:14.112 INFO:teuthology.orchestra.run.smithi016.stdout:Mon IP `172.21.15.16` is in CIDR network `172.21.0.0/20` 2024-08-01T06:46:14.113 INFO:teuthology.orchestra.run.smithi016.stdout:Mon IP `172.21.15.16` is in CIDR network `172.21.0.0/20` 2024-08-01T06:46:14.113 INFO:teuthology.orchestra.run.smithi016.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-01T06:46:14.113 INFO:teuthology.orchestra.run.smithi016.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-01T06:46:14.113 INFO:teuthology.orchestra.run.smithi016.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-08-01T06:46:17.491 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stdout d280790d1980f9ccca1416b0016ae8076dfdf14ec2e6b48f73b6dd2bb635bf63 2024-08-01T06:46:17.491 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:reef... 2024-08-01T06:46:17.491 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stderr Getting image source signatures 2024-08-01T06:46:17.491 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stderr Copying blob sha256:9eb91971788a5cdae2d221a9ffe247467a944185f1ee1731e17dee30cbe0a51e 2024-08-01T06:46:17.491 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stderr Copying blob sha256:a0a261c93a1a3b1a5634697d0569ba314563628d3546bf9326abaa78605cead1 2024-08-01T06:46:17.491 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stderr Copying config sha256:d280790d1980f9ccca1416b0016ae8076dfdf14ec2e6b48f73b6dd2bb635bf63 2024-08-01T06:46:17.491 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/podman: stderr Writing manifest to image destination 2024-08-01T06:46:26.590 INFO:teuthology.orchestra.run.smithi016.stdout:ceph: stdout ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable) 2024-08-01T06:46:26.591 INFO:teuthology.orchestra.run.smithi016.stdout:Ceph version: ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable) 2024-08-01T06:46:26.591 INFO:teuthology.orchestra.run.smithi016.stdout:Extracting ceph user uid/gid from container image... 2024-08-01T06:46:27.517 INFO:teuthology.orchestra.run.smithi016.stdout:stat: stdout 167 167 2024-08-01T06:46:27.517 INFO:teuthology.orchestra.run.smithi016.stdout:Creating initial keys... 2024-08-01T06:46:28.364 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph-authtool: stdout AQBDL6tm+fYnMhAAVUdm4wf+3KFZCE6M7h3zcw== 2024-08-01T06:46:29.253 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph-authtool: stdout AQBEL6tm6XGMJxAA+0M//+DQACKxEi5XuXQPWw== 2024-08-01T06:46:30.110 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph-authtool: stdout AQBFL6tm0yP3HxAAtg7LCCmYDpKmrRu62VHFsg== 2024-08-01T06:46:30.111 INFO:teuthology.orchestra.run.smithi016.stdout:Creating initial monmap... 2024-08-01T06:46:30.984 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-01T06:46:30.984 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-08-01T06:46:30.984 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:46:30.984 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-01T06:46:30.984 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool for smithi016 [v2:172.21.15.16:3300,v1:172.21.15.16:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-01T06:46:30.984 INFO:teuthology.orchestra.run.smithi016.stdout:setting min_mon_release = pacific 2024-08-01T06:46:30.985 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/monmaptool: set fsid to a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:46:30.985 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-01T06:46:30.985 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:46:30.985 INFO:teuthology.orchestra.run.smithi016.stdout:Creating mon... 2024-08-01T06:46:32.644 INFO:teuthology.orchestra.run.smithi016.stdout:create mon.smithi016 on 2024-08-01T06:46:32.866 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-08-01T06:46:33.034 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-08-01T06:46:33.212 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-a88427da-4fd1-11ef-bcca-c7b262605968.target → /etc/systemd/system/ceph-a88427da-4fd1-11ef-bcca-c7b262605968.target. 2024-08-01T06:46:33.212 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-a88427da-4fd1-11ef-bcca-c7b262605968.target → /etc/systemd/system/ceph-a88427da-4fd1-11ef-bcca-c7b262605968.target. 2024-08-01T06:46:33.457 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mon.smithi016 2024-08-01T06:46:33.457 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mon.smithi016.service: Unit ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mon.smithi016.service not loaded. 2024-08-01T06:46:33.634 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a88427da-4fd1-11ef-bcca-c7b262605968.target.wants/ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mon.smithi016.service → /etc/systemd/system/ceph-a88427da-4fd1-11ef-bcca-c7b262605968@.service. 2024-08-01T06:46:34.138 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:34 smithi016 ceph-mon[28902]: mon.smithi016 is new leader, mons smithi016 in quorum (ranks 0) 2024-08-01T06:46:34.138 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:34 smithi016 bash[28883]: 9f57d3d5497827bcfdae58a57ed512fa7407db8f75875950f841cae8aa6ad697 2024-08-01T06:46:34.151 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-01T06:46:34.152 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout disabled 2024-08-01T06:46:34.159 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-01T06:46:34.159 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout inactive 2024-08-01T06:46:34.159 INFO:teuthology.orchestra.run.smithi016.stdout:firewalld.service is not enabled 2024-08-01T06:46:34.159 INFO:teuthology.orchestra.run.smithi016.stdout:Not possible to enable service . firewalld.service is not available 2024-08-01T06:46:34.159 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for mon to start... 2024-08-01T06:46:34.159 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for mon... 2024-08-01T06:46:34.390 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:34 smithi016 systemd[1]: Started Ceph mon.smithi016 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T06:46:35.147 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:35 smithi016 ceph-mon[28902]: mon.smithi016 is new leader, mons smithi016 in quorum (ranks 0) 2024-08-01T06:46:35.147 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:35 smithi016 ceph-mon[28902]: monmap e1: 1 mons at {smithi016=[v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-08-01T06:46:35.147 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:35 smithi016 ceph-mon[28902]: fsmap 2024-08-01T06:46:35.147 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:35 smithi016 ceph-mon[28902]: osdmap e1: 0 total, 0 up, 0 in 2024-08-01T06:46:35.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:35 smithi016 ceph-mon[28902]: mgrmap e1: no daemons active 2024-08-01T06:46:35.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:35 smithi016 ceph-mon[28902]: from='client.? 172.21.15.16:0/1115623985' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-08-01T06:46:35.149 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout cluster: 2024-08-01T06:46:35.155 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout id: a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:46:35.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-01T06:46:35.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-08-01T06:46:35.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout services: 2024-08-01T06:46:35.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi016 (age 0.547888s) 2024-08-01T06:46:35.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-01T06:46:35.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-01T06:46:35.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-08-01T06:46:35.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout data: 2024-08-01T06:46:35.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-01T06:46:35.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-01T06:46:35.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-01T06:46:35.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout pgs: 2024-08-01T06:46:35.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-08-01T06:46:35.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.569+0000 7fd08014d640 1 Processor -- start 2024-08-01T06:46:35.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.570+0000 7fd08014d640 1 -- start start 2024-08-01T06:46:35.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.570+0000 7fd08014d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0781060f0 0x7fd0781084e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:35.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.570+0000 7fd08014d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd078079dd0 con 0x7fd0781060f0 2024-08-01T06:46:35.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.570+0000 7fd07dee9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0781060f0 0x7fd0781084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:35.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.570+0000 7fd07dee9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0781060f0 0x7fd0781084e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46202/0 (socket says 172.21.15.16:46202) 2024-08-01T06:46:35.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.570+0000 7fd07dee9640 1 -- 172.21.15.16:0/4266272656 learned_addr learned my addr 172.21.15.16:0/4266272656 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:35.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.571+0000 7fd07dee9640 1 -- 172.21.15.16:0/4266272656 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd078079f10 con 0x7fd0781060f0 2024-08-01T06:46:35.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.573+0000 7fd07dee9640 1 --2- 172.21.15.16:0/4266272656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0781060f0 0x7fd0781084e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd06c009820 tx=0x7fd06c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8ec366cf449ce8 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:35.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.573+0000 7fd07cee7640 1 -- 172.21.15.16:0/4266272656 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd06c02ad40 con 0x7fd0781060f0 2024-08-01T06:46:35.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.573+0000 7fd07cee7640 1 -- 172.21.15.16:0/4266272656 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06c032440 con 0x7fd0781060f0 2024-08-01T06:46:35.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.573+0000 7fd07cee7640 1 -- 172.21.15.16:0/4266272656 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd06c02aea0 con 0x7fd0781060f0 2024-08-01T06:46:35.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.573+0000 7fd08014d640 1 -- 172.21.15.16:0/4266272656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0781060f0 msgr2=0x7fd0781084e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:35.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.573+0000 7fd08014d640 1 --2- 172.21.15.16:0/4266272656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0781060f0 0x7fd0781084e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd06c009820 tx=0x7fd06c02a270 comp rx=0 tx=0).stop 2024-08-01T06:46:35.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.573+0000 7fd08014d640 1 -- 172.21.15.16:0/4266272656 shutdown_connections 2024-08-01T06:46:35.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.573+0000 7fd08014d640 1 --2- 172.21.15.16:0/4266272656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0781060f0 0x7fd0781084e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:35.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.573+0000 7fd08014d640 1 -- 172.21.15.16:0/4266272656 >> 172.21.15.16:0/4266272656 conn(0x7fd0780ffc50 msgr2=0x7fd0781020d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:35.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.574+0000 7fd08014d640 1 -- 172.21.15.16:0/4266272656 shutdown_connections 2024-08-01T06:46:35.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.574+0000 7fd08014d640 1 -- 172.21.15.16:0/4266272656 wait complete. 2024-08-01T06:46:35.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.574+0000 7fd08014d640 1 Processor -- start 2024-08-01T06:46:35.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.574+0000 7fd08014d640 1 -- start start 2024-08-01T06:46:35.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.574+0000 7fd08014d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0781060f0 0x7fd078105970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:35.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.574+0000 7fd08014d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd078105eb0 con 0x7fd0781060f0 2024-08-01T06:46:35.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.574+0000 7fd07dee9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0781060f0 0x7fd078105970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:35.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.575+0000 7fd07dee9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0781060f0 0x7fd078105970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46210/0 (socket says 172.21.15.16:46210) 2024-08-01T06:46:35.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.575+0000 7fd07dee9640 1 -- 172.21.15.16:0/1115623985 learned_addr learned my addr 172.21.15.16:0/1115623985 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:35.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.575+0000 7fd07dee9640 1 -- 172.21.15.16:0/1115623985 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c0094d0 con 0x7fd0781060f0 2024-08-01T06:46:35.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.575+0000 7fd07dee9640 1 --2- 172.21.15.16:0/1115623985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0781060f0 0x7fd078105970 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0090b0 tx=0x7fd06c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:35.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.575+0000 7fd06affd640 1 -- 172.21.15.16:0/1115623985 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd06c0308d0 con 0x7fd0781060f0 2024-08-01T06:46:35.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.575+0000 7fd06affd640 1 -- 172.21.15.16:0/1115623985 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06c030a30 con 0x7fd0781060f0 2024-08-01T06:46:35.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.575+0000 7fd08014d640 1 -- 172.21.15.16:0/1115623985 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0781040a0 con 0x7fd0781060f0 2024-08-01T06:46:35.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.575+0000 7fd06affd640 1 -- 172.21.15.16:0/1115623985 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd06c030d30 con 0x7fd0781060f0 2024-08-01T06:46:35.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.575+0000 7fd08014d640 1 -- 172.21.15.16:0/1115623985 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd078104540 con 0x7fd0781060f0 2024-08-01T06:46:35.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.576+0000 7fd06affd640 1 -- 172.21.15.16:0/1115623985 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd06c039040 con 0x7fd0781060f0 2024-08-01T06:46:35.160 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.576+0000 7fd06affd640 1 -- 172.21.15.16:0/1115623985 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd06c03b870 con 0x7fd0781060f0 2024-08-01T06:46:35.160 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.576+0000 7fd08014d640 1 -- 172.21.15.16:0/1115623985 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd078106550 con 0x7fd0781060f0 2024-08-01T06:46:35.160 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.579+0000 7fd06affd640 1 -- 172.21.15.16:0/1115623985 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fd06c037070 con 0x7fd0781060f0 2024-08-01T06:46:35.160 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.639+0000 7fd08014d640 1 -- 172.21.15.16:0/1115623985 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fd078108e10 con 0x7fd0781060f0 2024-08-01T06:46:35.160 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.639+0000 7fd06affd640 1 -- 172.21.15.16:0/1115623985 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7fd06c03bb40 con 0x7fd0781060f0 2024-08-01T06:46:35.160 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.640+0000 7fd08014d640 1 -- 172.21.15.16:0/1115623985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0781060f0 msgr2=0x7fd078105970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:35.160 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.640+0000 7fd08014d640 1 --2- 172.21.15.16:0/1115623985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0781060f0 0x7fd078105970 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0090b0 tx=0x7fd06c0046c0 comp rx=0 tx=0).stop 2024-08-01T06:46:35.160 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.640+0000 7fd08014d640 1 -- 172.21.15.16:0/1115623985 shutdown_connections 2024-08-01T06:46:35.160 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.640+0000 7fd08014d640 1 --2- 172.21.15.16:0/1115623985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0781060f0 0x7fd078105970 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:35.160 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.640+0000 7fd08014d640 1 -- 172.21.15.16:0/1115623985 >> 172.21.15.16:0/1115623985 conn(0x7fd0780ffc50 msgr2=0x7fd078100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:35.160 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.641+0000 7fd08014d640 1 -- 172.21.15.16:0/1115623985 shutdown_connections 2024-08-01T06:46:35.160 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:34.641+0000 7fd08014d640 1 -- 172.21.15.16:0/1115623985 wait complete. 2024-08-01T06:46:35.160 INFO:teuthology.orchestra.run.smithi016.stdout:mon is available 2024-08-01T06:46:35.161 INFO:teuthology.orchestra.run.smithi016.stdout:Assimilating anything we can from ceph.conf... 2024-08-01T06:46:36.195 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:36 smithi016 ceph-mon[28902]: from='client.? 172.21.15.16:0/4023072507' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-08-01T06:46:36.195 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:36 smithi016 ceph-mon[28902]: from='client.? 172.21.15.16:0/4023072507' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-01T06:46:36.205 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-08-01T06:46:36.205 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout [global] 2024-08-01T06:46:36.205 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout fsid = a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:46:36.205 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.16:3300,v1:172.21.15.16:6789] 2024-08-01T06:46:36.205 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-01T06:46:36.205 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-01T06:46:36.205 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-01T06:46:36.205 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-01T06:46:36.206 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-08-01T06:46:36.206 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-01T06:46:36.206 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-01T06:46:36.206 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-08-01T06:46:36.206 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout [osd] 2024-08-01T06:46:36.206 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-01T06:46:36.206 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-01T06:46:36.206 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-01T06:46:36.206 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-01T06:46:36.206 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-01T06:46:36.207 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.545+0000 7f16c94b5640 1 Processor -- start 2024-08-01T06:46:36.207 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.545+0000 7f16c94b5640 1 -- start start 2024-08-01T06:46:36.207 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.546+0000 7f16c94b5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16c41055c0 0x7f16c41059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:36.207 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.546+0000 7f16c94b5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c4105f90 con 0x7f16c41055c0 2024-08-01T06:46:36.207 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.546+0000 7f16c2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16c41055c0 0x7f16c41059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:36.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.546+0000 7f16c2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16c41055c0 0x7f16c41059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46212/0 (socket says 172.21.15.16:46212) 2024-08-01T06:46:36.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.546+0000 7f16c2ffd640 1 -- 172.21.15.16:0/4006783317 learned_addr learned my addr 172.21.15.16:0/4006783317 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:36.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.546+0000 7f16c2ffd640 1 -- 172.21.15.16:0/4006783317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c41067c0 con 0x7f16c41055c0 2024-08-01T06:46:36.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.547+0000 7f16c2ffd640 1 --2- 172.21.15.16:0/4006783317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16c41055c0 0x7f16c41059c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009e80 tx=0x7f16b402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d3f5cf12104d9a server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:36.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.547+0000 7f16c1ffb640 1 -- 172.21.15.16:0/4006783317 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16b4031400 con 0x7f16c41055c0 2024-08-01T06:46:36.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.547+0000 7f16c1ffb640 1 -- 172.21.15.16:0/4006783317 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b402d050 con 0x7f16c41055c0 2024-08-01T06:46:36.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.547+0000 7f16c1ffb640 1 -- 172.21.15.16:0/4006783317 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16b40316d0 con 0x7f16c41055c0 2024-08-01T06:46:36.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.547+0000 7f16c94b5640 1 -- 172.21.15.16:0/4006783317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16c41055c0 msgr2=0x7f16c41059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:36.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.547+0000 7f16c94b5640 1 --2- 172.21.15.16:0/4006783317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16c41055c0 0x7f16c41059c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009e80 tx=0x7f16b402a7a0 comp rx=0 tx=0).stop 2024-08-01T06:46:36.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.548+0000 7f16c94b5640 1 -- 172.21.15.16:0/4006783317 shutdown_connections 2024-08-01T06:46:36.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.548+0000 7f16c94b5640 1 --2- 172.21.15.16:0/4006783317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16c41055c0 0x7f16c41059c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:36.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.548+0000 7f16c94b5640 1 -- 172.21.15.16:0/4006783317 >> 172.21.15.16:0/4006783317 conn(0x7f16c4100d30 msgr2=0x7f16c4103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:36.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.548+0000 7f16c94b5640 1 -- 172.21.15.16:0/4006783317 shutdown_connections 2024-08-01T06:46:36.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.548+0000 7f16c94b5640 1 -- 172.21.15.16:0/4006783317 wait complete. 2024-08-01T06:46:36.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.548+0000 7f16c94b5640 1 Processor -- start 2024-08-01T06:46:36.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.548+0000 7f16c94b5640 1 -- start start 2024-08-01T06:46:36.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.549+0000 7f16c94b5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16c41055c0 0x7f16c4198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:36.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.549+0000 7f16c94b5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c41990a0 con 0x7f16c41055c0 2024-08-01T06:46:36.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.549+0000 7f16c2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16c41055c0 0x7f16c4198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:36.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.549+0000 7f16c2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16c41055c0 0x7f16c4198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46224/0 (socket says 172.21.15.16:46224) 2024-08-01T06:46:36.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.549+0000 7f16c2ffd640 1 -- 172.21.15.16:0/4023072507 learned_addr learned my addr 172.21.15.16:0/4023072507 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:36.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.549+0000 7f16c2ffd640 1 -- 172.21.15.16:0/4023072507 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b4009b30 con 0x7f16c41055c0 2024-08-01T06:46:36.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.549+0000 7f16c2ffd640 1 --2- 172.21.15.16:0/4023072507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16c41055c0 0x7f16c4198b60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f16b402acc0 tx=0x7f16b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:36.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.549+0000 7f16abfff640 1 -- 172.21.15.16:0/4023072507 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16b403b7d0 con 0x7f16c41055c0 2024-08-01T06:46:36.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.549+0000 7f16abfff640 1 -- 172.21.15.16:0/4023072507 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b403b930 con 0x7f16c41055c0 2024-08-01T06:46:36.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.549+0000 7f16abfff640 1 -- 172.21.15.16:0/4023072507 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16b403bc30 con 0x7f16c41055c0 2024-08-01T06:46:36.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.549+0000 7f16c94b5640 1 -- 172.21.15.16:0/4023072507 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c41992a0 con 0x7f16c41055c0 2024-08-01T06:46:36.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.549+0000 7f16c94b5640 1 -- 172.21.15.16:0/4023072507 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c4199740 con 0x7f16c41055c0 2024-08-01T06:46:36.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.550+0000 7f16abfff640 1 -- 172.21.15.16:0/4023072507 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f16b4038040 con 0x7f16c41055c0 2024-08-01T06:46:36.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.550+0000 7f16abfff640 1 -- 172.21.15.16:0/4023072507 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f16b403a3d0 con 0x7f16c41055c0 2024-08-01T06:46:36.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.550+0000 7f16c94b5640 1 -- 172.21.15.16:0/4023072507 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c4192220 con 0x7f16c41055c0 2024-08-01T06:46:36.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.552+0000 7f16abfff640 1 -- 172.21.15.16:0/4023072507 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f16b404b060 con 0x7f16c41055c0 2024-08-01T06:46:36.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.611+0000 7f16c94b5640 1 -- 172.21.15.16:0/4023072507 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f16c4106b30 con 0x7f16c41055c0 2024-08-01T06:46:36.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.614+0000 7f16abfff640 1 -- 172.21.15.16:0/4023072507 <== mon.0 v2:172.21.15.16:3300/0 7 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f16b403aa60 con 0x7f16c41055c0 2024-08-01T06:46:36.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.614+0000 7f16abfff640 1 -- 172.21.15.16:0/4023072507 <== mon.0 v2:172.21.15.16:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f16b4042070 con 0x7f16c41055c0 2024-08-01T06:46:36.211 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.615+0000 7f16c94b5640 1 -- 172.21.15.16:0/4023072507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16c41055c0 msgr2=0x7f16c4198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:36.211 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.615+0000 7f16c94b5640 1 --2- 172.21.15.16:0/4023072507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16c41055c0 0x7f16c4198b60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f16b402acc0 tx=0x7f16b4004a40 comp rx=0 tx=0).stop 2024-08-01T06:46:36.211 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.615+0000 7f16c94b5640 1 -- 172.21.15.16:0/4023072507 shutdown_connections 2024-08-01T06:46:36.211 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.615+0000 7f16c94b5640 1 --2- 172.21.15.16:0/4023072507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16c41055c0 0x7f16c4198b60 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:36.211 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.615+0000 7f16c94b5640 1 -- 172.21.15.16:0/4023072507 >> 172.21.15.16:0/4023072507 conn(0x7f16c4100d30 msgr2=0x7f16c418cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:36.211 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.615+0000 7f16c94b5640 1 -- 172.21.15.16:0/4023072507 shutdown_connections 2024-08-01T06:46:36.211 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:35.615+0000 7f16c94b5640 1 -- 172.21.15.16:0/4023072507 wait complete. 2024-08-01T06:46:36.211 INFO:teuthology.orchestra.run.smithi016.stdout:Generating new minimal ceph.conf... 2024-08-01T06:46:37.268 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:37 smithi016 ceph-mon[28902]: from='client.? 172.21.15.16:0/1449979395' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:46:37.275 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.627+0000 7fab41f49640 1 Processor -- start 2024-08-01T06:46:37.275 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.627+0000 7fab41f49640 1 -- start start 2024-08-01T06:46:37.275 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.627+0000 7fab41f49640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab3c106050 0x7fab3c108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:37.275 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.627+0000 7fab41f49640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c079ea0 con 0x7fab3c106050 2024-08-01T06:46:37.275 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.627+0000 7fab3b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab3c106050 0x7fab3c108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:37.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.627+0000 7fab3b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab3c106050 0x7fab3c108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46232/0 (socket says 172.21.15.16:46232) 2024-08-01T06:46:37.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.627+0000 7fab3b7fe640 1 -- 172.21.15.16:0/1633906959 learned_addr learned my addr 172.21.15.16:0/1633906959 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:37.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.627+0000 7fab3b7fe640 1 -- 172.21.15.16:0/1633906959 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3c108980 con 0x7fab3c106050 2024-08-01T06:46:37.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.628+0000 7fab3b7fe640 1 --2- 172.21.15.16:0/1633906959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab3c106050 0x7fab3c108440 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009820 tx=0x7fab2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42da0052e163a93 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:37.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.628+0000 7fab3a7fc640 1 -- 172.21.15.16:0/1633906959 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab2c02ad40 con 0x7fab3c106050 2024-08-01T06:46:37.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.628+0000 7fab3a7fc640 1 -- 172.21.15.16:0/1633906959 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fab2c0328c0 con 0x7fab3c106050 2024-08-01T06:46:37.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.628+0000 7fab3a7fc640 1 -- 172.21.15.16:0/1633906959 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab2c0307f0 con 0x7fab3c106050 2024-08-01T06:46:37.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.629+0000 7fab41f49640 1 -- 172.21.15.16:0/1633906959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab3c106050 msgr2=0x7fab3c108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:37.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.629+0000 7fab41f49640 1 --2- 172.21.15.16:0/1633906959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab3c106050 0x7fab3c108440 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009820 tx=0x7fab2c02a270 comp rx=0 tx=0).stop 2024-08-01T06:46:37.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.629+0000 7fab41f49640 1 -- 172.21.15.16:0/1633906959 shutdown_connections 2024-08-01T06:46:37.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.629+0000 7fab41f49640 1 --2- 172.21.15.16:0/1633906959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab3c106050 0x7fab3c108440 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:37.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.629+0000 7fab41f49640 1 -- 172.21.15.16:0/1633906959 >> 172.21.15.16:0/1633906959 conn(0x7fab3c0ffc50 msgr2=0x7fab3c1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:37.276 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.629+0000 7fab41f49640 1 -- 172.21.15.16:0/1633906959 shutdown_connections 2024-08-01T06:46:37.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.629+0000 7fab41f49640 1 -- 172.21.15.16:0/1633906959 wait complete. 2024-08-01T06:46:37.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.629+0000 7fab41f49640 1 Processor -- start 2024-08-01T06:46:37.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.630+0000 7fab41f49640 1 -- start start 2024-08-01T06:46:37.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.630+0000 7fab41f49640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab3c106050 0x7fab3c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:37.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.630+0000 7fab41f49640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c1997f0 con 0x7fab3c106050 2024-08-01T06:46:37.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.630+0000 7fab3b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab3c106050 0x7fab3c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:37.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.630+0000 7fab3b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab3c106050 0x7fab3c1992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46246/0 (socket says 172.21.15.16:46246) 2024-08-01T06:46:37.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.630+0000 7fab3b7fe640 1 -- 172.21.15.16:0/1449979395 learned_addr learned my addr 172.21.15.16:0/1449979395 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:37.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.630+0000 7fab3b7fe640 1 -- 172.21.15.16:0/1449979395 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2c0094d0 con 0x7fab3c106050 2024-08-01T06:46:37.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.630+0000 7fab3b7fe640 1 --2- 172.21.15.16:0/1449979395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab3c106050 0x7fab3c1992b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fab2c030d30 tx=0x7fab2c030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:37.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.631+0000 7fab38ff9640 1 -- 172.21.15.16:0/1449979395 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab2c032c40 con 0x7fab3c106050 2024-08-01T06:46:37.277 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.631+0000 7fab38ff9640 1 -- 172.21.15.16:0/1449979395 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fab2c032da0 con 0x7fab3c106050 2024-08-01T06:46:37.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.631+0000 7fab41f49640 1 -- 172.21.15.16:0/1449979395 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3c1999f0 con 0x7fab3c106050 2024-08-01T06:46:37.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.631+0000 7fab38ff9640 1 -- 172.21.15.16:0/1449979395 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab2c03c660 con 0x7fab3c106050 2024-08-01T06:46:37.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.631+0000 7fab41f49640 1 -- 172.21.15.16:0/1449979395 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3c199e10 con 0x7fab3c106050 2024-08-01T06:46:37.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.631+0000 7fab38ff9640 1 -- 172.21.15.16:0/1449979395 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fab2c03cac0 con 0x7fab3c106050 2024-08-01T06:46:37.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.631+0000 7fab38ff9640 1 -- 172.21.15.16:0/1449979395 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fab2c047e30 con 0x7fab3c106050 2024-08-01T06:46:37.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.632+0000 7fab41f49640 1 -- 172.21.15.16:0/1449979395 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3c109700 con 0x7fab3c106050 2024-08-01T06:46:37.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.634+0000 7fab38ff9640 1 -- 172.21.15.16:0/1449979395 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fab2c037070 con 0x7fab3c106050 2024-08-01T06:46:37.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.692+0000 7fab41f49640 1 -- 172.21.15.16:0/1449979395 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fab3c19ca20 con 0x7fab3c106050 2024-08-01T06:46:37.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.693+0000 7fab38ff9640 1 -- 172.21.15.16:0/1449979395 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fab2c03db00 con 0x7fab3c106050 2024-08-01T06:46:37.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.693+0000 7fab41f49640 1 -- 172.21.15.16:0/1449979395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab3c106050 msgr2=0x7fab3c1992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:37.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.693+0000 7fab41f49640 1 --2- 172.21.15.16:0/1449979395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab3c106050 0x7fab3c1992b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fab2c030d30 tx=0x7fab2c030d60 comp rx=0 tx=0).stop 2024-08-01T06:46:37.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.693+0000 7fab41f49640 1 -- 172.21.15.16:0/1449979395 shutdown_connections 2024-08-01T06:46:37.278 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.693+0000 7fab41f49640 1 --2- 172.21.15.16:0/1449979395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab3c106050 0x7fab3c1992b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:37.279 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.693+0000 7fab41f49640 1 -- 172.21.15.16:0/1449979395 >> 172.21.15.16:0/1449979395 conn(0x7fab3c0ffc50 msgr2=0x7fab3c100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:37.279 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.694+0000 7fab41f49640 1 -- 172.21.15.16:0/1449979395 shutdown_connections 2024-08-01T06:46:37.279 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:36.694+0000 7fab41f49640 1 -- 172.21.15.16:0/1449979395 wait complete. 2024-08-01T06:46:37.279 INFO:teuthology.orchestra.run.smithi016.stdout:Restarting the monitor... 2024-08-01T06:46:37.539 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:37 smithi016 systemd[1]: Stopping Ceph mon.smithi016 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T06:46:37.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:37 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016[28898]: 2024-08-01T06:46:37.537+0000 7f242c79d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi016 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-01T06:46:37.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:37 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016[28898]: 2024-08-01T06:46:37.537+0000 7f242c79d640 -1 mon.smithi016@0(leader) e1 *** Got Signal Terminated *** 2024-08-01T06:46:37.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:37 smithi016 podman[29144]: 2024-08-01 06:46:37.783576075 +0000 UTC m=+0.337686801 container died 9f57d3d5497827bcfdae58a57ed512fa7407db8f75875950f841cae8aa6ad697 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.36.0, RELEASE=reef-a3bbd72, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716, org.label-schema.license=GPLv2) 2024-08-01T06:46:38.532 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:38 smithi016 podman[29144]: 2024-08-01 06:46:38.528665055 +0000 UTC m=+1.082775780 container cleanup 9f57d3d5497827bcfdae58a57ed512fa7407db8f75875950f841cae8aa6ad697 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240716, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=reef-a3bbd72, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-08-01T06:46:38.532 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:38 smithi016 bash[29144]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016 2024-08-01T06:46:38.955 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:38 smithi016 podman[29156]: 2024-08-01 06:46:38.70441797 +0000 UTC m=+0.915903180 container remove 9f57d3d5497827bcfdae58a57ed512fa7407db8f75875950f841cae8aa6ad697 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240716, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=reef-a3bbd72, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-01T06:46:39.270 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:38 smithi016 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mon.smithi016.service: Deactivated successfully. 2024-08-01T06:46:39.270 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:38 smithi016 systemd[1]: Stopped Ceph mon.smithi016 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T06:46:39.270 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:38 smithi016 systemd[1]: Starting Ceph mon.smithi016 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T06:46:39.270 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 podman[29248]: 2024-08-01 06:46:39.17204936 +0000 UTC m=+0.112881316 container create e6a2e5d7eeecf90eb4155f077ee3ce88c7453ddc3ea99c8e8875a7cd074f5034 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=reef-a3bbd72, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-01T06:46:39.270 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 podman[29248]: 2024-08-01 06:46:39.076454255 +0000 UTC m=+0.017286213 image pull d280790d1980f9ccca1416b0016ae8076dfdf14ec2e6b48f73b6dd2bb635bf63 quay.ceph.io/ceph-ci/ceph:reef 2024-08-01T06:46:39.463 INFO:teuthology.orchestra.run.smithi016.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-01T06:46:39.577 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 podman[29248]: 2024-08-01 06:46:39.382715426 +0000 UTC m=+0.323547393 container init e6a2e5d7eeecf90eb4155f077ee3ce88c7453ddc3ea99c8e8875a7cd074f5034 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=reef-a3bbd72, org.label-schema.license=GPLv2, org.label-schema.build-date=20240716, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-01T06:46:39.577 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 podman[29248]: 2024-08-01 06:46:39.385915068 +0000 UTC m=+0.326747024 container start e6a2e5d7eeecf90eb4155f077ee3ce88c7453ddc3ea99c8e8875a7cd074f5034 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=reef-a3bbd72, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-01T06:46:39.577 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: set uid:gid to 167:167 (ceph:ceph) 2024-08-01T06:46:39.577 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable), process ceph-mon, pid 2 2024-08-01T06:46:39.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: pidfile_write: ignore empty --pid-file 2024-08-01T06:46:39.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: load: jerasure load: lrc 2024-08-01T06:46:39.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: RocksDB version: 7.9.2 2024-08-01T06:46:39.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Git sha 0 2024-08-01T06:46:39.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Compile date 2024-07-24 15:35:49 2024-08-01T06:46:39.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: DB SUMMARY 2024-08-01T06:46:39.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: DB Session ID: PC61Q0BE2Q6E7BLRG9J4 2024-08-01T06:46:39.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: CURRENT file: CURRENT 2024-08-01T06:46:39.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: IDENTITY file: IDENTITY 2024-08-01T06:46:39.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-08-01T06:46:39.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi016/store.db dir, Total Num: 1, files: 000008.sst 2024-08-01T06:46:39.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi016/store.db: 000009.log size: 98991 ; 2024-08-01T06:46:39.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.error_if_exists: 0 2024-08-01T06:46:39.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.create_if_missing: 0 2024-08-01T06:46:39.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.paranoid_checks: 1 2024-08-01T06:46:39.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-01T06:46:39.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-01T06:46:39.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-01T06:46:39.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.env: 0x5569546fabc0 2024-08-01T06:46:39.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.fs: PosixFileSystem 2024-08-01T06:46:39.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.info_log: 0x556956446dc0 2024-08-01T06:46:39.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_file_opening_threads: 16 2024-08-01T06:46:39.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.statistics: (nil) 2024-08-01T06:46:39.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.use_fsync: 0 2024-08-01T06:46:39.581 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_log_file_size: 0 2024-08-01T06:46:39.581 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-01T06:46:39.581 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-01T06:46:39.581 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.keep_log_file_num: 1000 2024-08-01T06:46:39.581 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.recycle_log_file_num: 0 2024-08-01T06:46:39.581 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.allow_fallocate: 1 2024-08-01T06:46:39.581 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.allow_mmap_reads: 0 2024-08-01T06:46:39.581 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.allow_mmap_writes: 0 2024-08-01T06:46:39.582 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.use_direct_reads: 0 2024-08-01T06:46:39.582 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-01T06:46:39.582 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.create_missing_column_families: 0 2024-08-01T06:46:39.582 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.db_log_dir: 2024-08-01T06:46:39.582 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.wal_dir: 2024-08-01T06:46:39.582 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-01T06:46:39.582 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-01T06:46:39.582 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-01T06:46:39.582 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-01T06:46:39.582 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-01T06:46:39.582 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-01T06:46:39.582 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.advise_random_on_open: 1 2024-08-01T06:46:39.582 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.db_write_buffer_size: 0 2024-08-01T06:46:39.583 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.write_buffer_manager: 0x556956416140 2024-08-01T06:46:39.583 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-01T06:46:39.583 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-01T06:46:39.583 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-01T06:46:39.583 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.rate_limiter: (nil) 2024-08-01T06:46:39.583 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-01T06:46:39.583 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.wal_recovery_mode: 2 2024-08-01T06:46:39.583 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.enable_thread_tracking: 0 2024-08-01T06:46:39.583 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.enable_pipelined_write: 0 2024-08-01T06:46:39.583 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.unordered_write: 0 2024-08-01T06:46:39.583 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-01T06:46:39.584 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-01T06:46:39.584 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-01T06:46:39.584 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-01T06:46:39.584 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.row_cache: None 2024-08-01T06:46:39.584 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.wal_filter: None 2024-08-01T06:46:39.584 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-01T06:46:39.584 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.allow_ingest_behind: 0 2024-08-01T06:46:39.584 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.two_write_queues: 0 2024-08-01T06:46:39.584 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.manual_wal_flush: 0 2024-08-01T06:46:39.584 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.wal_compression: 0 2024-08-01T06:46:39.584 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.atomic_flush: 0 2024-08-01T06:46:39.584 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-01T06:46:39.584 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-01T06:46:39.584 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-01T06:46:39.585 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.log_readahead_size: 0 2024-08-01T06:46:39.585 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-01T06:46:39.585 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.best_efforts_recovery: 0 2024-08-01T06:46:39.585 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-01T06:46:39.585 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-01T06:46:39.585 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.allow_data_in_errors: 0 2024-08-01T06:46:39.585 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.db_host_id: __hostname__ 2024-08-01T06:46:39.585 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-01T06:46:39.585 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_background_jobs: 2 2024-08-01T06:46:39.585 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_background_compactions: -1 2024-08-01T06:46:39.585 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_subcompactions: 1 2024-08-01T06:46:39.585 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-01T06:46:39.585 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-01T06:46:39.586 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-01T06:46:39.586 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_total_wal_size: 0 2024-08-01T06:46:39.586 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-01T06:46:39.586 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-01T06:46:39.586 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-01T06:46:39.586 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-01T06:46:39.586 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_open_files: -1 2024-08-01T06:46:39.586 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.bytes_per_sync: 0 2024-08-01T06:46:39.586 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-01T06:46:39.586 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-01T06:46:39.586 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compaction_readahead_size: 0 2024-08-01T06:46:39.586 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_background_flushes: -1 2024-08-01T06:46:39.586 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Compression algorithms supported: 2024-08-01T06:46:39.587 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: kZSTD supported: 0 2024-08-01T06:46:39.587 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: kXpressCompression supported: 0 2024-08-01T06:46:39.587 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: kBZip2Compression supported: 0 2024-08-01T06:46:39.587 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-01T06:46:39.587 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: kLZ4Compression supported: 1 2024-08-01T06:46:39.587 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: kZlibCompression supported: 1 2024-08-01T06:46:39.587 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: kLZ4HCCompression supported: 1 2024-08-01T06:46:39.587 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: kSnappyCompression supported: 1 2024-08-01T06:46:39.587 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-01T06:46:39.587 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-01T06:46:39.587 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi016/store.db/MANIFEST-000010 2024-08-01T06:46:39.587 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-01T06:46:39.587 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-01T06:46:39.587 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.merge_operator: 2024-08-01T06:46:39.588 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compaction_filter: None 2024-08-01T06:46:39.588 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compaction_filter_factory: None 2024-08-01T06:46:39.588 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.sst_partitioner_factory: None 2024-08-01T06:46:39.588 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-01T06:46:39.588 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-01T06:46:39.588 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556956446a60) 2024-08-01T06:46:39.588 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: cache_index_and_filter_blocks: 1 2024-08-01T06:46:39.588 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-01T06:46:39.588 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-01T06:46:39.588 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: pin_top_level_index_and_filter: 1 2024-08-01T06:46:39.588 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: index_type: 0 2024-08-01T06:46:39.588 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: data_block_index_type: 0 2024-08-01T06:46:39.588 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: index_shortening: 1 2024-08-01T06:46:39.589 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-01T06:46:39.589 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: checksum: 4 2024-08-01T06:46:39.589 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: no_block_cache: 0 2024-08-01T06:46:39.589 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: block_cache: 0x55695643b350 2024-08-01T06:46:39.589 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: block_cache_name: BinnedLRUCache 2024-08-01T06:46:39.589 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: block_cache_options: 2024-08-01T06:46:39.589 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: capacity : 536870912 2024-08-01T06:46:39.589 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: num_shard_bits : 4 2024-08-01T06:46:39.589 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: strict_capacity_limit : 0 2024-08-01T06:46:39.589 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: high_pri_pool_ratio: 0.000 2024-08-01T06:46:39.589 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: block_cache_compressed: (nil) 2024-08-01T06:46:39.589 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: persistent_cache: (nil) 2024-08-01T06:46:39.589 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: block_size: 4096 2024-08-01T06:46:39.590 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: block_size_deviation: 10 2024-08-01T06:46:39.590 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: block_restart_interval: 16 2024-08-01T06:46:39.590 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: index_block_restart_interval: 1 2024-08-01T06:46:39.590 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: metadata_block_size: 4096 2024-08-01T06:46:39.590 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: partition_filters: 0 2024-08-01T06:46:39.590 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: use_delta_encoding: 1 2024-08-01T06:46:39.590 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: filter_policy: bloomfilter 2024-08-01T06:46:39.590 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: whole_key_filtering: 1 2024-08-01T06:46:39.590 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: verify_compression: 0 2024-08-01T06:46:39.590 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: read_amp_bytes_per_bit: 0 2024-08-01T06:46:39.590 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: format_version: 5 2024-08-01T06:46:39.590 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: enable_index_compression: 1 2024-08-01T06:46:39.590 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: block_align: 0 2024-08-01T06:46:39.591 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: max_auto_readahead_size: 262144 2024-08-01T06:46:39.591 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: prepopulate_block_cache: 0 2024-08-01T06:46:39.591 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: initial_auto_readahead_size: 8192 2024-08-01T06:46:39.591 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: num_file_reads_for_auto_readahead: 2 2024-08-01T06:46:39.591 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.write_buffer_size: 33554432 2024-08-01T06:46:39.591 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_write_buffer_number: 2 2024-08-01T06:46:39.591 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compression: NoCompression 2024-08-01T06:46:39.591 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.bottommost_compression: Disabled 2024-08-01T06:46:39.591 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.prefix_extractor: nullptr 2024-08-01T06:46:39.591 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-01T06:46:39.591 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.num_levels: 7 2024-08-01T06:46:39.591 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-01T06:46:39.591 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-01T06:46:39.592 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-01T06:46:39.592 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-01T06:46:39.592 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-01T06:46:39.592 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-01T06:46:39.592 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-01T06:46:39.592 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-01T06:46:39.592 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-01T06:46:39.592 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-01T06:46:39.592 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-01T06:46:39.592 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-01T06:46:39.592 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-01T06:46:39.592 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compression_opts.level: 32767 2024-08-01T06:46:39.592 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compression_opts.strategy: 0 2024-08-01T06:46:39.592 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-01T06:46:39.593 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-01T06:46:39.593 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-01T06:46:39.593 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-01T06:46:39.593 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compression_opts.enabled: false 2024-08-01T06:46:39.593 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-01T06:46:39.593 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-01T06:46:39.593 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-01T06:46:39.593 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-01T06:46:39.593 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.target_file_size_base: 67108864 2024-08-01T06:46:39.593 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-01T06:46:39.593 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-01T06:46:39.593 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-01T06:46:39.593 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-01T06:46:39.593 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-01T06:46:39.594 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-01T06:46:39.594 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-01T06:46:39.594 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-01T06:46:39.594 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-01T06:46:39.594 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-01T06:46:39.594 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-01T06:46:39.594 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-01T06:46:39.594 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-01T06:46:39.594 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-01T06:46:39.594 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.arena_block_size: 1048576 2024-08-01T06:46:39.594 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-01T06:46:39.594 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-01T06:46:39.594 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.disable_auto_compactions: 0 2024-08-01T06:46:39.595 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-01T06:46:39.595 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-01T06:46:39.595 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-01T06:46:39.595 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-01T06:46:39.595 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-01T06:46:39.595 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-01T06:46:39.595 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-01T06:46:39.595 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-01T06:46:39.595 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-01T06:46:39.595 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-01T06:46:39.595 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.table_properties_collectors: 2024-08-01T06:46:39.595 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.inplace_update_support: 0 2024-08-01T06:46:39.595 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-01T06:46:39.596 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-01T06:46:39.596 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-01T06:46:39.596 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-01T06:46:39.596 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.bloom_locality: 0 2024-08-01T06:46:39.596 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.max_successive_merges: 0 2024-08-01T06:46:39.596 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-01T06:46:39.596 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.paranoid_file_checks: 0 2024-08-01T06:46:39.596 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.force_consistency_checks: 1 2024-08-01T06:46:39.596 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.report_bg_io_stats: 0 2024-08-01T06:46:39.596 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.ttl: 2592000 2024-08-01T06:46:39.596 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-01T06:46:39.596 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-01T06:46:39.596 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-01T06:46:39.596 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.enable_blob_files: false 2024-08-01T06:46:39.597 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.min_blob_size: 0 2024-08-01T06:46:39.597 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.blob_file_size: 268435456 2024-08-01T06:46:39.597 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-01T06:46:39.597 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-01T06:46:39.597 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-01T06:46:39.597 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-01T06:46:39.597 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-01T06:46:39.597 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.blob_file_starting_level: 0 2024-08-01T06:46:39.597 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-01T06:46:39.597 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi016/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-08-01T06:46:39.597 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-08-01T06:46:39.597 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 168c465c-f25c-4d36-86b1-acf937d77f8f 2024-08-01T06:46:39.597 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: EVENT_LOG_v1 {"time_micros": 1722494799412617, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-08-01T06:46:39.598 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-08-01T06:46:39.598 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: EVENT_LOG_v1 {"time_micros": 1722494799413690, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94237, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 316, "table_properties": {"data_size": 92243, "index_size": 276, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13701, "raw_average_key_size": 49, "raw_value_size": 84751, "raw_average_value_size": 308, "num_data_blocks": 11, "num_entries": 275, "num_filter_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1722494799, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "168c465c-f25c-4d36-86b1-acf937d77f8f", "db_session_id": "PC61Q0BE2Q6E7BLRG9J4", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-08-01T06:46:39.598 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: EVENT_LOG_v1 {"time_micros": 1722494799413788, "job": 1, "event": "recovery_finished"} 2024-08-01T06:46:39.598 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-08-01T06:46:39.598 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi016/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-01T06:46:39.598 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556956464e00 2024-08-01T06:46:39.598 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: DB pointer 0x556956558000 2024-08-01T06:46:39.598 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-01T06:46:39.598 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-01T06:46:39.598 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: ** DB Stats ** 2024-08-01T06:46:39.599 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-01T06:46:39.599 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-01T06:46:39.599 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-01T06:46:39.599 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-01T06:46:39.599 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-01T06:46:39.599 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-01T06:46:39.599 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-01T06:46:39.599 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: 2024-08-01T06:46:39.599 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: ** Compaction Stats [default] ** 2024-08-01T06:46:39.599 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-01T06:46:39.599 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-01T06:46:39.600 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: L0 2/0 93.90 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-01T06:46:39.600 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Sum 2/0 93.90 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-01T06:46:39.600 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-01T06:46:39.600 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: 2024-08-01T06:46:39.600 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: ** Compaction Stats [default] ** 2024-08-01T06:46:39.600 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-01T06:46:39.600 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-01T06:46:39.600 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 132.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-01T06:46:39.600 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: 2024-08-01T06:46:39.600 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-01T06:46:39.600 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: 2024-08-01T06:46:39.600 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-01T06:46:39.600 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-01T06:46:39.600 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-01T06:46:39.601 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-01T06:46:39.601 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-01T06:46:39.601 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-01T06:46:39.601 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Cumulative compaction: 0.00 GB write, 27.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-01T06:46:39.601 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Interval compaction: 0.00 GB write, 27.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-01T06:46:39.601 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-01T06:46:39.601 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Block cache BinnedLRUCache@0x55695643b350#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-01T06:46:39.601 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-08-01T06:46:39.601 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: 2024-08-01T06:46:39.601 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-01T06:46:39.601 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: starting mon.smithi016 rank 0 at public addrs [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] at bind addrs [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi016 fsid a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:46:39.601 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: mon.smithi016@-1(???) e1 preinit fsid a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:46:39.601 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: mon.smithi016@-1(???).mds e1 new map 2024-08-01T06:46:39.602 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: mon.smithi016@-1(???).mds e1 print_map 2024-08-01T06:46:39.602 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: e1 2024-08-01T06:46:39.602 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T06:46:39.602 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:46:39.602 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: legacy client fscid: -1 2024-08-01T06:46:39.602 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: 2024-08-01T06:46:39.602 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: No filesystems configured 2024-08-01T06:46:39.602 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: mon.smithi016@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-01T06:46:39.602 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: mon.smithi016@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-01T06:46:39.602 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: mon.smithi016@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-01T06:46:39.602 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: mon.smithi016@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-01T06:46:39.602 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: mon.smithi016@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-01T06:46:39.602 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 bash[29248]: e6a2e5d7eeecf90eb4155f077ee3ce88c7453ddc3ea99c8e8875a7cd074f5034 2024-08-01T06:46:39.603 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 systemd[1]: Started Ceph mon.smithi016 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T06:46:39.603 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: mon.smithi016 is new leader, mons smithi016 in quorum (ranks 0) 2024-08-01T06:46:39.603 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: monmap e1: 1 mons at {smithi016=[v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-08-01T06:46:39.603 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: fsmap 2024-08-01T06:46:39.603 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: osdmap e1: 0 total, 0 up, 0 in 2024-08-01T06:46:39.603 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:39 smithi016 ceph-mon[29266]: mgrmap e1: no daemons active 2024-08-01T06:46:40.473 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.901+0000 7fa651fb1640 1 Processor -- start 2024-08-01T06:46:40.473 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.901+0000 7fa651fb1640 1 -- start start 2024-08-01T06:46:40.473 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.901+0000 7fa651fb1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa64c1055c0 0x7fa64c1059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:40.473 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.901+0000 7fa651fb1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c105f90 con 0x7fa64c1055c0 2024-08-01T06:46:40.473 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.902+0000 7fa64b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa64c1055c0 0x7fa64c1059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:40.473 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.902+0000 7fa64b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa64c1055c0 0x7fa64c1059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41052/0 (socket says 172.21.15.16:41052) 2024-08-01T06:46:40.473 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.902+0000 7fa64b7fe640 1 -- 172.21.15.16:0/1293931930 learned_addr learned my addr 172.21.15.16:0/1293931930 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:40.473 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.902+0000 7fa64b7fe640 1 -- 172.21.15.16:0/1293931930 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c1067c0 con 0x7fa64c1055c0 2024-08-01T06:46:40.473 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.904+0000 7fa64b7fe640 1 --2- 172.21.15.16:0/1293931930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa64c1055c0 0x7fa64c1059c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009820 tx=0x7fa63c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f758b4d3e434ed3 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:40.474 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.904+0000 7fa64a7fc640 1 -- 172.21.15.16:0/1293931930 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa63c02ad40 con 0x7fa64c1055c0 2024-08-01T06:46:40.474 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.904+0000 7fa64a7fc640 1 -- 172.21.15.16:0/1293931930 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fa63c0328c0 con 0x7fa64c1055c0 2024-08-01T06:46:40.474 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.904+0000 7fa64a7fc640 1 -- 172.21.15.16:0/1293931930 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa63c0307f0 con 0x7fa64c1055c0 2024-08-01T06:46:40.474 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.905+0000 7fa651fb1640 1 -- 172.21.15.16:0/1293931930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa64c1055c0 msgr2=0x7fa64c1059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:40.474 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.905+0000 7fa651fb1640 1 --2- 172.21.15.16:0/1293931930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa64c1055c0 0x7fa64c1059c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009820 tx=0x7fa63c02a270 comp rx=0 tx=0).stop 2024-08-01T06:46:40.474 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.905+0000 7fa651fb1640 1 -- 172.21.15.16:0/1293931930 shutdown_connections 2024-08-01T06:46:40.474 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.905+0000 7fa651fb1640 1 --2- 172.21.15.16:0/1293931930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa64c1055c0 0x7fa64c1059c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:40.474 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.905+0000 7fa651fb1640 1 -- 172.21.15.16:0/1293931930 >> 172.21.15.16:0/1293931930 conn(0x7fa64c100d70 msgr2=0x7fa64c103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:40.474 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.905+0000 7fa651fb1640 1 -- 172.21.15.16:0/1293931930 shutdown_connections 2024-08-01T06:46:40.474 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.905+0000 7fa651fb1640 1 -- 172.21.15.16:0/1293931930 wait complete. 2024-08-01T06:46:40.474 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.905+0000 7fa651fb1640 1 Processor -- start 2024-08-01T06:46:40.475 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.906+0000 7fa651fb1640 1 -- start start 2024-08-01T06:46:40.475 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.906+0000 7fa651fb1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa64c1055c0 0x7fa64c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:40.475 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.906+0000 7fa651fb1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c1997f0 con 0x7fa64c1055c0 2024-08-01T06:46:40.475 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.906+0000 7fa64b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa64c1055c0 0x7fa64c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:40.475 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.906+0000 7fa64b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa64c1055c0 0x7fa64c1992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41056/0 (socket says 172.21.15.16:41056) 2024-08-01T06:46:40.475 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.906+0000 7fa64b7fe640 1 -- 172.21.15.16:0/2384750227 learned_addr learned my addr 172.21.15.16:0/2384750227 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:40.475 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.906+0000 7fa64b7fe640 1 -- 172.21.15.16:0/2384750227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c0094d0 con 0x7fa64c1055c0 2024-08-01T06:46:40.475 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.906+0000 7fa64b7fe640 1 --2- 172.21.15.16:0/2384750227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa64c1055c0 0x7fa64c1992b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa63c030d30 tx=0x7fa63c030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:40.475 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.906+0000 7fa648ff9640 1 -- 172.21.15.16:0/2384750227 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa63c032c40 con 0x7fa64c1055c0 2024-08-01T06:46:40.475 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.906+0000 7fa648ff9640 1 -- 172.21.15.16:0/2384750227 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fa63c032da0 con 0x7fa64c1055c0 2024-08-01T06:46:40.475 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.907+0000 7fa651fb1640 1 -- 172.21.15.16:0/2384750227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa64c1999f0 con 0x7fa64c1055c0 2024-08-01T06:46:40.475 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.907+0000 7fa648ff9640 1 -- 172.21.15.16:0/2384750227 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa63c03c570 con 0x7fa64c1055c0 2024-08-01T06:46:40.476 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.907+0000 7fa651fb1640 1 -- 172.21.15.16:0/2384750227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64c199e10 con 0x7fa64c1055c0 2024-08-01T06:46:40.476 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.907+0000 7fa648ff9640 1 -- 172.21.15.16:0/2384750227 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa63c03cb30 con 0x7fa64c1055c0 2024-08-01T06:46:40.476 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.907+0000 7fa648ff9640 1 -- 172.21.15.16:0/2384750227 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa63c0463c0 con 0x7fa64c1055c0 2024-08-01T06:46:40.476 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.907+0000 7fa651fb1640 1 -- 172.21.15.16:0/2384750227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64c1099f0 con 0x7fa64c1055c0 2024-08-01T06:46:40.476 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.910+0000 7fa648ff9640 1 -- 172.21.15.16:0/2384750227 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fa63c037070 con 0x7fa64c1055c0 2024-08-01T06:46:40.476 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.968+0000 7fa651fb1640 1 -- 172.21.15.16:0/2384750227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fa64c19c770 con 0x7fa64c1055c0 2024-08-01T06:46:40.476 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.971+0000 7fa648ff9640 1 -- 172.21.15.16:0/2384750227 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa63c047e10 con 0x7fa64c1055c0 2024-08-01T06:46:40.476 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.971+0000 7fa651fb1640 1 -- 172.21.15.16:0/2384750227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa64c1055c0 msgr2=0x7fa64c1992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:40.476 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.971+0000 7fa651fb1640 1 --2- 172.21.15.16:0/2384750227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa64c1055c0 0x7fa64c1992b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa63c030d30 tx=0x7fa63c030d60 comp rx=0 tx=0).stop 2024-08-01T06:46:40.476 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.971+0000 7fa651fb1640 1 -- 172.21.15.16:0/2384750227 shutdown_connections 2024-08-01T06:46:40.476 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.971+0000 7fa651fb1640 1 --2- 172.21.15.16:0/2384750227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa64c1055c0 0x7fa64c1992b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:40.476 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.971+0000 7fa651fb1640 1 -- 172.21.15.16:0/2384750227 >> 172.21.15.16:0/2384750227 conn(0x7fa64c100d70 msgr2=0x7fa64c101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:40.477 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.971+0000 7fa651fb1640 1 -- 172.21.15.16:0/2384750227 shutdown_connections 2024-08-01T06:46:40.477 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:39.971+0000 7fa651fb1640 1 -- 172.21.15.16:0/2384750227 wait complete. 2024-08-01T06:46:40.477 INFO:teuthology.orchestra.run.smithi016.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-01T06:46:40.498 INFO:teuthology.orchestra.run.smithi016.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-01T06:46:40.498 INFO:teuthology.orchestra.run.smithi016.stdout:Creating mgr... 2024-08-01T06:46:40.499 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-01T06:46:40.499 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-01T06:46:40.499 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying port 0.0.0.0:8443 ... 2024-08-01T06:46:40.750 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mgr.smithi016.whigbo 2024-08-01T06:46:40.750 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mgr.smithi016.whigbo.service: Unit ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mgr.smithi016.whigbo.service not loaded. 2024-08-01T06:46:40.898 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a88427da-4fd1-11ef-bcca-c7b262605968.target.wants/ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mgr.smithi016.whigbo.service → /etc/systemd/system/ceph-a88427da-4fd1-11ef-bcca-c7b262605968@.service. 2024-08-01T06:46:41.137 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:40 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/2384750227' entity='client.admin' 2024-08-01T06:46:41.430 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-01T06:46:41.430 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout disabled 2024-08-01T06:46:41.438 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-01T06:46:41.438 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout inactive 2024-08-01T06:46:41.438 INFO:teuthology.orchestra.run.smithi016.stdout:firewalld.service is not enabled 2024-08-01T06:46:41.438 INFO:teuthology.orchestra.run.smithi016.stdout:Not possible to enable service . firewalld.service is not available 2024-08-01T06:46:41.447 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-01T06:46:41.447 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout disabled 2024-08-01T06:46:41.455 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-01T06:46:41.455 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout inactive 2024-08-01T06:46:41.455 INFO:teuthology.orchestra.run.smithi016.stdout:firewalld.service is not enabled 2024-08-01T06:46:41.455 INFO:teuthology.orchestra.run.smithi016.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-08-01T06:46:41.455 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for mgr to start... 2024-08-01T06:46:41.455 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for mgr... 2024-08-01T06:46:42.267 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:41 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3428333993' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-01T06:46:42.531 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-08-01T06:46:42.531 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-08-01T06:46:42.531 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "fsid": "a88427da-4fd1-11ef-bcca-c7b262605968", 2024-08-01T06:46:42.531 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "health": { 2024-08-01T06:46:42.531 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-01T06:46:42.531 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-01T06:46:42.531 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-01T06:46:42.532 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:42.532 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-01T06:46:42.532 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-01T06:46:42.532 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 0 2024-08-01T06:46:42.532 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-08-01T06:46:42.532 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-01T06:46:42.532 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "smithi016" 2024-08-01T06:46:42.532 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-08-01T06:46:42.532 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-08-01T06:46:42.532 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-01T06:46:42.532 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-01T06:46:42.532 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-08-01T06:46:42.532 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-01T06:46:42.532 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:42.533 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-01T06:46:42.533 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-01T06:46:42.533 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-01T06:46:42.533 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-01T06:46:42.533 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-01T06:46:42.533 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-01T06:46:42.533 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-01T06:46:42.533 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-01T06:46:42.533 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:42.533 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-01T06:46:42.533 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-01T06:46:42.533 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-01T06:46:42.534 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-01T06:46:42.534 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-01T06:46:42.534 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-01T06:46:42.534 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-01T06:46:42.534 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-01T06:46:42.534 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-01T06:46:42.534 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:42.534 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-01T06:46:42.534 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-01T06:46:42.534 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-01T06:46:42.534 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-01T06:46:42.534 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:42.534 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-01T06:46:42.535 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-01T06:46:42.535 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-01T06:46:42.535 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-01T06:46:42.535 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-01T06:46:42.535 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-01T06:46:42.535 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "restful" 2024-08-01T06:46:42.535 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-08-01T06:46:42.535 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-01T06:46:42.535 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:42.535 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-01T06:46:42.535 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-01T06:46:42.535 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "modified": "2024-08-01T06:46:34.094104+0000", 2024-08-01T06:46:42.535 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-01T06:46:42.535 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:42.536 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-01T06:46:42.536 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-08-01T06:46:42.536 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.892+0000 7f1e51d43640 1 Processor -- start 2024-08-01T06:46:42.536 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.892+0000 7f1e51d43640 1 -- start start 2024-08-01T06:46:42.536 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.892+0000 7f1e51d43640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e4c1060b0 0x7f1e4c1084a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:42.536 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.892+0000 7f1e51d43640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c079e40 con 0x7f1e4c1060b0 2024-08-01T06:46:42.536 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.893+0000 7f1e4b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e4c1060b0 0x7f1e4c1084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:42.536 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.893+0000 7f1e4b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e4c1060b0 0x7f1e4c1084a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41096/0 (socket says 172.21.15.16:41096) 2024-08-01T06:46:42.536 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.893+0000 7f1e4b7fe640 1 -- 172.21.15.16:0/3646778883 learned_addr learned my addr 172.21.15.16:0/3646778883 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:42.536 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.893+0000 7f1e4b7fe640 1 -- 172.21.15.16:0/3646778883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4c1089e0 con 0x7f1e4c1060b0 2024-08-01T06:46:42.536 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.894+0000 7f1e4b7fe640 1 --2- 172.21.15.16:0/3646778883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e4c1060b0 0x7f1e4c1084a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009820 tx=0x7f1e3402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a981738b3d8e423d server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:42.536 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.894+0000 7f1e4a7fc640 1 -- 172.21.15.16:0/3646778883 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e3402ad40 con 0x7f1e4c1060b0 2024-08-01T06:46:42.536 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.894+0000 7f1e4a7fc640 1 -- 172.21.15.16:0/3646778883 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f1e340328c0 con 0x7f1e4c1060b0 2024-08-01T06:46:42.537 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.894+0000 7f1e4a7fc640 1 -- 172.21.15.16:0/3646778883 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e340307f0 con 0x7f1e4c1060b0 2024-08-01T06:46:42.537 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.894+0000 7f1e51d43640 1 -- 172.21.15.16:0/3646778883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e4c1060b0 msgr2=0x7f1e4c1084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:42.537 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.894+0000 7f1e51d43640 1 --2- 172.21.15.16:0/3646778883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e4c1060b0 0x7f1e4c1084a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009820 tx=0x7f1e3402a270 comp rx=0 tx=0).stop 2024-08-01T06:46:42.537 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.894+0000 7f1e51d43640 1 -- 172.21.15.16:0/3646778883 shutdown_connections 2024-08-01T06:46:42.537 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.894+0000 7f1e51d43640 1 --2- 172.21.15.16:0/3646778883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e4c1060b0 0x7f1e4c1084a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:42.537 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.894+0000 7f1e51d43640 1 -- 172.21.15.16:0/3646778883 >> 172.21.15.16:0/3646778883 conn(0x7f1e4c0ffc50 msgr2=0x7f1e4c1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:42.537 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.894+0000 7f1e51d43640 1 -- 172.21.15.16:0/3646778883 shutdown_connections 2024-08-01T06:46:42.537 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.895+0000 7f1e51d43640 1 -- 172.21.15.16:0/3646778883 wait complete. 2024-08-01T06:46:42.537 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.895+0000 7f1e51d43640 1 Processor -- start 2024-08-01T06:46:42.537 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.895+0000 7f1e51d43640 1 -- start start 2024-08-01T06:46:42.537 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.896+0000 7f1e51d43640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e4c1060b0 0x7f1e4c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:42.537 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.896+0000 7f1e51d43640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c1997f0 con 0x7f1e4c1060b0 2024-08-01T06:46:42.537 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.896+0000 7f1e4b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e4c1060b0 0x7f1e4c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:42.537 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.896+0000 7f1e4b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e4c1060b0 0x7f1e4c1992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41106/0 (socket says 172.21.15.16:41106) 2024-08-01T06:46:42.538 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.896+0000 7f1e4b7fe640 1 -- 172.21.15.16:0/3428333993 learned_addr learned my addr 172.21.15.16:0/3428333993 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:42.538 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.896+0000 7f1e4b7fe640 1 -- 172.21.15.16:0/3428333993 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e340094d0 con 0x7f1e4c1060b0 2024-08-01T06:46:42.538 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.896+0000 7f1e4b7fe640 1 --2- 172.21.15.16:0/3428333993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e4c1060b0 0x7f1e4c1992b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009940 tx=0x7f1e34032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:42.538 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.896+0000 7f1e48ff9640 1 -- 172.21.15.16:0/3428333993 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e34041070 con 0x7f1e4c1060b0 2024-08-01T06:46:42.538 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.896+0000 7f1e48ff9640 1 -- 172.21.15.16:0/3428333993 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f1e34030cc0 con 0x7f1e4c1060b0 2024-08-01T06:46:42.538 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.896+0000 7f1e51d43640 1 -- 172.21.15.16:0/3428333993 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4c1999f0 con 0x7f1e4c1060b0 2024-08-01T06:46:42.538 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.896+0000 7f1e48ff9640 1 -- 172.21.15.16:0/3428333993 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e3403c620 con 0x7f1e4c1060b0 2024-08-01T06:46:42.538 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.897+0000 7f1e51d43640 1 -- 172.21.15.16:0/3428333993 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4c199e10 con 0x7f1e4c1060b0 2024-08-01T06:46:42.538 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.897+0000 7f1e48ff9640 1 -- 172.21.15.16:0/3428333993 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f1e3403ca80 con 0x7f1e4c1060b0 2024-08-01T06:46:42.538 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.897+0000 7f1e48ff9640 1 -- 172.21.15.16:0/3428333993 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1e34046da0 con 0x7f1e4c1060b0 2024-08-01T06:46:42.538 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.897+0000 7f1e51d43640 1 -- 172.21.15.16:0/3428333993 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e4c109700 con 0x7f1e4c1060b0 2024-08-01T06:46:42.538 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.900+0000 7f1e48ff9640 1 -- 172.21.15.16:0/3428333993 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f1e34037070 con 0x7f1e4c1060b0 2024-08-01T06:46:42.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.961+0000 7f1e51d43640 1 -- 172.21.15.16:0/3428333993 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f1e4c1098f0 con 0x7f1e4c1060b0 2024-08-01T06:46:42.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.962+0000 7f1e48ff9640 1 -- 172.21.15.16:0/3428333993 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f1e34030e30 con 0x7f1e4c1060b0 2024-08-01T06:46:42.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.963+0000 7f1e51d43640 1 -- 172.21.15.16:0/3428333993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e4c1060b0 msgr2=0x7f1e4c1992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:42.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.963+0000 7f1e51d43640 1 --2- 172.21.15.16:0/3428333993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e4c1060b0 0x7f1e4c1992b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009940 tx=0x7f1e34032c60 comp rx=0 tx=0).stop 2024-08-01T06:46:42.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.963+0000 7f1e51d43640 1 -- 172.21.15.16:0/3428333993 shutdown_connections 2024-08-01T06:46:42.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.963+0000 7f1e51d43640 1 --2- 172.21.15.16:0/3428333993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e4c1060b0 0x7f1e4c1992b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:42.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.963+0000 7f1e51d43640 1 -- 172.21.15.16:0/3428333993 >> 172.21.15.16:0/3428333993 conn(0x7f1e4c0ffc50 msgr2=0x7f1e4c100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:42.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.963+0000 7f1e51d43640 1 -- 172.21.15.16:0/3428333993 shutdown_connections 2024-08-01T06:46:42.539 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:41.963+0000 7f1e51d43640 1 -- 172.21.15.16:0/3428333993 wait complete. 2024-08-01T06:46:42.539 INFO:teuthology.orchestra.run.smithi016.stdout:mgr not available, waiting (1/15)... 2024-08-01T06:46:45.279 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:45 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/1654957219' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-01T06:46:45.746 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-08-01T06:46:45.746 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-08-01T06:46:45.746 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "fsid": "a88427da-4fd1-11ef-bcca-c7b262605968", 2024-08-01T06:46:45.746 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "health": { 2024-08-01T06:46:45.746 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-01T06:46:45.746 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-01T06:46:45.747 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-01T06:46:45.747 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:45.747 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-01T06:46:45.747 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-01T06:46:45.747 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 0 2024-08-01T06:46:45.747 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-08-01T06:46:45.747 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-01T06:46:45.747 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "smithi016" 2024-08-01T06:46:45.747 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-08-01T06:46:45.747 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-08-01T06:46:45.747 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-01T06:46:45.747 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-01T06:46:45.747 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-08-01T06:46:45.748 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-01T06:46:45.748 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:45.748 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-01T06:46:45.748 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-01T06:46:45.748 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-01T06:46:45.748 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-01T06:46:45.748 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-01T06:46:45.756 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-01T06:46:45.757 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-01T06:46:45.757 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-01T06:46:45.757 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:45.757 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-01T06:46:45.757 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-01T06:46:45.757 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-01T06:46:45.757 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-01T06:46:45.757 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-01T06:46:45.757 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-01T06:46:45.758 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-01T06:46:45.758 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-01T06:46:45.758 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-01T06:46:45.758 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:45.758 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-01T06:46:45.758 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-01T06:46:45.758 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-01T06:46:45.758 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-01T06:46:45.758 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:45.758 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-01T06:46:45.758 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-01T06:46:45.758 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-01T06:46:45.758 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-01T06:46:45.759 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-01T06:46:45.759 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-01T06:46:45.759 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "restful" 2024-08-01T06:46:45.759 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-08-01T06:46:45.759 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-01T06:46:45.759 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:45.759 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-01T06:46:45.759 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-01T06:46:45.759 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "modified": "2024-08-01T06:46:34.094104+0000", 2024-08-01T06:46:45.759 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-01T06:46:45.759 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:45.759 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-01T06:46:45.759 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-08-01T06:46:45.760 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.920+0000 7fe97f640640 1 Processor -- start 2024-08-01T06:46:45.760 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.920+0000 7fe97f640640 1 -- start start 2024-08-01T06:46:45.760 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.920+0000 7fe97f640640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9781044e0 0x7fe9781048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:45.760 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.920+0000 7fe97f640640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe978104eb0 con 0x7fe9781044e0 2024-08-01T06:46:45.760 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.921+0000 7fe97d3dc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9781044e0 0x7fe9781048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:45.760 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.921+0000 7fe97d3dc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9781044e0 0x7fe9781048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41108/0 (socket says 172.21.15.16:41108) 2024-08-01T06:46:45.760 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.921+0000 7fe97d3dc640 1 -- 172.21.15.16:0/3754390841 learned_addr learned my addr 172.21.15.16:0/3754390841 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:45.760 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.921+0000 7fe97d3dc640 1 -- 172.21.15.16:0/3754390841 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9781056e0 con 0x7fe9781044e0 2024-08-01T06:46:45.760 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.922+0000 7fe97d3dc640 1 --2- 172.21.15.16:0/3754390841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9781044e0 0x7fe9781048e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe974009820 tx=0x7fe97402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b1c7ad8894ed5d server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:45.760 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.922+0000 7fe96ffff640 1 -- 172.21.15.16:0/3754390841 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe97402ad40 con 0x7fe9781044e0 2024-08-01T06:46:45.760 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.922+0000 7fe96ffff640 1 -- 172.21.15.16:0/3754390841 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe9740328c0 con 0x7fe9781044e0 2024-08-01T06:46:45.760 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.922+0000 7fe96ffff640 1 -- 172.21.15.16:0/3754390841 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9740307f0 con 0x7fe9781044e0 2024-08-01T06:46:45.760 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.922+0000 7fe97f640640 1 -- 172.21.15.16:0/3754390841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9781044e0 msgr2=0x7fe9781048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:45.761 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.922+0000 7fe97f640640 1 --2- 172.21.15.16:0/3754390841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9781044e0 0x7fe9781048e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe974009820 tx=0x7fe97402a270 comp rx=0 tx=0).stop 2024-08-01T06:46:45.761 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.923+0000 7fe97f640640 1 -- 172.21.15.16:0/3754390841 shutdown_connections 2024-08-01T06:46:45.761 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.923+0000 7fe97f640640 1 --2- 172.21.15.16:0/3754390841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9781044e0 0x7fe9781048e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:45.761 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.923+0000 7fe97f640640 1 -- 172.21.15.16:0/3754390841 >> 172.21.15.16:0/3754390841 conn(0x7fe9780ffc50 msgr2=0x7fe9781020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:45.761 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.923+0000 7fe97f640640 1 -- 172.21.15.16:0/3754390841 shutdown_connections 2024-08-01T06:46:45.761 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.923+0000 7fe97f640640 1 -- 172.21.15.16:0/3754390841 wait complete. 2024-08-01T06:46:45.761 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.923+0000 7fe97f640640 1 Processor -- start 2024-08-01T06:46:45.761 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.923+0000 7fe97f640640 1 -- start start 2024-08-01T06:46:45.761 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.923+0000 7fe97f640640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9781044e0 0x7fe97818f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:45.761 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.924+0000 7fe97f640640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97818fb80 con 0x7fe9781044e0 2024-08-01T06:46:45.761 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.924+0000 7fe97d3dc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9781044e0 0x7fe97818f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:45.761 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.924+0000 7fe97d3dc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9781044e0 0x7fe97818f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41114/0 (socket says 172.21.15.16:41114) 2024-08-01T06:46:45.761 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.924+0000 7fe97d3dc640 1 -- 172.21.15.16:0/1654957219 learned_addr learned my addr 172.21.15.16:0/1654957219 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:45.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.924+0000 7fe97d3dc640 1 -- 172.21.15.16:0/1654957219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9740094d0 con 0x7fe9781044e0 2024-08-01T06:46:45.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.924+0000 7fe97d3dc640 1 --2- 172.21.15.16:0/1654957219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9781044e0 0x7fe97818f640 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe974030d30 tx=0x7fe974030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:45.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.924+0000 7fe96e7fc640 1 -- 172.21.15.16:0/1654957219 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe974032c40 con 0x7fe9781044e0 2024-08-01T06:46:45.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.924+0000 7fe96e7fc640 1 -- 172.21.15.16:0/1654957219 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe974032da0 con 0x7fe9781044e0 2024-08-01T06:46:45.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.924+0000 7fe97f640640 1 -- 172.21.15.16:0/1654957219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97818ddc0 con 0x7fe9781044e0 2024-08-01T06:46:45.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.924+0000 7fe97f640640 1 -- 172.21.15.16:0/1654957219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97818e1e0 con 0x7fe9781044e0 2024-08-01T06:46:45.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.925+0000 7fe96e7fc640 1 -- 172.21.15.16:0/1654957219 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe97403c570 con 0x7fe9781044e0 2024-08-01T06:46:45.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.925+0000 7fe96e7fc640 1 -- 172.21.15.16:0/1654957219 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe97403cb60 con 0x7fe9781044e0 2024-08-01T06:46:45.763 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.925+0000 7fe96e7fc640 1 -- 172.21.15.16:0/1654957219 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe974047e40 con 0x7fe9781044e0 2024-08-01T06:46:45.763 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.925+0000 7fe97f640640 1 -- 172.21.15.16:0/1654957219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9781048e0 con 0x7fe9781044e0 2024-08-01T06:46:45.763 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.927+0000 7fe96e7fc640 1 -- 172.21.15.16:0/1654957219 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fe974037070 con 0x7fe9781044e0 2024-08-01T06:46:45.763 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.989+0000 7fe97f640640 1 -- 172.21.15.16:0/1654957219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe97818ebe0 con 0x7fe9781044e0 2024-08-01T06:46:45.763 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.990+0000 7fe96e7fc640 1 -- 172.21.15.16:0/1654957219 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fe97403da90 con 0x7fe9781044e0 2024-08-01T06:46:45.763 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.991+0000 7fe97f640640 1 -- 172.21.15.16:0/1654957219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9781044e0 msgr2=0x7fe97818f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:45.763 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.991+0000 7fe97f640640 1 --2- 172.21.15.16:0/1654957219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9781044e0 0x7fe97818f640 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe974030d30 tx=0x7fe974030d60 comp rx=0 tx=0).stop 2024-08-01T06:46:45.763 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.991+0000 7fe97f640640 1 -- 172.21.15.16:0/1654957219 shutdown_connections 2024-08-01T06:46:45.763 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.991+0000 7fe97f640640 1 --2- 172.21.15.16:0/1654957219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9781044e0 0x7fe97818f640 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:45.763 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.991+0000 7fe97f640640 1 -- 172.21.15.16:0/1654957219 >> 172.21.15.16:0/1654957219 conn(0x7fe9780ffc50 msgr2=0x7fe978100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:45.763 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.991+0000 7fe97f640640 1 -- 172.21.15.16:0/1654957219 shutdown_connections 2024-08-01T06:46:45.763 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:44.991+0000 7fe97f640640 1 -- 172.21.15.16:0/1654957219 wait complete. 2024-08-01T06:46:45.764 INFO:teuthology.orchestra.run.smithi016.stdout:mgr not available, waiting (2/15)... 2024-08-01T06:46:46.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:46 smithi016 ceph-mon[29266]: Activating manager daemon smithi016.whigbo 2024-08-01T06:46:46.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:46 smithi016 ceph-mon[29266]: mgrmap e2: smithi016.whigbo(active, starting, since 0.00325818s) 2024-08-01T06:46:46.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:46 smithi016 ceph-mon[29266]: from='mgr.14100 172.21.15.16:0/3867366287' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-01T06:46:46.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:46 smithi016 ceph-mon[29266]: from='mgr.14100 172.21.15.16:0/3867366287' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-01T06:46:46.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:46 smithi016 ceph-mon[29266]: from='mgr.14100 172.21.15.16:0/3867366287' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-01T06:46:46.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:46 smithi016 ceph-mon[29266]: from='mgr.14100 172.21.15.16:0/3867366287' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:46:46.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:46 smithi016 ceph-mon[29266]: from='mgr.14100 172.21.15.16:0/3867366287' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr metadata", "who": "smithi016.whigbo", "id": "smithi016.whigbo"}]: dispatch 2024-08-01T06:46:46.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:46 smithi016 ceph-mon[29266]: Manager daemon smithi016.whigbo is now available 2024-08-01T06:46:46.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:46 smithi016 ceph-mon[29266]: from='mgr.14100 172.21.15.16:0/3867366287' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi016.whigbo/mirror_snapshot_schedule"}]: dispatch 2024-08-01T06:46:46.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:46 smithi016 ceph-mon[29266]: from='mgr.14100 172.21.15.16:0/3867366287' entity='mgr.smithi016.whigbo' 2024-08-01T06:46:46.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:46 smithi016 ceph-mon[29266]: from='mgr.14100 172.21.15.16:0/3867366287' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi016.whigbo/trash_purge_schedule"}]: dispatch 2024-08-01T06:46:46.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:46 smithi016 ceph-mon[29266]: from='mgr.14100 172.21.15.16:0/3867366287' entity='mgr.smithi016.whigbo' 2024-08-01T06:46:46.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:46 smithi016 ceph-mon[29266]: from='mgr.14100 172.21.15.16:0/3867366287' entity='mgr.smithi016.whigbo' 2024-08-01T06:46:48.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:48 smithi016 ceph-mon[29266]: mgrmap e3: smithi016.whigbo(active, since 1.0071s) 2024-08-01T06:46:49.044 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-08-01T06:46:49.045 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-08-01T06:46:49.045 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "fsid": "a88427da-4fd1-11ef-bcca-c7b262605968", 2024-08-01T06:46:49.045 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "health": { 2024-08-01T06:46:49.045 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-01T06:46:49.045 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-01T06:46:49.045 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-01T06:46:49.045 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:49.045 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-01T06:46:49.045 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-01T06:46:49.045 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 0 2024-08-01T06:46:49.045 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-08-01T06:46:49.046 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-01T06:46:49.046 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "smithi016" 2024-08-01T06:46:49.046 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-08-01T06:46:49.046 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-08-01T06:46:49.046 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-01T06:46:49.046 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-01T06:46:49.046 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-08-01T06:46:49.046 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-01T06:46:49.046 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:49.046 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-01T06:46:49.046 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-01T06:46:49.046 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-01T06:46:49.046 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-01T06:46:49.046 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-01T06:46:49.055 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-01T06:46:49.055 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-01T06:46:49.055 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-01T06:46:49.055 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:49.055 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-01T06:46:49.055 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-01T06:46:49.055 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-01T06:46:49.055 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-01T06:46:49.055 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-01T06:46:49.056 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-01T06:46:49.056 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-01T06:46:49.056 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-01T06:46:49.056 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-01T06:46:49.056 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:49.056 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-01T06:46:49.056 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-01T06:46:49.056 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-01T06:46:49.056 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-01T06:46:49.056 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:49.056 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-01T06:46:49.056 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-01T06:46:49.057 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-01T06:46:49.057 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-01T06:46:49.057 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-01T06:46:49.057 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-01T06:46:49.057 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "restful" 2024-08-01T06:46:49.057 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ], 2024-08-01T06:46:49.057 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-01T06:46:49.057 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:49.057 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-01T06:46:49.057 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-01T06:46:49.057 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "modified": "2024-08-01T06:46:34.094104+0000", 2024-08-01T06:46:49.057 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-01T06:46:49.057 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout }, 2024-08-01T06:46:49.058 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-01T06:46:49.058 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-08-01T06:46:49.058 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.146+0000 7fcdf4fdb640 1 Processor -- start 2024-08-01T06:46:49.058 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.146+0000 7fcdf4fdb640 1 -- start start 2024-08-01T06:46:49.058 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.147+0000 7fcdf4fdb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf0106050 0x7fcdf0108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:49.058 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.147+0000 7fcdf4fdb640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf0079ea0 con 0x7fcdf0106050 2024-08-01T06:46:49.058 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.147+0000 7fcdee59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf0106050 0x7fcdf0108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:49.058 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.147+0000 7fcdee59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf0106050 0x7fcdf0108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41184/0 (socket says 172.21.15.16:41184) 2024-08-01T06:46:49.058 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.147+0000 7fcdee59c640 1 -- 172.21.15.16:0/2107799328 learned_addr learned my addr 172.21.15.16:0/2107799328 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:49.058 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.147+0000 7fcdee59c640 1 -- 172.21.15.16:0/2107799328 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf0108980 con 0x7fcdf0106050 2024-08-01T06:46:49.058 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.148+0000 7fcdee59c640 1 --2- 172.21.15.16:0/2107799328 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf0106050 0x7fcdf0108440 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009820 tx=0x7fcde002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6453b3cbd60f47 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:49.058 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.148+0000 7fcded59a640 1 -- 172.21.15.16:0/2107799328 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcde002ad40 con 0x7fcdf0106050 2024-08-01T06:46:49.058 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.148+0000 7fcded59a640 1 -- 172.21.15.16:0/2107799328 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fcde00328c0 con 0x7fcdf0106050 2024-08-01T06:46:49.059 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.148+0000 7fcded59a640 1 -- 172.21.15.16:0/2107799328 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcde00307f0 con 0x7fcdf0106050 2024-08-01T06:46:49.059 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.149+0000 7fcdf4fdb640 1 -- 172.21.15.16:0/2107799328 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf0106050 msgr2=0x7fcdf0108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:49.059 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.149+0000 7fcdf4fdb640 1 --2- 172.21.15.16:0/2107799328 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf0106050 0x7fcdf0108440 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009820 tx=0x7fcde002a270 comp rx=0 tx=0).stop 2024-08-01T06:46:49.059 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.149+0000 7fcdf4fdb640 1 -- 172.21.15.16:0/2107799328 shutdown_connections 2024-08-01T06:46:49.059 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.149+0000 7fcdf4fdb640 1 --2- 172.21.15.16:0/2107799328 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf0106050 0x7fcdf0108440 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:49.059 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.149+0000 7fcdf4fdb640 1 -- 172.21.15.16:0/2107799328 >> 172.21.15.16:0/2107799328 conn(0x7fcdf00ffc50 msgr2=0x7fcdf01020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:49.059 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.149+0000 7fcdf4fdb640 1 -- 172.21.15.16:0/2107799328 shutdown_connections 2024-08-01T06:46:49.059 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.149+0000 7fcdf4fdb640 1 -- 172.21.15.16:0/2107799328 wait complete. 2024-08-01T06:46:49.059 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.150+0000 7fcdf4fdb640 1 Processor -- start 2024-08-01T06:46:49.059 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.150+0000 7fcdf4fdb640 1 -- start start 2024-08-01T06:46:49.059 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.150+0000 7fcdf4fdb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf0106050 0x7fcdf019b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:49.059 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.150+0000 7fcdf4fdb640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf019ba00 con 0x7fcdf0106050 2024-08-01T06:46:49.060 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.151+0000 7fcdee59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf0106050 0x7fcdf019b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:49.060 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.151+0000 7fcdee59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf0106050 0x7fcdf019b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41188/0 (socket says 172.21.15.16:41188) 2024-08-01T06:46:49.060 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.151+0000 7fcdee59c640 1 -- 172.21.15.16:0/3586543304 learned_addr learned my addr 172.21.15.16:0/3586543304 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:49.060 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.151+0000 7fcdee59c640 1 -- 172.21.15.16:0/3586543304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde00094d0 con 0x7fcdf0106050 2024-08-01T06:46:49.060 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.151+0000 7fcdee59c640 1 --2- 172.21.15.16:0/3586543304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf0106050 0x7fcdf019b4c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcde0030d30 tx=0x7fcde0030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:49.060 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.151+0000 7fcddf7fe640 1 -- 172.21.15.16:0/3586543304 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcde0032c40 con 0x7fcdf0106050 2024-08-01T06:46:49.060 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.151+0000 7fcddf7fe640 1 -- 172.21.15.16:0/3586543304 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fcde0032da0 con 0x7fcdf0106050 2024-08-01T06:46:49.060 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.151+0000 7fcdf4fdb640 1 -- 172.21.15.16:0/3586543304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf019bc00 con 0x7fcdf0106050 2024-08-01T06:46:49.060 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.151+0000 7fcddf7fe640 1 -- 172.21.15.16:0/3586543304 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcde003c660 con 0x7fcdf0106050 2024-08-01T06:46:49.060 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.152+0000 7fcdf4fdb640 1 -- 172.21.15.16:0/3586543304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf019c020 con 0x7fcdf0106050 2024-08-01T06:46:49.060 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.153+0000 7fcddf7fe640 1 -- 172.21.15.16:0/3586543304 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 3) v1 ==== 45439+0+0 (secure 0 0 0) 0x7fcde003c8d0 con 0x7fcdf0106050 2024-08-01T06:46:49.060 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.153+0000 7fcddf7fe640 1 --2- 172.21.15.16:0/3586543304 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7fcdd80384e0 0x7fcdd803a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:49.061 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.153+0000 7fcddf7fe640 1 -- 172.21.15.16:0/3586543304 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcde006b6c0 con 0x7fcdf0106050 2024-08-01T06:46:49.061 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.153+0000 7fcdf4fdb640 1 -- 172.21.15.16:0/3586543304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf0109700 con 0x7fcdf0106050 2024-08-01T06:46:49.061 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.153+0000 7fcdedd9b640 1 --2- 172.21.15.16:0/3586543304 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7fcdd80384e0 0x7fcdd803a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:49.061 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.153+0000 7fcdedd9b640 1 --2- 172.21.15.16:0/3586543304 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7fcdd80384e0 0x7fcdd803a9a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcde40098c0 tx=0x7fcde4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:49.061 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.158+0000 7fcddf7fe640 1 -- 172.21.15.16:0/3586543304 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fcde00313a0 con 0x7fcdf0106050 2024-08-01T06:46:49.061 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.370+0000 7fcddf7fe640 1 -- 172.21.15.16:0/3586543304 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7fcde003db00 con 0x7fcdf0106050 2024-08-01T06:46:49.061 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.435+0000 7fcdf4fdb640 1 -- 172.21.15.16:0/3586543304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fcdf01098f0 con 0x7fcdf0106050 2024-08-01T06:46:49.061 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.435+0000 7fcddf7fe640 1 -- 172.21.15.16:0/3586543304 <== mon.0 v2:172.21.15.16:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1245 (secure 0 0 0) 0x7fcde003b6c0 con 0x7fcdf0106050 2024-08-01T06:46:49.061 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.439+0000 7fcdf4fdb640 1 -- 172.21.15.16:0/3586543304 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7fcdd80384e0 msgr2=0x7fcdd803a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:49.061 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.439+0000 7fcdf4fdb640 1 --2- 172.21.15.16:0/3586543304 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7fcdd80384e0 0x7fcdd803a9a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcde40098c0 tx=0x7fcde4006db0 comp rx=0 tx=0).stop 2024-08-01T06:46:49.061 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.439+0000 7fcdf4fdb640 1 -- 172.21.15.16:0/3586543304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf0106050 msgr2=0x7fcdf019b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:49.061 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.439+0000 7fcdf4fdb640 1 --2- 172.21.15.16:0/3586543304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf0106050 0x7fcdf019b4c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcde0030d30 tx=0x7fcde0030d60 comp rx=0 tx=0).stop 2024-08-01T06:46:49.062 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.439+0000 7fcdf4fdb640 1 -- 172.21.15.16:0/3586543304 shutdown_connections 2024-08-01T06:46:49.062 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.439+0000 7fcdf4fdb640 1 --2- 172.21.15.16:0/3586543304 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7fcdd80384e0 0x7fcdd803a9a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:49.062 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.439+0000 7fcdf4fdb640 1 --2- 172.21.15.16:0/3586543304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf0106050 0x7fcdf019b4c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:49.062 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.439+0000 7fcdf4fdb640 1 -- 172.21.15.16:0/3586543304 >> 172.21.15.16:0/3586543304 conn(0x7fcdf00ffc50 msgr2=0x7fcdf01007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:49.062 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.439+0000 7fcdf4fdb640 1 -- 172.21.15.16:0/3586543304 shutdown_connections 2024-08-01T06:46:49.062 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:48.439+0000 7fcdf4fdb640 1 -- 172.21.15.16:0/3586543304 wait complete. 2024-08-01T06:46:49.062 INFO:teuthology.orchestra.run.smithi016.stdout:mgr is available 2024-08-01T06:46:49.423 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:49 smithi016 ceph-mon[29266]: mgrmap e4: smithi016.whigbo(active, since 2s) 2024-08-01T06:46:49.423 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:49 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3586543304' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-01T06:46:50.207 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-08-01T06:46:50.207 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout [global] 2024-08-01T06:46:50.207 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout fsid = a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:46:50.207 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-01T06:46:50.207 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-01T06:46:50.207 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-01T06:46:50.207 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-01T06:46:50.207 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-08-01T06:46:50.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-01T06:46:50.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-01T06:46:50.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 2024-08-01T06:46:50.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout [osd] 2024-08-01T06:46:50.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-01T06:46:50.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-01T06:46:50.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-01T06:46:50.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-01T06:46:50.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-01T06:46:50.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.420+0000 7f5c819e8640 1 Processor -- start 2024-08-01T06:46:50.208 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.420+0000 7f5c819e8640 1 -- start start 2024-08-01T06:46:50.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.420+0000 7f5c819e8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c1055d0 0x7f5c7c1059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:50.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.420+0000 7f5c819e8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c105fa0 con 0x7f5c7c1055d0 2024-08-01T06:46:50.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.420+0000 7f5c7affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c1055d0 0x7f5c7c1059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:50.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.420+0000 7f5c7affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c1055d0 0x7f5c7c1059d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39856/0 (socket says 172.21.15.16:39856) 2024-08-01T06:46:50.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.420+0000 7f5c7affd640 1 -- 172.21.15.16:0/1943484385 learned_addr learned my addr 172.21.15.16:0/1943484385 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:50.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.421+0000 7f5c7affd640 1 -- 172.21.15.16:0/1943484385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c1067d0 con 0x7f5c7c1055d0 2024-08-01T06:46:50.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.421+0000 7f5c7affd640 1 --2- 172.21.15.16:0/1943484385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c1055d0 0x7f5c7c1059d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c009820 tx=0x7f5c6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65502f70d175f82f server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:50.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.422+0000 7f5c79ffb640 1 -- 172.21.15.16:0/1943484385 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c6c02ad40 con 0x7f5c7c1055d0 2024-08-01T06:46:50.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.422+0000 7f5c79ffb640 1 -- 172.21.15.16:0/1943484385 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f5c6c0328c0 con 0x7f5c7c1055d0 2024-08-01T06:46:50.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.422+0000 7f5c79ffb640 1 -- 172.21.15.16:0/1943484385 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c6c0307f0 con 0x7f5c7c1055d0 2024-08-01T06:46:50.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.422+0000 7f5c819e8640 1 -- 172.21.15.16:0/1943484385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c1055d0 msgr2=0x7f5c7c1059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:50.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.422+0000 7f5c819e8640 1 --2- 172.21.15.16:0/1943484385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c1055d0 0x7f5c7c1059d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c009820 tx=0x7f5c6c02a270 comp rx=0 tx=0).stop 2024-08-01T06:46:50.209 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.422+0000 7f5c819e8640 1 -- 172.21.15.16:0/1943484385 shutdown_connections 2024-08-01T06:46:50.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.422+0000 7f5c819e8640 1 --2- 172.21.15.16:0/1943484385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c1055d0 0x7f5c7c1059d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:50.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.422+0000 7f5c819e8640 1 -- 172.21.15.16:0/1943484385 >> 172.21.15.16:0/1943484385 conn(0x7f5c7c100d80 msgr2=0x7f5c7c1031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:50.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.422+0000 7f5c819e8640 1 -- 172.21.15.16:0/1943484385 shutdown_connections 2024-08-01T06:46:50.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.422+0000 7f5c819e8640 1 -- 172.21.15.16:0/1943484385 wait complete. 2024-08-01T06:46:50.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.423+0000 7f5c819e8640 1 Processor -- start 2024-08-01T06:46:50.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.423+0000 7f5c819e8640 1 -- start start 2024-08-01T06:46:50.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.423+0000 7f5c819e8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c1055d0 0x7f5c7c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:50.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.423+0000 7f5c819e8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c199820 con 0x7f5c7c1055d0 2024-08-01T06:46:50.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.423+0000 7f5c7affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c1055d0 0x7f5c7c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:50.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.423+0000 7f5c7affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c1055d0 0x7f5c7c1992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39860/0 (socket says 172.21.15.16:39860) 2024-08-01T06:46:50.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.423+0000 7f5c7affd640 1 -- 172.21.15.16:0/1234504969 learned_addr learned my addr 172.21.15.16:0/1234504969 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:50.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.424+0000 7f5c7affd640 1 -- 172.21.15.16:0/1234504969 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c0094d0 con 0x7f5c7c1055d0 2024-08-01T06:46:50.210 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.424+0000 7f5c7affd640 1 --2- 172.21.15.16:0/1234504969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c1055d0 0x7f5c7c1992e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c030d30 tx=0x7f5c6c030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:50.211 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.424+0000 7f5c809e6640 1 -- 172.21.15.16:0/1234504969 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c6c032c40 con 0x7f5c7c1055d0 2024-08-01T06:46:50.211 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.424+0000 7f5c809e6640 1 -- 172.21.15.16:0/1234504969 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f5c6c032da0 con 0x7f5c7c1055d0 2024-08-01T06:46:50.211 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.424+0000 7f5c819e8640 1 -- 172.21.15.16:0/1234504969 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7c199a20 con 0x7f5c7c1055d0 2024-08-01T06:46:50.211 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.424+0000 7f5c809e6640 1 -- 172.21.15.16:0/1234504969 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c6c03c570 con 0x7f5c7c1055d0 2024-08-01T06:46:50.211 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.424+0000 7f5c819e8640 1 -- 172.21.15.16:0/1234504969 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7c199e40 con 0x7f5c7c1055d0 2024-08-01T06:46:50.211 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.425+0000 7f5c809e6640 1 -- 172.21.15.16:0/1234504969 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7f5c6c03c870 con 0x7f5c7c1055d0 2024-08-01T06:46:50.211 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.425+0000 7f5c809e6640 1 --2- 172.21.15.16:0/1234504969 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f5c64038600 0x7f5c6403aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:50.211 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.425+0000 7f5c809e6640 1 -- 172.21.15.16:0/1234504969 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5c6c06b9a0 con 0x7f5c7c1055d0 2024-08-01T06:46:50.211 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.425+0000 7f5c819e8640 1 -- 172.21.15.16:0/1234504969 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7c1059d0 con 0x7f5c7c1055d0 2024-08-01T06:46:50.211 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.425+0000 7f5c7a7fc640 1 --2- 172.21.15.16:0/1234504969 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f5c64038600 0x7f5c6403aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:50.211 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.426+0000 7f5c7a7fc640 1 --2- 172.21.15.16:0/1234504969 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f5c64038600 0x7f5c6403aac0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5c700098c0 tx=0x7f5c70006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:50.211 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.430+0000 7f5c809e6640 1 -- 172.21.15.16:0/1234504969 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f5c6c0313a0 con 0x7f5c7c1055d0 2024-08-01T06:46:50.212 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.600+0000 7f5c819e8640 1 -- 172.21.15.16:0/1234504969 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f5c7c19c7a0 con 0x7f5c7c1055d0 2024-08-01T06:46:50.212 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.601+0000 7f5c809e6640 1 -- 172.21.15.16:0/1234504969 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f5c6c03bb30 con 0x7f5c7c1055d0 2024-08-01T06:46:50.212 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.603+0000 7f5c819e8640 1 -- 172.21.15.16:0/1234504969 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f5c64038600 msgr2=0x7f5c6403aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:50.212 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.603+0000 7f5c819e8640 1 --2- 172.21.15.16:0/1234504969 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f5c64038600 0x7f5c6403aac0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5c700098c0 tx=0x7f5c70006db0 comp rx=0 tx=0).stop 2024-08-01T06:46:50.212 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.603+0000 7f5c819e8640 1 -- 172.21.15.16:0/1234504969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c1055d0 msgr2=0x7f5c7c1992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:50.212 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.603+0000 7f5c819e8640 1 --2- 172.21.15.16:0/1234504969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c1055d0 0x7f5c7c1992e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c030d30 tx=0x7f5c6c030d60 comp rx=0 tx=0).stop 2024-08-01T06:46:50.212 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.603+0000 7f5c819e8640 1 -- 172.21.15.16:0/1234504969 shutdown_connections 2024-08-01T06:46:50.212 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.603+0000 7f5c819e8640 1 --2- 172.21.15.16:0/1234504969 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f5c64038600 0x7f5c6403aac0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:50.212 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.603+0000 7f5c819e8640 1 --2- 172.21.15.16:0/1234504969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c1055d0 0x7f5c7c1992e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:50.212 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.603+0000 7f5c819e8640 1 -- 172.21.15.16:0/1234504969 >> 172.21.15.16:0/1234504969 conn(0x7f5c7c100d80 msgr2=0x7f5c7c1018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:50.212 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.603+0000 7f5c819e8640 1 -- 172.21.15.16:0/1234504969 shutdown_connections 2024-08-01T06:46:50.212 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:49.603+0000 7f5c819e8640 1 -- 172.21.15.16:0/1234504969 wait complete. 2024-08-01T06:46:50.212 INFO:teuthology.orchestra.run.smithi016.stdout:Enabling cephadm module... 2024-08-01T06:46:50.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:50 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/1234504969' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-08-01T06:46:51.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:51 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/2811712394' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-08-01T06:46:51.911 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.617+0000 7f3a3435f640 1 Processor -- start 2024-08-01T06:46:51.911 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.617+0000 7f3a3435f640 1 -- start start 2024-08-01T06:46:51.911 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.617+0000 7f3a3435f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a2c1055c0 0x7f3a2c1059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:51.912 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.617+0000 7f3a3435f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c105f90 con 0x7f3a2c1055c0 2024-08-01T06:46:51.912 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.617+0000 7f3a320fb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a2c1055c0 0x7f3a2c1059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:51.912 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.617+0000 7f3a320fb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a2c1055c0 0x7f3a2c1059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39870/0 (socket says 172.21.15.16:39870) 2024-08-01T06:46:51.912 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.617+0000 7f3a320fb640 1 -- 172.21.15.16:0/3899364722 learned_addr learned my addr 172.21.15.16:0/3899364722 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:51.912 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.617+0000 7f3a320fb640 1 -- 172.21.15.16:0/3899364722 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c1067c0 con 0x7f3a2c1055c0 2024-08-01T06:46:51.912 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.618+0000 7f3a320fb640 1 --2- 172.21.15.16:0/3899364722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a2c1055c0 0x7f3a2c1059c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3a28009820 tx=0x7f3a2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3edc6214f5f0da server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:51.912 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.618+0000 7f3a310f9640 1 -- 172.21.15.16:0/3899364722 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a2802ad40 con 0x7f3a2c1055c0 2024-08-01T06:46:51.912 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.618+0000 7f3a310f9640 1 -- 172.21.15.16:0/3899364722 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f3a280328c0 con 0x7f3a2c1055c0 2024-08-01T06:46:51.912 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.618+0000 7f3a310f9640 1 -- 172.21.15.16:0/3899364722 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a280307f0 con 0x7f3a2c1055c0 2024-08-01T06:46:51.912 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.619+0000 7f3a3435f640 1 -- 172.21.15.16:0/3899364722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a2c1055c0 msgr2=0x7f3a2c1059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:51.912 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.619+0000 7f3a3435f640 1 --2- 172.21.15.16:0/3899364722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a2c1055c0 0x7f3a2c1059c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3a28009820 tx=0x7f3a2802a270 comp rx=0 tx=0).stop 2024-08-01T06:46:51.912 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.619+0000 7f3a3435f640 1 -- 172.21.15.16:0/3899364722 shutdown_connections 2024-08-01T06:46:51.913 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.619+0000 7f3a3435f640 1 --2- 172.21.15.16:0/3899364722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a2c1055c0 0x7f3a2c1059c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:51.913 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.619+0000 7f3a3435f640 1 -- 172.21.15.16:0/3899364722 >> 172.21.15.16:0/3899364722 conn(0x7f3a2c100d70 msgr2=0x7f3a2c103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:51.913 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.619+0000 7f3a3435f640 1 -- 172.21.15.16:0/3899364722 shutdown_connections 2024-08-01T06:46:51.913 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.619+0000 7f3a3435f640 1 -- 172.21.15.16:0/3899364722 wait complete. 2024-08-01T06:46:51.913 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.619+0000 7f3a3435f640 1 Processor -- start 2024-08-01T06:46:51.913 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.620+0000 7f3a3435f640 1 -- start start 2024-08-01T06:46:51.913 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.620+0000 7f3a3435f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a2c1055c0 0x7f3a2c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:51.913 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.620+0000 7f3a3435f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c1997f0 con 0x7f3a2c1055c0 2024-08-01T06:46:51.913 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.620+0000 7f3a320fb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a2c1055c0 0x7f3a2c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:51.914 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.620+0000 7f3a320fb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a2c1055c0 0x7f3a2c1992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39880/0 (socket says 172.21.15.16:39880) 2024-08-01T06:46:51.914 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.620+0000 7f3a320fb640 1 -- 172.21.15.16:0/2811712394 learned_addr learned my addr 172.21.15.16:0/2811712394 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:51.914 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.620+0000 7f3a320fb640 1 -- 172.21.15.16:0/2811712394 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a280094d0 con 0x7f3a2c1055c0 2024-08-01T06:46:51.914 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.620+0000 7f3a320fb640 1 --2- 172.21.15.16:0/2811712394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a2c1055c0 0x7f3a2c1992b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3a280303a0 tx=0x7f3a28032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:51.914 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.620+0000 7f3a237fe640 1 -- 172.21.15.16:0/2811712394 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a28030cc0 con 0x7f3a2c1055c0 2024-08-01T06:46:51.914 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.620+0000 7f3a237fe640 1 -- 172.21.15.16:0/2811712394 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f3a28030e20 con 0x7f3a2c1055c0 2024-08-01T06:46:51.914 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.620+0000 7f3a3435f640 1 -- 172.21.15.16:0/2811712394 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2c1999f0 con 0x7f3a2c1055c0 2024-08-01T06:46:51.914 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.621+0000 7f3a237fe640 1 -- 172.21.15.16:0/2811712394 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a2803c620 con 0x7f3a2c1055c0 2024-08-01T06:46:51.914 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.621+0000 7f3a3435f640 1 -- 172.21.15.16:0/2811712394 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2c199e10 con 0x7f3a2c1055c0 2024-08-01T06:46:51.914 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.621+0000 7f3a237fe640 1 -- 172.21.15.16:0/2811712394 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7f3a2803d480 con 0x7f3a2c1055c0 2024-08-01T06:46:51.914 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.622+0000 7f3a237fe640 1 --2- 172.21.15.16:0/2811712394 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f3a18038650 0x7f3a1803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:51.914 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.622+0000 7f3a3435f640 1 -- 172.21.15.16:0/2811712394 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2c1059c0 con 0x7f3a2c1055c0 2024-08-01T06:46:51.914 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.622+0000 7f3a237fe640 1 -- 172.21.15.16:0/2811712394 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3a2806b960 con 0x7f3a2c1055c0 2024-08-01T06:46:51.915 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.622+0000 7f3a318fa640 1 --2- 172.21.15.16:0/2811712394 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f3a18038650 0x7f3a1803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:51.915 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.622+0000 7f3a318fa640 1 --2- 172.21.15.16:0/2811712394 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f3a18038650 0x7f3a1803ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0098c0 tx=0x7f3a1c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:51.915 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.626+0000 7f3a237fe640 1 -- 172.21.15.16:0/2811712394 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f3a280313a0 con 0x7f3a2c1055c0 2024-08-01T06:46:51.915 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:50.848+0000 7f3a3435f640 1 -- 172.21.15.16:0/2811712394 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f3a2c19c770 con 0x7f3a2c1055c0 2024-08-01T06:46:51.915 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:51.375+0000 7f3a237fe640 1 -- 172.21.15.16:0/2811712394 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f3a2803db20 con 0x7f3a2c1055c0 2024-08-01T06:46:51.915 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:51.376+0000 7f3a237fe640 1 -- 172.21.15.16:0/2811712394 <== mon.0 v2:172.21.15.16:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f3a2803f740 con 0x7f3a2c1055c0 2024-08-01T06:46:51.915 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:51.379+0000 7f3a3435f640 1 -- 172.21.15.16:0/2811712394 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f3a18038650 msgr2=0x7f3a1803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:51.915 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:51.379+0000 7f3a3435f640 1 --2- 172.21.15.16:0/2811712394 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f3a18038650 0x7f3a1803ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0098c0 tx=0x7f3a1c006db0 comp rx=0 tx=0).stop 2024-08-01T06:46:51.915 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:51.379+0000 7f3a3435f640 1 -- 172.21.15.16:0/2811712394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a2c1055c0 msgr2=0x7f3a2c1992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:51.915 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:51.379+0000 7f3a3435f640 1 --2- 172.21.15.16:0/2811712394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a2c1055c0 0x7f3a2c1992b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3a280303a0 tx=0x7f3a28032c60 comp rx=0 tx=0).stop 2024-08-01T06:46:51.916 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:51.379+0000 7f3a3435f640 1 -- 172.21.15.16:0/2811712394 shutdown_connections 2024-08-01T06:46:51.916 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:51.379+0000 7f3a3435f640 1 --2- 172.21.15.16:0/2811712394 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f3a18038650 0x7f3a1803ab10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:51.916 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:51.379+0000 7f3a3435f640 1 --2- 172.21.15.16:0/2811712394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a2c1055c0 0x7f3a2c1992b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:51.916 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:51.379+0000 7f3a3435f640 1 -- 172.21.15.16:0/2811712394 >> 172.21.15.16:0/2811712394 conn(0x7f3a2c100d70 msgr2=0x7f3a2c101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:51.916 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:51.379+0000 7f3a3435f640 1 -- 172.21.15.16:0/2811712394 shutdown_connections 2024-08-01T06:46:51.916 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:51.379+0000 7f3a3435f640 1 -- 172.21.15.16:0/2811712394 wait complete. 2024-08-01T06:46:52.570 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:52 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/2811712394' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-01T06:46:52.570 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:52 smithi016 ceph-mon[29266]: mgrmap e5: smithi016.whigbo(active, since 5s) 2024-08-01T06:46:53.194 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-08-01T06:46:53.194 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-01T06:46:53.194 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-01T06:46:53.194 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "active_name": "smithi016.whigbo", 2024-08-01T06:46:53.194 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-01T06:46:53.194 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-08-01T06:46:53.194 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.317+0000 7f490ad67640 1 Processor -- start 2024-08-01T06:46:53.194 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.317+0000 7f490ad67640 1 -- start start 2024-08-01T06:46:53.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.317+0000 7f490ad67640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49041055c0 0x7f49041059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:53.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.317+0000 7f490ad67640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4904105f90 con 0x7f49041055c0 2024-08-01T06:46:53.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.317+0000 7f4908b03640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49041055c0 0x7f49041059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:53.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.317+0000 7f4908b03640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49041055c0 0x7f49041059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39900/0 (socket says 172.21.15.16:39900) 2024-08-01T06:46:53.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.317+0000 7f4908b03640 1 -- 172.21.15.16:0/3742303556 learned_addr learned my addr 172.21.15.16:0/3742303556 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:53.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.318+0000 7f4908b03640 1 -- 172.21.15.16:0/3742303556 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49041067c0 con 0x7f49041055c0 2024-08-01T06:46:53.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.318+0000 7f4908b03640 1 --2- 172.21.15.16:0/3742303556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49041055c0 0x7f49041059c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009820 tx=0x7f48f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271bcd98883f22ff server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:53.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.318+0000 7f49037fe640 1 -- 172.21.15.16:0/3742303556 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f48f802ad40 con 0x7f49041055c0 2024-08-01T06:46:53.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.318+0000 7f49037fe640 1 -- 172.21.15.16:0/3742303556 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f48f80328c0 con 0x7f49041055c0 2024-08-01T06:46:53.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.319+0000 7f49037fe640 1 -- 172.21.15.16:0/3742303556 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f48f80307f0 con 0x7f49041055c0 2024-08-01T06:46:53.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.319+0000 7f490ad67640 1 -- 172.21.15.16:0/3742303556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49041055c0 msgr2=0x7f49041059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:53.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.319+0000 7f490ad67640 1 --2- 172.21.15.16:0/3742303556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49041055c0 0x7f49041059c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009820 tx=0x7f48f802a270 comp rx=0 tx=0).stop 2024-08-01T06:46:53.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.319+0000 7f490ad67640 1 -- 172.21.15.16:0/3742303556 shutdown_connections 2024-08-01T06:46:53.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.319+0000 7f490ad67640 1 --2- 172.21.15.16:0/3742303556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49041055c0 0x7f49041059c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:53.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.319+0000 7f490ad67640 1 -- 172.21.15.16:0/3742303556 >> 172.21.15.16:0/3742303556 conn(0x7f4904100d30 msgr2=0x7f4904103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:53.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.319+0000 7f490ad67640 1 -- 172.21.15.16:0/3742303556 shutdown_connections 2024-08-01T06:46:53.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.319+0000 7f490ad67640 1 -- 172.21.15.16:0/3742303556 wait complete. 2024-08-01T06:46:53.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.320+0000 7f490ad67640 1 Processor -- start 2024-08-01T06:46:53.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.320+0000 7f490ad67640 1 -- start start 2024-08-01T06:46:53.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.320+0000 7f490ad67640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49041055c0 0x7f49041992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:53.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.320+0000 7f490ad67640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4904199810 con 0x7f49041055c0 2024-08-01T06:46:53.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.320+0000 7f4908b03640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49041055c0 0x7f49041992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:53.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.320+0000 7f4908b03640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49041055c0 0x7f49041992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39910/0 (socket says 172.21.15.16:39910) 2024-08-01T06:46:53.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.320+0000 7f4908b03640 1 -- 172.21.15.16:0/248538392 learned_addr learned my addr 172.21.15.16:0/248538392 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:53.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.321+0000 7f4908b03640 1 -- 172.21.15.16:0/248538392 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f80094d0 con 0x7f49041055c0 2024-08-01T06:46:53.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.321+0000 7f4908b03640 1 --2- 172.21.15.16:0/248538392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49041055c0 0x7f49041992d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f48f80303a0 tx=0x7f48f8032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:53.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.321+0000 7f4901ffb640 1 -- 172.21.15.16:0/248538392 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f48f8030cc0 con 0x7f49041055c0 2024-08-01T06:46:53.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.321+0000 7f4901ffb640 1 -- 172.21.15.16:0/248538392 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f48f8030e20 con 0x7f49041055c0 2024-08-01T06:46:53.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.321+0000 7f490ad67640 1 -- 172.21.15.16:0/248538392 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4904199a10 con 0x7f49041055c0 2024-08-01T06:46:53.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.321+0000 7f4901ffb640 1 -- 172.21.15.16:0/248538392 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f48f803c620 con 0x7f49041055c0 2024-08-01T06:46:53.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.321+0000 7f490ad67640 1 -- 172.21.15.16:0/248538392 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4904199e30 con 0x7f49041055c0 2024-08-01T06:46:53.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.322+0000 7f4901ffb640 1 -- 172.21.15.16:0/248538392 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f48f803c810 con 0x7f49041055c0 2024-08-01T06:46:53.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.322+0000 7f4901ffb640 1 --2- 172.21.15.16:0/248538392 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f48f40386a0 0x7f48f403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:53.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.322+0000 7f4901ffb640 1 -- 172.21.15.16:0/248538392 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f48f806b9f0 con 0x7f49041055c0 2024-08-01T06:46:53.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.322+0000 7f4903fff640 1 -- 172.21.15.16:0/248538392 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f48f40386a0 msgr2=0x7f48f403ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.16:6800/3674863410 2024-08-01T06:46:53.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.322+0000 7f4903fff640 1 --2- 172.21.15.16:0/248538392 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f48f40386a0 0x7f48f403ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-01T06:46:53.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.322+0000 7f490ad67640 1 -- 172.21.15.16:0/248538392 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49041059c0 con 0x7f49041055c0 2024-08-01T06:46:53.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.327+0000 7f4901ffb640 1 -- 172.21.15.16:0/248538392 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f48f80313a0 con 0x7f49041055c0 2024-08-01T06:46:53.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.523+0000 7f4903fff640 1 -- 172.21.15.16:0/248538392 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f48f40386a0 msgr2=0x7f48f403ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.16:6800/3674863410 2024-08-01T06:46:53.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.523+0000 7f4903fff640 1 --2- 172.21.15.16:0/248538392 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f48f40386a0 0x7f48f403ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-01T06:46:53.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.565+0000 7f490ad67640 1 -- 172.21.15.16:0/248538392 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f490419c950 con 0x7f49041055c0 2024-08-01T06:46:53.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.566+0000 7f4901ffb640 1 -- 172.21.15.16:0/248538392 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f48f803bb30 con 0x7f49041055c0 2024-08-01T06:46:53.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.569+0000 7f490ad67640 1 -- 172.21.15.16:0/248538392 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f48f40386a0 msgr2=0x7f48f403ab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-01T06:46:53.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.569+0000 7f490ad67640 1 --2- 172.21.15.16:0/248538392 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f48f40386a0 0x7f48f403ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:53.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.569+0000 7f490ad67640 1 -- 172.21.15.16:0/248538392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49041055c0 msgr2=0x7f49041992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:53.199 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.569+0000 7f490ad67640 1 --2- 172.21.15.16:0/248538392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49041055c0 0x7f49041992d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f48f80303a0 tx=0x7f48f8032c60 comp rx=0 tx=0).stop 2024-08-01T06:46:53.199 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.569+0000 7f490ad67640 1 -- 172.21.15.16:0/248538392 shutdown_connections 2024-08-01T06:46:53.199 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.569+0000 7f490ad67640 1 --2- 172.21.15.16:0/248538392 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f48f40386a0 0x7f48f403ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:53.199 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.569+0000 7f490ad67640 1 --2- 172.21.15.16:0/248538392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49041055c0 0x7f49041992d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:53.199 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.569+0000 7f490ad67640 1 -- 172.21.15.16:0/248538392 >> 172.21.15.16:0/248538392 conn(0x7f4904100d30 msgr2=0x7f49041018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:53.199 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.569+0000 7f490ad67640 1 -- 172.21.15.16:0/248538392 shutdown_connections 2024-08-01T06:46:53.199 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:52.569+0000 7f490ad67640 1 -- 172.21.15.16:0/248538392 wait complete. 2024-08-01T06:46:53.199 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for the mgr to restart... 2024-08-01T06:46:53.199 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for mgr epoch 5... 2024-08-01T06:46:53.418 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:53 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/248538392' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-08-01T06:46:56.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:56 smithi016 ceph-mon[29266]: Active manager daemon smithi016.whigbo restarted 2024-08-01T06:46:56.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:56 smithi016 ceph-mon[29266]: Activating manager daemon smithi016.whigbo 2024-08-01T06:46:56.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:56 smithi016 ceph-mon[29266]: osdmap e2: 0 total, 0 up, 0 in 2024-08-01T06:46:56.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:56 smithi016 ceph-mon[29266]: mgrmap e6: smithi016.whigbo(active, starting, since 0.00347962s) 2024-08-01T06:46:56.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:56 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:46:56.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:56 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr metadata", "who": "smithi016.whigbo", "id": "smithi016.whigbo"}]: dispatch 2024-08-01T06:46:56.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:56 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-01T06:46:56.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:56 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-01T06:46:56.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:56 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-01T06:46:56.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:56 smithi016 ceph-mon[29266]: Manager daemon smithi016.whigbo is now available 2024-08-01T06:46:56.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:56 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:46:56.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:56 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:46:56.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:56 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:46:56.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:56 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:46:56.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:56 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi016.whigbo/mirror_snapshot_schedule"}]: dispatch 2024-08-01T06:46:56.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:56 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi016.whigbo/trash_purge_schedule"}]: dispatch 2024-08-01T06:46:57.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:57 smithi016 ceph-mon[29266]: Found migration_current of "None". Setting to last migration. 2024-08-01T06:46:57.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:57 smithi016 ceph-mon[29266]: mgrmap e7: smithi016.whigbo(active, since 1.0054s) 2024-08-01T06:46:57.856 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-08-01T06:46:57.857 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-01T06:46:57.857 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-01T06:46:57.857 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-08-01T06:46:57.857 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.632+0000 7f021708a640 1 Processor -- start 2024-08-01T06:46:57.857 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.632+0000 7f021708a640 1 -- start start 2024-08-01T06:46:57.857 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.632+0000 7f021708a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0210106050 0x7f0210108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:57.857 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.632+0000 7f021708a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0210079ea0 con 0x7f0210106050 2024-08-01T06:46:57.857 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.632+0000 7f0214e26640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0210106050 0x7f0210108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:57.858 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.632+0000 7f0214e26640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0210106050 0x7f0210108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39926/0 (socket says 172.21.15.16:39926) 2024-08-01T06:46:57.858 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.632+0000 7f0214e26640 1 -- 172.21.15.16:0/184431280 learned_addr learned my addr 172.21.15.16:0/184431280 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:57.858 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.633+0000 7f0214e26640 1 -- 172.21.15.16:0/184431280 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0210108980 con 0x7f0210106050 2024-08-01T06:46:57.858 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.633+0000 7f0214e26640 1 --2- 172.21.15.16:0/184431280 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0210106050 0x7f0210108440 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0204009820 tx=0x7f020402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a80c85ecfef635 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:57.858 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.634+0000 7f020f7fe640 1 -- 172.21.15.16:0/184431280 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f020402ad40 con 0x7f0210106050 2024-08-01T06:46:57.858 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.634+0000 7f020f7fe640 1 -- 172.21.15.16:0/184431280 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f02040328c0 con 0x7f0210106050 2024-08-01T06:46:57.858 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.634+0000 7f020f7fe640 1 -- 172.21.15.16:0/184431280 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02040307f0 con 0x7f0210106050 2024-08-01T06:46:57.858 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.634+0000 7f021708a640 1 -- 172.21.15.16:0/184431280 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0210106050 msgr2=0x7f0210108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:57.859 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.634+0000 7f021708a640 1 --2- 172.21.15.16:0/184431280 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0210106050 0x7f0210108440 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0204009820 tx=0x7f020402a270 comp rx=0 tx=0).stop 2024-08-01T06:46:57.859 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.634+0000 7f021708a640 1 -- 172.21.15.16:0/184431280 shutdown_connections 2024-08-01T06:46:57.859 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.634+0000 7f021708a640 1 --2- 172.21.15.16:0/184431280 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0210106050 0x7f0210108440 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:57.859 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.634+0000 7f021708a640 1 -- 172.21.15.16:0/184431280 >> 172.21.15.16:0/184431280 conn(0x7f02100ffc50 msgr2=0x7f02101020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:57.859 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.634+0000 7f021708a640 1 -- 172.21.15.16:0/184431280 shutdown_connections 2024-08-01T06:46:57.859 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.634+0000 7f021708a640 1 -- 172.21.15.16:0/184431280 wait complete. 2024-08-01T06:46:57.859 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.635+0000 7f021708a640 1 Processor -- start 2024-08-01T06:46:57.860 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.635+0000 7f021708a640 1 -- start start 2024-08-01T06:46:57.860 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.635+0000 7f021708a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0210106050 0x7f02101058d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:57.860 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.635+0000 7f021708a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0210105e10 con 0x7f0210106050 2024-08-01T06:46:57.860 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.635+0000 7f0214e26640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0210106050 0x7f02101058d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:57.860 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.635+0000 7f0214e26640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0210106050 0x7f02101058d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39928/0 (socket says 172.21.15.16:39928) 2024-08-01T06:46:57.860 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.635+0000 7f0214e26640 1 -- 172.21.15.16:0/2509909914 learned_addr learned my addr 172.21.15.16:0/2509909914 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:57.861 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.636+0000 7f0214e26640 1 -- 172.21.15.16:0/2509909914 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02040094d0 con 0x7f0210106050 2024-08-01T06:46:57.861 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.636+0000 7f0214e26640 1 --2- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0210106050 0x7f02101058d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0204009940 tx=0x7f0204032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:57.861 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.636+0000 7f020dffb640 1 -- 172.21.15.16:0/2509909914 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0204041070 con 0x7f0210106050 2024-08-01T06:46:57.861 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.636+0000 7f020dffb640 1 -- 172.21.15.16:0/2509909914 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f0204030cc0 con 0x7f0210106050 2024-08-01T06:46:57.861 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.636+0000 7f021708a640 1 -- 172.21.15.16:0/2509909914 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0210104000 con 0x7f0210106050 2024-08-01T06:46:57.861 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.636+0000 7f020dffb640 1 -- 172.21.15.16:0/2509909914 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f020403c620 con 0x7f0210106050 2024-08-01T06:46:57.862 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.636+0000 7f021708a640 1 -- 172.21.15.16:0/2509909914 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0210104420 con 0x7f0210106050 2024-08-01T06:46:57.862 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.637+0000 7f020dffb640 1 -- 172.21.15.16:0/2509909914 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f020403c780 con 0x7f0210106050 2024-08-01T06:46:57.862 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.637+0000 7f020dffb640 1 --2- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f02000386a0 0x7f020003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:57.862 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.637+0000 7f020dffb640 1 -- 172.21.15.16:0/2509909914 --> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f020003b270 con 0x7f02000386a0 2024-08-01T06:46:57.862 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.638+0000 7f020dffb640 1 -- 172.21.15.16:0/2509909914 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f020406b5f0 con 0x7f0210106050 2024-08-01T06:46:57.862 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.638+0000 7f020ffff640 1 -- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f02000386a0 msgr2=0x7f020003ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.16:6800/3674863410 2024-08-01T06:46:57.863 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.638+0000 7f020ffff640 1 --2- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f02000386a0 0x7f020003ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-01T06:46:57.863 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.839+0000 7f020ffff640 1 -- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f02000386a0 msgr2=0x7f020003ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.16:6800/3674863410 2024-08-01T06:46:57.863 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:53.839+0000 7f020ffff640 1 --2- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f02000386a0 0x7f020003ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-01T06:46:57.863 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:54.240+0000 7f020ffff640 1 -- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f02000386a0 msgr2=0x7f020003ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.16:6800/3674863410 2024-08-01T06:46:57.863 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:54.240+0000 7f020ffff640 1 --2- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f02000386a0 0x7f020003ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-01T06:46:57.863 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:55.041+0000 7f020ffff640 1 -- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f02000386a0 msgr2=0x7f020003ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.16:6800/3674863410 2024-08-01T06:46:57.864 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:55.041+0000 7f020ffff640 1 --2- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f02000386a0 0x7f020003ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-01T06:46:57.864 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:56.353+0000 7f020dffb640 1 -- 172.21.15.16:0/2509909914 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mgrmap(e 6) v1 ==== 45323+0+0 (secure 0 0 0) 0x7f020403db00 con 0x7f0210106050 2024-08-01T06:46:57.864 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:56.353+0000 7f020dffb640 1 -- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f02000386a0 msgr2=0x7f020003ab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-01T06:46:57.864 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:56.353+0000 7f020dffb640 1 --2- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f02000386a0 0x7f020003ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:57.864 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:57.354+0000 7f020dffb640 1 -- 172.21.15.16:0/2509909914 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mgrmap(e 7) v1 ==== 45450+0+0 (secure 0 0 0) 0x7f020404c720 con 0x7f0210106050 2024-08-01T06:46:57.864 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:57.354+0000 7f020dffb640 1 --2- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f020003bfd0 0x7f020003e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:57.865 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:57.354+0000 7f020dffb640 1 -- 172.21.15.16:0/2509909914 --> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f020003b270 con 0x7f020003bfd0 2024-08-01T06:46:57.865 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:57.354+0000 7f020ffff640 1 --2- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f020003bfd0 0x7f020003e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:57.865 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:57.355+0000 7f020ffff640 1 --2- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f020003bfd0 0x7f020003e3c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f01fc003980 tx=0x7f01fc0092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:57.865 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:57.356+0000 7f020dffb640 1 -- 172.21.15.16:0/2509909914 <== mgr.14118 v2:172.21.15.16:6800/247151947 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f020003b270 con 0x7f020003bfd0 2024-08-01T06:46:57.865 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:57.361+0000 7f021708a640 1 -- 172.21.15.16:0/2509909914 --> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f0210106430 con 0x7f020003bfd0 2024-08-01T06:46:57.865 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:57.362+0000 7f020dffb640 1 -- 172.21.15.16:0/2509909914 <== mgr.14118 v2:172.21.15.16:6800/247151947 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f0210106430 con 0x7f020003bfd0 2024-08-01T06:46:57.866 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:57.362+0000 7f021708a640 1 -- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f020003bfd0 msgr2=0x7f020003e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:57.866 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:57.362+0000 7f021708a640 1 --2- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f020003bfd0 0x7f020003e3c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f01fc003980 tx=0x7f01fc0092b0 comp rx=0 tx=0).stop 2024-08-01T06:46:57.866 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:57.362+0000 7f021708a640 1 -- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0210106050 msgr2=0x7f02101058d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:57.866 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:57.362+0000 7f021708a640 1 --2- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0210106050 0x7f02101058d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0204009940 tx=0x7f0204032c60 comp rx=0 tx=0).stop 2024-08-01T06:46:57.866 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:57.362+0000 7f021708a640 1 -- 172.21.15.16:0/2509909914 shutdown_connections 2024-08-01T06:46:57.866 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:57.362+0000 7f021708a640 1 --2- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f020003bfd0 0x7f020003e3c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:57.866 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:57.362+0000 7f021708a640 1 --2- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:6800/3674863410,v1:172.21.15.16:6801/3674863410] conn(0x7f02000386a0 0x7f020003ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:57.866 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:57.362+0000 7f021708a640 1 --2- 172.21.15.16:0/2509909914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0210106050 0x7f02101058d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:57.866 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:57.362+0000 7f021708a640 1 -- 172.21.15.16:0/2509909914 >> 172.21.15.16:0/2509909914 conn(0x7f02100ffc50 msgr2=0x7f0210100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:57.866 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:57.362+0000 7f021708a640 1 -- 172.21.15.16:0/2509909914 shutdown_connections 2024-08-01T06:46:57.867 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:57.362+0000 7f021708a640 1 -- 172.21.15.16:0/2509909914 wait complete. 2024-08-01T06:46:57.867 INFO:teuthology.orchestra.run.smithi016.stdout:mgr epoch 5 is available 2024-08-01T06:46:57.867 INFO:teuthology.orchestra.run.smithi016.stdout:Setting orchestrator backend to cephadm... 2024-08-01T06:46:58.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:58 smithi016 ceph-mon[29266]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-01T06:46:58.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:58 smithi016 ceph-mon[29266]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-01T06:46:58.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:58 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:46:58.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:58 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:46:59.030 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.221+0000 7f43b3f04640 1 Processor -- start 2024-08-01T06:46:59.030 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.221+0000 7f43b3f04640 1 -- start start 2024-08-01T06:46:59.030 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.222+0000 7f43b3f04640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac106050 0x7f43ac108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:59.030 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.222+0000 7f43b3f04640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac079ea0 con 0x7f43ac106050 2024-08-01T06:46:59.030 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.222+0000 7f43b1ca0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac106050 0x7f43ac108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:59.031 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.222+0000 7f43b1ca0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac106050 0x7f43ac108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39984/0 (socket says 172.21.15.16:39984) 2024-08-01T06:46:59.031 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.222+0000 7f43b1ca0640 1 -- 172.21.15.16:0/1064406389 learned_addr learned my addr 172.21.15.16:0/1064406389 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:59.031 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.222+0000 7f43b1ca0640 1 -- 172.21.15.16:0/1064406389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac108980 con 0x7f43ac106050 2024-08-01T06:46:59.031 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.223+0000 7f43b1ca0640 1 --2- 172.21.15.16:0/1064406389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac106050 0x7f43ac108440 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009820 tx=0x7f43a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12be3f66c5a6fcd server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:59.031 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.223+0000 7f43b0c9e640 1 -- 172.21.15.16:0/1064406389 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43a802ad40 con 0x7f43ac106050 2024-08-01T06:46:59.031 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.223+0000 7f43b0c9e640 1 -- 172.21.15.16:0/1064406389 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f43a80328c0 con 0x7f43ac106050 2024-08-01T06:46:59.032 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.223+0000 7f43b0c9e640 1 -- 172.21.15.16:0/1064406389 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43a80307f0 con 0x7f43ac106050 2024-08-01T06:46:59.032 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.224+0000 7f43b3f04640 1 -- 172.21.15.16:0/1064406389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac106050 msgr2=0x7f43ac108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:59.032 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.224+0000 7f43b3f04640 1 --2- 172.21.15.16:0/1064406389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac106050 0x7f43ac108440 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009820 tx=0x7f43a802a270 comp rx=0 tx=0).stop 2024-08-01T06:46:59.032 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.224+0000 7f43b3f04640 1 -- 172.21.15.16:0/1064406389 shutdown_connections 2024-08-01T06:46:59.032 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.224+0000 7f43b3f04640 1 --2- 172.21.15.16:0/1064406389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac106050 0x7f43ac108440 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:59.032 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.224+0000 7f43b3f04640 1 -- 172.21.15.16:0/1064406389 >> 172.21.15.16:0/1064406389 conn(0x7f43ac0ffc50 msgr2=0x7f43ac1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:59.032 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.224+0000 7f43b3f04640 1 -- 172.21.15.16:0/1064406389 shutdown_connections 2024-08-01T06:46:59.032 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.224+0000 7f43b3f04640 1 -- 172.21.15.16:0/1064406389 wait complete. 2024-08-01T06:46:59.032 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.224+0000 7f43b3f04640 1 Processor -- start 2024-08-01T06:46:59.032 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.225+0000 7f43b3f04640 1 -- start start 2024-08-01T06:46:59.032 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.225+0000 7f43b3f04640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac106050 0x7f43ac1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:59.032 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.225+0000 7f43b3f04640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac1997f0 con 0x7f43ac106050 2024-08-01T06:46:59.033 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.225+0000 7f43b1ca0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac106050 0x7f43ac1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:59.033 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.225+0000 7f43b1ca0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac106050 0x7f43ac1992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39986/0 (socket says 172.21.15.16:39986) 2024-08-01T06:46:59.033 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.225+0000 7f43b1ca0640 1 -- 172.21.15.16:0/2518390664 learned_addr learned my addr 172.21.15.16:0/2518390664 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:46:59.033 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.225+0000 7f43b1ca0640 1 -- 172.21.15.16:0/2518390664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a80094d0 con 0x7f43ac106050 2024-08-01T06:46:59.033 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.225+0000 7f43b1ca0640 1 --2- 172.21.15.16:0/2518390664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac106050 0x7f43ac1992b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009940 tx=0x7f43a8032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:59.033 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.226+0000 7f43a2ffd640 1 -- 172.21.15.16:0/2518390664 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43a8041070 con 0x7f43ac106050 2024-08-01T06:46:59.033 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.226+0000 7f43a2ffd640 1 -- 172.21.15.16:0/2518390664 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f43a8030cc0 con 0x7f43ac106050 2024-08-01T06:46:59.034 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.226+0000 7f43b3f04640 1 -- 172.21.15.16:0/2518390664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ac1999f0 con 0x7f43ac106050 2024-08-01T06:46:59.034 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.226+0000 7f43a2ffd640 1 -- 172.21.15.16:0/2518390664 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43a803c620 con 0x7f43ac106050 2024-08-01T06:46:59.034 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.226+0000 7f43b3f04640 1 -- 172.21.15.16:0/2518390664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ac199e10 con 0x7f43ac106050 2024-08-01T06:46:59.034 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.227+0000 7f43a2ffd640 1 -- 172.21.15.16:0/2518390664 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 7) v1 ==== 45450+0+0 (secure 0 0 0) 0x7f43a803d480 con 0x7f43ac106050 2024-08-01T06:46:59.034 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.227+0000 7f43a2ffd640 1 --2- 172.21.15.16:0/2518390664 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f4398038530 0x7f439803a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:46:59.034 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.227+0000 7f43a2ffd640 1 -- 172.21.15.16:0/2518390664 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f43a806b430 con 0x7f43ac106050 2024-08-01T06:46:59.034 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.227+0000 7f43b3f04640 1 -- 172.21.15.16:0/2518390664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ac109700 con 0x7f43ac106050 2024-08-01T06:46:59.034 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.227+0000 7f43b149f640 1 --2- 172.21.15.16:0/2518390664 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f4398038530 0x7f439803a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:46:59.035 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.227+0000 7f43b149f640 1 --2- 172.21.15.16:0/2518390664 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f4398038530 0x7f439803a9f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f439c0098c0 tx=0x7f439c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:46:59.035 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.232+0000 7f43a2ffd640 1 -- 172.21.15.16:0/2518390664 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f43a803db00 con 0x7f43ac106050 2024-08-01T06:46:59.035 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.418+0000 7f43b3f04640 1 -- 172.21.15.16:0/2518390664 --> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f43ac19c770 con 0x7f4398038530 2024-08-01T06:46:59.035 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.426+0000 7f43a2ffd640 1 -- 172.21.15.16:0/2518390664 <== mgr.14118 v2:172.21.15.16:6800/247151947 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f43ac19c770 con 0x7f4398038530 2024-08-01T06:46:59.035 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.428+0000 7f43b3f04640 1 -- 172.21.15.16:0/2518390664 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f4398038530 msgr2=0x7f439803a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:59.035 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.428+0000 7f43b3f04640 1 --2- 172.21.15.16:0/2518390664 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f4398038530 0x7f439803a9f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f439c0098c0 tx=0x7f439c006db0 comp rx=0 tx=0).stop 2024-08-01T06:46:59.035 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.428+0000 7f43b3f04640 1 -- 172.21.15.16:0/2518390664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac106050 msgr2=0x7f43ac1992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:46:59.035 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.428+0000 7f43b3f04640 1 --2- 172.21.15.16:0/2518390664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac106050 0x7f43ac1992b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009940 tx=0x7f43a8032c60 comp rx=0 tx=0).stop 2024-08-01T06:46:59.035 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.428+0000 7f43b3f04640 1 -- 172.21.15.16:0/2518390664 shutdown_connections 2024-08-01T06:46:59.035 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.428+0000 7f43b3f04640 1 --2- 172.21.15.16:0/2518390664 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f4398038530 0x7f439803a9f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:59.036 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.428+0000 7f43b3f04640 1 --2- 172.21.15.16:0/2518390664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43ac106050 0x7f43ac1992b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:46:59.036 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.428+0000 7f43b3f04640 1 -- 172.21.15.16:0/2518390664 >> 172.21.15.16:0/2518390664 conn(0x7f43ac0ffc50 msgr2=0x7f43ac1007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:46:59.036 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.428+0000 7f43b3f04640 1 -- 172.21.15.16:0/2518390664 shutdown_connections 2024-08-01T06:46:59.036 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:58.428+0000 7f43b3f04640 1 -- 172.21.15.16:0/2518390664 wait complete. 2024-08-01T06:46:59.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:59 smithi016 ceph-mon[29266]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:46:59.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:59 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:46:59.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:59 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:46:59.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:46:59 smithi016 ceph-mon[29266]: mgrmap e8: smithi016.whigbo(active, since 2s) 2024-08-01T06:47:00.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-01T06:47:00.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.368+0000 7fde84e07640 1 Processor -- start 2024-08-01T06:47:00.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.368+0000 7fde84e07640 1 -- start start 2024-08-01T06:47:00.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.368+0000 7fde84e07640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde801055c0 0x7fde801059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:00.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.368+0000 7fde84e07640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde80105f90 con 0x7fde801055c0 2024-08-01T06:47:00.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.369+0000 7fde7e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde801055c0 0x7fde801059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:00.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.369+0000 7fde7e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde801055c0 0x7fde801059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41656/0 (socket says 172.21.15.16:41656) 2024-08-01T06:47:00.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.369+0000 7fde7e59c640 1 -- 172.21.15.16:0/2521236864 learned_addr learned my addr 172.21.15.16:0/2521236864 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:00.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.369+0000 7fde7e59c640 1 -- 172.21.15.16:0/2521236864 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde801067c0 con 0x7fde801055c0 2024-08-01T06:47:00.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.370+0000 7fde7e59c640 1 --2- 172.21.15.16:0/2521236864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde801055c0 0x7fde801059c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fde68009820 tx=0x7fde6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f54f65788ca792 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:00.195 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.370+0000 7fde7d59a640 1 -- 172.21.15.16:0/2521236864 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde6802ad40 con 0x7fde801055c0 2024-08-01T06:47:00.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.370+0000 7fde7d59a640 1 -- 172.21.15.16:0/2521236864 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fde680328c0 con 0x7fde801055c0 2024-08-01T06:47:00.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.370+0000 7fde7d59a640 1 -- 172.21.15.16:0/2521236864 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde680307f0 con 0x7fde801055c0 2024-08-01T06:47:00.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.370+0000 7fde84e07640 1 -- 172.21.15.16:0/2521236864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde801055c0 msgr2=0x7fde801059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:00.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.370+0000 7fde84e07640 1 --2- 172.21.15.16:0/2521236864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde801055c0 0x7fde801059c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fde68009820 tx=0x7fde6802a270 comp rx=0 tx=0).stop 2024-08-01T06:47:00.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.371+0000 7fde84e07640 1 -- 172.21.15.16:0/2521236864 shutdown_connections 2024-08-01T06:47:00.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.371+0000 7fde84e07640 1 --2- 172.21.15.16:0/2521236864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde801055c0 0x7fde801059c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:00.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.371+0000 7fde84e07640 1 -- 172.21.15.16:0/2521236864 >> 172.21.15.16:0/2521236864 conn(0x7fde80100d30 msgr2=0x7fde80103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:00.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.371+0000 7fde84e07640 1 -- 172.21.15.16:0/2521236864 shutdown_connections 2024-08-01T06:47:00.196 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.371+0000 7fde84e07640 1 -- 172.21.15.16:0/2521236864 wait complete. 2024-08-01T06:47:00.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.371+0000 7fde84e07640 1 Processor -- start 2024-08-01T06:47:00.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.371+0000 7fde84e07640 1 -- start start 2024-08-01T06:47:00.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.372+0000 7fde84e07640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde801055c0 0x7fde801992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:00.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.372+0000 7fde84e07640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde80199810 con 0x7fde801055c0 2024-08-01T06:47:00.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.372+0000 7fde7e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde801055c0 0x7fde801992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:00.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.372+0000 7fde7e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde801055c0 0x7fde801992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41658/0 (socket says 172.21.15.16:41658) 2024-08-01T06:47:00.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.372+0000 7fde7e59c640 1 -- 172.21.15.16:0/1997790903 learned_addr learned my addr 172.21.15.16:0/1997790903 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:00.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.372+0000 7fde7e59c640 1 -- 172.21.15.16:0/1997790903 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde680094d0 con 0x7fde801055c0 2024-08-01T06:47:00.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.372+0000 7fde7e59c640 1 --2- 172.21.15.16:0/1997790903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde801055c0 0x7fde801992d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fde680303a0 tx=0x7fde68032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:00.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.372+0000 7fde777fe640 1 -- 172.21.15.16:0/1997790903 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde68030cc0 con 0x7fde801055c0 2024-08-01T06:47:00.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.372+0000 7fde777fe640 1 -- 172.21.15.16:0/1997790903 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fde68030e20 con 0x7fde801055c0 2024-08-01T06:47:00.197 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.372+0000 7fde777fe640 1 -- 172.21.15.16:0/1997790903 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde6803c620 con 0x7fde801055c0 2024-08-01T06:47:00.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.372+0000 7fde84e07640 1 -- 172.21.15.16:0/1997790903 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde80199a10 con 0x7fde801055c0 2024-08-01T06:47:00.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.372+0000 7fde84e07640 1 -- 172.21.15.16:0/1997790903 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde80199e30 con 0x7fde801055c0 2024-08-01T06:47:00.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.373+0000 7fde777fe640 1 -- 172.21.15.16:0/1997790903 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fde6803d480 con 0x7fde801055c0 2024-08-01T06:47:00.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.373+0000 7fde84e07640 1 -- 172.21.15.16:0/1997790903 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde801099f0 con 0x7fde801055c0 2024-08-01T06:47:00.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.374+0000 7fde777fe640 1 --2- 172.21.15.16:0/1997790903 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fde6c0386a0 0x7fde6c03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:00.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.374+0000 7fde777fe640 1 -- 172.21.15.16:0/1997790903 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fde6806b9d0 con 0x7fde801055c0 2024-08-01T06:47:00.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.374+0000 7fde7dd9b640 1 --2- 172.21.15.16:0/1997790903 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fde6c0386a0 0x7fde6c03ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:00.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.374+0000 7fde7dd9b640 1 --2- 172.21.15.16:0/1997790903 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fde6c0386a0 0x7fde6c03ab60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fde700098c0 tx=0x7fde70006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:00.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.378+0000 7fde777fe640 1 -- 172.21.15.16:0/1997790903 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fde68045d30 con 0x7fde801055c0 2024-08-01T06:47:00.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.555+0000 7fde84e07640 1 -- 172.21.15.16:0/1997790903 --> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fde80101fc0 con 0x7fde6c0386a0 2024-08-01T06:47:00.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.556+0000 7fde777fe640 1 -- 172.21.15.16:0/1997790903 <== mgr.14118 v2:172.21.15.16:6800/247151947 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fde80101fc0 con 0x7fde6c0386a0 2024-08-01T06:47:00.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.558+0000 7fde84e07640 1 -- 172.21.15.16:0/1997790903 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fde6c0386a0 msgr2=0x7fde6c03ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:00.198 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.558+0000 7fde84e07640 1 --2- 172.21.15.16:0/1997790903 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fde6c0386a0 0x7fde6c03ab60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fde700098c0 tx=0x7fde70006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:00.199 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.558+0000 7fde84e07640 1 -- 172.21.15.16:0/1997790903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde801055c0 msgr2=0x7fde801992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:00.199 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.558+0000 7fde84e07640 1 --2- 172.21.15.16:0/1997790903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde801055c0 0x7fde801992d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fde680303a0 tx=0x7fde68032c60 comp rx=0 tx=0).stop 2024-08-01T06:47:00.199 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.558+0000 7fde84e07640 1 -- 172.21.15.16:0/1997790903 shutdown_connections 2024-08-01T06:47:00.199 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.558+0000 7fde84e07640 1 --2- 172.21.15.16:0/1997790903 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fde6c0386a0 0x7fde6c03ab60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:00.199 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.558+0000 7fde84e07640 1 --2- 172.21.15.16:0/1997790903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde801055c0 0x7fde801992d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:00.199 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.558+0000 7fde84e07640 1 -- 172.21.15.16:0/1997790903 >> 172.21.15.16:0/1997790903 conn(0x7fde80100d30 msgr2=0x7fde801018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:00.199 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.558+0000 7fde84e07640 1 -- 172.21.15.16:0/1997790903 shutdown_connections 2024-08-01T06:47:00.199 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:46:59.558+0000 7fde84e07640 1 -- 172.21.15.16:0/1997790903 wait complete. 2024-08-01T06:47:00.199 INFO:teuthology.orchestra.run.smithi016.stdout:Generating ssh key... 2024-08-01T06:47:00.514 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:00 smithi016 ceph-mon[29266]: [01/Aug/2024:06:46:59] ENGINE Bus STARTING 2024-08-01T06:47:00.515 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:00 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:47:01.510 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:01 smithi016 ceph-mon[29266]: [01/Aug/2024:06:46:59] ENGINE Serving on http://172.21.15.16:8765 2024-08-01T06:47:01.511 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:01 smithi016 ceph-mon[29266]: [01/Aug/2024:06:46:59] ENGINE Serving on https://172.21.15.16:7150 2024-08-01T06:47:01.511 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:01 smithi016 ceph-mon[29266]: [01/Aug/2024:06:46:59] ENGINE Bus STARTED 2024-08-01T06:47:01.511 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:01 smithi016 ceph-mon[29266]: [01/Aug/2024:06:46:59] ENGINE Error in HTTPServer.serve 2024-08-01T06:47:01.511 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Traceback (most recent call last): 2024-08-01T06:47:01.511 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-01T06:47:01.511 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self._connections.run(self.expiration_interval) 2024-08-01T06:47:01.511 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-01T06:47:01.511 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self._run(expiration_interval) 2024-08-01T06:47:01.511 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-01T06:47:01.511 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-01T06:47:01.511 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-01T06:47:01.511 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-01T06:47:01.511 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-01T06:47:01.512 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: s = self.context.wrap_socket( 2024-08-01T06:47:01.512 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-01T06:47:01.512 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: return self.sslsocket_class._create( 2024-08-01T06:47:01.512 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-01T06:47:01.512 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self.do_handshake() 2024-08-01T06:47:01.512 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-01T06:47:01.512 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self._sslobj.do_handshake() 2024-08-01T06:47:01.512 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-01T06:47:01.512 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:01 smithi016 ceph-mon[29266]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:47:01.512 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:01 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:01.512 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:01 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:01.793 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.595+0000 7fad514ab640 1 Processor -- start 2024-08-01T06:47:01.793 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.595+0000 7fad514ab640 1 -- start start 2024-08-01T06:47:01.793 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.595+0000 7fad514ab640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad4c07be70 0x7fad4c07a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:01.793 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.595+0000 7fad514ab640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c07a8a0 con 0x7fad4c07be70 2024-08-01T06:47:01.793 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.595+0000 7fad4affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad4c07be70 0x7fad4c07a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:01.793 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.595+0000 7fad4affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad4c07be70 0x7fad4c07a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41664/0 (socket says 172.21.15.16:41664) 2024-08-01T06:47:01.793 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.595+0000 7fad4affd640 1 -- 172.21.15.16:0/3480247658 learned_addr learned my addr 172.21.15.16:0/3480247658 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:01.794 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.596+0000 7fad4affd640 1 -- 172.21.15.16:0/3480247658 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c07a9e0 con 0x7fad4c07be70 2024-08-01T06:47:01.794 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.596+0000 7fad4affd640 1 --2- 172.21.15.16:0/3480247658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad4c07be70 0x7fad4c07a2d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009e80 tx=0x7fad3c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b7929e8119e375 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:01.794 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.597+0000 7fad49ffb640 1 -- 172.21.15.16:0/3480247658 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad3c031400 con 0x7fad4c07be70 2024-08-01T06:47:01.794 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.597+0000 7fad49ffb640 1 -- 172.21.15.16:0/3480247658 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fad3c02d050 con 0x7fad4c07be70 2024-08-01T06:47:01.794 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.597+0000 7fad49ffb640 1 -- 172.21.15.16:0/3480247658 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad3c007910 con 0x7fad4c07be70 2024-08-01T06:47:01.794 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.597+0000 7fad514ab640 1 -- 172.21.15.16:0/3480247658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad4c07be70 msgr2=0x7fad4c07a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:01.794 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.597+0000 7fad514ab640 1 --2- 172.21.15.16:0/3480247658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad4c07be70 0x7fad4c07a2d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009e80 tx=0x7fad3c02a7a0 comp rx=0 tx=0).stop 2024-08-01T06:47:01.794 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.597+0000 7fad514ab640 1 -- 172.21.15.16:0/3480247658 shutdown_connections 2024-08-01T06:47:01.794 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.597+0000 7fad514ab640 1 --2- 172.21.15.16:0/3480247658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad4c07be70 0x7fad4c07a2d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:01.794 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.597+0000 7fad514ab640 1 -- 172.21.15.16:0/3480247658 >> 172.21.15.16:0/3480247658 conn(0x7fad4c100d80 msgr2=0x7fad4c1031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:01.794 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.597+0000 7fad514ab640 1 -- 172.21.15.16:0/3480247658 shutdown_connections 2024-08-01T06:47:01.794 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.597+0000 7fad514ab640 1 -- 172.21.15.16:0/3480247658 wait complete. 2024-08-01T06:47:01.794 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.598+0000 7fad514ab640 1 Processor -- start 2024-08-01T06:47:01.795 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.598+0000 7fad514ab640 1 -- start start 2024-08-01T06:47:01.795 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.598+0000 7fad514ab640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad4c07be70 0x7fad4c19b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:01.795 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.598+0000 7fad514ab640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c19bab0 con 0x7fad4c07be70 2024-08-01T06:47:01.795 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.598+0000 7fad4affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad4c07be70 0x7fad4c19b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:01.795 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.598+0000 7fad4affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad4c07be70 0x7fad4c19b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41672/0 (socket says 172.21.15.16:41672) 2024-08-01T06:47:01.795 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.598+0000 7fad4affd640 1 -- 172.21.15.16:0/3596570924 learned_addr learned my addr 172.21.15.16:0/3596570924 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:01.795 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.599+0000 7fad4affd640 1 -- 172.21.15.16:0/3596570924 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c009b30 con 0x7fad4c07be70 2024-08-01T06:47:01.795 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.599+0000 7fad4affd640 1 --2- 172.21.15.16:0/3596570924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad4c07be70 0x7fad4c19b570 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fad3c031630 tx=0x7fad3c0075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:01.795 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.599+0000 7fad43fff640 1 -- 172.21.15.16:0/3596570924 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad3c031b50 con 0x7fad4c07be70 2024-08-01T06:47:01.795 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.599+0000 7fad43fff640 1 -- 172.21.15.16:0/3596570924 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fad3c031cb0 con 0x7fad4c07be70 2024-08-01T06:47:01.795 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.599+0000 7fad514ab640 1 -- 172.21.15.16:0/3596570924 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad4c19bcb0 con 0x7fad4c07be70 2024-08-01T06:47:01.795 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.599+0000 7fad43fff640 1 -- 172.21.15.16:0/3596570924 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad3c03a6b0 con 0x7fad4c07be70 2024-08-01T06:47:01.795 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.599+0000 7fad514ab640 1 -- 172.21.15.16:0/3596570924 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4c19c1b0 con 0x7fad4c07be70 2024-08-01T06:47:01.796 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.600+0000 7fad43fff640 1 -- 172.21.15.16:0/3596570924 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fad3c038040 con 0x7fad4c07be70 2024-08-01T06:47:01.796 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.600+0000 7fad514ab640 1 -- 172.21.15.16:0/3596570924 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4c10b940 con 0x7fad4c07be70 2024-08-01T06:47:01.796 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.600+0000 7fad43fff640 1 --2- 172.21.15.16:0/3596570924 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fad380386a0 0x7fad3803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:01.796 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.600+0000 7fad43fff640 1 -- 172.21.15.16:0/3596570924 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fad3c06b8b0 con 0x7fad4c07be70 2024-08-01T06:47:01.796 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.601+0000 7fad4a7fc640 1 --2- 172.21.15.16:0/3596570924 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fad380386a0 0x7fad3803ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:01.796 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.601+0000 7fad4a7fc640 1 --2- 172.21.15.16:0/3596570924 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fad380386a0 0x7fad3803ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fad340098c0 tx=0x7fad34006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:01.796 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.605+0000 7fad43fff640 1 -- 172.21.15.16:0/3596570924 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fad3c04b950 con 0x7fad4c07be70 2024-08-01T06:47:01.796 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:00.778+0000 7fad514ab640 1 -- 172.21.15.16:0/3596570924 --> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fad4c1020f0 con 0x7fad380386a0 2024-08-01T06:47:01.796 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:01.199+0000 7fad43fff640 1 -- 172.21.15.16:0/3596570924 <== mgr.14118 v2:172.21.15.16:6800/247151947 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fad4c1020f0 con 0x7fad380386a0 2024-08-01T06:47:01.796 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:01.200+0000 7fad514ab640 1 -- 172.21.15.16:0/3596570924 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fad380386a0 msgr2=0x7fad3803ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:01.796 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:01.200+0000 7fad514ab640 1 --2- 172.21.15.16:0/3596570924 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fad380386a0 0x7fad3803ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fad340098c0 tx=0x7fad34006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:01.796 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:01.200+0000 7fad514ab640 1 -- 172.21.15.16:0/3596570924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad4c07be70 msgr2=0x7fad4c19b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:01.796 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:01.200+0000 7fad514ab640 1 --2- 172.21.15.16:0/3596570924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad4c07be70 0x7fad4c19b570 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fad3c031630 tx=0x7fad3c0075c0 comp rx=0 tx=0).stop 2024-08-01T06:47:01.797 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:01.201+0000 7fad514ab640 1 -- 172.21.15.16:0/3596570924 shutdown_connections 2024-08-01T06:47:01.797 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:01.201+0000 7fad514ab640 1 --2- 172.21.15.16:0/3596570924 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fad380386a0 0x7fad3803ab60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:01.797 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:01.201+0000 7fad514ab640 1 --2- 172.21.15.16:0/3596570924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad4c07be70 0x7fad4c19b570 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:01.797 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:01.201+0000 7fad514ab640 1 -- 172.21.15.16:0/3596570924 >> 172.21.15.16:0/3596570924 conn(0x7fad4c100d80 msgr2=0x7fad4c1019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:01.797 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:01.201+0000 7fad514ab640 1 -- 172.21.15.16:0/3596570924 shutdown_connections 2024-08-01T06:47:01.797 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:01.201+0000 7fad514ab640 1 -- 172.21.15.16:0/3596570924 wait complete. 2024-08-01T06:47:02.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:02 smithi016 ceph-mon[29266]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:47:02.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:02 smithi016 ceph-mon[29266]: Generating ssh key... 2024-08-01T06:47:02.891 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSAFcFQJHGyOVjCDe10zU9KJnOWr2LKItN8sZCXDmRmVSJf6x00PciSW1J2Zm1z5dyuCFQNrsQA+0iTl0QXTzow6z8sdyYe1n5mpW5UieFAfGwZ1G23VRah6ktgsQATubkihw4FJeZKnhcQ17sBslku3vDKtSRITD+h45Zp18AfngRRL/cYAGtLGPGkXViCzxWtV+G9A1c622gYYAhDOEldKSWZh1hY9/BC2pt+hLvMi188ijCV3ZfC8kLs0VVZHGL78d7fsOf85X0QXVD7fOOxKAUqpXYOlR36lj2ynWLe47hAkOwixWRCws7pd7MxV3rKv/q6T5M5GdKok2YCa4KV5z93Q30qWO3EHhJCCuM7iHx2VF2zcguvwGHSjp7IwRyquvqW3+3C1jXHP+zypCVfB9SwgVf3hXphOF0bfD8DFxpvA3brgp2APFG3MgT8w9RAHP+Mlc0vLemUiLuywbD+jM8ZCNugpwZ0xeT0w211/OoqDpnTJvAbZcqo11RVss= ceph-a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:47:02.891 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.179+0000 7f5224c92640 1 Processor -- start 2024-08-01T06:47:02.891 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.179+0000 7f5224c92640 1 -- start start 2024-08-01T06:47:02.891 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.179+0000 7f5224c92640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5220106050 0x7f5220108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:02.891 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.179+0000 7f5224c92640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5220079ea0 con 0x7f5220106050 2024-08-01T06:47:02.892 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.179+0000 7f521e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5220106050 0x7f5220108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:02.892 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.179+0000 7f521e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5220106050 0x7f5220108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41676/0 (socket says 172.21.15.16:41676) 2024-08-01T06:47:02.892 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.179+0000 7f521e59c640 1 -- 172.21.15.16:0/3799033977 learned_addr learned my addr 172.21.15.16:0/3799033977 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:02.892 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.179+0000 7f521e59c640 1 -- 172.21.15.16:0/3799033977 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5220108980 con 0x7f5220106050 2024-08-01T06:47:02.892 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.180+0000 7f521e59c640 1 --2- 172.21.15.16:0/3799033977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5220106050 0x7f5220108440 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5210009820 tx=0x7f521002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635740c75d603caa server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:02.892 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.180+0000 7f521d59a640 1 -- 172.21.15.16:0/3799033977 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f521002ad40 con 0x7f5220106050 2024-08-01T06:47:02.892 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.180+0000 7f521d59a640 1 -- 172.21.15.16:0/3799033977 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f52100328c0 con 0x7f5220106050 2024-08-01T06:47:02.892 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.180+0000 7f521d59a640 1 -- 172.21.15.16:0/3799033977 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52100307f0 con 0x7f5220106050 2024-08-01T06:47:02.892 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.181+0000 7f5224c92640 1 -- 172.21.15.16:0/3799033977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5220106050 msgr2=0x7f5220108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:02.892 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.181+0000 7f5224c92640 1 --2- 172.21.15.16:0/3799033977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5220106050 0x7f5220108440 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5210009820 tx=0x7f521002a270 comp rx=0 tx=0).stop 2024-08-01T06:47:02.892 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.181+0000 7f5224c92640 1 -- 172.21.15.16:0/3799033977 shutdown_connections 2024-08-01T06:47:02.892 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.181+0000 7f5224c92640 1 --2- 172.21.15.16:0/3799033977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5220106050 0x7f5220108440 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:02.892 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.181+0000 7f5224c92640 1 -- 172.21.15.16:0/3799033977 >> 172.21.15.16:0/3799033977 conn(0x7f52200ffc50 msgr2=0x7f52201020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:02.893 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.181+0000 7f5224c92640 1 -- 172.21.15.16:0/3799033977 shutdown_connections 2024-08-01T06:47:02.893 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.181+0000 7f5224c92640 1 -- 172.21.15.16:0/3799033977 wait complete. 2024-08-01T06:47:02.893 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.182+0000 7f5224c92640 1 Processor -- start 2024-08-01T06:47:02.893 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.182+0000 7f5224c92640 1 -- start start 2024-08-01T06:47:02.893 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.182+0000 7f5224c92640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5220106050 0x7f52201058d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:02.893 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.182+0000 7f5224c92640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5220105e10 con 0x7f5220106050 2024-08-01T06:47:02.893 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.182+0000 7f521e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5220106050 0x7f52201058d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:02.893 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.182+0000 7f521e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5220106050 0x7f52201058d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41682/0 (socket says 172.21.15.16:41682) 2024-08-01T06:47:02.893 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.182+0000 7f521e59c640 1 -- 172.21.15.16:0/4081973029 learned_addr learned my addr 172.21.15.16:0/4081973029 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:02.893 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.183+0000 7f521e59c640 1 -- 172.21.15.16:0/4081973029 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52100094d0 con 0x7f5220106050 2024-08-01T06:47:02.893 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.183+0000 7f521e59c640 1 --2- 172.21.15.16:0/4081973029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5220106050 0x7f52201058d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5210030d30 tx=0x7f5210030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:02.893 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.183+0000 7f520f7fe640 1 -- 172.21.15.16:0/4081973029 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5210032c40 con 0x7f5220106050 2024-08-01T06:47:02.893 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.183+0000 7f520f7fe640 1 -- 172.21.15.16:0/4081973029 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f5210032da0 con 0x7f5220106050 2024-08-01T06:47:02.894 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.183+0000 7f5224c92640 1 -- 172.21.15.16:0/4081973029 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5220104000 con 0x7f5220106050 2024-08-01T06:47:02.894 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.183+0000 7f520f7fe640 1 -- 172.21.15.16:0/4081973029 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f521003c660 con 0x7f5220106050 2024-08-01T06:47:02.894 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.183+0000 7f5224c92640 1 -- 172.21.15.16:0/4081973029 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5220104420 con 0x7f5220106050 2024-08-01T06:47:02.894 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.184+0000 7f520f7fe640 1 -- 172.21.15.16:0/4081973029 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f521003c7c0 con 0x7f5220106050 2024-08-01T06:47:02.894 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.184+0000 7f5224c92640 1 -- 172.21.15.16:0/4081973029 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5220106430 con 0x7f5220106050 2024-08-01T06:47:02.894 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.184+0000 7f520f7fe640 1 --2- 172.21.15.16:0/4081973029 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f52080386a0 0x7f520803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:02.894 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.185+0000 7f520f7fe640 1 -- 172.21.15.16:0/4081973029 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f521006b8a0 con 0x7f5220106050 2024-08-01T06:47:02.894 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.185+0000 7f521dd9b640 1 --2- 172.21.15.16:0/4081973029 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f52080386a0 0x7f520803ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:02.894 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.185+0000 7f521dd9b640 1 --2- 172.21.15.16:0/4081973029 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f52080386a0 0x7f520803ab60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f52140098c0 tx=0x7f5214006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:02.894 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.189+0000 7f520f7fe640 1 -- 172.21.15.16:0/4081973029 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f52100313a0 con 0x7f5220106050 2024-08-01T06:47:02.894 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.364+0000 7f5224c92640 1 -- 172.21.15.16:0/4081973029 --> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f5220104ab0 con 0x7f52080386a0 2024-08-01T06:47:02.894 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.365+0000 7f520f7fe640 1 -- 172.21.15.16:0/4081973029 <== mgr.14118 v2:172.21.15.16:6800/247151947 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f5220104ab0 con 0x7f52080386a0 2024-08-01T06:47:02.894 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.367+0000 7f5224c92640 1 -- 172.21.15.16:0/4081973029 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f52080386a0 msgr2=0x7f520803ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:02.895 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.367+0000 7f5224c92640 1 --2- 172.21.15.16:0/4081973029 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f52080386a0 0x7f520803ab60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f52140098c0 tx=0x7f5214006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:02.895 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.367+0000 7f5224c92640 1 -- 172.21.15.16:0/4081973029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5220106050 msgr2=0x7f52201058d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:02.895 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.367+0000 7f5224c92640 1 --2- 172.21.15.16:0/4081973029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5220106050 0x7f52201058d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5210030d30 tx=0x7f5210030d60 comp rx=0 tx=0).stop 2024-08-01T06:47:02.895 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.368+0000 7f5224c92640 1 -- 172.21.15.16:0/4081973029 shutdown_connections 2024-08-01T06:47:02.895 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.368+0000 7f5224c92640 1 --2- 172.21.15.16:0/4081973029 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f52080386a0 0x7f520803ab60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:02.895 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.368+0000 7f5224c92640 1 --2- 172.21.15.16:0/4081973029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5220106050 0x7f52201058d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:02.895 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.368+0000 7f5224c92640 1 -- 172.21.15.16:0/4081973029 >> 172.21.15.16:0/4081973029 conn(0x7f52200ffc50 msgr2=0x7f5220100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:02.895 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.368+0000 7f5224c92640 1 -- 172.21.15.16:0/4081973029 shutdown_connections 2024-08-01T06:47:02.895 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:02.368+0000 7f5224c92640 1 -- 172.21.15.16:0/4081973029 wait complete. 2024-08-01T06:47:02.895 INFO:teuthology.orchestra.run.smithi016.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-01T06:47:02.895 INFO:teuthology.orchestra.run.smithi016.stdout:Adding key to root@localhost authorized_keys... 2024-08-01T06:47:02.895 INFO:teuthology.orchestra.run.smithi016.stdout:Adding host smithi016... 2024-08-01T06:47:03.703 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:03 smithi016 ceph-mon[29266]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:47:04.812 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:04 smithi016 ceph-mon[29266]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi016", "addr": "172.21.15.16", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:47:05.717 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:05 smithi016 ceph-mon[29266]: Deploying cephadm binary to smithi016 2024-08-01T06:47:07.333 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout Added host 'smithi016' with addr '172.21.15.16' 2024-08-01T06:47:07.333 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.302+0000 7fe74c909640 1 Processor -- start 2024-08-01T06:47:07.333 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.302+0000 7fe74c909640 1 -- start start 2024-08-01T06:47:07.333 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.302+0000 7fe74c909640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74807be70 0x7fe74807a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:07.333 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.302+0000 7fe74c909640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74807a8a0 con 0x7fe74807be70 2024-08-01T06:47:07.333 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.302+0000 7fe74659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74807be70 0x7fe74807a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:07.334 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.302+0000 7fe74659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74807be70 0x7fe74807a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41698/0 (socket says 172.21.15.16:41698) 2024-08-01T06:47:07.334 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.302+0000 7fe74659c640 1 -- 172.21.15.16:0/2690693383 learned_addr learned my addr 172.21.15.16:0/2690693383 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:07.334 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.302+0000 7fe74659c640 1 -- 172.21.15.16:0/2690693383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74807a9e0 con 0x7fe74807be70 2024-08-01T06:47:07.334 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.303+0000 7fe74659c640 1 --2- 172.21.15.16:0/2690693383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74807be70 0x7fe74807a2d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe738009820 tx=0x7fe73802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f07a0ea5fb7b81 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:07.334 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.303+0000 7fe745d9b640 1 -- 172.21.15.16:0/2690693383 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe73802ad40 con 0x7fe74807be70 2024-08-01T06:47:07.334 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.303+0000 7fe745d9b640 1 -- 172.21.15.16:0/2690693383 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe7380328c0 con 0x7fe74807be70 2024-08-01T06:47:07.334 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.303+0000 7fe745d9b640 1 -- 172.21.15.16:0/2690693383 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7380307f0 con 0x7fe74807be70 2024-08-01T06:47:07.334 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.304+0000 7fe74c909640 1 -- 172.21.15.16:0/2690693383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74807be70 msgr2=0x7fe74807a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:07.334 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.304+0000 7fe74c909640 1 --2- 172.21.15.16:0/2690693383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74807be70 0x7fe74807a2d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe738009820 tx=0x7fe73802a270 comp rx=0 tx=0).stop 2024-08-01T06:47:07.334 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.304+0000 7fe74c909640 1 -- 172.21.15.16:0/2690693383 shutdown_connections 2024-08-01T06:47:07.334 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.304+0000 7fe74c909640 1 --2- 172.21.15.16:0/2690693383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74807be70 0x7fe74807a2d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:07.334 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.304+0000 7fe74c909640 1 -- 172.21.15.16:0/2690693383 >> 172.21.15.16:0/2690693383 conn(0x7fe748100d30 msgr2=0x7fe748103170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.304+0000 7fe74c909640 1 -- 172.21.15.16:0/2690693383 shutdown_connections 2024-08-01T06:47:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.304+0000 7fe74c909640 1 -- 172.21.15.16:0/2690693383 wait complete. 2024-08-01T06:47:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.305+0000 7fe74c909640 1 Processor -- start 2024-08-01T06:47:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.305+0000 7fe74c909640 1 -- start start 2024-08-01T06:47:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.305+0000 7fe74c909640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74807be70 0x7fe74819b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.305+0000 7fe74c909640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74819ba00 con 0x7fe74807be70 2024-08-01T06:47:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.305+0000 7fe74659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74807be70 0x7fe74819b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.305+0000 7fe74659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74807be70 0x7fe74819b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41714/0 (socket says 172.21.15.16:41714) 2024-08-01T06:47:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.305+0000 7fe74659c640 1 -- 172.21.15.16:0/1406050121 learned_addr learned my addr 172.21.15.16:0/1406050121 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.305+0000 7fe74659c640 1 -- 172.21.15.16:0/1406050121 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7380094d0 con 0x7fe74807be70 2024-08-01T06:47:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.306+0000 7fe74659c640 1 --2- 172.21.15.16:0/1406050121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74807be70 0x7fe74819b4c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe738030d30 tx=0x7fe738030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.306+0000 7fe73ffff640 1 -- 172.21.15.16:0/1406050121 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe738032c40 con 0x7fe74807be70 2024-08-01T06:47:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.306+0000 7fe73ffff640 1 -- 172.21.15.16:0/1406050121 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe738032da0 con 0x7fe74807be70 2024-08-01T06:47:07.336 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.306+0000 7fe74c909640 1 -- 172.21.15.16:0/1406050121 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74819bc00 con 0x7fe74807be70 2024-08-01T06:47:07.336 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.306+0000 7fe73ffff640 1 -- 172.21.15.16:0/1406050121 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe73803c660 con 0x7fe74807be70 2024-08-01T06:47:07.336 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.306+0000 7fe74c909640 1 -- 172.21.15.16:0/1406050121 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74819c020 con 0x7fe74807be70 2024-08-01T06:47:07.336 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.307+0000 7fe73ffff640 1 -- 172.21.15.16:0/1406050121 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fe73803c8d0 con 0x7fe74807be70 2024-08-01T06:47:07.336 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.307+0000 7fe74c909640 1 -- 172.21.15.16:0/1406050121 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe74810b910 con 0x7fe74807be70 2024-08-01T06:47:07.336 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.307+0000 7fe73ffff640 1 --2- 172.21.15.16:0/1406050121 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fe734038650 0x7fe73403ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:07.336 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.307+0000 7fe73ffff640 1 -- 172.21.15.16:0/1406050121 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe73806b7a0 con 0x7fe74807be70 2024-08-01T06:47:07.336 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.307+0000 7fe73dd9b640 1 --2- 172.21.15.16:0/1406050121 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fe734038650 0x7fe73403ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:07.336 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.308+0000 7fe73dd9b640 1 --2- 172.21.15.16:0/1406050121 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fe734038650 0x7fe73403ab10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe7300098c0 tx=0x7fe730006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:07.336 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.312+0000 7fe73ffff640 1 -- 172.21.15.16:0/1406050121 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fe7380313a0 con 0x7fe74807be70 2024-08-01T06:47:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:03.491+0000 7fe74c909640 1 -- 172.21.15.16:0/1406050121 --> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi016", "addr": "172.21.15.16", "target": ["mon-mgr", ""]}) v1 -- 0x7fe748102020 con 0x7fe734038650 2024-08-01T06:47:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:06.791+0000 7fe73ffff640 1 -- 172.21.15.16:0/1406050121 <== mgr.14118 v2:172.21.15.16:6800/247151947 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fe748102020 con 0x7fe734038650 2024-08-01T06:47:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:06.794+0000 7fe74c909640 1 -- 172.21.15.16:0/1406050121 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fe734038650 msgr2=0x7fe73403ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:06.794+0000 7fe74c909640 1 --2- 172.21.15.16:0/1406050121 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fe734038650 0x7fe73403ab10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe7300098c0 tx=0x7fe730006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:06.794+0000 7fe74c909640 1 -- 172.21.15.16:0/1406050121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74807be70 msgr2=0x7fe74819b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:06.794+0000 7fe74c909640 1 --2- 172.21.15.16:0/1406050121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74807be70 0x7fe74819b4c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe738030d30 tx=0x7fe738030d60 comp rx=0 tx=0).stop 2024-08-01T06:47:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:06.794+0000 7fe74c909640 1 -- 172.21.15.16:0/1406050121 shutdown_connections 2024-08-01T06:47:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:06.794+0000 7fe74c909640 1 --2- 172.21.15.16:0/1406050121 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fe734038650 0x7fe73403ab10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:06.794+0000 7fe74c909640 1 --2- 172.21.15.16:0/1406050121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74807be70 0x7fe74819b4c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:06.794+0000 7fe74c909640 1 -- 172.21.15.16:0/1406050121 >> 172.21.15.16:0/1406050121 conn(0x7fe748100d30 msgr2=0x7fe748101910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:06.795+0000 7fe74c909640 1 -- 172.21.15.16:0/1406050121 shutdown_connections 2024-08-01T06:47:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:06.795+0000 7fe74c909640 1 -- 172.21.15.16:0/1406050121 wait complete. 2024-08-01T06:47:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:Deploying mon service with default placement... 2024-08-01T06:47:08.011 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:07 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:08.011 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:07 smithi016 ceph-mon[29266]: Added host smithi016 2024-08-01T06:47:08.011 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:07 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:47:08.483 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-01T06:47:08.484 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.707+0000 7f2e2b23e640 1 Processor -- start 2024-08-01T06:47:08.484 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.707+0000 7f2e2b23e640 1 -- start start 2024-08-01T06:47:08.484 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.707+0000 7f2e2b23e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e24106160 0x7f2e24108550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:08.484 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.707+0000 7f2e2b23e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e24079e20 con 0x7f2e24106160 2024-08-01T06:47:08.484 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.708+0000 7f2e28fda640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e24106160 0x7f2e24108550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:08.484 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.708+0000 7f2e28fda640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e24106160 0x7f2e24108550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41716/0 (socket says 172.21.15.16:41716) 2024-08-01T06:47:08.484 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.708+0000 7f2e28fda640 1 -- 172.21.15.16:0/3661221636 learned_addr learned my addr 172.21.15.16:0/3661221636 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:08.484 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.708+0000 7f2e28fda640 1 -- 172.21.15.16:0/3661221636 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e24108a90 con 0x7f2e24106160 2024-08-01T06:47:08.484 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.709+0000 7f2e28fda640 1 --2- 172.21.15.16:0/3661221636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e24106160 0x7f2e24108550 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009820 tx=0x7f2e1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8634af3740e6201a server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:08.484 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.709+0000 7f2e237fe640 1 -- 172.21.15.16:0/3661221636 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e1402ad40 con 0x7f2e24106160 2024-08-01T06:47:08.484 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.709+0000 7f2e237fe640 1 -- 172.21.15.16:0/3661221636 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f2e140328c0 con 0x7f2e24106160 2024-08-01T06:47:08.484 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.709+0000 7f2e237fe640 1 -- 172.21.15.16:0/3661221636 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e140307f0 con 0x7f2e24106160 2024-08-01T06:47:08.485 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.709+0000 7f2e2b23e640 1 -- 172.21.15.16:0/3661221636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e24106160 msgr2=0x7f2e24108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:08.485 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.709+0000 7f2e2b23e640 1 --2- 172.21.15.16:0/3661221636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e24106160 0x7f2e24108550 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009820 tx=0x7f2e1402a270 comp rx=0 tx=0).stop 2024-08-01T06:47:08.485 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.709+0000 7f2e2b23e640 1 -- 172.21.15.16:0/3661221636 shutdown_connections 2024-08-01T06:47:08.485 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.709+0000 7f2e2b23e640 1 --2- 172.21.15.16:0/3661221636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e24106160 0x7f2e24108550 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:08.485 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.710+0000 7f2e2b23e640 1 -- 172.21.15.16:0/3661221636 >> 172.21.15.16:0/3661221636 conn(0x7f2e240ffcc0 msgr2=0x7f2e24102140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:08.485 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.710+0000 7f2e2b23e640 1 -- 172.21.15.16:0/3661221636 shutdown_connections 2024-08-01T06:47:08.485 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.710+0000 7f2e2b23e640 1 -- 172.21.15.16:0/3661221636 wait complete. 2024-08-01T06:47:08.485 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.710+0000 7f2e2b23e640 1 Processor -- start 2024-08-01T06:47:08.485 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.710+0000 7f2e2b23e640 1 -- start start 2024-08-01T06:47:08.485 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.710+0000 7f2e2b23e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e24106160 0x7f2e241059e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:08.485 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.710+0000 7f2e2b23e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e24105f20 con 0x7f2e24106160 2024-08-01T06:47:08.485 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.711+0000 7f2e28fda640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e24106160 0x7f2e241059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:08.485 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.711+0000 7f2e28fda640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e24106160 0x7f2e241059e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41720/0 (socket says 172.21.15.16:41720) 2024-08-01T06:47:08.485 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.711+0000 7f2e28fda640 1 -- 172.21.15.16:0/3404938673 learned_addr learned my addr 172.21.15.16:0/3404938673 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:08.486 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.711+0000 7f2e28fda640 1 -- 172.21.15.16:0/3404938673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e140094d0 con 0x7f2e24106160 2024-08-01T06:47:08.486 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.711+0000 7f2e28fda640 1 --2- 172.21.15.16:0/3404938673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e24106160 0x7f2e241059e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009940 tx=0x7f2e14032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:08.486 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.711+0000 7f2e21ffb640 1 -- 172.21.15.16:0/3404938673 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e14041070 con 0x7f2e24106160 2024-08-01T06:47:08.486 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.711+0000 7f2e21ffb640 1 -- 172.21.15.16:0/3404938673 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f2e14030cc0 con 0x7f2e24106160 2024-08-01T06:47:08.486 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.711+0000 7f2e2b23e640 1 -- 172.21.15.16:0/3404938673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e24104110 con 0x7f2e24106160 2024-08-01T06:47:08.486 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.711+0000 7f2e21ffb640 1 -- 172.21.15.16:0/3404938673 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e1403c620 con 0x7f2e24106160 2024-08-01T06:47:08.486 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.712+0000 7f2e2b23e640 1 -- 172.21.15.16:0/3404938673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e24104530 con 0x7f2e24106160 2024-08-01T06:47:08.486 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.712+0000 7f2e21ffb640 1 -- 172.21.15.16:0/3404938673 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f2e1403c850 con 0x7f2e24106160 2024-08-01T06:47:08.486 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.713+0000 7f2e2b23e640 1 -- 172.21.15.16:0/3404938673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e24106540 con 0x7f2e24106160 2024-08-01T06:47:08.486 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.713+0000 7f2e21ffb640 1 --2- 172.21.15.16:0/3404938673 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f2e0c038650 0x7f2e0c03ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:08.486 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.713+0000 7f2e21ffb640 1 -- 172.21.15.16:0/3404938673 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2e1406b660 con 0x7f2e24106160 2024-08-01T06:47:08.486 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.713+0000 7f2e23fff640 1 --2- 172.21.15.16:0/3404938673 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f2e0c038650 0x7f2e0c03ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:08.487 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.713+0000 7f2e23fff640 1 --2- 172.21.15.16:0/3404938673 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f2e0c038650 0x7f2e0c03ab10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2e180098c0 tx=0x7f2e18006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:08.487 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.721+0000 7f2e21ffb640 1 -- 172.21.15.16:0/3404938673 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f2e14031e00 con 0x7f2e24106160 2024-08-01T06:47:08.487 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.914+0000 7f2e2b23e640 1 -- 172.21.15.16:0/3404938673 --> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e24104bc0 con 0x7f2e0c038650 2024-08-01T06:47:08.487 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.918+0000 7f2e21ffb640 1 -- 172.21.15.16:0/3404938673 <== mgr.14118 v2:172.21.15.16:6800/247151947 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f2e24104bc0 con 0x7f2e0c038650 2024-08-01T06:47:08.487 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.920+0000 7f2e2b23e640 1 -- 172.21.15.16:0/3404938673 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f2e0c038650 msgr2=0x7f2e0c03ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:08.487 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.920+0000 7f2e2b23e640 1 --2- 172.21.15.16:0/3404938673 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f2e0c038650 0x7f2e0c03ab10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2e180098c0 tx=0x7f2e18006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:08.487 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.920+0000 7f2e2b23e640 1 -- 172.21.15.16:0/3404938673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e24106160 msgr2=0x7f2e241059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:08.487 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.920+0000 7f2e2b23e640 1 --2- 172.21.15.16:0/3404938673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e24106160 0x7f2e241059e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009940 tx=0x7f2e14032c60 comp rx=0 tx=0).stop 2024-08-01T06:47:08.487 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.920+0000 7f2e2b23e640 1 -- 172.21.15.16:0/3404938673 shutdown_connections 2024-08-01T06:47:08.487 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.920+0000 7f2e2b23e640 1 --2- 172.21.15.16:0/3404938673 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f2e0c038650 0x7f2e0c03ab10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:08.487 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.920+0000 7f2e2b23e640 1 --2- 172.21.15.16:0/3404938673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e24106160 0x7f2e241059e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:08.487 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.920+0000 7f2e2b23e640 1 -- 172.21.15.16:0/3404938673 >> 172.21.15.16:0/3404938673 conn(0x7f2e240ffcc0 msgr2=0x7f2e241008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:08.487 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.921+0000 7f2e2b23e640 1 -- 172.21.15.16:0/3404938673 shutdown_connections 2024-08-01T06:47:08.488 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:07.921+0000 7f2e2b23e640 1 -- 172.21.15.16:0/3404938673 wait complete. 2024-08-01T06:47:08.488 INFO:teuthology.orchestra.run.smithi016.stdout:Deploying mgr service with default placement... 2024-08-01T06:47:09.122 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:08 smithi016 ceph-mon[29266]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:47:09.123 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:08 smithi016 ceph-mon[29266]: Saving service mon spec with placement count:5 2024-08-01T06:47:09.123 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:08 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:10.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:10 smithi016 ceph-mon[29266]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:47:10.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:10 smithi016 ceph-mon[29266]: Saving service mgr spec with placement count:2 2024-08-01T06:47:10.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:10 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:10.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:10 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:10.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:10 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:10.454 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-01T06:47:10.454 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.856+0000 7f461b9fa640 1 Processor -- start 2024-08-01T06:47:10.454 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.857+0000 7f461b9fa640 1 -- start start 2024-08-01T06:47:10.454 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.857+0000 7f461b9fa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46141055c0 0x7f46141059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:10.454 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.857+0000 7f461b9fa640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4614105f90 con 0x7f46141055c0 2024-08-01T06:47:10.454 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.857+0000 7f4619796640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46141055c0 0x7f46141059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:10.454 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.857+0000 7f4619796640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46141055c0 0x7f46141059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37306/0 (socket says 172.21.15.16:37306) 2024-08-01T06:47:10.455 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.857+0000 7f4619796640 1 -- 172.21.15.16:0/1827279697 learned_addr learned my addr 172.21.15.16:0/1827279697 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:10.455 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.858+0000 7f4619796640 1 -- 172.21.15.16:0/1827279697 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46141067c0 con 0x7f46141055c0 2024-08-01T06:47:10.455 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.858+0000 7f4619796640 1 --2- 172.21.15.16:0/1827279697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46141055c0 0x7f46141059c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4610009820 tx=0x7f461002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24216bcf8bd8d9a server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:10.455 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.859+0000 7f460bfff640 1 -- 172.21.15.16:0/1827279697 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f461002ad40 con 0x7f46141055c0 2024-08-01T06:47:10.455 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.859+0000 7f460bfff640 1 -- 172.21.15.16:0/1827279697 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f46100328c0 con 0x7f46141055c0 2024-08-01T06:47:10.455 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.859+0000 7f460bfff640 1 -- 172.21.15.16:0/1827279697 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46100307f0 con 0x7f46141055c0 2024-08-01T06:47:10.455 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.859+0000 7f461b9fa640 1 -- 172.21.15.16:0/1827279697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46141055c0 msgr2=0x7f46141059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:10.455 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.859+0000 7f461b9fa640 1 --2- 172.21.15.16:0/1827279697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46141055c0 0x7f46141059c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4610009820 tx=0x7f461002a270 comp rx=0 tx=0).stop 2024-08-01T06:47:10.455 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.859+0000 7f461b9fa640 1 -- 172.21.15.16:0/1827279697 shutdown_connections 2024-08-01T06:47:10.455 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.859+0000 7f461b9fa640 1 --2- 172.21.15.16:0/1827279697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46141055c0 0x7f46141059c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:10.455 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.859+0000 7f461b9fa640 1 -- 172.21.15.16:0/1827279697 >> 172.21.15.16:0/1827279697 conn(0x7f4614100d30 msgr2=0x7f4614103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:10.455 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.860+0000 7f461b9fa640 1 -- 172.21.15.16:0/1827279697 shutdown_connections 2024-08-01T06:47:10.456 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.860+0000 7f461b9fa640 1 -- 172.21.15.16:0/1827279697 wait complete. 2024-08-01T06:47:10.456 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.860+0000 7f461b9fa640 1 Processor -- start 2024-08-01T06:47:10.456 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.860+0000 7f461b9fa640 1 -- start start 2024-08-01T06:47:10.457 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.860+0000 7f461b9fa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46141055c0 0x7f46141992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:10.457 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.860+0000 7f461b9fa640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4614199810 con 0x7f46141055c0 2024-08-01T06:47:10.457 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.860+0000 7f4619796640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46141055c0 0x7f46141992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:10.457 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.860+0000 7f4619796640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46141055c0 0x7f46141992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37310/0 (socket says 172.21.15.16:37310) 2024-08-01T06:47:10.457 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.860+0000 7f4619796640 1 -- 172.21.15.16:0/1414108876 learned_addr learned my addr 172.21.15.16:0/1414108876 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:10.457 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.861+0000 7f4619796640 1 -- 172.21.15.16:0/1414108876 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46100094d0 con 0x7f46141055c0 2024-08-01T06:47:10.457 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.861+0000 7f4619796640 1 --2- 172.21.15.16:0/1414108876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46141055c0 0x7f46141992d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4610030d30 tx=0x7f4610030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:10.457 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.861+0000 7f460a7fc640 1 -- 172.21.15.16:0/1414108876 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4610032c40 con 0x7f46141055c0 2024-08-01T06:47:10.457 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.861+0000 7f461b9fa640 1 -- 172.21.15.16:0/1414108876 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4614199a10 con 0x7f46141055c0 2024-08-01T06:47:10.457 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.861+0000 7f460a7fc640 1 -- 172.21.15.16:0/1414108876 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f4610032da0 con 0x7f46141055c0 2024-08-01T06:47:10.457 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.861+0000 7f460a7fc640 1 -- 172.21.15.16:0/1414108876 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f461003c570 con 0x7f46141055c0 2024-08-01T06:47:10.458 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.861+0000 7f461b9fa640 1 -- 172.21.15.16:0/1414108876 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4614199e30 con 0x7f46141055c0 2024-08-01T06:47:10.458 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.862+0000 7f460a7fc640 1 -- 172.21.15.16:0/1414108876 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f461003c830 con 0x7f46141055c0 2024-08-01T06:47:10.458 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.862+0000 7f461b9fa640 1 -- 172.21.15.16:0/1414108876 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46141099f0 con 0x7f46141055c0 2024-08-01T06:47:10.458 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.862+0000 7f460a7fc640 1 --2- 172.21.15.16:0/1414108876 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f4600038650 0x7f460003ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:10.458 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.862+0000 7f460a7fc640 1 -- 172.21.15.16:0/1414108876 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f461006ba00 con 0x7f46141055c0 2024-08-01T06:47:10.458 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.862+0000 7f4618f95640 1 --2- 172.21.15.16:0/1414108876 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f4600038650 0x7f460003ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:10.458 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.863+0000 7f4618f95640 1 --2- 172.21.15.16:0/1414108876 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f4600038650 0x7f460003ab10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f46040098c0 tx=0x7f4604006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:10.458 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:08.867+0000 7f460a7fc640 1 -- 172.21.15.16:0/1414108876 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f46100313a0 con 0x7f46141055c0 2024-08-01T06:47:10.458 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:09.055+0000 7f461b9fa640 1 -- 172.21.15.16:0/1414108876 --> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f4614101fc0 con 0x7f4600038650 2024-08-01T06:47:10.458 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:09.060+0000 7f460a7fc640 1 -- 172.21.15.16:0/1414108876 <== mgr.14118 v2:172.21.15.16:6800/247151947 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4614101fc0 con 0x7f4600038650 2024-08-01T06:47:10.459 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:09.063+0000 7f461b9fa640 1 -- 172.21.15.16:0/1414108876 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f4600038650 msgr2=0x7f460003ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:10.459 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:09.063+0000 7f461b9fa640 1 --2- 172.21.15.16:0/1414108876 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f4600038650 0x7f460003ab10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f46040098c0 tx=0x7f4604006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:10.459 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:09.063+0000 7f461b9fa640 1 -- 172.21.15.16:0/1414108876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46141055c0 msgr2=0x7f46141992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:10.459 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:09.063+0000 7f461b9fa640 1 --2- 172.21.15.16:0/1414108876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46141055c0 0x7f46141992d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4610030d30 tx=0x7f4610030d60 comp rx=0 tx=0).stop 2024-08-01T06:47:10.459 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:09.063+0000 7f461b9fa640 1 -- 172.21.15.16:0/1414108876 shutdown_connections 2024-08-01T06:47:10.459 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:09.063+0000 7f461b9fa640 1 --2- 172.21.15.16:0/1414108876 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f4600038650 0x7f460003ab10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:10.459 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:09.063+0000 7f461b9fa640 1 --2- 172.21.15.16:0/1414108876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46141055c0 0x7f46141992d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:10.459 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:09.063+0000 7f461b9fa640 1 -- 172.21.15.16:0/1414108876 >> 172.21.15.16:0/1414108876 conn(0x7f4614100d30 msgr2=0x7f46141018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:10.459 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:09.063+0000 7f461b9fa640 1 -- 172.21.15.16:0/1414108876 shutdown_connections 2024-08-01T06:47:10.459 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:09.063+0000 7f461b9fa640 1 -- 172.21.15.16:0/1414108876 wait complete. 2024-08-01T06:47:10.459 INFO:teuthology.orchestra.run.smithi016.stdout:Deploying crash service with default placement... 2024-08-01T06:47:12.070 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-08-01T06:47:12.071 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.854+0000 7fb2e51ab640 1 Processor -- start 2024-08-01T06:47:12.071 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.854+0000 7fb2e51ab640 1 -- start start 2024-08-01T06:47:12.071 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.855+0000 7fb2e51ab640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e007be70 0x7fb2e007a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:12.071 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.855+0000 7fb2e51ab640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e007a8a0 con 0x7fb2e007be70 2024-08-01T06:47:12.071 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.855+0000 7fb2ded9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e007be70 0x7fb2e007a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:12.071 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.855+0000 7fb2ded9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e007be70 0x7fb2e007a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37318/0 (socket says 172.21.15.16:37318) 2024-08-01T06:47:12.071 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.855+0000 7fb2ded9d640 1 -- 172.21.15.16:0/3117007107 learned_addr learned my addr 172.21.15.16:0/3117007107 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:12.071 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.855+0000 7fb2ded9d640 1 -- 172.21.15.16:0/3117007107 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e007a9e0 con 0x7fb2e007be70 2024-08-01T06:47:12.071 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.856+0000 7fb2ded9d640 1 --2- 172.21.15.16:0/3117007107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e007be70 0x7fb2e007a2d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009820 tx=0x7fb2d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84118d612897a0c server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:12.071 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.856+0000 7fb2ddd9b640 1 -- 172.21.15.16:0/3117007107 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2d002ad40 con 0x7fb2e007be70 2024-08-01T06:47:12.071 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.856+0000 7fb2ddd9b640 1 -- 172.21.15.16:0/3117007107 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2d0032900 con 0x7fb2e007be70 2024-08-01T06:47:12.072 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.856+0000 7fb2ddd9b640 1 -- 172.21.15.16:0/3117007107 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2d0030860 con 0x7fb2e007be70 2024-08-01T06:47:12.072 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.857+0000 7fb2e51ab640 1 -- 172.21.15.16:0/3117007107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e007be70 msgr2=0x7fb2e007a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:12.072 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.857+0000 7fb2e51ab640 1 --2- 172.21.15.16:0/3117007107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e007be70 0x7fb2e007a2d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009820 tx=0x7fb2d002a270 comp rx=0 tx=0).stop 2024-08-01T06:47:12.072 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.857+0000 7fb2e51ab640 1 -- 172.21.15.16:0/3117007107 shutdown_connections 2024-08-01T06:47:12.072 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.857+0000 7fb2e51ab640 1 --2- 172.21.15.16:0/3117007107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e007be70 0x7fb2e007a2d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:12.072 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.857+0000 7fb2e51ab640 1 -- 172.21.15.16:0/3117007107 >> 172.21.15.16:0/3117007107 conn(0x7fb2e0100d80 msgr2=0x7fb2e01031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:12.072 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.857+0000 7fb2e51ab640 1 -- 172.21.15.16:0/3117007107 shutdown_connections 2024-08-01T06:47:12.072 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.857+0000 7fb2e51ab640 1 -- 172.21.15.16:0/3117007107 wait complete. 2024-08-01T06:47:12.072 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.858+0000 7fb2e51ab640 1 Processor -- start 2024-08-01T06:47:12.072 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.858+0000 7fb2e51ab640 1 -- start start 2024-08-01T06:47:12.072 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.858+0000 7fb2e51ab640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e007be70 0x7fb2e019b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:12.072 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.858+0000 7fb2e51ab640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e019ba50 con 0x7fb2e007be70 2024-08-01T06:47:12.072 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.858+0000 7fb2ded9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e007be70 0x7fb2e019b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:12.073 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.858+0000 7fb2ded9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e007be70 0x7fb2e019b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37330/0 (socket says 172.21.15.16:37330) 2024-08-01T06:47:12.073 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.858+0000 7fb2ded9d640 1 -- 172.21.15.16:0/744150588 learned_addr learned my addr 172.21.15.16:0/744150588 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:12.073 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.858+0000 7fb2ded9d640 1 -- 172.21.15.16:0/744150588 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d00094d0 con 0x7fb2e007be70 2024-08-01T06:47:12.073 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.859+0000 7fb2ded9d640 1 --2- 172.21.15.16:0/744150588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e007be70 0x7fb2e019b510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0032670 tx=0x7fb2d00326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:12.073 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.859+0000 7fb2c7fff640 1 -- 172.21.15.16:0/744150588 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2d0032c80 con 0x7fb2e007be70 2024-08-01T06:47:12.073 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.859+0000 7fb2c7fff640 1 -- 172.21.15.16:0/744150588 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2d0032de0 con 0x7fb2e007be70 2024-08-01T06:47:12.073 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.859+0000 7fb2e51ab640 1 -- 172.21.15.16:0/744150588 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e019bc50 con 0x7fb2e007be70 2024-08-01T06:47:12.073 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.859+0000 7fb2c7fff640 1 -- 172.21.15.16:0/744150588 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2d003a720 con 0x7fb2e007be70 2024-08-01T06:47:12.073 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.859+0000 7fb2e51ab640 1 -- 172.21.15.16:0/744150588 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e019c0f0 con 0x7fb2e007be70 2024-08-01T06:47:12.073 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.860+0000 7fb2c7fff640 1 -- 172.21.15.16:0/744150588 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fb2d003a950 con 0x7fb2e007be70 2024-08-01T06:47:12.073 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.860+0000 7fb2e51ab640 1 -- 172.21.15.16:0/744150588 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e010b9b0 con 0x7fb2e007be70 2024-08-01T06:47:12.073 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.860+0000 7fb2c7fff640 1 --2- 172.21.15.16:0/744150588 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fb2c80386a0 0x7fb2c803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:12.073 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.860+0000 7fb2c7fff640 1 -- 172.21.15.16:0/744150588 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb2d006ba60 con 0x7fb2e007be70 2024-08-01T06:47:12.074 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.860+0000 7fb2de59c640 1 --2- 172.21.15.16:0/744150588 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fb2c80386a0 0x7fb2c803ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:12.074 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.861+0000 7fb2de59c640 1 --2- 172.21.15.16:0/744150588 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fb2c80386a0 0x7fb2c803ab60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40098c0 tx=0x7fb2d4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:12.074 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:10.865+0000 7fb2c7fff640 1 -- 172.21.15.16:0/744150588 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fb2d0039310 con 0x7fb2e007be70 2024-08-01T06:47:12.074 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:11.059+0000 7fb2e51ab640 1 -- 172.21.15.16:0/744150588 --> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2e0102040 con 0x7fb2c80386a0 2024-08-01T06:47:12.074 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:11.064+0000 7fb2c7fff640 1 -- 172.21.15.16:0/744150588 <== mgr.14118 v2:172.21.15.16:6800/247151947 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fb2e0102040 con 0x7fb2c80386a0 2024-08-01T06:47:12.074 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:11.066+0000 7fb2e51ab640 1 -- 172.21.15.16:0/744150588 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fb2c80386a0 msgr2=0x7fb2c803ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:12.074 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:11.066+0000 7fb2e51ab640 1 --2- 172.21.15.16:0/744150588 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fb2c80386a0 0x7fb2c803ab60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40098c0 tx=0x7fb2d4006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:12.074 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:11.066+0000 7fb2e51ab640 1 -- 172.21.15.16:0/744150588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e007be70 msgr2=0x7fb2e019b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:12.074 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:11.066+0000 7fb2e51ab640 1 --2- 172.21.15.16:0/744150588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e007be70 0x7fb2e019b510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0032670 tx=0x7fb2d00326a0 comp rx=0 tx=0).stop 2024-08-01T06:47:12.074 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:11.066+0000 7fb2e51ab640 1 -- 172.21.15.16:0/744150588 shutdown_connections 2024-08-01T06:47:12.074 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:11.066+0000 7fb2e51ab640 1 --2- 172.21.15.16:0/744150588 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fb2c80386a0 0x7fb2c803ab60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:12.074 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:11.066+0000 7fb2e51ab640 1 --2- 172.21.15.16:0/744150588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2e007be70 0x7fb2e019b510 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:12.075 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:11.066+0000 7fb2e51ab640 1 -- 172.21.15.16:0/744150588 >> 172.21.15.16:0/744150588 conn(0x7fb2e0100d80 msgr2=0x7fb2e0101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:12.075 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:11.066+0000 7fb2e51ab640 1 -- 172.21.15.16:0/744150588 shutdown_connections 2024-08-01T06:47:12.075 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:11.066+0000 7fb2e51ab640 1 -- 172.21.15.16:0/744150588 wait complete. 2024-08-01T06:47:12.075 INFO:teuthology.orchestra.run.smithi016.stdout:Deploying ceph-exporter service with default placement... 2024-08-01T06:47:12.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:12 smithi016 ceph-mon[29266]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:47:12.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:12 smithi016 ceph-mon[29266]: Saving service crash spec with placement * 2024-08-01T06:47:12.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:12 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:13.236 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-08-01T06:47:13.236 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.452+0000 7f88eb46b640 1 Processor -- start 2024-08-01T06:47:13.236 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.453+0000 7f88eb46b640 1 -- start start 2024-08-01T06:47:13.236 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.453+0000 7f88eb46b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88e407beb0 0x7f88e407a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:13.236 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.453+0000 7f88eb46b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e407a8e0 con 0x7f88e407beb0 2024-08-01T06:47:13.236 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.453+0000 7f88e9207640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88e407beb0 0x7f88e407a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:13.237 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.453+0000 7f88e9207640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88e407beb0 0x7f88e407a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37332/0 (socket says 172.21.15.16:37332) 2024-08-01T06:47:13.237 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.453+0000 7f88e9207640 1 -- 172.21.15.16:0/2915853740 learned_addr learned my addr 172.21.15.16:0/2915853740 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:13.237 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.454+0000 7f88e9207640 1 -- 172.21.15.16:0/2915853740 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e407aa20 con 0x7f88e407beb0 2024-08-01T06:47:13.237 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.454+0000 7f88e9207640 1 --2- 172.21.15.16:0/2915853740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88e407beb0 0x7f88e407a310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009820 tx=0x7f88e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19308cd92057dd5 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:13.237 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.455+0000 7f88dbfff640 1 -- 172.21.15.16:0/2915853740 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88e002ad40 con 0x7f88e407beb0 2024-08-01T06:47:13.237 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.455+0000 7f88dbfff640 1 -- 172.21.15.16:0/2915853740 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f88e0032900 con 0x7f88e407beb0 2024-08-01T06:47:13.237 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.455+0000 7f88dbfff640 1 -- 172.21.15.16:0/2915853740 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88e0030860 con 0x7f88e407beb0 2024-08-01T06:47:13.237 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.455+0000 7f88eb46b640 1 -- 172.21.15.16:0/2915853740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88e407beb0 msgr2=0x7f88e407a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:13.237 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.455+0000 7f88eb46b640 1 --2- 172.21.15.16:0/2915853740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88e407beb0 0x7f88e407a310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009820 tx=0x7f88e002a270 comp rx=0 tx=0).stop 2024-08-01T06:47:13.237 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.455+0000 7f88eb46b640 1 -- 172.21.15.16:0/2915853740 shutdown_connections 2024-08-01T06:47:13.237 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.455+0000 7f88eb46b640 1 --2- 172.21.15.16:0/2915853740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88e407beb0 0x7f88e407a310 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:13.237 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.455+0000 7f88eb46b640 1 -- 172.21.15.16:0/2915853740 >> 172.21.15.16:0/2915853740 conn(0x7f88e4100d80 msgr2=0x7f88e41031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:13.238 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.455+0000 7f88eb46b640 1 -- 172.21.15.16:0/2915853740 shutdown_connections 2024-08-01T06:47:13.238 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.455+0000 7f88eb46b640 1 -- 172.21.15.16:0/2915853740 wait complete. 2024-08-01T06:47:13.238 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.456+0000 7f88eb46b640 1 Processor -- start 2024-08-01T06:47:13.238 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.456+0000 7f88eb46b640 1 -- start start 2024-08-01T06:47:13.238 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.456+0000 7f88eb46b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88e407beb0 0x7f88e419b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:13.238 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.456+0000 7f88eb46b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e419ba90 con 0x7f88e407beb0 2024-08-01T06:47:13.238 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.456+0000 7f88e9207640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88e407beb0 0x7f88e419b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:13.238 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.456+0000 7f88e9207640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88e407beb0 0x7f88e419b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37336/0 (socket says 172.21.15.16:37336) 2024-08-01T06:47:13.238 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.456+0000 7f88e9207640 1 -- 172.21.15.16:0/231537690 learned_addr learned my addr 172.21.15.16:0/231537690 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:13.238 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.456+0000 7f88e9207640 1 -- 172.21.15.16:0/231537690 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e00094d0 con 0x7f88e407beb0 2024-08-01T06:47:13.238 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.456+0000 7f88e9207640 1 --2- 172.21.15.16:0/231537690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88e407beb0 0x7f88e419b550 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009940 tx=0x7f88e0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:13.238 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.457+0000 7f88da7fc640 1 -- 172.21.15.16:0/231537690 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88e0032c80 con 0x7f88e407beb0 2024-08-01T06:47:13.238 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.457+0000 7f88da7fc640 1 -- 172.21.15.16:0/231537690 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f88e0032de0 con 0x7f88e407beb0 2024-08-01T06:47:13.239 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.457+0000 7f88eb46b640 1 -- 172.21.15.16:0/231537690 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e419bc90 con 0x7f88e407beb0 2024-08-01T06:47:13.239 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.457+0000 7f88da7fc640 1 -- 172.21.15.16:0/231537690 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88e003a720 con 0x7f88e407beb0 2024-08-01T06:47:13.239 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.457+0000 7f88eb46b640 1 -- 172.21.15.16:0/231537690 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e419c130 con 0x7f88e407beb0 2024-08-01T06:47:13.239 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.457+0000 7f88da7fc640 1 -- 172.21.15.16:0/231537690 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f88e003c400 con 0x7f88e407beb0 2024-08-01T06:47:13.239 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.458+0000 7f88da7fc640 1 --2- 172.21.15.16:0/231537690 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f88d00386a0 0x7f88d003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:13.239 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.458+0000 7f88eb46b640 1 -- 172.21.15.16:0/231537690 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e410b9d0 con 0x7f88e407beb0 2024-08-01T06:47:13.239 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.458+0000 7f88da7fc640 1 -- 172.21.15.16:0/231537690 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f88e006b8c0 con 0x7f88e407beb0 2024-08-01T06:47:13.239 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.458+0000 7f88e8a06640 1 --2- 172.21.15.16:0/231537690 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f88d00386a0 0x7f88d003ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:13.239 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.458+0000 7f88e8a06640 1 --2- 172.21.15.16:0/231537690 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f88d00386a0 0x7f88d003ab60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f88d40098c0 tx=0x7f88d4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:13.239 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.462+0000 7f88da7fc640 1 -- 172.21.15.16:0/231537690 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f88e00319f0 con 0x7f88e407beb0 2024-08-01T06:47:13.239 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.667+0000 7f88eb46b640 1 -- 172.21.15.16:0/231537690 --> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f88e4102090 con 0x7f88d00386a0 2024-08-01T06:47:13.239 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.672+0000 7f88da7fc640 1 -- 172.21.15.16:0/231537690 <== mgr.14118 v2:172.21.15.16:6800/247151947 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f88e4102090 con 0x7f88d00386a0 2024-08-01T06:47:13.239 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.673+0000 7f88eb46b640 1 -- 172.21.15.16:0/231537690 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f88d00386a0 msgr2=0x7f88d003ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:13.240 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.673+0000 7f88eb46b640 1 --2- 172.21.15.16:0/231537690 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f88d00386a0 0x7f88d003ab60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f88d40098c0 tx=0x7f88d4006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:13.240 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.673+0000 7f88eb46b640 1 -- 172.21.15.16:0/231537690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88e407beb0 msgr2=0x7f88e419b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:13.240 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.673+0000 7f88eb46b640 1 --2- 172.21.15.16:0/231537690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88e407beb0 0x7f88e419b550 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009940 tx=0x7f88e0032670 comp rx=0 tx=0).stop 2024-08-01T06:47:13.240 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.674+0000 7f88eb46b640 1 -- 172.21.15.16:0/231537690 shutdown_connections 2024-08-01T06:47:13.240 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.674+0000 7f88eb46b640 1 --2- 172.21.15.16:0/231537690 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f88d00386a0 0x7f88d003ab60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:13.240 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.674+0000 7f88eb46b640 1 --2- 172.21.15.16:0/231537690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88e407beb0 0x7f88e419b550 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:13.240 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.674+0000 7f88eb46b640 1 -- 172.21.15.16:0/231537690 >> 172.21.15.16:0/231537690 conn(0x7f88e4100d80 msgr2=0x7f88e4101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:13.240 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.674+0000 7f88eb46b640 1 -- 172.21.15.16:0/231537690 shutdown_connections 2024-08-01T06:47:13.240 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:12.674+0000 7f88eb46b640 1 -- 172.21.15.16:0/231537690 wait complete. 2024-08-01T06:47:13.240 INFO:teuthology.orchestra.run.smithi016.stdout:Deploying prometheus service with default placement... 2024-08-01T06:47:13.846 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:13 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:13.846 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:13 smithi016 ceph-mon[29266]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:47:13.846 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:13 smithi016 ceph-mon[29266]: Saving service ceph-exporter spec with placement * 2024-08-01T06:47:13.846 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:13 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:13.846 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:13 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:15.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:14 smithi016 ceph-mon[29266]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:47:15.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:14 smithi016 ceph-mon[29266]: Saving service prometheus spec with placement count:1 2024-08-01T06:47:15.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:14 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:15.221 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-08-01T06:47:15.231 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.668+0000 7fc463e3f640 1 Processor -- start 2024-08-01T06:47:15.231 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.668+0000 7fc463e3f640 1 -- start start 2024-08-01T06:47:15.231 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.669+0000 7fc463e3f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45c1044e0 0x7fc45c1048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:15.231 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.669+0000 7fc463e3f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c104eb0 con 0x7fc45c1044e0 2024-08-01T06:47:15.231 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.669+0000 7fc461bdb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45c1044e0 0x7fc45c1048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:15.232 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.669+0000 7fc461bdb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45c1044e0 0x7fc45c1048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37352/0 (socket says 172.21.15.16:37352) 2024-08-01T06:47:15.232 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.669+0000 7fc461bdb640 1 -- 172.21.15.16:0/102855732 learned_addr learned my addr 172.21.15.16:0/102855732 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:15.232 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.669+0000 7fc461bdb640 1 -- 172.21.15.16:0/102855732 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c1056e0 con 0x7fc45c1044e0 2024-08-01T06:47:15.232 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.670+0000 7fc461bdb640 1 --2- 172.21.15.16:0/102855732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45c1044e0 0x7fc45c1048e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc458009820 tx=0x7fc45802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d771be237bb6ad server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:15.232 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.670+0000 7fc460bd9640 1 -- 172.21.15.16:0/102855732 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc45802ad40 con 0x7fc45c1044e0 2024-08-01T06:47:15.232 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.670+0000 7fc460bd9640 1 -- 172.21.15.16:0/102855732 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc458032900 con 0x7fc45c1044e0 2024-08-01T06:47:15.232 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.670+0000 7fc460bd9640 1 -- 172.21.15.16:0/102855732 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc458030860 con 0x7fc45c1044e0 2024-08-01T06:47:15.232 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.671+0000 7fc463e3f640 1 -- 172.21.15.16:0/102855732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45c1044e0 msgr2=0x7fc45c1048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:15.232 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.671+0000 7fc463e3f640 1 --2- 172.21.15.16:0/102855732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45c1044e0 0x7fc45c1048e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc458009820 tx=0x7fc45802a270 comp rx=0 tx=0).stop 2024-08-01T06:47:15.232 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.671+0000 7fc463e3f640 1 -- 172.21.15.16:0/102855732 shutdown_connections 2024-08-01T06:47:15.232 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.671+0000 7fc463e3f640 1 --2- 172.21.15.16:0/102855732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45c1044e0 0x7fc45c1048e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:15.232 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.671+0000 7fc463e3f640 1 -- 172.21.15.16:0/102855732 >> 172.21.15.16:0/102855732 conn(0x7fc45c0ffc50 msgr2=0x7fc45c1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:15.233 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.671+0000 7fc463e3f640 1 -- 172.21.15.16:0/102855732 shutdown_connections 2024-08-01T06:47:15.233 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.671+0000 7fc463e3f640 1 -- 172.21.15.16:0/102855732 wait complete. 2024-08-01T06:47:15.233 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.671+0000 7fc463e3f640 1 Processor -- start 2024-08-01T06:47:15.233 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.671+0000 7fc463e3f640 1 -- start start 2024-08-01T06:47:15.233 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.672+0000 7fc463e3f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45c1044e0 0x7fc45c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:15.233 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.672+0000 7fc463e3f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c1998b0 con 0x7fc45c1044e0 2024-08-01T06:47:15.233 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.672+0000 7fc461bdb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45c1044e0 0x7fc45c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:15.233 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.672+0000 7fc461bdb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45c1044e0 0x7fc45c199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37354/0 (socket says 172.21.15.16:37354) 2024-08-01T06:47:15.233 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.672+0000 7fc461bdb640 1 -- 172.21.15.16:0/2713715748 learned_addr learned my addr 172.21.15.16:0/2713715748 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:15.233 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.672+0000 7fc461bdb640 1 -- 172.21.15.16:0/2713715748 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4580094d0 con 0x7fc45c1044e0 2024-08-01T06:47:15.234 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.672+0000 7fc461bdb640 1 --2- 172.21.15.16:0/2713715748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45c1044e0 0x7fc45c199370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc4580097f0 tx=0x7fc458030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:15.234 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.672+0000 7fc452ffd640 1 -- 172.21.15.16:0/2713715748 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc458040070 con 0x7fc45c1044e0 2024-08-01T06:47:15.234 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.672+0000 7fc452ffd640 1 -- 172.21.15.16:0/2713715748 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc458032dd0 con 0x7fc45c1044e0 2024-08-01T06:47:15.234 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.672+0000 7fc452ffd640 1 -- 172.21.15.16:0/2713715748 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc45803a730 con 0x7fc45c1044e0 2024-08-01T06:47:15.234 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.672+0000 7fc463e3f640 1 -- 172.21.15.16:0/2713715748 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45c199ab0 con 0x7fc45c1044e0 2024-08-01T06:47:15.234 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.672+0000 7fc463e3f640 1 -- 172.21.15.16:0/2713715748 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45c199f50 con 0x7fc45c1044e0 2024-08-01T06:47:15.234 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.673+0000 7fc452ffd640 1 -- 172.21.15.16:0/2713715748 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fc45803cc30 con 0x7fc45c1044e0 2024-08-01T06:47:15.234 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.674+0000 7fc452ffd640 1 --2- 172.21.15.16:0/2713715748 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fc4480386a0 0x7fc44803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:15.234 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.674+0000 7fc463e3f640 1 -- 172.21.15.16:0/2713715748 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45c1935b0 con 0x7fc45c1044e0 2024-08-01T06:47:15.235 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.674+0000 7fc4613da640 1 --2- 172.21.15.16:0/2713715748 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fc4480386a0 0x7fc44803ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:15.235 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.674+0000 7fc452ffd640 1 -- 172.21.15.16:0/2713715748 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc45806b6f0 con 0x7fc45c1044e0 2024-08-01T06:47:15.235 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.674+0000 7fc4613da640 1 --2- 172.21.15.16:0/2713715748 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fc4480386a0 0x7fc44803ab60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0098c0 tx=0x7fc44c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:15.235 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.678+0000 7fc452ffd640 1 -- 172.21.15.16:0/2713715748 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fc458031590 con 0x7fc45c1044e0 2024-08-01T06:47:15.235 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.870+0000 7fc463e3f640 1 -- 172.21.15.16:0/2713715748 --> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fc45c02c610 con 0x7fc4480386a0 2024-08-01T06:47:15.235 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.875+0000 7fc452ffd640 1 -- 172.21.15.16:0/2713715748 <== mgr.14118 v2:172.21.15.16:6800/247151947 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fc45c02c610 con 0x7fc4480386a0 2024-08-01T06:47:15.235 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.877+0000 7fc463e3f640 1 -- 172.21.15.16:0/2713715748 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fc4480386a0 msgr2=0x7fc44803ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:15.235 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.877+0000 7fc463e3f640 1 --2- 172.21.15.16:0/2713715748 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fc4480386a0 0x7fc44803ab60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0098c0 tx=0x7fc44c006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:15.235 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.877+0000 7fc463e3f640 1 -- 172.21.15.16:0/2713715748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45c1044e0 msgr2=0x7fc45c199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:15.235 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.877+0000 7fc463e3f640 1 --2- 172.21.15.16:0/2713715748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45c1044e0 0x7fc45c199370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc4580097f0 tx=0x7fc458030d50 comp rx=0 tx=0).stop 2024-08-01T06:47:15.235 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.877+0000 7fc463e3f640 1 -- 172.21.15.16:0/2713715748 shutdown_connections 2024-08-01T06:47:15.235 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.877+0000 7fc463e3f640 1 --2- 172.21.15.16:0/2713715748 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fc4480386a0 0x7fc44803ab60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:15.236 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.877+0000 7fc463e3f640 1 --2- 172.21.15.16:0/2713715748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45c1044e0 0x7fc45c199370 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:15.236 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.877+0000 7fc463e3f640 1 -- 172.21.15.16:0/2713715748 >> 172.21.15.16:0/2713715748 conn(0x7fc45c0ffc50 msgr2=0x7fc45c100b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:15.236 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.877+0000 7fc463e3f640 1 -- 172.21.15.16:0/2713715748 shutdown_connections 2024-08-01T06:47:15.236 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:13.877+0000 7fc463e3f640 1 -- 172.21.15.16:0/2713715748 wait complete. 2024-08-01T06:47:15.236 INFO:teuthology.orchestra.run.smithi016.stdout:Deploying grafana service with default placement... 2024-08-01T06:47:16.318 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-08-01T06:47:16.318 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.550+0000 7f1b04a1e640 1 Processor -- start 2024-08-01T06:47:16.319 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.550+0000 7f1b04a1e640 1 -- start start 2024-08-01T06:47:16.319 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.550+0000 7f1b04a1e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b00105ae0 0x7f1b00105ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:16.319 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.550+0000 7f1b04a1e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b001064b0 con 0x7f1b00105ae0 2024-08-01T06:47:16.319 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.550+0000 7f1afe59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b00105ae0 0x7f1b00105ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:16.319 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.550+0000 7f1afe59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b00105ae0 0x7f1b00105ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37358/0 (socket says 172.21.15.16:37358) 2024-08-01T06:47:16.319 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.550+0000 7f1afe59c640 1 -- 172.21.15.16:0/3010159713 learned_addr learned my addr 172.21.15.16:0/3010159713 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:16.319 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.551+0000 7f1afe59c640 1 -- 172.21.15.16:0/3010159713 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b001046f0 con 0x7f1b00105ae0 2024-08-01T06:47:16.320 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.551+0000 7f1afe59c640 1 --2- 172.21.15.16:0/3010159713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b00105ae0 0x7f1b00105ee0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009820 tx=0x7f1af002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3ad7855b4df773 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:16.320 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.552+0000 7f1afd59a640 1 -- 172.21.15.16:0/3010159713 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1af002ad40 con 0x7f1b00105ae0 2024-08-01T06:47:16.320 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.552+0000 7f1afd59a640 1 -- 172.21.15.16:0/3010159713 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1af0032900 con 0x7f1b00105ae0 2024-08-01T06:47:16.320 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.552+0000 7f1afd59a640 1 -- 172.21.15.16:0/3010159713 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1af0030860 con 0x7f1b00105ae0 2024-08-01T06:47:16.320 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.552+0000 7f1b04a1e640 1 -- 172.21.15.16:0/3010159713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b00105ae0 msgr2=0x7f1b00105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:16.320 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.552+0000 7f1b04a1e640 1 --2- 172.21.15.16:0/3010159713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b00105ae0 0x7f1b00105ee0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009820 tx=0x7f1af002a270 comp rx=0 tx=0).stop 2024-08-01T06:47:16.321 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.552+0000 7f1b04a1e640 1 -- 172.21.15.16:0/3010159713 shutdown_connections 2024-08-01T06:47:16.321 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.552+0000 7f1b04a1e640 1 --2- 172.21.15.16:0/3010159713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b00105ae0 0x7f1b00105ee0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:16.321 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.552+0000 7f1b04a1e640 1 -- 172.21.15.16:0/3010159713 >> 172.21.15.16:0/3010159713 conn(0x7f1b000ff410 msgr2=0x7f1b00101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:16.321 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.552+0000 7f1b04a1e640 1 -- 172.21.15.16:0/3010159713 shutdown_connections 2024-08-01T06:47:16.321 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.552+0000 7f1b04a1e640 1 -- 172.21.15.16:0/3010159713 wait complete. 2024-08-01T06:47:16.321 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.553+0000 7f1b04a1e640 1 Processor -- start 2024-08-01T06:47:16.322 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.553+0000 7f1b04a1e640 1 -- start start 2024-08-01T06:47:16.322 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.553+0000 7f1b04a1e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b00105ae0 0x7f1b001993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:16.322 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.553+0000 7f1b04a1e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b001998e0 con 0x7f1b00105ae0 2024-08-01T06:47:16.322 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.554+0000 7f1afe59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b00105ae0 0x7f1b001993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:16.322 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.554+0000 7f1afe59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b00105ae0 0x7f1b001993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37372/0 (socket says 172.21.15.16:37372) 2024-08-01T06:47:16.322 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.554+0000 7f1afe59c640 1 -- 172.21.15.16:0/2719233607 learned_addr learned my addr 172.21.15.16:0/2719233607 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:16.323 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.554+0000 7f1afe59c640 1 -- 172.21.15.16:0/2719233607 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af00094d0 con 0x7f1b00105ae0 2024-08-01T06:47:16.323 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.554+0000 7f1afe59c640 1 --2- 172.21.15.16:0/2719233607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b00105ae0 0x7f1b001993a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1af00097f0 tx=0x7f1af0030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:16.323 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.554+0000 7f1af77fe640 1 -- 172.21.15.16:0/2719233607 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1af0040070 con 0x7f1b00105ae0 2024-08-01T06:47:16.323 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.554+0000 7f1af77fe640 1 -- 172.21.15.16:0/2719233607 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1af0032dd0 con 0x7f1b00105ae0 2024-08-01T06:47:16.323 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.554+0000 7f1af77fe640 1 -- 172.21.15.16:0/2719233607 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1af003a730 con 0x7f1b00105ae0 2024-08-01T06:47:16.323 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.554+0000 7f1b04a1e640 1 -- 172.21.15.16:0/2719233607 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b00199ae0 con 0x7f1b00105ae0 2024-08-01T06:47:16.323 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.554+0000 7f1b04a1e640 1 -- 172.21.15.16:0/2719233607 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b00199f80 con 0x7f1b00105ae0 2024-08-01T06:47:16.323 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.555+0000 7f1af77fe640 1 -- 172.21.15.16:0/2719233607 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f1af003c400 con 0x7f1b00105ae0 2024-08-01T06:47:16.324 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.556+0000 7f1b04a1e640 1 -- 172.21.15.16:0/2719233607 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b001935d0 con 0x7f1b00105ae0 2024-08-01T06:47:16.324 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.556+0000 7f1af77fe640 1 --2- 172.21.15.16:0/2719233607 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f1aec0386a0 0x7f1aec03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:16.324 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.556+0000 7f1af77fe640 1 -- 172.21.15.16:0/2719233607 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1af006b5e0 con 0x7f1b00105ae0 2024-08-01T06:47:16.324 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.556+0000 7f1afdd9b640 1 --2- 172.21.15.16:0/2719233607 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f1aec0386a0 0x7f1aec03ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:16.324 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.556+0000 7f1afdd9b640 1 --2- 172.21.15.16:0/2719233607 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f1aec0386a0 0x7f1aec03ab60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1ae80098c0 tx=0x7f1ae8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:16.324 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.560+0000 7f1af77fe640 1 -- 172.21.15.16:0/2719233607 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f1af0043920 con 0x7f1b00105ae0 2024-08-01T06:47:16.324 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.742+0000 7f1b04a1e640 1 -- 172.21.15.16:0/2719233607 --> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b0002c610 con 0x7f1aec0386a0 2024-08-01T06:47:16.324 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.747+0000 7f1af77fe640 1 -- 172.21.15.16:0/2719233607 <== mgr.14118 v2:172.21.15.16:6800/247151947 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f1b0002c610 con 0x7f1aec0386a0 2024-08-01T06:47:16.324 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.749+0000 7f1b04a1e640 1 -- 172.21.15.16:0/2719233607 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f1aec0386a0 msgr2=0x7f1aec03ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:16.324 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.749+0000 7f1b04a1e640 1 --2- 172.21.15.16:0/2719233607 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f1aec0386a0 0x7f1aec03ab60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1ae80098c0 tx=0x7f1ae8006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:16.324 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.749+0000 7f1b04a1e640 1 -- 172.21.15.16:0/2719233607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b00105ae0 msgr2=0x7f1b001993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:16.324 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.749+0000 7f1b04a1e640 1 --2- 172.21.15.16:0/2719233607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b00105ae0 0x7f1b001993a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1af00097f0 tx=0x7f1af0030d50 comp rx=0 tx=0).stop 2024-08-01T06:47:16.324 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.749+0000 7f1b04a1e640 1 -- 172.21.15.16:0/2719233607 shutdown_connections 2024-08-01T06:47:16.325 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.749+0000 7f1b04a1e640 1 --2- 172.21.15.16:0/2719233607 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f1aec0386a0 0x7f1aec03ab60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:16.325 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.749+0000 7f1b04a1e640 1 --2- 172.21.15.16:0/2719233607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b00105ae0 0x7f1b001993a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:16.325 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.749+0000 7f1b04a1e640 1 -- 172.21.15.16:0/2719233607 >> 172.21.15.16:0/2719233607 conn(0x7f1b000ff410 msgr2=0x7f1b001002e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:16.325 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.749+0000 7f1b04a1e640 1 -- 172.21.15.16:0/2719233607 shutdown_connections 2024-08-01T06:47:16.325 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:15.749+0000 7f1b04a1e640 1 -- 172.21.15.16:0/2719233607 wait complete. 2024-08-01T06:47:16.325 INFO:teuthology.orchestra.run.smithi016.stdout:Deploying node-exporter service with default placement... 2024-08-01T06:47:16.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:16 smithi016 ceph-mon[29266]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:47:16.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:16 smithi016 ceph-mon[29266]: Saving service grafana spec with placement count:1 2024-08-01T06:47:16.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:16 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:16.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:16 smithi016 ceph-mon[29266]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:47:17.412 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-08-01T06:47:17.412 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.727+0000 7f187b267640 1 Processor -- start 2024-08-01T06:47:17.412 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.728+0000 7f187b267640 1 -- start start 2024-08-01T06:47:17.412 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.728+0000 7f187b267640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187407be90 0x7f187407a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:17.412 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.728+0000 7f187b267640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187407a8c0 con 0x7f187407be90 2024-08-01T06:47:17.413 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.728+0000 7f1879003640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187407be90 0x7f187407a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:17.413 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.728+0000 7f1879003640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187407be90 0x7f187407a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37380/0 (socket says 172.21.15.16:37380) 2024-08-01T06:47:17.413 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.728+0000 7f1879003640 1 -- 172.21.15.16:0/3305629861 learned_addr learned my addr 172.21.15.16:0/3305629861 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:17.413 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.729+0000 7f1879003640 1 -- 172.21.15.16:0/3305629861 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187407aa00 con 0x7f187407be90 2024-08-01T06:47:17.413 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.729+0000 7f1879003640 1 --2- 172.21.15.16:0/3305629861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187407be90 0x7f187407a2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1870009e80 tx=0x7f187002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b692126485a58703 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:17.413 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.730+0000 7f186bfff640 1 -- 172.21.15.16:0/3305629861 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1870031400 con 0x7f187407be90 2024-08-01T06:47:17.413 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.730+0000 7f186bfff640 1 -- 172.21.15.16:0/3305629861 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f187002d050 con 0x7f187407be90 2024-08-01T06:47:17.413 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.730+0000 7f186bfff640 1 -- 172.21.15.16:0/3305629861 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1870007930 con 0x7f187407be90 2024-08-01T06:47:17.413 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.730+0000 7f187b267640 1 -- 172.21.15.16:0/3305629861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187407be90 msgr2=0x7f187407a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:17.413 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.730+0000 7f187b267640 1 --2- 172.21.15.16:0/3305629861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187407be90 0x7f187407a2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1870009e80 tx=0x7f187002a7a0 comp rx=0 tx=0).stop 2024-08-01T06:47:17.413 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.730+0000 7f187b267640 1 -- 172.21.15.16:0/3305629861 shutdown_connections 2024-08-01T06:47:17.413 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.730+0000 7f187b267640 1 --2- 172.21.15.16:0/3305629861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187407be90 0x7f187407a2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:17.413 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.730+0000 7f187b267640 1 -- 172.21.15.16:0/3305629861 >> 172.21.15.16:0/3305629861 conn(0x7f1874100d80 msgr2=0x7f18741031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:17.413 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.731+0000 7f187b267640 1 -- 172.21.15.16:0/3305629861 shutdown_connections 2024-08-01T06:47:17.414 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.731+0000 7f187b267640 1 -- 172.21.15.16:0/3305629861 wait complete. 2024-08-01T06:47:17.414 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.731+0000 7f187b267640 1 Processor -- start 2024-08-01T06:47:17.414 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.731+0000 7f187b267640 1 -- start start 2024-08-01T06:47:17.414 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.731+0000 7f187b267640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187407be90 0x7f187419b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:17.414 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.731+0000 7f187b267640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187419bae0 con 0x7f187407be90 2024-08-01T06:47:17.414 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.732+0000 7f1879003640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187407be90 0x7f187419b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:17.414 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.732+0000 7f1879003640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187407be90 0x7f187419b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37392/0 (socket says 172.21.15.16:37392) 2024-08-01T06:47:17.414 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.732+0000 7f1879003640 1 -- 172.21.15.16:0/1481774544 learned_addr learned my addr 172.21.15.16:0/1481774544 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:17.414 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.732+0000 7f1879003640 1 -- 172.21.15.16:0/1481774544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1870009b30 con 0x7f187407be90 2024-08-01T06:47:17.414 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.732+0000 7f1879003640 1 --2- 172.21.15.16:0/1481774544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187407be90 0x7f187419b5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1870009680 tx=0x7f1870031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:17.414 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.732+0000 7f186a7fc640 1 -- 172.21.15.16:0/1481774544 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f187003a400 con 0x7f187407be90 2024-08-01T06:47:17.414 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.732+0000 7f186a7fc640 1 -- 172.21.15.16:0/1481774544 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f187003aa20 con 0x7f187407be90 2024-08-01T06:47:17.415 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.732+0000 7f187b267640 1 -- 172.21.15.16:0/1481774544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187419bce0 con 0x7f187407be90 2024-08-01T06:47:17.415 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.732+0000 7f186a7fc640 1 -- 172.21.15.16:0/1481774544 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1870039b60 con 0x7f187407be90 2024-08-01T06:47:17.415 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.732+0000 7f187b267640 1 -- 172.21.15.16:0/1481774544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187419c180 con 0x7f187407be90 2024-08-01T06:47:17.415 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.733+0000 7f186a7fc640 1 -- 172.21.15.16:0/1481774544 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f1870038040 con 0x7f187407be90 2024-08-01T06:47:17.415 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.734+0000 7f187b267640 1 -- 172.21.15.16:0/1481774544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f187410b9f0 con 0x7f187407be90 2024-08-01T06:47:17.415 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.734+0000 7f186a7fc640 1 --2- 172.21.15.16:0/1481774544 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f18600386a0 0x7f186003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:17.415 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.734+0000 7f186a7fc640 1 -- 172.21.15.16:0/1481774544 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f187006b720 con 0x7f187407be90 2024-08-01T06:47:17.415 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.734+0000 7f1878802640 1 --2- 172.21.15.16:0/1481774544 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f18600386a0 0x7f186003ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:17.415 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.735+0000 7f1878802640 1 --2- 172.21.15.16:0/1481774544 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f18600386a0 0x7f186003ab60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f18640098c0 tx=0x7f1864006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:17.415 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.738+0000 7f186a7fc640 1 -- 172.21.15.16:0/1481774544 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f1870039360 con 0x7f187407be90 2024-08-01T06:47:17.415 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.920+0000 7f187b267640 1 -- 172.21.15.16:0/1481774544 --> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f18741020f0 con 0x7f18600386a0 2024-08-01T06:47:17.415 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.924+0000 7f186a7fc640 1 -- 172.21.15.16:0/1481774544 <== mgr.14118 v2:172.21.15.16:6800/247151947 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f18741020f0 con 0x7f18600386a0 2024-08-01T06:47:17.415 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.926+0000 7f187b267640 1 -- 172.21.15.16:0/1481774544 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f18600386a0 msgr2=0x7f186003ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:17.415 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.926+0000 7f187b267640 1 --2- 172.21.15.16:0/1481774544 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f18600386a0 0x7f186003ab60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f18640098c0 tx=0x7f1864006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:17.416 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.926+0000 7f187b267640 1 -- 172.21.15.16:0/1481774544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187407be90 msgr2=0x7f187419b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:17.416 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.926+0000 7f187b267640 1 --2- 172.21.15.16:0/1481774544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187407be90 0x7f187419b5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1870009680 tx=0x7f1870031a10 comp rx=0 tx=0).stop 2024-08-01T06:47:17.416 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.926+0000 7f187b267640 1 -- 172.21.15.16:0/1481774544 shutdown_connections 2024-08-01T06:47:17.416 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.926+0000 7f187b267640 1 --2- 172.21.15.16:0/1481774544 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f18600386a0 0x7f186003ab60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:17.416 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.926+0000 7f187b267640 1 --2- 172.21.15.16:0/1481774544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187407be90 0x7f187419b5a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:17.416 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.926+0000 7f187b267640 1 -- 172.21.15.16:0/1481774544 >> 172.21.15.16:0/1481774544 conn(0x7f1874100d80 msgr2=0x7f18741019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:17.416 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.926+0000 7f187b267640 1 -- 172.21.15.16:0/1481774544 shutdown_connections 2024-08-01T06:47:17.416 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:16.927+0000 7f187b267640 1 -- 172.21.15.16:0/1481774544 wait complete. 2024-08-01T06:47:17.416 INFO:teuthology.orchestra.run.smithi016.stdout:Deploying alertmanager service with default placement... 2024-08-01T06:47:18.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:17 smithi016 ceph-mon[29266]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:47:18.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:17 smithi016 ceph-mon[29266]: Saving service node-exporter spec with placement * 2024-08-01T06:47:18.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:17 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:18.610 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-08-01T06:47:18.610 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.809+0000 7f094d0f5640 1 Processor -- start 2024-08-01T06:47:18.610 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.809+0000 7f094d0f5640 1 -- start start 2024-08-01T06:47:18.610 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.809+0000 7f094d0f5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948106070 0x7f0948108460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:18.610 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.809+0000 7f094d0f5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0948079e60 con 0x7f0948106070 2024-08-01T06:47:18.611 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.809+0000 7f0946d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948106070 0x7f0948108460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:18.611 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.809+0000 7f0946d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948106070 0x7f0948108460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37404/0 (socket says 172.21.15.16:37404) 2024-08-01T06:47:18.611 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.809+0000 7f0946d9d640 1 -- 172.21.15.16:0/690500979 learned_addr learned my addr 172.21.15.16:0/690500979 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:18.611 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.809+0000 7f0946d9d640 1 -- 172.21.15.16:0/690500979 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09481089a0 con 0x7f0948106070 2024-08-01T06:47:18.611 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.810+0000 7f0946d9d640 1 --2- 172.21.15.16:0/690500979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948106070 0x7f0948108460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0938009820 tx=0x7f093802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb341e51c8b547 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:18.611 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.810+0000 7f094659c640 1 -- 172.21.15.16:0/690500979 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f093802ad40 con 0x7f0948106070 2024-08-01T06:47:18.611 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.810+0000 7f094659c640 1 -- 172.21.15.16:0/690500979 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0938032900 con 0x7f0948106070 2024-08-01T06:47:18.611 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.810+0000 7f094659c640 1 -- 172.21.15.16:0/690500979 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0938030860 con 0x7f0948106070 2024-08-01T06:47:18.611 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.811+0000 7f094d0f5640 1 -- 172.21.15.16:0/690500979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948106070 msgr2=0x7f0948108460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:18.611 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.811+0000 7f094d0f5640 1 --2- 172.21.15.16:0/690500979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948106070 0x7f0948108460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0938009820 tx=0x7f093802a270 comp rx=0 tx=0).stop 2024-08-01T06:47:18.611 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.811+0000 7f094d0f5640 1 -- 172.21.15.16:0/690500979 shutdown_connections 2024-08-01T06:47:18.611 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.811+0000 7f094d0f5640 1 --2- 172.21.15.16:0/690500979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948106070 0x7f0948108460 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:18.611 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.811+0000 7f094d0f5640 1 -- 172.21.15.16:0/690500979 >> 172.21.15.16:0/690500979 conn(0x7f09480ffc30 msgr2=0x7f0948102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:18.612 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.811+0000 7f094d0f5640 1 -- 172.21.15.16:0/690500979 shutdown_connections 2024-08-01T06:47:18.612 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.811+0000 7f094d0f5640 1 -- 172.21.15.16:0/690500979 wait complete. 2024-08-01T06:47:18.612 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.812+0000 7f094d0f5640 1 Processor -- start 2024-08-01T06:47:18.612 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.812+0000 7f094d0f5640 1 -- start start 2024-08-01T06:47:18.612 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.812+0000 7f094d0f5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948106070 0x7f094819b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:18.612 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.812+0000 7f094d0f5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094819ba50 con 0x7f0948106070 2024-08-01T06:47:18.612 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.813+0000 7f0946d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948106070 0x7f094819b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:18.612 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.813+0000 7f0946d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948106070 0x7f094819b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37416/0 (socket says 172.21.15.16:37416) 2024-08-01T06:47:18.612 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.813+0000 7f0946d9d640 1 -- 172.21.15.16:0/1912144533 learned_addr learned my addr 172.21.15.16:0/1912144533 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:18.612 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.813+0000 7f0946d9d640 1 -- 172.21.15.16:0/1912144533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09380094d0 con 0x7f0948106070 2024-08-01T06:47:18.612 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.813+0000 7f0946d9d640 1 --2- 172.21.15.16:0/1912144533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948106070 0x7f094819b510 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0938032670 tx=0x7f09380326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:18.612 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.813+0000 7f0944d99640 1 -- 172.21.15.16:0/1912144533 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0938032c80 con 0x7f0948106070 2024-08-01T06:47:18.612 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.813+0000 7f0944d99640 1 -- 172.21.15.16:0/1912144533 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0938032de0 con 0x7f0948106070 2024-08-01T06:47:18.613 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.813+0000 7f094d0f5640 1 -- 172.21.15.16:0/1912144533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094819bc50 con 0x7f0948106070 2024-08-01T06:47:18.613 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.813+0000 7f094d0f5640 1 -- 172.21.15.16:0/1912144533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094819c0f0 con 0x7f0948106070 2024-08-01T06:47:18.613 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.813+0000 7f0944d99640 1 -- 172.21.15.16:0/1912144533 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f093803a720 con 0x7f0948106070 2024-08-01T06:47:18.613 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.814+0000 7f0944d99640 1 -- 172.21.15.16:0/1912144533 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f093803a9a0 con 0x7f0948106070 2024-08-01T06:47:18.613 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.814+0000 7f094d0f5640 1 -- 172.21.15.16:0/1912144533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0928005280 con 0x7f0948106070 2024-08-01T06:47:18.613 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.815+0000 7f0944d99640 1 --2- 172.21.15.16:0/1912144533 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f0934038650 0x7f093403ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:18.613 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.815+0000 7f0944d99640 1 -- 172.21.15.16:0/1912144533 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f093806b8f0 con 0x7f0948106070 2024-08-01T06:47:18.613 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.815+0000 7f093e59c640 1 --2- 172.21.15.16:0/1912144533 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f0934038650 0x7f093403ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:18.613 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.815+0000 7f093e59c640 1 --2- 172.21.15.16:0/1912144533 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f0934038650 0x7f093403ab10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f09300098c0 tx=0x7f0930006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:18.613 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:17.819+0000 7f0944d99640 1 -- 172.21.15.16:0/1912144533 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f0938039b60 con 0x7f0948106070 2024-08-01T06:47:18.613 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:18.002+0000 7f094d0f5640 1 -- 172.21.15.16:0/1912144533 --> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f0928000bf0 con 0x7f0934038650 2024-08-01T06:47:18.613 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:18.005+0000 7f0944d99640 1 -- 172.21.15.16:0/1912144533 <== mgr.14118 v2:172.21.15.16:6800/247151947 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f0928000bf0 con 0x7f0934038650 2024-08-01T06:47:18.613 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:18.007+0000 7f094d0f5640 1 -- 172.21.15.16:0/1912144533 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f0934038650 msgr2=0x7f093403ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:18.614 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:18.008+0000 7f094d0f5640 1 --2- 172.21.15.16:0/1912144533 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f0934038650 0x7f093403ab10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f09300098c0 tx=0x7f0930006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:18.614 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:18.008+0000 7f094d0f5640 1 -- 172.21.15.16:0/1912144533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948106070 msgr2=0x7f094819b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:18.614 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:18.008+0000 7f094d0f5640 1 --2- 172.21.15.16:0/1912144533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948106070 0x7f094819b510 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0938032670 tx=0x7f09380326a0 comp rx=0 tx=0).stop 2024-08-01T06:47:18.614 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:18.008+0000 7f094d0f5640 1 -- 172.21.15.16:0/1912144533 shutdown_connections 2024-08-01T06:47:18.614 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:18.008+0000 7f094d0f5640 1 --2- 172.21.15.16:0/1912144533 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f0934038650 0x7f093403ab10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:18.614 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:18.008+0000 7f094d0f5640 1 --2- 172.21.15.16:0/1912144533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948106070 0x7f094819b510 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:18.614 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:18.008+0000 7f094d0f5640 1 -- 172.21.15.16:0/1912144533 >> 172.21.15.16:0/1912144533 conn(0x7f09480ffc30 msgr2=0x7f0948100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:18.614 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:18.008+0000 7f094d0f5640 1 -- 172.21.15.16:0/1912144533 shutdown_connections 2024-08-01T06:47:18.614 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:18.008+0000 7f094d0f5640 1 -- 172.21.15.16:0/1912144533 wait complete. 2024-08-01T06:47:19.195 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:19 smithi016 ceph-mon[29266]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:47:19.196 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:19 smithi016 ceph-mon[29266]: Saving service alertmanager spec with placement count:1 2024-08-01T06:47:19.196 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:19 smithi016 ceph-mon[29266]: from='mgr.14118 172.21.15.16:0/3215845116' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:19.196 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:19 smithi016 ceph-mon[29266]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:47:19.783 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.011+0000 7fe7b47f1640 1 Processor -- start 2024-08-01T06:47:19.783 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.011+0000 7fe7b47f1640 1 -- start start 2024-08-01T06:47:19.783 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.011+0000 7fe7b47f1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1060b0 0x7fe7ac1084a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:19.783 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.011+0000 7fe7b47f1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac079e20 con 0x7fe7ac1060b0 2024-08-01T06:47:19.783 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.011+0000 7fe7b258d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1060b0 0x7fe7ac1084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:19.783 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.012+0000 7fe7b258d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1060b0 0x7fe7ac1084a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43826/0 (socket says 172.21.15.16:43826) 2024-08-01T06:47:19.783 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.012+0000 7fe7b258d640 1 -- 172.21.15.16:0/528578166 learned_addr learned my addr 172.21.15.16:0/528578166 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:19.783 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.012+0000 7fe7b258d640 1 -- 172.21.15.16:0/528578166 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac1089e0 con 0x7fe7ac1060b0 2024-08-01T06:47:19.784 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.012+0000 7fe7b258d640 1 --2- 172.21.15.16:0/528578166 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1060b0 0x7fe7ac1084a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009e80 tx=0x7fe79c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44891d12f9846d64 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:19.784 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.013+0000 7fe7b158b640 1 -- 172.21.15.16:0/528578166 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe79c031400 con 0x7fe7ac1060b0 2024-08-01T06:47:19.784 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.013+0000 7fe7b158b640 1 -- 172.21.15.16:0/528578166 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe79c02d050 con 0x7fe7ac1060b0 2024-08-01T06:47:19.784 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.013+0000 7fe7b158b640 1 -- 172.21.15.16:0/528578166 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe79c007930 con 0x7fe7ac1060b0 2024-08-01T06:47:19.784 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.013+0000 7fe7b47f1640 1 -- 172.21.15.16:0/528578166 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1060b0 msgr2=0x7fe7ac1084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:19.784 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.013+0000 7fe7b47f1640 1 --2- 172.21.15.16:0/528578166 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1060b0 0x7fe7ac1084a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009e80 tx=0x7fe79c02a7a0 comp rx=0 tx=0).stop 2024-08-01T06:47:19.784 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.013+0000 7fe7b47f1640 1 -- 172.21.15.16:0/528578166 shutdown_connections 2024-08-01T06:47:19.784 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.013+0000 7fe7b47f1640 1 --2- 172.21.15.16:0/528578166 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1060b0 0x7fe7ac1084a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:19.784 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.013+0000 7fe7b47f1640 1 -- 172.21.15.16:0/528578166 >> 172.21.15.16:0/528578166 conn(0x7fe7ac0ffc30 msgr2=0x7fe7ac102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:19.784 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.013+0000 7fe7b47f1640 1 -- 172.21.15.16:0/528578166 shutdown_connections 2024-08-01T06:47:19.784 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.013+0000 7fe7b47f1640 1 -- 172.21.15.16:0/528578166 wait complete. 2024-08-01T06:47:19.784 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.014+0000 7fe7b47f1640 1 Processor -- start 2024-08-01T06:47:19.785 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.014+0000 7fe7b47f1640 1 -- start start 2024-08-01T06:47:19.785 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.014+0000 7fe7b47f1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1060b0 0x7fe7ac19b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:19.785 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.014+0000 7fe7b47f1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac19bad0 con 0x7fe7ac1060b0 2024-08-01T06:47:19.785 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.014+0000 7fe7b258d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1060b0 0x7fe7ac19b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:19.785 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.014+0000 7fe7b258d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1060b0 0x7fe7ac19b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43836/0 (socket says 172.21.15.16:43836) 2024-08-01T06:47:19.785 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.014+0000 7fe7b258d640 1 -- 172.21.15.16:0/1553583641 learned_addr learned my addr 172.21.15.16:0/1553583641 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:19.785 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.015+0000 7fe7b258d640 1 -- 172.21.15.16:0/1553583641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c009b30 con 0x7fe7ac1060b0 2024-08-01T06:47:19.785 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.015+0000 7fe7b258d640 1 --2- 172.21.15.16:0/1553583641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1060b0 0x7fe7ac19b590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0319a0 tx=0x7fe79c0319d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:19.785 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.015+0000 7fe7ab7fe640 1 -- 172.21.15.16:0/1553583641 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe79c03a550 con 0x7fe7ac1060b0 2024-08-01T06:47:19.785 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.015+0000 7fe7ab7fe640 1 -- 172.21.15.16:0/1553583641 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe79c03ab70 con 0x7fe7ac1060b0 2024-08-01T06:47:19.785 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.015+0000 7fe7ab7fe640 1 -- 172.21.15.16:0/1553583641 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe79c039c00 con 0x7fe7ac1060b0 2024-08-01T06:47:19.785 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.015+0000 7fe7b47f1640 1 -- 172.21.15.16:0/1553583641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7ac19bcd0 con 0x7fe7ac1060b0 2024-08-01T06:47:19.786 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.015+0000 7fe7b47f1640 1 -- 172.21.15.16:0/1553583641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7ac19c170 con 0x7fe7ac1060b0 2024-08-01T06:47:19.786 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.016+0000 7fe7ab7fe640 1 -- 172.21.15.16:0/1553583641 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fe79c038040 con 0x7fe7ac1060b0 2024-08-01T06:47:19.786 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.016+0000 7fe7ab7fe640 1 --2- 172.21.15.16:0/1553583641 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fe794038650 0x7fe79403ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:19.786 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.016+0000 7fe7ab7fe640 1 -- 172.21.15.16:0/1553583641 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe79c06b630 con 0x7fe7ac1060b0 2024-08-01T06:47:19.786 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.016+0000 7fe7b47f1640 1 -- 172.21.15.16:0/1553583641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7ac1098e0 con 0x7fe7ac1060b0 2024-08-01T06:47:19.786 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.016+0000 7fe7b1d8c640 1 --2- 172.21.15.16:0/1553583641 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fe794038650 0x7fe79403ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:19.786 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.017+0000 7fe7b1d8c640 1 --2- 172.21.15.16:0/1553583641 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fe794038650 0x7fe79403ab10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00098c0 tx=0x7fe7a0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:19.786 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.021+0000 7fe7ab7fe640 1 -- 172.21.15.16:0/1553583641 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fe79c04a080 con 0x7fe7ac1060b0 2024-08-01T06:47:19.786 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.193+0000 7fe7b47f1640 1 -- 172.21.15.16:0/1553583641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fe7ac19ecf0 con 0x7fe7ac1060b0 2024-08-01T06:47:19.786 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.197+0000 7fe7ab7fe640 1 -- 172.21.15.16:0/1553583641 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fe79c041070 con 0x7fe7ac1060b0 2024-08-01T06:47:19.786 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.199+0000 7fe7b47f1640 1 -- 172.21.15.16:0/1553583641 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fe794038650 msgr2=0x7fe79403ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:19.786 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.199+0000 7fe7b47f1640 1 --2- 172.21.15.16:0/1553583641 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fe794038650 0x7fe79403ab10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00098c0 tx=0x7fe7a0006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:19.787 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.199+0000 7fe7b47f1640 1 -- 172.21.15.16:0/1553583641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1060b0 msgr2=0x7fe7ac19b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:19.787 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.199+0000 7fe7b47f1640 1 --2- 172.21.15.16:0/1553583641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1060b0 0x7fe7ac19b590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0319a0 tx=0x7fe79c0319d0 comp rx=0 tx=0).stop 2024-08-01T06:47:19.787 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.199+0000 7fe7b47f1640 1 -- 172.21.15.16:0/1553583641 shutdown_connections 2024-08-01T06:47:19.787 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.199+0000 7fe7b47f1640 1 --2- 172.21.15.16:0/1553583641 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fe794038650 0x7fe79403ab10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:19.787 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.199+0000 7fe7b47f1640 1 --2- 172.21.15.16:0/1553583641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1060b0 0x7fe7ac19b590 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:19.787 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.199+0000 7fe7b47f1640 1 -- 172.21.15.16:0/1553583641 >> 172.21.15.16:0/1553583641 conn(0x7fe7ac0ffc30 msgr2=0x7fe7ac100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:19.787 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.199+0000 7fe7b47f1640 1 -- 172.21.15.16:0/1553583641 shutdown_connections 2024-08-01T06:47:19.787 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:19.199+0000 7fe7b47f1640 1 -- 172.21.15.16:0/1553583641 wait complete. 2024-08-01T06:47:20.614 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:20 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/1553583641' entity='client.admin' 2024-08-01T06:47:21.006 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.175+0000 7fdf82859640 1 Processor -- start 2024-08-01T06:47:21.007 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.175+0000 7fdf82859640 1 -- start start 2024-08-01T06:47:21.007 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.175+0000 7fdf82859640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c1055c0 0x7fdf7c1059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:21.007 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.175+0000 7fdf82859640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c105f90 con 0x7fdf7c1055c0 2024-08-01T06:47:21.007 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.176+0000 7fdf7bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c1055c0 0x7fdf7c1059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:21.007 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.176+0000 7fdf7bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c1055c0 0x7fdf7c1059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43838/0 (socket says 172.21.15.16:43838) 2024-08-01T06:47:21.007 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.176+0000 7fdf7bfff640 1 -- 172.21.15.16:0/7936413 learned_addr learned my addr 172.21.15.16:0/7936413 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:21.007 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.176+0000 7fdf7bfff640 1 -- 172.21.15.16:0/7936413 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c1067c0 con 0x7fdf7c1055c0 2024-08-01T06:47:21.007 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.177+0000 7fdf7bfff640 1 --2- 172.21.15.16:0/7936413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c1055c0 0x7fdf7c1059c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009820 tx=0x7fdf6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15268524d37d6f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:21.007 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.177+0000 7fdf7b7fe640 1 -- 172.21.15.16:0/7936413 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf6c02ad40 con 0x7fdf7c1055c0 2024-08-01T06:47:21.007 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.177+0000 7fdf7b7fe640 1 -- 172.21.15.16:0/7936413 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf6c032900 con 0x7fdf7c1055c0 2024-08-01T06:47:21.007 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.177+0000 7fdf7b7fe640 1 -- 172.21.15.16:0/7936413 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf6c030860 con 0x7fdf7c1055c0 2024-08-01T06:47:21.007 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.177+0000 7fdf82859640 1 -- 172.21.15.16:0/7936413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c1055c0 msgr2=0x7fdf7c1059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:21.008 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.177+0000 7fdf82859640 1 --2- 172.21.15.16:0/7936413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c1055c0 0x7fdf7c1059c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009820 tx=0x7fdf6c02a270 comp rx=0 tx=0).stop 2024-08-01T06:47:21.008 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.178+0000 7fdf82859640 1 -- 172.21.15.16:0/7936413 shutdown_connections 2024-08-01T06:47:21.008 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.178+0000 7fdf82859640 1 --2- 172.21.15.16:0/7936413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c1055c0 0x7fdf7c1059c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:21.008 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.178+0000 7fdf82859640 1 -- 172.21.15.16:0/7936413 >> 172.21.15.16:0/7936413 conn(0x7fdf7c100d70 msgr2=0x7fdf7c103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:21.008 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.178+0000 7fdf82859640 1 -- 172.21.15.16:0/7936413 shutdown_connections 2024-08-01T06:47:21.008 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.178+0000 7fdf82859640 1 -- 172.21.15.16:0/7936413 wait complete. 2024-08-01T06:47:21.008 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.178+0000 7fdf82859640 1 Processor -- start 2024-08-01T06:47:21.008 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.178+0000 7fdf82859640 1 -- start start 2024-08-01T06:47:21.008 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.178+0000 7fdf82859640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c1055c0 0x7fdf7c19b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:21.008 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.178+0000 7fdf82859640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c19ba50 con 0x7fdf7c1055c0 2024-08-01T06:47:21.008 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.179+0000 7fdf7bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c1055c0 0x7fdf7c19b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:21.008 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.179+0000 7fdf7bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c1055c0 0x7fdf7c19b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43850/0 (socket says 172.21.15.16:43850) 2024-08-01T06:47:21.008 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.179+0000 7fdf7bfff640 1 -- 172.21.15.16:0/839080296 learned_addr learned my addr 172.21.15.16:0/839080296 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:21.008 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.179+0000 7fdf7bfff640 1 -- 172.21.15.16:0/839080296 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c0094d0 con 0x7fdf7c1055c0 2024-08-01T06:47:21.009 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.179+0000 7fdf7bfff640 1 --2- 172.21.15.16:0/839080296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c1055c0 0x7fdf7c19b510 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0097f0 tx=0x7fdf6c030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:21.009 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.179+0000 7fdf79ffb640 1 -- 172.21.15.16:0/839080296 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf6c040070 con 0x7fdf7c1055c0 2024-08-01T06:47:21.009 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.179+0000 7fdf79ffb640 1 -- 172.21.15.16:0/839080296 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf6c032dd0 con 0x7fdf7c1055c0 2024-08-01T06:47:21.009 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.179+0000 7fdf82859640 1 -- 172.21.15.16:0/839080296 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7c19bc50 con 0x7fdf7c1055c0 2024-08-01T06:47:21.009 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.179+0000 7fdf79ffb640 1 -- 172.21.15.16:0/839080296 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf6c03a730 con 0x7fdf7c1055c0 2024-08-01T06:47:21.009 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.179+0000 7fdf82859640 1 -- 172.21.15.16:0/839080296 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf7c19c0f0 con 0x7fdf7c1055c0 2024-08-01T06:47:21.009 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.180+0000 7fdf79ffb640 1 -- 172.21.15.16:0/839080296 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fdf6c03cc30 con 0x7fdf7c1055c0 2024-08-01T06:47:21.009 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.180+0000 7fdf82859640 1 -- 172.21.15.16:0/839080296 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf7c1099f0 con 0x7fdf7c1055c0 2024-08-01T06:47:21.009 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.180+0000 7fdf79ffb640 1 --2- 172.21.15.16:0/839080296 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fdf680386a0 0x7fdf6803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:21.009 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.180+0000 7fdf79ffb640 1 -- 172.21.15.16:0/839080296 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdf6c06b660 con 0x7fdf7c1055c0 2024-08-01T06:47:21.009 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.180+0000 7fdf73fff640 1 --2- 172.21.15.16:0/839080296 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fdf680386a0 0x7fdf6803ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:21.009 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.181+0000 7fdf73fff640 1 --2- 172.21.15.16:0/839080296 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fdf680386a0 0x7fdf6803ab60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdf640098c0 tx=0x7fdf64006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:21.009 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.185+0000 7fdf79ffb640 1 -- 172.21.15.16:0/839080296 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fdf6c043780 con 0x7fdf7c1055c0 2024-08-01T06:47:21.010 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.358+0000 7fdf82859640 1 -- 172.21.15.16:0/839080296 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fdf7c109c30 con 0x7fdf7c1055c0 2024-08-01T06:47:21.010 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.361+0000 7fdf79ffb640 1 -- 172.21.15.16:0/839080296 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fdf6c044e20 con 0x7fdf7c1055c0 2024-08-01T06:47:21.010 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.363+0000 7fdf82859640 1 -- 172.21.15.16:0/839080296 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fdf680386a0 msgr2=0x7fdf6803ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:21.010 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.363+0000 7fdf82859640 1 --2- 172.21.15.16:0/839080296 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fdf680386a0 0x7fdf6803ab60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdf640098c0 tx=0x7fdf64006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:21.010 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.363+0000 7fdf82859640 1 -- 172.21.15.16:0/839080296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c1055c0 msgr2=0x7fdf7c19b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:21.010 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.363+0000 7fdf82859640 1 --2- 172.21.15.16:0/839080296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c1055c0 0x7fdf7c19b510 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0097f0 tx=0x7fdf6c030d50 comp rx=0 tx=0).stop 2024-08-01T06:47:21.010 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.364+0000 7fdf82859640 1 -- 172.21.15.16:0/839080296 shutdown_connections 2024-08-01T06:47:21.010 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.364+0000 7fdf82859640 1 --2- 172.21.15.16:0/839080296 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7fdf680386a0 0x7fdf6803ab60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:21.010 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.364+0000 7fdf82859640 1 --2- 172.21.15.16:0/839080296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf7c1055c0 0x7fdf7c19b510 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:21.010 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.364+0000 7fdf82859640 1 -- 172.21.15.16:0/839080296 >> 172.21.15.16:0/839080296 conn(0x7fdf7c100d70 msgr2=0x7fdf7c101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:21.010 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.364+0000 7fdf82859640 1 -- 172.21.15.16:0/839080296 shutdown_connections 2024-08-01T06:47:21.010 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:20.364+0000 7fdf82859640 1 -- 172.21.15.16:0/839080296 wait complete. 2024-08-01T06:47:21.011 INFO:teuthology.orchestra.run.smithi016.stdout:Enabling the dashboard module... 2024-08-01T06:47:21.618 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:21 smithi016 ceph-mon[29266]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:47:21.618 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:21 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/839080296' entity='client.admin' 2024-08-01T06:47:22.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:22 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/1161716188' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-08-01T06:47:23.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.387+0000 7f6d68c1a640 1 Processor -- start 2024-08-01T06:47:23.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.388+0000 7f6d68c1a640 1 -- start start 2024-08-01T06:47:23.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.388+0000 7f6d68c1a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d64106070 0x7f6d64108460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:23.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.388+0000 7f6d68c1a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d64079e60 con 0x7f6d64106070 2024-08-01T06:47:23.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.388+0000 7f6d6259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d64106070 0x7f6d64108460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:23.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.388+0000 7f6d6259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d64106070 0x7f6d64108460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43852/0 (socket says 172.21.15.16:43852) 2024-08-01T06:47:23.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.388+0000 7f6d6259c640 1 -- 172.21.15.16:0/1323550783 learned_addr learned my addr 172.21.15.16:0/1323550783 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:23.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.388+0000 7f6d6259c640 1 -- 172.21.15.16:0/1323550783 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d641089a0 con 0x7f6d64106070 2024-08-01T06:47:23.156 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.389+0000 7f6d6259c640 1 --2- 172.21.15.16:0/1323550783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d64106070 0x7f6d64108460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009820 tx=0x7f6d5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de233c85be2b8515 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:23.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.389+0000 7f6d6159a640 1 -- 172.21.15.16:0/1323550783 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d5402ad40 con 0x7f6d64106070 2024-08-01T06:47:23.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.389+0000 7f6d6159a640 1 -- 172.21.15.16:0/1323550783 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d54032900 con 0x7f6d64106070 2024-08-01T06:47:23.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.389+0000 7f6d6159a640 1 -- 172.21.15.16:0/1323550783 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d54030860 con 0x7f6d64106070 2024-08-01T06:47:23.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.390+0000 7f6d68c1a640 1 -- 172.21.15.16:0/1323550783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d64106070 msgr2=0x7f6d64108460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:23.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.390+0000 7f6d68c1a640 1 --2- 172.21.15.16:0/1323550783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d64106070 0x7f6d64108460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009820 tx=0x7f6d5402a270 comp rx=0 tx=0).stop 2024-08-01T06:47:23.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.390+0000 7f6d68c1a640 1 -- 172.21.15.16:0/1323550783 shutdown_connections 2024-08-01T06:47:23.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.390+0000 7f6d68c1a640 1 --2- 172.21.15.16:0/1323550783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d64106070 0x7f6d64108460 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:23.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.390+0000 7f6d68c1a640 1 -- 172.21.15.16:0/1323550783 >> 172.21.15.16:0/1323550783 conn(0x7f6d640ffcd0 msgr2=0x7f6d641020f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:23.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.390+0000 7f6d68c1a640 1 -- 172.21.15.16:0/1323550783 shutdown_connections 2024-08-01T06:47:23.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.390+0000 7f6d68c1a640 1 -- 172.21.15.16:0/1323550783 wait complete. 2024-08-01T06:47:23.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.391+0000 7f6d68c1a640 1 Processor -- start 2024-08-01T06:47:23.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.391+0000 7f6d68c1a640 1 -- start start 2024-08-01T06:47:23.157 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.391+0000 7f6d68c1a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d64106070 0x7f6d6419b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:23.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.391+0000 7f6d68c1a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6419ba50 con 0x7f6d64106070 2024-08-01T06:47:23.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.391+0000 7f6d6259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d64106070 0x7f6d6419b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:23.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.391+0000 7f6d6259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d64106070 0x7f6d6419b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43856/0 (socket says 172.21.15.16:43856) 2024-08-01T06:47:23.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.391+0000 7f6d6259c640 1 -- 172.21.15.16:0/1161716188 learned_addr learned my addr 172.21.15.16:0/1161716188 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:23.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.392+0000 7f6d6259c640 1 -- 172.21.15.16:0/1161716188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d540094d0 con 0x7f6d64106070 2024-08-01T06:47:23.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.392+0000 7f6d6259c640 1 --2- 172.21.15.16:0/1161716188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d64106070 0x7f6d6419b510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6d54032670 tx=0x7f6d540326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:23.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.392+0000 7f6d537fe640 1 -- 172.21.15.16:0/1161716188 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d54032c80 con 0x7f6d64106070 2024-08-01T06:47:23.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.392+0000 7f6d537fe640 1 -- 172.21.15.16:0/1161716188 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d54032de0 con 0x7f6d64106070 2024-08-01T06:47:23.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.392+0000 7f6d68c1a640 1 -- 172.21.15.16:0/1161716188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6419bc50 con 0x7f6d64106070 2024-08-01T06:47:23.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.392+0000 7f6d537fe640 1 -- 172.21.15.16:0/1161716188 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d5403a720 con 0x7f6d64106070 2024-08-01T06:47:23.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.392+0000 7f6d68c1a640 1 -- 172.21.15.16:0/1161716188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6419c0f0 con 0x7f6d64106070 2024-08-01T06:47:23.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.393+0000 7f6d537fe640 1 -- 172.21.15.16:0/1161716188 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f6d5403a950 con 0x7f6d64106070 2024-08-01T06:47:23.158 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.393+0000 7f6d537fe640 1 --2- 172.21.15.16:0/1161716188 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f6d4c0386a0 0x7f6d4c03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:23.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.393+0000 7f6d68c1a640 1 -- 172.21.15.16:0/1161716188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d64109750 con 0x7f6d64106070 2024-08-01T06:47:23.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.393+0000 7f6d537fe640 1 -- 172.21.15.16:0/1161716188 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6d5406b8c0 con 0x7f6d64106070 2024-08-01T06:47:23.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.393+0000 7f6d61d9b640 1 --2- 172.21.15.16:0/1161716188 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f6d4c0386a0 0x7f6d4c03ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:23.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.394+0000 7f6d61d9b640 1 --2- 172.21.15.16:0/1161716188 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f6d4c0386a0 0x7f6d4c03ab60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6d580098c0 tx=0x7f6d58006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:23.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.398+0000 7f6d537fe640 1 -- 172.21.15.16:0/1161716188 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f6d540319f0 con 0x7f6d64106070 2024-08-01T06:47:23.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:21.616+0000 7f6d68c1a640 1 -- 172.21.15.16:0/1161716188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f6d64109990 con 0x7f6d64106070 2024-08-01T06:47:23.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:22.365+0000 7f6d537fe640 1 -- 172.21.15.16:0/1161716188 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f6d5403cc30 con 0x7f6d64106070 2024-08-01T06:47:23.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:22.367+0000 7f6d537fe640 1 -- 172.21.15.16:0/1161716188 <== mon.0 v2:172.21.15.16:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f6d54006120 con 0x7f6d64106070 2024-08-01T06:47:23.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:22.369+0000 7f6d68c1a640 1 -- 172.21.15.16:0/1161716188 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f6d4c0386a0 msgr2=0x7f6d4c03ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:23.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:22.369+0000 7f6d68c1a640 1 --2- 172.21.15.16:0/1161716188 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f6d4c0386a0 0x7f6d4c03ab60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6d580098c0 tx=0x7f6d58006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:23.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:22.369+0000 7f6d68c1a640 1 -- 172.21.15.16:0/1161716188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d64106070 msgr2=0x7f6d6419b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:23.159 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:22.369+0000 7f6d68c1a640 1 --2- 172.21.15.16:0/1161716188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d64106070 0x7f6d6419b510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6d54032670 tx=0x7f6d540326a0 comp rx=0 tx=0).stop 2024-08-01T06:47:23.160 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:22.370+0000 7f6d68c1a640 1 -- 172.21.15.16:0/1161716188 shutdown_connections 2024-08-01T06:47:23.160 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:22.370+0000 7f6d68c1a640 1 --2- 172.21.15.16:0/1161716188 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f6d4c0386a0 0x7f6d4c03ab60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:23.160 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:22.370+0000 7f6d68c1a640 1 --2- 172.21.15.16:0/1161716188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d64106070 0x7f6d6419b510 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:23.160 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:22.370+0000 7f6d68c1a640 1 -- 172.21.15.16:0/1161716188 >> 172.21.15.16:0/1161716188 conn(0x7f6d640ffcd0 msgr2=0x7f6d64100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:23.160 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:22.370+0000 7f6d68c1a640 1 -- 172.21.15.16:0/1161716188 shutdown_connections 2024-08-01T06:47:23.160 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:22.370+0000 7f6d68c1a640 1 -- 172.21.15.16:0/1161716188 wait complete. 2024-08-01T06:47:23.538 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:23 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/1161716188' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-01T06:47:23.538 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:23 smithi016 ceph-mon[29266]: mgrmap e9: smithi016.whigbo(active, since 26s) 2024-08-01T06:47:24.408 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-08-01T06:47:24.408 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-01T06:47:24.408 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-01T06:47:24.408 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "active_name": "smithi016.whigbo", 2024-08-01T06:47:24.408 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-01T06:47:24.409 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-08-01T06:47:24.409 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.536+0000 7f6c97d89640 1 Processor -- start 2024-08-01T06:47:24.409 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.536+0000 7f6c97d89640 1 -- start start 2024-08-01T06:47:24.409 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.537+0000 7f6c97d89640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c901055c0 0x7f6c901059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:24.409 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.537+0000 7f6c97d89640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c90105f90 con 0x7f6c901055c0 2024-08-01T06:47:24.409 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.537+0000 7f6c95b25640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c901055c0 0x7f6c901059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:24.409 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.537+0000 7f6c95b25640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c901055c0 0x7f6c901059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43866/0 (socket says 172.21.15.16:43866) 2024-08-01T06:47:24.409 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.537+0000 7f6c95b25640 1 -- 172.21.15.16:0/3945191146 learned_addr learned my addr 172.21.15.16:0/3945191146 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:24.409 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.537+0000 7f6c95b25640 1 -- 172.21.15.16:0/3945191146 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c901067c0 con 0x7f6c901055c0 2024-08-01T06:47:24.409 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.538+0000 7f6c95b25640 1 --2- 172.21.15.16:0/3945191146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c901055c0 0x7f6c901059c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009820 tx=0x7f6c8c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa47bdb6eed437c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:24.409 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.538+0000 7f6c94b23640 1 -- 172.21.15.16:0/3945191146 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c8c02ad40 con 0x7f6c901055c0 2024-08-01T06:47:24.409 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.538+0000 7f6c94b23640 1 -- 172.21.15.16:0/3945191146 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c8c032900 con 0x7f6c901055c0 2024-08-01T06:47:24.410 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.538+0000 7f6c94b23640 1 -- 172.21.15.16:0/3945191146 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c8c030860 con 0x7f6c901055c0 2024-08-01T06:47:24.410 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.539+0000 7f6c97d89640 1 -- 172.21.15.16:0/3945191146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c901055c0 msgr2=0x7f6c901059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:24.410 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.539+0000 7f6c97d89640 1 --2- 172.21.15.16:0/3945191146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c901055c0 0x7f6c901059c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009820 tx=0x7f6c8c02a270 comp rx=0 tx=0).stop 2024-08-01T06:47:24.410 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.539+0000 7f6c97d89640 1 -- 172.21.15.16:0/3945191146 shutdown_connections 2024-08-01T06:47:24.410 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.539+0000 7f6c97d89640 1 --2- 172.21.15.16:0/3945191146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c901055c0 0x7f6c901059c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:24.410 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.539+0000 7f6c97d89640 1 -- 172.21.15.16:0/3945191146 >> 172.21.15.16:0/3945191146 conn(0x7f6c90100d30 msgr2=0x7f6c90103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:24.410 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.539+0000 7f6c97d89640 1 -- 172.21.15.16:0/3945191146 shutdown_connections 2024-08-01T06:47:24.410 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.539+0000 7f6c97d89640 1 -- 172.21.15.16:0/3945191146 wait complete. 2024-08-01T06:47:24.410 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.540+0000 7f6c97d89640 1 Processor -- start 2024-08-01T06:47:24.410 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.540+0000 7f6c97d89640 1 -- start start 2024-08-01T06:47:24.410 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.540+0000 7f6c97d89640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c901055c0 0x7f6c9019b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:24.410 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.540+0000 7f6c97d89640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9019ba60 con 0x7f6c901055c0 2024-08-01T06:47:24.411 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.540+0000 7f6c95b25640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c901055c0 0x7f6c9019b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:24.411 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.540+0000 7f6c95b25640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c901055c0 0x7f6c9019b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43870/0 (socket says 172.21.15.16:43870) 2024-08-01T06:47:24.411 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.540+0000 7f6c95b25640 1 -- 172.21.15.16:0/4138326642 learned_addr learned my addr 172.21.15.16:0/4138326642 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:24.411 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.540+0000 7f6c95b25640 1 -- 172.21.15.16:0/4138326642 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c0094d0 con 0x7f6c901055c0 2024-08-01T06:47:24.411 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.541+0000 7f6c95b25640 1 --2- 172.21.15.16:0/4138326642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c901055c0 0x7f6c9019b520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009940 tx=0x7f6c8c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:24.411 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.541+0000 7f6c86ffd640 1 -- 172.21.15.16:0/4138326642 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c8c032c80 con 0x7f6c901055c0 2024-08-01T06:47:24.411 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.541+0000 7f6c86ffd640 1 -- 172.21.15.16:0/4138326642 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c8c032de0 con 0x7f6c901055c0 2024-08-01T06:47:24.411 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.541+0000 7f6c97d89640 1 -- 172.21.15.16:0/4138326642 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9019bc60 con 0x7f6c901055c0 2024-08-01T06:47:24.411 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.541+0000 7f6c97d89640 1 -- 172.21.15.16:0/4138326642 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9019c100 con 0x7f6c901055c0 2024-08-01T06:47:24.411 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.541+0000 7f6c86ffd640 1 -- 172.21.15.16:0/4138326642 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c8c03a720 con 0x7f6c901055c0 2024-08-01T06:47:24.411 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.542+0000 7f6c86ffd640 1 -- 172.21.15.16:0/4138326642 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f6c8c03a950 con 0x7f6c901055c0 2024-08-01T06:47:24.411 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.542+0000 7f6c86ffd640 1 --2- 172.21.15.16:0/4138326642 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f6c7c0386a0 0x7f6c7c03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:24.411 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.542+0000 7f6c86ffd640 1 -- 172.21.15.16:0/4138326642 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6c8c06b9d0 con 0x7f6c901055c0 2024-08-01T06:47:24.412 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.542+0000 7f6c95324640 1 -- 172.21.15.16:0/4138326642 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f6c7c0386a0 msgr2=0x7f6c7c03ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.16:6800/247151947 2024-08-01T06:47:24.412 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.542+0000 7f6c95324640 1 --2- 172.21.15.16:0/4138326642 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f6c7c0386a0 0x7f6c7c03ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-01T06:47:24.412 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.542+0000 7f6c97d89640 1 -- 172.21.15.16:0/4138326642 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c901059c0 con 0x7f6c901055c0 2024-08-01T06:47:24.412 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.547+0000 7f6c86ffd640 1 -- 172.21.15.16:0/4138326642 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f6c8c039d30 con 0x7f6c901055c0 2024-08-01T06:47:24.412 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.743+0000 7f6c95324640 1 -- 172.21.15.16:0/4138326642 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f6c7c0386a0 msgr2=0x7f6c7c03ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.16:6800/247151947 2024-08-01T06:47:24.412 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.743+0000 7f6c95324640 1 --2- 172.21.15.16:0/4138326642 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f6c7c0386a0 0x7f6c7c03ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-01T06:47:24.412 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.768+0000 7f6c97d89640 1 -- 172.21.15.16:0/4138326642 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f6c901099f0 con 0x7f6c901055c0 2024-08-01T06:47:24.412 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.768+0000 7f6c86ffd640 1 -- 172.21.15.16:0/4138326642 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f6c8c044e90 con 0x7f6c901055c0 2024-08-01T06:47:24.412 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.770+0000 7f6c97d89640 1 -- 172.21.15.16:0/4138326642 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f6c7c0386a0 msgr2=0x7f6c7c03ab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-01T06:47:24.412 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.770+0000 7f6c97d89640 1 --2- 172.21.15.16:0/4138326642 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f6c7c0386a0 0x7f6c7c03ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:24.412 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.770+0000 7f6c97d89640 1 -- 172.21.15.16:0/4138326642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c901055c0 msgr2=0x7f6c9019b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:24.412 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.770+0000 7f6c97d89640 1 --2- 172.21.15.16:0/4138326642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c901055c0 0x7f6c9019b520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009940 tx=0x7f6c8c032670 comp rx=0 tx=0).stop 2024-08-01T06:47:24.412 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.770+0000 7f6c97d89640 1 -- 172.21.15.16:0/4138326642 shutdown_connections 2024-08-01T06:47:24.413 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.770+0000 7f6c97d89640 1 --2- 172.21.15.16:0/4138326642 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f6c7c0386a0 0x7f6c7c03ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:24.413 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.770+0000 7f6c97d89640 1 --2- 172.21.15.16:0/4138326642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c901055c0 0x7f6c9019b520 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:24.413 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.770+0000 7f6c97d89640 1 -- 172.21.15.16:0/4138326642 >> 172.21.15.16:0/4138326642 conn(0x7f6c90100d30 msgr2=0x7f6c90101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:24.413 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.770+0000 7f6c97d89640 1 -- 172.21.15.16:0/4138326642 shutdown_connections 2024-08-01T06:47:24.413 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:23.770+0000 7f6c97d89640 1 -- 172.21.15.16:0/4138326642 wait complete. 2024-08-01T06:47:24.413 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for the mgr to restart... 2024-08-01T06:47:24.413 INFO:teuthology.orchestra.run.smithi016.stdout:Waiting for mgr epoch 9... 2024-08-01T06:47:24.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:24 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/4138326642' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-08-01T06:47:27.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:27 smithi016 ceph-mon[29266]: Active manager daemon smithi016.whigbo restarted 2024-08-01T06:47:27.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:27 smithi016 ceph-mon[29266]: Activating manager daemon smithi016.whigbo 2024-08-01T06:47:27.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:27 smithi016 ceph-mon[29266]: osdmap e3: 0 total, 0 up, 0 in 2024-08-01T06:47:27.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:27 smithi016 ceph-mon[29266]: mgrmap e10: smithi016.whigbo(active, starting, since 0.0034122s) 2024-08-01T06:47:27.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:27 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:47:27.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:27 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr metadata", "who": "smithi016.whigbo", "id": "smithi016.whigbo"}]: dispatch 2024-08-01T06:47:27.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:27 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-01T06:47:27.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:27 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-01T06:47:27.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:27 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-01T06:47:27.579 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:27 smithi016 ceph-mon[29266]: Manager daemon smithi016.whigbo is now available 2024-08-01T06:47:27.580 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:27 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:47:27.580 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:27 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi016.whigbo/mirror_snapshot_schedule"}]: dispatch 2024-08-01T06:47:27.580 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:27 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi016.whigbo/trash_purge_schedule"}]: dispatch 2024-08-01T06:47:29.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout { 2024-08-01T06:47:29.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-01T06:47:29.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-01T06:47:29.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout } 2024-08-01T06:47:29.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.851+0000 7f218ff1f640 1 Processor -- start 2024-08-01T06:47:29.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.852+0000 7f218ff1f640 1 -- start start 2024-08-01T06:47:29.282 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.852+0000 7f218ff1f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2188106090 0x7f2188108480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:29.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.852+0000 7f218ff1f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2188079e60 con 0x7f2188106090 2024-08-01T06:47:29.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.852+0000 7f218dcbb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2188106090 0x7f2188108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:29.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.852+0000 7f218dcbb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2188106090 0x7f2188108480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43874/0 (socket says 172.21.15.16:43874) 2024-08-01T06:47:29.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.852+0000 7f218dcbb640 1 -- 172.21.15.16:0/1222140140 learned_addr learned my addr 172.21.15.16:0/1222140140 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:29.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.852+0000 7f218dcbb640 1 -- 172.21.15.16:0/1222140140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21881089c0 con 0x7f2188106090 2024-08-01T06:47:29.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.853+0000 7f218dcbb640 1 --2- 172.21.15.16:0/1222140140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2188106090 0x7f2188108480 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2184009820 tx=0x7f218402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d97c449d764478 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:29.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.853+0000 7f218ccb9640 1 -- 172.21.15.16:0/1222140140 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f218402ad40 con 0x7f2188106090 2024-08-01T06:47:29.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.853+0000 7f218ccb9640 1 -- 172.21.15.16:0/1222140140 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2184032900 con 0x7f2188106090 2024-08-01T06:47:29.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.853+0000 7f218ccb9640 1 -- 172.21.15.16:0/1222140140 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2184030860 con 0x7f2188106090 2024-08-01T06:47:29.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.854+0000 7f218ff1f640 1 -- 172.21.15.16:0/1222140140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2188106090 msgr2=0x7f2188108480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:29.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.854+0000 7f218ff1f640 1 --2- 172.21.15.16:0/1222140140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2188106090 0x7f2188108480 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2184009820 tx=0x7f218402a270 comp rx=0 tx=0).stop 2024-08-01T06:47:29.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.854+0000 7f218ff1f640 1 -- 172.21.15.16:0/1222140140 shutdown_connections 2024-08-01T06:47:29.283 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.854+0000 7f218ff1f640 1 --2- 172.21.15.16:0/1222140140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2188106090 0x7f2188108480 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:29.284 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.854+0000 7f218ff1f640 1 -- 172.21.15.16:0/1222140140 >> 172.21.15.16:0/1222140140 conn(0x7f21880ffc50 msgr2=0x7f21881020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:29.284 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.854+0000 7f218ff1f640 1 -- 172.21.15.16:0/1222140140 shutdown_connections 2024-08-01T06:47:29.284 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.854+0000 7f218ff1f640 1 -- 172.21.15.16:0/1222140140 wait complete. 2024-08-01T06:47:29.284 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.855+0000 7f218ff1f640 1 Processor -- start 2024-08-01T06:47:29.284 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.855+0000 7f218ff1f640 1 -- start start 2024-08-01T06:47:29.284 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.855+0000 7f218ff1f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2188106090 0x7f2188105910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:29.284 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.855+0000 7f218ff1f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2188105e50 con 0x7f2188106090 2024-08-01T06:47:29.284 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.855+0000 7f218dcbb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2188106090 0x7f2188105910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:29.284 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.855+0000 7f218dcbb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2188106090 0x7f2188105910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43884/0 (socket says 172.21.15.16:43884) 2024-08-01T06:47:29.284 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.855+0000 7f218dcbb640 1 -- 172.21.15.16:0/4167244580 learned_addr learned my addr 172.21.15.16:0/4167244580 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:29.284 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.855+0000 7f218dcbb640 1 -- 172.21.15.16:0/4167244580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21840094d0 con 0x7f2188106090 2024-08-01T06:47:29.284 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.856+0000 7f218dcbb640 1 --2- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2188106090 0x7f2188105910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f21840097f0 tx=0x7f2184030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:29.284 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.856+0000 7f217effd640 1 -- 172.21.15.16:0/4167244580 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2184040070 con 0x7f2188106090 2024-08-01T06:47:29.285 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.856+0000 7f217effd640 1 -- 172.21.15.16:0/4167244580 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2184032dd0 con 0x7f2188106090 2024-08-01T06:47:29.285 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.856+0000 7f218ff1f640 1 -- 172.21.15.16:0/4167244580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2188104040 con 0x7f2188106090 2024-08-01T06:47:29.285 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.857+0000 7f217effd640 1 -- 172.21.15.16:0/4167244580 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f218403a790 con 0x7f2188106090 2024-08-01T06:47:29.285 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.857+0000 7f218ff1f640 1 -- 172.21.15.16:0/4167244580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21881044e0 con 0x7f2188106090 2024-08-01T06:47:29.285 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.857+0000 7f217effd640 1 -- 172.21.15.16:0/4167244580 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f218403a8f0 con 0x7f2188106090 2024-08-01T06:47:29.285 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.858+0000 7f217effd640 1 --2- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f2174038320 0x7f217403a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:29.285 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.858+0000 7f217effd640 1 -- 172.21.15.16:0/4167244580 --> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2184032dd0 con 0x7f2174038320 2024-08-01T06:47:29.285 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.858+0000 7f217effd640 1 -- 172.21.15.16:0/4167244580 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f218406b140 con 0x7f2188106090 2024-08-01T06:47:29.285 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.858+0000 7f218d4ba640 1 -- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f2174038320 msgr2=0x7f217403a7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.16:6800/247151947 2024-08-01T06:47:29.285 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:24.858+0000 7f218d4ba640 1 --2- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f2174038320 0x7f217403a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-01T06:47:29.285 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:25.059+0000 7f218d4ba640 1 -- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f2174038320 msgr2=0x7f217403a7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.16:6800/247151947 2024-08-01T06:47:29.285 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:25.059+0000 7f218d4ba640 1 --2- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f2174038320 0x7f217403a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-01T06:47:29.285 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:25.460+0000 7f218d4ba640 1 -- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f2174038320 msgr2=0x7f217403a7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.16:6800/247151947 2024-08-01T06:47:29.286 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:25.460+0000 7f218d4ba640 1 --2- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f2174038320 0x7f217403a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-01T06:47:29.286 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:26.261+0000 7f218d4ba640 1 -- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f2174038320 msgr2=0x7f217403a7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.16:6800/247151947 2024-08-01T06:47:29.286 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:26.261+0000 7f218d4ba640 1 --2- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f2174038320 0x7f217403a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-01T06:47:29.286 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:27.349+0000 7f217effd640 1 -- 172.21.15.16:0/4167244580 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mgrmap(e 10) v1 ==== 45336+0+0 (secure 0 0 0) 0x7f2184069f70 con 0x7f2188106090 2024-08-01T06:47:29.286 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:27.349+0000 7f217effd640 1 -- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f2174038320 msgr2=0x7f217403a7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-01T06:47:29.286 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:27.349+0000 7f217effd640 1 --2- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f2174038320 0x7f217403a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:29.286 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:28.351+0000 7f217effd640 1 -- 172.21.15.16:0/4167244580 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mgrmap(e 11) v1 ==== 45463+0+0 (secure 0 0 0) 0x7f218403c400 con 0x7f2188106090 2024-08-01T06:47:29.286 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:28.351+0000 7f217effd640 1 --2- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f217403bc70 0x7f217403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:29.286 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:28.351+0000 7f217effd640 1 -- 172.21.15.16:0/4167244580 --> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2184032dd0 con 0x7f217403bc70 2024-08-01T06:47:29.286 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:28.352+0000 7f218d4ba640 1 --2- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f217403bc70 0x7f217403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:29.286 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:28.352+0000 7f218d4ba640 1 --2- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f217403bc70 0x7f217403e060 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2178003980 tx=0x7f2178006e10 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:29.286 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:28.353+0000 7f217effd640 1 -- 172.21.15.16:0/4167244580 <== mgr.14162 v2:172.21.15.16:6800/3100338993 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f2184032dd0 con 0x7f217403bc70 2024-08-01T06:47:29.286 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:28.359+0000 7f218ff1f640 1 -- 172.21.15.16:0/4167244580 --> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f2188106470 con 0x7f217403bc70 2024-08-01T06:47:29.287 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:28.359+0000 7f217effd640 1 -- 172.21.15.16:0/4167244580 <== mgr.14162 v2:172.21.15.16:6800/3100338993 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f2188106470 con 0x7f217403bc70 2024-08-01T06:47:29.287 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:28.359+0000 7f218ff1f640 1 -- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f217403bc70 msgr2=0x7f217403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:29.287 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:28.359+0000 7f218ff1f640 1 --2- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f217403bc70 0x7f217403e060 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2178003980 tx=0x7f2178006e10 comp rx=0 tx=0).stop 2024-08-01T06:47:29.287 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:28.359+0000 7f218ff1f640 1 -- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2188106090 msgr2=0x7f2188105910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:29.287 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:28.359+0000 7f218ff1f640 1 --2- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2188106090 0x7f2188105910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f21840097f0 tx=0x7f2184030d50 comp rx=0 tx=0).stop 2024-08-01T06:47:29.287 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:28.359+0000 7f218ff1f640 1 -- 172.21.15.16:0/4167244580 shutdown_connections 2024-08-01T06:47:29.287 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:28.359+0000 7f218ff1f640 1 --2- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f217403bc70 0x7f217403e060 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:29.287 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:28.359+0000 7f218ff1f640 1 --2- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:6800/247151947,v1:172.21.15.16:6801/247151947] conn(0x7f2174038320 0x7f217403a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:29.287 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:28.359+0000 7f218ff1f640 1 --2- 172.21.15.16:0/4167244580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2188106090 0x7f2188105910 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:29.287 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:28.359+0000 7f218ff1f640 1 -- 172.21.15.16:0/4167244580 >> 172.21.15.16:0/4167244580 conn(0x7f21880ffc50 msgr2=0x7f2188100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:29.287 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:28.360+0000 7f218ff1f640 1 -- 172.21.15.16:0/4167244580 shutdown_connections 2024-08-01T06:47:29.287 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:28.360+0000 7f218ff1f640 1 -- 172.21.15.16:0/4167244580 wait complete. 2024-08-01T06:47:29.287 INFO:teuthology.orchestra.run.smithi016.stdout:mgr epoch 9 is available 2024-08-01T06:47:29.287 INFO:teuthology.orchestra.run.smithi016.stdout:Generating a dashboard self-signed certificate... 2024-08-01T06:47:29.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:29 smithi016 ceph-mon[29266]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-01T06:47:29.525 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:29 smithi016 ceph-mon[29266]: mgrmap e11: smithi016.whigbo(active, since 1.00632s) 2024-08-01T06:47:29.525 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:29 smithi016 ceph-mon[29266]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-01T06:47:29.525 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:29 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:29.525 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:29 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:30.599 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:30 smithi016 ceph-mon[29266]: [01/Aug/2024:06:47:28] ENGINE Bus STARTING 2024-08-01T06:47:30.617 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:30 smithi016 ceph-mon[29266]: [01/Aug/2024:06:47:28] ENGINE Serving on https://172.21.15.16:7150 2024-08-01T06:47:30.617 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:30 smithi016 ceph-mon[29266]: [01/Aug/2024:06:47:28] ENGINE Error in HTTPServer.serve 2024-08-01T06:47:30.618 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Traceback (most recent call last): 2024-08-01T06:47:30.618 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-01T06:47:30.618 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self._connections.run(self.expiration_interval) 2024-08-01T06:47:30.618 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-01T06:47:30.618 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self._run(expiration_interval) 2024-08-01T06:47:30.618 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-01T06:47:30.618 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-01T06:47:30.618 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-01T06:47:30.618 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-01T06:47:30.618 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-01T06:47:30.618 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: s = self.context.wrap_socket( 2024-08-01T06:47:30.618 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-01T06:47:30.618 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: return self.sslsocket_class._create( 2024-08-01T06:47:30.619 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-01T06:47:30.619 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self.do_handshake() 2024-08-01T06:47:30.619 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-01T06:47:30.619 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self._sslobj.do_handshake() 2024-08-01T06:47:30.619 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-01T06:47:30.619 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:30 smithi016 ceph-mon[29266]: [01/Aug/2024:06:47:29] ENGINE Serving on http://172.21.15.16:8765 2024-08-01T06:47:30.619 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:30 smithi016 ceph-mon[29266]: [01/Aug/2024:06:47:29] ENGINE Bus STARTED 2024-08-01T06:47:30.619 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:30 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:30.619 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:30 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:30.619 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:30 smithi016 ceph-mon[29266]: mgrmap e12: smithi016.whigbo(active, since 2s) 2024-08-01T06:47:31.143 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-08-01T06:47:31.143 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.738+0000 7f31cc14f640 1 Processor -- start 2024-08-01T06:47:31.143 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.739+0000 7f31cc14f640 1 -- start start 2024-08-01T06:47:31.143 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.739+0000 7f31cc14f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31c41060d0 0x7f31c41084c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:31.143 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.739+0000 7f31cc14f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4079e20 con 0x7f31c41060d0 2024-08-01T06:47:31.144 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.739+0000 7f31c9eeb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31c41060d0 0x7f31c41084c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:31.144 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.739+0000 7f31c9eeb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31c41060d0 0x7f31c41084c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38170/0 (socket says 172.21.15.16:38170) 2024-08-01T06:47:31.144 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.739+0000 7f31c9eeb640 1 -- 172.21.15.16:0/1091724715 learned_addr learned my addr 172.21.15.16:0/1091724715 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:31.144 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.739+0000 7f31c9eeb640 1 -- 172.21.15.16:0/1091724715 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c4108a00 con 0x7f31c41060d0 2024-08-01T06:47:31.144 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.740+0000 7f31c9eeb640 1 --2- 172.21.15.16:0/1091724715 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31c41060d0 0x7f31c41084c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009820 tx=0x7f31c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96807829bea2a010 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:31.144 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.740+0000 7f31c8ee9640 1 -- 172.21.15.16:0/1091724715 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31c002ad40 con 0x7f31c41060d0 2024-08-01T06:47:31.144 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.740+0000 7f31c8ee9640 1 -- 172.21.15.16:0/1091724715 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f31c0032900 con 0x7f31c41060d0 2024-08-01T06:47:31.144 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.740+0000 7f31c8ee9640 1 -- 172.21.15.16:0/1091724715 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31c0030860 con 0x7f31c41060d0 2024-08-01T06:47:31.144 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.741+0000 7f31cc14f640 1 -- 172.21.15.16:0/1091724715 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31c41060d0 msgr2=0x7f31c41084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:31.144 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.741+0000 7f31cc14f640 1 --2- 172.21.15.16:0/1091724715 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31c41060d0 0x7f31c41084c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009820 tx=0x7f31c002a270 comp rx=0 tx=0).stop 2024-08-01T06:47:31.144 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.741+0000 7f31cc14f640 1 -- 172.21.15.16:0/1091724715 shutdown_connections 2024-08-01T06:47:31.144 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.741+0000 7f31cc14f640 1 --2- 172.21.15.16:0/1091724715 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31c41060d0 0x7f31c41084c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:31.145 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.741+0000 7f31cc14f640 1 -- 172.21.15.16:0/1091724715 >> 172.21.15.16:0/1091724715 conn(0x7f31c40ffc50 msgr2=0x7f31c41020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:31.145 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.741+0000 7f31cc14f640 1 -- 172.21.15.16:0/1091724715 shutdown_connections 2024-08-01T06:47:31.145 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.741+0000 7f31cc14f640 1 -- 172.21.15.16:0/1091724715 wait complete. 2024-08-01T06:47:31.145 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.742+0000 7f31cc14f640 1 Processor -- start 2024-08-01T06:47:31.145 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.742+0000 7f31cc14f640 1 -- start start 2024-08-01T06:47:31.145 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.742+0000 7f31cc14f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31c41060d0 0x7f31c41992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:31.145 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.742+0000 7f31cc14f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4199830 con 0x7f31c41060d0 2024-08-01T06:47:31.145 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.742+0000 7f31c9eeb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31c41060d0 0x7f31c41992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:31.145 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.742+0000 7f31c9eeb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31c41060d0 0x7f31c41992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38180/0 (socket says 172.21.15.16:38180) 2024-08-01T06:47:31.145 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.742+0000 7f31c9eeb640 1 -- 172.21.15.16:0/1057042772 learned_addr learned my addr 172.21.15.16:0/1057042772 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:31.145 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.743+0000 7f31c9eeb640 1 -- 172.21.15.16:0/1057042772 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c00094d0 con 0x7f31c41060d0 2024-08-01T06:47:31.145 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.743+0000 7f31c9eeb640 1 --2- 172.21.15.16:0/1057042772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31c41060d0 0x7f31c41992f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f31c0032670 tx=0x7f31c00326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:31.145 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.743+0000 7f31baffd640 1 -- 172.21.15.16:0/1057042772 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31c0032c80 con 0x7f31c41060d0 2024-08-01T06:47:31.146 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.743+0000 7f31baffd640 1 -- 172.21.15.16:0/1057042772 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f31c0032de0 con 0x7f31c41060d0 2024-08-01T06:47:31.146 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.743+0000 7f31cc14f640 1 -- 172.21.15.16:0/1057042772 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c4199a30 con 0x7f31c41060d0 2024-08-01T06:47:31.146 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.743+0000 7f31baffd640 1 -- 172.21.15.16:0/1057042772 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31c003a720 con 0x7f31c41060d0 2024-08-01T06:47:31.146 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.743+0000 7f31cc14f640 1 -- 172.21.15.16:0/1057042772 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c4199ed0 con 0x7f31c41060d0 2024-08-01T06:47:31.146 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.744+0000 7f31cc14f640 1 -- 172.21.15.16:0/1057042772 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c41097b0 con 0x7f31c41060d0 2024-08-01T06:47:31.146 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.744+0000 7f31baffd640 1 -- 172.21.15.16:0/1057042772 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 11) v1 ==== 45463+0+0 (secure 0 0 0) 0x7f31c003c400 con 0x7f31c41060d0 2024-08-01T06:47:31.146 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.744+0000 7f31baffd640 1 --2- 172.21.15.16:0/1057042772 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f31b0038580 0x7f31b003aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:31.148 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.744+0000 7f31baffd640 1 -- 172.21.15.16:0/1057042772 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f31c006b8f0 con 0x7f31c41060d0 2024-08-01T06:47:31.148 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.745+0000 7f31c96ea640 1 --2- 172.21.15.16:0/1057042772 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f31b0038580 0x7f31b003aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:31.148 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.745+0000 7f31c96ea640 1 --2- 172.21.15.16:0/1057042772 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f31b0038580 0x7f31b003aa40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f31b40098c0 tx=0x7f31b4006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:31.148 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.753+0000 7f31baffd640 1 -- 172.21.15.16:0/1057042772 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f31c003a9a0 con 0x7f31c41060d0 2024-08-01T06:47:31.148 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.933+0000 7f31cc14f640 1 -- 172.21.15.16:0/1057042772 --> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f31c4100f40 con 0x7f31b0038580 2024-08-01T06:47:31.148 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.973+0000 7f31baffd640 1 -- 172.21.15.16:0/1057042772 <== mgr.14162 v2:172.21.15.16:6800/3100338993 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f31c4100f40 con 0x7f31b0038580 2024-08-01T06:47:31.148 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.975+0000 7f31cc14f640 1 -- 172.21.15.16:0/1057042772 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f31b0038580 msgr2=0x7f31b003aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:31.149 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.975+0000 7f31cc14f640 1 --2- 172.21.15.16:0/1057042772 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f31b0038580 0x7f31b003aa40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f31b40098c0 tx=0x7f31b4006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:31.149 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.975+0000 7f31cc14f640 1 -- 172.21.15.16:0/1057042772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31c41060d0 msgr2=0x7f31c41992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:31.149 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.975+0000 7f31cc14f640 1 --2- 172.21.15.16:0/1057042772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31c41060d0 0x7f31c41992f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f31c0032670 tx=0x7f31c00326a0 comp rx=0 tx=0).stop 2024-08-01T06:47:31.149 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.975+0000 7f31cc14f640 1 -- 172.21.15.16:0/1057042772 shutdown_connections 2024-08-01T06:47:31.149 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.975+0000 7f31cc14f640 1 --2- 172.21.15.16:0/1057042772 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f31b0038580 0x7f31b003aa40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:31.149 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.975+0000 7f31cc14f640 1 --2- 172.21.15.16:0/1057042772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31c41060d0 0x7f31c41992f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:31.149 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.975+0000 7f31cc14f640 1 -- 172.21.15.16:0/1057042772 >> 172.21.15.16:0/1057042772 conn(0x7f31c40ffc50 msgr2=0x7f31c4100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:31.149 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.975+0000 7f31cc14f640 1 -- 172.21.15.16:0/1057042772 shutdown_connections 2024-08-01T06:47:31.149 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:29.975+0000 7f31cc14f640 1 -- 172.21.15.16:0/1057042772 wait complete. 2024-08-01T06:47:31.149 INFO:teuthology.orchestra.run.smithi016.stdout:Creating initial admin user... 2024-08-01T06:47:31.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:31 smithi016 ceph-mon[29266]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:47:32.724 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$0OFk/.mRJKFHZgkZ5TNMWeY8/bIC/LQc14BQhS/Xp6yRGJhXadZwO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1722494851, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-01T06:47:32.724 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.532+0000 7f2dcbf49640 1 Processor -- start 2024-08-01T06:47:32.724 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.533+0000 7f2dcbf49640 1 -- start start 2024-08-01T06:47:32.725 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.533+0000 7f2dcbf49640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc407be70 0x7f2dc407a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:32.725 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.533+0000 7f2dcbf49640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc407a8a0 con 0x7f2dc407be70 2024-08-01T06:47:32.725 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.533+0000 7f2dc9ce5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc407be70 0x7f2dc407a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:32.725 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.533+0000 7f2dc9ce5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc407be70 0x7f2dc407a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38190/0 (socket says 172.21.15.16:38190) 2024-08-01T06:47:32.725 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.533+0000 7f2dc9ce5640 1 -- 172.21.15.16:0/3057147719 learned_addr learned my addr 172.21.15.16:0/3057147719 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:32.725 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.533+0000 7f2dc9ce5640 1 -- 172.21.15.16:0/3057147719 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc407a9e0 con 0x7f2dc407be70 2024-08-01T06:47:32.725 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.534+0000 7f2dc9ce5640 1 --2- 172.21.15.16:0/3057147719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc407be70 0x7f2dc407a2d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009820 tx=0x7f2dc002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f323794f71e156 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:32.725 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.534+0000 7f2dc8ce3640 1 -- 172.21.15.16:0/3057147719 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc002ad40 con 0x7f2dc407be70 2024-08-01T06:47:32.725 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.534+0000 7f2dc8ce3640 1 -- 172.21.15.16:0/3057147719 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2dc0032900 con 0x7f2dc407be70 2024-08-01T06:47:32.725 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.534+0000 7f2dc8ce3640 1 -- 172.21.15.16:0/3057147719 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc0030860 con 0x7f2dc407be70 2024-08-01T06:47:32.725 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.535+0000 7f2dcbf49640 1 -- 172.21.15.16:0/3057147719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc407be70 msgr2=0x7f2dc407a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:32.725 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.535+0000 7f2dcbf49640 1 --2- 172.21.15.16:0/3057147719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc407be70 0x7f2dc407a2d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009820 tx=0x7f2dc002a270 comp rx=0 tx=0).stop 2024-08-01T06:47:32.725 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.535+0000 7f2dcbf49640 1 -- 172.21.15.16:0/3057147719 shutdown_connections 2024-08-01T06:47:32.726 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.535+0000 7f2dcbf49640 1 --2- 172.21.15.16:0/3057147719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc407be70 0x7f2dc407a2d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:32.726 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.535+0000 7f2dcbf49640 1 -- 172.21.15.16:0/3057147719 >> 172.21.15.16:0/3057147719 conn(0x7f2dc4100d80 msgr2=0x7f2dc41031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:32.726 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.535+0000 7f2dcbf49640 1 -- 172.21.15.16:0/3057147719 shutdown_connections 2024-08-01T06:47:32.726 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.535+0000 7f2dcbf49640 1 -- 172.21.15.16:0/3057147719 wait complete. 2024-08-01T06:47:32.726 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.536+0000 7f2dcbf49640 1 Processor -- start 2024-08-01T06:47:32.726 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.536+0000 7f2dcbf49640 1 -- start start 2024-08-01T06:47:32.726 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.536+0000 7f2dcbf49640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc407be70 0x7f2dc419b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:32.726 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.536+0000 7f2dcbf49640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc419ba30 con 0x7f2dc407be70 2024-08-01T06:47:32.726 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.536+0000 7f2dc9ce5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc407be70 0x7f2dc419b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:32.726 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.536+0000 7f2dc9ce5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc407be70 0x7f2dc419b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38198/0 (socket says 172.21.15.16:38198) 2024-08-01T06:47:32.726 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.536+0000 7f2dc9ce5640 1 -- 172.21.15.16:0/2899976307 learned_addr learned my addr 172.21.15.16:0/2899976307 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:32.726 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.536+0000 7f2dc9ce5640 1 -- 172.21.15.16:0/2899976307 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc00094d0 con 0x7f2dc407be70 2024-08-01T06:47:32.726 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.536+0000 7f2dc9ce5640 1 --2- 172.21.15.16:0/2899976307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc407be70 0x7f2dc419b4f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00097f0 tx=0x7f2dc0030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:32.727 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.537+0000 7f2dbaffd640 1 -- 172.21.15.16:0/2899976307 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc0040070 con 0x7f2dc407be70 2024-08-01T06:47:32.727 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.537+0000 7f2dbaffd640 1 -- 172.21.15.16:0/2899976307 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2dc0032dd0 con 0x7f2dc407be70 2024-08-01T06:47:32.727 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.537+0000 7f2dcbf49640 1 -- 172.21.15.16:0/2899976307 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc419bc30 con 0x7f2dc407be70 2024-08-01T06:47:32.727 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.537+0000 7f2dbaffd640 1 -- 172.21.15.16:0/2899976307 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc003a790 con 0x7f2dc407be70 2024-08-01T06:47:32.727 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.537+0000 7f2dcbf49640 1 -- 172.21.15.16:0/2899976307 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc419c0d0 con 0x7f2dc407be70 2024-08-01T06:47:32.727 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.538+0000 7f2dbaffd640 1 -- 172.21.15.16:0/2899976307 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f2dc003c400 con 0x7f2dc407be70 2024-08-01T06:47:32.727 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.538+0000 7f2dcbf49640 1 -- 172.21.15.16:0/2899976307 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc410b9b0 con 0x7f2dc407be70 2024-08-01T06:47:32.727 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.538+0000 7f2dbaffd640 1 --2- 172.21.15.16:0/2899976307 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f2db00386f0 0x7f2db003abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:32.727 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.538+0000 7f2dbaffd640 1 -- 172.21.15.16:0/2899976307 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2dc006b7f0 con 0x7f2dc407be70 2024-08-01T06:47:32.727 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.538+0000 7f2dc94e4640 1 --2- 172.21.15.16:0/2899976307 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f2db00386f0 0x7f2db003abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:32.727 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.538+0000 7f2dc94e4640 1 --2- 172.21.15.16:0/2899976307 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f2db00386f0 0x7f2db003abb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2db40098c0 tx=0x7f2db4006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:32.727 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.542+0000 7f2dbaffd640 1 -- 172.21.15.16:0/2899976307 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f2dc0043b00 con 0x7f2dc407be70 2024-08-01T06:47:32.728 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.726+0000 7f2dcbf49640 1 -- 172.21.15.16:0/2899976307 --> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f2dc4061900 con 0x7f2db00386f0 2024-08-01T06:47:32.728 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.974+0000 7f2dbaffd640 1 -- 172.21.15.16:0/2899976307 <== mgr.14162 v2:172.21.15.16:6800/3100338993 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f2dc4061900 con 0x7f2db00386f0 2024-08-01T06:47:32.728 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.976+0000 7f2dcbf49640 1 -- 172.21.15.16:0/2899976307 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f2db00386f0 msgr2=0x7f2db003abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:32.728 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.976+0000 7f2dcbf49640 1 --2- 172.21.15.16:0/2899976307 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f2db00386f0 0x7f2db003abb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2db40098c0 tx=0x7f2db4006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:32.728 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.976+0000 7f2dcbf49640 1 -- 172.21.15.16:0/2899976307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc407be70 msgr2=0x7f2dc419b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:32.728 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.976+0000 7f2dcbf49640 1 --2- 172.21.15.16:0/2899976307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc407be70 0x7f2dc419b4f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00097f0 tx=0x7f2dc0030d50 comp rx=0 tx=0).stop 2024-08-01T06:47:32.728 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.976+0000 7f2dcbf49640 1 -- 172.21.15.16:0/2899976307 shutdown_connections 2024-08-01T06:47:32.728 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.976+0000 7f2dcbf49640 1 --2- 172.21.15.16:0/2899976307 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f2db00386f0 0x7f2db003abb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:32.728 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.976+0000 7f2dcbf49640 1 --2- 172.21.15.16:0/2899976307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc407be70 0x7f2dc419b4f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:32.728 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.976+0000 7f2dcbf49640 1 -- 172.21.15.16:0/2899976307 >> 172.21.15.16:0/2899976307 conn(0x7f2dc4100d80 msgr2=0x7f2dc4101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:32.728 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.976+0000 7f2dcbf49640 1 -- 172.21.15.16:0/2899976307 shutdown_connections 2024-08-01T06:47:32.728 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:31.976+0000 7f2dcbf49640 1 -- 172.21.15.16:0/2899976307 wait complete. 2024-08-01T06:47:32.728 INFO:teuthology.orchestra.run.smithi016.stdout:Fetching dashboard port number... 2024-08-01T06:47:33.323 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:32 smithi016 ceph-mon[29266]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:47:33.323 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:32 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:33.879 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stdout 8443 2024-08-01T06:47:33.879 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.140+0000 7f01dbde6640 1 Processor -- start 2024-08-01T06:47:33.880 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.140+0000 7f01dbde6640 1 -- start start 2024-08-01T06:47:33.880 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.140+0000 7f01dbde6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01d41060d0 0x7f01d41084c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:33.880 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.141+0000 7f01dbde6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d4079e20 con 0x7f01d41060d0 2024-08-01T06:47:33.880 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.141+0000 7f01d9b82640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01d41060d0 0x7f01d41084c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:33.880 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.141+0000 7f01d9b82640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01d41060d0 0x7f01d41084c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38208/0 (socket says 172.21.15.16:38208) 2024-08-01T06:47:33.880 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.141+0000 7f01d9b82640 1 -- 172.21.15.16:0/2817360168 learned_addr learned my addr 172.21.15.16:0/2817360168 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:33.880 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.141+0000 7f01d9b82640 1 -- 172.21.15.16:0/2817360168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d4108a00 con 0x7f01d41060d0 2024-08-01T06:47:33.880 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.142+0000 7f01d9b82640 1 --2- 172.21.15.16:0/2817360168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01d41060d0 0x7f01d41084c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009820 tx=0x7f01cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a286eac408a874 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:33.880 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.142+0000 7f01d8b80640 1 -- 172.21.15.16:0/2817360168 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01cc02ad40 con 0x7f01d41060d0 2024-08-01T06:47:33.880 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.142+0000 7f01d8b80640 1 -- 172.21.15.16:0/2817360168 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f01cc032900 con 0x7f01d41060d0 2024-08-01T06:47:33.880 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.142+0000 7f01d8b80640 1 -- 172.21.15.16:0/2817360168 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01cc030860 con 0x7f01d41060d0 2024-08-01T06:47:33.880 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.142+0000 7f01dbde6640 1 -- 172.21.15.16:0/2817360168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01d41060d0 msgr2=0x7f01d41084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:33.881 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.142+0000 7f01dbde6640 1 --2- 172.21.15.16:0/2817360168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01d41060d0 0x7f01d41084c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009820 tx=0x7f01cc02a270 comp rx=0 tx=0).stop 2024-08-01T06:47:33.881 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.142+0000 7f01dbde6640 1 -- 172.21.15.16:0/2817360168 shutdown_connections 2024-08-01T06:47:33.881 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.142+0000 7f01dbde6640 1 --2- 172.21.15.16:0/2817360168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01d41060d0 0x7f01d41084c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:33.881 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.142+0000 7f01dbde6640 1 -- 172.21.15.16:0/2817360168 >> 172.21.15.16:0/2817360168 conn(0x7f01d40ffc50 msgr2=0x7f01d41020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:33.881 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.143+0000 7f01dbde6640 1 -- 172.21.15.16:0/2817360168 shutdown_connections 2024-08-01T06:47:33.881 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.143+0000 7f01dbde6640 1 -- 172.21.15.16:0/2817360168 wait complete. 2024-08-01T06:47:33.881 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.143+0000 7f01dbde6640 1 Processor -- start 2024-08-01T06:47:33.881 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.143+0000 7f01dbde6640 1 -- start start 2024-08-01T06:47:33.881 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.143+0000 7f01dbde6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01d41060d0 0x7f01d4105950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:33.881 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.143+0000 7f01dbde6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d4105e90 con 0x7f01d41060d0 2024-08-01T06:47:33.881 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.143+0000 7f01d9b82640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01d41060d0 0x7f01d4105950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:33.881 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.143+0000 7f01d9b82640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01d41060d0 0x7f01d4105950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38220/0 (socket says 172.21.15.16:38220) 2024-08-01T06:47:33.882 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.143+0000 7f01d9b82640 1 -- 172.21.15.16:0/315708253 learned_addr learned my addr 172.21.15.16:0/315708253 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:33.882 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.144+0000 7f01d9b82640 1 -- 172.21.15.16:0/315708253 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc0094d0 con 0x7f01d41060d0 2024-08-01T06:47:33.882 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.144+0000 7f01d9b82640 1 --2- 172.21.15.16:0/315708253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01d41060d0 0x7f01d4105950 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f01cc032670 tx=0x7f01cc0326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:33.882 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.144+0000 7f01d2ffd640 1 -- 172.21.15.16:0/315708253 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01cc032c80 con 0x7f01d41060d0 2024-08-01T06:47:33.882 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.144+0000 7f01d2ffd640 1 -- 172.21.15.16:0/315708253 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f01cc032de0 con 0x7f01d41060d0 2024-08-01T06:47:33.882 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.144+0000 7f01dbde6640 1 -- 172.21.15.16:0/315708253 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d4104080 con 0x7f01d41060d0 2024-08-01T06:47:33.882 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.144+0000 7f01d2ffd640 1 -- 172.21.15.16:0/315708253 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01cc03a720 con 0x7f01d41060d0 2024-08-01T06:47:33.882 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.144+0000 7f01dbde6640 1 -- 172.21.15.16:0/315708253 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d4104520 con 0x7f01d41060d0 2024-08-01T06:47:33.882 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.145+0000 7f01d2ffd640 1 -- 172.21.15.16:0/315708253 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f01cc03c400 con 0x7f01d41060d0 2024-08-01T06:47:33.882 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.145+0000 7f01dbde6640 1 -- 172.21.15.16:0/315708253 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d41097b0 con 0x7f01d41060d0 2024-08-01T06:47:33.882 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.145+0000 7f01d2ffd640 1 --2- 172.21.15.16:0/315708253 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f01bc0386a0 0x7f01bc03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:33.882 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.145+0000 7f01d2ffd640 1 -- 172.21.15.16:0/315708253 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f01cc06bb00 con 0x7f01d41060d0 2024-08-01T06:47:33.883 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.145+0000 7f01d9381640 1 --2- 172.21.15.16:0/315708253 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f01bc0386a0 0x7f01bc03ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:33.883 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.146+0000 7f01d9381640 1 --2- 172.21.15.16:0/315708253 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f01bc0386a0 0x7f01bc03ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f01c80098c0 tx=0x7f01c8006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:33.883 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.150+0000 7f01d2ffd640 1 -- 172.21.15.16:0/315708253 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f01cc031b40 con 0x7f01d41060d0 2024-08-01T06:47:33.883 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.321+0000 7f01dbde6640 1 -- 172.21.15.16:0/315708253 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f01d4104a10 con 0x7f01d41060d0 2024-08-01T06:47:33.883 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.322+0000 7f01d2ffd640 1 -- 172.21.15.16:0/315708253 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f01cc031b40 con 0x7f01d41060d0 2024-08-01T06:47:33.883 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.324+0000 7f01dbde6640 1 -- 172.21.15.16:0/315708253 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f01bc0386a0 msgr2=0x7f01bc03ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:33.883 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.324+0000 7f01dbde6640 1 --2- 172.21.15.16:0/315708253 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f01bc0386a0 0x7f01bc03ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f01c80098c0 tx=0x7f01c8006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:33.883 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.324+0000 7f01dbde6640 1 -- 172.21.15.16:0/315708253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01d41060d0 msgr2=0x7f01d4105950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:33.883 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.324+0000 7f01dbde6640 1 --2- 172.21.15.16:0/315708253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01d41060d0 0x7f01d4105950 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f01cc032670 tx=0x7f01cc0326a0 comp rx=0 tx=0).stop 2024-08-01T06:47:33.883 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.324+0000 7f01dbde6640 1 -- 172.21.15.16:0/315708253 shutdown_connections 2024-08-01T06:47:33.883 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.324+0000 7f01dbde6640 1 --2- 172.21.15.16:0/315708253 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f01bc0386a0 0x7f01bc03ab60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:33.883 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.324+0000 7f01dbde6640 1 --2- 172.21.15.16:0/315708253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01d41060d0 0x7f01d4105950 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:33.883 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.324+0000 7f01dbde6640 1 -- 172.21.15.16:0/315708253 >> 172.21.15.16:0/315708253 conn(0x7f01d40ffc50 msgr2=0x7f01d4100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:33.884 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.324+0000 7f01dbde6640 1 -- 172.21.15.16:0/315708253 shutdown_connections 2024-08-01T06:47:33.884 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:33.324+0000 7f01dbde6640 1 -- 172.21.15.16:0/315708253 wait complete. 2024-08-01T06:47:33.887 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-01T06:47:33.887 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout disabled 2024-08-01T06:47:33.895 INFO:teuthology.orchestra.run.smithi016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-01T06:47:33.895 INFO:teuthology.orchestra.run.smithi016.stdout:systemctl: stdout inactive 2024-08-01T06:47:33.895 INFO:teuthology.orchestra.run.smithi016.stdout:firewalld.service is not enabled 2024-08-01T06:47:33.895 INFO:teuthology.orchestra.run.smithi016.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-01T06:47:33.896 INFO:teuthology.orchestra.run.smithi016.stdout:Ceph Dashboard is now available at: 2024-08-01T06:47:33.896 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:47:33.897 INFO:teuthology.orchestra.run.smithi016.stdout: URL: https://smithi016.front.sepia.ceph.com:8443/ 2024-08-01T06:47:33.897 INFO:teuthology.orchestra.run.smithi016.stdout: User: admin 2024-08-01T06:47:33.898 INFO:teuthology.orchestra.run.smithi016.stdout: Password: 2b6djchbq9 2024-08-01T06:47:33.898 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:47:33.898 INFO:teuthology.orchestra.run.smithi016.stdout:Saving cluster configuration to /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config directory 2024-08-01T06:47:33.899 INFO:teuthology.orchestra.run.smithi016.stdout:Enabling autotune for osd_memory_target 2024-08-01T06:47:34.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:33 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/315708253' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-08-01T06:47:35.111 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.391+0000 7fda18380640 1 Processor -- start 2024-08-01T06:47:35.111 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.391+0000 7fda18380640 1 -- start start 2024-08-01T06:47:35.111 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.391+0000 7fda18380640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda1007be70 0x7fda1007a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:35.112 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.391+0000 7fda18380640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1007a8a0 con 0x7fda1007be70 2024-08-01T06:47:35.112 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.391+0000 7fda1611c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda1007be70 0x7fda1007a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:35.112 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.391+0000 7fda1611c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda1007be70 0x7fda1007a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38230/0 (socket says 172.21.15.16:38230) 2024-08-01T06:47:35.112 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.391+0000 7fda1611c640 1 -- 172.21.15.16:0/1074267028 learned_addr learned my addr 172.21.15.16:0/1074267028 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:35.112 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.392+0000 7fda1611c640 1 -- 172.21.15.16:0/1074267028 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1007a9e0 con 0x7fda1007be70 2024-08-01T06:47:35.112 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.392+0000 7fda1611c640 1 --2- 172.21.15.16:0/1074267028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda1007be70 0x7fda1007a2d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009820 tx=0x7fda0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b196cf93841608 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:35.112 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.392+0000 7fda1511a640 1 -- 172.21.15.16:0/1074267028 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda0c02ad40 con 0x7fda1007be70 2024-08-01T06:47:35.112 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.393+0000 7fda1511a640 1 -- 172.21.15.16:0/1074267028 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda0c032900 con 0x7fda1007be70 2024-08-01T06:47:35.112 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.393+0000 7fda1511a640 1 -- 172.21.15.16:0/1074267028 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda0c030860 con 0x7fda1007be70 2024-08-01T06:47:35.112 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.393+0000 7fda18380640 1 -- 172.21.15.16:0/1074267028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda1007be70 msgr2=0x7fda1007a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:35.113 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.393+0000 7fda18380640 1 --2- 172.21.15.16:0/1074267028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda1007be70 0x7fda1007a2d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009820 tx=0x7fda0c02a270 comp rx=0 tx=0).stop 2024-08-01T06:47:35.113 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.393+0000 7fda18380640 1 -- 172.21.15.16:0/1074267028 shutdown_connections 2024-08-01T06:47:35.113 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.393+0000 7fda18380640 1 --2- 172.21.15.16:0/1074267028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda1007be70 0x7fda1007a2d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:35.113 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.393+0000 7fda18380640 1 -- 172.21.15.16:0/1074267028 >> 172.21.15.16:0/1074267028 conn(0x7fda10100d70 msgr2=0x7fda10103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:35.113 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.393+0000 7fda18380640 1 -- 172.21.15.16:0/1074267028 shutdown_connections 2024-08-01T06:47:35.113 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.393+0000 7fda18380640 1 -- 172.21.15.16:0/1074267028 wait complete. 2024-08-01T06:47:35.113 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.394+0000 7fda18380640 1 Processor -- start 2024-08-01T06:47:35.113 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.394+0000 7fda18380640 1 -- start start 2024-08-01T06:47:35.113 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.394+0000 7fda18380640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda1007be70 0x7fda1019b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:35.113 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.394+0000 7fda18380640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1019ba40 con 0x7fda1007be70 2024-08-01T06:47:35.113 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.394+0000 7fda1611c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda1007be70 0x7fda1019b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:35.113 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.394+0000 7fda1611c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda1007be70 0x7fda1019b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38240/0 (socket says 172.21.15.16:38240) 2024-08-01T06:47:35.114 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.394+0000 7fda1611c640 1 -- 172.21.15.16:0/605179903 learned_addr learned my addr 172.21.15.16:0/605179903 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:35.114 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.395+0000 7fda1611c640 1 -- 172.21.15.16:0/605179903 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c0094d0 con 0x7fda1007be70 2024-08-01T06:47:35.114 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.395+0000 7fda1611c640 1 --2- 172.21.15.16:0/605179903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda1007be70 0x7fda1019b500 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0097f0 tx=0x7fda0c030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:35.114 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.395+0000 7fda077fe640 1 -- 172.21.15.16:0/605179903 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda0c040070 con 0x7fda1007be70 2024-08-01T06:47:35.114 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.395+0000 7fda077fe640 1 -- 172.21.15.16:0/605179903 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda0c032dd0 con 0x7fda1007be70 2024-08-01T06:47:35.114 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.395+0000 7fda18380640 1 -- 172.21.15.16:0/605179903 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1019bc40 con 0x7fda1007be70 2024-08-01T06:47:35.114 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.395+0000 7fda077fe640 1 -- 172.21.15.16:0/605179903 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda0c03a790 con 0x7fda1007be70 2024-08-01T06:47:35.114 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.395+0000 7fda18380640 1 -- 172.21.15.16:0/605179903 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1019c0e0 con 0x7fda1007be70 2024-08-01T06:47:35.114 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.396+0000 7fda077fe640 1 -- 172.21.15.16:0/605179903 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fda0c03a8f0 con 0x7fda1007be70 2024-08-01T06:47:35.114 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.396+0000 7fda077fe640 1 --2- 172.21.15.16:0/605179903 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fd9fc038790 0x7fd9fc03ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:35.115 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.396+0000 7fda077fe640 1 -- 172.21.15.16:0/605179903 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fda0c06b880 con 0x7fda1007be70 2024-08-01T06:47:35.115 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.396+0000 7fda18380640 1 -- 172.21.15.16:0/605179903 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1010b9a0 con 0x7fda1007be70 2024-08-01T06:47:35.115 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.396+0000 7fda1591b640 1 --2- 172.21.15.16:0/605179903 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fd9fc038790 0x7fd9fc03ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:35.115 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.397+0000 7fda1591b640 1 --2- 172.21.15.16:0/605179903 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fd9fc038790 0x7fd9fc03ac50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fda000098c0 tx=0x7fda00006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:35.115 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.401+0000 7fda077fe640 1 -- 172.21.15.16:0/605179903 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fda0c039b90 con 0x7fda1007be70 2024-08-01T06:47:35.115 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.573+0000 7fda18380640 1 -- 172.21.15.16:0/605179903 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fda1019ea20 con 0x7fda1007be70 2024-08-01T06:47:35.115 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.574+0000 7fda077fe640 1 -- 172.21.15.16:0/605179903 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fda0c067020 con 0x7fda1007be70 2024-08-01T06:47:35.115 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.576+0000 7fda18380640 1 -- 172.21.15.16:0/605179903 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fd9fc038790 msgr2=0x7fd9fc03ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:35.115 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.576+0000 7fda18380640 1 --2- 172.21.15.16:0/605179903 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fd9fc038790 0x7fd9fc03ac50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fda000098c0 tx=0x7fda00006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:35.115 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.576+0000 7fda18380640 1 -- 172.21.15.16:0/605179903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda1007be70 msgr2=0x7fda1019b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:35.115 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.576+0000 7fda18380640 1 --2- 172.21.15.16:0/605179903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda1007be70 0x7fda1019b500 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0097f0 tx=0x7fda0c030d50 comp rx=0 tx=0).stop 2024-08-01T06:47:35.116 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.576+0000 7fda18380640 1 -- 172.21.15.16:0/605179903 shutdown_connections 2024-08-01T06:47:35.116 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.576+0000 7fda18380640 1 --2- 172.21.15.16:0/605179903 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fd9fc038790 0x7fd9fc03ac50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:35.116 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.576+0000 7fda18380640 1 --2- 172.21.15.16:0/605179903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda1007be70 0x7fda1019b500 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:35.116 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.576+0000 7fda18380640 1 -- 172.21.15.16:0/605179903 >> 172.21.15.16:0/605179903 conn(0x7fda10100d70 msgr2=0x7fda10101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:35.116 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.576+0000 7fda18380640 1 -- 172.21.15.16:0/605179903 shutdown_connections 2024-08-01T06:47:35.116 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:34.576+0000 7fda18380640 1 -- 172.21.15.16:0/605179903 wait complete. 2024-08-01T06:47:35.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:34 smithi016 ceph-mon[29266]: mgrmap e13: smithi016.whigbo(active, since 6s) 2024-08-01T06:47:36.353 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.556+0000 7f6ae0baf640 1 Processor -- start 2024-08-01T06:47:36.353 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.556+0000 7f6ae0baf640 1 -- start start 2024-08-01T06:47:36.353 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.556+0000 7f6ae0baf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6adc1044e0 0x7f6adc1048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:36.353 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.556+0000 7f6ae0baf640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc104eb0 con 0x7f6adc1044e0 2024-08-01T06:47:36.353 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.557+0000 7f6ada59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6adc1044e0 0x7f6adc1048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:36.353 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.557+0000 7f6ada59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6adc1044e0 0x7f6adc1048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38246/0 (socket says 172.21.15.16:38246) 2024-08-01T06:47:36.353 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.557+0000 7f6ada59c640 1 -- 172.21.15.16:0/197333509 learned_addr learned my addr 172.21.15.16:0/197333509 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:36.354 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.557+0000 7f6ada59c640 1 -- 172.21.15.16:0/197333509 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc1056e0 con 0x7f6adc1044e0 2024-08-01T06:47:36.354 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.558+0000 7f6ada59c640 1 --2- 172.21.15.16:0/197333509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6adc1044e0 0x7f6adc1048e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009e80 tx=0x7f6acc02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5377d22e7162e41 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:36.354 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.558+0000 7f6ad959a640 1 -- 172.21.15.16:0/197333509 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6acc031400 con 0x7f6adc1044e0 2024-08-01T06:47:36.354 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.558+0000 7f6ad959a640 1 -- 172.21.15.16:0/197333509 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6acc02d050 con 0x7f6adc1044e0 2024-08-01T06:47:36.354 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.558+0000 7f6ad959a640 1 -- 172.21.15.16:0/197333509 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6acc007930 con 0x7f6adc1044e0 2024-08-01T06:47:36.354 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.559+0000 7f6ae0baf640 1 -- 172.21.15.16:0/197333509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6adc1044e0 msgr2=0x7f6adc1048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:36.354 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.559+0000 7f6ae0baf640 1 --2- 172.21.15.16:0/197333509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6adc1044e0 0x7f6adc1048e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009e80 tx=0x7f6acc02a7a0 comp rx=0 tx=0).stop 2024-08-01T06:47:36.354 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.559+0000 7f6ae0baf640 1 -- 172.21.15.16:0/197333509 shutdown_connections 2024-08-01T06:47:36.354 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.559+0000 7f6ae0baf640 1 --2- 172.21.15.16:0/197333509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6adc1044e0 0x7f6adc1048e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:36.355 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.559+0000 7f6ae0baf640 1 -- 172.21.15.16:0/197333509 >> 172.21.15.16:0/197333509 conn(0x7f6adc0ffc50 msgr2=0x7f6adc1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:36.355 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.559+0000 7f6ae0baf640 1 -- 172.21.15.16:0/197333509 shutdown_connections 2024-08-01T06:47:36.355 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.559+0000 7f6ae0baf640 1 -- 172.21.15.16:0/197333509 wait complete. 2024-08-01T06:47:36.355 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.559+0000 7f6ae0baf640 1 Processor -- start 2024-08-01T06:47:36.355 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.560+0000 7f6ae0baf640 1 -- start start 2024-08-01T06:47:36.355 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.560+0000 7f6ae0baf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6adc1044e0 0x7f6adc18f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:36.355 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.560+0000 7f6ae0baf640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc18fc50 con 0x7f6adc1044e0 2024-08-01T06:47:36.355 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.560+0000 7f6ada59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6adc1044e0 0x7f6adc18f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:36.355 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.560+0000 7f6ada59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6adc1044e0 0x7f6adc18f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38262/0 (socket says 172.21.15.16:38262) 2024-08-01T06:47:36.355 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.560+0000 7f6ada59c640 1 -- 172.21.15.16:0/3919055238 learned_addr learned my addr 172.21.15.16:0/3919055238 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:36.355 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.560+0000 7f6ada59c640 1 -- 172.21.15.16:0/3919055238 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc009b30 con 0x7f6adc1044e0 2024-08-01T06:47:36.355 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.560+0000 7f6ada59c640 1 --2- 172.21.15.16:0/3919055238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6adc1044e0 0x7f6adc18f710 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6acc02acc0 tx=0x7f6acc0319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:36.356 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.560+0000 7f6ad37fe640 1 -- 172.21.15.16:0/3919055238 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6acc03a550 con 0x7f6adc1044e0 2024-08-01T06:47:36.356 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.560+0000 7f6ad37fe640 1 -- 172.21.15.16:0/3919055238 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6acc03ab70 con 0x7f6adc1044e0 2024-08-01T06:47:36.356 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.560+0000 7f6ad37fe640 1 -- 172.21.15.16:0/3919055238 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6acc039b20 con 0x7f6adc1044e0 2024-08-01T06:47:36.356 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.560+0000 7f6ae0baf640 1 -- 172.21.15.16:0/3919055238 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6adc18de40 con 0x7f6adc1044e0 2024-08-01T06:47:36.356 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.561+0000 7f6ae0baf640 1 -- 172.21.15.16:0/3919055238 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6adc18e2e0 con 0x7f6adc1044e0 2024-08-01T06:47:36.356 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.561+0000 7f6ad37fe640 1 -- 172.21.15.16:0/3919055238 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f6acc038040 con 0x7f6adc1044e0 2024-08-01T06:47:36.356 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.562+0000 7f6ad37fe640 1 --2- 172.21.15.16:0/3919055238 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f6ac8038790 0x7f6ac803ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:36.356 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.562+0000 7f6ae0baf640 1 -- 172.21.15.16:0/3919055238 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6adc104960 con 0x7f6adc1044e0 2024-08-01T06:47:36.356 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.562+0000 7f6ad37fe640 1 -- 172.21.15.16:0/3919055238 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6acc06baf0 con 0x7f6adc1044e0 2024-08-01T06:47:36.356 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.562+0000 7f6ad9d9b640 1 --2- 172.21.15.16:0/3919055238 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f6ac8038790 0x7f6ac803ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:36.357 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.562+0000 7f6ad9d9b640 1 --2- 172.21.15.16:0/3919055238 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f6ac8038790 0x7f6ac803ac50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40098c0 tx=0x7f6ac4006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:36.357 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.566+0000 7f6ad37fe640 1 -- 172.21.15.16:0/3919055238 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f6acc041070 con 0x7f6adc1044e0 2024-08-01T06:47:36.357 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.826+0000 7f6ae0baf640 1 -- 172.21.15.16:0/3919055238 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f6adc108910 con 0x7f6adc1044e0 2024-08-01T06:47:36.357 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.829+0000 7f6ad37fe640 1 -- 172.21.15.16:0/3919055238 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f6acc045400 con 0x7f6adc1044e0 2024-08-01T06:47:36.358 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-01T06:47:36.358 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.831+0000 7f6ae0baf640 1 -- 172.21.15.16:0/3919055238 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f6ac8038790 msgr2=0x7f6ac803ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:36.358 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.831+0000 7f6ae0baf640 1 --2- 172.21.15.16:0/3919055238 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f6ac8038790 0x7f6ac803ac50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40098c0 tx=0x7f6ac4006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:36.358 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.831+0000 7f6ae0baf640 1 -- 172.21.15.16:0/3919055238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6adc1044e0 msgr2=0x7f6adc18f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:36.358 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.831+0000 7f6ae0baf640 1 --2- 172.21.15.16:0/3919055238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6adc1044e0 0x7f6adc18f710 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6acc02acc0 tx=0x7f6acc0319a0 comp rx=0 tx=0).stop 2024-08-01T06:47:36.359 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.831+0000 7f6ae0baf640 1 -- 172.21.15.16:0/3919055238 shutdown_connections 2024-08-01T06:47:36.359 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.831+0000 7f6ae0baf640 1 --2- 172.21.15.16:0/3919055238 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f6ac8038790 0x7f6ac803ac50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:36.359 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.831+0000 7f6ae0baf640 1 --2- 172.21.15.16:0/3919055238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6adc1044e0 0x7f6adc18f710 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:36.359 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.831+0000 7f6ae0baf640 1 -- 172.21.15.16:0/3919055238 >> 172.21.15.16:0/3919055238 conn(0x7f6adc0ffc50 msgr2=0x7f6adc100b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:36.359 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.831+0000 7f6ae0baf640 1 -- 172.21.15.16:0/3919055238 shutdown_connections 2024-08-01T06:47:36.359 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/ceph: stderr 2024-08-01T06:47:35.831+0000 7f6ae0baf640 1 -- 172.21.15.16:0/3919055238 wait complete. 2024-08-01T06:47:36.359 INFO:teuthology.orchestra.run.smithi016.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-01T06:47:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:47:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-01T06:47:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:47:36.360 INFO:teuthology.orchestra.run.smithi016.stdout:Or, if you are only running a single cluster on this host: 2024-08-01T06:47:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:47:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-01T06:47:36.361 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:47:36.361 INFO:teuthology.orchestra.run.smithi016.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-01T06:47:36.361 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:47:36.361 INFO:teuthology.orchestra.run.smithi016.stdout: ceph telemetry on 2024-08-01T06:47:36.361 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:47:36.362 INFO:teuthology.orchestra.run.smithi016.stdout:For more information see: 2024-08-01T06:47:36.362 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:47:36.362 INFO:teuthology.orchestra.run.smithi016.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-08-01T06:47:36.362 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:47:36.362 INFO:teuthology.orchestra.run.smithi016.stdout:Bootstrap complete. 2024-08-01T06:47:36.384 INFO:tasks.cephadm:Fetching config... 2024-08-01T06:47:36.384 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-08-01T06:47:36.384 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-01T06:47:36.442 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-01T06:47:36.442 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-08-01T06:47:36.442 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-01T06:47:36.498 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-01T06:47:36.499 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-08-01T06:47:36.499 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/keyring of=/dev/stdout 2024-08-01T06:47:36.564 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-01T06:47:36.565 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-08-01T06:47:36.565 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-01T06:47:36.620 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-01T06:47:36.621 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSAFcFQJHGyOVjCDe10zU9KJnOWr2LKItN8sZCXDmRmVSJf6x00PciSW1J2Zm1z5dyuCFQNrsQA+0iTl0QXTzow6z8sdyYe1n5mpW5UieFAfGwZ1G23VRah6ktgsQATubkihw4FJeZKnhcQ17sBslku3vDKtSRITD+h45Zp18AfngRRL/cYAGtLGPGkXViCzxWtV+G9A1c622gYYAhDOEldKSWZh1hY9/BC2pt+hLvMi188ijCV3ZfC8kLs0VVZHGL78d7fsOf85X0QXVD7fOOxKAUqpXYOlR36lj2ynWLe47hAkOwixWRCws7pd7MxV3rKv/q6T5M5GdKok2YCa4KV5z93Q30qWO3EHhJCCuM7iHx2VF2zcguvwGHSjp7IwRyquvqW3+3C1jXHP+zypCVfB9SwgVf3hXphOF0bfD8DFxpvA3brgp2APFG3MgT8w9RAHP+Mlc0vLemUiLuywbD+jM8ZCNugpwZ0xeT0w211/OoqDpnTJvAbZcqo11RVss= ceph-a88427da-4fd1-11ef-bcca-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-01T06:47:36.697 INFO:teuthology.orchestra.run.smithi016.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSAFcFQJHGyOVjCDe10zU9KJnOWr2LKItN8sZCXDmRmVSJf6x00PciSW1J2Zm1z5dyuCFQNrsQA+0iTl0QXTzow6z8sdyYe1n5mpW5UieFAfGwZ1G23VRah6ktgsQATubkihw4FJeZKnhcQ17sBslku3vDKtSRITD+h45Zp18AfngRRL/cYAGtLGPGkXViCzxWtV+G9A1c622gYYAhDOEldKSWZh1hY9/BC2pt+hLvMi188ijCV3ZfC8kLs0VVZHGL78d7fsOf85X0QXVD7fOOxKAUqpXYOlR36lj2ynWLe47hAkOwixWRCws7pd7MxV3rKv/q6T5M5GdKok2YCa4KV5z93Q30qWO3EHhJCCuM7iHx2VF2zcguvwGHSjp7IwRyquvqW3+3C1jXHP+zypCVfB9SwgVf3hXphOF0bfD8DFxpvA3brgp2APFG3MgT8w9RAHP+Mlc0vLemUiLuywbD+jM8ZCNugpwZ0xeT0w211/OoqDpnTJvAbZcqo11RVss= ceph-a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:47:36.708 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSAFcFQJHGyOVjCDe10zU9KJnOWr2LKItN8sZCXDmRmVSJf6x00PciSW1J2Zm1z5dyuCFQNrsQA+0iTl0QXTzow6z8sdyYe1n5mpW5UieFAfGwZ1G23VRah6ktgsQATubkihw4FJeZKnhcQ17sBslku3vDKtSRITD+h45Zp18AfngRRL/cYAGtLGPGkXViCzxWtV+G9A1c622gYYAhDOEldKSWZh1hY9/BC2pt+hLvMi188ijCV3ZfC8kLs0VVZHGL78d7fsOf85X0QXVD7fOOxKAUqpXYOlR36lj2ynWLe47hAkOwixWRCws7pd7MxV3rKv/q6T5M5GdKok2YCa4KV5z93Q30qWO3EHhJCCuM7iHx2VF2zcguvwGHSjp7IwRyquvqW3+3C1jXHP+zypCVfB9SwgVf3hXphOF0bfD8DFxpvA3brgp2APFG3MgT8w9RAHP+Mlc0vLemUiLuywbD+jM8ZCNugpwZ0xeT0w211/OoqDpnTJvAbZcqo11RVss= ceph-a88427da-4fd1-11ef-bcca-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-01T06:47:36.749 INFO:teuthology.orchestra.run.smithi089.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSAFcFQJHGyOVjCDe10zU9KJnOWr2LKItN8sZCXDmRmVSJf6x00PciSW1J2Zm1z5dyuCFQNrsQA+0iTl0QXTzow6z8sdyYe1n5mpW5UieFAfGwZ1G23VRah6ktgsQATubkihw4FJeZKnhcQ17sBslku3vDKtSRITD+h45Zp18AfngRRL/cYAGtLGPGkXViCzxWtV+G9A1c622gYYAhDOEldKSWZh1hY9/BC2pt+hLvMi188ijCV3ZfC8kLs0VVZHGL78d7fsOf85X0QXVD7fOOxKAUqpXYOlR36lj2ynWLe47hAkOwixWRCws7pd7MxV3rKv/q6T5M5GdKok2YCa4KV5z93Q30qWO3EHhJCCuM7iHx2VF2zcguvwGHSjp7IwRyquvqW3+3C1jXHP+zypCVfB9SwgVf3hXphOF0bfD8DFxpvA3brgp2APFG3MgT8w9RAHP+Mlc0vLemUiLuywbD+jM8ZCNugpwZ0xeT0w211/OoqDpnTJvAbZcqo11RVss= ceph-a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:47:36.762 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-01T06:47:36.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:36 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3919055238' entity='client.admin' 2024-08-01T06:47:36.968 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:47:39.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.305+0000 7fc44fb0d640 1 -- 172.21.15.16:0/784473705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4480fe070 msgr2=0x7fc4480fe470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:39.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.305+0000 7fc44fb0d640 1 --2- 172.21.15.16:0/784473705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4480fe070 0x7fc4480fe470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009880 tx=0x7fc43c02a5d0 comp rx=0 tx=0).stop 2024-08-01T06:47:39.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.305+0000 7fc44fb0d640 1 -- 172.21.15.16:0/784473705 shutdown_connections 2024-08-01T06:47:39.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.305+0000 7fc44fb0d640 1 --2- 172.21.15.16:0/784473705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4480fe070 0x7fc4480fe470 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:39.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.305+0000 7fc44fb0d640 1 -- 172.21.15.16:0/784473705 >> 172.21.15.16:0/784473705 conn(0x7fc4480f9e80 msgr2=0x7fc4480fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:39.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.306+0000 7fc44fb0d640 1 -- 172.21.15.16:0/784473705 shutdown_connections 2024-08-01T06:47:39.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.306+0000 7fc44fb0d640 1 -- 172.21.15.16:0/784473705 wait complete. 2024-08-01T06:47:39.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.306+0000 7fc44fb0d640 1 Processor -- start 2024-08-01T06:47:39.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.306+0000 7fc44fb0d640 1 -- start start 2024-08-01T06:47:39.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.306+0000 7fc44fb0d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4480fe070 0x7fc448196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:39.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.306+0000 7fc44fb0d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc448197400 con 0x7fc4480fe070 2024-08-01T06:47:39.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.307+0000 7fc44d8a9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4480fe070 0x7fc448196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:39.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.307+0000 7fc44d8a9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4480fe070 0x7fc448196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45096/0 (socket says 172.21.15.16:45096) 2024-08-01T06:47:39.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.307+0000 7fc44d8a9640 1 -- 172.21.15.16:0/2526724276 learned_addr learned my addr 172.21.15.16:0/2526724276 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:39.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.307+0000 7fc44d8a9640 1 -- 172.21.15.16:0/2526724276 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c009560 con 0x7fc4480fe070 2024-08-01T06:47:39.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.307+0000 7fc44d8a9640 1 --2- 172.21.15.16:0/2526724276 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4480fe070 0x7fc448196ec0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc43c006010 tx=0x7fc43c005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:39.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.307+0000 7fc43affd640 1 -- 172.21.15.16:0/2526724276 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc43c004aa0 con 0x7fc4480fe070 2024-08-01T06:47:39.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.307+0000 7fc43affd640 1 -- 172.21.15.16:0/2526724276 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc43c004c00 con 0x7fc4480fe070 2024-08-01T06:47:39.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.307+0000 7fc44fb0d640 1 -- 172.21.15.16:0/2526724276 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc448197600 con 0x7fc4480fe070 2024-08-01T06:47:39.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.307+0000 7fc43affd640 1 -- 172.21.15.16:0/2526724276 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc43c031a80 con 0x7fc4480fe070 2024-08-01T06:47:39.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.307+0000 7fc44fb0d640 1 -- 172.21.15.16:0/2526724276 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc448197aa0 con 0x7fc4480fe070 2024-08-01T06:47:39.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.308+0000 7fc43affd640 1 -- 172.21.15.16:0/2526724276 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fc43c031cf0 con 0x7fc4480fe070 2024-08-01T06:47:39.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.308+0000 7fc44fb0d640 1 -- 172.21.15.16:0/2526724276 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4480fe470 con 0x7fc4480fe070 2024-08-01T06:47:39.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.308+0000 7fc43affd640 1 --2- 172.21.15.16:0/2526724276 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fc434038790 0x7fc43403ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:39.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.308+0000 7fc43affd640 1 -- 172.21.15.16:0/2526724276 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc43c06c4a0 con 0x7fc4480fe070 2024-08-01T06:47:39.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.308+0000 7fc44d0a8640 1 --2- 172.21.15.16:0/2526724276 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fc434038790 0x7fc43403ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:39.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.309+0000 7fc44d0a8640 1 --2- 172.21.15.16:0/2526724276 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fc434038790 0x7fc43403ac50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc4440098c0 tx=0x7fc444006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:39.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.313+0000 7fc43affd640 1 -- 172.21.15.16:0/2526724276 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fc43c04d9a0 con 0x7fc4480fe070 2024-08-01T06:47:39.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.487+0000 7fc44fb0d640 1 -- 172.21.15.16:0/2526724276 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fc448107b60 con 0x7fc4480fe070 2024-08-01T06:47:39.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.491+0000 7fc43affd640 1 -- 172.21.15.16:0/2526724276 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fc43c035020 con 0x7fc4480fe070 2024-08-01T06:47:39.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.493+0000 7fc44fb0d640 1 -- 172.21.15.16:0/2526724276 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fc434038790 msgr2=0x7fc43403ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:39.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.493+0000 7fc44fb0d640 1 --2- 172.21.15.16:0/2526724276 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fc434038790 0x7fc43403ac50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc4440098c0 tx=0x7fc444006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:39.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.493+0000 7fc44fb0d640 1 -- 172.21.15.16:0/2526724276 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4480fe070 msgr2=0x7fc448196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:39.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.493+0000 7fc44fb0d640 1 --2- 172.21.15.16:0/2526724276 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4480fe070 0x7fc448196ec0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc43c006010 tx=0x7fc43c005630 comp rx=0 tx=0).stop 2024-08-01T06:47:39.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.493+0000 7fc44fb0d640 1 -- 172.21.15.16:0/2526724276 shutdown_connections 2024-08-01T06:47:39.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.493+0000 7fc44fb0d640 1 --2- 172.21.15.16:0/2526724276 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fc434038790 0x7fc43403ac50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:39.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.493+0000 7fc44fb0d640 1 --2- 172.21.15.16:0/2526724276 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4480fe070 0x7fc448196ec0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:39.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.493+0000 7fc44fb0d640 1 -- 172.21.15.16:0/2526724276 >> 172.21.15.16:0/2526724276 conn(0x7fc4480f9e80 msgr2=0x7fc4480fa8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:39.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.493+0000 7fc44fb0d640 1 -- 172.21.15.16:0/2526724276 shutdown_connections 2024-08-01T06:47:39.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:39.494+0000 7fc44fb0d640 1 -- 172.21.15.16:0/2526724276 wait complete. 2024-08-01T06:47:39.836 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:39 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:39.836 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:39 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:39.836 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:39 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:47:39.836 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:39 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:39.836 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:39 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi016", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-01T06:47:39.836 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:39 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi016", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-08-01T06:47:39.836 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:39 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:47:39.836 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:39 smithi016 ceph-mon[29266]: Deploying daemon ceph-exporter.smithi016 on smithi016 2024-08-01T06:47:39.836 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:39 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/2526724276' entity='client.admin' 2024-08-01T06:47:40.548 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-01T06:47:40.549 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-01T06:47:40.762 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:47:43.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.170+0000 7f068e015640 1 -- 172.21.15.16:0/2028714959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06880ff7e0 msgr2=0x7f06880ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:43.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.170+0000 7f068e015640 1 --2- 172.21.15.16:0/2028714959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06880ff7e0 0x7f06880ffbe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0678009880 tx=0x7f067802a5d0 comp rx=0 tx=0).stop 2024-08-01T06:47:43.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.170+0000 7f068e015640 1 -- 172.21.15.16:0/2028714959 shutdown_connections 2024-08-01T06:47:43.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.170+0000 7f068e015640 1 --2- 172.21.15.16:0/2028714959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06880ff7e0 0x7f06880ffbe0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:43.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.170+0000 7f068e015640 1 -- 172.21.15.16:0/2028714959 >> 172.21.15.16:0/2028714959 conn(0x7f06880faf90 msgr2=0x7f06880fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:43.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.170+0000 7f068e015640 1 -- 172.21.15.16:0/2028714959 shutdown_connections 2024-08-01T06:47:43.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.170+0000 7f068e015640 1 -- 172.21.15.16:0/2028714959 wait complete. 2024-08-01T06:47:43.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.170+0000 7f068e015640 1 Processor -- start 2024-08-01T06:47:43.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.171+0000 7f068e015640 1 -- start start 2024-08-01T06:47:43.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.171+0000 7f068e015640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06880ff7e0 0x7f0688074170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:43.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.171+0000 7f068e015640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06880746b0 con 0x7f06880ff7e0 2024-08-01T06:47:43.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.171+0000 7f06877fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06880ff7e0 0x7f0688074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:43.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.171+0000 7f06877fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06880ff7e0 0x7f0688074170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45114/0 (socket says 172.21.15.16:45114) 2024-08-01T06:47:43.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.171+0000 7f06877fe640 1 -- 172.21.15.16:0/3609974568 learned_addr learned my addr 172.21.15.16:0/3609974568 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:43.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.171+0000 7f06877fe640 1 -- 172.21.15.16:0/3609974568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0678009560 con 0x7f06880ff7e0 2024-08-01T06:47:43.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.171+0000 7f06877fe640 1 --2- 172.21.15.16:0/3609974568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06880ff7e0 0x7f0688074170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0678005610 tx=0x7f0678005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:43.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.172+0000 7f0684ff9640 1 -- 172.21.15.16:0/3609974568 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0678004b20 con 0x7f06880ff7e0 2024-08-01T06:47:43.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.172+0000 7f0684ff9640 1 -- 172.21.15.16:0/3609974568 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0678004c80 con 0x7f06880ff7e0 2024-08-01T06:47:43.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.172+0000 7f0684ff9640 1 -- 172.21.15.16:0/3609974568 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0678031a90 con 0x7f06880ff7e0 2024-08-01T06:47:43.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.172+0000 7f068e015640 1 -- 172.21.15.16:0/3609974568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06880728a0 con 0x7f06880ff7e0 2024-08-01T06:47:43.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.172+0000 7f068e015640 1 -- 172.21.15.16:0/3609974568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0688072d40 con 0x7f06880ff7e0 2024-08-01T06:47:43.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.173+0000 7f068e015640 1 -- 172.21.15.16:0/3609974568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0688105fd0 con 0x7f06880ff7e0 2024-08-01T06:47:43.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.173+0000 7f0684ff9640 1 -- 172.21.15.16:0/3609974568 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f0678031d50 con 0x7f06880ff7e0 2024-08-01T06:47:43.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.173+0000 7f0684ff9640 1 --2- 172.21.15.16:0/3609974568 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f0670038740 0x7f067003ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:43.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.173+0000 7f0684ff9640 1 -- 172.21.15.16:0/3609974568 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f067806c780 con 0x7f06880ff7e0 2024-08-01T06:47:43.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.173+0000 7f0686ffd640 1 --2- 172.21.15.16:0/3609974568 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f0670038740 0x7f067003ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:43.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.174+0000 7f0686ffd640 1 --2- 172.21.15.16:0/3609974568 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f0670038740 0x7f067003ac00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f067c0098c0 tx=0x7f067c006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:43.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.182+0000 7f0684ff9640 1 -- 172.21.15.16:0/3609974568 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f067804ddb0 con 0x7f06880ff7e0 2024-08-01T06:47:43.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.363+0000 7f068e015640 1 -- 172.21.15.16:0/3609974568 --> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f068818e0f0 con 0x7f0670038740 2024-08-01T06:47:43.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.366+0000 7f0684ff9640 1 -- 172.21.15.16:0/3609974568 <== mgr.14162 v2:172.21.15.16:6800/3100338993 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f068818e0f0 con 0x7f0670038740 2024-08-01T06:47:43.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.368+0000 7f068e015640 1 -- 172.21.15.16:0/3609974568 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f0670038740 msgr2=0x7f067003ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:43.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.368+0000 7f068e015640 1 --2- 172.21.15.16:0/3609974568 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f0670038740 0x7f067003ac00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f067c0098c0 tx=0x7f067c006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:43.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.368+0000 7f068e015640 1 -- 172.21.15.16:0/3609974568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06880ff7e0 msgr2=0x7f0688074170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:43.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.368+0000 7f068e015640 1 --2- 172.21.15.16:0/3609974568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06880ff7e0 0x7f0688074170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0678005610 tx=0x7f0678005640 comp rx=0 tx=0).stop 2024-08-01T06:47:43.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.368+0000 7f068e015640 1 -- 172.21.15.16:0/3609974568 shutdown_connections 2024-08-01T06:47:43.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.368+0000 7f068e015640 1 --2- 172.21.15.16:0/3609974568 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f0670038740 0x7f067003ac00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:43.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.368+0000 7f068e015640 1 --2- 172.21.15.16:0/3609974568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06880ff7e0 0x7f0688074170 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:43.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.368+0000 7f068e015640 1 -- 172.21.15.16:0/3609974568 >> 172.21.15.16:0/3609974568 conn(0x7f06880faf90 msgr2=0x7f06880fb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:43.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.368+0000 7f068e015640 1 -- 172.21.15.16:0/3609974568 shutdown_connections 2024-08-01T06:47:43.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:43.369+0000 7f068e015640 1 -- 172.21.15.16:0/3609974568 wait complete. 2024-08-01T06:47:44.263 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi089 2024-08-01T06:47:44.263 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-01T06:47:44.263 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/etc/ceph/ceph.conf 2024-08-01T06:47:44.282 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-01T06:47:44.282 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-01T06:47:44.343 INFO:tasks.cephadm:Adding host smithi089 to orchestrator... 2024-08-01T06:47:44.343 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph orch host add smithi089 2024-08-01T06:47:44.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:44 smithi016 ceph-mon[29266]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:47:44.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:44 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:44.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:44 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:44.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:44 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:44.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:44 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:44.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:44 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:44.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:44 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi016", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-01T06:47:44.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:44 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi016", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-08-01T06:47:44.578 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:44 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:47:45.349 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:47:45.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:45 smithi016 ceph-mon[29266]: Deploying daemon crash.smithi016 on smithi016 2024-08-01T06:47:46.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.884+0000 7f1e158c7640 1 -- 172.21.15.16:0/2845596656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e100fe6f0 msgr2=0x7f1e100feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:46.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.884+0000 7f1e158c7640 1 --2- 172.21.15.16:0/2845596656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e100fe6f0 0x7f1e100feaf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1e00009880 tx=0x7f1e0002a5d0 comp rx=0 tx=0).stop 2024-08-01T06:47:46.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.884+0000 7f1e158c7640 1 -- 172.21.15.16:0/2845596656 shutdown_connections 2024-08-01T06:47:46.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.884+0000 7f1e158c7640 1 --2- 172.21.15.16:0/2845596656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e100fe6f0 0x7f1e100feaf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:46.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.884+0000 7f1e158c7640 1 -- 172.21.15.16:0/2845596656 >> 172.21.15.16:0/2845596656 conn(0x7f1e100f9e80 msgr2=0x7f1e100fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:46.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.884+0000 7f1e158c7640 1 -- 172.21.15.16:0/2845596656 shutdown_connections 2024-08-01T06:47:46.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.884+0000 7f1e158c7640 1 -- 172.21.15.16:0/2845596656 wait complete. 2024-08-01T06:47:46.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.885+0000 7f1e158c7640 1 Processor -- start 2024-08-01T06:47:46.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.885+0000 7f1e158c7640 1 -- start start 2024-08-01T06:47:46.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.885+0000 7f1e158c7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e100fe6f0 0x7f1e100fbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:46.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.885+0000 7f1e158c7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e100fc280 con 0x7f1e100fe6f0 2024-08-01T06:47:46.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.886+0000 7f1e0effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e100fe6f0 0x7f1e100fbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:46.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.886+0000 7f1e0effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e100fe6f0 0x7f1e100fbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45142/0 (socket says 172.21.15.16:45142) 2024-08-01T06:47:46.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.886+0000 7f1e0effd640 1 -- 172.21.15.16:0/3923824498 learned_addr learned my addr 172.21.15.16:0/3923824498 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:46.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.886+0000 7f1e0effd640 1 -- 172.21.15.16:0/3923824498 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e00009560 con 0x7f1e100fe6f0 2024-08-01T06:47:46.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.886+0000 7f1e0effd640 1 --2- 172.21.15.16:0/3923824498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e100fe6f0 0x7f1e100fbd40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1e00005610 tx=0x7f1e00005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:46.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.886+0000 7f1e148c5640 1 -- 172.21.15.16:0/3923824498 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e00004b20 con 0x7f1e100fe6f0 2024-08-01T06:47:46.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.886+0000 7f1e148c5640 1 -- 172.21.15.16:0/3923824498 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e00004c80 con 0x7f1e100fe6f0 2024-08-01T06:47:46.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.886+0000 7f1e158c7640 1 -- 172.21.15.16:0/3923824498 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e100fa470 con 0x7f1e100fe6f0 2024-08-01T06:47:46.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.886+0000 7f1e148c5640 1 -- 172.21.15.16:0/3923824498 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e00031a90 con 0x7f1e100fe6f0 2024-08-01T06:47:46.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.886+0000 7f1e158c7640 1 -- 172.21.15.16:0/3923824498 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e100fa910 con 0x7f1e100fe6f0 2024-08-01T06:47:46.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.887+0000 7f1e148c5640 1 -- 172.21.15.16:0/3923824498 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f1e00031d10 con 0x7f1e100fe6f0 2024-08-01T06:47:46.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.887+0000 7f1e158c7640 1 -- 172.21.15.16:0/3923824498 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e10104ee0 con 0x7f1e100fe6f0 2024-08-01T06:47:46.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.888+0000 7f1e148c5640 1 --2- 172.21.15.16:0/3923824498 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f1df8038740 0x7f1df803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:46.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.888+0000 7f1e148c5640 1 -- 172.21.15.16:0/3923824498 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1e0006c4f0 con 0x7f1e100fe6f0 2024-08-01T06:47:46.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.888+0000 7f1e0e7fc640 1 --2- 172.21.15.16:0/3923824498 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f1df8038740 0x7f1df803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:46.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.888+0000 7f1e0e7fc640 1 --2- 172.21.15.16:0/3923824498 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f1df8038740 0x7f1df803ac00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1e040098c0 tx=0x7f1e04006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:46.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:46.892+0000 7f1e148c5640 1 -- 172.21.15.16:0/3923824498 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f1e00043360 con 0x7f1e100fe6f0 2024-08-01T06:47:47.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:47.069+0000 7f1e158c7640 1 -- 172.21.15.16:0/3923824498 --> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi089", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e1018e260 con 0x7f1df8038740 2024-08-01T06:47:48.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:48 smithi016 ceph-mon[29266]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi089", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:47:48.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:48 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:48.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:48 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:48 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:48 smithi016 ceph-mon[29266]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:47:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:48 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:48 smithi016 ceph-mon[29266]: Deploying daemon node-exporter.smithi016 on smithi016 2024-08-01T06:47:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:48 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:49.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:49 smithi016 ceph-mon[29266]: Deploying cephadm binary to smithi089 2024-08-01T06:47:50.471 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:50 smithi016 ceph-mon[29266]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:47:50.471 INFO:teuthology.orchestra.run.smithi016.stdout:Added host 'smithi089' with addr '172.21.15.89' 2024-08-01T06:47:50.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:50.467+0000 7f1e148c5640 1 -- 172.21.15.16:0/3923824498 <== mgr.14162 v2:172.21.15.16:6800/3100338993 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f1e1018e260 con 0x7f1df8038740 2024-08-01T06:47:50.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:50.470+0000 7f1e158c7640 1 -- 172.21.15.16:0/3923824498 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f1df8038740 msgr2=0x7f1df803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:50.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:50.470+0000 7f1e158c7640 1 --2- 172.21.15.16:0/3923824498 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f1df8038740 0x7f1df803ac00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1e040098c0 tx=0x7f1e04006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:50.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:50.470+0000 7f1e158c7640 1 -- 172.21.15.16:0/3923824498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e100fe6f0 msgr2=0x7f1e100fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:50.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:50.470+0000 7f1e158c7640 1 --2- 172.21.15.16:0/3923824498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e100fe6f0 0x7f1e100fbd40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1e00005610 tx=0x7f1e00005640 comp rx=0 tx=0).stop 2024-08-01T06:47:50.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:50.470+0000 7f1e158c7640 1 -- 172.21.15.16:0/3923824498 shutdown_connections 2024-08-01T06:47:50.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:50.470+0000 7f1e158c7640 1 --2- 172.21.15.16:0/3923824498 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f1df8038740 0x7f1df803ac00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:50.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:50.470+0000 7f1e158c7640 1 --2- 172.21.15.16:0/3923824498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e100fe6f0 0x7f1e100fbd40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:50.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:50.470+0000 7f1e158c7640 1 -- 172.21.15.16:0/3923824498 >> 172.21.15.16:0/3923824498 conn(0x7f1e100f9e80 msgr2=0x7f1e10068360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:50.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:50.470+0000 7f1e158c7640 1 -- 172.21.15.16:0/3923824498 shutdown_connections 2024-08-01T06:47:50.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:50.470+0000 7f1e158c7640 1 -- 172.21.15.16:0/3923824498 wait complete. 2024-08-01T06:47:51.095 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph orch host ls --format=json 2024-08-01T06:47:51.486 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:47:51.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:51 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:51.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:51 smithi016 ceph-mon[29266]: Added host smithi089 2024-08-01T06:47:51.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:51 smithi016 ceph-mon[29266]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:47:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:52 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:52 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:52 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:52 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:52 smithi016 ceph-mon[29266]: Deploying daemon alertmanager.smithi016 on smithi016 2024-08-01T06:47:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:52 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:47:53.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.012+0000 7f18e7e6b640 1 -- 172.21.15.16:0/2089904245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e00fe6d0 msgr2=0x7f18e00fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:53.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.012+0000 7f18e7e6b640 1 --2- 172.21.15.16:0/2089904245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e00fe6d0 0x7f18e00fead0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f18dc009880 tx=0x7f18dc02a5d0 comp rx=0 tx=0).stop 2024-08-01T06:47:53.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.012+0000 7f18e7e6b640 1 -- 172.21.15.16:0/2089904245 shutdown_connections 2024-08-01T06:47:53.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.012+0000 7f18e7e6b640 1 --2- 172.21.15.16:0/2089904245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e00fe6d0 0x7f18e00fead0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:53.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.012+0000 7f18e7e6b640 1 -- 172.21.15.16:0/2089904245 >> 172.21.15.16:0/2089904245 conn(0x7f18e00f9e80 msgr2=0x7f18e00fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:53.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.012+0000 7f18e7e6b640 1 -- 172.21.15.16:0/2089904245 shutdown_connections 2024-08-01T06:47:53.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.012+0000 7f18e7e6b640 1 -- 172.21.15.16:0/2089904245 wait complete. 2024-08-01T06:47:53.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.013+0000 7f18e7e6b640 1 Processor -- start 2024-08-01T06:47:53.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.013+0000 7f18e7e6b640 1 -- start start 2024-08-01T06:47:53.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.013+0000 7f18e7e6b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e00fe6d0 0x7f18e00fbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:53.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.013+0000 7f18e7e6b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00fc230 con 0x7f18e00fe6d0 2024-08-01T06:47:53.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.013+0000 7f18e5c07640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e00fe6d0 0x7f18e00fbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:53.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.013+0000 7f18e5c07640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e00fe6d0 0x7f18e00fbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44362/0 (socket says 172.21.15.16:44362) 2024-08-01T06:47:53.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.013+0000 7f18e5c07640 1 -- 172.21.15.16:0/2289030370 learned_addr learned my addr 172.21.15.16:0/2289030370 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:53.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.014+0000 7f18e5c07640 1 -- 172.21.15.16:0/2289030370 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc009560 con 0x7f18e00fe6d0 2024-08-01T06:47:53.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.014+0000 7f18e5c07640 1 --2- 172.21.15.16:0/2289030370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e00fe6d0 0x7f18e00fbcf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f18dc009230 tx=0x7f18dc0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:53.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.014+0000 7f18d6ffd640 1 -- 172.21.15.16:0/2289030370 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f18dc004aa0 con 0x7f18e00fe6d0 2024-08-01T06:47:53.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.014+0000 7f18d6ffd640 1 -- 172.21.15.16:0/2289030370 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f18dc004c00 con 0x7f18e00fe6d0 2024-08-01T06:47:53.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.014+0000 7f18e7e6b640 1 -- 172.21.15.16:0/2289030370 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e00fa420 con 0x7f18e00fe6d0 2024-08-01T06:47:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.014+0000 7f18d6ffd640 1 -- 172.21.15.16:0/2289030370 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f18dc031a60 con 0x7f18e00fe6d0 2024-08-01T06:47:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.014+0000 7f18e7e6b640 1 -- 172.21.15.16:0/2289030370 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e00fa8c0 con 0x7f18e00fe6d0 2024-08-01T06:47:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.015+0000 7f18d6ffd640 1 -- 172.21.15.16:0/2289030370 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f18dc031bc0 con 0x7f18e00fe6d0 2024-08-01T06:47:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.015+0000 7f18d6ffd640 1 --2- 172.21.15.16:0/2289030370 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f18cc038740 0x7f18cc03ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.015+0000 7f18d6ffd640 1 -- 172.21.15.16:0/2289030370 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f18dc06c410 con 0x7f18e00fe6d0 2024-08-01T06:47:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.015+0000 7f18e7e6b640 1 -- 172.21.15.16:0/2289030370 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e0104ec0 con 0x7f18e00fe6d0 2024-08-01T06:47:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.015+0000 7f18e5406640 1 --2- 172.21.15.16:0/2289030370 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f18cc038740 0x7f18cc03ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.016+0000 7f18e5406640 1 --2- 172.21.15.16:0/2289030370 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f18cc038740 0x7f18cc03ac00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f18d00098c0 tx=0x7f18d0006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:53.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.020+0000 7f18d6ffd640 1 -- 172.21.15.16:0/2289030370 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f18dc035080 con 0x7f18e00fe6d0 2024-08-01T06:47:53.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.202+0000 7f18e7e6b640 1 -- 172.21.15.16:0/2289030370 --> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f18e00fab00 con 0x7f18cc038740 2024-08-01T06:47:53.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.203+0000 7f18d6ffd640 1 -- 172.21.15.16:0/2289030370 <== mgr.14162 v2:172.21.15.16:6800/3100338993 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f18e00fab00 con 0x7f18cc038740 2024-08-01T06:47:53.206 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:47:53.206 INFO:teuthology.orchestra.run.smithi016.stdout:[{"addr": "172.21.15.16", "hostname": "smithi016", "labels": [], "status": ""}, {"addr": "172.21.15.89", "hostname": "smithi089", "labels": [], "status": ""}] 2024-08-01T06:47:53.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.205+0000 7f18e7e6b640 1 -- 172.21.15.16:0/2289030370 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f18cc038740 msgr2=0x7f18cc03ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:53.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.205+0000 7f18e7e6b640 1 --2- 172.21.15.16:0/2289030370 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f18cc038740 0x7f18cc03ac00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f18d00098c0 tx=0x7f18d0006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:53.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.205+0000 7f18e7e6b640 1 -- 172.21.15.16:0/2289030370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e00fe6d0 msgr2=0x7f18e00fbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:53.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.205+0000 7f18e7e6b640 1 --2- 172.21.15.16:0/2289030370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e00fe6d0 0x7f18e00fbcf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f18dc009230 tx=0x7f18dc0056e0 comp rx=0 tx=0).stop 2024-08-01T06:47:53.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.205+0000 7f18e7e6b640 1 -- 172.21.15.16:0/2289030370 shutdown_connections 2024-08-01T06:47:53.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.205+0000 7f18e7e6b640 1 --2- 172.21.15.16:0/2289030370 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f18cc038740 0x7f18cc03ac00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:53.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.205+0000 7f18e7e6b640 1 --2- 172.21.15.16:0/2289030370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e00fe6d0 0x7f18e00fbcf0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:53.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.205+0000 7f18e7e6b640 1 -- 172.21.15.16:0/2289030370 >> 172.21.15.16:0/2289030370 conn(0x7f18e00f9e80 msgr2=0x7f18e0067dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:53.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.205+0000 7f18e7e6b640 1 -- 172.21.15.16:0/2289030370 shutdown_connections 2024-08-01T06:47:53.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:53.205+0000 7f18e7e6b640 1 -- 172.21.15.16:0/2289030370 wait complete. 2024-08-01T06:47:53.778 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:53 smithi016 ceph-mon[29266]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-01T06:47:53.779 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:53 smithi016 ceph-mon[29266]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:47:54.527 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-01T06:47:54.527 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph osd crush tunables default 2024-08-01T06:47:55.374 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:47:56.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:56 smithi016 ceph-mon[29266]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:47:58.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.165+0000 7fada5c31640 1 -- 172.21.15.16:0/2943855632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada01019f0 msgr2=0x7fada0101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:58.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.165+0000 7fada5c31640 1 --2- 172.21.15.16:0/2943855632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada01019f0 0x7fada0101df0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fad90009880 tx=0x7fad9002a5d0 comp rx=0 tx=0).stop 2024-08-01T06:47:58.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.165+0000 7fada5c31640 1 -- 172.21.15.16:0/2943855632 shutdown_connections 2024-08-01T06:47:58.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.165+0000 7fada5c31640 1 --2- 172.21.15.16:0/2943855632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada01019f0 0x7fada0101df0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:58.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.165+0000 7fada5c31640 1 -- 172.21.15.16:0/2943855632 >> 172.21.15.16:0/2943855632 conn(0x7fada00fd1a0 msgr2=0x7fada00ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:58.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.165+0000 7fada5c31640 1 -- 172.21.15.16:0/2943855632 shutdown_connections 2024-08-01T06:47:58.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.165+0000 7fada5c31640 1 -- 172.21.15.16:0/2943855632 wait complete. 2024-08-01T06:47:58.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.166+0000 7fada5c31640 1 Processor -- start 2024-08-01T06:47:58.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.166+0000 7fada5c31640 1 -- start start 2024-08-01T06:47:58.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.166+0000 7fada5c31640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada01019f0 0x7fada0196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:58.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.166+0000 7fada5c31640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada01973f0 con 0x7fada01019f0 2024-08-01T06:47:58.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.167+0000 7fad9f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada01019f0 0x7fada0196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:58.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.167+0000 7fad9f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada01019f0 0x7fada0196eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44374/0 (socket says 172.21.15.16:44374) 2024-08-01T06:47:58.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.167+0000 7fad9f7fe640 1 -- 172.21.15.16:0/2800757344 learned_addr learned my addr 172.21.15.16:0/2800757344 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:47:58.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.167+0000 7fad9f7fe640 1 -- 172.21.15.16:0/2800757344 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad90009560 con 0x7fada01019f0 2024-08-01T06:47:58.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.167+0000 7fad9f7fe640 1 --2- 172.21.15.16:0/2800757344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada01019f0 0x7fada0196eb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fad90005610 tx=0x7fad90005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:58.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.167+0000 7fad9cff9640 1 -- 172.21.15.16:0/2800757344 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad90004b20 con 0x7fada01019f0 2024-08-01T06:47:58.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.167+0000 7fad9cff9640 1 -- 172.21.15.16:0/2800757344 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad90004c80 con 0x7fada01019f0 2024-08-01T06:47:58.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.167+0000 7fad9cff9640 1 -- 172.21.15.16:0/2800757344 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad90031a90 con 0x7fada01019f0 2024-08-01T06:47:58.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.167+0000 7fada5c31640 1 -- 172.21.15.16:0/2800757344 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada01975f0 con 0x7fada01019f0 2024-08-01T06:47:58.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.167+0000 7fada5c31640 1 -- 172.21.15.16:0/2800757344 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada0197a90 con 0x7fada01019f0 2024-08-01T06:47:58.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.168+0000 7fad9cff9640 1 -- 172.21.15.16:0/2800757344 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fad90031cc0 con 0x7fada01019f0 2024-08-01T06:47:58.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.168+0000 7fada5c31640 1 -- 172.21.15.16:0/2800757344 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada0101df0 con 0x7fada01019f0 2024-08-01T06:47:58.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.169+0000 7fad9cff9640 1 --2- 172.21.15.16:0/2800757344 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fad8c038790 0x7fad8c03ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:47:58.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.169+0000 7fad9cff9640 1 -- 172.21.15.16:0/2800757344 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fad9006c5d0 con 0x7fada01019f0 2024-08-01T06:47:58.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.169+0000 7fad9effd640 1 --2- 172.21.15.16:0/2800757344 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fad8c038790 0x7fad8c03ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:47:58.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.169+0000 7fad9effd640 1 --2- 172.21.15.16:0/2800757344 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fad8c038790 0x7fad8c03ac50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fad880098c0 tx=0x7fad88006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:47:58.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.173+0000 7fad9cff9640 1 -- 172.21.15.16:0/2800757344 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fad90043360 con 0x7fada01019f0 2024-08-01T06:47:58.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.352+0000 7fada5c31640 1 -- 172.21.15.16:0/2800757344 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fada0190820 con 0x7fada01019f0 2024-08-01T06:47:58.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.409+0000 7fad9cff9640 1 -- 172.21.15.16:0/2800757344 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fad90035020 con 0x7fada01019f0 2024-08-01T06:47:58.411 INFO:teuthology.orchestra.run.smithi016.stderr:adjusted tunables profile to default 2024-08-01T06:47:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.411+0000 7fada5c31640 1 -- 172.21.15.16:0/2800757344 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fad8c038790 msgr2=0x7fad8c03ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.411+0000 7fada5c31640 1 --2- 172.21.15.16:0/2800757344 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fad8c038790 0x7fad8c03ac50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fad880098c0 tx=0x7fad88006db0 comp rx=0 tx=0).stop 2024-08-01T06:47:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.411+0000 7fada5c31640 1 -- 172.21.15.16:0/2800757344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada01019f0 msgr2=0x7fada0196eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:47:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.411+0000 7fada5c31640 1 --2- 172.21.15.16:0/2800757344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada01019f0 0x7fada0196eb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fad90005610 tx=0x7fad90005640 comp rx=0 tx=0).stop 2024-08-01T06:47:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.411+0000 7fada5c31640 1 -- 172.21.15.16:0/2800757344 shutdown_connections 2024-08-01T06:47:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.411+0000 7fada5c31640 1 --2- 172.21.15.16:0/2800757344 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fad8c038790 0x7fad8c03ac50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.411+0000 7fada5c31640 1 --2- 172.21.15.16:0/2800757344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada01019f0 0x7fada0196eb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:47:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.411+0000 7fada5c31640 1 -- 172.21.15.16:0/2800757344 >> 172.21.15.16:0/2800757344 conn(0x7fada00fd1a0 msgr2=0x7fada00fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:47:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.411+0000 7fada5c31640 1 -- 172.21.15.16:0/2800757344 shutdown_connections 2024-08-01T06:47:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:47:58.411+0000 7fada5c31640 1 -- 172.21.15.16:0/2800757344 wait complete. 2024-08-01T06:47:58.790 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:58 smithi016 ceph-mon[29266]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:47:58.790 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:58 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/2800757344' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-08-01T06:47:59.105 INFO:tasks.cephadm:Adding mon.smithi016 on smithi016 2024-08-01T06:47:59.105 INFO:tasks.cephadm:Adding mon.smithi089 on smithi089 2024-08-01T06:47:59.105 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph orch apply mon '2;smithi016:172.21.15.16=smithi016;smithi089:172.21.15.89=smithi089' 2024-08-01T06:47:59.306 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:47:59.353 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:47:59.727 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:59 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/2800757344' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-01T06:47:59.727 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:47:59 smithi016 ceph-mon[29266]: osdmap e4: 0 total, 0 up, 0 in 2024-08-01T06:48:00.666 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:00 smithi016 ceph-mon[29266]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:48:00.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.993+0000 7f672471e640 1 -- 172.21.15.89:0/2757431748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f671c0ff7e0 msgr2=0x7f671c0ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:00.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.993+0000 7f672471e640 1 --2- 172.21.15.89:0/2757431748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f671c0ff7e0 0x7f671c0ffbe0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6718009880 tx=0x7f671802a5d0 comp rx=0 tx=0).stop 2024-08-01T06:48:00.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.993+0000 7f672471e640 1 -- 172.21.15.89:0/2757431748 shutdown_connections 2024-08-01T06:48:00.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.993+0000 7f672471e640 1 --2- 172.21.15.89:0/2757431748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f671c0ff7e0 0x7f671c0ffbe0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:00.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.994+0000 7f672471e640 1 -- 172.21.15.89:0/2757431748 >> 172.21.15.89:0/2757431748 conn(0x7f671c0faf90 msgr2=0x7f671c0fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:00.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.994+0000 7f672471e640 1 -- 172.21.15.89:0/2757431748 shutdown_connections 2024-08-01T06:48:00.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.994+0000 7f672471e640 1 -- 172.21.15.89:0/2757431748 wait complete. 2024-08-01T06:48:00.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.994+0000 7f672471e640 1 Processor -- start 2024-08-01T06:48:00.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.994+0000 7f672471e640 1 -- start start 2024-08-01T06:48:00.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.994+0000 7f672471e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f671c0ff7e0 0x7f671c194cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:00.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.994+0000 7f672471e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671c195200 con 0x7f671c0ff7e0 2024-08-01T06:48:00.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.994+0000 7f67224ba640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f671c0ff7e0 0x7f671c194cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:00.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.995+0000 7f67224ba640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f671c0ff7e0 0x7f671c194cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.89:57770/0 (socket says 172.21.15.89:57770) 2024-08-01T06:48:00.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.995+0000 7f67224ba640 1 -- 172.21.15.89:0/1765876765 learned_addr learned my addr 172.21.15.89:0/1765876765 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:48:00.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.995+0000 7f67224ba640 1 -- 172.21.15.89:0/1765876765 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6718009560 con 0x7f671c0ff7e0 2024-08-01T06:48:00.998 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.995+0000 7f67224ba640 1 --2- 172.21.15.89:0/1765876765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f671c0ff7e0 0x7f671c194cc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6718005610 tx=0x7f6718005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:00.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.995+0000 7f67137fe640 1 -- 172.21.15.89:0/1765876765 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6718004b20 con 0x7f671c0ff7e0 2024-08-01T06:48:00.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.995+0000 7f672471e640 1 -- 172.21.15.89:0/1765876765 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671c195400 con 0x7f671c0ff7e0 2024-08-01T06:48:00.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.995+0000 7f67137fe640 1 -- 172.21.15.89:0/1765876765 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6718004c80 con 0x7f671c0ff7e0 2024-08-01T06:48:00.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.995+0000 7f67137fe640 1 -- 172.21.15.89:0/1765876765 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6718031a90 con 0x7f671c0ff7e0 2024-08-01T06:48:00.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.995+0000 7f672471e640 1 -- 172.21.15.89:0/1765876765 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671c1958a0 con 0x7f671c0ff7e0 2024-08-01T06:48:00.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.996+0000 7f67137fe640 1 -- 172.21.15.89:0/1765876765 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f6718031d50 con 0x7f671c0ff7e0 2024-08-01T06:48:00.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.996+0000 7f672471e640 1 -- 172.21.15.89:0/1765876765 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671c0ffbe0 con 0x7f671c0ff7e0 2024-08-01T06:48:00.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.997+0000 7f67137fe640 1 --2- 172.21.15.89:0/1765876765 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f6708038740 0x7f670803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:00.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.997+0000 7f67137fe640 1 -- 172.21.15.89:0/1765876765 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f671806c500 con 0x7f671c0ff7e0 2024-08-01T06:48:00.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.997+0000 7f6721cb9640 1 --2- 172.21.15.89:0/1765876765 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f6708038740 0x7f670803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:00.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:00.997+0000 7f6721cb9640 1 --2- 172.21.15.89:0/1765876765 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f6708038740 0x7f670803ac00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f670c0098c0 tx=0x7f670c006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:01.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:01.005+0000 7f67137fe640 1 -- 172.21.15.89:0/1765876765 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f671804dce0 con 0x7f671c0ff7e0 2024-08-01T06:48:01.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:01.177+0000 7f672471e640 1 -- 172.21.15.89:0/1765876765 --> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi016:172.21.15.16=smithi016;smithi089:172.21.15.89=smithi089", "target": ["mon-mgr", ""]}) v1 -- 0x7f671c02c5c0 con 0x7f6708038740 2024-08-01T06:48:01.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:01.183+0000 7f67137fe640 1 -- 172.21.15.89:0/1765876765 <== mgr.14162 v2:172.21.15.16:6800/3100338993 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f671c02c5c0 con 0x7f6708038740 2024-08-01T06:48:01.184 INFO:teuthology.orchestra.run.smithi089.stdout:Scheduled mon update... 2024-08-01T06:48:01.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:01.184+0000 7f672471e640 1 -- 172.21.15.89:0/1765876765 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f6708038740 msgr2=0x7f670803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:01.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:01.184+0000 7f672471e640 1 --2- 172.21.15.89:0/1765876765 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f6708038740 0x7f670803ac00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f670c0098c0 tx=0x7f670c006db0 comp rx=0 tx=0).stop 2024-08-01T06:48:01.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:01.184+0000 7f672471e640 1 -- 172.21.15.89:0/1765876765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f671c0ff7e0 msgr2=0x7f671c194cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:01.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:01.184+0000 7f672471e640 1 --2- 172.21.15.89:0/1765876765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f671c0ff7e0 0x7f671c194cc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6718005610 tx=0x7f6718005640 comp rx=0 tx=0).stop 2024-08-01T06:48:01.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:01.184+0000 7f672471e640 1 -- 172.21.15.89:0/1765876765 shutdown_connections 2024-08-01T06:48:01.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:01.184+0000 7f672471e640 1 --2- 172.21.15.89:0/1765876765 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f6708038740 0x7f670803ac00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:01.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:01.184+0000 7f672471e640 1 --2- 172.21.15.89:0/1765876765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f671c0ff7e0 0x7f671c194cc0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:01.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:01.184+0000 7f672471e640 1 -- 172.21.15.89:0/1765876765 >> 172.21.15.89:0/1765876765 conn(0x7f671c0faf90 msgr2=0x7f671c0fb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:01.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:01.184+0000 7f672471e640 1 -- 172.21.15.89:0/1765876765 shutdown_connections 2024-08-01T06:48:01.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:01.184+0000 7f672471e640 1 -- 172.21.15.89:0/1765876765 wait complete. 2024-08-01T06:48:01.726 DEBUG:teuthology.orchestra.run.smithi089:mon.smithi089> sudo journalctl -f -n 0 -u ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mon.smithi089.service 2024-08-01T06:48:01.729 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-01T06:48:01.729 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-01T06:48:01.954 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:02.000 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:02.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:02 smithi016 ceph-mon[29266]: from='client.14195 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi016:172.21.15.16=smithi016;smithi089:172.21.15.89=smithi089", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:48:02.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:02 smithi016 ceph-mon[29266]: Saving service mon spec with placement smithi016:172.21.15.16=smithi016;smithi089:172.21.15.89=smithi089;count:2 2024-08-01T06:48:02.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:02 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:02.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:02 smithi016 ceph-mon[29266]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:48:02.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:02 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:02.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:02 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:02.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:02 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:02.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:02 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:02.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:02 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:02.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:02 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:02.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:02 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:02.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:02 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:02.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:02 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-08-01T06:48:02.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:02 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:03.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.306+0000 7f5324c39640 1 -- 172.21.15.89:0/2429923208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53200fd580 msgr2=0x7f53200fd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:03.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.306+0000 7f5324c39640 1 --2- 172.21.15.89:0/2429923208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53200fd580 0x7f53200fd980 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5314009880 tx=0x7f531402a5d0 comp rx=0 tx=0).stop 2024-08-01T06:48:03.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.306+0000 7f5324c39640 1 -- 172.21.15.89:0/2429923208 shutdown_connections 2024-08-01T06:48:03.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.306+0000 7f5324c39640 1 --2- 172.21.15.89:0/2429923208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53200fd580 0x7f53200fd980 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:03.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.306+0000 7f5324c39640 1 -- 172.21.15.89:0/2429923208 >> 172.21.15.89:0/2429923208 conn(0x7f53200f91b0 msgr2=0x7f53200fb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:03.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.306+0000 7f5324c39640 1 -- 172.21.15.89:0/2429923208 shutdown_connections 2024-08-01T06:48:03.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.306+0000 7f5324c39640 1 -- 172.21.15.89:0/2429923208 wait complete. 2024-08-01T06:48:03.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.307+0000 7f5324c39640 1 Processor -- start 2024-08-01T06:48:03.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.307+0000 7f5324c39640 1 -- start start 2024-08-01T06:48:03.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.307+0000 7f5324c39640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53200fd580 0x7f5320100750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:03.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.307+0000 7f5324c39640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5320100c90 con 0x7f53200fd580 2024-08-01T06:48:03.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.308+0000 7f531e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53200fd580 0x7f5320100750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:03.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.308+0000 7f531e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53200fd580 0x7f5320100750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.89:57788/0 (socket says 172.21.15.89:57788) 2024-08-01T06:48:03.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.308+0000 7f531e59c640 1 -- 172.21.15.89:0/2053846515 learned_addr learned my addr 172.21.15.89:0/2053846515 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:48:03.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.308+0000 7f531e59c640 1 -- 172.21.15.89:0/2053846515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5314009560 con 0x7f53200fd580 2024-08-01T06:48:03.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.308+0000 7f531e59c640 1 --2- 172.21.15.89:0/2053846515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53200fd580 0x7f5320100750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5314006010 tx=0x7f5314005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:03.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.308+0000 7f530f7fe640 1 -- 172.21.15.89:0/2053846515 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5314004aa0 con 0x7f53200fd580 2024-08-01T06:48:03.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.308+0000 7f5324c39640 1 -- 172.21.15.89:0/2053846515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53200fee80 con 0x7f53200fd580 2024-08-01T06:48:03.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.308+0000 7f530f7fe640 1 -- 172.21.15.89:0/2053846515 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5314004c00 con 0x7f53200fd580 2024-08-01T06:48:03.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.308+0000 7f530f7fe640 1 -- 172.21.15.89:0/2053846515 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5314031a80 con 0x7f53200fd580 2024-08-01T06:48:03.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.308+0000 7f5324c39640 1 -- 172.21.15.89:0/2053846515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53200ff320 con 0x7f53200fd580 2024-08-01T06:48:03.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.309+0000 7f5324c39640 1 -- 172.21.15.89:0/2053846515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5320105fb0 con 0x7f53200fd580 2024-08-01T06:48:03.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.309+0000 7f530f7fe640 1 -- 172.21.15.89:0/2053846515 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f5314031d40 con 0x7f53200fd580 2024-08-01T06:48:03.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.310+0000 7f530f7fe640 1 --2- 172.21.15.89:0/2053846515 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f5308038740 0x7f530803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:03.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.310+0000 7f530f7fe640 1 -- 172.21.15.89:0/2053846515 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f531406c580 con 0x7f53200fd580 2024-08-01T06:48:03.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.310+0000 7f531dd9b640 1 --2- 172.21.15.89:0/2053846515 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f5308038740 0x7f530803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:03.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.310+0000 7f531dd9b640 1 --2- 172.21.15.89:0/2053846515 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f5308038740 0x7f530803ac00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f53100098c0 tx=0x7f5310006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:03.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.315+0000 7f530f7fe640 1 -- 172.21.15.89:0/2053846515 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f531404d9a0 con 0x7f53200fd580 2024-08-01T06:48:03.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.540+0000 7f5324c39640 1 -- 172.21.15.89:0/2053846515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f53200fd980 con 0x7f53200fd580 2024-08-01T06:48:03.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.541+0000 7f530f7fe640 1 -- 172.21.15.89:0/2053846515 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f5314035070 con 0x7f53200fd580 2024-08-01T06:48:03.544 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:48:03.544 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":1,"fsid":"a88427da-4fd1-11ef-bcca-c7b262605968","modified":"2024-08-01T06:46:30.398884Z","created":"2024-08-01T06:46:30.398884Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi016","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-01T06:48:03.544 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 1 2024-08-01T06:48:03.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.543+0000 7f5324c39640 1 -- 172.21.15.89:0/2053846515 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f5308038740 msgr2=0x7f530803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:03.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.543+0000 7f5324c39640 1 --2- 172.21.15.89:0/2053846515 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f5308038740 0x7f530803ac00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f53100098c0 tx=0x7f5310006db0 comp rx=0 tx=0).stop 2024-08-01T06:48:03.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.543+0000 7f5324c39640 1 -- 172.21.15.89:0/2053846515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53200fd580 msgr2=0x7f5320100750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:03.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.543+0000 7f5324c39640 1 --2- 172.21.15.89:0/2053846515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53200fd580 0x7f5320100750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5314006010 tx=0x7f5314005630 comp rx=0 tx=0).stop 2024-08-01T06:48:03.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.543+0000 7f5324c39640 1 -- 172.21.15.89:0/2053846515 shutdown_connections 2024-08-01T06:48:03.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.543+0000 7f5324c39640 1 --2- 172.21.15.89:0/2053846515 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f5308038740 0x7f530803ac00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:03.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.543+0000 7f5324c39640 1 --2- 172.21.15.89:0/2053846515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53200fd580 0x7f5320100750 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:03.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.543+0000 7f5324c39640 1 -- 172.21.15.89:0/2053846515 >> 172.21.15.89:0/2053846515 conn(0x7f53200f91b0 msgr2=0x7f53200f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:03.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.543+0000 7f5324c39640 1 -- 172.21.15.89:0/2053846515 shutdown_connections 2024-08-01T06:48:03.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:03.543+0000 7f5324c39640 1 -- 172.21.15.89:0/2053846515 wait complete. 2024-08-01T06:48:03.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:03 smithi016 ceph-mon[29266]: Regenerating cephadm self-signed grafana TLS certificates 2024-08-01T06:48:03.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:03 smithi016 ceph-mon[29266]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-08-01T06:48:03.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:03 smithi016 ceph-mon[29266]: Deploying daemon grafana.smithi016 on smithi016 2024-08-01T06:48:03.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:03 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:04.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:04 smithi016 ceph-mon[29266]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:48:04.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:04 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/2053846515' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:48:05.127 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-01T06:48:05.127 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-01T06:48:05.329 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:05.375 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:06.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:06 smithi016 ceph-mon[29266]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:48:06.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.805+0000 7fbf2dfeb640 1 -- 172.21.15.89:0/3847889804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf280fe6d0 msgr2=0x7fbf280fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:06.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.805+0000 7fbf2dfeb640 1 --2- 172.21.15.89:0/3847889804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf280fe6d0 0x7fbf280fead0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbf18009880 tx=0x7fbf1802a5d0 comp rx=0 tx=0).stop 2024-08-01T06:48:06.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.805+0000 7fbf2dfeb640 1 -- 172.21.15.89:0/3847889804 shutdown_connections 2024-08-01T06:48:06.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.805+0000 7fbf2dfeb640 1 --2- 172.21.15.89:0/3847889804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf280fe6d0 0x7fbf280fead0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:06.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.805+0000 7fbf2dfeb640 1 -- 172.21.15.89:0/3847889804 >> 172.21.15.89:0/3847889804 conn(0x7fbf280f9e80 msgr2=0x7fbf280fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:06.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.805+0000 7fbf2dfeb640 1 -- 172.21.15.89:0/3847889804 shutdown_connections 2024-08-01T06:48:06.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.805+0000 7fbf2dfeb640 1 -- 172.21.15.89:0/3847889804 wait complete. 2024-08-01T06:48:06.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.805+0000 7fbf2dfeb640 1 Processor -- start 2024-08-01T06:48:06.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.805+0000 7fbf2dfeb640 1 -- start start 2024-08-01T06:48:06.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.806+0000 7fbf2dfeb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf280fe6d0 0x7fbf28194d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:06.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.806+0000 7fbf2dfeb640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf281952a0 con 0x7fbf280fe6d0 2024-08-01T06:48:06.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.806+0000 7fbf277fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf280fe6d0 0x7fbf28194d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:06.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.806+0000 7fbf277fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf280fe6d0 0x7fbf28194d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.89:45566/0 (socket says 172.21.15.89:45566) 2024-08-01T06:48:06.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.806+0000 7fbf277fe640 1 -- 172.21.15.89:0/3888544670 learned_addr learned my addr 172.21.15.89:0/3888544670 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:48:06.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.806+0000 7fbf277fe640 1 -- 172.21.15.89:0/3888544670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf18009560 con 0x7fbf280fe6d0 2024-08-01T06:48:06.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.806+0000 7fbf277fe640 1 --2- 172.21.15.89:0/3888544670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf280fe6d0 0x7fbf28194d60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbf18009230 tx=0x7fbf180056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:06.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.806+0000 7fbf257fa640 1 -- 172.21.15.89:0/3888544670 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf18004aa0 con 0x7fbf280fe6d0 2024-08-01T06:48:06.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.807+0000 7fbf2dfeb640 1 -- 172.21.15.89:0/3888544670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf281954a0 con 0x7fbf280fe6d0 2024-08-01T06:48:06.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.807+0000 7fbf257fa640 1 -- 172.21.15.89:0/3888544670 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf18004c00 con 0x7fbf280fe6d0 2024-08-01T06:48:06.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.807+0000 7fbf257fa640 1 -- 172.21.15.89:0/3888544670 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf18031a60 con 0x7fbf280fe6d0 2024-08-01T06:48:06.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.807+0000 7fbf2dfeb640 1 -- 172.21.15.89:0/3888544670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf28195940 con 0x7fbf280fe6d0 2024-08-01T06:48:06.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.807+0000 7fbf257fa640 1 -- 172.21.15.89:0/3888544670 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fbf18031bc0 con 0x7fbf280fe6d0 2024-08-01T06:48:06.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.808+0000 7fbf257fa640 1 --2- 172.21.15.89:0/3888544670 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fbf14038740 0x7fbf1403ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:06.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.808+0000 7fbf2dfeb640 1 -- 172.21.15.89:0/3888544670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf280fead0 con 0x7fbf280fe6d0 2024-08-01T06:48:06.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.808+0000 7fbf257fa640 1 -- 172.21.15.89:0/3888544670 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbf1806c4c0 con 0x7fbf280fe6d0 2024-08-01T06:48:06.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.808+0000 7fbf1effd640 1 --2- 172.21.15.89:0/3888544670 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fbf14038740 0x7fbf1403ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:06.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.808+0000 7fbf1effd640 1 --2- 172.21.15.89:0/3888544670 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fbf14038740 0x7fbf1403ac00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbf100098c0 tx=0x7fbf10006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:06.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:06.817+0000 7fbf257fa640 1 -- 172.21.15.89:0/3888544670 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fbf18035080 con 0x7fbf280fe6d0 2024-08-01T06:48:07.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:07.040+0000 7fbf2dfeb640 1 -- 172.21.15.89:0/3888544670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbf28104740 con 0x7fbf280fe6d0 2024-08-01T06:48:07.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:07.040+0000 7fbf257fa640 1 -- 172.21.15.89:0/3888544670 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fbf18040020 con 0x7fbf280fe6d0 2024-08-01T06:48:07.043 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:48:07.043 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":1,"fsid":"a88427da-4fd1-11ef-bcca-c7b262605968","modified":"2024-08-01T06:46:30.398884Z","created":"2024-08-01T06:46:30.398884Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi016","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-01T06:48:07.044 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 1 2024-08-01T06:48:07.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:07.043+0000 7fbf2dfeb640 1 -- 172.21.15.89:0/3888544670 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fbf14038740 msgr2=0x7fbf1403ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:07.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:07.043+0000 7fbf2dfeb640 1 --2- 172.21.15.89:0/3888544670 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fbf14038740 0x7fbf1403ac00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbf100098c0 tx=0x7fbf10006db0 comp rx=0 tx=0).stop 2024-08-01T06:48:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:07.043+0000 7fbf2dfeb640 1 -- 172.21.15.89:0/3888544670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf280fe6d0 msgr2=0x7fbf28194d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:07.043+0000 7fbf2dfeb640 1 --2- 172.21.15.89:0/3888544670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf280fe6d0 0x7fbf28194d60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbf18009230 tx=0x7fbf180056e0 comp rx=0 tx=0).stop 2024-08-01T06:48:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:07.043+0000 7fbf2dfeb640 1 -- 172.21.15.89:0/3888544670 shutdown_connections 2024-08-01T06:48:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:07.043+0000 7fbf2dfeb640 1 --2- 172.21.15.89:0/3888544670 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fbf14038740 0x7fbf1403ac00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:07.043+0000 7fbf2dfeb640 1 --2- 172.21.15.89:0/3888544670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf280fe6d0 0x7fbf28194d60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:07.043+0000 7fbf2dfeb640 1 -- 172.21.15.89:0/3888544670 >> 172.21.15.89:0/3888544670 conn(0x7fbf280f9e80 msgr2=0x7fbf280faa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:07.043+0000 7fbf2dfeb640 1 -- 172.21.15.89:0/3888544670 shutdown_connections 2024-08-01T06:48:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:07.043+0000 7fbf2dfeb640 1 -- 172.21.15.89:0/3888544670 wait complete. 2024-08-01T06:48:07.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:07 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/3888544670' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:48:08.613 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-01T06:48:08.613 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-01T06:48:08.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:08 smithi016 ceph-mon[29266]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:48:08.805 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:08.852 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:10.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.276+0000 7f9c89617640 1 -- 172.21.15.89:0/2249026216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c840fe6d0 msgr2=0x7f9c840fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:10.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.276+0000 7f9c89617640 1 --2- 172.21.15.89:0/2249026216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c840fe6d0 0x7f9c840fead0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009880 tx=0x7f9c7402a5d0 comp rx=0 tx=0).stop 2024-08-01T06:48:10.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.277+0000 7f9c89617640 1 -- 172.21.15.89:0/2249026216 shutdown_connections 2024-08-01T06:48:10.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.277+0000 7f9c89617640 1 --2- 172.21.15.89:0/2249026216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c840fe6d0 0x7f9c840fead0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:10.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.277+0000 7f9c89617640 1 -- 172.21.15.89:0/2249026216 >> 172.21.15.89:0/2249026216 conn(0x7f9c840f9e80 msgr2=0x7f9c840fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:10.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.277+0000 7f9c89617640 1 -- 172.21.15.89:0/2249026216 shutdown_connections 2024-08-01T06:48:10.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.277+0000 7f9c89617640 1 -- 172.21.15.89:0/2249026216 wait complete. 2024-08-01T06:48:10.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.277+0000 7f9c89617640 1 Processor -- start 2024-08-01T06:48:10.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.277+0000 7f9c89617640 1 -- start start 2024-08-01T06:48:10.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.278+0000 7f9c89617640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c840fe6d0 0x7f9c84194d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:10.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.278+0000 7f9c89617640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c84195280 con 0x7f9c840fe6d0 2024-08-01T06:48:10.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.278+0000 7f9c82ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c840fe6d0 0x7f9c84194d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:10.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.278+0000 7f9c82ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c840fe6d0 0x7f9c84194d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.89:45596/0 (socket says 172.21.15.89:45596) 2024-08-01T06:48:10.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.278+0000 7f9c82ffd640 1 -- 172.21.15.89:0/593820332 learned_addr learned my addr 172.21.15.89:0/593820332 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:48:10.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.278+0000 7f9c82ffd640 1 -- 172.21.15.89:0/593820332 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c74009560 con 0x7f9c840fe6d0 2024-08-01T06:48:10.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.278+0000 7f9c82ffd640 1 --2- 172.21.15.89:0/593820332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c840fe6d0 0x7f9c84194d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009230 tx=0x7f9c740056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:10.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.278+0000 7f9c6bfff640 1 -- 172.21.15.89:0/593820332 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c74004aa0 con 0x7f9c840fe6d0 2024-08-01T06:48:10.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.278+0000 7f9c6bfff640 1 -- 172.21.15.89:0/593820332 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c74004c00 con 0x7f9c840fe6d0 2024-08-01T06:48:10.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.278+0000 7f9c89617640 1 -- 172.21.15.89:0/593820332 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c84195480 con 0x7f9c840fe6d0 2024-08-01T06:48:10.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.278+0000 7f9c6bfff640 1 -- 172.21.15.89:0/593820332 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c74031a60 con 0x7f9c840fe6d0 2024-08-01T06:48:10.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.279+0000 7f9c89617640 1 -- 172.21.15.89:0/593820332 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c84195920 con 0x7f9c840fe6d0 2024-08-01T06:48:10.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.279+0000 7f9c6bfff640 1 -- 172.21.15.89:0/593820332 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f9c74031bc0 con 0x7f9c840fe6d0 2024-08-01T06:48:10.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.279+0000 7f9c89617640 1 -- 172.21.15.89:0/593820332 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c840fead0 con 0x7f9c840fe6d0 2024-08-01T06:48:10.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.280+0000 7f9c6bfff640 1 --2- 172.21.15.89:0/593820332 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f9c6c038790 0x7f9c6c03ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:10.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.280+0000 7f9c6bfff640 1 -- 172.21.15.89:0/593820332 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9c7406c630 con 0x7f9c840fe6d0 2024-08-01T06:48:10.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.280+0000 7f9c827fc640 1 --2- 172.21.15.89:0/593820332 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f9c6c038790 0x7f9c6c03ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:10.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.280+0000 7f9c827fc640 1 --2- 172.21.15.89:0/593820332 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f9c6c038790 0x7f9c6c03ac50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00ad30 tx=0x7f9c7c0093f0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:10.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.288+0000 7f9c6bfff640 1 -- 172.21.15.89:0/593820332 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f9c74043360 con 0x7f9c840fe6d0 2024-08-01T06:48:10.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.512+0000 7f9c89617640 1 -- 172.21.15.89:0/593820332 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9c8402c3e0 con 0x7f9c840fe6d0 2024-08-01T06:48:10.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.513+0000 7f9c6bfff640 1 -- 172.21.15.89:0/593820332 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f9c74035030 con 0x7f9c840fe6d0 2024-08-01T06:48:10.515 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:48:10.515 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":1,"fsid":"a88427da-4fd1-11ef-bcca-c7b262605968","modified":"2024-08-01T06:46:30.398884Z","created":"2024-08-01T06:46:30.398884Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi016","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-01T06:48:10.515 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 1 2024-08-01T06:48:10.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.515+0000 7f9c89617640 1 -- 172.21.15.89:0/593820332 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f9c6c038790 msgr2=0x7f9c6c03ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:10.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.515+0000 7f9c89617640 1 --2- 172.21.15.89:0/593820332 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f9c6c038790 0x7f9c6c03ac50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00ad30 tx=0x7f9c7c0093f0 comp rx=0 tx=0).stop 2024-08-01T06:48:10.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.515+0000 7f9c89617640 1 -- 172.21.15.89:0/593820332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c840fe6d0 msgr2=0x7f9c84194d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:10.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.515+0000 7f9c89617640 1 --2- 172.21.15.89:0/593820332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c840fe6d0 0x7f9c84194d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009230 tx=0x7f9c740056e0 comp rx=0 tx=0).stop 2024-08-01T06:48:10.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.515+0000 7f9c89617640 1 -- 172.21.15.89:0/593820332 shutdown_connections 2024-08-01T06:48:10.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.515+0000 7f9c89617640 1 --2- 172.21.15.89:0/593820332 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f9c6c038790 0x7f9c6c03ac50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:10.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.515+0000 7f9c89617640 1 --2- 172.21.15.89:0/593820332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c840fe6d0 0x7f9c84194d40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:10.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.515+0000 7f9c89617640 1 -- 172.21.15.89:0/593820332 >> 172.21.15.89:0/593820332 conn(0x7f9c840f9e80 msgr2=0x7f9c84067dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:10.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.515+0000 7f9c89617640 1 -- 172.21.15.89:0/593820332 shutdown_connections 2024-08-01T06:48:10.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:10.515+0000 7f9c89617640 1 -- 172.21.15.89:0/593820332 wait complete. 2024-08-01T06:48:10.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:10 smithi016 ceph-mon[29266]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:48:11.771 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:11 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/593820332' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:48:12.026 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-01T06:48:12.026 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-01T06:48:12.227 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:12.273 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:12.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:12 smithi016 ceph-mon[29266]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:48:13.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.661+0000 7fe9da1d1640 1 -- 172.21.15.89:0/193641818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9d40ff780 msgr2=0x7fe9d40ffb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:13.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.661+0000 7fe9da1d1640 1 --2- 172.21.15.89:0/193641818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9d40ff780 0x7fe9d40ffb80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4009c20 tx=0x7fe9c402aa90 comp rx=0 tx=0).stop 2024-08-01T06:48:13.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.661+0000 7fe9da1d1640 1 -- 172.21.15.89:0/193641818 shutdown_connections 2024-08-01T06:48:13.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.661+0000 7fe9da1d1640 1 --2- 172.21.15.89:0/193641818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9d40ff780 0x7fe9d40ffb80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:13.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.661+0000 7fe9da1d1640 1 -- 172.21.15.89:0/193641818 >> 172.21.15.89:0/193641818 conn(0x7fe9d40faf30 msgr2=0x7fe9d40fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:13.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.661+0000 7fe9da1d1640 1 -- 172.21.15.89:0/193641818 shutdown_connections 2024-08-01T06:48:13.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.661+0000 7fe9da1d1640 1 -- 172.21.15.89:0/193641818 wait complete. 2024-08-01T06:48:13.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.662+0000 7fe9da1d1640 1 Processor -- start 2024-08-01T06:48:13.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.662+0000 7fe9da1d1640 1 -- start start 2024-08-01T06:48:13.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.662+0000 7fe9da1d1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9d40ff780 0x7fe9d4194cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:13.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.662+0000 7fe9da1d1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d4195230 con 0x7fe9d40ff780 2024-08-01T06:48:13.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.662+0000 7fe9d37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9d40ff780 0x7fe9d4194cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:13.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.662+0000 7fe9d37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9d40ff780 0x7fe9d4194cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.89:45604/0 (socket says 172.21.15.89:45604) 2024-08-01T06:48:13.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.662+0000 7fe9d37fe640 1 -- 172.21.15.89:0/982372412 learned_addr learned my addr 172.21.15.89:0/982372412 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:48:13.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.663+0000 7fe9d37fe640 1 -- 172.21.15.89:0/982372412 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c4009900 con 0x7fe9d40ff780 2024-08-01T06:48:13.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.663+0000 7fe9d37fe640 1 --2- 172.21.15.89:0/982372412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9d40ff780 0x7fe9d4194cf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4005cc0 tx=0x7fe9c402e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:13.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.663+0000 7fe9d0ff9640 1 -- 172.21.15.89:0/982372412 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9c403e070 con 0x7fe9d40ff780 2024-08-01T06:48:13.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.663+0000 7fe9da1d1640 1 -- 172.21.15.89:0/982372412 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d4195430 con 0x7fe9d40ff780 2024-08-01T06:48:13.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.663+0000 7fe9d0ff9640 1 -- 172.21.15.89:0/982372412 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9c402e990 con 0x7fe9d40ff780 2024-08-01T06:48:13.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.663+0000 7fe9d0ff9640 1 -- 172.21.15.89:0/982372412 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9c4038450 con 0x7fe9d40ff780 2024-08-01T06:48:13.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.663+0000 7fe9da1d1640 1 -- 172.21.15.89:0/982372412 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d41958d0 con 0x7fe9d40ff780 2024-08-01T06:48:13.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.664+0000 7fe9d0ff9640 1 -- 172.21.15.89:0/982372412 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fe9c400a040 con 0x7fe9d40ff780 2024-08-01T06:48:13.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.664+0000 7fe9da1d1640 1 -- 172.21.15.89:0/982372412 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d40ffc00 con 0x7fe9d40ff780 2024-08-01T06:48:13.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.664+0000 7fe9d0ff9640 1 --2- 172.21.15.89:0/982372412 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fe9c0038740 0x7fe9c003ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:13.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.664+0000 7fe9d0ff9640 1 -- 172.21.15.89:0/982372412 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe9c406c260 con 0x7fe9d40ff780 2024-08-01T06:48:13.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.665+0000 7fe9d2ffd640 1 --2- 172.21.15.89:0/982372412 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fe9c0038740 0x7fe9c003ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:13.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.665+0000 7fe9d2ffd640 1 --2- 172.21.15.89:0/982372412 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fe9c0038740 0x7fe9c003ac00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0098c0 tx=0x7fe9bc006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:13.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.669+0000 7fe9d0ff9640 1 -- 172.21.15.89:0/982372412 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fe9c404c440 con 0x7fe9d40ff780 2024-08-01T06:48:13.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.888+0000 7fe9da1d1640 1 -- 172.21.15.89:0/982372412 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe9d418e5b0 con 0x7fe9d40ff780 2024-08-01T06:48:13.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.889+0000 7fe9d0ff9640 1 -- 172.21.15.89:0/982372412 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fe9c4047020 con 0x7fe9d40ff780 2024-08-01T06:48:13.891 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:48:13.891 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":1,"fsid":"a88427da-4fd1-11ef-bcca-c7b262605968","modified":"2024-08-01T06:46:30.398884Z","created":"2024-08-01T06:46:30.398884Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi016","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-01T06:48:13.891 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 1 2024-08-01T06:48:13.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.891+0000 7fe9da1d1640 1 -- 172.21.15.89:0/982372412 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fe9c0038740 msgr2=0x7fe9c003ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:13.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.891+0000 7fe9da1d1640 1 --2- 172.21.15.89:0/982372412 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fe9c0038740 0x7fe9c003ac00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0098c0 tx=0x7fe9bc006db0 comp rx=0 tx=0).stop 2024-08-01T06:48:13.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.891+0000 7fe9da1d1640 1 -- 172.21.15.89:0/982372412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9d40ff780 msgr2=0x7fe9d4194cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:13.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.891+0000 7fe9da1d1640 1 --2- 172.21.15.89:0/982372412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9d40ff780 0x7fe9d4194cf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4005cc0 tx=0x7fe9c402e5f0 comp rx=0 tx=0).stop 2024-08-01T06:48:13.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.891+0000 7fe9da1d1640 1 -- 172.21.15.89:0/982372412 shutdown_connections 2024-08-01T06:48:13.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.891+0000 7fe9da1d1640 1 --2- 172.21.15.89:0/982372412 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fe9c0038740 0x7fe9c003ac00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:13.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.891+0000 7fe9da1d1640 1 --2- 172.21.15.89:0/982372412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9d40ff780 0x7fe9d4194cf0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:13.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.891+0000 7fe9da1d1640 1 -- 172.21.15.89:0/982372412 >> 172.21.15.89:0/982372412 conn(0x7fe9d40faf30 msgr2=0x7fe9d40fb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:13.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.891+0000 7fe9da1d1640 1 -- 172.21.15.89:0/982372412 shutdown_connections 2024-08-01T06:48:13.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:13.891+0000 7fe9da1d1640 1 -- 172.21.15.89:0/982372412 wait complete. 2024-08-01T06:48:14.685 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:14 smithi016 ceph-mon[29266]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:48:14.685 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:14 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/982372412' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:48:15.496 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-01T06:48:15.496 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-01T06:48:15.698 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:15.744 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:16.319 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:16 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:16.319 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:16 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:16.319 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:16 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:16.320 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:16 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:16.320 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:16 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:16.320 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:16 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:16.320 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:16 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:16.320 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:16 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:16.320 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:16 smithi016 ceph-mon[29266]: Deploying daemon prometheus.smithi016 on smithi016 2024-08-01T06:48:16.320 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:16 smithi016 ceph-mon[29266]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:48:17.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.143+0000 7f841d72b640 1 -- 172.21.15.89:0/3482196127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84180ff7e0 msgr2=0x7f84180ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:17.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.143+0000 7f841d72b640 1 --2- 172.21.15.89:0/3482196127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84180ff7e0 0x7f84180ffbe0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8408009880 tx=0x7f840802a5d0 comp rx=0 tx=0).stop 2024-08-01T06:48:17.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.143+0000 7f841d72b640 1 -- 172.21.15.89:0/3482196127 shutdown_connections 2024-08-01T06:48:17.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.143+0000 7f841d72b640 1 --2- 172.21.15.89:0/3482196127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84180ff7e0 0x7f84180ffbe0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:17.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.143+0000 7f841d72b640 1 -- 172.21.15.89:0/3482196127 >> 172.21.15.89:0/3482196127 conn(0x7f84180faf90 msgr2=0x7f84180fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:17.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.143+0000 7f841d72b640 1 -- 172.21.15.89:0/3482196127 shutdown_connections 2024-08-01T06:48:17.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.143+0000 7f841d72b640 1 -- 172.21.15.89:0/3482196127 wait complete. 2024-08-01T06:48:17.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.144+0000 7f841d72b640 1 Processor -- start 2024-08-01T06:48:17.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.144+0000 7f841d72b640 1 -- start start 2024-08-01T06:48:17.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.144+0000 7f841d72b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84180ff7e0 0x7f8418194c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:17.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.144+0000 7f841d72b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84181951a0 con 0x7f84180ff7e0 2024-08-01T06:48:17.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.144+0000 7f8416ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84180ff7e0 0x7f8418194c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:17.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.144+0000 7f8416ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84180ff7e0 0x7f8418194c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.89:33478/0 (socket says 172.21.15.89:33478) 2024-08-01T06:48:17.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.144+0000 7f8416ffd640 1 -- 172.21.15.89:0/2478307833 learned_addr learned my addr 172.21.15.89:0/2478307833 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:48:17.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.145+0000 7f8416ffd640 1 -- 172.21.15.89:0/2478307833 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8408009560 con 0x7f84180ff7e0 2024-08-01T06:48:17.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.145+0000 7f8416ffd640 1 --2- 172.21.15.89:0/2478307833 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84180ff7e0 0x7f8418194c60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8408005610 tx=0x7f8408005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:17.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.145+0000 7f83fffff640 1 -- 172.21.15.89:0/2478307833 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8408004b20 con 0x7f84180ff7e0 2024-08-01T06:48:17.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.145+0000 7f841d72b640 1 -- 172.21.15.89:0/2478307833 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84181953a0 con 0x7f84180ff7e0 2024-08-01T06:48:17.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.145+0000 7f83fffff640 1 -- 172.21.15.89:0/2478307833 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8408004c80 con 0x7f84180ff7e0 2024-08-01T06:48:17.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.145+0000 7f83fffff640 1 -- 172.21.15.89:0/2478307833 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8408031a90 con 0x7f84180ff7e0 2024-08-01T06:48:17.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.145+0000 7f841d72b640 1 -- 172.21.15.89:0/2478307833 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8418195840 con 0x7f84180ff7e0 2024-08-01T06:48:17.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.146+0000 7f83fffff640 1 -- 172.21.15.89:0/2478307833 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f8408031d50 con 0x7f84180ff7e0 2024-08-01T06:48:17.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.146+0000 7f841d72b640 1 -- 172.21.15.89:0/2478307833 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84180ffbe0 con 0x7f84180ff7e0 2024-08-01T06:48:17.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.146+0000 7f83fffff640 1 --2- 172.21.15.89:0/2478307833 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f8400038740 0x7f840003ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:17.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.146+0000 7f83fffff640 1 -- 172.21.15.89:0/2478307833 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f840806c580 con 0x7f84180ff7e0 2024-08-01T06:48:17.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.146+0000 7f84167fc640 1 --2- 172.21.15.89:0/2478307833 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f8400038740 0x7f840003ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:17.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.147+0000 7f84167fc640 1 --2- 172.21.15.89:0/2478307833 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f8400038740 0x7f840003ac00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f840c0098c0 tx=0x7f840c006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:17.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.151+0000 7f83fffff640 1 -- 172.21.15.89:0/2478307833 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f84080443b0 con 0x7f84180ff7e0 2024-08-01T06:48:17.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.372+0000 7f841d72b640 1 -- 172.21.15.89:0/2478307833 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f841818e610 con 0x7f84180ff7e0 2024-08-01T06:48:17.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.372+0000 7f83fffff640 1 -- 172.21.15.89:0/2478307833 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f8408035070 con 0x7f84180ff7e0 2024-08-01T06:48:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:48:17.374 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":1,"fsid":"a88427da-4fd1-11ef-bcca-c7b262605968","modified":"2024-08-01T06:46:30.398884Z","created":"2024-08-01T06:46:30.398884Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi016","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-01T06:48:17.374 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 1 2024-08-01T06:48:17.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.374+0000 7f841d72b640 1 -- 172.21.15.89:0/2478307833 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f8400038740 msgr2=0x7f840003ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:17.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.374+0000 7f841d72b640 1 --2- 172.21.15.89:0/2478307833 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f8400038740 0x7f840003ac00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f840c0098c0 tx=0x7f840c006db0 comp rx=0 tx=0).stop 2024-08-01T06:48:17.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.374+0000 7f841d72b640 1 -- 172.21.15.89:0/2478307833 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84180ff7e0 msgr2=0x7f8418194c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:17.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.374+0000 7f841d72b640 1 --2- 172.21.15.89:0/2478307833 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84180ff7e0 0x7f8418194c60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8408005610 tx=0x7f8408005640 comp rx=0 tx=0).stop 2024-08-01T06:48:17.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.374+0000 7f841d72b640 1 -- 172.21.15.89:0/2478307833 shutdown_connections 2024-08-01T06:48:17.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.374+0000 7f841d72b640 1 --2- 172.21.15.89:0/2478307833 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f8400038740 0x7f840003ac00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:17.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.374+0000 7f841d72b640 1 --2- 172.21.15.89:0/2478307833 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84180ff7e0 0x7f8418194c60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:17.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.374+0000 7f841d72b640 1 -- 172.21.15.89:0/2478307833 >> 172.21.15.89:0/2478307833 conn(0x7f84180faf90 msgr2=0x7f84180fb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:17.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.374+0000 7f841d72b640 1 -- 172.21.15.89:0/2478307833 shutdown_connections 2024-08-01T06:48:17.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:17.374+0000 7f841d72b640 1 -- 172.21.15.89:0/2478307833 wait complete. 2024-08-01T06:48:17.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:17 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/2478307833' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:48:17.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:17 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:18.838 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:18 smithi016 ceph-mon[29266]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:48:18.957 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-01T06:48:18.958 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-01T06:48:19.148 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:19.196 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:20.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.612+0000 7f9c67523640 1 -- 172.21.15.89:0/4136307511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c600fe6e0 msgr2=0x7f9c600feae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:20.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.612+0000 7f9c67523640 1 --2- 172.21.15.89:0/4136307511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c600fe6e0 0x7f9c600feae0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009880 tx=0x7f9c5c02a5d0 comp rx=0 tx=0).stop 2024-08-01T06:48:20.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.612+0000 7f9c67523640 1 -- 172.21.15.89:0/4136307511 shutdown_connections 2024-08-01T06:48:20.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.612+0000 7f9c67523640 1 --2- 172.21.15.89:0/4136307511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c600fe6e0 0x7f9c600feae0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:20.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.612+0000 7f9c67523640 1 -- 172.21.15.89:0/4136307511 >> 172.21.15.89:0/4136307511 conn(0x7f9c600f9e90 msgr2=0x7f9c600fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:20.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.612+0000 7f9c67523640 1 -- 172.21.15.89:0/4136307511 shutdown_connections 2024-08-01T06:48:20.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.612+0000 7f9c67523640 1 -- 172.21.15.89:0/4136307511 wait complete. 2024-08-01T06:48:20.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.612+0000 7f9c67523640 1 Processor -- start 2024-08-01T06:48:20.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.613+0000 7f9c67523640 1 -- start start 2024-08-01T06:48:20.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.613+0000 7f9c67523640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c600fe6e0 0x7f9c60194cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:20.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.613+0000 7f9c67523640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c60195200 con 0x7f9c600fe6e0 2024-08-01T06:48:20.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.613+0000 7f9c652bf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c600fe6e0 0x7f9c60194cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.613+0000 7f9c652bf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c600fe6e0 0x7f9c60194cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.89:33498/0 (socket says 172.21.15.89:33498) 2024-08-01T06:48:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.613+0000 7f9c652bf640 1 -- 172.21.15.89:0/426060653 learned_addr learned my addr 172.21.15.89:0/426060653 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:48:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.613+0000 7f9c652bf640 1 -- 172.21.15.89:0/426060653 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c009560 con 0x7f9c600fe6e0 2024-08-01T06:48:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.613+0000 7f9c652bf640 1 --2- 172.21.15.89:0/426060653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c600fe6e0 0x7f9c60194cc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c005610 tx=0x7f9c5c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.614+0000 7f9c567fc640 1 -- 172.21.15.89:0/426060653 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c5c004b20 con 0x7f9c600fe6e0 2024-08-01T06:48:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.614+0000 7f9c567fc640 1 -- 172.21.15.89:0/426060653 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c5c004c80 con 0x7f9c600fe6e0 2024-08-01T06:48:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.614+0000 7f9c567fc640 1 -- 172.21.15.89:0/426060653 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c5c031a90 con 0x7f9c600fe6e0 2024-08-01T06:48:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.614+0000 7f9c67523640 1 -- 172.21.15.89:0/426060653 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c60195400 con 0x7f9c600fe6e0 2024-08-01T06:48:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.614+0000 7f9c67523640 1 -- 172.21.15.89:0/426060653 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c601958a0 con 0x7f9c600fe6e0 2024-08-01T06:48:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.614+0000 7f9c567fc640 1 -- 172.21.15.89:0/426060653 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f9c5c031d00 con 0x7f9c600fe6e0 2024-08-01T06:48:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.615+0000 7f9c67523640 1 -- 172.21.15.89:0/426060653 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c600feae0 con 0x7f9c600fe6e0 2024-08-01T06:48:20.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.615+0000 7f9c567fc640 1 --2- 172.21.15.89:0/426060653 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f9c4c038790 0x7f9c4c03ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:20.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.615+0000 7f9c567fc640 1 -- 172.21.15.89:0/426060653 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9c5c06c520 con 0x7f9c600fe6e0 2024-08-01T06:48:20.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.615+0000 7f9c64abe640 1 --2- 172.21.15.89:0/426060653 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f9c4c038790 0x7f9c4c03ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:20.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.615+0000 7f9c64abe640 1 --2- 172.21.15.89:0/426060653 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f9c4c038790 0x7f9c4c03ac50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9c500098c0 tx=0x7f9c50006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:20.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.620+0000 7f9c567fc640 1 -- 172.21.15.89:0/426060653 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f9c5c04dd20 con 0x7f9c600fe6e0 2024-08-01T06:48:20.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.841+0000 7f9c67523640 1 -- 172.21.15.89:0/426060653 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9c6018e750 con 0x7f9c600fe6e0 2024-08-01T06:48:20.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.841+0000 7f9c567fc640 1 -- 172.21.15.89:0/426060653 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f9c5c035020 con 0x7f9c600fe6e0 2024-08-01T06:48:20.843 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:48:20.843 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":1,"fsid":"a88427da-4fd1-11ef-bcca-c7b262605968","modified":"2024-08-01T06:46:30.398884Z","created":"2024-08-01T06:46:30.398884Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi016","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-01T06:48:20.844 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 1 2024-08-01T06:48:20.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.843+0000 7f9c67523640 1 -- 172.21.15.89:0/426060653 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f9c4c038790 msgr2=0x7f9c4c03ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:20.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.843+0000 7f9c67523640 1 --2- 172.21.15.89:0/426060653 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f9c4c038790 0x7f9c4c03ac50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9c500098c0 tx=0x7f9c50006db0 comp rx=0 tx=0).stop 2024-08-01T06:48:20.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.843+0000 7f9c67523640 1 -- 172.21.15.89:0/426060653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c600fe6e0 msgr2=0x7f9c60194cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:20.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.843+0000 7f9c67523640 1 --2- 172.21.15.89:0/426060653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c600fe6e0 0x7f9c60194cc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c005610 tx=0x7f9c5c005640 comp rx=0 tx=0).stop 2024-08-01T06:48:20.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.843+0000 7f9c67523640 1 -- 172.21.15.89:0/426060653 shutdown_connections 2024-08-01T06:48:20.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.843+0000 7f9c67523640 1 --2- 172.21.15.89:0/426060653 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f9c4c038790 0x7f9c4c03ac50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:20.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.843+0000 7f9c67523640 1 --2- 172.21.15.89:0/426060653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c600fe6e0 0x7f9c60194cc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:20.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.843+0000 7f9c67523640 1 -- 172.21.15.89:0/426060653 >> 172.21.15.89:0/426060653 conn(0x7f9c600f9e90 msgr2=0x7f9c60068340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:20.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.843+0000 7f9c67523640 1 -- 172.21.15.89:0/426060653 shutdown_connections 2024-08-01T06:48:20.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:20.844+0000 7f9c67523640 1 -- 172.21.15.89:0/426060653 wait complete. 2024-08-01T06:48:20.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:20 smithi016 ceph-mon[29266]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:48:21.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:21 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/426060653' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:48:22.415 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-01T06:48:22.415 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-01T06:48:22.615 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:22.662 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:22.847 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:22 smithi016 ceph-mon[29266]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:48:24.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.101+0000 7f02c2a28640 1 -- 172.21.15.89:0/584272205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02bc0fe6d0 msgr2=0x7f02bc0fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:24.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.101+0000 7f02c2a28640 1 --2- 172.21.15.89:0/584272205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02bc0fe6d0 0x7f02bc0fead0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009880 tx=0x7f02ac02a5d0 comp rx=0 tx=0).stop 2024-08-01T06:48:24.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.101+0000 7f02c2a28640 1 -- 172.21.15.89:0/584272205 shutdown_connections 2024-08-01T06:48:24.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.101+0000 7f02c2a28640 1 --2- 172.21.15.89:0/584272205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02bc0fe6d0 0x7f02bc0fead0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:24.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.101+0000 7f02c2a28640 1 -- 172.21.15.89:0/584272205 >> 172.21.15.89:0/584272205 conn(0x7f02bc0f9e80 msgr2=0x7f02bc0fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:24.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.101+0000 7f02c2a28640 1 -- 172.21.15.89:0/584272205 shutdown_connections 2024-08-01T06:48:24.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.101+0000 7f02c2a28640 1 -- 172.21.15.89:0/584272205 wait complete. 2024-08-01T06:48:24.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.101+0000 7f02c2a28640 1 Processor -- start 2024-08-01T06:48:24.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.101+0000 7f02c2a28640 1 -- start start 2024-08-01T06:48:24.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.101+0000 7f02c2a28640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02bc0fe6d0 0x7f02bc068120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:24.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.101+0000 7f02c2a28640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc068660 con 0x7f02bc0fe6d0 2024-08-01T06:48:24.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.102+0000 7f02bbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02bc0fe6d0 0x7f02bc068120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:24.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.102+0000 7f02bbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02bc0fe6d0 0x7f02bc068120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.89:33518/0 (socket says 172.21.15.89:33518) 2024-08-01T06:48:24.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.102+0000 7f02bbfff640 1 -- 172.21.15.89:0/1902151499 learned_addr learned my addr 172.21.15.89:0/1902151499 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:48:24.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.102+0000 7f02bbfff640 1 -- 172.21.15.89:0/1902151499 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac009560 con 0x7f02bc0fe6d0 2024-08-01T06:48:24.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.102+0000 7f02bbfff640 1 --2- 172.21.15.89:0/1902151499 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02bc0fe6d0 0x7f02bc068120 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009230 tx=0x7f02ac0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:24.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.102+0000 7f02b9ffb640 1 -- 172.21.15.89:0/1902151499 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02ac004950 con 0x7f02bc0fe6d0 2024-08-01T06:48:24.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.102+0000 7f02c2a28640 1 -- 172.21.15.89:0/1902151499 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02bc197ac0 con 0x7f02bc0fe6d0 2024-08-01T06:48:24.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.102+0000 7f02b9ffb640 1 -- 172.21.15.89:0/1902151499 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f02ac0035f0 con 0x7f02bc0fe6d0 2024-08-01T06:48:24.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.102+0000 7f02b9ffb640 1 -- 172.21.15.89:0/1902151499 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02ac031820 con 0x7f02bc0fe6d0 2024-08-01T06:48:24.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.102+0000 7f02c2a28640 1 -- 172.21.15.89:0/1902151499 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02bc197f60 con 0x7f02bc0fe6d0 2024-08-01T06:48:24.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.103+0000 7f02b9ffb640 1 -- 172.21.15.89:0/1902151499 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f02ac004ab0 con 0x7f02bc0fe6d0 2024-08-01T06:48:24.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.103+0000 7f02c2a28640 1 -- 172.21.15.89:0/1902151499 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02bc0fead0 con 0x7f02bc0fe6d0 2024-08-01T06:48:24.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.104+0000 7f02b9ffb640 1 --2- 172.21.15.89:0/1902151499 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f02a8038740 0x7f02a803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:24.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.104+0000 7f02b9ffb640 1 -- 172.21.15.89:0/1902151499 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f02ac06c360 con 0x7f02bc0fe6d0 2024-08-01T06:48:24.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.104+0000 7f02b3fff640 1 --2- 172.21.15.89:0/1902151499 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f02a8038740 0x7f02a803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:24.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.104+0000 7f02b3fff640 1 --2- 172.21.15.89:0/1902151499 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f02a8038740 0x7f02a803ac00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f02a40098c0 tx=0x7f02a4006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:24.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.108+0000 7f02b9ffb640 1 -- 172.21.15.89:0/1902151499 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f02ac003760 con 0x7f02bc0fe6d0 2024-08-01T06:48:24.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.331+0000 7f02c2a28640 1 -- 172.21.15.89:0/1902151499 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f02bc18d500 con 0x7f02bc0fe6d0 2024-08-01T06:48:24.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.332+0000 7f02b9ffb640 1 -- 172.21.15.89:0/1902151499 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f02ac035070 con 0x7f02bc0fe6d0 2024-08-01T06:48:24.333 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:48:24.333 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":1,"fsid":"a88427da-4fd1-11ef-bcca-c7b262605968","modified":"2024-08-01T06:46:30.398884Z","created":"2024-08-01T06:46:30.398884Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi016","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-01T06:48:24.333 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 1 2024-08-01T06:48:24.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.333+0000 7f02c2a28640 1 -- 172.21.15.89:0/1902151499 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f02a8038740 msgr2=0x7f02a803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:24.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.333+0000 7f02c2a28640 1 --2- 172.21.15.89:0/1902151499 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f02a8038740 0x7f02a803ac00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f02a40098c0 tx=0x7f02a4006db0 comp rx=0 tx=0).stop 2024-08-01T06:48:24.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.333+0000 7f02c2a28640 1 -- 172.21.15.89:0/1902151499 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02bc0fe6d0 msgr2=0x7f02bc068120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:24.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.333+0000 7f02c2a28640 1 --2- 172.21.15.89:0/1902151499 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02bc0fe6d0 0x7f02bc068120 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009230 tx=0x7f02ac0056e0 comp rx=0 tx=0).stop 2024-08-01T06:48:24.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.334+0000 7f02c2a28640 1 -- 172.21.15.89:0/1902151499 shutdown_connections 2024-08-01T06:48:24.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.334+0000 7f02c2a28640 1 --2- 172.21.15.89:0/1902151499 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f02a8038740 0x7f02a803ac00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:24.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.334+0000 7f02c2a28640 1 --2- 172.21.15.89:0/1902151499 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02bc0fe6d0 0x7f02bc068120 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:24.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.334+0000 7f02c2a28640 1 -- 172.21.15.89:0/1902151499 >> 172.21.15.89:0/1902151499 conn(0x7f02bc0f9e80 msgr2=0x7f02bc0fa900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:24.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.334+0000 7f02c2a28640 1 -- 172.21.15.89:0/1902151499 shutdown_connections 2024-08-01T06:48:24.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:24.334+0000 7f02c2a28640 1 -- 172.21.15.89:0/1902151499 wait complete. 2024-08-01T06:48:24.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:24 smithi016 ceph-mon[29266]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:48:24.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:24 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/1902151499' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:48:25.917 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-01T06:48:25.917 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-01T06:48:26.118 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:26.162 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:26.549 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:26 smithi016 ceph-mon[29266]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:48:27.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.387+0000 7fa264277640 1 -- 172.21.15.89:0/1580542170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa25c0fe6e0 msgr2=0x7fa25c0feae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.387+0000 7fa264277640 1 --2- 172.21.15.89:0/1580542170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa25c0fe6e0 0x7fa25c0feae0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa258009880 tx=0x7fa25802a5d0 comp rx=0 tx=0).stop 2024-08-01T06:48:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.387+0000 7fa264277640 1 -- 172.21.15.89:0/1580542170 shutdown_connections 2024-08-01T06:48:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.387+0000 7fa264277640 1 --2- 172.21.15.89:0/1580542170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa25c0fe6e0 0x7fa25c0feae0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.387+0000 7fa264277640 1 -- 172.21.15.89:0/1580542170 >> 172.21.15.89:0/1580542170 conn(0x7fa25c0f9e90 msgr2=0x7fa25c0fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.387+0000 7fa264277640 1 -- 172.21.15.89:0/1580542170 shutdown_connections 2024-08-01T06:48:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.387+0000 7fa264277640 1 -- 172.21.15.89:0/1580542170 wait complete. 2024-08-01T06:48:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.387+0000 7fa264277640 1 Processor -- start 2024-08-01T06:48:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.387+0000 7fa264277640 1 -- start start 2024-08-01T06:48:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.388+0000 7fa264277640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa25c0fe6e0 0x7fa25c196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:27.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.388+0000 7fa264277640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c197410 con 0x7fa25c0fe6e0 2024-08-01T06:48:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.388+0000 7fa262013640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa25c0fe6e0 0x7fa25c196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.388+0000 7fa262013640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa25c0fe6e0 0x7fa25c196ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.89:35594/0 (socket says 172.21.15.89:35594) 2024-08-01T06:48:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.388+0000 7fa262013640 1 -- 172.21.15.89:0/2778904916 learned_addr learned my addr 172.21.15.89:0/2778904916 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:48:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.388+0000 7fa262013640 1 -- 172.21.15.89:0/2778904916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa258009560 con 0x7fa25c0fe6e0 2024-08-01T06:48:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.388+0000 7fa262013640 1 --2- 172.21.15.89:0/2778904916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa25c0fe6e0 0x7fa25c196ed0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa258005610 tx=0x7fa258005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.389+0000 7fa2537fe640 1 -- 172.21.15.89:0/2778904916 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa258004b20 con 0x7fa25c0fe6e0 2024-08-01T06:48:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.389+0000 7fa264277640 1 -- 172.21.15.89:0/2778904916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25c197610 con 0x7fa25c0fe6e0 2024-08-01T06:48:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.389+0000 7fa2537fe640 1 -- 172.21.15.89:0/2778904916 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa258004c80 con 0x7fa25c0fe6e0 2024-08-01T06:48:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.389+0000 7fa2537fe640 1 -- 172.21.15.89:0/2778904916 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa258031a90 con 0x7fa25c0fe6e0 2024-08-01T06:48:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.389+0000 7fa264277640 1 -- 172.21.15.89:0/2778904916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25c197ab0 con 0x7fa25c0fe6e0 2024-08-01T06:48:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.390+0000 7fa2537fe640 1 -- 172.21.15.89:0/2778904916 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fa258031d50 con 0x7fa25c0fe6e0 2024-08-01T06:48:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.390+0000 7fa264277640 1 -- 172.21.15.89:0/2778904916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25c0feae0 con 0x7fa25c0fe6e0 2024-08-01T06:48:27.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.390+0000 7fa2537fe640 1 --2- 172.21.15.89:0/2778904916 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fa248038740 0x7fa24803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:27.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.390+0000 7fa2537fe640 1 -- 172.21.15.89:0/2778904916 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa25806c580 con 0x7fa25c0fe6e0 2024-08-01T06:48:27.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.390+0000 7fa261812640 1 --2- 172.21.15.89:0/2778904916 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fa248038740 0x7fa24803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:27.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.391+0000 7fa261812640 1 --2- 172.21.15.89:0/2778904916 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fa248038740 0x7fa24803ac00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0098c0 tx=0x7fa24c006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:27.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.395+0000 7fa2537fe640 1 -- 172.21.15.89:0/2778904916 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fa25804d9a0 con 0x7fa25c0fe6e0 2024-08-01T06:48:27.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.509+0000 7fa2537fe640 1 -- 172.21.15.89:0/2778904916 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mgrmap(e 14) v1 ==== 45626+0+0 (secure 0 0 0) 0x7fa258003970 con 0x7fa25c0fe6e0 2024-08-01T06:48:27.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.534+0000 7fa261812640 1 -- 172.21.15.89:0/2778904916 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fa248038740 msgr2=0x7fa24803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-01T06:48:27.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.534+0000 7fa261812640 1 -- 172.21.15.89:0/2778904916 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fa248038740 msgr2=0x7fa24803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-01T06:48:27.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.534+0000 7fa261812640 1 --2- 172.21.15.89:0/2778904916 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fa248038740 0x7fa24803ac00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0098c0 tx=0x7fa24c006db0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-01T06:48:27.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.534+0000 7fa261812640 1 --2- 172.21.15.89:0/2778904916 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fa248038740 0x7fa24803ac00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0098c0 tx=0x7fa24c006db0 comp rx=0 tx=0).stop 2024-08-01T06:48:27.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.534+0000 7fa2537fe640 1 -- 172.21.15.89:0/2778904916 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fa248038740 msgr2=0x7fa24803ac00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-01T06:48:27.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.534+0000 7fa2537fe640 1 --2- 172.21.15.89:0/2778904916 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fa248038740 0x7fa24803ac00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:27.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.627+0000 7fa264277640 1 -- 172.21.15.89:0/2778904916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa244005100 con 0x7fa25c0fe6e0 2024-08-01T06:48:27.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.628+0000 7fa2537fe640 1 -- 172.21.15.89:0/2778904916 <== mon.0 v2:172.21.15.16:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fa258035070 con 0x7fa25c0fe6e0 2024-08-01T06:48:27.629 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:48:27.630 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":1,"fsid":"a88427da-4fd1-11ef-bcca-c7b262605968","modified":"2024-08-01T06:46:30.398884Z","created":"2024-08-01T06:46:30.398884Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi016","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-01T06:48:27.630 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 1 2024-08-01T06:48:27.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.630+0000 7fa264277640 1 -- 172.21.15.89:0/2778904916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa25c0fe6e0 msgr2=0x7fa25c196ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:27.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.630+0000 7fa264277640 1 --2- 172.21.15.89:0/2778904916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa25c0fe6e0 0x7fa25c196ed0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa258005610 tx=0x7fa258005640 comp rx=0 tx=0).stop 2024-08-01T06:48:27.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.630+0000 7fa264277640 1 -- 172.21.15.89:0/2778904916 shutdown_connections 2024-08-01T06:48:27.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.630+0000 7fa264277640 1 --2- 172.21.15.89:0/2778904916 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7fa248038740 0x7fa24803ac00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:27.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.630+0000 7fa264277640 1 --2- 172.21.15.89:0/2778904916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa25c0fe6e0 0x7fa25c196ed0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:27.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.630+0000 7fa264277640 1 -- 172.21.15.89:0/2778904916 >> 172.21.15.89:0/2778904916 conn(0x7fa25c0f9e90 msgr2=0x7fa25c068380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:27.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.630+0000 7fa264277640 1 -- 172.21.15.89:0/2778904916 shutdown_connections 2024-08-01T06:48:27.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:27.630+0000 7fa264277640 1 -- 172.21.15.89:0/2778904916 wait complete. 2024-08-01T06:48:27.833 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:27 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:27.833 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:27 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:27.833 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:27 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:27.834 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:27 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-08-01T06:48:27.834 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:27 smithi016 ceph-mon[29266]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:48:27.834 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:27 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:28.860 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:28 smithi016 ceph-mon[29266]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-08-01T06:48:28.860 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:28 smithi016 ceph-mon[29266]: mgrmap e14: smithi016.whigbo(active, since 60s) 2024-08-01T06:48:28.860 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:28 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/2778904916' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:48:29.137 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-01T06:48:29.137 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-01T06:48:29.338 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:29.384 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:30.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.793+0000 7f0bf92d2640 1 -- 172.21.15.89:0/3201913420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bf40fe6e0 msgr2=0x7f0bf40feae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:30.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.793+0000 7f0bf92d2640 1 --2- 172.21.15.89:0/3201913420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bf40fe6e0 0x7f0bf40feae0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009880 tx=0x7f0be402a5d0 comp rx=0 tx=0).stop 2024-08-01T06:48:30.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.793+0000 7f0bf92d2640 1 -- 172.21.15.89:0/3201913420 shutdown_connections 2024-08-01T06:48:30.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.793+0000 7f0bf92d2640 1 --2- 172.21.15.89:0/3201913420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bf40fe6e0 0x7f0bf40feae0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:30.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.793+0000 7f0bf92d2640 1 -- 172.21.15.89:0/3201913420 >> 172.21.15.89:0/3201913420 conn(0x7f0bf40f9e90 msgr2=0x7f0bf40fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:30.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.793+0000 7f0bf92d2640 1 -- 172.21.15.89:0/3201913420 shutdown_connections 2024-08-01T06:48:30.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.793+0000 7f0bf92d2640 1 -- 172.21.15.89:0/3201913420 wait complete. 2024-08-01T06:48:30.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.794+0000 7f0bf92d2640 1 Processor -- start 2024-08-01T06:48:30.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.794+0000 7f0bf92d2640 1 -- start start 2024-08-01T06:48:30.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.794+0000 7f0bf92d2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bf40fe6e0 0x7f0bf4068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:30.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.794+0000 7f0bf92d2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf4068e80 con 0x7f0bf40fe6e0 2024-08-01T06:48:30.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.795+0000 7f0bf2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bf40fe6e0 0x7f0bf4068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:30.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.795+0000 7f0bf2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bf40fe6e0 0x7f0bf4068940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.89:35618/0 (socket says 172.21.15.89:35618) 2024-08-01T06:48:30.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.795+0000 7f0bf2ffd640 1 -- 172.21.15.89:0/1677670582 learned_addr learned my addr 172.21.15.89:0/1677670582 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:48:30.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.795+0000 7f0bf2ffd640 1 -- 172.21.15.89:0/1677670582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be4009560 con 0x7f0bf40fe6e0 2024-08-01T06:48:30.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.795+0000 7f0bf2ffd640 1 --2- 172.21.15.89:0/1677670582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bf40fe6e0 0x7f0bf4068940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0be4005610 tx=0x7f0be4005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:30.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.795+0000 7f0bf0ff9640 1 -- 172.21.15.89:0/1677670582 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0be40049d0 con 0x7f0bf40fe6e0 2024-08-01T06:48:30.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.795+0000 7f0bf0ff9640 1 -- 172.21.15.89:0/1677670582 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0be4004b30 con 0x7f0bf40fe6e0 2024-08-01T06:48:30.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.795+0000 7f0bf92d2640 1 -- 172.21.15.89:0/1677670582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf4197a20 con 0x7f0bf40fe6e0 2024-08-01T06:48:30.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.795+0000 7f0bf0ff9640 1 -- 172.21.15.89:0/1677670582 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0be40318e0 con 0x7f0bf40fe6e0 2024-08-01T06:48:30.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.795+0000 7f0bf92d2640 1 -- 172.21.15.89:0/1677670582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf4197ec0 con 0x7f0bf40fe6e0 2024-08-01T06:48:30.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.796+0000 7f0bf92d2640 1 -- 172.21.15.89:0/1677670582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf40feae0 con 0x7f0bf40fe6e0 2024-08-01T06:48:30.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.796+0000 7f0bf0ff9640 1 -- 172.21.15.89:0/1677670582 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 14) v1 ==== 45626+0+0 (secure 0 0 0) 0x7f0be4031ba0 con 0x7f0bf40fe6e0 2024-08-01T06:48:30.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.797+0000 7f0bf0ff9640 1 --2- 172.21.15.89:0/1677670582 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f0be0038790 0x7f0be003ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:30.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.797+0000 7f0bf0ff9640 1 -- 172.21.15.89:0/1677670582 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0be406c3d0 con 0x7f0bf40fe6e0 2024-08-01T06:48:30.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.797+0000 7f0bea7fc640 1 -- 172.21.15.89:0/1677670582 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f0be0038790 msgr2=0x7f0be003ac50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.16:6800/3100338993 2024-08-01T06:48:30.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.797+0000 7f0bea7fc640 1 --2- 172.21.15.89:0/1677670582 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f0be0038790 0x7f0be003ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-01T06:48:30.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.801+0000 7f0bf0ff9640 1 -- 172.21.15.89:0/1677670582 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f0be404d530 con 0x7f0bf40fe6e0 2024-08-01T06:48:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.998+0000 7f0bea7fc640 1 -- 172.21.15.89:0/1677670582 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f0be0038790 msgr2=0x7f0be003ac50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.16:6800/3100338993 2024-08-01T06:48:30.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:30.998+0000 7f0bea7fc640 1 --2- 172.21.15.89:0/1677670582 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f0be0038790 0x7f0be003ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-01T06:48:31.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:31.023+0000 7f0bf92d2640 1 -- 172.21.15.89:0/1677670582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0bf418d510 con 0x7f0bf40fe6e0 2024-08-01T06:48:31.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:31.024+0000 7f0bf0ff9640 1 -- 172.21.15.89:0/1677670582 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f0be4035020 con 0x7f0bf40fe6e0 2024-08-01T06:48:31.025 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:48:31.025 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":1,"fsid":"a88427da-4fd1-11ef-bcca-c7b262605968","modified":"2024-08-01T06:46:30.398884Z","created":"2024-08-01T06:46:30.398884Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi016","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-01T06:48:31.026 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 1 2024-08-01T06:48:31.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:31.025+0000 7f0bf92d2640 1 -- 172.21.15.89:0/1677670582 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f0be0038790 msgr2=0x7f0be003ac50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-01T06:48:31.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:31.025+0000 7f0bf92d2640 1 --2- 172.21.15.89:0/1677670582 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f0be0038790 0x7f0be003ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:31.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:31.025+0000 7f0bf92d2640 1 -- 172.21.15.89:0/1677670582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bf40fe6e0 msgr2=0x7f0bf4068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:31.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:31.025+0000 7f0bf92d2640 1 --2- 172.21.15.89:0/1677670582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bf40fe6e0 0x7f0bf4068940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0be4005610 tx=0x7f0be4005640 comp rx=0 tx=0).stop 2024-08-01T06:48:31.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:31.026+0000 7f0bf92d2640 1 -- 172.21.15.89:0/1677670582 shutdown_connections 2024-08-01T06:48:31.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:31.026+0000 7f0bf92d2640 1 --2- 172.21.15.89:0/1677670582 >> [v2:172.21.15.16:6800/3100338993,v1:172.21.15.16:6801/3100338993] conn(0x7f0be0038790 0x7f0be003ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:31.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:31.026+0000 7f0bf92d2640 1 --2- 172.21.15.89:0/1677670582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bf40fe6e0 0x7f0bf4068940 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:31.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:31.026+0000 7f0bf92d2640 1 -- 172.21.15.89:0/1677670582 >> 172.21.15.89:0/1677670582 conn(0x7f0bf40f9e90 msgr2=0x7f0bf40fa860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:31.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:31.026+0000 7f0bf92d2640 1 -- 172.21.15.89:0/1677670582 shutdown_connections 2024-08-01T06:48:31.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:31.026+0000 7f0bf92d2640 1 -- 172.21.15.89:0/1677670582 wait complete. 2024-08-01T06:48:31.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:31 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/1677670582' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:48:32.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:32 smithi016 ceph-mon[29266]: Active manager daemon smithi016.whigbo restarted 2024-08-01T06:48:32.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:32 smithi016 ceph-mon[29266]: Activating manager daemon smithi016.whigbo 2024-08-01T06:48:32.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:32 smithi016 ceph-mon[29266]: osdmap e5: 0 total, 0 up, 0 in 2024-08-01T06:48:32.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:32 smithi016 ceph-mon[29266]: mgrmap e15: smithi016.whigbo(active, starting, since 0.00304118s) 2024-08-01T06:48:32.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:32 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:48:32.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:32 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr metadata", "who": "smithi016.whigbo", "id": "smithi016.whigbo"}]: dispatch 2024-08-01T06:48:32.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:32 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-01T06:48:32.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:32 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-01T06:48:32.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:32 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-01T06:48:32.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:32 smithi016 ceph-mon[29266]: Manager daemon smithi016.whigbo is now available 2024-08-01T06:48:32.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:32 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:48:32.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:32 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:32.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:32 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:48:32.668 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-01T06:48:32.668 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-01T06:48:32.872 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:32.918 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:33.870 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:33 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi016.whigbo/mirror_snapshot_schedule"}]: dispatch 2024-08-01T06:48:33.870 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:33 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi016.whigbo/trash_purge_schedule"}]: dispatch 2024-08-01T06:48:33.870 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:33 smithi016 ceph-mon[29266]: mgrmap e16: smithi016.whigbo(active, since 1.00561s) 2024-08-01T06:48:33.870 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:33 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:34.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.337+0000 7fce6334d640 1 -- 172.21.15.89:0/354442679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce5c0fe6f0 msgr2=0x7fce5c0feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:34.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.337+0000 7fce6334d640 1 --2- 172.21.15.89:0/354442679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce5c0fe6f0 0x7fce5c0feaf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fce58009880 tx=0x7fce5802a5d0 comp rx=0 tx=0).stop 2024-08-01T06:48:34.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.337+0000 7fce6334d640 1 -- 172.21.15.89:0/354442679 shutdown_connections 2024-08-01T06:48:34.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.337+0000 7fce6334d640 1 --2- 172.21.15.89:0/354442679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce5c0fe6f0 0x7fce5c0feaf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:34.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.337+0000 7fce6334d640 1 -- 172.21.15.89:0/354442679 >> 172.21.15.89:0/354442679 conn(0x7fce5c0f9e80 msgr2=0x7fce5c0fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:34.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.337+0000 7fce6334d640 1 -- 172.21.15.89:0/354442679 shutdown_connections 2024-08-01T06:48:34.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.337+0000 7fce6334d640 1 -- 172.21.15.89:0/354442679 wait complete. 2024-08-01T06:48:34.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.338+0000 7fce6334d640 1 Processor -- start 2024-08-01T06:48:34.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.338+0000 7fce6334d640 1 -- start start 2024-08-01T06:48:34.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.338+0000 7fce6334d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce5c0fe6f0 0x7fce5c068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:34.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.338+0000 7fce6334d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c068e80 con 0x7fce5c0fe6f0 2024-08-01T06:48:34.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.338+0000 7fce610e9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce5c0fe6f0 0x7fce5c068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:34.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.338+0000 7fce610e9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce5c0fe6f0 0x7fce5c068940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.89:35634/0 (socket says 172.21.15.89:35634) 2024-08-01T06:48:34.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.338+0000 7fce610e9640 1 -- 172.21.15.89:0/2334295887 learned_addr learned my addr 172.21.15.89:0/2334295887 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:48:34.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.339+0000 7fce610e9640 1 -- 172.21.15.89:0/2334295887 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce58009560 con 0x7fce5c0fe6f0 2024-08-01T06:48:34.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.339+0000 7fce610e9640 1 --2- 172.21.15.89:0/2334295887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce5c0fe6f0 0x7fce5c068940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fce58005610 tx=0x7fce58005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:34.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.339+0000 7fce527fc640 1 -- 172.21.15.89:0/2334295887 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce580049d0 con 0x7fce5c0fe6f0 2024-08-01T06:48:34.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.339+0000 7fce527fc640 1 -- 172.21.15.89:0/2334295887 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce58004b30 con 0x7fce5c0fe6f0 2024-08-01T06:48:34.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.339+0000 7fce527fc640 1 -- 172.21.15.89:0/2334295887 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce58031910 con 0x7fce5c0fe6f0 2024-08-01T06:48:34.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.339+0000 7fce6334d640 1 -- 172.21.15.89:0/2334295887 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5c1957e0 con 0x7fce5c0fe6f0 2024-08-01T06:48:34.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.339+0000 7fce6334d640 1 -- 172.21.15.89:0/2334295887 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5c19a0a0 con 0x7fce5c0fe6f0 2024-08-01T06:48:34.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.340+0000 7fce527fc640 1 -- 172.21.15.89:0/2334295887 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 16) v1 ==== 45477+0+0 (secure 0 0 0) 0x7fce58003c20 con 0x7fce5c0fe6f0 2024-08-01T06:48:34.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.340+0000 7fce6334d640 1 -- 172.21.15.89:0/2334295887 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5c0feaf0 con 0x7fce5c0fe6f0 2024-08-01T06:48:34.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.340+0000 7fce527fc640 1 --2- 172.21.15.89:0/2334295887 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fce480385d0 0x7fce4803aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:34.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.340+0000 7fce527fc640 1 -- 172.21.15.89:0/2334295887 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fce5806c2e0 con 0x7fce5c0fe6f0 2024-08-01T06:48:34.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.340+0000 7fce608e8640 1 --2- 172.21.15.89:0/2334295887 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fce480385d0 0x7fce4803aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:34.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.341+0000 7fce608e8640 1 --2- 172.21.15.89:0/2334295887 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fce480385d0 0x7fce4803aa90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0098c0 tx=0x7fce4c006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:34.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.349+0000 7fce527fc640 1 -- 172.21.15.89:0/2334295887 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fce5804d710 con 0x7fce5c0fe6f0 2024-08-01T06:48:34.587 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.585+0000 7fce6334d640 1 -- 172.21.15.89:0/2334295887 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fce5c18d520 con 0x7fce5c0fe6f0 2024-08-01T06:48:34.587 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.586+0000 7fce527fc640 1 -- 172.21.15.89:0/2334295887 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fce58035070 con 0x7fce5c0fe6f0 2024-08-01T06:48:34.588 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:48:34.588 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":1,"fsid":"a88427da-4fd1-11ef-bcca-c7b262605968","modified":"2024-08-01T06:46:30.398884Z","created":"2024-08-01T06:46:30.398884Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi016","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-01T06:48:34.588 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 1 2024-08-01T06:48:34.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.588+0000 7fce6334d640 1 -- 172.21.15.89:0/2334295887 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fce480385d0 msgr2=0x7fce4803aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:34.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.588+0000 7fce6334d640 1 --2- 172.21.15.89:0/2334295887 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fce480385d0 0x7fce4803aa90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0098c0 tx=0x7fce4c006db0 comp rx=0 tx=0).stop 2024-08-01T06:48:34.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.588+0000 7fce6334d640 1 -- 172.21.15.89:0/2334295887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce5c0fe6f0 msgr2=0x7fce5c068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:34.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.588+0000 7fce6334d640 1 --2- 172.21.15.89:0/2334295887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce5c0fe6f0 0x7fce5c068940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fce58005610 tx=0x7fce58005640 comp rx=0 tx=0).stop 2024-08-01T06:48:34.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.588+0000 7fce6334d640 1 -- 172.21.15.89:0/2334295887 shutdown_connections 2024-08-01T06:48:34.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.588+0000 7fce6334d640 1 --2- 172.21.15.89:0/2334295887 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fce480385d0 0x7fce4803aa90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:34.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.588+0000 7fce6334d640 1 --2- 172.21.15.89:0/2334295887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce5c0fe6f0 0x7fce5c068940 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:34.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.588+0000 7fce6334d640 1 -- 172.21.15.89:0/2334295887 >> 172.21.15.89:0/2334295887 conn(0x7fce5c0f9e80 msgr2=0x7fce5c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:34.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.588+0000 7fce6334d640 1 -- 172.21.15.89:0/2334295887 shutdown_connections 2024-08-01T06:48:34.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:34.588+0000 7fce6334d640 1 -- 172.21.15.89:0/2334295887 wait complete. 2024-08-01T06:48:35.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:35 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:35.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:35 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/2334295887' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:48:35.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:35 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:36.155 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-01T06:48:36.156 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-01T06:48:36.526 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:36.680 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:36 smithi016 ceph-mon[29266]: [01/Aug/2024:06:48:34] ENGINE Bus STARTING 2024-08-01T06:48:36.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:36 smithi016 ceph-mon[29266]: [01/Aug/2024:06:48:35] ENGINE Serving on https://172.21.15.16:7150 2024-08-01T06:48:36.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:36 smithi016 ceph-mon[29266]: [01/Aug/2024:06:48:35] ENGINE Error in HTTPServer.serve 2024-08-01T06:48:36.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Traceback (most recent call last): 2024-08-01T06:48:36.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-01T06:48:36.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self._connections.run(self.expiration_interval) 2024-08-01T06:48:36.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-01T06:48:36.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self._run(expiration_interval) 2024-08-01T06:48:36.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-01T06:48:36.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-01T06:48:36.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-01T06:48:36.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-01T06:48:36.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-01T06:48:36.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: s = self.context.wrap_socket( 2024-08-01T06:48:36.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-01T06:48:36.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: return self.sslsocket_class._create( 2024-08-01T06:48:36.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-01T06:48:36.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self.do_handshake() 2024-08-01T06:48:36.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-01T06:48:36.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self._sslobj.do_handshake() 2024-08-01T06:48:36.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-01T06:48:36.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:36 smithi016 ceph-mon[29266]: [01/Aug/2024:06:48:35] ENGINE Serving on http://172.21.15.16:8765 2024-08-01T06:48:36.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:36 smithi016 ceph-mon[29266]: [01/Aug/2024:06:48:35] ENGINE Bus STARTED 2024-08-01T06:48:36.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:36 smithi016 ceph-mon[29266]: mgrmap e17: smithi016.whigbo(active, since 2s) 2024-08-01T06:48:36.913 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-01T06:48:38.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:37 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:38.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:37 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:38.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:37 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:38.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:37 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:38.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:37 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:48:39.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.203+0000 7fd650b76640 1 -- 172.21.15.89:0/3407945251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd64c100910 msgr2=0x7fd64c100cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:39.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.203+0000 7fd650b76640 1 --2- 172.21.15.89:0/3407945251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd64c100910 0x7fd64c100cf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd640009880 tx=0x7fd64002a670 comp rx=0 tx=0).stop 2024-08-01T06:48:39.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.203+0000 7fd650b76640 1 -- 172.21.15.89:0/3407945251 shutdown_connections 2024-08-01T06:48:39.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.203+0000 7fd650b76640 1 --2- 172.21.15.89:0/3407945251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd64c100910 0x7fd64c100cf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:39.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.203+0000 7fd650b76640 1 -- 172.21.15.89:0/3407945251 >> 172.21.15.89:0/3407945251 conn(0x7fd64c075490 msgr2=0x7fd64c0fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:39.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.203+0000 7fd650b76640 1 -- 172.21.15.89:0/3407945251 shutdown_connections 2024-08-01T06:48:39.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.203+0000 7fd650b76640 1 -- 172.21.15.89:0/3407945251 wait complete. 2024-08-01T06:48:39.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.204+0000 7fd650b76640 1 Processor -- start 2024-08-01T06:48:39.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.204+0000 7fd650b76640 1 -- start start 2024-08-01T06:48:39.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.204+0000 7fd650b76640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd64c100910 0x7fd64c0fe570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:39.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.204+0000 7fd650b76640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c100480 con 0x7fd64c100910 2024-08-01T06:48:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.204+0000 7fd64a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd64c100910 0x7fd64c0fe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.204+0000 7fd64a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd64c100910 0x7fd64c0fe570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.89:38512/0 (socket says 172.21.15.89:38512) 2024-08-01T06:48:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.204+0000 7fd64a59c640 1 -- 172.21.15.89:0/2649962130 learned_addr learned my addr 172.21.15.89:0/2649962130 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:48:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.204+0000 7fd64a59c640 1 -- 172.21.15.89:0/2649962130 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd640009560 con 0x7fd64c100910 2024-08-01T06:48:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.205+0000 7fd64a59c640 1 --2- 172.21.15.89:0/2649962130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd64c100910 0x7fd64c0fe570 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd640009230 tx=0x7fd6400056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.205+0000 7fd63b7fe640 1 -- 172.21.15.89:0/2649962130 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd640004aa0 con 0x7fd64c100910 2024-08-01T06:48:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.205+0000 7fd63b7fe640 1 -- 172.21.15.89:0/2649962130 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd640004c00 con 0x7fd64c100910 2024-08-01T06:48:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.205+0000 7fd650b76640 1 -- 172.21.15.89:0/2649962130 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64c0feab0 con 0x7fd64c100910 2024-08-01T06:48:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.205+0000 7fd63b7fe640 1 -- 172.21.15.89:0/2649962130 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd640031940 con 0x7fd64c100910 2024-08-01T06:48:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.205+0000 7fd650b76640 1 -- 172.21.15.89:0/2649962130 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64c0feed0 con 0x7fd64c100910 2024-08-01T06:48:39.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.206+0000 7fd63b7fe640 1 -- 172.21.15.89:0/2649962130 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7fd640031b00 con 0x7fd64c100910 2024-08-01T06:48:39.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.206+0000 7fd650b76640 1 -- 172.21.15.89:0/2649962130 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64c067f80 con 0x7fd64c100910 2024-08-01T06:48:39.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.206+0000 7fd63b7fe640 1 --2- 172.21.15.89:0/2649962130 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd634038830 0x7fd63403acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:39.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.206+0000 7fd63b7fe640 1 -- 172.21.15.89:0/2649962130 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fd64006c680 con 0x7fd64c100910 2024-08-01T06:48:39.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.206+0000 7fd649d9b640 1 --2- 172.21.15.89:0/2649962130 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd634038830 0x7fd63403acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:39.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.206+0000 7fd649d9b640 1 --2- 172.21.15.89:0/2649962130 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd634038830 0x7fd63403acf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0098c0 tx=0x7fd63c006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:39.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.211+0000 7fd63b7fe640 1 -- 172.21.15.89:0/2649962130 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fd64004d350 con 0x7fd64c100910 2024-08-01T06:48:39.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.455+0000 7fd650b76640 1 -- 172.21.15.89:0/2649962130 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd64c0ff1d0 con 0x7fd64c100910 2024-08-01T06:48:39.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.456+0000 7fd63b7fe640 1 -- 172.21.15.89:0/2649962130 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd640035090 con 0x7fd64c100910 2024-08-01T06:48:39.458 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:48:39.458 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":1,"fsid":"a88427da-4fd1-11ef-bcca-c7b262605968","modified":"2024-08-01T06:46:30.398884Z","created":"2024-08-01T06:46:30.398884Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi016","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-01T06:48:39.458 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 1 2024-08-01T06:48:39.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.458+0000 7fd650b76640 1 -- 172.21.15.89:0/2649962130 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd634038830 msgr2=0x7fd63403acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:39.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.458+0000 7fd650b76640 1 --2- 172.21.15.89:0/2649962130 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd634038830 0x7fd63403acf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0098c0 tx=0x7fd63c006db0 comp rx=0 tx=0).stop 2024-08-01T06:48:39.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.458+0000 7fd650b76640 1 -- 172.21.15.89:0/2649962130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd64c100910 msgr2=0x7fd64c0fe570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:39.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.458+0000 7fd650b76640 1 --2- 172.21.15.89:0/2649962130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd64c100910 0x7fd64c0fe570 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd640009230 tx=0x7fd6400056e0 comp rx=0 tx=0).stop 2024-08-01T06:48:39.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.458+0000 7fd650b76640 1 -- 172.21.15.89:0/2649962130 shutdown_connections 2024-08-01T06:48:39.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.458+0000 7fd650b76640 1 --2- 172.21.15.89:0/2649962130 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd634038830 0x7fd63403acf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:39.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.458+0000 7fd650b76640 1 --2- 172.21.15.89:0/2649962130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd64c100910 0x7fd64c0fe570 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:39.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.458+0000 7fd650b76640 1 -- 172.21.15.89:0/2649962130 >> 172.21.15.89:0/2649962130 conn(0x7fd64c075490 msgr2=0x7fd64c1036d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:39.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.458+0000 7fd650b76640 1 -- 172.21.15.89:0/2649962130 shutdown_connections 2024-08-01T06:48:39.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:39.458+0000 7fd650b76640 1 -- 172.21.15.89:0/2649962130 wait complete. 2024-08-01T06:48:39.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:39.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:39.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:39.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:39.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd/host:smithi089", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:48:39.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:48:39.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:48:39.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:39 smithi016 ceph-mon[29266]: Updating smithi016:/etc/ceph/ceph.conf 2024-08-01T06:48:39.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:39 smithi016 ceph-mon[29266]: Updating smithi089:/etc/ceph/ceph.conf 2024-08-01T06:48:39.651 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:39 smithi016 ceph-mon[29266]: Updating smithi089:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:48:39.651 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:39 smithi016 ceph-mon[29266]: Updating smithi016:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:48:39.651 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:39.651 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:39.651 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:39.651 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:39.652 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:39.652 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-01T06:48:39.652 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-08-01T06:48:39.652 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:48:40.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:40 smithi016 ceph-mon[29266]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-08-01T06:48:40.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:40 smithi016 ceph-mon[29266]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-08-01T06:48:40.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:40 smithi016 ceph-mon[29266]: Updating smithi089:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-01T06:48:40.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:40 smithi016 ceph-mon[29266]: Updating smithi016:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-01T06:48:40.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:40 smithi016 ceph-mon[29266]: Deploying daemon ceph-exporter.smithi089 on smithi089 2024-08-01T06:48:40.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:40 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/2649962130' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:48:41.158 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-01T06:48:41.159 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-01T06:48:41.438 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:48:43.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.182+0000 7fefcaf26640 1 -- 172.21.15.89:0/3727231673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefc41009d0 msgr2=0x7fefc4100db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:43.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.182+0000 7fefcaf26640 1 --2- 172.21.15.89:0/3727231673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefc41009d0 0x7fefc4100db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fefb4009c20 tx=0x7fefb402ab20 comp rx=0 tx=0).stop 2024-08-01T06:48:43.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.182+0000 7fefcaf26640 1 -- 172.21.15.89:0/3727231673 shutdown_connections 2024-08-01T06:48:43.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.182+0000 7fefcaf26640 1 --2- 172.21.15.89:0/3727231673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefc41009d0 0x7fefc4100db0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:43.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.182+0000 7fefcaf26640 1 -- 172.21.15.89:0/3727231673 >> 172.21.15.89:0/3727231673 conn(0x7fefc40fa3b0 msgr2=0x7fefc40fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:43.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.182+0000 7fefcaf26640 1 -- 172.21.15.89:0/3727231673 shutdown_connections 2024-08-01T06:48:43.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.182+0000 7fefcaf26640 1 -- 172.21.15.89:0/3727231673 wait complete. 2024-08-01T06:48:43.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.183+0000 7fefcaf26640 1 Processor -- start 2024-08-01T06:48:43.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.183+0000 7fefcaf26640 1 -- start start 2024-08-01T06:48:43.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.183+0000 7fefcaf26640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefc41009d0 0x7fefc4195060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:43.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.183+0000 7fefcaf26640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc41955a0 con 0x7fefc41009d0 2024-08-01T06:48:43.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.184+0000 7fefc8cc2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefc41009d0 0x7fefc4195060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:43.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.184+0000 7fefc8cc2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefc41009d0 0x7fefc4195060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.89:38526/0 (socket says 172.21.15.89:38526) 2024-08-01T06:48:43.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.184+0000 7fefc8cc2640 1 -- 172.21.15.89:0/1849067577 learned_addr learned my addr 172.21.15.89:0/1849067577 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:48:43.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.184+0000 7fefc8cc2640 1 -- 172.21.15.89:0/1849067577 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb4009900 con 0x7fefc41009d0 2024-08-01T06:48:43.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.184+0000 7fefc8cc2640 1 --2- 172.21.15.89:0/1849067577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefc41009d0 0x7fefc4195060 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fefb402ec00 tx=0x7fefb402ffb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:43.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.184+0000 7fefc1ffb640 1 -- 172.21.15.89:0/1849067577 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fefb403c070 con 0x7fefc41009d0 2024-08-01T06:48:43.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.184+0000 7fefcaf26640 1 -- 172.21.15.89:0/1849067577 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc41957a0 con 0x7fefc41009d0 2024-08-01T06:48:43.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.184+0000 7fefc1ffb640 1 -- 172.21.15.89:0/1849067577 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fefb4003e60 con 0x7fefc41009d0 2024-08-01T06:48:43.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.184+0000 7fefc1ffb640 1 -- 172.21.15.89:0/1849067577 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fefb4004590 con 0x7fefc41009d0 2024-08-01T06:48:43.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.185+0000 7fefcaf26640 1 -- 172.21.15.89:0/1849067577 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc4195bc0 con 0x7fefc41009d0 2024-08-01T06:48:43.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.185+0000 7fefcaf26640 1 -- 172.21.15.89:0/1849067577 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc4068700 con 0x7fefc41009d0 2024-08-01T06:48:43.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.186+0000 7fefc1ffb640 1 -- 172.21.15.89:0/1849067577 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7fefb4040070 con 0x7fefc41009d0 2024-08-01T06:48:43.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.186+0000 7fefc1ffb640 1 --2- 172.21.15.89:0/1849067577 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fefb0038830 0x7fefb003acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:43.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.186+0000 7fefc1ffb640 1 -- 172.21.15.89:0/1849067577 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fefb406c140 con 0x7fefc41009d0 2024-08-01T06:48:43.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.186+0000 7fefc3fff640 1 --2- 172.21.15.89:0/1849067577 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fefb0038830 0x7fefb003acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:43.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.187+0000 7fefc3fff640 1 --2- 172.21.15.89:0/1849067577 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fefb0038830 0x7fefb003acf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fefac0098c0 tx=0x7fefac006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:43.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.191+0000 7fefc1ffb640 1 -- 172.21.15.89:0/1849067577 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fefb404a750 con 0x7fefc41009d0 2024-08-01T06:48:43.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.418+0000 7fefcaf26640 1 -- 172.21.15.89:0/1849067577 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fefc4109c40 con 0x7fefc41009d0 2024-08-01T06:48:43.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.419+0000 7fefc1ffb640 1 -- 172.21.15.89:0/1849067577 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fefb4047030 con 0x7fefc41009d0 2024-08-01T06:48:43.421 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:48:43.421 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":1,"fsid":"a88427da-4fd1-11ef-bcca-c7b262605968","modified":"2024-08-01T06:46:30.398884Z","created":"2024-08-01T06:46:30.398884Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi016","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-01T06:48:43.421 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 1 2024-08-01T06:48:43.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.421+0000 7fefcaf26640 1 -- 172.21.15.89:0/1849067577 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fefb0038830 msgr2=0x7fefb003acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:43.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.421+0000 7fefcaf26640 1 --2- 172.21.15.89:0/1849067577 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fefb0038830 0x7fefb003acf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fefac0098c0 tx=0x7fefac006db0 comp rx=0 tx=0).stop 2024-08-01T06:48:43.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.421+0000 7fefcaf26640 1 -- 172.21.15.89:0/1849067577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefc41009d0 msgr2=0x7fefc4195060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:43.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.421+0000 7fefcaf26640 1 --2- 172.21.15.89:0/1849067577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefc41009d0 0x7fefc4195060 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fefb402ec00 tx=0x7fefb402ffb0 comp rx=0 tx=0).stop 2024-08-01T06:48:43.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.421+0000 7fefcaf26640 1 -- 172.21.15.89:0/1849067577 shutdown_connections 2024-08-01T06:48:43.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.421+0000 7fefcaf26640 1 --2- 172.21.15.89:0/1849067577 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fefb0038830 0x7fefb003acf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:43.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.421+0000 7fefcaf26640 1 --2- 172.21.15.89:0/1849067577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefc41009d0 0x7fefc4195060 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:43.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.421+0000 7fefcaf26640 1 -- 172.21.15.89:0/1849067577 >> 172.21.15.89:0/1849067577 conn(0x7fefc40fa3b0 msgr2=0x7fefc4101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:43.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.421+0000 7fefcaf26640 1 -- 172.21.15.89:0/1849067577 shutdown_connections 2024-08-01T06:48:43.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:43.421+0000 7fefcaf26640 1 -- 172.21.15.89:0/1849067577 wait complete. 2024-08-01T06:48:43.892 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:43 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/1849067577' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:48:43.893 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:43 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:43.893 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:43 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:43.893 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:43 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:43.893 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:43 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:43.893 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:43 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-01T06:48:43.893 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:43 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-08-01T06:48:43.893 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:43 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:48:44.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:44 smithi016 ceph-mon[29266]: Deploying daemon crash.smithi089 on smithi089 2024-08-01T06:48:44.924 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-01T06:48:44.924 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-01T06:48:45.259 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:48:46.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.636+0000 7fd2439f2640 1 -- 172.21.15.89:0/3637880242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23c1057a0 msgr2=0x7fd23c105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:46.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.636+0000 7fd2439f2640 1 --2- 172.21.15.89:0/3637880242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23c1057a0 0x7fd23c105b80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009880 tx=0x7fd22c02a5d0 comp rx=0 tx=0).stop 2024-08-01T06:48:46.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.636+0000 7fd2439f2640 1 -- 172.21.15.89:0/3637880242 shutdown_connections 2024-08-01T06:48:46.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.636+0000 7fd2439f2640 1 --2- 172.21.15.89:0/3637880242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23c1057a0 0x7fd23c105b80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:46.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.636+0000 7fd2439f2640 1 -- 172.21.15.89:0/3637880242 >> 172.21.15.89:0/3637880242 conn(0x7fd23c076500 msgr2=0x7fd23c076910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:46.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.636+0000 7fd2439f2640 1 -- 172.21.15.89:0/3637880242 shutdown_connections 2024-08-01T06:48:46.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.636+0000 7fd2439f2640 1 -- 172.21.15.89:0/3637880242 wait complete. 2024-08-01T06:48:46.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.636+0000 7fd2439f2640 1 Processor -- start 2024-08-01T06:48:46.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.637+0000 7fd2439f2640 1 -- start start 2024-08-01T06:48:46.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.637+0000 7fd2439f2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23c1057a0 0x7fd23c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:46.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.637+0000 7fd2439f2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0746c0 con 0x7fd23c1057a0 2024-08-01T06:48:46.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.637+0000 7fd24178e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23c1057a0 0x7fd23c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:46.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.637+0000 7fd24178e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23c1057a0 0x7fd23c0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.89:51422/0 (socket says 172.21.15.89:51422) 2024-08-01T06:48:46.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.637+0000 7fd24178e640 1 -- 172.21.15.89:0/1733668335 learned_addr learned my addr 172.21.15.89:0/1733668335 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:48:46.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.637+0000 7fd24178e640 1 -- 172.21.15.89:0/1733668335 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c009560 con 0x7fd23c1057a0 2024-08-01T06:48:46.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.638+0000 7fd24178e640 1 --2- 172.21.15.89:0/1733668335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23c1057a0 0x7fd23c0727b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009230 tx=0x7fd22c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:46.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.638+0000 7fd2327fc640 1 -- 172.21.15.89:0/1733668335 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd22c004aa0 con 0x7fd23c1057a0 2024-08-01T06:48:46.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.638+0000 7fd2327fc640 1 -- 172.21.15.89:0/1733668335 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd22c004c00 con 0x7fd23c1057a0 2024-08-01T06:48:46.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.638+0000 7fd2439f2640 1 -- 172.21.15.89:0/1733668335 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23c072cf0 con 0x7fd23c1057a0 2024-08-01T06:48:46.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.638+0000 7fd2327fc640 1 -- 172.21.15.89:0/1733668335 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd22c031940 con 0x7fd23c1057a0 2024-08-01T06:48:46.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.638+0000 7fd2439f2640 1 -- 172.21.15.89:0/1733668335 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c073170 con 0x7fd23c1057a0 2024-08-01T06:48:46.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.639+0000 7fd2439f2640 1 -- 172.21.15.89:0/1733668335 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c0fc960 con 0x7fd23c1057a0 2024-08-01T06:48:46.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.639+0000 7fd2327fc640 1 -- 172.21.15.89:0/1733668335 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7fd22c031b00 con 0x7fd23c1057a0 2024-08-01T06:48:46.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.639+0000 7fd2327fc640 1 --2- 172.21.15.89:0/1733668335 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd228038830 0x7fd22803acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:46.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.639+0000 7fd2327fc640 1 -- 172.21.15.89:0/1733668335 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fd22c06c540 con 0x7fd23c1057a0 2024-08-01T06:48:46.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.639+0000 7fd240f8d640 1 --2- 172.21.15.89:0/1733668335 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd228038830 0x7fd22803acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:46.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.640+0000 7fd240f8d640 1 --2- 172.21.15.89:0/1733668335 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd228038830 0x7fd22803acf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd2380098c0 tx=0x7fd238006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:46.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.644+0000 7fd2327fc640 1 -- 172.21.15.89:0/1733668335 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fd22c04d350 con 0x7fd23c1057a0 2024-08-01T06:48:46.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.889+0000 7fd2439f2640 1 -- 172.21.15.89:0/1733668335 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd23c100e70 con 0x7fd23c1057a0 2024-08-01T06:48:46.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.890+0000 7fd2327fc640 1 -- 172.21.15.89:0/1733668335 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd23c100e70 con 0x7fd23c1057a0 2024-08-01T06:48:46.894 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:48:46.895 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":1,"fsid":"a88427da-4fd1-11ef-bcca-c7b262605968","modified":"2024-08-01T06:46:30.398884Z","created":"2024-08-01T06:46:30.398884Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi016","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-01T06:48:46.895 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 1 2024-08-01T06:48:46.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.892+0000 7fd2439f2640 1 -- 172.21.15.89:0/1733668335 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd228038830 msgr2=0x7fd22803acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:46.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.892+0000 7fd2439f2640 1 --2- 172.21.15.89:0/1733668335 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd228038830 0x7fd22803acf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd2380098c0 tx=0x7fd238006db0 comp rx=0 tx=0).stop 2024-08-01T06:48:46.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.892+0000 7fd2439f2640 1 -- 172.21.15.89:0/1733668335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23c1057a0 msgr2=0x7fd23c0727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:46.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.892+0000 7fd2439f2640 1 --2- 172.21.15.89:0/1733668335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23c1057a0 0x7fd23c0727b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009230 tx=0x7fd22c0056e0 comp rx=0 tx=0).stop 2024-08-01T06:48:46.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.892+0000 7fd2439f2640 1 -- 172.21.15.89:0/1733668335 shutdown_connections 2024-08-01T06:48:46.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.892+0000 7fd2439f2640 1 --2- 172.21.15.89:0/1733668335 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd228038830 0x7fd22803acf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:46.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.892+0000 7fd2439f2640 1 --2- 172.21.15.89:0/1733668335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd23c1057a0 0x7fd23c0727b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:46.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.892+0000 7fd2439f2640 1 -- 172.21.15.89:0/1733668335 >> 172.21.15.89:0/1733668335 conn(0x7fd23c076500 msgr2=0x7fd23c0fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:46.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.892+0000 7fd2439f2640 1 -- 172.21.15.89:0/1733668335 shutdown_connections 2024-08-01T06:48:46.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:46.892+0000 7fd2439f2640 1 -- 172.21.15.89:0/1733668335 wait complete. 2024-08-01T06:48:47.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:46 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/1733668335' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:48:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:48 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:48 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:48 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:48 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:48 smithi016 ceph-mon[29266]: Deploying daemon node-exporter.smithi089 on smithi089 2024-08-01T06:48:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:48 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:48 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:48:48.754 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-01T06:48:48.755 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-01T06:48:48.953 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:48:51.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.811+0000 7f54e4e9d640 1 -- 172.21.15.89:0/2425431427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0100910 msgr2=0x7f54e0100cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.811+0000 7f54e4e9d640 1 --2- 172.21.15.89:0/2425431427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0100910 0x7f54e0100cf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009880 tx=0x7f54d002a670 comp rx=0 tx=0).stop 2024-08-01T06:48:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.811+0000 7f54e4e9d640 1 -- 172.21.15.89:0/2425431427 shutdown_connections 2024-08-01T06:48:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.811+0000 7f54e4e9d640 1 --2- 172.21.15.89:0/2425431427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0100910 0x7f54e0100cf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.811+0000 7f54e4e9d640 1 -- 172.21.15.89:0/2425431427 >> 172.21.15.89:0/2425431427 conn(0x7f54e0075490 msgr2=0x7f54e00fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.811+0000 7f54e4e9d640 1 -- 172.21.15.89:0/2425431427 shutdown_connections 2024-08-01T06:48:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.811+0000 7f54e4e9d640 1 -- 172.21.15.89:0/2425431427 wait complete. 2024-08-01T06:48:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.811+0000 7f54e4e9d640 1 Processor -- start 2024-08-01T06:48:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.812+0000 7f54e4e9d640 1 -- start start 2024-08-01T06:48:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.812+0000 7f54e4e9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0100910 0x7f54e01950d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.812+0000 7f54e4e9d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e0195610 con 0x7f54e0100910 2024-08-01T06:48:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.812+0000 7f54de59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0100910 0x7f54e01950d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.812+0000 7f54de59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0100910 0x7f54e01950d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.89:51464/0 (socket says 172.21.15.89:51464) 2024-08-01T06:48:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.812+0000 7f54de59c640 1 -- 172.21.15.89:0/2752686863 learned_addr learned my addr 172.21.15.89:0/2752686863 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:48:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.813+0000 7f54de59c640 1 -- 172.21.15.89:0/2752686863 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d0009560 con 0x7f54e0100910 2024-08-01T06:48:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.813+0000 7f54de59c640 1 --2- 172.21.15.89:0/2752686863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0100910 0x7f54e01950d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009230 tx=0x7f54d00056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.813+0000 7f54d7fff640 1 -- 172.21.15.89:0/2752686863 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54d0004aa0 con 0x7f54e0100910 2024-08-01T06:48:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.813+0000 7f54e4e9d640 1 -- 172.21.15.89:0/2752686863 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e0195810 con 0x7f54e0100910 2024-08-01T06:48:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.813+0000 7f54d7fff640 1 -- 172.21.15.89:0/2752686863 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f54d0004c00 con 0x7f54e0100910 2024-08-01T06:48:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.813+0000 7f54d7fff640 1 -- 172.21.15.89:0/2752686863 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54d0031940 con 0x7f54e0100910 2024-08-01T06:48:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.813+0000 7f54e4e9d640 1 -- 172.21.15.89:0/2752686863 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e0195c30 con 0x7f54e0100910 2024-08-01T06:48:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.814+0000 7f54e4e9d640 1 -- 172.21.15.89:0/2752686863 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e0067f80 con 0x7f54e0100910 2024-08-01T06:48:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.814+0000 7f54d7fff640 1 -- 172.21.15.89:0/2752686863 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f54d00035f0 con 0x7f54e0100910 2024-08-01T06:48:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.815+0000 7f54d7fff640 1 --2- 172.21.15.89:0/2752686863 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f54cc038830 0x7f54cc03acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.815+0000 7f54d7fff640 1 -- 172.21.15.89:0/2752686863 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f54d006c650 con 0x7f54e0100910 2024-08-01T06:48:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.815+0000 7f54d5d9b640 1 --2- 172.21.15.89:0/2752686863 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f54cc038830 0x7f54cc03acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.815+0000 7f54d5d9b640 1 --2- 172.21.15.89:0/2752686863 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f54cc038830 0x7f54cc03acf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f54c80098c0 tx=0x7f54c8006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:51.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:51.819+0000 7f54d7fff640 1 -- 172.21.15.89:0/2752686863 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f54d003a9b0 con 0x7f54e0100910 2024-08-01T06:48:52.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:52.059+0000 7f54e4e9d640 1 -- 172.21.15.89:0/2752686863 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f54e0109c20 con 0x7f54e0100910 2024-08-01T06:48:52.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:52.060+0000 7f54d7fff640 1 -- 172.21.15.89:0/2752686863 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f54d0035070 con 0x7f54e0100910 2024-08-01T06:48:52.062 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:48:52.062 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":1,"fsid":"a88427da-4fd1-11ef-bcca-c7b262605968","modified":"2024-08-01T06:46:30.398884Z","created":"2024-08-01T06:46:30.398884Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi016","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-01T06:48:52.062 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 1 2024-08-01T06:48:52.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:52.062+0000 7f54e4e9d640 1 -- 172.21.15.89:0/2752686863 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f54cc038830 msgr2=0x7f54cc03acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:52.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:52.062+0000 7f54e4e9d640 1 --2- 172.21.15.89:0/2752686863 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f54cc038830 0x7f54cc03acf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f54c80098c0 tx=0x7f54c8006db0 comp rx=0 tx=0).stop 2024-08-01T06:48:52.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:52.062+0000 7f54e4e9d640 1 -- 172.21.15.89:0/2752686863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0100910 msgr2=0x7f54e01950d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:52.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:52.062+0000 7f54e4e9d640 1 --2- 172.21.15.89:0/2752686863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0100910 0x7f54e01950d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009230 tx=0x7f54d00056e0 comp rx=0 tx=0).stop 2024-08-01T06:48:52.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:52.062+0000 7f54e4e9d640 1 -- 172.21.15.89:0/2752686863 shutdown_connections 2024-08-01T06:48:52.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:52.062+0000 7f54e4e9d640 1 --2- 172.21.15.89:0/2752686863 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f54cc038830 0x7f54cc03acf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:52.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:52.062+0000 7f54e4e9d640 1 --2- 172.21.15.89:0/2752686863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54e0100910 0x7f54e01950d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:52.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:52.062+0000 7f54e4e9d640 1 -- 172.21.15.89:0/2752686863 >> 172.21.15.89:0/2752686863 conn(0x7f54e0075490 msgr2=0x7f54e01036d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:52.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:52.062+0000 7f54e4e9d640 1 -- 172.21.15.89:0/2752686863 shutdown_connections 2024-08-01T06:48:52.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:52.062+0000 7f54e4e9d640 1 -- 172.21.15.89:0/2752686863 wait complete. 2024-08-01T06:48:52.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:52 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:52.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:52 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:52.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:52 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:52.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:52 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:52.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:52 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.hfgnsr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-01T06:48:52.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:52 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.hfgnsr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-01T06:48:52.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:52 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-01T06:48:52.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:52 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:48:52.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:52 smithi016 ceph-mon[29266]: Deploying daemon mgr.smithi089.hfgnsr on smithi089 2024-08-01T06:48:52.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:52 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/2752686863' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:48:52.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:52 smithi016 ceph-mon[29266]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:48:52.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:52 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:54.019 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-01T06:48:54.019 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-01T06:48:54.480 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:48:55.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:55 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:55.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:55 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:55.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:55 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:55.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:55 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:55.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:55 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-01T06:48:55.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:55 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:48:55.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:55 smithi016 ceph-mon[29266]: Deploying daemon mon.smithi089 on smithi089 2024-08-01T06:48:55.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:55 smithi016 ceph-mon[29266]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:48:56.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.689+0000 7f336b6d0640 1 -- 172.21.15.89:0/2894710482 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364104650 msgr2=0x7f3364104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:56.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.689+0000 7f336b6d0640 1 --2- 172.21.15.89:0/2894710482 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364104650 0x7f3364104a30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3354009880 tx=0x7f335402a5d0 comp rx=0 tx=0).stop 2024-08-01T06:48:56.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.689+0000 7f336b6d0640 1 -- 172.21.15.89:0/2894710482 shutdown_connections 2024-08-01T06:48:56.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.689+0000 7f336b6d0640 1 --2- 172.21.15.89:0/2894710482 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364104650 0x7f3364104a30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:56.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.689+0000 7f336b6d0640 1 -- 172.21.15.89:0/2894710482 >> 172.21.15.89:0/2894710482 conn(0x7f3364075490 msgr2=0x7f33640fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:56.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.690+0000 7f336b6d0640 1 -- 172.21.15.89:0/2894710482 shutdown_connections 2024-08-01T06:48:56.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.690+0000 7f336b6d0640 1 -- 172.21.15.89:0/2894710482 wait complete. 2024-08-01T06:48:56.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.690+0000 7f336b6d0640 1 Processor -- start 2024-08-01T06:48:56.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.690+0000 7f336b6d0640 1 -- start start 2024-08-01T06:48:56.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.690+0000 7f336b6d0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364104650 0x7f33640fb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:56.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.690+0000 7f336b6d0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33640fd590 con 0x7f3364104650 2024-08-01T06:48:56.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.691+0000 7f336946c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364104650 0x7f33640fb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:56.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.691+0000 7f336946c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364104650 0x7f33640fb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.89:51398/0 (socket says 172.21.15.89:51398) 2024-08-01T06:48:56.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.691+0000 7f336946c640 1 -- 172.21.15.89:0/2461303957 learned_addr learned my addr 172.21.15.89:0/2461303957 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:48:56.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.691+0000 7f336946c640 1 -- 172.21.15.89:0/2461303957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3354009560 con 0x7f3364104650 2024-08-01T06:48:56.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.691+0000 7f336946c640 1 --2- 172.21.15.89:0/2461303957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364104650 0x7f33640fb680 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3354009230 tx=0x7f33540056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:56.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.691+0000 7f335a7fc640 1 -- 172.21.15.89:0/2461303957 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3354004aa0 con 0x7f3364104650 2024-08-01T06:48:56.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.691+0000 7f336b6d0640 1 -- 172.21.15.89:0/2461303957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33640fbbc0 con 0x7f3364104650 2024-08-01T06:48:56.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.691+0000 7f335a7fc640 1 -- 172.21.15.89:0/2461303957 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3354004c00 con 0x7f3364104650 2024-08-01T06:48:56.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.691+0000 7f336b6d0640 1 -- 172.21.15.89:0/2461303957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33640fc040 con 0x7f3364104650 2024-08-01T06:48:56.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.692+0000 7f335a7fc640 1 -- 172.21.15.89:0/2461303957 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f33540317b0 con 0x7f3364104650 2024-08-01T06:48:56.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.692+0000 7f335a7fc640 1 -- 172.21.15.89:0/2461303957 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f33540035f0 con 0x7f3364104650 2024-08-01T06:48:56.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.692+0000 7f336b6d0640 1 -- 172.21.15.89:0/2461303957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336418e3f0 con 0x7f3364104650 2024-08-01T06:48:56.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.693+0000 7f335a7fc640 1 --2- 172.21.15.89:0/2461303957 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f3350038830 0x7f335003acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:48:56.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.693+0000 7f335a7fc640 1 -- 172.21.15.89:0/2461303957 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f335406c4f0 con 0x7f3364104650 2024-08-01T06:48:56.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.693+0000 7f3368c6b640 1 --2- 172.21.15.89:0/2461303957 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f3350038830 0x7f335003acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:48:56.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.693+0000 7f3368c6b640 1 --2- 172.21.15.89:0/2461303957 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f3350038830 0x7f335003acf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f33600098c0 tx=0x7f3360006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:48:56.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.698+0000 7f335a7fc640 1 -- 172.21.15.89:0/2461303957 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f335403ba20 con 0x7f3364104650 2024-08-01T06:48:56.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:56 smithi016 ceph-mon[29266]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:48:56.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.931+0000 7f336b6d0640 1 -- 172.21.15.89:0/2461303957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f33640ffd90 con 0x7f3364104650 2024-08-01T06:48:56.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.931+0000 7f335a7fc640 1 -- 172.21.15.89:0/2461303957 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f3354035020 con 0x7f3364104650 2024-08-01T06:48:56.933 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:48:56.933 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":1,"fsid":"a88427da-4fd1-11ef-bcca-c7b262605968","modified":"2024-08-01T06:46:30.398884Z","created":"2024-08-01T06:46:30.398884Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi016","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-01T06:48:56.933 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 1 2024-08-01T06:48:56.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.933+0000 7f336b6d0640 1 -- 172.21.15.89:0/2461303957 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f3350038830 msgr2=0x7f335003acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:56.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.933+0000 7f336b6d0640 1 --2- 172.21.15.89:0/2461303957 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f3350038830 0x7f335003acf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f33600098c0 tx=0x7f3360006db0 comp rx=0 tx=0).stop 2024-08-01T06:48:56.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.933+0000 7f336b6d0640 1 -- 172.21.15.89:0/2461303957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364104650 msgr2=0x7f33640fb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:48:56.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.933+0000 7f336b6d0640 1 --2- 172.21.15.89:0/2461303957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364104650 0x7f33640fb680 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3354009230 tx=0x7f33540056e0 comp rx=0 tx=0).stop 2024-08-01T06:48:56.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.933+0000 7f336b6d0640 1 -- 172.21.15.89:0/2461303957 shutdown_connections 2024-08-01T06:48:56.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.933+0000 7f336b6d0640 1 --2- 172.21.15.89:0/2461303957 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f3350038830 0x7f335003acf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:56.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.933+0000 7f336b6d0640 1 --2- 172.21.15.89:0/2461303957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364104650 0x7f33640fb680 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:48:56.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.933+0000 7f336b6d0640 1 -- 172.21.15.89:0/2461303957 >> 172.21.15.89:0/2461303957 conn(0x7f3364075490 msgr2=0x7f33640676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:48:56.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.934+0000 7f336b6d0640 1 -- 172.21.15.89:0/2461303957 shutdown_connections 2024-08-01T06:48:56.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:48:56.934+0000 7f336b6d0640 1 -- 172.21.15.89:0/2461303957 wait complete. 2024-08-01T06:48:57.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:57 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/2461303957' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:48:57.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:57 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:48:58.657 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-01T06:48:58.657 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-01T06:48:58.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:58 smithi016 ceph-mon[29266]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:48:58.944 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi089/config 2024-08-01T06:48:59.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:48:59 smithi089 systemd[1]: Starting Ceph mon.smithi089 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T06:48:59.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:59 smithi016 ceph-mon[29266]: Standby manager daemon smithi089.hfgnsr started 2024-08-01T06:48:59.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:59 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.89:0/4099790515' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/crt"}]: dispatch 2024-08-01T06:48:59.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:59 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.89:0/4099790515' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-01T06:48:59.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:59 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.89:0/4099790515' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/key"}]: dispatch 2024-08-01T06:48:59.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:48:59 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.89:0/4099790515' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-01T06:49:00.832 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 podman[36574]: 2024-08-01 06:49:00.525550955 +0000 UTC m=+0.020511995 image pull d280790d1980f9ccca1416b0016ae8076dfdf14ec2e6b48f73b6dd2bb635bf63 quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448 2024-08-01T06:49:00.832 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 podman[36574]: 2024-08-01 06:49:00.62783221 +0000 UTC m=+0.122793239 container create 9ca9e3e814cbc4e47b2413d4670b82a8daa4539f8780d3ab5c9638624fed9676 (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi089, GIT_CLEAN=True, RELEASE=reef-a3bbd72, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240716, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-01T06:49:00.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:00 smithi016 ceph-mon[29266]: mgrmap e18: smithi016.whigbo(active, since 27s), standbys: smithi089.hfgnsr 2024-08-01T06:49:00.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:00 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr metadata", "who": "smithi089.hfgnsr", "id": "smithi089.hfgnsr"}]: dispatch 2024-08-01T06:49:00.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:00 smithi016 ceph-mon[29266]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 podman[36574]: 2024-08-01 06:49:00.930927506 +0000 UTC m=+0.425888554 container init 9ca9e3e814cbc4e47b2413d4670b82a8daa4539f8780d3ab5c9638624fed9676 (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi089, ceph=True, org.label-schema.build-date=20240716, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, RELEASE=reef-a3bbd72, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-01T06:49:01.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 podman[36574]: 2024-08-01 06:49:00.934338834 +0000 UTC m=+0.429299872 container start 9ca9e3e814cbc4e47b2413d4670b82a8daa4539f8780d3ab5c9638624fed9676 (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi089, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240716, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=reef-a3bbd72, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-08-01T06:49:01.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: set uid:gid to 167:167 (ceph:ceph) 2024-08-01T06:49:01.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable), process ceph-mon, pid 2 2024-08-01T06:49:01.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pidfile_write: ignore empty --pid-file 2024-08-01T06:49:01.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: load: jerasure load: lrc 2024-08-01T06:49:01.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: RocksDB version: 7.9.2 2024-08-01T06:49:01.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Git sha 0 2024-08-01T06:49:01.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Compile date 2024-07-24 15:35:49 2024-08-01T06:49:01.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: DB SUMMARY 2024-08-01T06:49:01.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: DB Session ID: L7HZJ7K41K2UL5QTC1IW 2024-08-01T06:49:01.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: CURRENT file: CURRENT 2024-08-01T06:49:01.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: IDENTITY file: IDENTITY 2024-08-01T06:49:01.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-01T06:49:01.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi089/store.db dir, Total Num: 0, files: 2024-08-01T06:49:01.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi089/store.db: 000004.log size: 511 ; 2024-08-01T06:49:01.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.error_if_exists: 0 2024-08-01T06:49:01.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.create_if_missing: 0 2024-08-01T06:49:01.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.paranoid_checks: 1 2024-08-01T06:49:01.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-01T06:49:01.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-01T06:49:01.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-01T06:49:01.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.env: 0x5586b57e0bc0 2024-08-01T06:49:01.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.fs: PosixFileSystem 2024-08-01T06:49:01.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.info_log: 0x5586b7954dc0 2024-08-01T06:49:01.140 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_file_opening_threads: 16 2024-08-01T06:49:01.140 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.statistics: (nil) 2024-08-01T06:49:01.142 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.use_fsync: 0 2024-08-01T06:49:01.142 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_log_file_size: 0 2024-08-01T06:49:01.142 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-01T06:49:01.142 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-01T06:49:01.143 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.keep_log_file_num: 1000 2024-08-01T06:49:01.143 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.recycle_log_file_num: 0 2024-08-01T06:49:01.143 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.allow_fallocate: 1 2024-08-01T06:49:01.143 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.allow_mmap_reads: 0 2024-08-01T06:49:01.143 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.allow_mmap_writes: 0 2024-08-01T06:49:01.143 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.use_direct_reads: 0 2024-08-01T06:49:01.143 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-01T06:49:01.143 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.create_missing_column_families: 0 2024-08-01T06:49:01.143 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.db_log_dir: 2024-08-01T06:49:01.143 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.wal_dir: 2024-08-01T06:49:01.143 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-01T06:49:01.143 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-01T06:49:01.143 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-01T06:49:01.144 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-01T06:49:01.144 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-01T06:49:01.144 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-01T06:49:01.144 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.advise_random_on_open: 1 2024-08-01T06:49:01.144 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.db_write_buffer_size: 0 2024-08-01T06:49:01.144 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.write_buffer_manager: 0x5586b7924140 2024-08-01T06:49:01.144 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-01T06:49:01.144 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-01T06:49:01.144 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-01T06:49:01.144 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.rate_limiter: (nil) 2024-08-01T06:49:01.144 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-01T06:49:01.144 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.wal_recovery_mode: 2 2024-08-01T06:49:01.144 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.enable_thread_tracking: 0 2024-08-01T06:49:01.145 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.enable_pipelined_write: 0 2024-08-01T06:49:01.145 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.unordered_write: 0 2024-08-01T06:49:01.145 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-01T06:49:01.145 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-01T06:49:01.145 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-01T06:49:01.145 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-01T06:49:01.145 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.row_cache: None 2024-08-01T06:49:01.145 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.wal_filter: None 2024-08-01T06:49:01.145 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-01T06:49:01.145 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.allow_ingest_behind: 0 2024-08-01T06:49:01.145 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.two_write_queues: 0 2024-08-01T06:49:01.145 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.manual_wal_flush: 0 2024-08-01T06:49:01.145 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.wal_compression: 0 2024-08-01T06:49:01.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.atomic_flush: 0 2024-08-01T06:49:01.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-01T06:49:01.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-01T06:49:01.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-01T06:49:01.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.log_readahead_size: 0 2024-08-01T06:49:01.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-01T06:49:01.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.best_efforts_recovery: 0 2024-08-01T06:49:01.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-01T06:49:01.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-01T06:49:01.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.allow_data_in_errors: 0 2024-08-01T06:49:01.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.db_host_id: __hostname__ 2024-08-01T06:49:01.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-01T06:49:01.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_background_jobs: 2 2024-08-01T06:49:01.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_background_compactions: -1 2024-08-01T06:49:01.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_subcompactions: 1 2024-08-01T06:49:01.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-01T06:49:01.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-01T06:49:01.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-01T06:49:01.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_total_wal_size: 0 2024-08-01T06:49:01.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-01T06:49:01.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-01T06:49:01.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-01T06:49:01.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-01T06:49:01.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_open_files: -1 2024-08-01T06:49:01.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.bytes_per_sync: 0 2024-08-01T06:49:01.147 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-01T06:49:01.148 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-01T06:49:01.148 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compaction_readahead_size: 0 2024-08-01T06:49:01.148 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_background_flushes: -1 2024-08-01T06:49:01.148 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Compression algorithms supported: 2024-08-01T06:49:01.148 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: kZSTD supported: 0 2024-08-01T06:49:01.148 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: kXpressCompression supported: 0 2024-08-01T06:49:01.148 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: kBZip2Compression supported: 0 2024-08-01T06:49:01.148 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-01T06:49:01.148 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: kLZ4Compression supported: 1 2024-08-01T06:49:01.148 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: kZlibCompression supported: 1 2024-08-01T06:49:01.148 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: kLZ4HCCompression supported: 1 2024-08-01T06:49:01.148 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: kSnappyCompression supported: 1 2024-08-01T06:49:01.148 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-01T06:49:01.148 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-01T06:49:01.149 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi089/store.db/MANIFEST-000005 2024-08-01T06:49:01.149 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-01T06:49:01.149 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-01T06:49:01.149 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.merge_operator: 2024-08-01T06:49:01.149 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compaction_filter: None 2024-08-01T06:49:01.149 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compaction_filter_factory: None 2024-08-01T06:49:01.149 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.sst_partitioner_factory: None 2024-08-01T06:49:01.149 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-01T06:49:01.149 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-01T06:49:01.149 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5586b7954a60) 2024-08-01T06:49:01.149 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: cache_index_and_filter_blocks: 1 2024-08-01T06:49:01.149 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-01T06:49:01.149 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-01T06:49:01.150 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: pin_top_level_index_and_filter: 1 2024-08-01T06:49:01.150 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: index_type: 0 2024-08-01T06:49:01.150 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: data_block_index_type: 0 2024-08-01T06:49:01.150 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: index_shortening: 1 2024-08-01T06:49:01.150 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-01T06:49:01.150 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: checksum: 4 2024-08-01T06:49:01.150 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: no_block_cache: 0 2024-08-01T06:49:01.150 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache: 0x5586b7949350 2024-08-01T06:49:01.150 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache_name: BinnedLRUCache 2024-08-01T06:49:01.150 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache_options: 2024-08-01T06:49:01.150 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: capacity : 536870912 2024-08-01T06:49:01.150 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: num_shard_bits : 4 2024-08-01T06:49:01.150 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: strict_capacity_limit : 0 2024-08-01T06:49:01.150 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: high_pri_pool_ratio: 0.000 2024-08-01T06:49:01.151 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache_compressed: (nil) 2024-08-01T06:49:01.151 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: persistent_cache: (nil) 2024-08-01T06:49:01.151 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_size: 4096 2024-08-01T06:49:01.151 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_size_deviation: 10 2024-08-01T06:49:01.151 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_restart_interval: 16 2024-08-01T06:49:01.151 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: index_block_restart_interval: 1 2024-08-01T06:49:01.151 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: metadata_block_size: 4096 2024-08-01T06:49:01.151 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: partition_filters: 0 2024-08-01T06:49:01.151 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: use_delta_encoding: 1 2024-08-01T06:49:01.151 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: filter_policy: bloomfilter 2024-08-01T06:49:01.151 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: whole_key_filtering: 1 2024-08-01T06:49:01.151 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: verify_compression: 0 2024-08-01T06:49:01.152 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: read_amp_bytes_per_bit: 0 2024-08-01T06:49:01.152 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: format_version: 5 2024-08-01T06:49:01.152 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: enable_index_compression: 1 2024-08-01T06:49:01.152 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_align: 0 2024-08-01T06:49:01.152 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: max_auto_readahead_size: 262144 2024-08-01T06:49:01.152 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: prepopulate_block_cache: 0 2024-08-01T06:49:01.152 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: initial_auto_readahead_size: 8192 2024-08-01T06:49:01.152 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: num_file_reads_for_auto_readahead: 2 2024-08-01T06:49:01.152 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.write_buffer_size: 33554432 2024-08-01T06:49:01.152 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_write_buffer_number: 2 2024-08-01T06:49:01.152 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compression: NoCompression 2024-08-01T06:49:01.152 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.bottommost_compression: Disabled 2024-08-01T06:49:01.152 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.prefix_extractor: nullptr 2024-08-01T06:49:01.152 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-01T06:49:01.153 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.num_levels: 7 2024-08-01T06:49:01.153 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-01T06:49:01.153 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-01T06:49:01.153 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-01T06:49:01.153 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-01T06:49:01.153 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-01T06:49:01.153 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-01T06:49:01.153 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-01T06:49:01.153 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-01T06:49:01.153 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-01T06:49:01.153 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-01T06:49:01.153 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-01T06:49:01.153 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-01T06:49:01.154 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-01T06:49:01.154 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compression_opts.level: 32767 2024-08-01T06:49:01.154 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compression_opts.strategy: 0 2024-08-01T06:49:01.154 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-01T06:49:01.154 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-01T06:49:01.154 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-01T06:49:01.154 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-01T06:49:01.154 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compression_opts.enabled: false 2024-08-01T06:49:01.154 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-01T06:49:01.154 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-01T06:49:01.154 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-01T06:49:01.154 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-01T06:49:01.155 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.target_file_size_base: 67108864 2024-08-01T06:49:01.155 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-01T06:49:01.155 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-01T06:49:01.155 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-01T06:49:01.155 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-01T06:49:01.155 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-01T06:49:01.155 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-01T06:49:01.155 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-01T06:49:01.155 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-01T06:49:01.155 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-01T06:49:01.155 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-01T06:49:01.155 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-01T06:49:01.155 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-01T06:49:01.155 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-01T06:49:01.156 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-01T06:49:01.156 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.arena_block_size: 1048576 2024-08-01T06:49:01.156 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-01T06:49:01.156 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-01T06:49:01.156 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.disable_auto_compactions: 0 2024-08-01T06:49:01.156 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-01T06:49:01.156 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-01T06:49:01.156 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-01T06:49:01.156 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-01T06:49:01.156 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-01T06:49:01.156 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-01T06:49:01.156 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-01T06:49:01.156 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-01T06:49:01.157 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-01T06:49:01.157 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-01T06:49:01.157 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.table_properties_collectors: 2024-08-01T06:49:01.157 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.inplace_update_support: 0 2024-08-01T06:49:01.157 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-01T06:49:01.157 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-01T06:49:01.157 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-01T06:49:01.157 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-01T06:49:01.157 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.bloom_locality: 0 2024-08-01T06:49:01.157 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.max_successive_merges: 0 2024-08-01T06:49:01.157 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-01T06:49:01.157 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.paranoid_file_checks: 0 2024-08-01T06:49:01.157 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.force_consistency_checks: 1 2024-08-01T06:49:01.157 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.report_bg_io_stats: 0 2024-08-01T06:49:01.158 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.ttl: 2592000 2024-08-01T06:49:01.158 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-01T06:49:01.158 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-01T06:49:01.158 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-01T06:49:01.158 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.enable_blob_files: false 2024-08-01T06:49:01.158 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.min_blob_size: 0 2024-08-01T06:49:01.158 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.blob_file_size: 268435456 2024-08-01T06:49:01.158 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-01T06:49:01.158 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-01T06:49:01.158 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-01T06:49:01.158 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-01T06:49:01.158 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-01T06:49:01.158 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.blob_file_starting_level: 0 2024-08-01T06:49:01.158 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-01T06:49:01.159 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi089/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-01T06:49:01.159 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-01T06:49:01.159 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ddb0290b-fd1a-43b6-b1e1-863e3c47d530 2024-08-01T06:49:01.159 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: EVENT_LOG_v1 {"time_micros": 1722494940960778, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-01T06:49:01.159 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-01T06:49:01.159 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: EVENT_LOG_v1 {"time_micros": 1722494940961205, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1722494940, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ddb0290b-fd1a-43b6-b1e1-863e3c47d530", "db_session_id": "L7HZJ7K41K2UL5QTC1IW", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-01T06:49:01.159 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: EVENT_LOG_v1 {"time_micros": 1722494940961300, "job": 1, "event": "recovery_finished"} 2024-08-01T06:49:01.159 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-01T06:49:01.159 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi089/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-01T06:49:01.159 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5586b7972e00 2024-08-01T06:49:01.159 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: DB pointer 0x5586b7a66000 2024-08-01T06:49:01.159 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-01T06:49:01.159 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-01T06:49:01.159 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** DB Stats ** 2024-08-01T06:49:01.159 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-01T06:49:01.160 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-01T06:49:01.160 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-01T06:49:01.160 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-01T06:49:01.160 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-01T06:49:01.160 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-01T06:49:01.160 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-01T06:49:01.160 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-08-01T06:49:01.160 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** Compaction Stats [default] ** 2024-08-01T06:49:01.160 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-01T06:49:01.160 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-01T06:49:01.160 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-01T06:49:01.160 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-01T06:49:01.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-01T06:49:01.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-08-01T06:49:01.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** Compaction Stats [default] ** 2024-08-01T06:49:01.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-01T06:49:01.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-01T06:49:01.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-01T06:49:01.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-08-01T06:49:01.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-01T06:49:01.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-08-01T06:49:01.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-01T06:49:01.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-01T06:49:01.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-01T06:49:01.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-01T06:49:01.162 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-01T06:49:01.162 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-01T06:49:01.162 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-01T06:49:01.162 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-01T06:49:01.162 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-01T06:49:01.162 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Block cache BinnedLRUCache@0x5586b7949350#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-01T06:49:01.162 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-01T06:49:01.162 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-08-01T06:49:01.162 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-01T06:49:01.162 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mon.smithi089 does not exist in monmap, will attempt to join an existing cluster 2024-08-01T06:49:01.162 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: using public_addr v2:172.21.15.89:0/0 -> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] 2024-08-01T06:49:01.162 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: starting mon.smithi089 rank -1 at public addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] at bind addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi089 fsid a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:49:01.162 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mon.smithi089@-1(???) e0 preinit fsid a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:49:01.163 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mon.smithi089@-1(synchronizing).mds e1 new map 2024-08-01T06:49:01.163 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mon.smithi089@-1(synchronizing).mds e1 print_map 2024-08-01T06:49:01.163 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: e1 2024-08-01T06:49:01.163 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T06:49:01.163 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:49:01.163 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: legacy client fscid: -1 2024-08-01T06:49:01.163 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-08-01T06:49:01.163 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: No filesystems configured 2024-08-01T06:49:01.163 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mon.smithi089@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-01T06:49:01.163 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mon.smithi089@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-01T06:49:01.163 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mon.smithi089@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-01T06:49:01.163 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mon.smithi089@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-01T06:49:01.163 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mon.smithi089@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-01T06:49:01.163 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mon.smithi089@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-01T06:49:01.163 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mon.smithi089@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-08-01T06:49:01.164 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mon.smithi089@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-01T06:49:01.164 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mon.smithi089@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-08-01T06:49:01.164 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mon.smithi089@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-08-01T06:49:01.164 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mon.smithi089@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-08-01T06:49:01.164 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi089", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:49:01.164 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.164 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.164 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.164 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.164 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.164 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Deploying daemon node-exporter.smithi016 on smithi016 2024-08-01T06:49:01.164 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.164 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Deploying cephadm binary to smithi089 2024-08-01T06:49:01.165 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.165 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.165 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Added host smithi089 2024-08-01T06:49:01.165 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.165 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.165 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.165 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.165 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.165 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Deploying daemon alertmanager.smithi016 on smithi016 2024-08-01T06:49:01.165 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.165 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-01T06:49:01.165 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.165 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.166 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.166 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/2800757344' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-08-01T06:49:01.166 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/2800757344' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-01T06:49:01.166 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: osdmap e4: 0 total, 0 up, 0 in 2024-08-01T06:49:01.166 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.166 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.14195 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi016:172.21.15.16=smithi016;smithi089:172.21.15.89=smithi089", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:49:01.166 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Saving service mon spec with placement smithi016:172.21.15.16=smithi016;smithi089:172.21.15.89=smithi089;count:2 2024-08-01T06:49:01.166 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.166 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.166 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.166 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.166 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.166 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.167 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.167 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.167 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.167 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.167 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-08-01T06:49:01.167 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.167 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Regenerating cephadm self-signed grafana TLS certificates 2024-08-01T06:49:01.167 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-08-01T06:49:01.167 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Deploying daemon grafana.smithi016 on smithi016 2024-08-01T06:49:01.167 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.167 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.167 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/2053846515' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:49:01.167 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.167 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/3888544670' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:49:01.167 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.168 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.168 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/593820332' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:49:01.168 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.168 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.168 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/982372412' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:49:01.168 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.168 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.168 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.168 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.168 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.168 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.168 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.168 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.168 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Deploying daemon prometheus.smithi016 on smithi016 2024-08-01T06:49:01.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/2478307833' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:49:01.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/426060653' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:49:01.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/1902151499' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:49:01.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-08-01T06:49:01.170 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.170 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.170 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14162 172.21.15.16:0/2141585236' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-08-01T06:49:01.170 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mgrmap e14: smithi016.whigbo(active, since 60s) 2024-08-01T06:49:01.170 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/2778904916' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:49:01.170 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/1677670582' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:49:01.170 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Active manager daemon smithi016.whigbo restarted 2024-08-01T06:49:01.170 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Activating manager daemon smithi016.whigbo 2024-08-01T06:49:01.170 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: osdmap e5: 0 total, 0 up, 0 in 2024-08-01T06:49:01.170 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mgrmap e15: smithi016.whigbo(active, starting, since 0.00304118s) 2024-08-01T06:49:01.170 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:49:01.170 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr metadata", "who": "smithi016.whigbo", "id": "smithi016.whigbo"}]: dispatch 2024-08-01T06:49:01.170 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-01T06:49:01.170 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-01T06:49:01.171 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-01T06:49:01.171 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Manager daemon smithi016.whigbo is now available 2024-08-01T06:49:01.171 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:49:01.171 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.171 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:49:01.171 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi016.whigbo/mirror_snapshot_schedule"}]: dispatch 2024-08-01T06:49:01.171 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi016.whigbo/trash_purge_schedule"}]: dispatch 2024-08-01T06:49:01.171 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mgrmap e16: smithi016.whigbo(active, since 1.00561s) 2024-08-01T06:49:01.171 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.171 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.171 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/2334295887' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:49:01.171 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.171 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: [01/Aug/2024:06:48:34] ENGINE Bus STARTING 2024-08-01T06:49:01.171 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: [01/Aug/2024:06:48:35] ENGINE Serving on https://172.21.15.16:7150 2024-08-01T06:49:01.171 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: [01/Aug/2024:06:48:35] ENGINE Error in HTTPServer.serve 2024-08-01T06:49:01.172 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Traceback (most recent call last): 2024-08-01T06:49:01.172 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-01T06:49:01.172 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-08-01T06:49:01.172 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-01T06:49:01.172 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._run(expiration_interval) 2024-08-01T06:49:01.172 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-01T06:49:01.172 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-01T06:49:01.172 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-01T06:49:01.172 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-01T06:49:01.172 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-01T06:49:01.172 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s = self.context.wrap_socket( 2024-08-01T06:49:01.172 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-01T06:49:01.172 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: return self.sslsocket_class._create( 2024-08-01T06:49:01.172 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-01T06:49:01.172 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self.do_handshake() 2024-08-01T06:49:01.173 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-01T06:49:01.173 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._sslobj.do_handshake() 2024-08-01T06:49:01.173 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-01T06:49:01.173 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: [01/Aug/2024:06:48:35] ENGINE Serving on http://172.21.15.16:8765 2024-08-01T06:49:01.173 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: [01/Aug/2024:06:48:35] ENGINE Bus STARTED 2024-08-01T06:49:01.173 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mgrmap e17: smithi016.whigbo(active, since 2s) 2024-08-01T06:49:01.173 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.173 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.173 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.173 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.173 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:49:01.173 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.173 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.173 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.174 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.174 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd/host:smithi089", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:49:01.174 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:01.174 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:49:01.174 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Updating smithi016:/etc/ceph/ceph.conf 2024-08-01T06:49:01.174 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Updating smithi089:/etc/ceph/ceph.conf 2024-08-01T06:49:01.174 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Updating smithi089:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:49:01.174 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Updating smithi016:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:49:01.174 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.174 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.174 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.174 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.174 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.174 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-01T06:49:01.175 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-08-01T06:49:01.175 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:01.175 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-08-01T06:49:01.175 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-08-01T06:49:01.175 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Updating smithi089:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-01T06:49:01.175 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Updating smithi016:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-01T06:49:01.175 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Deploying daemon ceph-exporter.smithi089 on smithi089 2024-08-01T06:49:01.175 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/2649962130' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:49:01.175 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/1849067577' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:49:01.175 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.175 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.175 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.175 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.175 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-01T06:49:01.176 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-08-01T06:49:01.176 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:01.176 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Deploying daemon crash.smithi089 on smithi089 2024-08-01T06:49:01.176 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/1733668335' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:49:01.176 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.176 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.176 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.176 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.176 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Deploying daemon node-exporter.smithi089 on smithi089 2024-08-01T06:49:01.176 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.176 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:49:01.176 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.176 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.177 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.177 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.177 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.hfgnsr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-01T06:49:01.177 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.hfgnsr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-01T06:49:01.177 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-01T06:49:01.177 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:01.177 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Deploying daemon mgr.smithi089.hfgnsr on smithi089 2024-08-01T06:49:01.177 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/2752686863' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:49:01.177 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.177 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.177 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.177 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.177 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.178 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.178 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-01T06:49:01.178 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:01.178 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Deploying daemon mon.smithi089 on smithi089 2024-08-01T06:49:01.178 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.178 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.178 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/2461303957' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:49:01.178 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:01.178 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.178 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: Standby manager daemon smithi089.hfgnsr started 2024-08-01T06:49:01.178 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/4099790515' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/crt"}]: dispatch 2024-08-01T06:49:01.178 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/4099790515' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-01T06:49:01.178 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/4099790515' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/key"}]: dispatch 2024-08-01T06:49:01.179 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/4099790515' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-01T06:49:01.179 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mgrmap e18: smithi016.whigbo(active, since 27s), standbys: smithi089.hfgnsr 2024-08-01T06:49:01.179 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr metadata", "who": "smithi089.hfgnsr", "id": "smithi089.hfgnsr"}]: dispatch 2024-08-01T06:49:01.179 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:01.179 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:00 smithi089 ceph-mon[36617]: mon.smithi089@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-08-01T06:49:01.179 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:01 smithi089 bash[36574]: 9ca9e3e814cbc4e47b2413d4670b82a8daa4539f8780d3ab5c9638624fed9676 2024-08-01T06:49:01.179 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:01 smithi089 systemd[1]: Started Ceph mon.smithi089 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T06:49:01.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.910+0000 7f4df0517640 1 -- 172.21.15.89:0/253170079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de80fed10 msgr2=0x7f4de80ff0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:49:01.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.910+0000 7f4df0517640 1 --2- 172.21.15.89:0/253170079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de80fed10 0x7f4de80ff0f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009880 tx=0x7f4de002a5d0 comp rx=0 tx=0).stop 2024-08-01T06:49:01.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.910+0000 7f4df0517640 1 -- 172.21.15.89:0/253170079 shutdown_connections 2024-08-01T06:49:01.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.910+0000 7f4df0517640 1 --2- 172.21.15.89:0/253170079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de80fed10 0x7f4de80ff0f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:49:01.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.910+0000 7f4df0517640 1 -- 172.21.15.89:0/253170079 >> 172.21.15.89:0/253170079 conn(0x7f4de8074620 msgr2=0x7f4de8074a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:49:01.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.910+0000 7f4df0517640 1 -- 172.21.15.89:0/253170079 shutdown_connections 2024-08-01T06:49:01.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.910+0000 7f4df0517640 1 -- 172.21.15.89:0/253170079 wait complete. 2024-08-01T06:49:01.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.910+0000 7f4df0517640 1 Processor -- start 2024-08-01T06:49:01.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.911+0000 7f4df0517640 1 -- start start 2024-08-01T06:49:01.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.911+0000 7f4df0517640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de80fed10 0x7f4de81952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:49:01.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.911+0000 7f4df0517640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de8195830 con 0x7f4de80fed10 2024-08-01T06:49:01.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.911+0000 7f4dee2b3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de80fed10 0x7f4de81952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:49:01.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.911+0000 7f4dee2b3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de80fed10 0x7f4de81952f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.89:51420/0 (socket says 172.21.15.89:51420) 2024-08-01T06:49:01.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.911+0000 7f4dee2b3640 1 -- 172.21.15.89:0/1244048206 learned_addr learned my addr 172.21.15.89:0/1244048206 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:49:01.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.911+0000 7f4dee2b3640 1 -- 172.21.15.89:0/1244048206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de0009560 con 0x7f4de80fed10 2024-08-01T06:49:01.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.912+0000 7f4dee2b3640 1 --2- 172.21.15.89:0/1244048206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de80fed10 0x7f4de81952f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009230 tx=0x7f4de00056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:49:01.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.912+0000 7f4de77fe640 1 -- 172.21.15.89:0/1244048206 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4de0004be0 con 0x7f4de80fed10 2024-08-01T06:49:01.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.912+0000 7f4de77fe640 1 -- 172.21.15.89:0/1244048206 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4de0004d40 con 0x7f4de80fed10 2024-08-01T06:49:01.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.912+0000 7f4df0517640 1 -- 172.21.15.89:0/1244048206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de8195a30 con 0x7f4de80fed10 2024-08-01T06:49:01.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.912+0000 7f4de77fe640 1 -- 172.21.15.89:0/1244048206 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4de0031a90 con 0x7f4de80fed10 2024-08-01T06:49:01.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.912+0000 7f4df0517640 1 -- 172.21.15.89:0/1244048206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de8195ed0 con 0x7f4de80fed10 2024-08-01T06:49:01.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.913+0000 7f4df0517640 1 -- 172.21.15.89:0/1244048206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de80fffc0 con 0x7f4de80fed10 2024-08-01T06:49:01.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.914+0000 7f4de77fe640 1 -- 172.21.15.89:0/1244048206 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f4de0031cc0 con 0x7f4de80fed10 2024-08-01T06:49:01.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.914+0000 7f4de77fe640 1 --2- 172.21.15.89:0/1244048206 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f4dd006cbb0 0x7f4dd006f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:49:01.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.914+0000 7f4de77fe640 1 -- 172.21.15.89:0/1244048206 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f4de00ac220 con 0x7f4de80fed10 2024-08-01T06:49:01.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.914+0000 7f4dedab2640 1 --2- 172.21.15.89:0/1244048206 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f4dd006cbb0 0x7f4dd006f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:49:01.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.915+0000 7f4dedab2640 1 --2- 172.21.15.89:0/1244048206 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f4dd006cbb0 0x7f4dd006f070 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00ad30 tx=0x7f4ddc0093f0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:49:01.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.919+0000 7f4de77fe640 1 -- 172.21.15.89:0/1244048206 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f4de0077640 con 0x7f4de80fed10 2024-08-01T06:49:01.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:00.990+0000 7f4de77fe640 1 -- 172.21.15.89:0/1244048206 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4de0077640 con 0x7f4de80fed10 2024-08-01T06:49:01.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:01.153+0000 7f4df0517640 1 -- 172.21.15.89:0/1244048206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4de8108d20 con 0x7f4de80fed10 2024-08-01T06:49:06.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:06.002+0000 7f4de77fe640 1 -- 172.21.15.89:0/1244048206 <== mon.0 v2:172.21.15.16:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1018 (secure 0 0 0) 0x7f4de00ab9e0 con 0x7f4de80fed10 2024-08-01T06:49:06.004 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:49:06.005 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":2,"fsid":"a88427da-4fd1-11ef-bcca-c7b262605968","modified":"2024-08-01T06:49:00.990417Z","created":"2024-08-01T06:46:30.398884Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi016","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-01T06:49:06.005 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 2 2024-08-01T06:49:06.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:06.006+0000 7f4df0517640 1 -- 172.21.15.89:0/1244048206 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f4dd006cbb0 msgr2=0x7f4dd006f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:49:06.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:06.006+0000 7f4df0517640 1 --2- 172.21.15.89:0/1244048206 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f4dd006cbb0 0x7f4dd006f070 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00ad30 tx=0x7f4ddc0093f0 comp rx=0 tx=0).stop 2024-08-01T06:49:06.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:06.006+0000 7f4df0517640 1 -- 172.21.15.89:0/1244048206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de80fed10 msgr2=0x7f4de81952f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:49:06.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:06.006+0000 7f4df0517640 1 --2- 172.21.15.89:0/1244048206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de80fed10 0x7f4de81952f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009230 tx=0x7f4de00056e0 comp rx=0 tx=0).stop 2024-08-01T06:49:06.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:06.006+0000 7f4df0517640 1 -- 172.21.15.89:0/1244048206 shutdown_connections 2024-08-01T06:49:06.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:06.006+0000 7f4df0517640 1 --2- 172.21.15.89:0/1244048206 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f4dd006cbb0 0x7f4dd006f070 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:49:06.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:06.006+0000 7f4df0517640 1 --2- 172.21.15.89:0/1244048206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de80fed10 0x7f4de81952f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:49:06.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:06.006+0000 7f4df0517640 1 -- 172.21.15.89:0/1244048206 >> 172.21.15.89:0/1244048206 conn(0x7f4de8074620 msgr2=0x7f4de8067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:49:06.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:06.006+0000 7f4df0517640 1 -- 172.21.15.89:0/1244048206 shutdown_connections 2024-08-01T06:49:06.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:49:06.006+0000 7f4df0517640 1 -- 172.21.15.89:0/1244048206 wait complete. 2024-08-01T06:49:06.340 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:49:06.341 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: mon.smithi016 calling monitor election 2024-08-01T06:49:06.341 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:49:06.341 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/1244048206' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:49:06.341 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:49:06.341 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:06.341 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:49:06.341 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:49:06.341 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: mon.smithi089 calling monitor election 2024-08-01T06:49:06.341 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:49:06.341 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:06.342 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:49:06.342 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:49:06.342 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: mon.smithi016 is new leader, mons smithi016,smithi089 in quorum (ranks 0,1) 2024-08-01T06:49:06.342 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: monmap e2: 2 mons at {smithi016=[v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0],smithi089=[v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-08-01T06:49:06.342 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: fsmap 2024-08-01T06:49:06.342 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: osdmap e5: 0 total, 0 up, 0 in 2024-08-01T06:49:06.342 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: mgrmap e18: smithi016.whigbo(active, since 33s), standbys: smithi089.hfgnsr 2024-08-01T06:49:06.342 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: overall HEALTH_OK 2024-08-01T06:49:06.342 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:06.342 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:06.342 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:06.342 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:06.343 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:06 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:06.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:49:06.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: mon.smithi016 calling monitor election 2024-08-01T06:49:06.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:49:06.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/1244048206' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-01T06:49:06.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:49:06.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:06.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:49:06.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:49:06.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: mon.smithi089 calling monitor election 2024-08-01T06:49:06.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:49:06.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:06.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:49:06.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:49:06.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: mon.smithi016 is new leader, mons smithi016,smithi089 in quorum (ranks 0,1) 2024-08-01T06:49:06.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: monmap e2: 2 mons at {smithi016=[v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0],smithi089=[v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-08-01T06:49:06.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: fsmap 2024-08-01T06:49:06.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: osdmap e5: 0 total, 0 up, 0 in 2024-08-01T06:49:06.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: mgrmap e18: smithi016.whigbo(active, since 33s), standbys: smithi089.hfgnsr 2024-08-01T06:49:06.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: overall HEALTH_OK 2024-08-01T06:49:06.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:06.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:06.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:06.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:06.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:06 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:06.672 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-01T06:49:06.673 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph config generate-minimal-conf 2024-08-01T06:49:06.898 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:49:07.310 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:07 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:49:07.311 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:07 smithi016 ceph-mon[29266]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:07.311 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:07 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:49:07.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:07 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:49:07.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:07 smithi089 ceph-mon[36617]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:07.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:07 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:49:08.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.410+0000 7f76f6485640 1 -- 172.21.15.16:0/1103080855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76f0104650 msgr2=0x7f76f0104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:49:08.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.410+0000 7f76f6485640 1 --2- 172.21.15.16:0/1103080855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76f0104650 0x7f76f0104a30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009880 tx=0x7f76e002a5d0 comp rx=0 tx=0).stop 2024-08-01T06:49:08.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.410+0000 7f76f6485640 1 -- 172.21.15.16:0/1103080855 shutdown_connections 2024-08-01T06:49:08.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.410+0000 7f76f6485640 1 --2- 172.21.15.16:0/1103080855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76f0104650 0x7f76f0104a30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:49:08.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.410+0000 7f76f6485640 1 -- 172.21.15.16:0/1103080855 >> 172.21.15.16:0/1103080855 conn(0x7f76f0075490 msgr2=0x7f76f00fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:49:08.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.410+0000 7f76f6485640 1 -- 172.21.15.16:0/1103080855 shutdown_connections 2024-08-01T06:49:08.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.410+0000 7f76f6485640 1 -- 172.21.15.16:0/1103080855 wait complete. 2024-08-01T06:49:08.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.410+0000 7f76f6485640 1 Processor -- start 2024-08-01T06:49:08.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.410+0000 7f76f6485640 1 -- start start 2024-08-01T06:49:08.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.411+0000 7f76f6485640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76f0104650 0x7f76f01952b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:49:08.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.411+0000 7f76f6485640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76f01957f0 0x7f76f0199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:49:08.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.411+0000 7f76f6485640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f0195df0 con 0x7f76f0104650 2024-08-01T06:49:08.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.411+0000 7f76f6485640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f0195f60 con 0x7f76f01957f0 2024-08-01T06:49:08.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.411+0000 7f76effff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76f0104650 0x7f76f01952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:49:08.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.411+0000 7f76effff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76f0104650 0x7f76f01952b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34676/0 (socket says 172.21.15.16:34676) 2024-08-01T06:49:08.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.411+0000 7f76effff640 1 -- 172.21.15.16:0/726358613 learned_addr learned my addr 172.21.15.16:0/726358613 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:49:08.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.411+0000 7f76effff640 1 -- 172.21.15.16:0/726358613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76f01957f0 msgr2=0x7f76f0199bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:49:08.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.411+0000 7f76effff640 1 --2- 172.21.15.16:0/726358613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76f01957f0 0x7f76f0199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:49:08.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.411+0000 7f76effff640 1 -- 172.21.15.16:0/726358613 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e0009560 con 0x7f76f0104650 2024-08-01T06:49:08.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.412+0000 7f76effff640 1 --2- 172.21.15.16:0/726358613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76f0104650 0x7f76f01952b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f76e00055a0 tx=0x7f76e00055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:49:08.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.412+0000 7f76ed7fa640 1 -- 172.21.15.16:0/726358613 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76e0004aa0 con 0x7f76f0104650 2024-08-01T06:49:08.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.412+0000 7f76ed7fa640 1 -- 172.21.15.16:0/726358613 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f76e0004c00 con 0x7f76f0104650 2024-08-01T06:49:08.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.412+0000 7f76f6485640 1 -- 172.21.15.16:0/726358613 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f019a1f0 con 0x7f76f0104650 2024-08-01T06:49:08.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.412+0000 7f76ed7fa640 1 -- 172.21.15.16:0/726358613 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76e0003a30 con 0x7f76f0104650 2024-08-01T06:49:08.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.412+0000 7f76f6485640 1 -- 172.21.15.16:0/726358613 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f019a740 con 0x7f76f0104650 2024-08-01T06:49:08.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.413+0000 7f76f6485640 1 -- 172.21.15.16:0/726358613 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f019aa70 con 0x7f76f0104650 2024-08-01T06:49:08.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.413+0000 7f76ed7fa640 1 -- 172.21.15.16:0/726358613 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f76e0031c00 con 0x7f76f0104650 2024-08-01T06:49:08.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.414+0000 7f76ed7fa640 1 --2- 172.21.15.16:0/726358613 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f76d806cd20 0x7f76d806f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:49:08.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.414+0000 7f76ed7fa640 1 -- 172.21.15.16:0/726358613 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f76e00ac190 con 0x7f76f0104650 2024-08-01T06:49:08.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.414+0000 7f76ef7fe640 1 --2- 172.21.15.16:0/726358613 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f76d806cd20 0x7f76d806f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:49:08.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.415+0000 7f76ef7fe640 1 --2- 172.21.15.16:0/726358613 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f76d806cd20 0x7f76d806f1e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f76e4006fd0 tx=0x7f76e4006d40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:49:08.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.418+0000 7f76ed7fa640 1 -- 172.21.15.16:0/726358613 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f76e00776c0 con 0x7f76f0104650 2024-08-01T06:49:08.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.595+0000 7f76f6485640 1 -- 172.21.15.16:0/726358613 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f76f0103800 con 0x7f76f0104650 2024-08-01T06:49:08.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.595+0000 7f76ed7fa640 1 -- 172.21.15.16:0/726358613 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+223 (secure 0 0 0) 0x7f76e00ab950 con 0x7f76f0104650 2024-08-01T06:49:08.597 INFO:teuthology.orchestra.run.smithi016.stdout:# minimal ceph.conf for a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:49:08.597 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2024-08-01T06:49:08.597 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:49:08.597 INFO:teuthology.orchestra.run.smithi016.stdout: mon_host = [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] 2024-08-01T06:49:08.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.597+0000 7f76f6485640 1 -- 172.21.15.16:0/726358613 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f76d806cd20 msgr2=0x7f76d806f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:49:08.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.597+0000 7f76f6485640 1 --2- 172.21.15.16:0/726358613 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f76d806cd20 0x7f76d806f1e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f76e4006fd0 tx=0x7f76e4006d40 comp rx=0 tx=0).stop 2024-08-01T06:49:08.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.597+0000 7f76f6485640 1 -- 172.21.15.16:0/726358613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76f0104650 msgr2=0x7f76f01952b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:49:08.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.597+0000 7f76f6485640 1 --2- 172.21.15.16:0/726358613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76f0104650 0x7f76f01952b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f76e00055a0 tx=0x7f76e00055d0 comp rx=0 tx=0).stop 2024-08-01T06:49:08.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.598+0000 7f76f6485640 1 -- 172.21.15.16:0/726358613 shutdown_connections 2024-08-01T06:49:08.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.598+0000 7f76f6485640 1 --2- 172.21.15.16:0/726358613 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f76d806cd20 0x7f76d806f1e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:49:08.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.598+0000 7f76f6485640 1 --2- 172.21.15.16:0/726358613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76f01957f0 0x7f76f0199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:49:08.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.598+0000 7f76f6485640 1 --2- 172.21.15.16:0/726358613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76f0104650 0x7f76f01952b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:49:08.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.598+0000 7f76f6485640 1 -- 172.21.15.16:0/726358613 >> 172.21.15.16:0/726358613 conn(0x7f76f0075490 msgr2=0x7f76f00676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:49:08.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.598+0000 7f76f6485640 1 -- 172.21.15.16:0/726358613 shutdown_connections 2024-08-01T06:49:08.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:08.598+0000 7f76f6485640 1 -- 172.21.15.16:0/726358613 wait complete. 2024-08-01T06:49:08.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:08 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:08.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:08 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:08.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:08 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:08.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:08 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:08.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:08 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:49:08.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:08 smithi089 ceph-mon[36617]: Updating smithi016:/etc/ceph/ceph.conf 2024-08-01T06:49:08.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:08 smithi089 ceph-mon[36617]: Updating smithi089:/etc/ceph/ceph.conf 2024-08-01T06:49:08.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:08 smithi089 ceph-mon[36617]: Updating smithi089:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:49:08.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:08 smithi089 ceph-mon[36617]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:08.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:08 smithi089 ceph-mon[36617]: Updating smithi016:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:49:08.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:08 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:08.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:08 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:08.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:08 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:08.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:08 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:08.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:08 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:49:08.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:08 smithi016 ceph-mon[29266]: Updating smithi016:/etc/ceph/ceph.conf 2024-08-01T06:49:08.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:08 smithi016 ceph-mon[29266]: Updating smithi089:/etc/ceph/ceph.conf 2024-08-01T06:49:08.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:08 smithi016 ceph-mon[29266]: Updating smithi089:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:49:08.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:08 smithi016 ceph-mon[29266]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:08.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:08 smithi016 ceph-mon[29266]: Updating smithi016:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:49:09.270 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-01T06:49:09.270 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-08-01T06:49:09.270 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.conf 2024-08-01T06:49:09.299 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-08-01T06:49:09.299 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-01T06:49:09.365 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-01T06:49:09.365 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.conf 2024-08-01T06:49:09.392 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-01T06:49:09.392 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-01T06:49:09.457 INFO:tasks.cephadm:Deploying OSDs... 2024-08-01T06:49:09.457 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-08-01T06:49:09.457 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2024-08-01T06:49:09.473 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-01T06:49:09.473 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 2024-08-01T06:49:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-01T06:49:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-01T06:49:09.530 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-08-01T06:49:09.530 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-01T06:49:09.530 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-08-01T06:49:09.530 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-08-01 06:48:25.713384484 +0000 2024-08-01T06:49:09.530 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-08-01 06:42:22.783706222 +0000 2024-08-01T06:49:09.530 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-08-01 06:42:22.783706222 +0000 2024-08-01T06:49:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-08-01 06:42:22.783706222 +0000 2024-08-01T06:49:09.530 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-01T06:49:09.609 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-08-01T06:49:09.609 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-08-01T06:49:09.609 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000107955 s, 4.7 MB/s 2024-08-01T06:49:09.610 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-01T06:49:09.667 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 2024-08-01T06:49:09.727 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-01T06:49:09.727 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-01T06:49:09.727 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-08-01T06:49:09.727 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-01T06:49:09.727 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-08-01T06:49:09.727 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-08-01 06:48:25.713384484 +0000 2024-08-01T06:49:09.727 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-08-01 06:42:23.116701094 +0000 2024-08-01T06:49:09.727 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-08-01 06:42:23.116701094 +0000 2024-08-01T06:49:09.727 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-08-01 06:42:23.116701094 +0000 2024-08-01T06:49:09.728 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-01T06:49:09.793 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-08-01T06:49:09.793 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-08-01T06:49:09.793 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 9.8711e-05 s, 5.2 MB/s 2024-08-01T06:49:09.794 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-01T06:49:09.810 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:09 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/726358613' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:09.811 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:09 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:09.811 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:09 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:09.811 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:09 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:09.811 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:09 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:09.811 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:09 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:09.811 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:09 smithi016 ceph-mon[29266]: Reconfiguring mon.smithi016 (unknown last config time)... 2024-08-01T06:49:09.811 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:09 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-01T06:49:09.811 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:09 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-01T06:49:09.811 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:09 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:09.811 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:09 smithi016 ceph-mon[29266]: Reconfiguring daemon mon.smithi016 on smithi016 2024-08-01T06:49:09.827 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 2024-08-01T06:49:09.884 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-01T06:49:09.884 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-01T06:49:09.884 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-08-01T06:49:09.884 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-01T06:49:09.885 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-08-01T06:49:09.885 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-08-01 06:48:25.714384469 +0000 2024-08-01T06:49:09.885 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-08-01 06:42:23.433696212 +0000 2024-08-01T06:49:09.885 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-08-01 06:42:23.433696212 +0000 2024-08-01T06:49:09.885 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-08-01 06:42:23.433696212 +0000 2024-08-01T06:49:09.885 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-01T06:49:09.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:09 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/726358613' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:09.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:09 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:09.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:09 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:09.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:09 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:09.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:09 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:09.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:09 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:09.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:09 smithi089 ceph-mon[36617]: Reconfiguring mon.smithi016 (unknown last config time)... 2024-08-01T06:49:09.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:09 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-01T06:49:09.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:09 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-01T06:49:09.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:09 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:09.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:09 smithi089 ceph-mon[36617]: Reconfiguring daemon mon.smithi016 on smithi016 2024-08-01T06:49:09.949 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-08-01T06:49:09.949 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-08-01T06:49:09.949 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000104892 s, 4.9 MB/s 2024-08-01T06:49:09.950 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-01T06:49:10.007 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 2024-08-01T06:49:10.064 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-01T06:49:10.065 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-01T06:49:10.065 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-08-01T06:49:10.065 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-01T06:49:10.065 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-08-01T06:49:10.066 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-08-01 06:48:25.714384469 +0000 2024-08-01T06:49:10.066 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-08-01 06:42:23.758691206 +0000 2024-08-01T06:49:10.066 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-08-01 06:42:23.758691206 +0000 2024-08-01T06:49:10.066 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-08-01 06:42:23.758691206 +0000 2024-08-01T06:49:10.067 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-01T06:49:10.130 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-08-01T06:49:10.130 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-08-01T06:49:10.131 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000107053 s, 4.8 MB/s 2024-08-01T06:49:10.132 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-01T06:49:10.190 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-01T06:49:10.190 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2024-08-01T06:49:10.209 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-01T06:49:10.209 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2024-08-01T06:49:10.266 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-01T06:49:10.266 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-01T06:49:10.266 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-08-01T06:49:10.266 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-01T06:49:10.266 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-08-01T06:49:10.266 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-08-01 06:48:59.302662026 +0000 2024-08-01T06:49:10.266 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-08-01 06:42:13.506033104 +0000 2024-08-01T06:49:10.266 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-08-01 06:42:13.506033104 +0000 2024-08-01T06:49:10.267 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-08-01 06:42:13.506033104 +0000 2024-08-01T06:49:10.267 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-01T06:49:10.331 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-08-01T06:49:10.331 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-08-01T06:49:10.331 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000252328 s, 2.0 MB/s 2024-08-01T06:49:10.333 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-01T06:49:10.390 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2024-08-01T06:49:10.446 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-01T06:49:10.447 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-01T06:49:10.447 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-08-01T06:49:10.447 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-01T06:49:10.447 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-08-01T06:49:10.447 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-08-01 06:48:59.303662003 +0000 2024-08-01T06:49:10.447 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-08-01 06:42:13.843025038 +0000 2024-08-01T06:49:10.447 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-08-01 06:42:13.843025038 +0000 2024-08-01T06:49:10.447 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-08-01 06:42:13.843025038 +0000 2024-08-01T06:49:10.447 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-01T06:49:10.511 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-08-01T06:49:10.511 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-08-01T06:49:10.511 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000206852 s, 2.5 MB/s 2024-08-01T06:49:10.513 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-01T06:49:10.573 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2024-08-01T06:49:10.629 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-01T06:49:10.629 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-01T06:49:10.629 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-08-01T06:49:10.629 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-01T06:49:10.629 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-08-01T06:49:10.629 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-08-01 06:48:59.303662003 +0000 2024-08-01T06:49:10.629 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-08-01 06:42:14.171017187 +0000 2024-08-01T06:49:10.630 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-08-01 06:42:14.171017187 +0000 2024-08-01T06:49:10.630 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-08-01 06:42:14.171017187 +0000 2024-08-01T06:49:10.630 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-01T06:49:10.692 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-08-01T06:49:10.693 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-08-01T06:49:10.693 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000203095 s, 2.5 MB/s 2024-08-01T06:49:10.694 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-01T06:49:10.751 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2024-08-01T06:49:10.806 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-01T06:49:10.806 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-01T06:49:10.807 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-08-01T06:49:10.807 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-01T06:49:10.807 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-08-01T06:49:10.807 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-08-01 06:48:59.304661979 +0000 2024-08-01T06:49:10.807 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-08-01 06:42:14.502009264 +0000 2024-08-01T06:49:10.807 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-08-01 06:42:14.502009264 +0000 2024-08-01T06:49:10.807 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-08-01 06:42:14.502009264 +0000 2024-08-01T06:49:10.807 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-01T06:49:10.869 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-08-01T06:49:10.869 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-08-01T06:49:10.869 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000190036 s, 2.7 MB/s 2024-08-01T06:49:10.870 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-01T06:49:10.926 INFO:tasks.cephadm:Deploying osd.0 on smithi016 with /dev/vg_nvme/lv_4... 2024-08-01T06:49:10.926 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-01T06:49:11.317 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:49:11.705 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:11 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:11.705 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:11 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:11.705 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:11 smithi016 ceph-mon[29266]: Reconfiguring mgr.smithi016.whigbo (unknown last config time)... 2024-08-01T06:49:11.705 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:11 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi016.whigbo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-01T06:49:11.705 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:11 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-01T06:49:11.706 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:11 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:11.706 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:11 smithi016 ceph-mon[29266]: Reconfiguring daemon mgr.smithi016.whigbo on smithi016 2024-08-01T06:49:11.706 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:11 smithi016 ceph-mon[29266]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:11.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:11 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:11.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:11 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:11.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:11 smithi089 ceph-mon[36617]: Reconfiguring mgr.smithi016.whigbo (unknown last config time)... 2024-08-01T06:49:11.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:11 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi016.whigbo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-01T06:49:11.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:11 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-01T06:49:11.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:11 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:11.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:11 smithi089 ceph-mon[36617]: Reconfiguring daemon mgr.smithi016.whigbo on smithi016 2024-08-01T06:49:11.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:11 smithi089 ceph-mon[36617]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:13.045 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:12 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:13.045 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:12 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:13.045 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:12 smithi016 ceph-mon[29266]: Reconfiguring ceph-exporter.smithi016 (monmap changed)... 2024-08-01T06:49:13.045 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:12 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi016", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-01T06:49:13.045 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:12 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:13.045 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:12 smithi016 ceph-mon[29266]: Reconfiguring daemon ceph-exporter.smithi016 on smithi016 2024-08-01T06:49:13.046 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:12 smithi016 ceph-mon[29266]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:13.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:12 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:13.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:12 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:13.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:12 smithi089 ceph-mon[36617]: Reconfiguring ceph-exporter.smithi016 (monmap changed)... 2024-08-01T06:49:13.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:12 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi016", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-01T06:49:13.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:12 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:13.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:12 smithi089 ceph-mon[36617]: Reconfiguring daemon ceph-exporter.smithi016 on smithi016 2024-08-01T06:49:13.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:12 smithi089 ceph-mon[36617]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:15.118 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:14 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:15.119 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:14 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:15.119 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:14 smithi016 ceph-mon[29266]: Reconfiguring crash.smithi016 (monmap changed)... 2024-08-01T06:49:15.119 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:14 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi016", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-01T06:49:15.119 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:14 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:15.119 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:14 smithi016 ceph-mon[29266]: Reconfiguring daemon crash.smithi016 on smithi016 2024-08-01T06:49:15.119 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:14 smithi016 ceph-mon[29266]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:15.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:14 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:15.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:14 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:15.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:14 smithi089 ceph-mon[36617]: Reconfiguring crash.smithi016 (monmap changed)... 2024-08-01T06:49:15.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:14 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi016", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-01T06:49:15.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:14 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:15.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:14 smithi089 ceph-mon[36617]: Reconfiguring daemon crash.smithi016 on smithi016 2024-08-01T06:49:15.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:14 smithi089 ceph-mon[36617]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:15.218 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:49:15.239 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph orch daemon add osd smithi016:vg_nvme/lv_4 2024-08-01T06:49:16.336 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:49:17.313 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:17 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:17.313 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:17 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:17.313 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:17 smithi016 ceph-mon[29266]: Reconfiguring alertmanager.smithi016 (dependencies changed)... 2024-08-01T06:49:17.313 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:17 smithi016 ceph-mon[29266]: Reconfiguring daemon alertmanager.smithi016 on smithi016 2024-08-01T06:49:17.313 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:17 smithi016 ceph-mon[29266]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:17.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:17 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:17.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:17 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:17.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:17 smithi089 ceph-mon[36617]: Reconfiguring alertmanager.smithi016 (dependencies changed)... 2024-08-01T06:49:17.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:17 smithi089 ceph-mon[36617]: Reconfiguring daemon alertmanager.smithi016 on smithi016 2024-08-01T06:49:17.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:17 smithi089 ceph-mon[36617]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:18.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:18 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:49:18.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:18 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:49:19.581 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:19 smithi089 ceph-mon[36617]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:19.611 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:19 smithi016 ceph-mon[29266]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:19.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.705+0000 7fa1dab46640 1 -- 172.21.15.16:0/3002424856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1d4107710 msgr2=0x7fa1d4107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:49:19.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.705+0000 7fa1dab46640 1 --2- 172.21.15.16:0/3002424856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1d4107710 0x7fa1d4107b10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009c20 tx=0x7fa1c402a970 comp rx=0 tx=0).stop 2024-08-01T06:49:19.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.705+0000 7fa1dab46640 1 -- 172.21.15.16:0/3002424856 shutdown_connections 2024-08-01T06:49:19.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.705+0000 7fa1dab46640 1 --2- 172.21.15.16:0/3002424856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1d41080e0 0x7fa1d4071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:49:19.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.705+0000 7fa1dab46640 1 --2- 172.21.15.16:0/3002424856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1d4107710 0x7fa1d4107b10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:49:19.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.705+0000 7fa1dab46640 1 -- 172.21.15.16:0/3002424856 >> 172.21.15.16:0/3002424856 conn(0x7fa1d406cc10 msgr2=0x7fa1d406f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:49:19.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.705+0000 7fa1dab46640 1 -- 172.21.15.16:0/3002424856 shutdown_connections 2024-08-01T06:49:19.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.705+0000 7fa1dab46640 1 -- 172.21.15.16:0/3002424856 wait complete. 2024-08-01T06:49:19.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.706+0000 7fa1dab46640 1 Processor -- start 2024-08-01T06:49:19.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.706+0000 7fa1dab46640 1 -- start start 2024-08-01T06:49:19.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.706+0000 7fa1dab46640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1d4107710 0x7fa1d419de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:49:19.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.706+0000 7fa1dab46640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1d41080e0 0x7fa1d419e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:49:19.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.706+0000 7fa1dab46640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d419e970 con 0x7fa1d41080e0 2024-08-01T06:49:19.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.706+0000 7fa1dab46640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d419eae0 con 0x7fa1d4107710 2024-08-01T06:49:19.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.706+0000 7fa1d3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1d41080e0 0x7fa1d419e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:49:19.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.706+0000 7fa1d3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1d41080e0 0x7fa1d419e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42970/0 (socket says 172.21.15.16:42970) 2024-08-01T06:49:19.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.706+0000 7fa1d3fff640 1 -- 172.21.15.16:0/371612604 learned_addr learned my addr 172.21.15.16:0/371612604 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:49:19.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.706+0000 7fa1d88e2640 1 --2- 172.21.15.16:0/371612604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1d4107710 0x7fa1d419de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:49:19.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.706+0000 7fa1d3fff640 1 -- 172.21.15.16:0/371612604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1d4107710 msgr2=0x7fa1d419de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:49:19.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.706+0000 7fa1d3fff640 1 --2- 172.21.15.16:0/371612604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1d4107710 0x7fa1d419de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:49:19.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.706+0000 7fa1d3fff640 1 -- 172.21.15.16:0/371612604 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c4009900 con 0x7fa1d41080e0 2024-08-01T06:49:19.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.707+0000 7fa1d3fff640 1 --2- 172.21.15.16:0/371612604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1d41080e0 0x7fa1d419e3a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800d720 tx=0x7fa1c800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:49:19.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.707+0000 7fa1d1ffb640 1 -- 172.21.15.16:0/371612604 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1c80051f0 con 0x7fa1d41080e0 2024-08-01T06:49:19.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.707+0000 7fa1d1ffb640 1 -- 172.21.15.16:0/371612604 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa1c8009ce0 con 0x7fa1d41080e0 2024-08-01T06:49:19.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.707+0000 7fa1dab46640 1 -- 172.21.15.16:0/371612604 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d41a3530 con 0x7fa1d41080e0 2024-08-01T06:49:19.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.707+0000 7fa1d1ffb640 1 -- 172.21.15.16:0/371612604 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1c8010460 con 0x7fa1d41080e0 2024-08-01T06:49:19.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.707+0000 7fa1dab46640 1 -- 172.21.15.16:0/371612604 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d41a3b00 con 0x7fa1d41080e0 2024-08-01T06:49:19.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.708+0000 7fa1dab46640 1 -- 172.21.15.16:0/371612604 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d4197f30 con 0x7fa1d41080e0 2024-08-01T06:49:19.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.708+0000 7fa1d1ffb640 1 -- 172.21.15.16:0/371612604 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7fa1c8005350 con 0x7fa1d41080e0 2024-08-01T06:49:19.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.709+0000 7fa1d1ffb640 1 --2- 172.21.15.16:0/371612604 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fa1bc06cbc0 0x7fa1bc06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:49:19.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.709+0000 7fa1d1ffb640 1 -- 172.21.15.16:0/371612604 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fa1c808ab60 con 0x7fa1d41080e0 2024-08-01T06:49:19.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.709+0000 7fa1d88e2640 1 --2- 172.21.15.16:0/371612604 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fa1bc06cbc0 0x7fa1bc06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:49:19.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.710+0000 7fa1d88e2640 1 --2- 172.21.15.16:0/371612604 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fa1bc06cbc0 0x7fa1bc06f080 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4006010 tx=0x7fa1c403d040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:49:19.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.713+0000 7fa1d1ffb640 1 -- 172.21.15.16:0/371612604 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fa1c8056140 con 0x7fa1d41080e0 2024-08-01T06:49:19.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:19.897+0000 7fa1dab46640 1 -- 172.21.15.16:0/371612604 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1d402c4f0 con 0x7fa1bc06cbc0 2024-08-01T06:49:20.445 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:20 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-01T06:49:20.446 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:20 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-01T06:49:20.446 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:20 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:20.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:20 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-01T06:49:20.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:20 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-01T06:49:20.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:20 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:21.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:21 smithi089 ceph-mon[36617]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:49:21.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:21 smithi089 ceph-mon[36617]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:21.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:21 smithi016 ceph-mon[29266]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:49:21.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:21 smithi016 ceph-mon[29266]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:22.697 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:22 smithi016 ceph-mon[29266]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:22.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:22 smithi089 ceph-mon[36617]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:24.122 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:23 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:24.122 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:23 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:24.122 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:23 smithi016 ceph-mon[29266]: Reconfiguring grafana.smithi016 (dependencies changed)... 2024-08-01T06:49:24.122 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:23 smithi016 ceph-mon[29266]: Reconfiguring daemon grafana.smithi016 on smithi016 2024-08-01T06:49:24.122 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:23 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3998360808' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f51cb32b-c276-4b4b-9085-351c6536cda6"}]: dispatch 2024-08-01T06:49:24.122 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:23 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3998360808' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f51cb32b-c276-4b4b-9085-351c6536cda6"}]': finished 2024-08-01T06:49:24.122 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:23 smithi016 ceph-mon[29266]: osdmap e6: 1 total, 0 up, 1 in 2024-08-01T06:49:24.122 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:23 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:49:24.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:23 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:24.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:23 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:24.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:23 smithi089 ceph-mon[36617]: Reconfiguring grafana.smithi016 (dependencies changed)... 2024-08-01T06:49:24.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:23 smithi089 ceph-mon[36617]: Reconfiguring daemon grafana.smithi016 on smithi016 2024-08-01T06:49:24.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:23 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/3998360808' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f51cb32b-c276-4b4b-9085-351c6536cda6"}]: dispatch 2024-08-01T06:49:24.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:23 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/3998360808' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f51cb32b-c276-4b4b-9085-351c6536cda6"}]': finished 2024-08-01T06:49:24.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:23 smithi089 ceph-mon[36617]: osdmap e6: 1 total, 0 up, 1 in 2024-08-01T06:49:24.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:23 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:49:25.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:24 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/1658512984' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-01T06:49:25.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:24 smithi089 ceph-mon[36617]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:25.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:24 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/1658512984' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-01T06:49:25.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:24 smithi016 ceph-mon[29266]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:26.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:26 smithi089 ceph-mon[36617]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:26.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:26 smithi016 ceph-mon[29266]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:28.789 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:28 smithi016 ceph-mon[29266]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:28.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:28 smithi089 ceph-mon[36617]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:30.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:30 smithi089 ceph-mon[36617]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:30.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:30 smithi016 ceph-mon[29266]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:32.817 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:32 smithi016 ceph-mon[29266]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:32.817 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:32 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:49:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:32 smithi089 ceph-mon[36617]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:32 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:49:34.109 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:33 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:34.109 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:33 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:34.109 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:33 smithi016 ceph-mon[29266]: Reconfiguring prometheus.smithi016 (dependencies changed)... 2024-08-01T06:49:34.109 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:33 smithi016 ceph-mon[29266]: Reconfiguring daemon prometheus.smithi016 on smithi016 2024-08-01T06:49:34.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:33 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:34.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:33 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:34.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:33 smithi089 ceph-mon[36617]: Reconfiguring prometheus.smithi016 (dependencies changed)... 2024-08-01T06:49:34.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:33 smithi089 ceph-mon[36617]: Reconfiguring daemon prometheus.smithi016 on smithi016 2024-08-01T06:49:35.117 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:34 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-01T06:49:35.117 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:34 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:35.117 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:34 smithi016 ceph-mon[29266]: Deploying daemon osd.0 on smithi016 2024-08-01T06:49:35.117 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:34 smithi016 ceph-mon[29266]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:35.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:34 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-01T06:49:35.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:34 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:35.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:34 smithi089 ceph-mon[36617]: Deploying daemon osd.0 on smithi016 2024-08-01T06:49:35.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:34 smithi089 ceph-mon[36617]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:36.846 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:36 smithi016 ceph-mon[29266]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:36.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:36 smithi089 ceph-mon[36617]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:39.632 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:39.632 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:39.632 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:39 smithi016 ceph-mon[29266]: Reconfiguring ceph-exporter.smithi089 (monmap changed)... 2024-08-01T06:49:39.633 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-01T06:49:39.633 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:39.633 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:39 smithi016 ceph-mon[29266]: Reconfiguring daemon ceph-exporter.smithi089 on smithi089 2024-08-01T06:49:39.633 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:39 smithi016 ceph-mon[29266]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:39.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:39 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:39.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:39 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:39.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:39 smithi089 ceph-mon[36617]: Reconfiguring ceph-exporter.smithi089 (monmap changed)... 2024-08-01T06:49:39.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:39 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-01T06:49:39.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:39 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:39.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:39 smithi089 ceph-mon[36617]: Reconfiguring daemon ceph-exporter.smithi089 on smithi089 2024-08-01T06:49:39.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:39 smithi089 ceph-mon[36617]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:40.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:40 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:40.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:40 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:40.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:40 smithi089 ceph-mon[36617]: Reconfiguring crash.smithi089 (monmap changed)... 2024-08-01T06:49:40.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:40 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-01T06:49:40.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:40 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:40.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:40 smithi089 ceph-mon[36617]: Reconfiguring daemon crash.smithi089 on smithi089 2024-08-01T06:49:40.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:40 smithi089 ceph-mon[36617]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:40.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:40 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:40.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:40 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:40.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:40 smithi016 ceph-mon[29266]: Reconfiguring crash.smithi089 (monmap changed)... 2024-08-01T06:49:40.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:40 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-01T06:49:40.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:40 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:40.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:40 smithi016 ceph-mon[29266]: Reconfiguring daemon crash.smithi089 on smithi089 2024-08-01T06:49:40.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:40 smithi016 ceph-mon[29266]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:41.966 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:41 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:41.966 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:41 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:41.966 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:41 smithi089 ceph-mon[36617]: Reconfiguring mgr.smithi089.hfgnsr (monmap changed)... 2024-08-01T06:49:41.966 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:41 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.hfgnsr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-01T06:49:41.967 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:41 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-01T06:49:41.967 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:41 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:41.967 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:41 smithi089 ceph-mon[36617]: Reconfiguring daemon mgr.smithi089.hfgnsr on smithi089 2024-08-01T06:49:42.114 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:41 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:42.114 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:41 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:42.114 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:41 smithi016 ceph-mon[29266]: Reconfiguring mgr.smithi089.hfgnsr (monmap changed)... 2024-08-01T06:49:42.114 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:41 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.hfgnsr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-01T06:49:42.114 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:41 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-01T06:49:42.115 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:41 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:42.115 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:41 smithi016 ceph-mon[29266]: Reconfiguring daemon mgr.smithi089.hfgnsr on smithi089 2024-08-01T06:49:43.215 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:43 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:43.215 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:43 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:43.215 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:43 smithi089 ceph-mon[36617]: Reconfiguring mon.smithi089 (monmap changed)... 2024-08-01T06:49:43.215 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:43 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-01T06:49:43.215 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:43 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-01T06:49:43.215 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:43 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:43.215 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:43 smithi089 ceph-mon[36617]: Reconfiguring daemon mon.smithi089 on smithi089 2024-08-01T06:49:43.215 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:43 smithi089 ceph-mon[36617]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:43.276 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:43 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:43.277 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:43 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:43.277 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:43 smithi016 ceph-mon[29266]: Reconfiguring mon.smithi089 (monmap changed)... 2024-08-01T06:49:43.277 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:43 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-01T06:49:43.277 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:43 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-01T06:49:43.277 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:43 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:43.277 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:43 smithi016 ceph-mon[29266]: Reconfiguring daemon mon.smithi089 on smithi089 2024-08-01T06:49:43.277 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:43 smithi016 ceph-mon[29266]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:44.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:44.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:44.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-01T06:49:44.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-01T06:49:44.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi016.front.sepia.ceph.com:9093"}]: dispatch 2024-08-01T06:49:44.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi016.front.sepia.ceph.com:9093"}]: dispatch 2024-08-01T06:49:44.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:44.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-01T06:49:44.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-01T06:49:44.525 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi016.front.sepia.ceph.com:3000"}]: dispatch 2024-08-01T06:49:44.525 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi016.front.sepia.ceph.com:3000"}]: dispatch 2024-08-01T06:49:44.525 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:44.525 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-01T06:49:44.525 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-01T06:49:44.525 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi016.front.sepia.ceph.com:9095"}]: dispatch 2024-08-01T06:49:44.525 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi016.front.sepia.ceph.com:9095"}]: dispatch 2024-08-01T06:49:44.525 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:44.525 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:44.525 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:44.525 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:44 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:49:44.569 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:44.569 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:44.569 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-01T06:49:44.569 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-01T06:49:44.569 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi016.front.sepia.ceph.com:9093"}]: dispatch 2024-08-01T06:49:44.570 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi016.front.sepia.ceph.com:9093"}]: dispatch 2024-08-01T06:49:44.570 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:44.570 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-01T06:49:44.570 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-01T06:49:44.570 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi016.front.sepia.ceph.com:3000"}]: dispatch 2024-08-01T06:49:44.570 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi016.front.sepia.ceph.com:3000"}]: dispatch 2024-08-01T06:49:44.570 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:44.570 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-01T06:49:44.570 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-01T06:49:44.570 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi016.front.sepia.ceph.com:9095"}]: dispatch 2024-08-01T06:49:44.570 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi016.front.sepia.ceph.com:9095"}]: dispatch 2024-08-01T06:49:44.570 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:44.570 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:44.571 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:44.571 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:44 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:49:45.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:45 smithi016 ceph-mon[29266]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:45.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:45 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:45.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:45 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:45.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:45 smithi089 ceph-mon[36617]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:45.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:45 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:45.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:45 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:46.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:46.274+0000 7fa1d1ffb640 1 -- 172.21.15.16:0/371612604 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa1d402c4f0 con 0x7fa1bc06cbc0 2024-08-01T06:49:46.275 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 0 on host 'smithi016' 2024-08-01T06:49:46.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:46.276+0000 7fa1dab46640 1 -- 172.21.15.16:0/371612604 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fa1bc06cbc0 msgr2=0x7fa1bc06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:49:46.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:46.276+0000 7fa1dab46640 1 --2- 172.21.15.16:0/371612604 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fa1bc06cbc0 0x7fa1bc06f080 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4006010 tx=0x7fa1c403d040 comp rx=0 tx=0).stop 2024-08-01T06:49:46.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:46.276+0000 7fa1dab46640 1 -- 172.21.15.16:0/371612604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1d41080e0 msgr2=0x7fa1d419e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:49:46.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:46.276+0000 7fa1dab46640 1 --2- 172.21.15.16:0/371612604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1d41080e0 0x7fa1d419e3a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800d720 tx=0x7fa1c800dbe0 comp rx=0 tx=0).stop 2024-08-01T06:49:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:46.276+0000 7fa1dab46640 1 -- 172.21.15.16:0/371612604 shutdown_connections 2024-08-01T06:49:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:46.276+0000 7fa1dab46640 1 --2- 172.21.15.16:0/371612604 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fa1bc06cbc0 0x7fa1bc06f080 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:49:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:46.276+0000 7fa1dab46640 1 --2- 172.21.15.16:0/371612604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1d41080e0 0x7fa1d419e3a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:49:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:46.276+0000 7fa1dab46640 1 --2- 172.21.15.16:0/371612604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1d4107710 0x7fa1d419de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:49:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:46.276+0000 7fa1dab46640 1 -- 172.21.15.16:0/371612604 >> 172.21.15.16:0/371612604 conn(0x7fa1d406cc10 msgr2=0x7fa1d410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:49:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:46.276+0000 7fa1dab46640 1 -- 172.21.15.16:0/371612604 shutdown_connections 2024-08-01T06:49:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:46.276+0000 7fa1dab46640 1 -- 172.21.15.16:0/371612604 wait complete. 2024-08-01T06:49:46.894 DEBUG:teuthology.orchestra.run.smithi016:osd.0> sudo journalctl -f -n 0 -u ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.0.service 2024-08-01T06:49:46.896 INFO:tasks.cephadm:Deploying osd.1 on smithi016 with /dev/vg_nvme/lv_3... 2024-08-01T06:49:46.897 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-01T06:49:47.288 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:49:47.511 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:47 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:47.512 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:47 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:47.512 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:47 smithi016 ceph-mon[29266]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:47.512 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:47 smithi016 ceph-mon[29266]: from='osd.0 [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-01T06:49:47.512 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:49:47 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0[47643]: 2024-08-01T06:49:47.210+0000 7f08760a9640 -1 osd.0 0 log_to_monitors true 2024-08-01T06:49:47.573 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:47 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:47.573 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:47 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:47.573 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:47 smithi089 ceph-mon[36617]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:47.573 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:47 smithi089 ceph-mon[36617]: from='osd.0 [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-01T06:49:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:48 smithi089 ceph-mon[36617]: from='osd.0 [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-01T06:49:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:48 smithi089 ceph-mon[36617]: osdmap e7: 1 total, 0 up, 1 in 2024-08-01T06:49:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:48 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:49:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:48 smithi089 ceph-mon[36617]: from='osd.0 [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-08-01T06:49:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:48 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:49:48.568 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:48 smithi016 ceph-mon[29266]: from='osd.0 [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-01T06:49:48.569 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:48 smithi016 ceph-mon[29266]: osdmap e7: 1 total, 0 up, 1 in 2024-08-01T06:49:48.569 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:48 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:49:48.569 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:48 smithi016 ceph-mon[29266]: from='osd.0 [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-08-01T06:49:48.569 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:48 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:49:49.287 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:49:49 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0[47643]: 2024-08-01T06:49:49.054+0000 7f0871807640 -1 osd.0 0 waiting for initial osdmap 2024-08-01T06:49:49.287 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:49:49 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0[47643]: 2024-08-01T06:49:49.058+0000 7f0869e3a640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-01T06:49:49.600 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:49 smithi016 ceph-mon[29266]: from='osd.0 [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-08-01T06:49:49.601 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:49 smithi016 ceph-mon[29266]: osdmap e8: 1 total, 0 up, 1 in 2024-08-01T06:49:49.601 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:49 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:49:49.601 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:49 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:49:49.601 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:49 smithi016 ceph-mon[29266]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:49.601 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:49 smithi016 ceph-mon[29266]: from='osd.0 [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750]' entity='osd.0' 2024-08-01T06:49:49.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:49 smithi089 ceph-mon[36617]: from='osd.0 [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-08-01T06:49:49.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:49 smithi089 ceph-mon[36617]: osdmap e8: 1 total, 0 up, 1 in 2024-08-01T06:49:49.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:49 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:49:49.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:49 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:49:49.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:49 smithi089 ceph-mon[36617]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-01T06:49:49.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:49 smithi089 ceph-mon[36617]: from='osd.0 [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750]' entity='osd.0' 2024-08-01T06:49:50.499 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:50 smithi016 ceph-mon[29266]: purged_snaps scrub starts 2024-08-01T06:49:50.500 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:50 smithi016 ceph-mon[29266]: purged_snaps scrub ok 2024-08-01T06:49:50.500 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:50 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:49:50.500 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:50 smithi016 ceph-mon[29266]: osd.0 [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750] boot 2024-08-01T06:49:50.500 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:50 smithi016 ceph-mon[29266]: osdmap e9: 1 total, 1 up, 1 in 2024-08-01T06:49:50.500 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:50 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:49:50.503 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:49:50.528 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph orch daemon add osd smithi016:vg_nvme/lv_3 2024-08-01T06:49:50.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:50 smithi089 ceph-mon[36617]: purged_snaps scrub starts 2024-08-01T06:49:50.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:50 smithi089 ceph-mon[36617]: purged_snaps scrub ok 2024-08-01T06:49:50.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:50 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:49:50.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:50 smithi089 ceph-mon[36617]: osd.0 [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750] boot 2024-08-01T06:49:50.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:50 smithi089 ceph-mon[36617]: osdmap e9: 1 total, 1 up, 1 in 2024-08-01T06:49:50.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:50 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:49:50.939 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:49:51.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:51 smithi016 ceph-mon[29266]: pgmap v36: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:49:51.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:51 smithi016 ceph-mon[29266]: osdmap e10: 1 total, 1 up, 1 in 2024-08-01T06:49:51.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:51 smithi089 ceph-mon[36617]: pgmap v36: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:49:51.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:51 smithi089 ceph-mon[36617]: osdmap e10: 1 total, 1 up, 1 in 2024-08-01T06:49:52.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:52 smithi089 ceph-mon[36617]: pgmap v38: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:49:52.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:52 smithi016 ceph-mon[29266]: pgmap v38: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:49:53.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.735+0000 7fa22ff26640 1 -- 172.21.15.16:0/3675238629 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2280ffb90 msgr2=0x7fa2280fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:49:53.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.735+0000 7fa22ff26640 1 --2- 172.21.15.16:0/3675238629 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2280ffb90 0x7fa2280fff90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa224009880 tx=0x7fa22402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:49:53.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.735+0000 7fa22ff26640 1 -- 172.21.15.16:0/3675238629 shutdown_connections 2024-08-01T06:49:53.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.735+0000 7fa22ff26640 1 --2- 172.21.15.16:0/3675238629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa228100d90 0x7fa228101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:49:53.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.735+0000 7fa22ff26640 1 --2- 172.21.15.16:0/3675238629 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2280ffb90 0x7fa2280fff90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:49:53.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.735+0000 7fa22ff26640 1 -- 172.21.15.16:0/3675238629 >> 172.21.15.16:0/3675238629 conn(0x7fa2280fb320 msgr2=0x7fa2280fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:49:53.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.736+0000 7fa22ff26640 1 -- 172.21.15.16:0/3675238629 shutdown_connections 2024-08-01T06:49:53.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.736+0000 7fa22ff26640 1 -- 172.21.15.16:0/3675238629 wait complete. 2024-08-01T06:49:53.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.736+0000 7fa22ff26640 1 Processor -- start 2024-08-01T06:49:53.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.736+0000 7fa22ff26640 1 -- start start 2024-08-01T06:49:53.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.736+0000 7fa22ff26640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2280ffb90 0x7fa228197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:49:53.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.736+0000 7fa22ff26640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa228100d90 0x7fa228197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:49:53.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.736+0000 7fa22ff26640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa228198360 con 0x7fa228100d90 2024-08-01T06:49:53.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.736+0000 7fa22ff26640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2281984d0 con 0x7fa2280ffb90 2024-08-01T06:49:53.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.736+0000 7fa22d4c1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa228100d90 0x7fa228197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:49:53.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.736+0000 7fa22d4c1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa228100d90 0x7fa228197d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46136/0 (socket says 172.21.15.16:46136) 2024-08-01T06:49:53.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.737+0000 7fa22d4c1640 1 -- 172.21.15.16:0/3604642607 learned_addr learned my addr 172.21.15.16:0/3604642607 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:49:53.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.737+0000 7fa22dcc2640 1 --2- 172.21.15.16:0/3604642607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2280ffb90 0x7fa228197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:49:53.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.737+0000 7fa22d4c1640 1 -- 172.21.15.16:0/3604642607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2280ffb90 msgr2=0x7fa228197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:49:53.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.737+0000 7fa22d4c1640 1 --2- 172.21.15.16:0/3604642607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2280ffb90 0x7fa228197850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:49:53.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.737+0000 7fa22d4c1640 1 -- 172.21.15.16:0/3604642607 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa224009560 con 0x7fa228100d90 2024-08-01T06:49:53.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.737+0000 7fa22d4c1640 1 --2- 172.21.15.16:0/3604642607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa228100d90 0x7fa228197d90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa21800d900 tx=0x7fa21800ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:49:53.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.737+0000 7fa21effd640 1 -- 172.21.15.16:0/3604642607 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa218009c00 con 0x7fa228100d90 2024-08-01T06:49:53.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.737+0000 7fa22ff26640 1 -- 172.21.15.16:0/3604642607 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22819cf20 con 0x7fa228100d90 2024-08-01T06:49:53.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.737+0000 7fa21effd640 1 -- 172.21.15.16:0/3604642607 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa21800b660 con 0x7fa228100d90 2024-08-01T06:49:53.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.737+0000 7fa21effd640 1 -- 172.21.15.16:0/3604642607 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa21800f680 con 0x7fa228100d90 2024-08-01T06:49:53.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.737+0000 7fa22ff26640 1 -- 172.21.15.16:0/3604642607 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22819d4c0 con 0x7fa228100d90 2024-08-01T06:49:53.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.738+0000 7fa22ff26640 1 -- 172.21.15.16:0/3604642607 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2280fff90 con 0x7fa228100d90 2024-08-01T06:49:53.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.739+0000 7fa21effd640 1 -- 172.21.15.16:0/3604642607 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7fa218010ab0 con 0x7fa228100d90 2024-08-01T06:49:53.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.739+0000 7fa21effd640 1 --2- 172.21.15.16:0/3604642607 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fa21406cbd0 0x7fa21406f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:49:53.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.739+0000 7fa21effd640 1 -- 172.21.15.16:0/3604642607 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7fa21808b140 con 0x7fa228100d90 2024-08-01T06:49:53.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.740+0000 7fa22dcc2640 1 --2- 172.21.15.16:0/3604642607 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fa21406cbd0 0x7fa21406f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:49:53.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.740+0000 7fa22dcc2640 1 --2- 172.21.15.16:0/3604642607 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fa21406cbd0 0x7fa21406f090 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa224009230 tx=0x7fa224005d50 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:49:53.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.744+0000 7fa21effd640 1 -- 172.21.15.16:0/3604642607 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fa218056390 con 0x7fa228100d90 2024-08-01T06:49:53.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:49:53.932+0000 7fa22ff26640 1 -- 172.21.15.16:0/3604642607 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa22802c540 con 0x7fa21406cbd0 2024-08-01T06:49:54.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:53 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:54.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:53 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:54.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:53 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:54.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:53 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:55.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:54 smithi089 ceph-mon[36617]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:49:55.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:54 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-01T06:49:55.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:54 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-01T06:49:55.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:54 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:55.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:54 smithi089 ceph-mon[36617]: pgmap v39: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:49:55.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:54 smithi016 ceph-mon[29266]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:49:55.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:54 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-01T06:49:55.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:54 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-01T06:49:55.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:54 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:55.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:54 smithi016 ceph-mon[29266]: pgmap v39: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:49:56.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:56 smithi016 ceph-mon[29266]: pgmap v40: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:49:56.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:56 smithi089 ceph-mon[36617]: pgmap v40: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:49:57.968 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:57 smithi016 ceph-mon[29266]: Detected new or changed devices on smithi016 2024-08-01T06:49:57.968 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:57 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:57.968 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:57 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:57.968 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:57 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:49:57.969 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:57 smithi016 ceph-mon[29266]: Adjusting osd_memory_target on smithi016 to 11844M 2024-08-01T06:49:57.969 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:57 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:57.969 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:57 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:57.969 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:57 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:49:57.969 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:57 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:57.969 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:57 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:49:58.029 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:57 smithi089 ceph-mon[36617]: Detected new or changed devices on smithi016 2024-08-01T06:49:58.029 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:57 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:58.029 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:57 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:58.029 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:57 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:49:58.029 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:57 smithi089 ceph-mon[36617]: Adjusting osd_memory_target on smithi016 to 11844M 2024-08-01T06:49:58.029 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:57 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:58.029 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:57 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:49:58.029 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:57 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:49:58.029 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:57 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:58.029 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:57 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:49:58.848 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:58 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3151397073' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2670e18d-6fbf-460d-86c0-5b897c25d542"}]: dispatch 2024-08-01T06:49:58.848 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:58 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3151397073' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2670e18d-6fbf-460d-86c0-5b897c25d542"}]': finished 2024-08-01T06:49:58.848 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:58 smithi016 ceph-mon[29266]: osdmap e11: 2 total, 1 up, 2 in 2024-08-01T06:49:58.848 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:58 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-01T06:49:58.848 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:58 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:58.848 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:58 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:58.848 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:58 smithi016 ceph-mon[29266]: pgmap v42: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:49:59.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:58 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/3151397073' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2670e18d-6fbf-460d-86c0-5b897c25d542"}]: dispatch 2024-08-01T06:49:59.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:58 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/3151397073' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2670e18d-6fbf-460d-86c0-5b897c25d542"}]': finished 2024-08-01T06:49:59.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:58 smithi089 ceph-mon[36617]: osdmap e11: 2 total, 1 up, 2 in 2024-08-01T06:49:59.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:58 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-01T06:49:59.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:58 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:59.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:58 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:49:59.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:58 smithi089 ceph-mon[36617]: pgmap v42: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:50:00.121 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:49:59 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/930850406' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-01T06:50:00.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:49:59 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/930850406' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-01T06:50:01.115 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:00 smithi016 ceph-mon[29266]: overall HEALTH_OK 2024-08-01T06:50:01.116 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:00 smithi016 ceph-mon[29266]: pgmap v43: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:50:01.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:00 smithi089 ceph-mon[36617]: overall HEALTH_OK 2024-08-01T06:50:01.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:00 smithi089 ceph-mon[36617]: pgmap v43: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:50:02.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:02 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:02.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:02 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:02.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:02 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:02.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:02 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:50:02.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:02 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:02.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:02 smithi089 ceph-mon[36617]: pgmap v44: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:50:02.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:02 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:50:02.897 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:02 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:02.897 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:02 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:02.897 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:02 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:02.897 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:02 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:50:02.897 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:02 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:02.897 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:02 smithi016 ceph-mon[29266]: pgmap v44: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:50:02.897 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:02 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:50:04.748 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:04 smithi016 ceph-mon[29266]: pgmap v45: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:50:04.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:04 smithi089 ceph-mon[36617]: pgmap v45: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:50:05.826 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:05 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-01T06:50:05.826 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:05 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:05.826 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:05 smithi016 ceph-mon[29266]: Deploying daemon osd.1 on smithi016 2024-08-01T06:50:05.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:05 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-01T06:50:05.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:05 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:05.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:05 smithi089 ceph-mon[36617]: Deploying daemon osd.1 on smithi016 2024-08-01T06:50:06.789 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:06 smithi016 ceph-mon[29266]: pgmap v46: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:50:06.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:06 smithi089 ceph-mon[36617]: pgmap v46: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:50:08.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:08 smithi089 ceph-mon[36617]: pgmap v47: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:50:08.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:08 smithi016 ceph-mon[29266]: pgmap v47: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:50:10.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:10 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:50:10.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:10 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:10.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:10 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:10.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:10 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:50:10.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:10 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:10.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:10 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:11.363 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:11 smithi016 ceph-mon[29266]: pgmap v48: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:50:11.589 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:11 smithi089 ceph-mon[36617]: pgmap v48: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:50:13.283 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:12 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:13.283 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:12 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:13.283 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:12 smithi016 ceph-mon[29266]: pgmap v49: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:50:13.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:13.315+0000 7fa21effd640 1 -- 172.21.15.16:0/3604642607 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa22802c540 con 0x7fa21406cbd0 2024-08-01T06:50:13.318 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 1 on host 'smithi016' 2024-08-01T06:50:13.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:13.318+0000 7fa22ff26640 1 -- 172.21.15.16:0/3604642607 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fa21406cbd0 msgr2=0x7fa21406f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:50:13.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:13.318+0000 7fa22ff26640 1 --2- 172.21.15.16:0/3604642607 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fa21406cbd0 0x7fa21406f090 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa224009230 tx=0x7fa224005d50 comp rx=0 tx=0).stop 2024-08-01T06:50:13.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:13.318+0000 7fa22ff26640 1 -- 172.21.15.16:0/3604642607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa228100d90 msgr2=0x7fa228197d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:50:13.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:13.318+0000 7fa22ff26640 1 --2- 172.21.15.16:0/3604642607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa228100d90 0x7fa228197d90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa21800d900 tx=0x7fa21800ddc0 comp rx=0 tx=0).stop 2024-08-01T06:50:13.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:13.318+0000 7fa22ff26640 1 -- 172.21.15.16:0/3604642607 shutdown_connections 2024-08-01T06:50:13.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:13.318+0000 7fa22ff26640 1 --2- 172.21.15.16:0/3604642607 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fa21406cbd0 0x7fa21406f090 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:50:13.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:13.318+0000 7fa22ff26640 1 --2- 172.21.15.16:0/3604642607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa228100d90 0x7fa228197d90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:50:13.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:13.318+0000 7fa22ff26640 1 --2- 172.21.15.16:0/3604642607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2280ffb90 0x7fa228197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:50:13.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:13.318+0000 7fa22ff26640 1 -- 172.21.15.16:0/3604642607 >> 172.21.15.16:0/3604642607 conn(0x7fa2280fb320 msgr2=0x7fa228102430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:50:13.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:13.318+0000 7fa22ff26640 1 -- 172.21.15.16:0/3604642607 shutdown_connections 2024-08-01T06:50:13.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:13.318+0000 7fa22ff26640 1 -- 172.21.15.16:0/3604642607 wait complete. 2024-08-01T06:50:13.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:12 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:13.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:12 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:13.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:12 smithi089 ceph-mon[36617]: pgmap v49: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:50:13.909 DEBUG:teuthology.orchestra.run.smithi016:osd.1> sudo journalctl -f -n 0 -u ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.1.service 2024-08-01T06:50:13.912 INFO:tasks.cephadm:Deploying osd.2 on smithi016 with /dev/vg_nvme/lv_2... 2024-08-01T06:50:13.912 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-01T06:50:14.148 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 06:50:14 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1[55324]: 2024-08-01T06:50:14.094+0000 7f8bd4b5f640 -1 osd.1 0 log_to_monitors true 2024-08-01T06:50:14.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:14 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:14.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:14 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:14.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:14 smithi016 ceph-mon[29266]: from='osd.1 [v2:172.21.15.16:6810/3206893924,v1:172.21.15.16:6811/3206893924]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-01T06:50:14.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:14 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:14.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:14 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:14.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:14 smithi089 ceph-mon[36617]: from='osd.1 [v2:172.21.15.16:6810/3206893924,v1:172.21.15.16:6811/3206893924]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-01T06:50:14.744 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:50:15.496 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 06:50:15 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1[55324]: 2024-08-01T06:50:15.320+0000 7f8bd1af8640 -1 osd.1 0 waiting for initial osdmap 2024-08-01T06:50:15.496 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 06:50:15 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1[55324]: 2024-08-01T06:50:15.326+0000 7f8bcc8f8640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-01T06:50:15.496 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:15 smithi016 ceph-mon[29266]: from='osd.1 [v2:172.21.15.16:6810/3206893924,v1:172.21.15.16:6811/3206893924]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-01T06:50:15.496 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:15 smithi016 ceph-mon[29266]: osdmap e12: 2 total, 1 up, 2 in 2024-08-01T06:50:15.496 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:15 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-01T06:50:15.496 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:15 smithi016 ceph-mon[29266]: from='osd.1 [v2:172.21.15.16:6810/3206893924,v1:172.21.15.16:6811/3206893924]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-08-01T06:50:15.496 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:15 smithi016 ceph-mon[29266]: pgmap v51: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:50:15.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:15 smithi089 ceph-mon[36617]: from='osd.1 [v2:172.21.15.16:6810/3206893924,v1:172.21.15.16:6811/3206893924]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-01T06:50:15.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:15 smithi089 ceph-mon[36617]: osdmap e12: 2 total, 1 up, 2 in 2024-08-01T06:50:15.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:15 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-01T06:50:15.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:15 smithi089 ceph-mon[36617]: from='osd.1 [v2:172.21.15.16:6810/3206893924,v1:172.21.15.16:6811/3206893924]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-08-01T06:50:15.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:15 smithi089 ceph-mon[36617]: pgmap v51: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:50:16.591 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:16 smithi016 ceph-mon[29266]: from='osd.1 [v2:172.21.15.16:6810/3206893924,v1:172.21.15.16:6811/3206893924]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-08-01T06:50:16.591 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:16 smithi016 ceph-mon[29266]: osdmap e13: 2 total, 1 up, 2 in 2024-08-01T06:50:16.592 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:16 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-01T06:50:16.592 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:16 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-01T06:50:16.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:16 smithi089 ceph-mon[36617]: from='osd.1 [v2:172.21.15.16:6810/3206893924,v1:172.21.15.16:6811/3206893924]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-08-01T06:50:16.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:16 smithi089 ceph-mon[36617]: osdmap e13: 2 total, 1 up, 2 in 2024-08-01T06:50:16.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:16 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-01T06:50:16.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:16 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-01T06:50:17.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:17 smithi016 ceph-mon[29266]: purged_snaps scrub starts 2024-08-01T06:50:17.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:17 smithi016 ceph-mon[29266]: purged_snaps scrub ok 2024-08-01T06:50:17.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:17 smithi016 ceph-mon[29266]: osd.1 [v2:172.21.15.16:6810/3206893924,v1:172.21.15.16:6811/3206893924] boot 2024-08-01T06:50:17.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:17 smithi016 ceph-mon[29266]: osdmap e14: 2 total, 2 up, 2 in 2024-08-01T06:50:17.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:17 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-01T06:50:17.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:17 smithi016 ceph-mon[29266]: pgmap v54: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:50:17.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:17 smithi089 ceph-mon[36617]: purged_snaps scrub starts 2024-08-01T06:50:17.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:17 smithi089 ceph-mon[36617]: purged_snaps scrub ok 2024-08-01T06:50:17.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:17 smithi089 ceph-mon[36617]: osd.1 [v2:172.21.15.16:6810/3206893924,v1:172.21.15.16:6811/3206893924] boot 2024-08-01T06:50:17.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:17 smithi089 ceph-mon[36617]: osdmap e14: 2 total, 2 up, 2 in 2024-08-01T06:50:17.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:17 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-01T06:50:17.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:17 smithi089 ceph-mon[36617]: pgmap v54: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-01T06:50:17.773 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:50:17.792 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph orch daemon add osd smithi016:vg_nvme/lv_2 2024-08-01T06:50:18.622 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:50:18.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:18 smithi089 ceph-mon[36617]: osdmap e15: 2 total, 2 up, 2 in 2024-08-01T06:50:18.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:18 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:50:18.647 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:18 smithi016 ceph-mon[29266]: osdmap e15: 2 total, 2 up, 2 in 2024-08-01T06:50:18.647 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:18 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:50:19.387 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:19 smithi016 ceph-mon[29266]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:19.387 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:19 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:19.388 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:19 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:19.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:19 smithi089 ceph-mon[36617]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:19.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:19 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:19.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:19 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:20.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:20 smithi089 ceph-mon[36617]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:20.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:20 smithi016 ceph-mon[29266]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:21.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.154+0000 7f48a08a5640 1 -- 172.21.15.16:0/4261211044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0ffcf0 msgr2=0x7f489c100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:50:21.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.154+0000 7f48a08a5640 1 --2- 172.21.15.16:0/4261211044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0ffcf0 0x7f489c100170 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4884009880 tx=0x7f488402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:50:21.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.154+0000 7f48a08a5640 1 -- 172.21.15.16:0/4261211044 shutdown_connections 2024-08-01T06:50:21.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.154+0000 7f48a08a5640 1 --2- 172.21.15.16:0/4261211044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0ffcf0 0x7f489c100170 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:50:21.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.154+0000 7f48a08a5640 1 --2- 172.21.15.16:0/4261211044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f489c0feaf0 0x7f489c0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:50:21.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.154+0000 7f48a08a5640 1 -- 172.21.15.16:0/4261211044 >> 172.21.15.16:0/4261211044 conn(0x7f489c0fa280 msgr2=0x7f489c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:50:21.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.154+0000 7f48a08a5640 1 -- 172.21.15.16:0/4261211044 shutdown_connections 2024-08-01T06:50:21.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.154+0000 7f48a08a5640 1 -- 172.21.15.16:0/4261211044 wait complete. 2024-08-01T06:50:21.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.155+0000 7f48a08a5640 1 Processor -- start 2024-08-01T06:50:21.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.155+0000 7f48a08a5640 1 -- start start 2024-08-01T06:50:21.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.155+0000 7f48a08a5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0feaf0 0x7f489c194570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:50:21.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.155+0000 7f48a08a5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f489c0ffcf0 0x7f489c194ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:50:21.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.155+0000 7f48a08a5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c195080 con 0x7f489c0feaf0 2024-08-01T06:50:21.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.155+0000 7f48a08a5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c1951f0 con 0x7f489c0ffcf0 2024-08-01T06:50:21.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.155+0000 7f489a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0feaf0 0x7f489c194570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:50:21.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.155+0000 7f489a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0feaf0 0x7f489c194570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44152/0 (socket says 172.21.15.16:44152) 2024-08-01T06:50:21.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.155+0000 7f489a59c640 1 -- 172.21.15.16:0/1236602568 learned_addr learned my addr 172.21.15.16:0/1236602568 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:50:21.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.155+0000 7f4893fff640 1 --2- 172.21.15.16:0/1236602568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f489c0ffcf0 0x7f489c194ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:50:21.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.156+0000 7f489a59c640 1 -- 172.21.15.16:0/1236602568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f489c0ffcf0 msgr2=0x7f489c194ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:50:21.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.156+0000 7f489a59c640 1 --2- 172.21.15.16:0/1236602568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f489c0ffcf0 0x7f489c194ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:50:21.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.156+0000 7f489a59c640 1 -- 172.21.15.16:0/1236602568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4884009560 con 0x7f489c0feaf0 2024-08-01T06:50:21.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.156+0000 7f4893fff640 1 --2- 172.21.15.16:0/1236602568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f489c0ffcf0 0x7f489c194ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T06:50:21.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.156+0000 7f489a59c640 1 --2- 172.21.15.16:0/1236602568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0feaf0 0x7f489c194570 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f488c00d720 tx=0x7f488c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:50:21.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.156+0000 7f48937fe640 1 -- 172.21.15.16:0/1236602568 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f488c0041f0 con 0x7f489c0feaf0 2024-08-01T06:50:21.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.156+0000 7f48a08a5640 1 -- 172.21.15.16:0/1236602568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489c199c90 con 0x7f489c0feaf0 2024-08-01T06:50:21.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.156+0000 7f48937fe640 1 -- 172.21.15.16:0/1236602568 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f488c004350 con 0x7f489c0feaf0 2024-08-01T06:50:21.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.156+0000 7f48937fe640 1 -- 172.21.15.16:0/1236602568 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f488c003df0 con 0x7f489c0feaf0 2024-08-01T06:50:21.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.156+0000 7f48a08a5640 1 -- 172.21.15.16:0/1236602568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489c19a1b0 con 0x7f489c0feaf0 2024-08-01T06:50:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.157+0000 7f48a08a5640 1 -- 172.21.15.16:0/1236602568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489c18e670 con 0x7f489c0feaf0 2024-08-01T06:50:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.158+0000 7f48937fe640 1 -- 172.21.15.16:0/1236602568 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f488c0035f0 con 0x7f489c0feaf0 2024-08-01T06:50:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.158+0000 7f48937fe640 1 --2- 172.21.15.16:0/1236602568 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f488806cb70 0x7f488806f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:50:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.158+0000 7f48937fe640 1 -- 172.21.15.16:0/1236602568 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7f488c08afe0 con 0x7f489c0feaf0 2024-08-01T06:50:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.158+0000 7f4893fff640 1 --2- 172.21.15.16:0/1236602568 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f488806cb70 0x7f488806f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:50:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.159+0000 7f4893fff640 1 --2- 172.21.15.16:0/1236602568 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f488806cb70 0x7f488806f030 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4884000c00 tx=0x7f48840314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:50:21.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.163+0000 7f48937fe640 1 -- 172.21.15.16:0/1236602568 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f488c056080 con 0x7f489c0feaf0 2024-08-01T06:50:21.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:21.344+0000 7f48a08a5640 1 -- 172.21.15.16:0/1236602568 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f489c02c5d0 con 0x7f488806cb70 2024-08-01T06:50:21.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:21 smithi089 ceph-mon[36617]: from='client.14282 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:50:21.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:21 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-01T06:50:21.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:21 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-01T06:50:21.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:21 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:21.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:21 smithi016 ceph-mon[29266]: from='client.14282 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:50:21.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:21 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-01T06:50:21.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:21 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-01T06:50:21.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:21 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:22.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:22 smithi016 ceph-mon[29266]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:23.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:22 smithi089 ceph-mon[36617]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:24.970 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:24 smithi016 ceph-mon[29266]: Detected new or changed devices on smithi016 2024-08-01T06:50:24.971 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:24 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:24.971 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:24 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:24.971 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:24 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:50:24.971 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:24 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:50:24.971 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:24 smithi016 ceph-mon[29266]: Adjusting osd_memory_target on smithi016 to 5922M 2024-08-01T06:50:24.971 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:24 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:24.971 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:24 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:24.972 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:24 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:50:24.972 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:24 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:24.972 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:24 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:50:24.972 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:24 smithi016 ceph-mon[29266]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:25.328 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:24 smithi089 ceph-mon[36617]: Detected new or changed devices on smithi016 2024-08-01T06:50:25.328 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:24 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:25.328 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:24 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:25.328 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:24 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:50:25.329 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:24 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:50:25.329 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:24 smithi089 ceph-mon[36617]: Adjusting osd_memory_target on smithi016 to 5922M 2024-08-01T06:50:25.329 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:24 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:25.329 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:24 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:25.329 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:24 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:50:25.329 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:24 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:25.329 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:24 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:50:25.329 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:24 smithi089 ceph-mon[36617]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:26.133 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:25 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/1538202967' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94f66ce0-ee7b-4d29-8a65-5ee7464270db"}]: dispatch 2024-08-01T06:50:26.134 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:25 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/1538202967' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "94f66ce0-ee7b-4d29-8a65-5ee7464270db"}]': finished 2024-08-01T06:50:26.134 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:25 smithi016 ceph-mon[29266]: osdmap e16: 3 total, 2 up, 3 in 2024-08-01T06:50:26.134 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:25 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T06:50:26.134 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:25 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:26.134 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:25 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:26.134 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:25 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/973280750' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-01T06:50:26.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:25 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/1538202967' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94f66ce0-ee7b-4d29-8a65-5ee7464270db"}]: dispatch 2024-08-01T06:50:26.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:25 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/1538202967' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "94f66ce0-ee7b-4d29-8a65-5ee7464270db"}]': finished 2024-08-01T06:50:26.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:25 smithi089 ceph-mon[36617]: osdmap e16: 3 total, 2 up, 3 in 2024-08-01T06:50:26.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:25 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T06:50:26.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:25 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:26.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:25 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:26.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:25 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/973280750' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-01T06:50:27.236 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:26 smithi016 ceph-mon[29266]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:27.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:26 smithi089 ceph-mon[36617]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:29.468 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:29 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:29.468 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:29 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:29.468 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:29 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:29.468 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:29 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:50:29.468 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:29 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:29.468 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:29 smithi016 ceph-mon[29266]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:29.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:29 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:29.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:29 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:29.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:29 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:29.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:29 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:50:29.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:29 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:29.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:29 smithi089 ceph-mon[36617]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:30.736 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:30 smithi016 ceph-mon[29266]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:30.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:30 smithi089 ceph-mon[36617]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:32.326 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:31 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-01T06:50:32.326 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:31 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:31 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-01T06:50:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:31 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:33.332 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:33 smithi016 ceph-mon[29266]: Deploying daemon osd.2 on smithi016 2024-08-01T06:50:33.332 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:33 smithi016 ceph-mon[29266]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:33.332 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:33 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:50:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:33 smithi089 ceph-mon[36617]: Deploying daemon osd.2 on smithi016 2024-08-01T06:50:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:33 smithi089 ceph-mon[36617]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:33 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:50:34.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:34 smithi089 ceph-mon[36617]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:34.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:34 smithi016 ceph-mon[29266]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:36.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:36 smithi089 ceph-mon[36617]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:36.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:36 smithi016 ceph-mon[29266]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:37.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:37 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:50:37.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:37 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:37.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:37 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:37.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:37 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:50:37.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:37 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:37.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:37 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:38.664 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:38 smithi016 ceph-mon[29266]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:38.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:38 smithi089 ceph-mon[36617]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:40.024 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 2 on host 'smithi016' 2024-08-01T06:50:40.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:40.022+0000 7f48937fe640 1 -- 172.21.15.16:0/1236602568 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f489c02c5d0 con 0x7f488806cb70 2024-08-01T06:50:40.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:40.026+0000 7f48a08a5640 1 -- 172.21.15.16:0/1236602568 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f488806cb70 msgr2=0x7f488806f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:50:40.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:40.026+0000 7f48a08a5640 1 --2- 172.21.15.16:0/1236602568 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f488806cb70 0x7f488806f030 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4884000c00 tx=0x7f48840314e0 comp rx=0 tx=0).stop 2024-08-01T06:50:40.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:40.026+0000 7f48a08a5640 1 -- 172.21.15.16:0/1236602568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0feaf0 msgr2=0x7f489c194570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:50:40.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:40.026+0000 7f48a08a5640 1 --2- 172.21.15.16:0/1236602568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0feaf0 0x7f489c194570 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f488c00d720 tx=0x7f488c00dbe0 comp rx=0 tx=0).stop 2024-08-01T06:50:40.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:40.026+0000 7f48a08a5640 1 -- 172.21.15.16:0/1236602568 shutdown_connections 2024-08-01T06:50:40.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:40.026+0000 7f48a08a5640 1 --2- 172.21.15.16:0/1236602568 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f488806cb70 0x7f488806f030 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:50:40.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:40.026+0000 7f48a08a5640 1 --2- 172.21.15.16:0/1236602568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f489c0ffcf0 0x7f489c194ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:50:40.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:40.026+0000 7f48a08a5640 1 --2- 172.21.15.16:0/1236602568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0feaf0 0x7f489c194570 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:50:40.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:40.026+0000 7f48a08a5640 1 -- 172.21.15.16:0/1236602568 >> 172.21.15.16:0/1236602568 conn(0x7f489c0fa280 msgr2=0x7f489c1033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:50:40.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:40.026+0000 7f48a08a5640 1 -- 172.21.15.16:0/1236602568 shutdown_connections 2024-08-01T06:50:40.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:50:40.026+0000 7f48a08a5640 1 -- 172.21.15.16:0/1236602568 wait complete. 2024-08-01T06:50:41.057 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:41 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:41.057 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:41 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:41.057 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:41 smithi016 ceph-mon[29266]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:41.057 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:41 smithi016 ceph-mon[29266]: from='osd.2 [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-01T06:50:41.348 DEBUG:teuthology.orchestra.run.smithi016:osd.2> sudo journalctl -f -n 0 -u ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.2.service 2024-08-01T06:50:41.351 INFO:tasks.cephadm:Deploying osd.3 on smithi089 with /dev/vg_nvme/lv_4... 2024-08-01T06:50:41.351 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-01T06:50:41.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:41 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:41.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:41 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:41.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:41 smithi089 ceph-mon[36617]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:41.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:41 smithi089 ceph-mon[36617]: from='osd.2 [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-01T06:50:41.565 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi089/config 2024-08-01T06:50:42.325 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:42 smithi016 ceph-mon[29266]: from='osd.2 [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-01T06:50:42.326 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:42 smithi016 ceph-mon[29266]: osdmap e17: 3 total, 2 up, 3 in 2024-08-01T06:50:42.326 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:42 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T06:50:42.326 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:42 smithi016 ceph-mon[29266]: from='osd.2 [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-08-01T06:50:42.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:42 smithi089 ceph-mon[36617]: from='osd.2 [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-01T06:50:42.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:42 smithi089 ceph-mon[36617]: osdmap e17: 3 total, 2 up, 3 in 2024-08-01T06:50:42.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:42 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T06:50:42.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:42 smithi089 ceph-mon[36617]: from='osd.2 [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-08-01T06:50:43.091 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:43 smithi016 ceph-mon[29266]: from='osd.2 [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-08-01T06:50:43.091 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:43 smithi016 ceph-mon[29266]: osdmap e18: 3 total, 2 up, 3 in 2024-08-01T06:50:43.092 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:43 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T06:50:43.092 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:43 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T06:50:43.092 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:43 smithi016 ceph-mon[29266]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:43.092 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:43 smithi016 ceph-mon[29266]: from='osd.2 [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812]' entity='osd.2' 2024-08-01T06:50:43.092 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 06:50:42 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2[63113]: 2024-08-01T06:50:42.809+0000 7f417c73e640 -1 osd.2 0 waiting for initial osdmap 2024-08-01T06:50:43.092 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 06:50:42 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2[63113]: 2024-08-01T06:50:42.815+0000 7f4174d71640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-01T06:50:43.313 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:43 smithi089 ceph-mon[36617]: from='osd.2 [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-08-01T06:50:43.313 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:43 smithi089 ceph-mon[36617]: osdmap e18: 3 total, 2 up, 3 in 2024-08-01T06:50:43.313 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:43 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T06:50:43.313 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:43 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T06:50:43.313 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:43 smithi089 ceph-mon[36617]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-01T06:50:43.313 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:43 smithi089 ceph-mon[36617]: from='osd.2 [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812]' entity='osd.2' 2024-08-01T06:50:44.121 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:44 smithi089 ceph-mon[36617]: purged_snaps scrub starts 2024-08-01T06:50:44.122 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:44 smithi089 ceph-mon[36617]: purged_snaps scrub ok 2024-08-01T06:50:44.122 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:44 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T06:50:44.122 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:44 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:44.122 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:44 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:44.122 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:44 smithi089 ceph-mon[36617]: osd.2 [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812] boot 2024-08-01T06:50:44.122 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:44 smithi089 ceph-mon[36617]: osdmap e19: 3 total, 3 up, 3 in 2024-08-01T06:50:44.122 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:44 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T06:50:44.125 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:50:44.143 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph orch daemon add osd smithi089:vg_nvme/lv_4 2024-08-01T06:50:44.303 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:44 smithi016 ceph-mon[29266]: purged_snaps scrub starts 2024-08-01T06:50:44.303 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:44 smithi016 ceph-mon[29266]: purged_snaps scrub ok 2024-08-01T06:50:44.304 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:44 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T06:50:44.304 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:44 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:44.304 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:44 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:44.304 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:44 smithi016 ceph-mon[29266]: osd.2 [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812] boot 2024-08-01T06:50:44.304 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:44 smithi016 ceph-mon[29266]: osdmap e19: 3 total, 3 up, 3 in 2024-08-01T06:50:44.304 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:44 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T06:50:44.383 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi089/config 2024-08-01T06:50:45.259 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:45 smithi016 ceph-mon[29266]: pgmap v73: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-08-01T06:50:45.259 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:45 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-01T06:50:45.259 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:45 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-01T06:50:45.259 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:45 smithi016 ceph-mon[29266]: osdmap e20: 3 total, 3 up, 3 in 2024-08-01T06:50:45.259 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:45 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-01T06:50:45.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:45 smithi089 ceph-mon[36617]: pgmap v73: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-08-01T06:50:45.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:45 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-01T06:50:45.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:45 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-01T06:50:45.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:45 smithi089 ceph-mon[36617]: osdmap e20: 3 total, 3 up, 3 in 2024-08-01T06:50:45.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:45 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-01T06:50:45.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.752+0000 7fbedc05a640 1 -- 172.21.15.89:0/2850532584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed40ffbc0 msgr2=0x7fbed40fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:50:45.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.752+0000 7fbedc05a640 1 --2- 172.21.15.89:0/2850532584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed40ffbc0 0x7fbed40fffc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009880 tx=0x7fbed002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:50:45.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.752+0000 7fbedc05a640 1 -- 172.21.15.89:0/2850532584 shutdown_connections 2024-08-01T06:50:45.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.752+0000 7fbedc05a640 1 --2- 172.21.15.89:0/2850532584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbed4100dc0 0x7fbed4101240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:50:45.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.752+0000 7fbedc05a640 1 --2- 172.21.15.89:0/2850532584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed40ffbc0 0x7fbed40fffc0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:50:45.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.752+0000 7fbedc05a640 1 -- 172.21.15.89:0/2850532584 >> 172.21.15.89:0/2850532584 conn(0x7fbed40fb350 msgr2=0x7fbed40fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:50:45.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.752+0000 7fbedc05a640 1 -- 172.21.15.89:0/2850532584 shutdown_connections 2024-08-01T06:50:45.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.752+0000 7fbedc05a640 1 -- 172.21.15.89:0/2850532584 wait complete. 2024-08-01T06:50:45.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.753+0000 7fbedc05a640 1 Processor -- start 2024-08-01T06:50:45.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.753+0000 7fbedc05a640 1 -- start start 2024-08-01T06:50:45.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.753+0000 7fbedc05a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbed40ffbc0 0x7fbed41956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:50:45.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.753+0000 7fbedc05a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed4100dc0 0x7fbed4195c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:50:45.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.753+0000 7fbedc05a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed41961d0 con 0x7fbed40ffbc0 2024-08-01T06:50:45.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.753+0000 7fbedc05a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed4196340 con 0x7fbed4100dc0 2024-08-01T06:50:45.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.753+0000 7fbed95f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed4100dc0 0x7fbed4195c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:50:45.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.753+0000 7fbed9df6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbed40ffbc0 0x7fbed41956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:50:45.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.753+0000 7fbed95f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed4100dc0 0x7fbed4195c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35894/0 (socket says 172.21.15.89:35894) 2024-08-01T06:50:45.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.753+0000 7fbed95f5640 1 -- 172.21.15.89:0/631241340 learned_addr learned my addr 172.21.15.89:0/631241340 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:50:45.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.754+0000 7fbed95f5640 1 -- 172.21.15.89:0/631241340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbed40ffbc0 msgr2=0x7fbed41956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:50:45.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.754+0000 7fbed95f5640 1 --2- 172.21.15.89:0/631241340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbed40ffbc0 0x7fbed41956c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:50:45.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.754+0000 7fbed95f5640 1 -- 172.21.15.89:0/631241340 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed0009560 con 0x7fbed4100dc0 2024-08-01T06:50:45.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.754+0000 7fbed95f5640 1 --2- 172.21.15.89:0/631241340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed4100dc0 0x7fbed4195c00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fbec800e970 tx=0x7fbec800ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:50:45.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.754+0000 7fbec6ffd640 1 -- 172.21.15.89:0/631241340 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbec800cc90 con 0x7fbed4100dc0 2024-08-01T06:50:45.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.754+0000 7fbec6ffd640 1 -- 172.21.15.89:0/631241340 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbec800cdf0 con 0x7fbed4100dc0 2024-08-01T06:50:45.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.754+0000 7fbedc05a640 1 -- 172.21.15.89:0/631241340 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed419ad70 con 0x7fbed4100dc0 2024-08-01T06:50:45.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.754+0000 7fbec6ffd640 1 -- 172.21.15.89:0/631241340 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbec8010430 con 0x7fbed4100dc0 2024-08-01T06:50:45.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.754+0000 7fbedc05a640 1 -- 172.21.15.89:0/631241340 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed419b340 con 0x7fbed4100dc0 2024-08-01T06:50:45.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.756+0000 7fbedc05a640 1 -- 172.21.15.89:0/631241340 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed41087d0 con 0x7fbed4100dc0 2024-08-01T06:50:45.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.756+0000 7fbec6ffd640 1 -- 172.21.15.89:0/631241340 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7fbec80106a0 con 0x7fbed4100dc0 2024-08-01T06:50:45.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.756+0000 7fbec6ffd640 1 --2- 172.21.15.89:0/631241340 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fbec006cbd0 0x7fbec006f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:50:45.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.757+0000 7fbec6ffd640 1 -- 172.21.15.89:0/631241340 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3221+0+0 (secure 0 0 0) 0x7fbec8014070 con 0x7fbed4100dc0 2024-08-01T06:50:45.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.757+0000 7fbed9df6640 1 --2- 172.21.15.89:0/631241340 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fbec006cbd0 0x7fbec006f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:50:45.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.757+0000 7fbed9df6640 1 --2- 172.21.15.89:0/631241340 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fbec006cbd0 0x7fbec006f090 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009230 tx=0x7fbed00314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:50:45.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.761+0000 7fbec6ffd640 1 -- 172.21.15.89:0/631241340 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fbec8056a90 con 0x7fbed4100dc0 2024-08-01T06:50:45.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:45.930+0000 7fbedc05a640 1 -- 172.21.15.89:0/631241340 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fbed419b5e0 con 0x7fbec006cbd0 2024-08-01T06:50:46.290 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:46 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-01T06:50:46.291 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:46 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-01T06:50:46.291 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:46 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:46.291 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:46 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-01T06:50:46.291 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:46 smithi089 ceph-mon[36617]: osdmap e21: 3 total, 3 up, 3 in 2024-08-01T06:50:46.356 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:46 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-01T06:50:46.356 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:46 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-01T06:50:46.356 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:46 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:46.356 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:46 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-01T06:50:46.356 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:46 smithi016 ceph-mon[29266]: osdmap e21: 3 total, 3 up, 3 in 2024-08-01T06:50:47.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:50:47.049+0000 7fbec6ffd640 1 -- 172.21.15.89:0/631241340 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbec8056e60 con 0x7fbed4100dc0 2024-08-01T06:50:47.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:47 smithi089 ceph-mon[36617]: from='client.24141 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:50:47.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:47 smithi089 ceph-mon[36617]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-08-01T06:50:47.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:47 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:47.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:47 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:47.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:47 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:50:47.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:47 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:50:47.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:47 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:50:47.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:47 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:47.290 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:47 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:47.290 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:47 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:50:47.290 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:47 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:47.290 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:47 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:50:47.386 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:50:46 smithi016 sudo[67772]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-01T06:50:47.387 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:50:46 smithi016 sudo[67772]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-01T06:50:47.387 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:50:46 smithi016 sudo[67772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-01T06:50:47.387 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:50:46 smithi016 sudo[67772]: pam_unix(sudo:session): session closed for user root 2024-08-01T06:50:47.387 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:47 smithi016 ceph-mon[29266]: from='client.24141 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:50:47.387 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:47 smithi016 ceph-mon[29266]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-08-01T06:50:47.387 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:47 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:47.387 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:47 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:47.387 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:47 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:50:47.387 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:47 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:50:47.388 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:47 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:50:47.388 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:47 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:47.388 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:47 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:47.388 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:47 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:50:47.388 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:47 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:47.388 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:47 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:50:47.648 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:50:47 smithi016 sudo[67862]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-01T06:50:47.648 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:50:47 smithi016 sudo[67862]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-01T06:50:47.649 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:50:47 smithi016 sudo[67862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-01T06:50:47.649 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:50:47 smithi016 sudo[67862]: pam_unix(sudo:session): session closed for user root 2024-08-01T06:50:48.148 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 06:50:47 smithi016 sudo[67901]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-01T06:50:48.149 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 06:50:47 smithi016 sudo[67901]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-01T06:50:48.149 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 06:50:47 smithi016 sudo[67901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-01T06:50:48.149 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 06:50:47 smithi016 sudo[67901]: pam_unix(sudo:session): session closed for user root 2024-08-01T06:50:48.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:48 smithi016 ceph-mon[29266]: Detected new or changed devices on smithi016 2024-08-01T06:50:48.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:48 smithi016 ceph-mon[29266]: Adjusting osd_memory_target on smithi016 to 3948M 2024-08-01T06:50:48.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:48 smithi016 ceph-mon[29266]: mgrmap e19: smithi016.whigbo(active, since 2m), standbys: smithi089.hfgnsr 2024-08-01T06:50:48.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:48 smithi016 ceph-mon[29266]: osdmap e22: 3 total, 3 up, 3 in 2024-08-01T06:50:48.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:48 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:48.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:48 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:50:48.326 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:48 smithi089 ceph-mon[36617]: Detected new or changed devices on smithi016 2024-08-01T06:50:48.326 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:48 smithi089 ceph-mon[36617]: Adjusting osd_memory_target on smithi016 to 3948M 2024-08-01T06:50:48.326 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:48 smithi089 ceph-mon[36617]: mgrmap e19: smithi016.whigbo(active, since 2m), standbys: smithi089.hfgnsr 2024-08-01T06:50:48.326 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:48 smithi089 ceph-mon[36617]: osdmap e22: 3 total, 3 up, 3 in 2024-08-01T06:50:48.327 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:48 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:48.327 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:48 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:50:48.648 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 06:50:48 smithi016 sudo[67999]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-01T06:50:48.649 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 06:50:48 smithi016 sudo[67999]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-01T06:50:48.649 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 06:50:48 smithi016 sudo[67999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-01T06:50:48.649 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 06:50:48 smithi016 sudo[67999]: pam_unix(sudo:session): session closed for user root 2024-08-01T06:50:49.139 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 06:50:48 smithi016 sudo[68050]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-01T06:50:49.140 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 06:50:48 smithi016 sudo[68050]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-01T06:50:49.140 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 06:50:48 smithi016 sudo[68050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-01T06:50:49.140 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 06:50:48 smithi016 sudo[68050]: pam_unix(sudo:session): session closed for user root 2024-08-01T06:50:49.140 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:49 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/4262501210' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3c0e7296-4283-441a-b445-9a57aa8617de"}]: dispatch 2024-08-01T06:50:49.140 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:49 smithi016 ceph-mon[29266]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3c0e7296-4283-441a-b445-9a57aa8617de"}]: dispatch 2024-08-01T06:50:49.140 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:49 smithi016 ceph-mon[29266]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3c0e7296-4283-441a-b445-9a57aa8617de"}]': finished 2024-08-01T06:50:49.140 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:49 smithi016 ceph-mon[29266]: osdmap e23: 4 total, 3 up, 4 in 2024-08-01T06:50:49.140 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:49 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-01T06:50:49.140 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:49 smithi016 ceph-mon[29266]: pgmap v79: 1 pgs: 1 active+clean; 449 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-08-01T06:50:49.140 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:49 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/1538957807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-01T06:50:49.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:49 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/4262501210' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3c0e7296-4283-441a-b445-9a57aa8617de"}]: dispatch 2024-08-01T06:50:49.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:49 smithi089 ceph-mon[36617]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3c0e7296-4283-441a-b445-9a57aa8617de"}]: dispatch 2024-08-01T06:50:49.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:49 smithi089 ceph-mon[36617]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3c0e7296-4283-441a-b445-9a57aa8617de"}]': finished 2024-08-01T06:50:49.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:49 smithi089 ceph-mon[36617]: osdmap e23: 4 total, 3 up, 4 in 2024-08-01T06:50:49.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:49 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-01T06:50:49.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:49 smithi089 ceph-mon[36617]: pgmap v79: 1 pgs: 1 active+clean; 449 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-08-01T06:50:49.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:49 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/1538957807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-01T06:50:49.398 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 06:50:49 smithi016 sudo[68081]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-01T06:50:49.398 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 06:50:49 smithi016 sudo[68081]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-01T06:50:49.398 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 06:50:49 smithi016 sudo[68081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-01T06:50:49.398 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 06:50:49 smithi016 sudo[68081]: pam_unix(sudo:session): session closed for user root 2024-08-01T06:50:49.895 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:49 smithi016 sudo[68127]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-01T06:50:49.895 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:49 smithi016 sudo[68127]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-01T06:50:49.895 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:49 smithi016 sudo[68127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-01T06:50:49.895 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:49 smithi016 sudo[68127]: pam_unix(sudo:session): session closed for user root 2024-08-01T06:50:50.486 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:50 smithi016 sudo[68173]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-01T06:50:50.487 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:50 smithi016 sudo[68173]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-01T06:50:50.487 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:50 smithi016 sudo[68173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-01T06:50:50.487 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:50 smithi016 sudo[68173]: pam_unix(sudo:session): session closed for user root 2024-08-01T06:50:50.701 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:50 smithi089 sudo[41015]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-01T06:50:50.701 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:50 smithi089 sudo[41015]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-01T06:50:50.701 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:50 smithi089 sudo[41015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-01T06:50:50.701 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:50 smithi089 sudo[41015]: pam_unix(sudo:session): session closed for user root 2024-08-01T06:50:50.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:50 smithi016 ceph-mon[29266]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-01T06:50:50.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:50 smithi016 ceph-mon[29266]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-01T06:50:50.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:50 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:50:50.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:50 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:50:50.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:50 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:50:50.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:50 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:50:51.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:50 smithi089 sudo[41202]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-01T06:50:51.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:50 smithi089 sudo[41202]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-01T06:50:51.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:50 smithi089 sudo[41202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-01T06:50:51.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:50 smithi089 sudo[41202]: pam_unix(sudo:session): session closed for user root 2024-08-01T06:50:51.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:50 smithi089 ceph-mon[36617]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-01T06:50:51.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:50 smithi089 ceph-mon[36617]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-01T06:50:51.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:50 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:50:51.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:50 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:50:51.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:50 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:50:51.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:50 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:50:52.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:51 smithi089 ceph-mon[36617]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-01T06:50:52.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:51 smithi089 ceph-mon[36617]: pgmap v80: 1 pgs: 1 active+clean; 449 KiB data, 106 MiB used, 268 GiB / 268 GiB avail 2024-08-01T06:50:52.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:51 smithi089 ceph-mon[36617]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-01T06:50:52.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:51 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:52.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:51 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:52.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:51 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:52.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:51 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:52.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:51 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:50:52.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:51 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:52.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:51 smithi016 ceph-mon[29266]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-01T06:50:52.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:51 smithi016 ceph-mon[29266]: pgmap v80: 1 pgs: 1 active+clean; 449 KiB data, 106 MiB used, 268 GiB / 268 GiB avail 2024-08-01T06:50:52.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:51 smithi016 ceph-mon[29266]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-01T06:50:52.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:51 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:52.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:51 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:52.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:51 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:52.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:51 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:52.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:51 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:50:52.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:51 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:53.008 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:52 smithi089 ceph-mon[36617]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 293 KiB/s wr, 20 op/s 2024-08-01T06:50:53.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:52 smithi016 ceph-mon[29266]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 293 KiB/s wr, 20 op/s 2024-08-01T06:50:54.876 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:54 smithi089 ceph-mon[36617]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 202 KiB/s wr, 13 op/s 2024-08-01T06:50:54.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:54 smithi016 ceph-mon[29266]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 202 KiB/s wr, 13 op/s 2024-08-01T06:50:55.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:55 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-01T06:50:55.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:55 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:55.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:55 smithi089 ceph-mon[36617]: Deploying daemon osd.3 on smithi089 2024-08-01T06:50:55.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:55 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-01T06:50:55.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:55 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:50:55.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:55 smithi016 ceph-mon[29266]: Deploying daemon osd.3 on smithi089 2024-08-01T06:50:56.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:56 smithi089 ceph-mon[36617]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 154 KiB/s wr, 10 op/s 2024-08-01T06:50:56.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:56 smithi016 ceph-mon[29266]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 154 KiB/s wr, 10 op/s 2024-08-01T06:50:58.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:58 smithi089 ceph-mon[36617]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 125 KiB/s wr, 8 op/s 2024-08-01T06:50:58.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:58 smithi016 ceph-mon[29266]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 125 KiB/s wr, 8 op/s 2024-08-01T06:50:59.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:59 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:50:59.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:59 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:50:59.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:50:59 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:00.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:59 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:51:00.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:59 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:00.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:50:59 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:01.033 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:00 smithi089 ceph-mon[36617]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-08-01T06:51:01.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:00 smithi016 ceph-mon[29266]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-08-01T06:51:02.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:02 smithi089 ceph-mon[36617]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-08-01T06:51:02.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:02 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:51:02.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:02 smithi016 ceph-mon[29266]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-08-01T06:51:02.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:02 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:51:03.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:03.452+0000 7fbec6ffd640 1 -- 172.21.15.89:0/631241340 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fbed419b5e0 con 0x7fbec006cbd0 2024-08-01T06:51:03.454 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 3 on host 'smithi089' 2024-08-01T06:51:03.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:03.454+0000 7fbedc05a640 1 -- 172.21.15.89:0/631241340 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fbec006cbd0 msgr2=0x7fbec006f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:51:03.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:03.454+0000 7fbedc05a640 1 --2- 172.21.15.89:0/631241340 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fbec006cbd0 0x7fbec006f090 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009230 tx=0x7fbed00314e0 comp rx=0 tx=0).stop 2024-08-01T06:51:03.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:03.454+0000 7fbedc05a640 1 -- 172.21.15.89:0/631241340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed4100dc0 msgr2=0x7fbed4195c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:51:03.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:03.454+0000 7fbedc05a640 1 --2- 172.21.15.89:0/631241340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed4100dc0 0x7fbed4195c00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fbec800e970 tx=0x7fbec800ed70 comp rx=0 tx=0).stop 2024-08-01T06:51:03.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:03.455+0000 7fbedc05a640 1 -- 172.21.15.89:0/631241340 shutdown_connections 2024-08-01T06:51:03.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:03.455+0000 7fbedc05a640 1 --2- 172.21.15.89:0/631241340 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fbec006cbd0 0x7fbec006f090 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:03.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:03.455+0000 7fbedc05a640 1 --2- 172.21.15.89:0/631241340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbed4100dc0 0x7fbed4195c00 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:03.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:03.455+0000 7fbedc05a640 1 --2- 172.21.15.89:0/631241340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbed40ffbc0 0x7fbed41956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:03.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:03.455+0000 7fbedc05a640 1 -- 172.21.15.89:0/631241340 >> 172.21.15.89:0/631241340 conn(0x7fbed40fb350 msgr2=0x7fbed4103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:51:03.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:03.455+0000 7fbedc05a640 1 -- 172.21.15.89:0/631241340 shutdown_connections 2024-08-01T06:51:03.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:03.455+0000 7fbedc05a640 1 -- 172.21.15.89:0/631241340 wait complete. 2024-08-01T06:51:04.006 DEBUG:teuthology.orchestra.run.smithi089:osd.3> sudo journalctl -f -n 0 -u ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.3.service 2024-08-01T06:51:04.009 INFO:tasks.cephadm:Deploying osd.4 on smithi089 with /dev/vg_nvme/lv_3... 2024-08-01T06:51:04.009 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-01T06:51:04.260 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi089/config 2024-08-01T06:51:04.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:04 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:04.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:04 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:04.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:04 smithi089 ceph-mon[36617]: from='osd.3 [v2:172.21.15.89:6800/2212217098,v1:172.21.15.89:6801/2212217098]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-01T06:51:04.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:04 smithi089 ceph-mon[36617]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-01T06:51:04.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:04 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:04.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:04 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:04.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:04 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:04.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:04 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:04.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:04 smithi016 ceph-mon[29266]: from='osd.3 [v2:172.21.15.89:6800/2212217098,v1:172.21.15.89:6801/2212217098]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-01T06:51:04.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:04 smithi016 ceph-mon[29266]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-01T06:51:04.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:04 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:04.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:04 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:05.637 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 06:51:05 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3[42442]: 2024-08-01T06:51:05.459+0000 7fe2f7ef2640 -1 osd.3 0 waiting for initial osdmap 2024-08-01T06:51:05.638 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 06:51:05 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3[42442]: 2024-08-01T06:51:05.464+0000 7fe2f452d640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-01T06:51:05.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:05 smithi089 ceph-mon[36617]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-01T06:51:05.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:05 smithi089 ceph-mon[36617]: osdmap e24: 4 total, 3 up, 4 in 2024-08-01T06:51:05.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:05 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-01T06:51:05.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:05 smithi089 ceph-mon[36617]: from='osd.3 [v2:172.21.15.89:6800/2212217098,v1:172.21.15.89:6801/2212217098]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T06:51:05.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:05 smithi089 ceph-mon[36617]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T06:51:05.639 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:05 smithi089 ceph-mon[36617]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail 2024-08-01T06:51:05.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:05 smithi016 ceph-mon[29266]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-01T06:51:05.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:05 smithi016 ceph-mon[29266]: osdmap e24: 4 total, 3 up, 4 in 2024-08-01T06:51:05.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:05 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-01T06:51:05.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:05 smithi016 ceph-mon[29266]: from='osd.3 [v2:172.21.15.89:6800/2212217098,v1:172.21.15.89:6801/2212217098]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T06:51:05.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:05 smithi016 ceph-mon[29266]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T06:51:05.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:05 smithi016 ceph-mon[29266]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail 2024-08-01T06:51:06.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:06 smithi089 ceph-mon[36617]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-08-01T06:51:06.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:06 smithi089 ceph-mon[36617]: osdmap e25: 4 total, 3 up, 4 in 2024-08-01T06:51:06.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:06 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-01T06:51:06.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:06 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-01T06:51:06.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:06 smithi016 ceph-mon[29266]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-08-01T06:51:06.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:06 smithi016 ceph-mon[29266]: osdmap e25: 4 total, 3 up, 4 in 2024-08-01T06:51:06.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:06 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-01T06:51:06.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:06 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-01T06:51:07.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:07 smithi089 ceph-mon[36617]: purged_snaps scrub starts 2024-08-01T06:51:07.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:07 smithi089 ceph-mon[36617]: purged_snaps scrub ok 2024-08-01T06:51:07.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:07 smithi089 ceph-mon[36617]: osd.3 [v2:172.21.15.89:6800/2212217098,v1:172.21.15.89:6801/2212217098] boot 2024-08-01T06:51:07.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:07 smithi089 ceph-mon[36617]: osdmap e26: 4 total, 4 up, 4 in 2024-08-01T06:51:07.563 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:07 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-01T06:51:07.563 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:07 smithi089 ceph-mon[36617]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail 2024-08-01T06:51:07.565 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:51:07.585 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph orch daemon add osd smithi089:vg_nvme/lv_3 2024-08-01T06:51:07.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:07 smithi016 ceph-mon[29266]: purged_snaps scrub starts 2024-08-01T06:51:07.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:07 smithi016 ceph-mon[29266]: purged_snaps scrub ok 2024-08-01T06:51:07.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:07 smithi016 ceph-mon[29266]: osd.3 [v2:172.21.15.89:6800/2212217098,v1:172.21.15.89:6801/2212217098] boot 2024-08-01T06:51:07.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:07 smithi016 ceph-mon[29266]: osdmap e26: 4 total, 4 up, 4 in 2024-08-01T06:51:07.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:07 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-01T06:51:07.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:07 smithi016 ceph-mon[29266]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail 2024-08-01T06:51:08.145 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi089/config 2024-08-01T06:51:08.800 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:08 smithi016 ceph-mon[29266]: osdmap e27: 4 total, 4 up, 4 in 2024-08-01T06:51:08.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:08 smithi089 ceph-mon[36617]: osdmap e27: 4 total, 4 up, 4 in 2024-08-01T06:51:09.510 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:09 smithi089 ceph-mon[36617]: osdmap e28: 4 total, 4 up, 4 in 2024-08-01T06:51:09.511 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:09 smithi089 ceph-mon[36617]: pgmap v94: 1 pgs: 1 remapped+peering; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-01T06:51:09.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.713+0000 7f0243585640 1 -- 172.21.15.89:0/4152696198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c0feaf0 msgr2=0x7f023c0feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:51:09.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.713+0000 7f0243585640 1 --2- 172.21.15.89:0/4152696198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c0feaf0 0x7f023c0feef0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f022c009880 tx=0x7f022c02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:51:09.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.713+0000 7f0243585640 1 -- 172.21.15.89:0/4152696198 shutdown_connections 2024-08-01T06:51:09.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.713+0000 7f0243585640 1 --2- 172.21.15.89:0/4152696198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f023c0ffcf0 0x7f023c100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:09.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.713+0000 7f0243585640 1 --2- 172.21.15.89:0/4152696198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c0feaf0 0x7f023c0feef0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:09.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.713+0000 7f0243585640 1 -- 172.21.15.89:0/4152696198 >> 172.21.15.89:0/4152696198 conn(0x7f023c0fa280 msgr2=0x7f023c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:51:09.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.713+0000 7f0243585640 1 -- 172.21.15.89:0/4152696198 shutdown_connections 2024-08-01T06:51:09.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.713+0000 7f0243585640 1 -- 172.21.15.89:0/4152696198 wait complete. 2024-08-01T06:51:09.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.714+0000 7f0243585640 1 Processor -- start 2024-08-01T06:51:09.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.714+0000 7f0243585640 1 -- start start 2024-08-01T06:51:09.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.714+0000 7f0243585640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c0feaf0 0x7f023c195730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:51:09.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.714+0000 7f0243585640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f023c0ffcf0 0x7f023c195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:51:09.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.714+0000 7f0243585640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c196240 con 0x7f023c0ffcf0 2024-08-01T06:51:09.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.714+0000 7f0243585640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c1963b0 con 0x7f023c0feaf0 2024-08-01T06:51:09.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.714+0000 7f0241321640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c0feaf0 0x7f023c195730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:51:09.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.714+0000 7f0241321640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c0feaf0 0x7f023c195730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53378/0 (socket says 172.21.15.89:53378) 2024-08-01T06:51:09.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.714+0000 7f0241321640 1 -- 172.21.15.89:0/3076756147 learned_addr learned my addr 172.21.15.89:0/3076756147 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:51:09.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.714+0000 7f0240b20640 1 --2- 172.21.15.89:0/3076756147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f023c0ffcf0 0x7f023c195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:51:09.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.715+0000 7f0241321640 1 -- 172.21.15.89:0/3076756147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f023c0ffcf0 msgr2=0x7f023c195c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:51:09.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.715+0000 7f0241321640 1 --2- 172.21.15.89:0/3076756147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f023c0ffcf0 0x7f023c195c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:09.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.715+0000 7f0241321640 1 -- 172.21.15.89:0/3076756147 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c009560 con 0x7f023c0feaf0 2024-08-01T06:51:09.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.715+0000 7f0241321640 1 --2- 172.21.15.89:0/3076756147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c0feaf0 0x7f023c195730 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f022c006010 tx=0x7f022c0055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:51:09.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.715+0000 7f02327fc640 1 -- 172.21.15.89:0/3076756147 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f022c004aa0 con 0x7f023c0feaf0 2024-08-01T06:51:09.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.715+0000 7f02327fc640 1 -- 172.21.15.89:0/3076756147 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f022c004c00 con 0x7f023c0feaf0 2024-08-01T06:51:09.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.715+0000 7f02327fc640 1 -- 172.21.15.89:0/3076756147 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f022c0039b0 con 0x7f023c0feaf0 2024-08-01T06:51:09.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.715+0000 7f0243585640 1 -- 172.21.15.89:0/3076756147 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023c19adf0 con 0x7f023c0feaf0 2024-08-01T06:51:09.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.715+0000 7f0243585640 1 -- 172.21.15.89:0/3076756147 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023c19b260 con 0x7f023c0feaf0 2024-08-01T06:51:09.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.716+0000 7f0243585640 1 -- 172.21.15.89:0/3076756147 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023c0feef0 con 0x7f023c0feaf0 2024-08-01T06:51:09.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.716+0000 7f02327fc640 1 -- 172.21.15.89:0/3076756147 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f022c031c00 con 0x7f023c0feaf0 2024-08-01T06:51:09.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.717+0000 7f02327fc640 1 --2- 172.21.15.89:0/3076756147 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f022806cc50 0x7f022806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:51:09.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.717+0000 7f02327fc640 1 -- 172.21.15.89:0/3076756147 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3774+0+0 (secure 0 0 0) 0x7f022c0acc10 con 0x7f023c0feaf0 2024-08-01T06:51:09.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.717+0000 7f0240b20640 1 --2- 172.21.15.89:0/3076756147 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f022806cc50 0x7f022806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:51:09.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.718+0000 7f0240b20640 1 --2- 172.21.15.89:0/3076756147 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f022806cc50 0x7f022806f110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f023c196c50 tx=0x7f023800b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:51:09.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.721+0000 7f02327fc640 1 -- 172.21.15.89:0/3076756147 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f022c077730 con 0x7f023c0feaf0 2024-08-01T06:51:09.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:09.895+0000 7f0243585640 1 -- 172.21.15.89:0/3076756147 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f023c0fc460 con 0x7f022806cc50 2024-08-01T06:51:09.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:09 smithi016 ceph-mon[29266]: osdmap e28: 4 total, 4 up, 4 in 2024-08-01T06:51:09.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:09 smithi016 ceph-mon[29266]: pgmap v94: 1 pgs: 1 remapped+peering; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-01T06:51:10.783 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:10 smithi089 ceph-mon[36617]: osdmap e29: 4 total, 4 up, 4 in 2024-08-01T06:51:10.783 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:10 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-01T06:51:10.784 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:10 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-01T06:51:10.784 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:10 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:10.784 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:10 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:10.784 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:10 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:10.784 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:10 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:51:10.784 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:10 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:10.784 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:10 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:10.784 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:10 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:51:10.784 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:10 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:10.784 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:10 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:51:10.784 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:10 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:10.784 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:10 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:51:10.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:10 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:10 smithi016 ceph-mon[29266]: osdmap e29: 4 total, 4 up, 4 in 2024-08-01T06:51:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:10 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-01T06:51:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:10 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-01T06:51:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:10 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:10 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:10 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:10 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:51:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:10 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:10 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:10.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:10 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:51:10.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:10 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:10.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:10 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:51:10.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:10 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:10.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:10 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:51:10.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:10 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:11.703 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:11 smithi089 ceph-mon[36617]: from='client.24165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:51:11.703 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:11 smithi089 ceph-mon[36617]: Detected new or changed devices on smithi089 2024-08-01T06:51:11.703 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:11 smithi089 ceph-mon[36617]: Adjusting osd_memory_target on smithi089 to 14911M 2024-08-01T06:51:11.703 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:11 smithi089 ceph-mon[36617]: osdmap e30: 4 total, 4 up, 4 in 2024-08-01T06:51:11.703 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:11 smithi089 ceph-mon[36617]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-01T06:51:11.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:11 smithi016 ceph-mon[29266]: from='client.24165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:51:11.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:11 smithi016 ceph-mon[29266]: Detected new or changed devices on smithi089 2024-08-01T06:51:11.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:11 smithi016 ceph-mon[29266]: Adjusting osd_memory_target on smithi089 to 14911M 2024-08-01T06:51:11.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:11 smithi016 ceph-mon[29266]: osdmap e30: 4 total, 4 up, 4 in 2024-08-01T06:51:11.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:11 smithi016 ceph-mon[29266]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-01T06:51:12.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:12 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/3713674923' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8db8b0e3-4ecb-45c1-8e3e-c73c48996459"}]: dispatch 2024-08-01T06:51:12.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:12 smithi089 ceph-mon[36617]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8db8b0e3-4ecb-45c1-8e3e-c73c48996459"}]: dispatch 2024-08-01T06:51:12.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:12 smithi089 ceph-mon[36617]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8db8b0e3-4ecb-45c1-8e3e-c73c48996459"}]': finished 2024-08-01T06:51:12.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:12 smithi089 ceph-mon[36617]: osdmap e31: 5 total, 4 up, 5 in 2024-08-01T06:51:12.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:12 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T06:51:12.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:12 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/3713674923' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8db8b0e3-4ecb-45c1-8e3e-c73c48996459"}]: dispatch 2024-08-01T06:51:12.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:12 smithi016 ceph-mon[29266]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8db8b0e3-4ecb-45c1-8e3e-c73c48996459"}]: dispatch 2024-08-01T06:51:12.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:12 smithi016 ceph-mon[29266]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8db8b0e3-4ecb-45c1-8e3e-c73c48996459"}]': finished 2024-08-01T06:51:12.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:12 smithi016 ceph-mon[29266]: osdmap e31: 5 total, 4 up, 5 in 2024-08-01T06:51:12.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:12 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T06:51:13.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:13 smithi089 ceph-mon[36617]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-08-01T06:51:13.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:13 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/3385032389' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-01T06:51:13.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:13 smithi016 ceph-mon[29266]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-08-01T06:51:13.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:13 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/3385032389' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-01T06:51:14.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:14 smithi016 ceph-mon[29266]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-01T06:51:15.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:14 smithi089 ceph-mon[36617]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-01T06:51:16.823 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:16 smithi089 ceph-mon[36617]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-08-01T06:51:16.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:16 smithi016 ceph-mon[29266]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-08-01T06:51:17.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:17 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:51:17.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:17 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:51:18.798 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:18 smithi089 ceph-mon[36617]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-08-01T06:51:18.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:18 smithi016 ceph-mon[29266]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-08-01T06:51:19.700 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:19 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-01T06:51:19.701 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:19 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:19.701 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:19 smithi089 ceph-mon[36617]: Deploying daemon osd.4 on smithi089 2024-08-01T06:51:19.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:19 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-01T06:51:19.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:19 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:19.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:19 smithi016 ceph-mon[29266]: Deploying daemon osd.4 on smithi089 2024-08-01T06:51:20.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:20 smithi089 ceph-mon[36617]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-01T06:51:20.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:20 smithi016 ceph-mon[29266]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-01T06:51:22.857 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:22 smithi089 ceph-mon[36617]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-01T06:51:22.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:22 smithi016 ceph-mon[29266]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-01T06:51:24.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:24 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:51:24.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:24 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:24.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:24 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:24.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:24 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:51:24.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:24 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:24.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:24 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:25.705 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:25 smithi089 ceph-mon[36617]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-01T06:51:25.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:25 smithi016 ceph-mon[29266]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-01T06:51:26.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:26 smithi089 ceph-mon[36617]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-01T06:51:26.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:26 smithi016 ceph-mon[29266]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-01T06:51:27.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:27.060+0000 7f02327fc640 1 -- 172.21.15.89:0/3076756147 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f023c0fc460 con 0x7f022806cc50 2024-08-01T06:51:27.062 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 4 on host 'smithi089' 2024-08-01T06:51:27.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:27.062+0000 7f0243585640 1 -- 172.21.15.89:0/3076756147 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f022806cc50 msgr2=0x7f022806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:51:27.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:27.062+0000 7f0243585640 1 --2- 172.21.15.89:0/3076756147 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f022806cc50 0x7f022806f110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f023c196c50 tx=0x7f023800b390 comp rx=0 tx=0).stop 2024-08-01T06:51:27.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:27.062+0000 7f0243585640 1 -- 172.21.15.89:0/3076756147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c0feaf0 msgr2=0x7f023c195730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:51:27.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:27.062+0000 7f0243585640 1 --2- 172.21.15.89:0/3076756147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c0feaf0 0x7f023c195730 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f022c006010 tx=0x7f022c0055a0 comp rx=0 tx=0).stop 2024-08-01T06:51:27.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:27.062+0000 7f0243585640 1 -- 172.21.15.89:0/3076756147 shutdown_connections 2024-08-01T06:51:27.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:27.062+0000 7f0243585640 1 --2- 172.21.15.89:0/3076756147 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f022806cc50 0x7f022806f110 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:27.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:27.062+0000 7f0243585640 1 --2- 172.21.15.89:0/3076756147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f023c0ffcf0 0x7f023c195c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:27.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:27.062+0000 7f0243585640 1 --2- 172.21.15.89:0/3076756147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f023c0feaf0 0x7f023c195730 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:27.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:27.062+0000 7f0243585640 1 -- 172.21.15.89:0/3076756147 >> 172.21.15.89:0/3076756147 conn(0x7f023c0fa280 msgr2=0x7f023c0fbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:51:27.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:27.062+0000 7f0243585640 1 -- 172.21.15.89:0/3076756147 shutdown_connections 2024-08-01T06:51:27.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:27.062+0000 7f0243585640 1 -- 172.21.15.89:0/3076756147 wait complete. 2024-08-01T06:51:28.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:28 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:28.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:28 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:28.183 DEBUG:teuthology.orchestra.run.smithi089:osd.4> sudo journalctl -f -n 0 -u ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.4.service 2024-08-01T06:51:28.185 INFO:tasks.cephadm:Deploying osd.5 on smithi089 with /dev/vg_nvme/lv_2... 2024-08-01T06:51:28.186 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-01T06:51:28.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:28 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:28.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:28 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:28.464 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 06:51:28 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[48882]: 2024-08-01T06:51:28.261+0000 7f9b8f2a6640 -1 osd.4 0 log_to_monitors true 2024-08-01T06:51:28.990 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi089/config 2024-08-01T06:51:29.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:29 smithi089 ceph-mon[36617]: from='osd.4 [v2:172.21.15.89:6808/900847704,v1:172.21.15.89:6809/900847704]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-01T06:51:29.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:29 smithi089 ceph-mon[36617]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-01T06:51:29.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:29 smithi089 ceph-mon[36617]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-01T06:51:29.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:29 smithi016 ceph-mon[29266]: from='osd.4 [v2:172.21.15.89:6808/900847704,v1:172.21.15.89:6809/900847704]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-01T06:51:29.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:29 smithi016 ceph-mon[29266]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-01T06:51:29.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:29 smithi016 ceph-mon[29266]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-01T06:51:30.105 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:30 smithi089 ceph-mon[36617]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-01T06:51:30.105 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:30 smithi089 ceph-mon[36617]: osdmap e32: 5 total, 4 up, 5 in 2024-08-01T06:51:30.105 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:30 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T06:51:30.105 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:30 smithi089 ceph-mon[36617]: from='osd.4 [v2:172.21.15.89:6808/900847704,v1:172.21.15.89:6809/900847704]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T06:51:30.105 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:30 smithi089 ceph-mon[36617]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T06:51:30.105 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:30 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:30.105 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:30 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:30.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:30 smithi016 ceph-mon[29266]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-01T06:51:30.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:30 smithi016 ceph-mon[29266]: osdmap e32: 5 total, 4 up, 5 in 2024-08-01T06:51:30.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:30 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T06:51:30.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:30 smithi016 ceph-mon[29266]: from='osd.4 [v2:172.21.15.89:6808/900847704,v1:172.21.15.89:6809/900847704]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T06:51:30.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:30 smithi016 ceph-mon[29266]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T06:51:30.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:30 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:30.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:30 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:30.984 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 06:51:30 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[48882]: 2024-08-01T06:51:30.857+0000 7f9b8aa04640 -1 osd.4 0 waiting for initial osdmap 2024-08-01T06:51:30.984 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 06:51:30 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[48882]: 2024-08-01T06:51:30.864+0000 7f9b83037640 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-01T06:51:31.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:31 smithi089 ceph-mon[36617]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-08-01T06:51:31.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:31 smithi089 ceph-mon[36617]: osdmap e33: 5 total, 4 up, 5 in 2024-08-01T06:51:31.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:31 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T06:51:31.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:31 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T06:51:31.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:31 smithi089 ceph-mon[36617]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-01T06:51:31.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:31 smithi089 ceph-mon[36617]: from='osd.4 ' entity='osd.4' 2024-08-01T06:51:31.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:31 smithi016 ceph-mon[29266]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-08-01T06:51:31.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:31 smithi016 ceph-mon[29266]: osdmap e33: 5 total, 4 up, 5 in 2024-08-01T06:51:31.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:31 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T06:51:31.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:31 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T06:51:31.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:31 smithi016 ceph-mon[29266]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-01T06:51:31.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:31 smithi016 ceph-mon[29266]: from='osd.4 ' entity='osd.4' 2024-08-01T06:51:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:32 smithi089 ceph-mon[36617]: purged_snaps scrub starts 2024-08-01T06:51:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:32 smithi089 ceph-mon[36617]: purged_snaps scrub ok 2024-08-01T06:51:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:32 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T06:51:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:32 smithi089 ceph-mon[36617]: osd.4 [v2:172.21.15.89:6808/900847704,v1:172.21.15.89:6809/900847704] boot 2024-08-01T06:51:32.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:32 smithi089 ceph-mon[36617]: osdmap e34: 5 total, 5 up, 5 in 2024-08-01T06:51:32.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:32 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T06:51:32.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:32 smithi016 ceph-mon[29266]: purged_snaps scrub starts 2024-08-01T06:51:32.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:32 smithi016 ceph-mon[29266]: purged_snaps scrub ok 2024-08-01T06:51:32.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:32 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T06:51:32.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:32 smithi016 ceph-mon[29266]: osd.4 [v2:172.21.15.89:6808/900847704,v1:172.21.15.89:6809/900847704] boot 2024-08-01T06:51:32.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:32 smithi016 ceph-mon[29266]: osdmap e34: 5 total, 5 up, 5 in 2024-08-01T06:51:32.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:32 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T06:51:32.430 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-01T06:51:32.448 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph orch daemon add osd smithi089:vg_nvme/lv_2 2024-08-01T06:51:33.027 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi089/config 2024-08-01T06:51:33.284 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:33 smithi089 ceph-mon[36617]: osdmap e35: 5 total, 5 up, 5 in 2024-08-01T06:51:33.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:33 smithi089 ceph-mon[36617]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:33.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:33 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:51:33.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:33 smithi016 ceph-mon[29266]: osdmap e35: 5 total, 5 up, 5 in 2024-08-01T06:51:33.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:33 smithi016 ceph-mon[29266]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:33.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:33 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:51:35.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.208+0000 7f6f8b39e640 1 -- 172.21.15.89:0/2041084105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f84102f60 msgr2=0x7f6f84105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:51:35.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.208+0000 7f6f8b39e640 1 --2- 172.21.15.89:0/2041084105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f84102f60 0x7f6f84105350 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6f74009880 tx=0x7f6f7402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:51:35.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.208+0000 7f6f8b39e640 1 -- 172.21.15.89:0/2041084105 shutdown_connections 2024-08-01T06:51:35.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.208+0000 7f6f8b39e640 1 --2- 172.21.15.89:0/2041084105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f84102f60 0x7f6f84105350 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:35.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.209+0000 7f6f8b39e640 1 --2- 172.21.15.89:0/2041084105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f84100630 0x7f6f84102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:35.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.209+0000 7f6f8b39e640 1 -- 172.21.15.89:0/2041084105 >> 172.21.15.89:0/2041084105 conn(0x7f6f840fa250 msgr2=0x7f6f840fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:51:35.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.209+0000 7f6f8b39e640 1 -- 172.21.15.89:0/2041084105 shutdown_connections 2024-08-01T06:51:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.209+0000 7f6f8b39e640 1 -- 172.21.15.89:0/2041084105 wait complete. 2024-08-01T06:51:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.209+0000 7f6f8b39e640 1 Processor -- start 2024-08-01T06:51:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.209+0000 7f6f8b39e640 1 -- start start 2024-08-01T06:51:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.209+0000 7f6f8b39e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f84100630 0x7f6f84195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:51:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.209+0000 7f6f8b39e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f84102f60 0x7f6f84195bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:51:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.209+0000 7f6f8b39e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f84196190 con 0x7f6f84102f60 2024-08-01T06:51:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.209+0000 7f6f8b39e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f84196300 con 0x7f6f84100630 2024-08-01T06:51:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.209+0000 7f6f8913a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f84100630 0x7f6f84195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:51:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.209+0000 7f6f8913a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f84100630 0x7f6f84195680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36366/0 (socket says 172.21.15.89:36366) 2024-08-01T06:51:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.209+0000 7f6f8913a640 1 -- 172.21.15.89:0/2688765709 learned_addr learned my addr 172.21.15.89:0/2688765709 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:51:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.210+0000 7f6f88939640 1 --2- 172.21.15.89:0/2688765709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f84102f60 0x7f6f84195bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:51:35.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.210+0000 7f6f8913a640 1 -- 172.21.15.89:0/2688765709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f84102f60 msgr2=0x7f6f84195bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:51:35.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.210+0000 7f6f8913a640 1 --2- 172.21.15.89:0/2688765709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f84102f60 0x7f6f84195bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:35.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.210+0000 7f6f8913a640 1 -- 172.21.15.89:0/2688765709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f74009560 con 0x7f6f84100630 2024-08-01T06:51:35.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.210+0000 7f6f8913a640 1 --2- 172.21.15.89:0/2688765709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f84100630 0x7f6f84195680 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000d8d0 tx=0x7f6f8000dd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:51:35.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.210+0000 7f6f7a7fc640 1 -- 172.21.15.89:0/2688765709 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f8000bea0 con 0x7f6f84100630 2024-08-01T06:51:35.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.210+0000 7f6f8b39e640 1 -- 172.21.15.89:0/2688765709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8419ad50 con 0x7f6f84100630 2024-08-01T06:51:35.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.210+0000 7f6f7a7fc640 1 -- 172.21.15.89:0/2688765709 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f80009c00 con 0x7f6f84100630 2024-08-01T06:51:35.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.210+0000 7f6f7a7fc640 1 -- 172.21.15.89:0/2688765709 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f8000f7b0 con 0x7f6f84100630 2024-08-01T06:51:35.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.210+0000 7f6f8b39e640 1 -- 172.21.15.89:0/2688765709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8419b290 con 0x7f6f84100630 2024-08-01T06:51:35.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.211+0000 7f6f8b39e640 1 -- 172.21.15.89:0/2688765709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f84108790 con 0x7f6f84100630 2024-08-01T06:51:35.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.211+0000 7f6f7a7fc640 1 -- 172.21.15.89:0/2688765709 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6f8000f9b0 con 0x7f6f84100630 2024-08-01T06:51:35.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.212+0000 7f6f7a7fc640 1 --2- 172.21.15.89:0/2688765709 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f6f7006cc50 0x7f6f7006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:51:35.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.212+0000 7f6f7a7fc640 1 -- 172.21.15.89:0/2688765709 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4206+0+0 (secure 0 0 0) 0x7f6f8008ba10 con 0x7f6f84100630 2024-08-01T06:51:35.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.212+0000 7f6f88939640 1 --2- 172.21.15.89:0/2688765709 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f6f7006cc50 0x7f6f7006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:51:35.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.213+0000 7f6f88939640 1 --2- 172.21.15.89:0/2688765709 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f6f7006cc50 0x7f6f7006f110 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f74000c00 tx=0x7f6f740314a0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:51:35.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.216+0000 7f6f7a7fc640 1 -- 172.21.15.89:0/2688765709 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f6f80056380 con 0x7f6f84100630 2024-08-01T06:51:35.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:35.387+0000 7f6f8b39e640 1 -- 172.21.15.89:0/2688765709 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f8419b4b0 con 0x7f6f7006cc50 2024-08-01T06:51:35.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:35 smithi089 ceph-mon[36617]: Detected new or changed devices on smithi089 2024-08-01T06:51:35.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:35 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:35.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:35 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:35.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:35 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:51:35.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:35 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:51:35.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:35 smithi089 ceph-mon[36617]: Adjusting osd_memory_target on smithi089 to 7455M 2024-08-01T06:51:35.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:35 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:35.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:35 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:35.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:35 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:51:35.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:35 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:35.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:35 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:51:35.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:35 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:35.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:35 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:51:35.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:35 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:35.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:35 smithi089 ceph-mon[36617]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:35.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:35 smithi016 ceph-mon[29266]: Detected new or changed devices on smithi089 2024-08-01T06:51:35.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:35 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:35.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:35 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:35.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:35 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:51:35.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:35 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:51:35.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:35 smithi016 ceph-mon[29266]: Adjusting osd_memory_target on smithi089 to 7455M 2024-08-01T06:51:35.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:35 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:35.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:35 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:35.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:35 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:51:35.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:35 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:35.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:35 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:51:35.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:35 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:35.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:35 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:51:35.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:35 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:35.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:35 smithi016 ceph-mon[29266]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:36.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:36 smithi089 ceph-mon[36617]: from='client.24183 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:51:36.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:36 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-01T06:51:36.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:36 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-01T06:51:36.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:36 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:36.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:36 smithi016 ceph-mon[29266]: from='client.24183 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:51:36.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:36 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-01T06:51:36.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:36 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-01T06:51:36.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:36 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:37.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:37 smithi089 ceph-mon[36617]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:37.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:37 smithi016 ceph-mon[29266]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:38.309 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:38 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/807224915' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18045ff7-9343-4eec-97c0-e2ed091a868d"}]: dispatch 2024-08-01T06:51:38.309 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:38 smithi089 ceph-mon[36617]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18045ff7-9343-4eec-97c0-e2ed091a868d"}]: dispatch 2024-08-01T06:51:38.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:38 smithi089 ceph-mon[36617]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "18045ff7-9343-4eec-97c0-e2ed091a868d"}]': finished 2024-08-01T06:51:38.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:38 smithi089 ceph-mon[36617]: osdmap e36: 6 total, 5 up, 6 in 2024-08-01T06:51:38.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:38 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T06:51:38.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:38 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/807224915' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18045ff7-9343-4eec-97c0-e2ed091a868d"}]: dispatch 2024-08-01T06:51:38.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:38 smithi016 ceph-mon[29266]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18045ff7-9343-4eec-97c0-e2ed091a868d"}]: dispatch 2024-08-01T06:51:38.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:38 smithi016 ceph-mon[29266]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "18045ff7-9343-4eec-97c0-e2ed091a868d"}]': finished 2024-08-01T06:51:38.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:38 smithi016 ceph-mon[29266]: osdmap e36: 6 total, 5 up, 6 in 2024-08-01T06:51:38.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:38 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T06:51:39.575 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:39 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/2924017347' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-01T06:51:39.575 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:39 smithi016 ceph-mon[29266]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:39.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:39 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/2924017347' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-01T06:51:39.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:39 smithi089 ceph-mon[36617]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:40.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:40 smithi016 ceph-mon[29266]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:41.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:40 smithi089 ceph-mon[36617]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:42.843 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:42 smithi089 ceph-mon[36617]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:42.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:42 smithi016 ceph-mon[29266]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:44.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:44 smithi016 ceph-mon[29266]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:45.061 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:44 smithi089 ceph-mon[36617]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:45.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:45 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-01T06:51:45.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:45 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:45.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:45 smithi016 ceph-mon[29266]: Deploying daemon osd.5 on smithi089 2024-08-01T06:51:45.984 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:45 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-01T06:51:45.984 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:45 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:45.984 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:45 smithi089 ceph-mon[36617]: Deploying daemon osd.5 on smithi089 2024-08-01T06:51:46.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:46 smithi089 ceph-mon[36617]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:47.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:46 smithi016 ceph-mon[29266]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:47.977 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:47 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:51:48.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:47 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:51:48.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:48 smithi089 ceph-mon[36617]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:49.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:48 smithi016 ceph-mon[29266]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:50.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:49 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:51:50.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:49 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:50.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:49 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:50.297 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:49 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:51:50.297 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:49 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:50.298 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:49 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:51.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:50 smithi016 ceph-mon[29266]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:51.245 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:50 smithi089 ceph-mon[36617]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:52.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:52.652+0000 7f6f7a7fc640 1 -- 172.21.15.89:0/2688765709 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6f8419b4b0 con 0x7f6f7006cc50 2024-08-01T06:51:52.654 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 5 on host 'smithi089' 2024-08-01T06:51:52.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:52.654+0000 7f6f8b39e640 1 -- 172.21.15.89:0/2688765709 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f6f7006cc50 msgr2=0x7f6f7006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:51:52.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:52.654+0000 7f6f8b39e640 1 --2- 172.21.15.89:0/2688765709 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f6f7006cc50 0x7f6f7006f110 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f74000c00 tx=0x7f6f740314a0 comp rx=0 tx=0).stop 2024-08-01T06:51:52.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:52.654+0000 7f6f8b39e640 1 -- 172.21.15.89:0/2688765709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f84100630 msgr2=0x7f6f84195680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:51:52.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:52.654+0000 7f6f8b39e640 1 --2- 172.21.15.89:0/2688765709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f84100630 0x7f6f84195680 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000d8d0 tx=0x7f6f8000dd90 comp rx=0 tx=0).stop 2024-08-01T06:51:52.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:52.654+0000 7f6f8b39e640 1 -- 172.21.15.89:0/2688765709 shutdown_connections 2024-08-01T06:51:52.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:52.654+0000 7f6f8b39e640 1 --2- 172.21.15.89:0/2688765709 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f6f7006cc50 0x7f6f7006f110 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:52.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:52.654+0000 7f6f8b39e640 1 --2- 172.21.15.89:0/2688765709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f84102f60 0x7f6f84195bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:52.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:52.654+0000 7f6f8b39e640 1 --2- 172.21.15.89:0/2688765709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f84100630 0x7f6f84195680 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:52.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:52.654+0000 7f6f8b39e640 1 -- 172.21.15.89:0/2688765709 >> 172.21.15.89:0/2688765709 conn(0x7f6f840fa250 msgr2=0x7f6f840fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:51:52.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:52.654+0000 7f6f8b39e640 1 -- 172.21.15.89:0/2688765709 shutdown_connections 2024-08-01T06:51:52.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:51:52.654+0000 7f6f8b39e640 1 -- 172.21.15.89:0/2688765709 wait complete. 2024-08-01T06:51:52.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:52 smithi089 ceph-mon[36617]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:52.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:52 smithi016 ceph-mon[29266]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:53.328 DEBUG:teuthology.orchestra.run.smithi089:osd.5> sudo journalctl -f -n 0 -u ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.5.service 2024-08-01T06:51:53.331 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-08-01T06:51:53.331 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph osd stat -f json 2024-08-01T06:51:53.562 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:51:53.904 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:53 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:53.904 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:53 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:53.904 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 06:51:53 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[55492]: 2024-08-01T06:51:53.797+0000 7f3751cc3640 -1 osd.5 0 log_to_monitors true 2024-08-01T06:51:53.911 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:53 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:53.911 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:53 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:54.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:54 smithi016 ceph-mon[29266]: from='osd.5 [v2:172.21.15.89:6816/2072119759,v1:172.21.15.89:6817/2072119759]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-01T06:51:54.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:54 smithi016 ceph-mon[29266]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-01T06:51:54.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:54 smithi016 ceph-mon[29266]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:54.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:54 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:54.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:54 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:55.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:54 smithi089 ceph-mon[36617]: from='osd.5 [v2:172.21.15.89:6816/2072119759,v1:172.21.15.89:6817/2072119759]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-01T06:51:55.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:54 smithi089 ceph-mon[36617]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-01T06:51:55.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:54 smithi089 ceph-mon[36617]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:55.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:54 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:55.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:54 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:55.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.217+0000 7f24afdb6640 1 -- 172.21.15.16:0/619501285 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24a80feaf0 msgr2=0x7f24a80feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:51:55.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.217+0000 7f24afdb6640 1 --2- 172.21.15.16:0/619501285 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24a80feaf0 0x7f24a80feef0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009880 tx=0x7f24a402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:51:55.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.217+0000 7f24afdb6640 1 -- 172.21.15.16:0/619501285 shutdown_connections 2024-08-01T06:51:55.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.217+0000 7f24afdb6640 1 --2- 172.21.15.16:0/619501285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a80ffcf0 0x7f24a8100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:55.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.217+0000 7f24afdb6640 1 --2- 172.21.15.16:0/619501285 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24a80feaf0 0x7f24a80feef0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:55.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.217+0000 7f24afdb6640 1 -- 172.21.15.16:0/619501285 >> 172.21.15.16:0/619501285 conn(0x7f24a80fa280 msgr2=0x7f24a80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:51:55.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.218+0000 7f24afdb6640 1 -- 172.21.15.16:0/619501285 shutdown_connections 2024-08-01T06:51:55.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.218+0000 7f24afdb6640 1 -- 172.21.15.16:0/619501285 wait complete. 2024-08-01T06:51:55.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.218+0000 7f24afdb6640 1 Processor -- start 2024-08-01T06:51:55.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.218+0000 7f24afdb6640 1 -- start start 2024-08-01T06:51:55.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.218+0000 7f24afdb6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a80feaf0 0x7f24a8195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:51:55.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.218+0000 7f24afdb6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24a80ffcf0 0x7f24a8195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:51:55.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.218+0000 7f24afdb6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a81961a0 con 0x7f24a80ffcf0 2024-08-01T06:51:55.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.218+0000 7f24afdb6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a8196310 con 0x7f24a80feaf0 2024-08-01T06:51:55.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.218+0000 7f24ad351640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24a80ffcf0 0x7f24a8195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:51:55.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.218+0000 7f24ad351640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24a80ffcf0 0x7f24a8195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60754/0 (socket says 172.21.15.16:60754) 2024-08-01T06:51:55.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.218+0000 7f24ad351640 1 -- 172.21.15.16:0/1836241402 learned_addr learned my addr 172.21.15.16:0/1836241402 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:51:55.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.219+0000 7f24adb52640 1 --2- 172.21.15.16:0/1836241402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a80feaf0 0x7f24a8195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:51:55.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.219+0000 7f24ad351640 1 -- 172.21.15.16:0/1836241402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a80feaf0 msgr2=0x7f24a8195690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:51:55.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.219+0000 7f24ad351640 1 --2- 172.21.15.16:0/1836241402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a80feaf0 0x7f24a8195690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:55.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.219+0000 7f24ad351640 1 -- 172.21.15.16:0/1836241402 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a4009560 con 0x7f24a80ffcf0 2024-08-01T06:51:55.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.219+0000 7f24ad351640 1 --2- 172.21.15.16:0/1836241402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24a80ffcf0 0x7f24a8195bd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f249800c920 tx=0x7f249800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:51:55.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.219+0000 7f249effd640 1 -- 172.21.15.16:0/1836241402 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2498007b80 con 0x7f24a80ffcf0 2024-08-01T06:51:55.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.219+0000 7f249effd640 1 -- 172.21.15.16:0/1836241402 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f24980054e0 con 0x7f24a80ffcf0 2024-08-01T06:51:55.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.219+0000 7f24afdb6640 1 -- 172.21.15.16:0/1836241402 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a819adb0 con 0x7f24a80ffcf0 2024-08-01T06:51:55.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.219+0000 7f249effd640 1 -- 172.21.15.16:0/1836241402 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f249800f450 con 0x7f24a80ffcf0 2024-08-01T06:51:55.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.219+0000 7f24afdb6640 1 -- 172.21.15.16:0/1836241402 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a819b2d0 con 0x7f24a80ffcf0 2024-08-01T06:51:55.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.220+0000 7f24afdb6640 1 -- 172.21.15.16:0/1836241402 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a80feed0 con 0x7f24a80ffcf0 2024-08-01T06:51:55.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.221+0000 7f249effd640 1 -- 172.21.15.16:0/1836241402 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2498004f60 con 0x7f24a80ffcf0 2024-08-01T06:51:55.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.221+0000 7f249effd640 1 --2- 172.21.15.16:0/1836241402 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f249406cc50 0x7f249406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:51:55.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.222+0000 7f249effd640 1 -- 172.21.15.16:0/1836241402 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4342+0+0 (secure 0 0 0) 0x7f249808bb60 con 0x7f24a80ffcf0 2024-08-01T06:51:55.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.222+0000 7f24adb52640 1 --2- 172.21.15.16:0/1836241402 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f249406cc50 0x7f249406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:51:55.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.222+0000 7f24adb52640 1 --2- 172.21.15.16:0/1836241402 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f249406cc50 0x7f249406f110 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009230 tx=0x7f24a4005b50 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:51:55.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.226+0000 7f249effd640 1 -- 172.21.15.16:0/1836241402 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f2498056410 con 0x7f24a80ffcf0 2024-08-01T06:51:55.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.398+0000 7f24afdb6640 1 -- 172.21.15.16:0/1836241402 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f24a8107700 con 0x7f24a80ffcf0 2024-08-01T06:51:55.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.399+0000 7f249effd640 1 -- 172.21.15.16:0/1836241402 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) v1 ==== 74+0+130 (secure 0 0 0) 0x7f249801d090 con 0x7f24a80ffcf0 2024-08-01T06:51:55.401 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:51:55.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.401+0000 7f24afdb6640 1 -- 172.21.15.16:0/1836241402 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f249406cc50 msgr2=0x7f249406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:51:55.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.401+0000 7f24afdb6640 1 --2- 172.21.15.16:0/1836241402 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f249406cc50 0x7f249406f110 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009230 tx=0x7f24a4005b50 comp rx=0 tx=0).stop 2024-08-01T06:51:55.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.401+0000 7f24afdb6640 1 -- 172.21.15.16:0/1836241402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24a80ffcf0 msgr2=0x7f24a8195bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:51:55.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.401+0000 7f24afdb6640 1 --2- 172.21.15.16:0/1836241402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24a80ffcf0 0x7f24a8195bd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f249800c920 tx=0x7f249800cde0 comp rx=0 tx=0).stop 2024-08-01T06:51:55.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.401+0000 7f24afdb6640 1 -- 172.21.15.16:0/1836241402 shutdown_connections 2024-08-01T06:51:55.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.401+0000 7f24afdb6640 1 --2- 172.21.15.16:0/1836241402 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f249406cc50 0x7f249406f110 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:55.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.401+0000 7f24afdb6640 1 --2- 172.21.15.16:0/1836241402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24a80ffcf0 0x7f24a8195bd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:55.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.401+0000 7f24afdb6640 1 --2- 172.21.15.16:0/1836241402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a80feaf0 0x7f24a8195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:55.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.401+0000 7f24afdb6640 1 -- 172.21.15.16:0/1836241402 >> 172.21.15.16:0/1836241402 conn(0x7f24a80fa280 msgr2=0x7f24a80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:51:55.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.401+0000 7f24afdb6640 1 -- 172.21.15.16:0/1836241402 shutdown_connections 2024-08-01T06:51:55.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:55.401+0000 7f24afdb6640 1 -- 172.21.15.16:0/1836241402 wait complete. 2024-08-01T06:51:55.748 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:55 smithi016 ceph-mon[29266]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-01T06:51:55.748 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:55 smithi016 ceph-mon[29266]: osdmap e37: 6 total, 5 up, 6 in 2024-08-01T06:51:55.748 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:55 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T06:51:55.748 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:55 smithi016 ceph-mon[29266]: from='osd.5 [v2:172.21.15.89:6816/2072119759,v1:172.21.15.89:6817/2072119759]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T06:51:55.748 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:55 smithi016 ceph-mon[29266]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T06:51:55.748 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:55 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/1836241402' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-01T06:51:55.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:55 smithi089 ceph-mon[36617]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-01T06:51:55.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:55 smithi089 ceph-mon[36617]: osdmap e37: 6 total, 5 up, 6 in 2024-08-01T06:51:55.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:55 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T06:51:55.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:55 smithi089 ceph-mon[36617]: from='osd.5 [v2:172.21.15.89:6816/2072119759,v1:172.21.15.89:6817/2072119759]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T06:51:55.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:55 smithi089 ceph-mon[36617]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T06:51:55.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:55 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/1836241402' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-01T06:51:56.095 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":37,"num_osds":6,"num_up_osds":5,"osd_up_since":1722495091,"num_in_osds":6,"osd_in_since":1722495097,"num_remapped_pgs":0} 2024-08-01T06:51:56.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 06:51:56 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[55492]: 2024-08-01T06:51:56.472+0000 7f374ec5c640 -1 osd.5 0 waiting for initial osdmap 2024-08-01T06:51:56.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 06:51:56 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[55492]: 2024-08-01T06:51:56.484+0000 7f3745a54640 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-01T06:51:56.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:56 smithi089 ceph-mon[36617]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-08-01T06:51:56.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:56 smithi089 ceph-mon[36617]: osdmap e38: 6 total, 5 up, 6 in 2024-08-01T06:51:56.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:56 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T06:51:56.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:56 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T06:51:56.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:56 smithi089 ceph-mon[36617]: from='osd.5 ' entity='osd.5' 2024-08-01T06:51:56.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:56 smithi089 ceph-mon[36617]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:56.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:56 smithi016 ceph-mon[29266]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-08-01T06:51:56.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:56 smithi016 ceph-mon[29266]: osdmap e38: 6 total, 5 up, 6 in 2024-08-01T06:51:56.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:56 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T06:51:56.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:56 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T06:51:56.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:56 smithi016 ceph-mon[29266]: from='osd.5 ' entity='osd.5' 2024-08-01T06:51:56.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:56 smithi016 ceph-mon[29266]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-01T06:51:57.097 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph osd stat -f json 2024-08-01T06:51:57.320 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:51:57.727 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:57 smithi016 ceph-mon[29266]: purged_snaps scrub starts 2024-08-01T06:51:57.727 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:57 smithi016 ceph-mon[29266]: purged_snaps scrub ok 2024-08-01T06:51:57.727 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:57 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T06:51:57.727 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:57 smithi016 ceph-mon[29266]: osd.5 [v2:172.21.15.89:6816/2072119759,v1:172.21.15.89:6817/2072119759] boot 2024-08-01T06:51:57.727 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:57 smithi016 ceph-mon[29266]: osdmap e39: 6 total, 6 up, 6 in 2024-08-01T06:51:57.727 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:57 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T06:51:57.870 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:57 smithi089 ceph-mon[36617]: purged_snaps scrub starts 2024-08-01T06:51:57.870 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:57 smithi089 ceph-mon[36617]: purged_snaps scrub ok 2024-08-01T06:51:57.870 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:57 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T06:51:57.870 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:57 smithi089 ceph-mon[36617]: osd.5 [v2:172.21.15.89:6816/2072119759,v1:172.21.15.89:6817/2072119759] boot 2024-08-01T06:51:57.870 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:57 smithi089 ceph-mon[36617]: osdmap e39: 6 total, 6 up, 6 in 2024-08-01T06:51:57.870 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:57 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T06:51:58.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.872+0000 7f29cd49a640 1 -- 172.21.15.16:0/1831606356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29c8101190 msgr2=0x7f29c8101590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:51:58.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.872+0000 7f29cd49a640 1 --2- 172.21.15.16:0/1831606356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29c8101190 0x7f29c8101590 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f29b8009880 tx=0x7f29b802a4a0 comp rx=0 tx=0).stop 2024-08-01T06:51:58.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.872+0000 7f29cd49a640 1 -- 172.21.15.16:0/1831606356 shutdown_connections 2024-08-01T06:51:58.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.872+0000 7f29cd49a640 1 --2- 172.21.15.16:0/1831606356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29c8101b60 0x7f29c80fdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:58.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.872+0000 7f29cd49a640 1 --2- 172.21.15.16:0/1831606356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29c8101190 0x7f29c8101590 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:58.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.872+0000 7f29cd49a640 1 -- 172.21.15.16:0/1831606356 >> 172.21.15.16:0/1831606356 conn(0x7f29c80f99c0 msgr2=0x7f29c80fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:51:58.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.872+0000 7f29cd49a640 1 -- 172.21.15.16:0/1831606356 shutdown_connections 2024-08-01T06:51:58.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.872+0000 7f29cd49a640 1 -- 172.21.15.16:0/1831606356 wait complete. 2024-08-01T06:51:58.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.873+0000 7f29cd49a640 1 Processor -- start 2024-08-01T06:51:58.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.873+0000 7f29cd49a640 1 -- start start 2024-08-01T06:51:58.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.874+0000 7f29cd49a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29c8101190 0x7f29c8100840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:51:58.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.874+0000 7f29cd49a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29c8101b60 0x7f29c80feee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:51:58.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.874+0000 7f29cd49a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c80ff420 con 0x7f29c8101190 2024-08-01T06:51:58.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.874+0000 7f29cd49a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c80ff590 con 0x7f29c8101b60 2024-08-01T06:51:58.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.874+0000 7f29c6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29c8101190 0x7f29c8100840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:51:58.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.874+0000 7f29c6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29c8101190 0x7f29c8100840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58074/0 (socket says 172.21.15.16:58074) 2024-08-01T06:51:58.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.874+0000 7f29c6ffd640 1 -- 172.21.15.16:0/3158118403 learned_addr learned my addr 172.21.15.16:0/3158118403 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:51:58.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.874+0000 7f29be7fc640 1 --2- 172.21.15.16:0/3158118403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29c8101b60 0x7f29c80feee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:51:58.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.874+0000 7f29c6ffd640 1 -- 172.21.15.16:0/3158118403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29c8101b60 msgr2=0x7f29c80feee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:51:58.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.874+0000 7f29c6ffd640 1 --2- 172.21.15.16:0/3158118403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29c8101b60 0x7f29c80feee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:58.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.874+0000 7f29c6ffd640 1 -- 172.21.15.16:0/3158118403 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b8009560 con 0x7f29c8101190 2024-08-01T06:51:58.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.874+0000 7f29be7fc640 1 --2- 172.21.15.16:0/3158118403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29c8101b60 0x7f29c80feee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T06:51:58.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.874+0000 7f29c6ffd640 1 --2- 172.21.15.16:0/3158118403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29c8101190 0x7f29c8100840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f29b802a9c0 tx=0x7f29b80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:51:58.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.874+0000 7f29c4ff9640 1 -- 172.21.15.16:0/3158118403 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b8004aa0 con 0x7f29c8101190 2024-08-01T06:51:58.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.874+0000 7f29c4ff9640 1 -- 172.21.15.16:0/3158118403 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29b8005d50 con 0x7f29c8101190 2024-08-01T06:51:58.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.874+0000 7f29cd49a640 1 -- 172.21.15.16:0/3158118403 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c80ff810 con 0x7f29c8101190 2024-08-01T06:51:58.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.875+0000 7f29c4ff9640 1 -- 172.21.15.16:0/3158118403 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b80039e0 con 0x7f29c8101190 2024-08-01T06:51:58.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.875+0000 7f29cd49a640 1 -- 172.21.15.16:0/3158118403 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c819d6f0 con 0x7f29c8101190 2024-08-01T06:51:58.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.875+0000 7f29cd49a640 1 -- 172.21.15.16:0/3158118403 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c8101590 con 0x7f29c8101190 2024-08-01T06:51:58.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.876+0000 7f29c4ff9640 1 -- 172.21.15.16:0/3158118403 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f29b8031c00 con 0x7f29c8101190 2024-08-01T06:51:58.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.876+0000 7f29c4ff9640 1 --2- 172.21.15.16:0/3158118403 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f29b406cc50 0x7f29b406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:51:58.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.877+0000 7f29c4ff9640 1 -- 172.21.15.16:0/3158118403 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f29b80acf60 con 0x7f29c8101190 2024-08-01T06:51:58.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.877+0000 7f29be7fc640 1 --2- 172.21.15.16:0/3158118403 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f29b406cc50 0x7f29b406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:51:58.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.877+0000 7f29be7fc640 1 --2- 172.21.15.16:0/3158118403 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f29b406cc50 0x7f29b406f110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f29c81005c0 tx=0x7f29b0005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:51:58.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:58.881+0000 7f29c4ff9640 1 -- 172.21.15.16:0/3158118403 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f29b80e0de0 con 0x7f29c8101190 2024-08-01T06:51:59.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:59.057+0000 7f29cd49a640 1 -- 172.21.15.16:0/3158118403 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f29c818f750 con 0x7f29c8101190 2024-08-01T06:51:59.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:59.058+0000 7f29c4ff9640 1 -- 172.21.15.16:0/3158118403 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7f29b80400a0 con 0x7f29c8101190 2024-08-01T06:51:59.059 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:51:59.060 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:58 smithi016 ceph-mon[29266]: Detected new or changed devices on smithi089 2024-08-01T06:51:59.060 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:58 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:59.060 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:58 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:59.060 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:58 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:51:59.060 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:58 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:51:59.060 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:58 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:51:59.060 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:58 smithi016 ceph-mon[29266]: Adjusting osd_memory_target on smithi089 to 4970M 2024-08-01T06:51:59.060 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:58 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:59.060 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:58 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:59.060 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:58 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:51:59.061 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:58 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:59.061 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:58 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:51:59.061 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:58 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:59.061 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:58 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:51:59.061 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:58 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:59.061 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:58 smithi016 ceph-mon[29266]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:51:59.061 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:51:58 smithi016 ceph-mon[29266]: osdmap e40: 6 total, 6 up, 6 in 2024-08-01T06:51:59.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:59.060+0000 7f29cd49a640 1 -- 172.21.15.16:0/3158118403 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f29b406cc50 msgr2=0x7f29b406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:51:59.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:59.060+0000 7f29cd49a640 1 --2- 172.21.15.16:0/3158118403 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f29b406cc50 0x7f29b406f110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f29c81005c0 tx=0x7f29b0005f90 comp rx=0 tx=0).stop 2024-08-01T06:51:59.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:59.060+0000 7f29cd49a640 1 -- 172.21.15.16:0/3158118403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29c8101190 msgr2=0x7f29c8100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:51:59.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:59.060+0000 7f29cd49a640 1 --2- 172.21.15.16:0/3158118403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29c8101190 0x7f29c8100840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f29b802a9c0 tx=0x7f29b80055a0 comp rx=0 tx=0).stop 2024-08-01T06:51:59.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:59.060+0000 7f29cd49a640 1 -- 172.21.15.16:0/3158118403 shutdown_connections 2024-08-01T06:51:59.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:59.061+0000 7f29cd49a640 1 --2- 172.21.15.16:0/3158118403 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f29b406cc50 0x7f29b406f110 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:59.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:59.061+0000 7f29cd49a640 1 --2- 172.21.15.16:0/3158118403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29c8101b60 0x7f29c80feee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:59.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:59.061+0000 7f29cd49a640 1 --2- 172.21.15.16:0/3158118403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29c8101190 0x7f29c8100840 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:51:59.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:59.061+0000 7f29cd49a640 1 -- 172.21.15.16:0/3158118403 >> 172.21.15.16:0/3158118403 conn(0x7f29c80f99c0 msgr2=0x7f29c8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:51:59.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:59.061+0000 7f29cd49a640 1 -- 172.21.15.16:0/3158118403 shutdown_connections 2024-08-01T06:51:59.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:51:59.061+0000 7f29cd49a640 1 -- 172.21.15.16:0/3158118403 wait complete. 2024-08-01T06:51:59.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:58 smithi089 ceph-mon[36617]: Detected new or changed devices on smithi089 2024-08-01T06:51:59.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:58 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:59.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:58 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:59.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:58 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:51:59.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:58 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:51:59.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:58 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:51:59.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:58 smithi089 ceph-mon[36617]: Adjusting osd_memory_target on smithi089 to 4970M 2024-08-01T06:51:59.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:58 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:59.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:58 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:59.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:58 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:51:59.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:58 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:59.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:58 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:51:59.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:58 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:51:59.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:58 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:51:59.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:58 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:51:59.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:58 smithi089 ceph-mon[36617]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:51:59.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:51:58 smithi089 ceph-mon[36617]: osdmap e40: 6 total, 6 up, 6 in 2024-08-01T06:51:59.721 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1722495117,"num_in_osds":6,"osd_in_since":1722495097,"num_remapped_pgs":0} 2024-08-01T06:51:59.721 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph osd dump --format=json 2024-08-01T06:51:59.934 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:00.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:00 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/3158118403' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-01T06:52:00.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:00 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3158118403' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-01T06:52:01.064 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:01 smithi016 ceph-mon[29266]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:01.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:01 smithi089 ceph-mon[36617]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:01.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.614+0000 7fd05c322640 1 -- 172.21.15.16:0/657629721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd054100750 msgr2=0x7fd0541047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:01.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.614+0000 7fd05c322640 1 --2- 172.21.15.16:0/657629721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd054100750 0x7fd0541047a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd044009880 tx=0x7fd04402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:52:01.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.614+0000 7fd05c322640 1 -- 172.21.15.16:0/657629721 shutdown_connections 2024-08-01T06:52:01.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.614+0000 7fd05c322640 1 --2- 172.21.15.16:0/657629721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd054100750 0x7fd0541047a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:01.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.614+0000 7fd05c322640 1 --2- 172.21.15.16:0/657629721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0540ffda0 0x7fd054100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:01.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.614+0000 7fd05c322640 1 -- 172.21.15.16:0/657629721 >> 172.21.15.16:0/657629721 conn(0x7fd0540fb840 msgr2=0x7fd0540fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:01.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.614+0000 7fd05c322640 1 -- 172.21.15.16:0/657629721 shutdown_connections 2024-08-01T06:52:01.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.614+0000 7fd05c322640 1 -- 172.21.15.16:0/657629721 wait complete. 2024-08-01T06:52:01.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.615+0000 7fd05c322640 1 Processor -- start 2024-08-01T06:52:01.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.615+0000 7fd05c322640 1 -- start start 2024-08-01T06:52:01.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.615+0000 7fd05c322640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0540ffda0 0x7fd0540727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:01.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.615+0000 7fd05c322640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd054100750 0x7fd054072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:01.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.615+0000 7fd05c322640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd054073230 con 0x7fd054100750 2024-08-01T06:52:01.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.615+0000 7fd05c322640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd054073370 con 0x7fd0540ffda0 2024-08-01T06:52:01.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.615+0000 7fd0598bd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd054100750 0x7fd054072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:01.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.615+0000 7fd0598bd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd054100750 0x7fd054072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58086/0 (socket says 172.21.15.16:58086) 2024-08-01T06:52:01.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.615+0000 7fd0598bd640 1 -- 172.21.15.16:0/3575950231 learned_addr learned my addr 172.21.15.16:0/3575950231 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:01.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.615+0000 7fd05a0be640 1 --2- 172.21.15.16:0/3575950231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0540ffda0 0x7fd0540727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:01.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.616+0000 7fd0598bd640 1 -- 172.21.15.16:0/3575950231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0540ffda0 msgr2=0x7fd0540727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:01.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.616+0000 7fd0598bd640 1 --2- 172.21.15.16:0/3575950231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0540ffda0 0x7fd0540727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:01.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.616+0000 7fd0598bd640 1 -- 172.21.15.16:0/3575950231 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd044009560 con 0x7fd054100750 2024-08-01T06:52:01.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.616+0000 7fd0598bd640 1 --2- 172.21.15.16:0/3575950231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd054100750 0x7fd054072cf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd04402a9c0 tx=0x7fd0440055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:01.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.616+0000 7fd04b7fe640 1 -- 172.21.15.16:0/3575950231 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd044004aa0 con 0x7fd054100750 2024-08-01T06:52:01.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.616+0000 7fd04b7fe640 1 -- 172.21.15.16:0/3575950231 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd044004c00 con 0x7fd054100750 2024-08-01T06:52:01.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.616+0000 7fd05c322640 1 -- 172.21.15.16:0/3575950231 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0540735f0 con 0x7fd054100750 2024-08-01T06:52:01.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.616+0000 7fd04b7fe640 1 -- 172.21.15.16:0/3575950231 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd044003980 con 0x7fd054100750 2024-08-01T06:52:01.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.616+0000 7fd05c322640 1 -- 172.21.15.16:0/3575950231 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0541a2000 con 0x7fd054100750 2024-08-01T06:52:01.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.617+0000 7fd05c322640 1 -- 172.21.15.16:0/3575950231 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd054101280 con 0x7fd054100750 2024-08-01T06:52:01.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.618+0000 7fd04b7fe640 1 -- 172.21.15.16:0/3575950231 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd044003b20 con 0x7fd054100750 2024-08-01T06:52:01.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.618+0000 7fd04b7fe640 1 --2- 172.21.15.16:0/3575950231 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd04006cc50 0x7fd04006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:01.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.618+0000 7fd04b7fe640 1 -- 172.21.15.16:0/3575950231 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd0440ace40 con 0x7fd054100750 2024-08-01T06:52:01.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.618+0000 7fd05a0be640 1 --2- 172.21.15.16:0/3575950231 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd04006cc50 0x7fd04006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:01.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.619+0000 7fd05a0be640 1 --2- 172.21.15.16:0/3575950231 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd04006cc50 0x7fd04006f110 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd050005fd0 tx=0x7fd05000b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:01.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.623+0000 7fd04b7fe640 1 -- 172.21.15.16:0/3575950231 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fd044077680 con 0x7fd054100750 2024-08-01T06:52:01.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.796+0000 7fd05c322640 1 -- 172.21.15.16:0/3575950231 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd054100180 con 0x7fd054100750 2024-08-01T06:52:01.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.797+0000 7fd04b7fe640 1 -- 172.21.15.16:0/3575950231 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11300 (secure 0 0 0) 0x7fd04407aca0 con 0x7fd054100750 2024-08-01T06:52:01.799 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:52:01.799 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":40,"fsid":"a88427da-4fd1-11ef-bcca-c7b262605968","created":"2024-08-01T06:46:34.093437+0000","modified":"2024-08-01T06:51:58.660378+0000","last_up_change":"2024-08-01T06:51:57.474883+0000","last_in_change":"2024-08-01T06:51:37.752663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-01T06:50:45.021550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f51cb32b-c276-4b4b-9085-351c6536cda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1985422750},{"type":"v1","addr":"172.21.15.16:6803","nonce":1985422750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1985422750},{"type":"v1","addr":"172.21.15.16:6805","nonce":1985422750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1985422750},{"type":"v1","addr":"172.21.15.16:6809","nonce":1985422750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1985422750},{"type":"v1","addr":"172.21.15.16:6807","nonce":1985422750}]},"public_addr":"172.21.15.16:6803/1985422750","cluster_addr":"172.21.15.16:6805/1985422750","heartbeat_back_addr":"172.21.15.16:6809/1985422750","heartbeat_front_addr":"172.21.15.16:6807/1985422750","state":["exists","up"]},{"osd":1,"uuid":"2670e18d-6fbf-460d-86c0-5b897c25d542","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3206893924},{"type":"v1","addr":"172.21.15.16:6811","nonce":3206893924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3206893924},{"type":"v1","addr":"172.21.15.16:6813","nonce":3206893924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3206893924},{"type":"v1","addr":"172.21.15.16:6817","nonce":3206893924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3206893924},{"type":"v1","addr":"172.21.15.16:6815","nonce":3206893924}]},"public_addr":"172.21.15.16:6811/3206893924","cluster_addr":"172.21.15.16:6813/3206893924","heartbeat_back_addr":"172.21.15.16:6817/3206893924","heartbeat_front_addr":"172.21.15.16:6815/3206893924","state":["exists","up"]},{"osd":2,"uuid":"94f66ce0-ee7b-4d29-8a65-5ee7464270db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2241613812},{"type":"v1","addr":"172.21.15.16:6819","nonce":2241613812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2241613812},{"type":"v1","addr":"172.21.15.16:6821","nonce":2241613812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2241613812},{"type":"v1","addr":"172.21.15.16:6825","nonce":2241613812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2241613812},{"type":"v1","addr":"172.21.15.16:6823","nonce":2241613812}]},"public_addr":"172.21.15.16:6819/2241613812","cluster_addr":"172.21.15.16:6821/2241613812","heartbeat_back_addr":"172.21.15.16:6825/2241613812","heartbeat_front_addr":"172.21.15.16:6823/2241613812","state":["exists","up"]},{"osd":3,"uuid":"3c0e7296-4283-441a-b445-9a57aa8617de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2212217098},{"type":"v1","addr":"172.21.15.89:6801","nonce":2212217098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2212217098},{"type":"v1","addr":"172.21.15.89:6803","nonce":2212217098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2212217098},{"type":"v1","addr":"172.21.15.89:6807","nonce":2212217098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2212217098},{"type":"v1","addr":"172.21.15.89:6805","nonce":2212217098}]},"public_addr":"172.21.15.89:6801/2212217098","cluster_addr":"172.21.15.89:6803/2212217098","heartbeat_back_addr":"172.21.15.89:6807/2212217098","heartbeat_front_addr":"172.21.15.89:6805/2212217098","state":["exists","up"]},{"osd":4,"uuid":"8db8b0e3-4ecb-45c1-8e3e-c73c48996459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":900847704},{"type":"v1","addr":"172.21.15.89:6809","nonce":900847704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":900847704},{"type":"v1","addr":"172.21.15.89:6811","nonce":900847704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":900847704},{"type":"v1","addr":"172.21.15.89:6815","nonce":900847704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":900847704},{"type":"v1","addr":"172.21.15.89:6813","nonce":900847704}]},"public_addr":"172.21.15.89:6809/900847704","cluster_addr":"172.21.15.89:6811/900847704","heartbeat_back_addr":"172.21.15.89:6815/900847704","heartbeat_front_addr":"172.21.15.89:6813/900847704","state":["exists","up"]},{"osd":5,"uuid":"18045ff7-9343-4eec-97c0-e2ed091a868d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2072119759},{"type":"v1","addr":"172.21.15.89:6817","nonce":2072119759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":2072119759},{"type":"v1","addr":"172.21.15.89:6819","nonce":2072119759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":2072119759},{"type":"v1","addr":"172.21.15.89:6823","nonce":2072119759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":2072119759},{"type":"v1","addr":"172.21.15.89:6821","nonce":2072119759}]},"public_addr":"172.21.15.89:6817/2072119759","cluster_addr":"172.21.15.89:6819/2072119759","heartbeat_back_addr":"172.21.15.89:6823/2072119759","heartbeat_front_addr":"172.21.15.89:6821/2072119759","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-01T06:49:48.180562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-01T06:50:15.128817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-01T06:50:41.882357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-01T06:51:04.660626+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-01T06:51:29.277470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-01T06:51:54.755292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/247151947":"2024-08-02T06:47:27.347897+0000","172.21.15.16:6800/3674863410":"2024-08-02T06:46:56.352049+0000","172.21.15.16:6800/3100338993":"2024-08-02T06:48:32.522874+0000","172.21.15.16:0/3966853485":"2024-08-02T06:48:32.522874+0000","172.21.15.16:6801/3674863410":"2024-08-02T06:46:56.352049+0000","172.21.15.16:0/2356611709":"2024-08-02T06:46:56.352049+0000","172.21.15.16:0/1836104042":"2024-08-02T06:48:32.522874+0000","172.21.15.16:0/2947838469":"2024-08-02T06:48:32.522874+0000","172.21.15.16:0/3369355765":"2024-08-02T06:46:56.352049+0000","172.21.15.16:0/2604937406":"2024-08-02T06:46:56.352049+0000","172.21.15.16:0/2595787010":"2024-08-02T06:47:27.347897+0000","172.21.15.16:0/320178436":"2024-08-02T06:47:27.347897+0000","172.21.15.16:0/2028838931":"2024-08-02T06:47:27.347897+0000","172.21.15.16:6800/247151947":"2024-08-02T06:47:27.347897+0000","172.21.15.16:6801/3100338993":"2024-08-02T06:48:32.522874+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-01T06:52:01.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.799+0000 7fd05c322640 1 -- 172.21.15.16:0/3575950231 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd04006cc50 msgr2=0x7fd04006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:01.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.799+0000 7fd05c322640 1 --2- 172.21.15.16:0/3575950231 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd04006cc50 0x7fd04006f110 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd050005fd0 tx=0x7fd05000b390 comp rx=0 tx=0).stop 2024-08-01T06:52:01.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.799+0000 7fd05c322640 1 -- 172.21.15.16:0/3575950231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd054100750 msgr2=0x7fd054072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:01.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.799+0000 7fd05c322640 1 --2- 172.21.15.16:0/3575950231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd054100750 0x7fd054072cf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd04402a9c0 tx=0x7fd0440055a0 comp rx=0 tx=0).stop 2024-08-01T06:52:01.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.799+0000 7fd05c322640 1 -- 172.21.15.16:0/3575950231 shutdown_connections 2024-08-01T06:52:01.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.799+0000 7fd05c322640 1 --2- 172.21.15.16:0/3575950231 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd04006cc50 0x7fd04006f110 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:01.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.799+0000 7fd05c322640 1 --2- 172.21.15.16:0/3575950231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd054100750 0x7fd054072cf0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:01.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.799+0000 7fd05c322640 1 --2- 172.21.15.16:0/3575950231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0540ffda0 0x7fd0540727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:01.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.799+0000 7fd05c322640 1 -- 172.21.15.16:0/3575950231 >> 172.21.15.16:0/3575950231 conn(0x7fd0540fb840 msgr2=0x7fd0540fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:01.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.799+0000 7fd05c322640 1 -- 172.21.15.16:0/3575950231 shutdown_connections 2024-08-01T06:52:01.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:01.799+0000 7fd05c322640 1 -- 172.21.15.16:0/3575950231 wait complete. 2024-08-01T06:52:02.111 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:02 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3575950231' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-01T06:52:02.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:02 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/3575950231' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-01T06:52:02.480 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-01T06:50:45.021550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-01T06:52:02.480 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-01T06:52:02.698 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:03.082 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:03 smithi016 ceph-mon[29266]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:03.082 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:03 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:52:03.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:03 smithi089 ceph-mon[36617]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:03.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:03 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:52:04.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.138+0000 7f78d081f640 1 -- 172.21.15.16:0/1157301055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78cc100d50 msgr2=0x7f78cc101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:04.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.138+0000 7f78d081f640 1 --2- 172.21.15.16:0/1157301055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78cc100d50 0x7f78cc101130 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f78bc009880 tx=0x7f78bc02a530 comp rx=0 tx=0).stop 2024-08-01T06:52:04.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.138+0000 7f78d081f640 1 -- 172.21.15.16:0/1157301055 shutdown_connections 2024-08-01T06:52:04.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.138+0000 7f78d081f640 1 --2- 172.21.15.16:0/1157301055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78cc101670 0x7f78cc109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:04.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.138+0000 7f78d081f640 1 --2- 172.21.15.16:0/1157301055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78cc100d50 0x7f78cc101130 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:04.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.138+0000 7f78d081f640 1 -- 172.21.15.16:0/1157301055 >> 172.21.15.16:0/1157301055 conn(0x7f78cc0758a0 msgr2=0x7f78cc0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:04.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.138+0000 7f78d081f640 1 -- 172.21.15.16:0/1157301055 shutdown_connections 2024-08-01T06:52:04.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.138+0000 7f78d081f640 1 -- 172.21.15.16:0/1157301055 wait complete. 2024-08-01T06:52:04.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.139+0000 7f78d081f640 1 Processor -- start 2024-08-01T06:52:04.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.139+0000 7f78d081f640 1 -- start start 2024-08-01T06:52:04.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.139+0000 7f78d081f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78cc100d50 0x7f78cc19b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:04.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.139+0000 7f78d081f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78cc101670 0x7f78cc19bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:04.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.139+0000 7f78d081f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc19c3f0 con 0x7f78cc101670 2024-08-01T06:52:04.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.139+0000 7f78d081f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc195980 con 0x7f78cc100d50 2024-08-01T06:52:04.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.139+0000 7f78c9d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78cc101670 0x7f78cc19bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:04.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.139+0000 7f78c9d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78cc101670 0x7f78cc19bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58108/0 (socket says 172.21.15.16:58108) 2024-08-01T06:52:04.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.139+0000 7f78c9d9b640 1 -- 172.21.15.16:0/2161001934 learned_addr learned my addr 172.21.15.16:0/2161001934 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:04.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.139+0000 7f78ca59c640 1 --2- 172.21.15.16:0/2161001934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78cc100d50 0x7f78cc19b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:04.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.139+0000 7f78c9d9b640 1 -- 172.21.15.16:0/2161001934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78cc100d50 msgr2=0x7f78cc19b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:04.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.139+0000 7f78c9d9b640 1 --2- 172.21.15.16:0/2161001934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78cc100d50 0x7f78cc19b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:04.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.139+0000 7f78c9d9b640 1 -- 172.21.15.16:0/2161001934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc009560 con 0x7f78cc101670 2024-08-01T06:52:04.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.140+0000 7f78c9d9b640 1 --2- 172.21.15.16:0/2161001934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78cc101670 0x7f78cc19bdd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f78c000d6f0 tx=0x7f78c000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:04.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.140+0000 7f78bb7fe640 1 -- 172.21.15.16:0/2161001934 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78c0009a30 con 0x7f78cc101670 2024-08-01T06:52:04.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.140+0000 7f78bb7fe640 1 -- 172.21.15.16:0/2161001934 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f78c00054e0 con 0x7f78cc101670 2024-08-01T06:52:04.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.140+0000 7f78d081f640 1 -- 172.21.15.16:0/2161001934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78cc195c60 con 0x7f78cc101670 2024-08-01T06:52:04.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.140+0000 7f78bb7fe640 1 -- 172.21.15.16:0/2161001934 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78c0010460 con 0x7f78cc101670 2024-08-01T06:52:04.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.140+0000 7f78d081f640 1 -- 172.21.15.16:0/2161001934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78cc1961b0 con 0x7f78cc101670 2024-08-01T06:52:04.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.141+0000 7f78d081f640 1 -- 172.21.15.16:0/2161001934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78cc068470 con 0x7f78cc101670 2024-08-01T06:52:04.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.141+0000 7f78bb7fe640 1 -- 172.21.15.16:0/2161001934 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f78c0009b90 con 0x7f78cc101670 2024-08-01T06:52:04.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.142+0000 7f78bb7fe640 1 --2- 172.21.15.16:0/2161001934 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f78b406cc50 0x7f78b406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:04.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.142+0000 7f78bb7fe640 1 -- 172.21.15.16:0/2161001934 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f78c008ba10 con 0x7f78cc101670 2024-08-01T06:52:04.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.142+0000 7f78ca59c640 1 --2- 172.21.15.16:0/2161001934 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f78b406cc50 0x7f78b406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:04.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.142+0000 7f78ca59c640 1 --2- 172.21.15.16:0/2161001934 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f78b406cc50 0x7f78b406f110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f78bc000c00 tx=0x7f78bc0058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:04.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.146+0000 7f78bb7fe640 1 -- 172.21.15.16:0/2161001934 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f78c00561d0 con 0x7f78cc101670 2024-08-01T06:52:04.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.319+0000 7f78d081f640 1 -- 172.21.15.16:0/2161001934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78cc1043e0 con 0x7f78cc101670 2024-08-01T06:52:04.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.319+0000 7f78bb7fe640 1 -- 172.21.15.16:0/2161001934 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78c00200a0 con 0x7f78cc101670 2024-08-01T06:52:04.321 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-08-01T06:52:04.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.321+0000 7f78d081f640 1 -- 172.21.15.16:0/2161001934 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f78b406cc50 msgr2=0x7f78b406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:04.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.321+0000 7f78d081f640 1 --2- 172.21.15.16:0/2161001934 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f78b406cc50 0x7f78b406f110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f78bc000c00 tx=0x7f78bc0058d0 comp rx=0 tx=0).stop 2024-08-01T06:52:04.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.321+0000 7f78d081f640 1 -- 172.21.15.16:0/2161001934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78cc101670 msgr2=0x7f78cc19bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:04.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.321+0000 7f78d081f640 1 --2- 172.21.15.16:0/2161001934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78cc101670 0x7f78cc19bdd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f78c000d6f0 tx=0x7f78c000dbb0 comp rx=0 tx=0).stop 2024-08-01T06:52:04.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.321+0000 7f78d081f640 1 -- 172.21.15.16:0/2161001934 shutdown_connections 2024-08-01T06:52:04.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.321+0000 7f78d081f640 1 --2- 172.21.15.16:0/2161001934 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f78b406cc50 0x7f78b406f110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:04.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.321+0000 7f78d081f640 1 --2- 172.21.15.16:0/2161001934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78cc101670 0x7f78cc19bdd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:04.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.321+0000 7f78d081f640 1 --2- 172.21.15.16:0/2161001934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78cc100d50 0x7f78cc19b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:04.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.321+0000 7f78d081f640 1 -- 172.21.15.16:0/2161001934 >> 172.21.15.16:0/2161001934 conn(0x7f78cc0758a0 msgr2=0x7f78cc101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:04.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.322+0000 7f78d081f640 1 -- 172.21.15.16:0/2161001934 shutdown_connections 2024-08-01T06:52:04.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:04.322+0000 7f78d081f640 1 -- 172.21.15.16:0/2161001934 wait complete. 2024-08-01T06:52:04.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:04 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/2161001934' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-01T06:52:04.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:04 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/2161001934' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-01T06:52:04.941 INFO:tasks.cephadm:Setting up client nodes... 2024-08-01T06:52:04.942 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-01T06:52:05.155 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:05.587 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:05 smithi016 ceph-mon[29266]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:05.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:05 smithi089 ceph-mon[36617]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:06.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.816+0000 7f00a966c640 1 -- 172.21.15.16:0/2135190854 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a40fe400 msgr2=0x7f00a40fe800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:06.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.816+0000 7f00a966c640 1 --2- 172.21.15.16:0/2135190854 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a40fe400 0x7f00a40fe800 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0094009880 tx=0x7f009402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:52:06.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.816+0000 7f00a966c640 1 -- 172.21.15.16:0/2135190854 shutdown_connections 2024-08-01T06:52:06.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.816+0000 7f00a966c640 1 --2- 172.21.15.16:0/2135190854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00a40fed40 0x7f00a40ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:06.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.816+0000 7f00a966c640 1 --2- 172.21.15.16:0/2135190854 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a40fe400 0x7f00a40fe800 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:06.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.816+0000 7f00a966c640 1 -- 172.21.15.16:0/2135190854 >> 172.21.15.16:0/2135190854 conn(0x7f00a40fa230 msgr2=0x7f00a40fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:06.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.817+0000 7f00a966c640 1 -- 172.21.15.16:0/2135190854 shutdown_connections 2024-08-01T06:52:06.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.817+0000 7f00a966c640 1 -- 172.21.15.16:0/2135190854 wait complete. 2024-08-01T06:52:06.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.817+0000 7f00a966c640 1 Processor -- start 2024-08-01T06:52:06.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.818+0000 7f00a966c640 1 -- start start 2024-08-01T06:52:06.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.818+0000 7f00a966c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00a40fe400 0x7f00a4197780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:06.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.818+0000 7f00a966c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a40fed40 0x7f00a4197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:06.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.818+0000 7f00a966c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a4198290 con 0x7f00a40fed40 2024-08-01T06:52:06.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.818+0000 7f00a966c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a4198400 con 0x7f00a40fe400 2024-08-01T06:52:06.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.818+0000 7f00a27fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a40fed40 0x7f00a4197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:06.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.818+0000 7f00a27fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a40fed40 0x7f00a4197cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58118/0 (socket says 172.21.15.16:58118) 2024-08-01T06:52:06.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.818+0000 7f00a27fc640 1 -- 172.21.15.16:0/1970836347 learned_addr learned my addr 172.21.15.16:0/1970836347 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:06.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.818+0000 7f00a2ffd640 1 --2- 172.21.15.16:0/1970836347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00a40fe400 0x7f00a4197780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:06.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.818+0000 7f00a27fc640 1 -- 172.21.15.16:0/1970836347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00a40fe400 msgr2=0x7f00a4197780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:06.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.818+0000 7f00a27fc640 1 --2- 172.21.15.16:0/1970836347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00a40fe400 0x7f00a4197780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:06.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.818+0000 7f00a27fc640 1 -- 172.21.15.16:0/1970836347 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0094009560 con 0x7f00a40fed40 2024-08-01T06:52:06.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.818+0000 7f00a27fc640 1 --2- 172.21.15.16:0/1970836347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a40fed40 0x7f00a4197cc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f009800e9a0 tx=0x7f009800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:06.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.819+0000 7f008bfff640 1 -- 172.21.15.16:0/1970836347 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f009800cc90 con 0x7f00a40fed40 2024-08-01T06:52:06.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.819+0000 7f00a966c640 1 -- 172.21.15.16:0/1970836347 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a419cea0 con 0x7f00a40fed40 2024-08-01T06:52:06.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.819+0000 7f008bfff640 1 -- 172.21.15.16:0/1970836347 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f009800cdf0 con 0x7f00a40fed40 2024-08-01T06:52:06.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.819+0000 7f008bfff640 1 -- 172.21.15.16:0/1970836347 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00980187f0 con 0x7f00a40fed40 2024-08-01T06:52:06.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.819+0000 7f00a966c640 1 -- 172.21.15.16:0/1970836347 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a419d440 con 0x7f00a40fed40 2024-08-01T06:52:06.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.820+0000 7f00a966c640 1 -- 172.21.15.16:0/1970836347 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a40fe800 con 0x7f00a40fed40 2024-08-01T06:52:06.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.820+0000 7f008bfff640 1 -- 172.21.15.16:0/1970836347 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0098010430 con 0x7f00a40fed40 2024-08-01T06:52:06.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.821+0000 7f008bfff640 1 --2- 172.21.15.16:0/1970836347 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f008c06cc50 0x7f008c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:06.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.821+0000 7f00a2ffd640 1 --2- 172.21.15.16:0/1970836347 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f008c06cc50 0x7f008c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:06.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.821+0000 7f008bfff640 1 -- 172.21.15.16:0/1970836347 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f0098014070 con 0x7f00a40fed40 2024-08-01T06:52:06.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.821+0000 7f00a2ffd640 1 --2- 172.21.15.16:0/1970836347 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f008c06cc50 0x7f008c06f110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0094000c00 tx=0x7f00940314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:06.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:06.825+0000 7f008bfff640 1 -- 172.21.15.16:0/1970836347 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f0098052de0 con 0x7f00a40fed40 2024-08-01T06:52:06.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:06 smithi016 ceph-mon[29266]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:07.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:07.063+0000 7f00a966c640 1 -- 172.21.15.16:0/1970836347 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f00a419d6c0 con 0x7f00a40fed40 2024-08-01T06:52:07.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:07.067+0000 7f008bfff640 1 -- 172.21.15.16:0/1970836347 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f009805a500 con 0x7f00a40fed40 2024-08-01T06:52:07.068 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2024-08-01T06:52:07.068 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCXMKtm7lnWAxAAGipl+9/yNIe4FsYsZBDGxQ== 2024-08-01T06:52:07.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:07.069+0000 7f00a966c640 1 -- 172.21.15.16:0/1970836347 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f008c06cc50 msgr2=0x7f008c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:07.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:07.069+0000 7f00a966c640 1 --2- 172.21.15.16:0/1970836347 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f008c06cc50 0x7f008c06f110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0094000c00 tx=0x7f00940314e0 comp rx=0 tx=0).stop 2024-08-01T06:52:07.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:07.069+0000 7f00a966c640 1 -- 172.21.15.16:0/1970836347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a40fed40 msgr2=0x7f00a4197cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:07.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:07.069+0000 7f00a966c640 1 --2- 172.21.15.16:0/1970836347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a40fed40 0x7f00a4197cc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f009800e9a0 tx=0x7f009800ee60 comp rx=0 tx=0).stop 2024-08-01T06:52:07.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:07.069+0000 7f00a966c640 1 -- 172.21.15.16:0/1970836347 shutdown_connections 2024-08-01T06:52:07.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:07.069+0000 7f00a966c640 1 --2- 172.21.15.16:0/1970836347 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f008c06cc50 0x7f008c06f110 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:07.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:07.069+0000 7f00a966c640 1 --2- 172.21.15.16:0/1970836347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a40fed40 0x7f00a4197cc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:07.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:07.069+0000 7f00a966c640 1 --2- 172.21.15.16:0/1970836347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00a40fe400 0x7f00a4197780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:07.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:07.069+0000 7f00a966c640 1 -- 172.21.15.16:0/1970836347 >> 172.21.15.16:0/1970836347 conn(0x7f00a40fa230 msgr2=0x7f00a4106a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:07.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:07.069+0000 7f00a966c640 1 -- 172.21.15.16:0/1970836347 shutdown_connections 2024-08-01T06:52:07.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:07.069+0000 7f00a966c640 1 -- 172.21.15.16:0/1970836347 wait complete. 2024-08-01T06:52:07.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:06 smithi089 ceph-mon[36617]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:07.622 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-08-01T06:52:07.623 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-08-01T06:52:07.623 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-01T06:52:07.664 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-01T06:52:07.688 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:07 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/1970836347' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-01T06:52:07.689 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:07 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/1970836347' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-01T06:52:07.874 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi089/config 2024-08-01T06:52:07.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:07 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/1970836347' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-01T06:52:07.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:07 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/1970836347' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-01T06:52:08.921 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:08 smithi089 ceph-mon[36617]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:09.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:08 smithi016 ceph-mon[29266]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:09.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.376+0000 7fccdf427640 1 -- 172.21.15.89:0/102745973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccd80fea70 msgr2=0x7fccd80fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:09.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.376+0000 7fccdf427640 1 --2- 172.21.15.89:0/102745973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccd80fea70 0x7fccd80fee70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009880 tx=0x7fccd402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:52:09.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.376+0000 7fccdf427640 1 -- 172.21.15.89:0/102745973 shutdown_connections 2024-08-01T06:52:09.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.376+0000 7fccdf427640 1 --2- 172.21.15.89:0/102745973 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fccd80ffc70 0x7fccd81000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:09.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.376+0000 7fccdf427640 1 --2- 172.21.15.89:0/102745973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccd80fea70 0x7fccd80fee70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:09.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.376+0000 7fccdf427640 1 -- 172.21.15.89:0/102745973 >> 172.21.15.89:0/102745973 conn(0x7fccd80fa200 msgr2=0x7fccd80fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:09.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.376+0000 7fccdf427640 1 -- 172.21.15.89:0/102745973 shutdown_connections 2024-08-01T06:52:09.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.376+0000 7fccdf427640 1 -- 172.21.15.89:0/102745973 wait complete. 2024-08-01T06:52:09.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.377+0000 7fccdf427640 1 Processor -- start 2024-08-01T06:52:09.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.377+0000 7fccdf427640 1 -- start start 2024-08-01T06:52:09.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.377+0000 7fccdf427640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fccd80fea70 0x7fccd8102a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:09.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.377+0000 7fccdf427640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccd80ffc70 0x7fccd8101050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:09.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.377+0000 7fccdf427640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd8101590 con 0x7fccd80fea70 2024-08-01T06:52:09.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.377+0000 7fccdf427640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd8101700 con 0x7fccd80ffc70 2024-08-01T06:52:09.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.377+0000 7fccdc9c2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccd80ffc70 0x7fccd8101050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:09.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.377+0000 7fccdc9c2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccd80ffc70 0x7fccd8101050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40062/0 (socket says 172.21.15.89:40062) 2024-08-01T06:52:09.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.377+0000 7fccdc9c2640 1 -- 172.21.15.89:0/547351874 learned_addr learned my addr 172.21.15.89:0/547351874 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-01T06:52:09.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.377+0000 7fccdd1c3640 1 --2- 172.21.15.89:0/547351874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fccd80fea70 0x7fccd8102a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:09.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.377+0000 7fccdc9c2640 1 -- 172.21.15.89:0/547351874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fccd80fea70 msgr2=0x7fccd8102a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:09.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.377+0000 7fccdc9c2640 1 --2- 172.21.15.89:0/547351874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fccd80fea70 0x7fccd8102a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:09.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.377+0000 7fccdc9c2640 1 -- 172.21.15.89:0/547351874 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd4009560 con 0x7fccd80ffc70 2024-08-01T06:52:09.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.378+0000 7fccdc9c2640 1 --2- 172.21.15.89:0/547351874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccd80ffc70 0x7fccd8101050 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fccc800d8d0 tx=0x7fccc800dd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:09.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.378+0000 7fccce7fc640 1 -- 172.21.15.89:0/547351874 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccc800bea0 con 0x7fccd80ffc70 2024-08-01T06:52:09.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.378+0000 7fccce7fc640 1 -- 172.21.15.89:0/547351874 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fccc8009c00 con 0x7fccd80ffc70 2024-08-01T06:52:09.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.378+0000 7fccdf427640 1 -- 172.21.15.89:0/547351874 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd81019e0 con 0x7fccd80ffc70 2024-08-01T06:52:09.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.378+0000 7fccce7fc640 1 -- 172.21.15.89:0/547351874 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccc800f710 con 0x7fccd80ffc70 2024-08-01T06:52:09.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.378+0000 7fccdf427640 1 -- 172.21.15.89:0/547351874 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd819d6a0 con 0x7fccd80ffc70 2024-08-01T06:52:09.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.379+0000 7fccdf427640 1 -- 172.21.15.89:0/547351874 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd80fee70 con 0x7fccd80ffc70 2024-08-01T06:52:09.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.379+0000 7fccce7fc640 1 -- 172.21.15.89:0/547351874 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fccc8010460 con 0x7fccd80ffc70 2024-08-01T06:52:09.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.380+0000 7fccce7fc640 1 --2- 172.21.15.89:0/547351874 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fccc406cc50 0x7fccc406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:09.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.380+0000 7fccce7fc640 1 -- 172.21.15.89:0/547351874 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fccc808bae0 con 0x7fccd80ffc70 2024-08-01T06:52:09.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.380+0000 7fccdd1c3640 1 --2- 172.21.15.89:0/547351874 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fccc406cc50 0x7fccc406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:09.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.381+0000 7fccdd1c3640 1 --2- 172.21.15.89:0/547351874 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fccc406cc50 0x7fccc406f110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009230 tx=0x7fccd40314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:09.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.384+0000 7fccce7fc640 1 -- 172.21.15.89:0/547351874 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fccc8056320 con 0x7fccd80ffc70 2024-08-01T06:52:09.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.609+0000 7fccdf427640 1 -- 172.21.15.89:0/547351874 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fccd819da10 con 0x7fccd80ffc70 2024-08-01T06:52:09.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.615+0000 7fccce7fc640 1 -- 172.21.15.89:0/547351874 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7fccc8059940 con 0x7fccd80ffc70 2024-08-01T06:52:09.616 INFO:teuthology.orchestra.run.smithi089.stdout:[client.1] 2024-08-01T06:52:09.616 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCZMKtmsSNtJBAAhJ1PTZb0MmnQwqrIKFXbtQ== 2024-08-01T06:52:09.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.617+0000 7fccdf427640 1 -- 172.21.15.89:0/547351874 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fccc406cc50 msgr2=0x7fccc406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:09.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.617+0000 7fccdf427640 1 --2- 172.21.15.89:0/547351874 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fccc406cc50 0x7fccc406f110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009230 tx=0x7fccd40314e0 comp rx=0 tx=0).stop 2024-08-01T06:52:09.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.617+0000 7fccdf427640 1 -- 172.21.15.89:0/547351874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccd80ffc70 msgr2=0x7fccd8101050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.617+0000 7fccdf427640 1 --2- 172.21.15.89:0/547351874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccd80ffc70 0x7fccd8101050 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fccc800d8d0 tx=0x7fccc800dd90 comp rx=0 tx=0).stop 2024-08-01T06:52:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.617+0000 7fccdf427640 1 -- 172.21.15.89:0/547351874 shutdown_connections 2024-08-01T06:52:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.617+0000 7fccdf427640 1 --2- 172.21.15.89:0/547351874 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fccc406cc50 0x7fccc406f110 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.617+0000 7fccdf427640 1 --2- 172.21.15.89:0/547351874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccd80ffc70 0x7fccd8101050 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.617+0000 7fccdf427640 1 --2- 172.21.15.89:0/547351874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fccd80fea70 0x7fccd8102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.617+0000 7fccdf427640 1 -- 172.21.15.89:0/547351874 >> 172.21.15.89:0/547351874 conn(0x7fccd80fa200 msgr2=0x7fccd8067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.617+0000 7fccdf427640 1 -- 172.21.15.89:0/547351874 shutdown_connections 2024-08-01T06:52:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:52:09.617+0000 7fccdf427640 1 -- 172.21.15.89:0/547351874 wait complete. 2024-08-01T06:52:09.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:09 smithi089 ceph-mon[36617]: from='client.? 172.21.15.89:0/547351874' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-01T06:52:09.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:09 smithi089 ceph-mon[36617]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-01T06:52:09.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:09 smithi089 ceph-mon[36617]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-01T06:52:10.081 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:09 smithi016 ceph-mon[29266]: from='client.? 172.21.15.89:0/547351874' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-01T06:52:10.081 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:09 smithi016 ceph-mon[29266]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-01T06:52:10.081 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:09 smithi016 ceph-mon[29266]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-01T06:52:10.208 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-01T06:52:10.209 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-08-01T06:52:10.209 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-01T06:52:10.288 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-01T06:52:10.288 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-01T06:52:10.288 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph mgr dump --format=json 2024-08-01T06:52:10.509 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:10.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:10 smithi016 ceph-mon[29266]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:11.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:10 smithi089 ceph-mon[36617]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:12.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.097+0000 7fe39fbe0640 1 -- 172.21.15.16:0/3623414469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe398100c60 msgr2=0x7fe398101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:12.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.097+0000 7fe39fbe0640 1 --2- 172.21.15.16:0/3623414469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe398100c60 0x7fe398101040 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe3940098b0 tx=0x7fe39402a4d0 comp rx=0 tx=0).stop 2024-08-01T06:52:12.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.097+0000 7fe39fbe0640 1 -- 172.21.15.16:0/3623414469 shutdown_connections 2024-08-01T06:52:12.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.097+0000 7fe39fbe0640 1 --2- 172.21.15.16:0/3623414469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe398101610 0x7fe398109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:12.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.097+0000 7fe39fbe0640 1 --2- 172.21.15.16:0/3623414469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe398100c60 0x7fe398101040 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:12.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.097+0000 7fe39fbe0640 1 -- 172.21.15.16:0/3623414469 >> 172.21.15.16:0/3623414469 conn(0x7fe3980fa730 msgr2=0x7fe3980fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:12.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.097+0000 7fe39fbe0640 1 -- 172.21.15.16:0/3623414469 shutdown_connections 2024-08-01T06:52:12.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.097+0000 7fe39fbe0640 1 -- 172.21.15.16:0/3623414469 wait complete. 2024-08-01T06:52:12.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.098+0000 7fe39fbe0640 1 Processor -- start 2024-08-01T06:52:12.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.098+0000 7fe39fbe0640 1 -- start start 2024-08-01T06:52:12.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.098+0000 7fe39fbe0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe398100c60 0x7fe39819b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:12.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.098+0000 7fe39fbe0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe398101610 0x7fe39819be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:12.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.098+0000 7fe39fbe0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39819c4a0 con 0x7fe398101610 2024-08-01T06:52:12.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.098+0000 7fe39fbe0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe398195a30 con 0x7fe398100c60 2024-08-01T06:52:12.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.098+0000 7fe39d17b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe398101610 0x7fe39819be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:12.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.098+0000 7fe39d17b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe398101610 0x7fe39819be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55796/0 (socket says 172.21.15.16:55796) 2024-08-01T06:52:12.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.098+0000 7fe39d17b640 1 -- 172.21.15.16:0/2063324634 learned_addr learned my addr 172.21.15.16:0/2063324634 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:12.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.098+0000 7fe39d17b640 1 -- 172.21.15.16:0/2063324634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe398100c60 msgr2=0x7fe39819b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:12.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.098+0000 7fe39d97c640 1 --2- 172.21.15.16:0/2063324634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe398100c60 0x7fe39819b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:12.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.098+0000 7fe39d17b640 1 --2- 172.21.15.16:0/2063324634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe398100c60 0x7fe39819b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:12.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.099+0000 7fe39d17b640 1 -- 172.21.15.16:0/2063324634 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe394009560 con 0x7fe398101610 2024-08-01T06:52:12.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.099+0000 7fe39d17b640 1 --2- 172.21.15.16:0/2063324634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe398101610 0x7fe39819be80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe38800b420 tx=0x7fe38800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:12.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.099+0000 7fe38effd640 1 -- 172.21.15.16:0/2063324634 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe388011800 con 0x7fe398101610 2024-08-01T06:52:12.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.099+0000 7fe38effd640 1 -- 172.21.15.16:0/2063324634 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe388011e20 con 0x7fe398101610 2024-08-01T06:52:12.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.099+0000 7fe39fbe0640 1 -- 172.21.15.16:0/2063324634 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe398195d10 con 0x7fe398101610 2024-08-01T06:52:12.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.099+0000 7fe38effd640 1 -- 172.21.15.16:0/2063324634 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe38800f2e0 con 0x7fe398101610 2024-08-01T06:52:12.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.099+0000 7fe39fbe0640 1 -- 172.21.15.16:0/2063324634 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe398196260 con 0x7fe398101610 2024-08-01T06:52:12.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.100+0000 7fe39fbe0640 1 -- 172.21.15.16:0/2063324634 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe398068d30 con 0x7fe398101610 2024-08-01T06:52:12.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.100+0000 7fe38effd640 1 -- 172.21.15.16:0/2063324634 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe388010380 con 0x7fe398101610 2024-08-01T06:52:12.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.101+0000 7fe38effd640 1 --2- 172.21.15.16:0/2063324634 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fe38406cc50 0x7fe38406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:12.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.101+0000 7fe38effd640 1 -- 172.21.15.16:0/2063324634 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe38808b7e0 con 0x7fe398101610 2024-08-01T06:52:12.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.101+0000 7fe39d97c640 1 --2- 172.21.15.16:0/2063324634 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fe38406cc50 0x7fe38406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:12.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.102+0000 7fe39d97c640 1 --2- 172.21.15.16:0/2063324634 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fe38406cc50 0x7fe38406f110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe394000c00 tx=0x7fe394004120 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:12.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.105+0000 7fe38effd640 1 -- 172.21.15.16:0/2063324634 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fe388055f70 con 0x7fe398101610 2024-08-01T06:52:12.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.322+0000 7fe39fbe0640 1 -- 172.21.15.16:0/2063324634 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe3981010c0 con 0x7fe398101610 2024-08-01T06:52:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.326+0000 7fe38effd640 1 -- 172.21.15.16:0/2063324634 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+174012 (secure 0 0 0) 0x7fe388059590 con 0x7fe398101610 2024-08-01T06:52:12.331 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:52:12.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.328+0000 7fe39fbe0640 1 -- 172.21.15.16:0/2063324634 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fe38406cc50 msgr2=0x7fe38406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:12.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.328+0000 7fe39fbe0640 1 --2- 172.21.15.16:0/2063324634 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fe38406cc50 0x7fe38406f110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe394000c00 tx=0x7fe394004120 comp rx=0 tx=0).stop 2024-08-01T06:52:12.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.328+0000 7fe39fbe0640 1 -- 172.21.15.16:0/2063324634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe398101610 msgr2=0x7fe39819be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:12.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.328+0000 7fe39fbe0640 1 --2- 172.21.15.16:0/2063324634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe398101610 0x7fe39819be80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe38800b420 tx=0x7fe38800b8e0 comp rx=0 tx=0).stop 2024-08-01T06:52:12.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.328+0000 7fe39fbe0640 1 -- 172.21.15.16:0/2063324634 shutdown_connections 2024-08-01T06:52:12.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.328+0000 7fe39fbe0640 1 --2- 172.21.15.16:0/2063324634 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fe38406cc50 0x7fe38406f110 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:12.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.328+0000 7fe39fbe0640 1 --2- 172.21.15.16:0/2063324634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe398101610 0x7fe39819be80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:12.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.328+0000 7fe39fbe0640 1 --2- 172.21.15.16:0/2063324634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe398100c60 0x7fe39819b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:12.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.328+0000 7fe39fbe0640 1 -- 172.21.15.16:0/2063324634 >> 172.21.15.16:0/2063324634 conn(0x7fe3980fa730 msgr2=0x7fe398101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:12.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.329+0000 7fe39fbe0640 1 -- 172.21.15.16:0/2063324634 shutdown_connections 2024-08-01T06:52:12.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:12.329+0000 7fe39fbe0640 1 -- 172.21.15.16:0/2063324634 wait complete. 2024-08-01T06:52:12.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:12 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/2063324634' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-01T06:52:12.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:12 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/2063324634' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-01T06:52:13.048 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":19,"flags":0,"active_gid":14213,"active_name":"smithi016.whigbo","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1423663197},{"type":"v1","addr":"172.21.15.16:6801","nonce":1423663197}]},"active_addr":"172.21.15.16:6801/1423663197","active_change":"2024-08-01T06:48:32.522984+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14234,"name":"smithi089.hfgnsr","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.16:8443/","prometheus":"http://172.21.15.16:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":876907707}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":1946935911}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":1537399575}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":2891102165}]}]} 2024-08-01T06:52:13.056 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-01T06:52:13.056 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-01T06:52:13.056 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph osd dump --format=json 2024-08-01T06:52:13.276 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:13.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:13 smithi089 ceph-mon[36617]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:13.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:13 smithi016 ceph-mon[29266]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:14.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.821+0000 7f3e6676c640 1 -- 172.21.15.16:0/1693328142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e600fec40 msgr2=0x7f3e60104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:14.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.821+0000 7f3e6676c640 1 --2- 172.21.15.16:0/1693328142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e600fec40 0x7f3e60104780 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009880 tx=0x7f3e4802a4a0 comp rx=0 tx=0).stop 2024-08-01T06:52:14.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.821+0000 7f3e6676c640 1 -- 172.21.15.16:0/1693328142 shutdown_connections 2024-08-01T06:52:14.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.821+0000 7f3e6676c640 1 --2- 172.21.15.16:0/1693328142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e600fec40 0x7f3e60104780 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:14.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.821+0000 7f3e6676c640 1 --2- 172.21.15.16:0/1693328142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e600fe290 0x7f3e600fe670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:14.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.821+0000 7f3e6676c640 1 -- 172.21.15.16:0/1693328142 >> 172.21.15.16:0/1693328142 conn(0x7f3e600f9ec0 msgr2=0x7f3e600fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:14.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.821+0000 7f3e6676c640 1 -- 172.21.15.16:0/1693328142 shutdown_connections 2024-08-01T06:52:14.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.821+0000 7f3e6676c640 1 -- 172.21.15.16:0/1693328142 wait complete. 2024-08-01T06:52:14.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.822+0000 7f3e6676c640 1 Processor -- start 2024-08-01T06:52:14.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.822+0000 7f3e6676c640 1 -- start start 2024-08-01T06:52:14.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.822+0000 7f3e6676c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e600fe290 0x7f3e600ff210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:14.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.822+0000 7f3e6676c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e600fec40 0x7f3e600ff750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:14.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.822+0000 7f3e6676c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e600ffc90 con 0x7f3e600fe290 2024-08-01T06:52:14.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.822+0000 7f3e6676c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e600ffe00 con 0x7f3e600fec40 2024-08-01T06:52:14.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.822+0000 7f3e5ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e600fe290 0x7f3e600ff210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:14.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.822+0000 7f3e5ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e600fe290 0x7f3e600ff210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55820/0 (socket says 172.21.15.16:55820) 2024-08-01T06:52:14.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.822+0000 7f3e5ffff640 1 -- 172.21.15.16:0/3783380330 learned_addr learned my addr 172.21.15.16:0/3783380330 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:14.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.822+0000 7f3e5ffff640 1 -- 172.21.15.16:0/3783380330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e600fec40 msgr2=0x7f3e600ff750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:14.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.822+0000 7f3e5ffff640 1 --2- 172.21.15.16:0/3783380330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e600fec40 0x7f3e600ff750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:14.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.822+0000 7f3e5ffff640 1 -- 172.21.15.16:0/3783380330 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e48009560 con 0x7f3e600fe290 2024-08-01T06:52:14.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.823+0000 7f3e5ffff640 1 --2- 172.21.15.16:0/3783380330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e600fe290 0x7f3e600ff210 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000c8f0 tx=0x7f3e5000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:14.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.823+0000 7f3e5dffb640 1 -- 172.21.15.16:0/3783380330 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e50007b80 con 0x7f3e600fe290 2024-08-01T06:52:14.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.823+0000 7f3e6676c640 1 -- 172.21.15.16:0/3783380330 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e601a1cb0 con 0x7f3e600fe290 2024-08-01T06:52:14.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.823+0000 7f3e5dffb640 1 -- 172.21.15.16:0/3783380330 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3e500054e0 con 0x7f3e600fe290 2024-08-01T06:52:14.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.823+0000 7f3e5dffb640 1 -- 172.21.15.16:0/3783380330 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e5000f450 con 0x7f3e600fe290 2024-08-01T06:52:14.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.823+0000 7f3e6676c640 1 -- 172.21.15.16:0/3783380330 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e601a2010 con 0x7f3e600fe290 2024-08-01T06:52:14.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.824+0000 7f3e6676c640 1 -- 172.21.15.16:0/3783380330 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e60101350 con 0x7f3e600fe290 2024-08-01T06:52:14.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.824+0000 7f3e5dffb640 1 -- 172.21.15.16:0/3783380330 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3e50004f60 con 0x7f3e600fe290 2024-08-01T06:52:14.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.825+0000 7f3e5dffb640 1 --2- 172.21.15.16:0/3783380330 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f3e4c06cc50 0x7f3e4c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:14.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.825+0000 7f3e5dffb640 1 -- 172.21.15.16:0/3783380330 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f3e5008bd70 con 0x7f3e600fe290 2024-08-01T06:52:14.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.825+0000 7f3e57fff640 1 --2- 172.21.15.16:0/3783380330 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f3e4c06cc50 0x7f3e4c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:14.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.825+0000 7f3e57fff640 1 --2- 172.21.15.16:0/3783380330 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f3e4c06cc50 0x7f3e4c06f110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3e60100990 tx=0x7f3e48000bc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:14.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:14.829+0000 7f3e5dffb640 1 -- 172.21.15.16:0/3783380330 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f3e50056480 con 0x7f3e600fe290 2024-08-01T06:52:14.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:14 smithi016 ceph-mon[29266]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:15.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:15.000+0000 7f3e6676c640 1 -- 172.21.15.16:0/3783380330 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e600fffc0 con 0x7f3e600fe290 2024-08-01T06:52:15.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:15.001+0000 7f3e5dffb640 1 -- 172.21.15.16:0/3783380330 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11300 (secure 0 0 0) 0x7f3e600fffc0 con 0x7f3e600fe290 2024-08-01T06:52:15.003 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:52:15.003 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":40,"fsid":"a88427da-4fd1-11ef-bcca-c7b262605968","created":"2024-08-01T06:46:34.093437+0000","modified":"2024-08-01T06:51:58.660378+0000","last_up_change":"2024-08-01T06:51:57.474883+0000","last_in_change":"2024-08-01T06:51:37.752663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-01T06:50:45.021550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f51cb32b-c276-4b4b-9085-351c6536cda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1985422750},{"type":"v1","addr":"172.21.15.16:6803","nonce":1985422750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1985422750},{"type":"v1","addr":"172.21.15.16:6805","nonce":1985422750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1985422750},{"type":"v1","addr":"172.21.15.16:6809","nonce":1985422750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1985422750},{"type":"v1","addr":"172.21.15.16:6807","nonce":1985422750}]},"public_addr":"172.21.15.16:6803/1985422750","cluster_addr":"172.21.15.16:6805/1985422750","heartbeat_back_addr":"172.21.15.16:6809/1985422750","heartbeat_front_addr":"172.21.15.16:6807/1985422750","state":["exists","up"]},{"osd":1,"uuid":"2670e18d-6fbf-460d-86c0-5b897c25d542","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3206893924},{"type":"v1","addr":"172.21.15.16:6811","nonce":3206893924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3206893924},{"type":"v1","addr":"172.21.15.16:6813","nonce":3206893924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3206893924},{"type":"v1","addr":"172.21.15.16:6817","nonce":3206893924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3206893924},{"type":"v1","addr":"172.21.15.16:6815","nonce":3206893924}]},"public_addr":"172.21.15.16:6811/3206893924","cluster_addr":"172.21.15.16:6813/3206893924","heartbeat_back_addr":"172.21.15.16:6817/3206893924","heartbeat_front_addr":"172.21.15.16:6815/3206893924","state":["exists","up"]},{"osd":2,"uuid":"94f66ce0-ee7b-4d29-8a65-5ee7464270db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2241613812},{"type":"v1","addr":"172.21.15.16:6819","nonce":2241613812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2241613812},{"type":"v1","addr":"172.21.15.16:6821","nonce":2241613812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2241613812},{"type":"v1","addr":"172.21.15.16:6825","nonce":2241613812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2241613812},{"type":"v1","addr":"172.21.15.16:6823","nonce":2241613812}]},"public_addr":"172.21.15.16:6819/2241613812","cluster_addr":"172.21.15.16:6821/2241613812","heartbeat_back_addr":"172.21.15.16:6825/2241613812","heartbeat_front_addr":"172.21.15.16:6823/2241613812","state":["exists","up"]},{"osd":3,"uuid":"3c0e7296-4283-441a-b445-9a57aa8617de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2212217098},{"type":"v1","addr":"172.21.15.89:6801","nonce":2212217098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2212217098},{"type":"v1","addr":"172.21.15.89:6803","nonce":2212217098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2212217098},{"type":"v1","addr":"172.21.15.89:6807","nonce":2212217098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2212217098},{"type":"v1","addr":"172.21.15.89:6805","nonce":2212217098}]},"public_addr":"172.21.15.89:6801/2212217098","cluster_addr":"172.21.15.89:6803/2212217098","heartbeat_back_addr":"172.21.15.89:6807/2212217098","heartbeat_front_addr":"172.21.15.89:6805/2212217098","state":["exists","up"]},{"osd":4,"uuid":"8db8b0e3-4ecb-45c1-8e3e-c73c48996459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":900847704},{"type":"v1","addr":"172.21.15.89:6809","nonce":900847704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":900847704},{"type":"v1","addr":"172.21.15.89:6811","nonce":900847704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":900847704},{"type":"v1","addr":"172.21.15.89:6815","nonce":900847704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":900847704},{"type":"v1","addr":"172.21.15.89:6813","nonce":900847704}]},"public_addr":"172.21.15.89:6809/900847704","cluster_addr":"172.21.15.89:6811/900847704","heartbeat_back_addr":"172.21.15.89:6815/900847704","heartbeat_front_addr":"172.21.15.89:6813/900847704","state":["exists","up"]},{"osd":5,"uuid":"18045ff7-9343-4eec-97c0-e2ed091a868d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2072119759},{"type":"v1","addr":"172.21.15.89:6817","nonce":2072119759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":2072119759},{"type":"v1","addr":"172.21.15.89:6819","nonce":2072119759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":2072119759},{"type":"v1","addr":"172.21.15.89:6823","nonce":2072119759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":2072119759},{"type":"v1","addr":"172.21.15.89:6821","nonce":2072119759}]},"public_addr":"172.21.15.89:6817/2072119759","cluster_addr":"172.21.15.89:6819/2072119759","heartbeat_back_addr":"172.21.15.89:6823/2072119759","heartbeat_front_addr":"172.21.15.89:6821/2072119759","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-01T06:49:48.180562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-01T06:50:15.128817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-01T06:50:41.882357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-01T06:51:04.660626+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-01T06:51:29.277470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-01T06:51:54.755292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/247151947":"2024-08-02T06:47:27.347897+0000","172.21.15.16:6800/3674863410":"2024-08-02T06:46:56.352049+0000","172.21.15.16:6800/3100338993":"2024-08-02T06:48:32.522874+0000","172.21.15.16:0/3966853485":"2024-08-02T06:48:32.522874+0000","172.21.15.16:6801/3674863410":"2024-08-02T06:46:56.352049+0000","172.21.15.16:0/2356611709":"2024-08-02T06:46:56.352049+0000","172.21.15.16:0/1836104042":"2024-08-02T06:48:32.522874+0000","172.21.15.16:0/2947838469":"2024-08-02T06:48:32.522874+0000","172.21.15.16:0/3369355765":"2024-08-02T06:46:56.352049+0000","172.21.15.16:0/2604937406":"2024-08-02T06:46:56.352049+0000","172.21.15.16:0/2595787010":"2024-08-02T06:47:27.347897+0000","172.21.15.16:0/320178436":"2024-08-02T06:47:27.347897+0000","172.21.15.16:0/2028838931":"2024-08-02T06:47:27.347897+0000","172.21.15.16:6800/247151947":"2024-08-02T06:47:27.347897+0000","172.21.15.16:6801/3100338993":"2024-08-02T06:48:32.522874+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-01T06:52:15.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:15.003+0000 7f3e6676c640 1 -- 172.21.15.16:0/3783380330 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f3e4c06cc50 msgr2=0x7f3e4c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:15.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:15.003+0000 7f3e6676c640 1 --2- 172.21.15.16:0/3783380330 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f3e4c06cc50 0x7f3e4c06f110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3e60100990 tx=0x7f3e48000bc0 comp rx=0 tx=0).stop 2024-08-01T06:52:15.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:15.003+0000 7f3e6676c640 1 -- 172.21.15.16:0/3783380330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e600fe290 msgr2=0x7f3e600ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:15.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:15.003+0000 7f3e6676c640 1 --2- 172.21.15.16:0/3783380330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e600fe290 0x7f3e600ff210 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000c8f0 tx=0x7f3e5000cdb0 comp rx=0 tx=0).stop 2024-08-01T06:52:15.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:15.003+0000 7f3e6676c640 1 -- 172.21.15.16:0/3783380330 shutdown_connections 2024-08-01T06:52:15.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:15.003+0000 7f3e6676c640 1 --2- 172.21.15.16:0/3783380330 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f3e4c06cc50 0x7f3e4c06f110 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:15.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:15.003+0000 7f3e6676c640 1 --2- 172.21.15.16:0/3783380330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e600fec40 0x7f3e600ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:15.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:15.003+0000 7f3e6676c640 1 --2- 172.21.15.16:0/3783380330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e600fe290 0x7f3e600ff210 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:15.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:15.003+0000 7f3e6676c640 1 -- 172.21.15.16:0/3783380330 >> 172.21.15.16:0/3783380330 conn(0x7f3e600f9ec0 msgr2=0x7f3e600fb130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:15.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:15.003+0000 7f3e6676c640 1 -- 172.21.15.16:0/3783380330 shutdown_connections 2024-08-01T06:52:15.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:15.003+0000 7f3e6676c640 1 -- 172.21.15.16:0/3783380330 wait complete. 2024-08-01T06:52:15.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:14 smithi089 ceph-mon[36617]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:15.643 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-01T06:52:15.644 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph osd dump --format=json 2024-08-01T06:52:15.856 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:15.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:15 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3783380330' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-01T06:52:16.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:15 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/3783380330' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-01T06:52:16.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:16 smithi016 ceph-mon[29266]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:17.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:16 smithi089 ceph-mon[36617]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:17.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.435+0000 7f7b25ef1640 1 -- 172.21.15.16:0/2966066121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100750 msgr2=0x7f7b201047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:17.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.435+0000 7f7b25ef1640 1 --2- 172.21.15.16:0/2966066121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100750 0x7f7b201047a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009880 tx=0x7f7b1402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:52:17.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.435+0000 7f7b25ef1640 1 -- 172.21.15.16:0/2966066121 shutdown_connections 2024-08-01T06:52:17.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.435+0000 7f7b25ef1640 1 --2- 172.21.15.16:0/2966066121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100750 0x7f7b201047a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:17.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.435+0000 7f7b25ef1640 1 --2- 172.21.15.16:0/2966066121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b200ffda0 0x7f7b20100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:17.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.435+0000 7f7b25ef1640 1 -- 172.21.15.16:0/2966066121 >> 172.21.15.16:0/2966066121 conn(0x7f7b200fb840 msgr2=0x7f7b200fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:17.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.435+0000 7f7b25ef1640 1 -- 172.21.15.16:0/2966066121 shutdown_connections 2024-08-01T06:52:17.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.435+0000 7f7b25ef1640 1 -- 172.21.15.16:0/2966066121 wait complete. 2024-08-01T06:52:17.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.436+0000 7f7b25ef1640 1 Processor -- start 2024-08-01T06:52:17.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.436+0000 7f7b25ef1640 1 -- start start 2024-08-01T06:52:17.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.436+0000 7f7b25ef1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b200ffda0 0x7f7b200727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:17.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.436+0000 7f7b25ef1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100750 0x7f7b20072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:17.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.436+0000 7f7b25ef1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b20073230 con 0x7f7b20100750 2024-08-01T06:52:17.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.436+0000 7f7b25ef1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b200733a0 con 0x7f7b200ffda0 2024-08-01T06:52:17.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.437+0000 7f7b1effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100750 0x7f7b20072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:17.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.437+0000 7f7b1effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100750 0x7f7b20072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55850/0 (socket says 172.21.15.16:55850) 2024-08-01T06:52:17.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.437+0000 7f7b1effd640 1 -- 172.21.15.16:0/1499628354 learned_addr learned my addr 172.21.15.16:0/1499628354 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:17.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.437+0000 7f7b1f7fe640 1 --2- 172.21.15.16:0/1499628354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b200ffda0 0x7f7b200727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:17.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.437+0000 7f7b1effd640 1 -- 172.21.15.16:0/1499628354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b200ffda0 msgr2=0x7f7b200727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:17.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.437+0000 7f7b1effd640 1 --2- 172.21.15.16:0/1499628354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b200ffda0 0x7f7b200727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:17.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.437+0000 7f7b1effd640 1 -- 172.21.15.16:0/1499628354 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b14009560 con 0x7f7b20100750 2024-08-01T06:52:17.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.437+0000 7f7b1effd640 1 --2- 172.21.15.16:0/1499628354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100750 0x7f7b20072cf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7b1402a9c0 tx=0x7f7b140055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:17.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.437+0000 7f7b1cff9640 1 -- 172.21.15.16:0/1499628354 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b14004aa0 con 0x7f7b20100750 2024-08-01T06:52:17.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.437+0000 7f7b1cff9640 1 -- 172.21.15.16:0/1499628354 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b14004c00 con 0x7f7b20100750 2024-08-01T06:52:17.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.437+0000 7f7b25ef1640 1 -- 172.21.15.16:0/1499628354 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b20073620 con 0x7f7b20100750 2024-08-01T06:52:17.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.437+0000 7f7b1cff9640 1 -- 172.21.15.16:0/1499628354 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b14003ab0 con 0x7f7b20100750 2024-08-01T06:52:17.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.437+0000 7f7b25ef1640 1 -- 172.21.15.16:0/1499628354 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b201a2010 con 0x7f7b20100750 2024-08-01T06:52:17.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.438+0000 7f7b25ef1640 1 -- 172.21.15.16:0/1499628354 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b20101280 con 0x7f7b20100750 2024-08-01T06:52:17.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.439+0000 7f7b1cff9640 1 -- 172.21.15.16:0/1499628354 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7b14003ce0 con 0x7f7b20100750 2024-08-01T06:52:17.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.439+0000 7f7b1cff9640 1 --2- 172.21.15.16:0/1499628354 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f7b0806cc50 0x7f7b0806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:17.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.439+0000 7f7b1cff9640 1 -- 172.21.15.16:0/1499628354 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f7b140ace90 con 0x7f7b20100750 2024-08-01T06:52:17.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.439+0000 7f7b1f7fe640 1 --2- 172.21.15.16:0/1499628354 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f7b0806cc50 0x7f7b0806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:17.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.440+0000 7f7b1f7fe640 1 --2- 172.21.15.16:0/1499628354 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f7b0806cc50 0x7f7b0806f110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009890 tx=0x7f7b10008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:17.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.444+0000 7f7b1cff9640 1 -- 172.21.15.16:0/1499628354 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f7b140775a0 con 0x7f7b20100750 2024-08-01T06:52:17.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.615+0000 7f7b25ef1640 1 -- 172.21.15.16:0/1499628354 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b20073620 con 0x7f7b20100750 2024-08-01T06:52:17.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.616+0000 7f7b1cff9640 1 -- 172.21.15.16:0/1499628354 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11300 (secure 0 0 0) 0x7f7b20073620 con 0x7f7b20100750 2024-08-01T06:52:17.619 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:52:17.619 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":40,"fsid":"a88427da-4fd1-11ef-bcca-c7b262605968","created":"2024-08-01T06:46:34.093437+0000","modified":"2024-08-01T06:51:58.660378+0000","last_up_change":"2024-08-01T06:51:57.474883+0000","last_in_change":"2024-08-01T06:51:37.752663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-01T06:50:45.021550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f51cb32b-c276-4b4b-9085-351c6536cda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1985422750},{"type":"v1","addr":"172.21.15.16:6803","nonce":1985422750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1985422750},{"type":"v1","addr":"172.21.15.16:6805","nonce":1985422750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":1985422750},{"type":"v1","addr":"172.21.15.16:6809","nonce":1985422750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1985422750},{"type":"v1","addr":"172.21.15.16:6807","nonce":1985422750}]},"public_addr":"172.21.15.16:6803/1985422750","cluster_addr":"172.21.15.16:6805/1985422750","heartbeat_back_addr":"172.21.15.16:6809/1985422750","heartbeat_front_addr":"172.21.15.16:6807/1985422750","state":["exists","up"]},{"osd":1,"uuid":"2670e18d-6fbf-460d-86c0-5b897c25d542","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3206893924},{"type":"v1","addr":"172.21.15.16:6811","nonce":3206893924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3206893924},{"type":"v1","addr":"172.21.15.16:6813","nonce":3206893924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3206893924},{"type":"v1","addr":"172.21.15.16:6817","nonce":3206893924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3206893924},{"type":"v1","addr":"172.21.15.16:6815","nonce":3206893924}]},"public_addr":"172.21.15.16:6811/3206893924","cluster_addr":"172.21.15.16:6813/3206893924","heartbeat_back_addr":"172.21.15.16:6817/3206893924","heartbeat_front_addr":"172.21.15.16:6815/3206893924","state":["exists","up"]},{"osd":2,"uuid":"94f66ce0-ee7b-4d29-8a65-5ee7464270db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2241613812},{"type":"v1","addr":"172.21.15.16:6819","nonce":2241613812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2241613812},{"type":"v1","addr":"172.21.15.16:6821","nonce":2241613812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2241613812},{"type":"v1","addr":"172.21.15.16:6825","nonce":2241613812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2241613812},{"type":"v1","addr":"172.21.15.16:6823","nonce":2241613812}]},"public_addr":"172.21.15.16:6819/2241613812","cluster_addr":"172.21.15.16:6821/2241613812","heartbeat_back_addr":"172.21.15.16:6825/2241613812","heartbeat_front_addr":"172.21.15.16:6823/2241613812","state":["exists","up"]},{"osd":3,"uuid":"3c0e7296-4283-441a-b445-9a57aa8617de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2212217098},{"type":"v1","addr":"172.21.15.89:6801","nonce":2212217098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2212217098},{"type":"v1","addr":"172.21.15.89:6803","nonce":2212217098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2212217098},{"type":"v1","addr":"172.21.15.89:6807","nonce":2212217098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2212217098},{"type":"v1","addr":"172.21.15.89:6805","nonce":2212217098}]},"public_addr":"172.21.15.89:6801/2212217098","cluster_addr":"172.21.15.89:6803/2212217098","heartbeat_back_addr":"172.21.15.89:6807/2212217098","heartbeat_front_addr":"172.21.15.89:6805/2212217098","state":["exists","up"]},{"osd":4,"uuid":"8db8b0e3-4ecb-45c1-8e3e-c73c48996459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":900847704},{"type":"v1","addr":"172.21.15.89:6809","nonce":900847704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":900847704},{"type":"v1","addr":"172.21.15.89:6811","nonce":900847704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":900847704},{"type":"v1","addr":"172.21.15.89:6815","nonce":900847704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":900847704},{"type":"v1","addr":"172.21.15.89:6813","nonce":900847704}]},"public_addr":"172.21.15.89:6809/900847704","cluster_addr":"172.21.15.89:6811/900847704","heartbeat_back_addr":"172.21.15.89:6815/900847704","heartbeat_front_addr":"172.21.15.89:6813/900847704","state":["exists","up"]},{"osd":5,"uuid":"18045ff7-9343-4eec-97c0-e2ed091a868d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2072119759},{"type":"v1","addr":"172.21.15.89:6817","nonce":2072119759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":2072119759},{"type":"v1","addr":"172.21.15.89:6819","nonce":2072119759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":2072119759},{"type":"v1","addr":"172.21.15.89:6823","nonce":2072119759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":2072119759},{"type":"v1","addr":"172.21.15.89:6821","nonce":2072119759}]},"public_addr":"172.21.15.89:6817/2072119759","cluster_addr":"172.21.15.89:6819/2072119759","heartbeat_back_addr":"172.21.15.89:6823/2072119759","heartbeat_front_addr":"172.21.15.89:6821/2072119759","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-01T06:49:48.180562+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-01T06:50:15.128817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-01T06:50:41.882357+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-01T06:51:04.660626+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-01T06:51:29.277470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-01T06:51:54.755292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6801/247151947":"2024-08-02T06:47:27.347897+0000","172.21.15.16:6800/3674863410":"2024-08-02T06:46:56.352049+0000","172.21.15.16:6800/3100338993":"2024-08-02T06:48:32.522874+0000","172.21.15.16:0/3966853485":"2024-08-02T06:48:32.522874+0000","172.21.15.16:6801/3674863410":"2024-08-02T06:46:56.352049+0000","172.21.15.16:0/2356611709":"2024-08-02T06:46:56.352049+0000","172.21.15.16:0/1836104042":"2024-08-02T06:48:32.522874+0000","172.21.15.16:0/2947838469":"2024-08-02T06:48:32.522874+0000","172.21.15.16:0/3369355765":"2024-08-02T06:46:56.352049+0000","172.21.15.16:0/2604937406":"2024-08-02T06:46:56.352049+0000","172.21.15.16:0/2595787010":"2024-08-02T06:47:27.347897+0000","172.21.15.16:0/320178436":"2024-08-02T06:47:27.347897+0000","172.21.15.16:0/2028838931":"2024-08-02T06:47:27.347897+0000","172.21.15.16:6800/247151947":"2024-08-02T06:47:27.347897+0000","172.21.15.16:6801/3100338993":"2024-08-02T06:48:32.522874+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-01T06:52:17.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.619+0000 7f7b25ef1640 1 -- 172.21.15.16:0/1499628354 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f7b0806cc50 msgr2=0x7f7b0806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:17.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.619+0000 7f7b25ef1640 1 --2- 172.21.15.16:0/1499628354 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f7b0806cc50 0x7f7b0806f110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009890 tx=0x7f7b10008040 comp rx=0 tx=0).stop 2024-08-01T06:52:17.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.619+0000 7f7b25ef1640 1 -- 172.21.15.16:0/1499628354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100750 msgr2=0x7f7b20072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:17.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.619+0000 7f7b25ef1640 1 --2- 172.21.15.16:0/1499628354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100750 0x7f7b20072cf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7b1402a9c0 tx=0x7f7b140055a0 comp rx=0 tx=0).stop 2024-08-01T06:52:17.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.620+0000 7f7b25ef1640 1 -- 172.21.15.16:0/1499628354 shutdown_connections 2024-08-01T06:52:17.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.620+0000 7f7b25ef1640 1 --2- 172.21.15.16:0/1499628354 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f7b0806cc50 0x7f7b0806f110 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:17.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.620+0000 7f7b25ef1640 1 --2- 172.21.15.16:0/1499628354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100750 0x7f7b20072cf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:17.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.620+0000 7f7b25ef1640 1 --2- 172.21.15.16:0/1499628354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b200ffda0 0x7f7b200727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:17.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.620+0000 7f7b25ef1640 1 -- 172.21.15.16:0/1499628354 >> 172.21.15.16:0/1499628354 conn(0x7f7b200fb840 msgr2=0x7f7b200fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:17.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.620+0000 7f7b25ef1640 1 -- 172.21.15.16:0/1499628354 shutdown_connections 2024-08-01T06:52:17.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:17.620+0000 7f7b25ef1640 1 -- 172.21.15.16:0/1499628354 wait complete. 2024-08-01T06:52:17.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:17 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:52:17.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:17 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/1499628354' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-01T06:52:18.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:17 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:52:18.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:17 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/1499628354' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-01T06:52:18.287 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-01T06:52:18.288 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-01T06:52:18.288 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-01T06:52:18.289 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-08-01T06:52:18.289 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-08-01T06:52:18.289 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-08-01T06:52:18.562 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:18.571 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:18.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:18 smithi089 ceph-mon[36617]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:18.922 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:18 smithi016 ceph-mon[29266]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:20.544 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:20.544 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:20.547 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:20.548 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:20.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:20 smithi016 ceph-mon[29266]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:21.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:20 smithi089 ceph-mon[36617]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:22.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.804+0000 7f70d83df640 1 -- 172.21.15.16:0/2421477747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70d0100750 msgr2=0x7f70d01047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:22.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.804+0000 7f70d83df640 1 --2- 172.21.15.16:0/2421477747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70d0100750 0x7f70d01047a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009880 tx=0x7f70c002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:52:22.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.804+0000 7f70d83df640 1 -- 172.21.15.16:0/2421477747 shutdown_connections 2024-08-01T06:52:22.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.804+0000 7f70d83df640 1 --2- 172.21.15.16:0/2421477747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70d0100750 0x7f70d01047a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:22.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.804+0000 7f70d83df640 1 --2- 172.21.15.16:0/2421477747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70d00ffda0 0x7f70d0100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:22.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.804+0000 7f70d83df640 1 -- 172.21.15.16:0/2421477747 >> 172.21.15.16:0/2421477747 conn(0x7f70d00fb840 msgr2=0x7f70d00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:22.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.804+0000 7f70d83df640 1 -- 172.21.15.16:0/2421477747 shutdown_connections 2024-08-01T06:52:22.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.804+0000 7f70d83df640 1 -- 172.21.15.16:0/2421477747 wait complete. 2024-08-01T06:52:22.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.805+0000 7f70d83df640 1 Processor -- start 2024-08-01T06:52:22.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.805+0000 7f70d83df640 1 -- start start 2024-08-01T06:52:22.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.805+0000 7f70d83df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70d00ffda0 0x7f70d00727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:22.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.805+0000 7f70d83df640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70d0100750 0x7f70d0072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:22.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.805+0000 7f70d83df640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d0073230 con 0x7f70d0100750 2024-08-01T06:52:22.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.805+0000 7f70d83df640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d0073370 con 0x7f70d00ffda0 2024-08-01T06:52:22.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.805+0000 7f70d597a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70d0100750 0x7f70d0072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:22.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.805+0000 7f70d597a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70d0100750 0x7f70d0072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40414/0 (socket says 172.21.15.16:40414) 2024-08-01T06:52:22.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.805+0000 7f70d597a640 1 -- 172.21.15.16:0/1356272597 learned_addr learned my addr 172.21.15.16:0/1356272597 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:22.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.806+0000 7f70d617b640 1 --2- 172.21.15.16:0/1356272597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70d00ffda0 0x7f70d00727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:22.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.806+0000 7f70d597a640 1 -- 172.21.15.16:0/1356272597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70d00ffda0 msgr2=0x7f70d00727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:22.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.806+0000 7f70d597a640 1 --2- 172.21.15.16:0/1356272597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70d00ffda0 0x7f70d00727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:22.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.806+0000 7f70d597a640 1 -- 172.21.15.16:0/1356272597 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c0009560 con 0x7f70d0100750 2024-08-01T06:52:22.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.806+0000 7f70d597a640 1 --2- 172.21.15.16:0/1356272597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70d0100750 0x7f70d0072cf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f70c002a9c0 tx=0x7f70c00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:22.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.806+0000 7f70c77fe640 1 -- 172.21.15.16:0/1356272597 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70c0004aa0 con 0x7f70d0100750 2024-08-01T06:52:22.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.806+0000 7f70d83df640 1 -- 172.21.15.16:0/1356272597 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d00735f0 con 0x7f70d0100750 2024-08-01T06:52:22.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.806+0000 7f70c77fe640 1 -- 172.21.15.16:0/1356272597 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70c0004c00 con 0x7f70d0100750 2024-08-01T06:52:22.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.806+0000 7f70c77fe640 1 -- 172.21.15.16:0/1356272597 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70c0003ab0 con 0x7f70d0100750 2024-08-01T06:52:22.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.807+0000 7f70d83df640 1 -- 172.21.15.16:0/1356272597 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d01a2000 con 0x7f70d0100750 2024-08-01T06:52:22.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.808+0000 7f70d83df640 1 -- 172.21.15.16:0/1356272597 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f70d010d010 con 0x7f70d0100750 2024-08-01T06:52:22.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.809+0000 7f70c77fe640 1 -- 172.21.15.16:0/1356272597 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f70c0003c10 con 0x7f70d0100750 2024-08-01T06:52:22.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.810+0000 7f70c77fe640 1 --2- 172.21.15.16:0/1356272597 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f70bc06cc50 0x7f70bc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:22.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.810+0000 7f70c77fe640 1 -- 172.21.15.16:0/1356272597 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f70c00ace50 con 0x7f70d0100750 2024-08-01T06:52:22.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.810+0000 7f70d617b640 1 --2- 172.21.15.16:0/1356272597 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f70bc06cc50 0x7f70bc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:22.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.811+0000 7f70c77fe640 1 --2- 172.21.15.16:0/1356272597 >> [v2:172.21.15.89:6816/2072119759,v1:172.21.15.89:6817/2072119759] conn(0x7f70bc0729e0 0x7f70bc074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:22.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.811+0000 7f70c77fe640 1 -- 172.21.15.16:0/1356272597 --> [v2:172.21.15.89:6816/2072119759,v1:172.21.15.89:6817/2072119759] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70bc0754b0 con 0x7f70bc0729e0 2024-08-01T06:52:22.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.811+0000 7f70c77fe640 1 -- 172.21.15.16:0/1356272597 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70c00b2530 con 0x7f70d0100750 2024-08-01T06:52:22.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.811+0000 7f70d697c640 1 --2- 172.21.15.16:0/1356272597 >> [v2:172.21.15.89:6816/2072119759,v1:172.21.15.89:6817/2072119759] conn(0x7f70bc0729e0 0x7f70bc074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:22.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.811+0000 7f70d617b640 1 --2- 172.21.15.16:0/1356272597 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f70bc06cc50 0x7f70bc06f110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f70cc0058c0 tx=0x7f70cc00a250 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:22.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.811+0000 7f70d697c640 1 --2- 172.21.15.16:0/1356272597 >> [v2:172.21.15.89:6816/2072119759,v1:172.21.15.89:6817/2072119759] conn(0x7f70bc0729e0 0x7f70bc074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:22.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.812+0000 7f70c77fe640 1 -- 172.21.15.16:0/1356272597 <== osd.5 v2:172.21.15.89:6816/2072119759 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f70bc0754b0 con 0x7f70bc0729e0 2024-08-01T06:52:22.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.826+0000 7f70d83df640 1 -- 172.21.15.16:0/1356272597 --> [v2:172.21.15.89:6816/2072119759,v1:172.21.15.89:6817/2072119759] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f70d0060b30 con 0x7f70bc0729e0 2024-08-01T06:52:22.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.827+0000 7f70c77fe640 1 -- 172.21.15.16:0/1356272597 <== osd.5 v2:172.21.15.89:6816/2072119759 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f70d0060b30 con 0x7f70bc0729e0 2024-08-01T06:52:22.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.827+0000 7f70d83df640 1 -- 172.21.15.16:0/1356272597 >> [v2:172.21.15.89:6816/2072119759,v1:172.21.15.89:6817/2072119759] conn(0x7f70bc0729e0 msgr2=0x7f70bc074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:22.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.827+0000 7f70d83df640 1 --2- 172.21.15.16:0/1356272597 >> [v2:172.21.15.89:6816/2072119759,v1:172.21.15.89:6817/2072119759] conn(0x7f70bc0729e0 0x7f70bc074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:22.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.827+0000 7f70d83df640 1 -- 172.21.15.16:0/1356272597 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f70bc06cc50 msgr2=0x7f70bc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:22.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.827+0000 7f70d83df640 1 --2- 172.21.15.16:0/1356272597 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f70bc06cc50 0x7f70bc06f110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f70cc0058c0 tx=0x7f70cc00a250 comp rx=0 tx=0).stop 2024-08-01T06:52:22.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.827+0000 7f70d83df640 1 -- 172.21.15.16:0/1356272597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70d0100750 msgr2=0x7f70d0072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:22.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.827+0000 7f70d83df640 1 --2- 172.21.15.16:0/1356272597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70d0100750 0x7f70d0072cf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f70c002a9c0 tx=0x7f70c00055a0 comp rx=0 tx=0).stop 2024-08-01T06:52:22.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.827+0000 7f70d83df640 1 -- 172.21.15.16:0/1356272597 shutdown_connections 2024-08-01T06:52:22.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.827+0000 7f70d83df640 1 --2- 172.21.15.16:0/1356272597 >> [v2:172.21.15.89:6816/2072119759,v1:172.21.15.89:6817/2072119759] conn(0x7f70bc0729e0 0x7f70bc074e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:22.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.827+0000 7f70d83df640 1 --2- 172.21.15.16:0/1356272597 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f70bc06cc50 0x7f70bc06f110 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:22.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.827+0000 7f70d83df640 1 --2- 172.21.15.16:0/1356272597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70d0100750 0x7f70d0072cf0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:22.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.827+0000 7f70d83df640 1 --2- 172.21.15.16:0/1356272597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70d00ffda0 0x7f70d00727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:22.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.827+0000 7f70d83df640 1 -- 172.21.15.16:0/1356272597 >> 172.21.15.16:0/1356272597 conn(0x7f70d00fb840 msgr2=0x7f70d00fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:22.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.827+0000 7f70d83df640 1 -- 172.21.15.16:0/1356272597 shutdown_connections 2024-08-01T06:52:22.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:22.827+0000 7f70d83df640 1 -- 172.21.15.16:0/1356272597 wait complete. 2024-08-01T06:52:22.910 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:22 smithi016 ceph-mon[29266]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:23.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.014+0000 7f27d62a3640 1 -- 172.21.15.16:0/578455778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27d0102920 msgr2=0x7f27d0106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:23.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.014+0000 7f27d62a3640 1 --2- 172.21.15.16:0/578455778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27d0102920 0x7f27d0106970 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f27c4009880 tx=0x7f27c402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:52:23.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.014+0000 7f27d62a3640 1 -- 172.21.15.16:0/578455778 shutdown_connections 2024-08-01T06:52:23.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.014+0000 7f27d62a3640 1 --2- 172.21.15.16:0/578455778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27d0102920 0x7f27d0106970 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:23.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.014+0000 7f27d62a3640 1 --2- 172.21.15.16:0/578455778 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27d0101f70 0x7f27d0102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:23.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.014+0000 7f27d62a3640 1 -- 172.21.15.16:0/578455778 >> 172.21.15.16:0/578455778 conn(0x7f27d00fd9f0 msgr2=0x7f27d00ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:23.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.014+0000 7f27d62a3640 1 -- 172.21.15.16:0/578455778 shutdown_connections 2024-08-01T06:52:23.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.014+0000 7f27d62a3640 1 -- 172.21.15.16:0/578455778 wait complete. 2024-08-01T06:52:23.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.015+0000 7f27d62a3640 1 Processor -- start 2024-08-01T06:52:23.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.015+0000 7f27d62a3640 1 -- start start 2024-08-01T06:52:23.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.015+0000 7f27d62a3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27d0101f70 0x7f27d0197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:23.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.015+0000 7f27d62a3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27d0102920 0x7f27d01981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:23.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.015+0000 7f27d62a3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d01988d0 con 0x7f27d0102920 2024-08-01T06:52:23.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.015+0000 7f27d62a3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d019b540 con 0x7f27d0101f70 2024-08-01T06:52:23.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.015+0000 7f27cf7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27d0102920 0x7f27d01981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:23.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.015+0000 7f27cf7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27d0102920 0x7f27d01981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40426/0 (socket says 172.21.15.16:40426) 2024-08-01T06:52:23.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.015+0000 7f27cf7fe640 1 -- 172.21.15.16:0/2527993666 learned_addr learned my addr 172.21.15.16:0/2527993666 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:23.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.015+0000 7f27cffff640 1 --2- 172.21.15.16:0/2527993666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27d0101f70 0x7f27d0197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:23.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.016+0000 7f27cf7fe640 1 -- 172.21.15.16:0/2527993666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27d0101f70 msgr2=0x7f27d0197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:23.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.016+0000 7f27cf7fe640 1 --2- 172.21.15.16:0/2527993666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27d0101f70 0x7f27d0197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:23.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.016+0000 7f27cf7fe640 1 -- 172.21.15.16:0/2527993666 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c4009560 con 0x7f27d0102920 2024-08-01T06:52:23.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.016+0000 7f27cf7fe640 1 --2- 172.21.15.16:0/2527993666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27d0102920 0x7f27d01981f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f27c402a9c0 tx=0x7f27c40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:23.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.016+0000 7f27cd7fa640 1 -- 172.21.15.16:0/2527993666 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27c4004aa0 con 0x7f27d0102920 2024-08-01T06:52:23.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.016+0000 7f27d62a3640 1 -- 172.21.15.16:0/2527993666 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d019b7c0 con 0x7f27d0102920 2024-08-01T06:52:23.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.016+0000 7f27cd7fa640 1 -- 172.21.15.16:0/2527993666 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f27c4004c00 con 0x7f27d0102920 2024-08-01T06:52:23.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.016+0000 7f27cd7fa640 1 -- 172.21.15.16:0/2527993666 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27c4003980 con 0x7f27d0102920 2024-08-01T06:52:23.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.016+0000 7f27d62a3640 1 -- 172.21.15.16:0/2527993666 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d019bcb0 con 0x7f27d0102920 2024-08-01T06:52:23.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.017+0000 7f27d62a3640 1 -- 172.21.15.16:0/2527993666 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f27d010f280 con 0x7f27d0102920 2024-08-01T06:52:23.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.018+0000 7f27cd7fa640 1 -- 172.21.15.16:0/2527993666 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f27c4003bf0 con 0x7f27d0102920 2024-08-01T06:52:23.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.018+0000 7f27cd7fa640 1 --2- 172.21.15.16:0/2527993666 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f27b806cc50 0x7f27b806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:23.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.018+0000 7f27cd7fa640 1 -- 172.21.15.16:0/2527993666 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f27c40acf20 con 0x7f27d0102920 2024-08-01T06:52:23.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.018+0000 7f27cffff640 1 --2- 172.21.15.16:0/2527993666 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f27b806cc50 0x7f27b806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:23.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.018+0000 7f27cd7fa640 1 --2- 172.21.15.16:0/2527993666 >> [v2:172.21.15.16:6810/3206893924,v1:172.21.15.16:6811/3206893924] conn(0x7f27b80729e0 0x7f27b8074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:23.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.018+0000 7f27cd7fa640 1 -- 172.21.15.16:0/2527993666 --> [v2:172.21.15.16:6810/3206893924,v1:172.21.15.16:6811/3206893924] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27b80754b0 con 0x7f27b80729e0 2024-08-01T06:52:23.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.018+0000 7f27cd7fa640 1 -- 172.21.15.16:0/2527993666 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27c40af5f0 con 0x7f27d0102920 2024-08-01T06:52:23.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.019+0000 7f27d4840640 1 --2- 172.21.15.16:0/2527993666 >> [v2:172.21.15.16:6810/3206893924,v1:172.21.15.16:6811/3206893924] conn(0x7f27b80729e0 0x7f27b8074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:23.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.019+0000 7f27cffff640 1 --2- 172.21.15.16:0/2527993666 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f27b806cc50 0x7f27b806f110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f27c000bbe0 tx=0x7f27c000b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:23.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.019+0000 7f27d4840640 1 --2- 172.21.15.16:0/2527993666 >> [v2:172.21.15.16:6810/3206893924,v1:172.21.15.16:6811/3206893924] conn(0x7f27b80729e0 0x7f27b8074e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:23.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.020+0000 7f27cd7fa640 1 -- 172.21.15.16:0/2527993666 <== osd.1 v2:172.21.15.16:6810/3206893924 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f27b80754b0 con 0x7f27b80729e0 2024-08-01T06:52:23.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.033+0000 7f27d62a3640 1 -- 172.21.15.16:0/2527993666 --> [v2:172.21.15.16:6810/3206893924,v1:172.21.15.16:6811/3206893924] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f27d019c1d0 con 0x7f27b80729e0 2024-08-01T06:52:23.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.033+0000 7f27cd7fa640 1 -- 172.21.15.16:0/2527993666 <== osd.1 v2:172.21.15.16:6810/3206893924 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f27d019c1d0 con 0x7f27b80729e0 2024-08-01T06:52:23.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.033+0000 7f27d62a3640 1 -- 172.21.15.16:0/2527993666 >> [v2:172.21.15.16:6810/3206893924,v1:172.21.15.16:6811/3206893924] conn(0x7f27b80729e0 msgr2=0x7f27b8074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:23.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.033+0000 7f27d62a3640 1 --2- 172.21.15.16:0/2527993666 >> [v2:172.21.15.16:6810/3206893924,v1:172.21.15.16:6811/3206893924] conn(0x7f27b80729e0 0x7f27b8074e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:23.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.033+0000 7f27d62a3640 1 -- 172.21.15.16:0/2527993666 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f27b806cc50 msgr2=0x7f27b806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:23.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.033+0000 7f27d62a3640 1 --2- 172.21.15.16:0/2527993666 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f27b806cc50 0x7f27b806f110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f27c000bbe0 tx=0x7f27c000b390 comp rx=0 tx=0).stop 2024-08-01T06:52:23.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.033+0000 7f27d62a3640 1 -- 172.21.15.16:0/2527993666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27d0102920 msgr2=0x7f27d01981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:23.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.033+0000 7f27d62a3640 1 --2- 172.21.15.16:0/2527993666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27d0102920 0x7f27d01981f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f27c402a9c0 tx=0x7f27c40055a0 comp rx=0 tx=0).stop 2024-08-01T06:52:23.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.034+0000 7f27d62a3640 1 -- 172.21.15.16:0/2527993666 shutdown_connections 2024-08-01T06:52:23.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.034+0000 7f27d62a3640 1 --2- 172.21.15.16:0/2527993666 >> [v2:172.21.15.16:6810/3206893924,v1:172.21.15.16:6811/3206893924] conn(0x7f27b80729e0 0x7f27b8074e00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:23.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.034+0000 7f27d62a3640 1 --2- 172.21.15.16:0/2527993666 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f27b806cc50 0x7f27b806f110 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:23.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.034+0000 7f27d62a3640 1 --2- 172.21.15.16:0/2527993666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27d0102920 0x7f27d01981f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:23.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.034+0000 7f27d62a3640 1 --2- 172.21.15.16:0/2527993666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27d0101f70 0x7f27d0197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:23.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.034+0000 7f27d62a3640 1 -- 172.21.15.16:0/2527993666 >> 172.21.15.16:0/2527993666 conn(0x7f27d00fd9f0 msgr2=0x7f27d00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:23.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.034+0000 7f27d62a3640 1 -- 172.21.15.16:0/2527993666 shutdown_connections 2024-08-01T06:52:23.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:23.034+0000 7f27d62a3640 1 -- 172.21.15.16:0/2527993666 wait complete. 2024-08-01T06:52:23.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:22 smithi089 ceph-mon[36617]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:23.685 INFO:teuthology.orchestra.run.smithi016.stdout:167503724553 2024-08-01T06:52:23.686 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-08-01T06:52:24.786 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:24 smithi016 ceph-mon[29266]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:25.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:24 smithi089 ceph-mon[36617]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:26.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.350+0000 7f230611f640 1 -- 172.21.15.16:0/3098648030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23001015d0 msgr2=0x7f2300109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:26.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.350+0000 7f230611f640 1 --2- 172.21.15.16:0/3098648030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23001015d0 0x7f2300109ac0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009880 tx=0x7f22f402a530 comp rx=0 tx=0).stop 2024-08-01T06:52:26.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.350+0000 7f230611f640 1 -- 172.21.15.16:0/3098648030 shutdown_connections 2024-08-01T06:52:26.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.350+0000 7f230611f640 1 --2- 172.21.15.16:0/3098648030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23001015d0 0x7f2300109ac0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:26.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.350+0000 7f230611f640 1 --2- 172.21.15.16:0/3098648030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2300100cb0 0x7f2300101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:26.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.350+0000 7f230611f640 1 -- 172.21.15.16:0/3098648030 >> 172.21.15.16:0/3098648030 conn(0x7f23000758a0 msgr2=0x7f23000fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:26.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.350+0000 7f230611f640 1 -- 172.21.15.16:0/3098648030 shutdown_connections 2024-08-01T06:52:26.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.350+0000 7f230611f640 1 -- 172.21.15.16:0/3098648030 wait complete. 2024-08-01T06:52:26.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.350+0000 7f230611f640 1 Processor -- start 2024-08-01T06:52:26.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.350+0000 7f230611f640 1 -- start start 2024-08-01T06:52:26.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.351+0000 7f230611f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2300100cb0 0x7f23000fe910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:26.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.351+0000 7f230611f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23001015d0 0x7f23000fee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:26.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.351+0000 7f230611f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23001008e0 con 0x7f2300100cb0 2024-08-01T06:52:26.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.351+0000 7f230611f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23000ff390 con 0x7f23001015d0 2024-08-01T06:52:26.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.351+0000 7f22ff7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2300100cb0 0x7f23000fe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:26.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.351+0000 7f22ff7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2300100cb0 0x7f23000fe910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40446/0 (socket says 172.21.15.16:40446) 2024-08-01T06:52:26.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.351+0000 7f22ff7fe640 1 -- 172.21.15.16:0/2852047442 learned_addr learned my addr 172.21.15.16:0/2852047442 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:26.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.351+0000 7f22feffd640 1 --2- 172.21.15.16:0/2852047442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23001015d0 0x7f23000fee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:26.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.351+0000 7f22ff7fe640 1 -- 172.21.15.16:0/2852047442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23001015d0 msgr2=0x7f23000fee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:26.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.351+0000 7f22ff7fe640 1 --2- 172.21.15.16:0/2852047442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23001015d0 0x7f23000fee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:26.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.351+0000 7f22ff7fe640 1 -- 172.21.15.16:0/2852047442 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f4009560 con 0x7f2300100cb0 2024-08-01T06:52:26.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.351+0000 7f22feffd640 1 --2- 172.21.15.16:0/2852047442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23001015d0 0x7f23000fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T06:52:26.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.351+0000 7f22ff7fe640 1 --2- 172.21.15.16:0/2852047442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2300100cb0 0x7f23000fe910 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f22f000c8a0 tx=0x7f22f000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:26.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.351+0000 7f22fcff9640 1 -- 172.21.15.16:0/2852047442 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f0007b80 con 0x7f2300100cb0 2024-08-01T06:52:26.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.352+0000 7f22fcff9640 1 -- 172.21.15.16:0/2852047442 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22f0007ce0 con 0x7f2300100cb0 2024-08-01T06:52:26.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.352+0000 7f230611f640 1 -- 172.21.15.16:0/2852047442 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23000ff670 con 0x7f2300100cb0 2024-08-01T06:52:26.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.352+0000 7f22fcff9640 1 -- 172.21.15.16:0/2852047442 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f0018810 con 0x7f2300100cb0 2024-08-01T06:52:26.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.352+0000 7f230611f640 1 -- 172.21.15.16:0/2852047442 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23001a1f20 con 0x7f2300100cb0 2024-08-01T06:52:26.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.353+0000 7f230611f640 1 -- 172.21.15.16:0/2852047442 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f230010d080 con 0x7f2300100cb0 2024-08-01T06:52:26.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.353+0000 7f22fcff9640 1 -- 172.21.15.16:0/2852047442 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f22f0018a80 con 0x7f2300100cb0 2024-08-01T06:52:26.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.354+0000 7f22fcff9640 1 --2- 172.21.15.16:0/2852047442 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f22e806cc50 0x7f22e806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:26.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.354+0000 7f22fcff9640 1 -- 172.21.15.16:0/2852047442 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f22f008c440 con 0x7f2300100cb0 2024-08-01T06:52:26.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.354+0000 7f22feffd640 1 --2- 172.21.15.16:0/2852047442 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f22e806cc50 0x7f22e806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:26.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.354+0000 7f22fcff9640 1 --2- 172.21.15.16:0/2852047442 >> [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812] conn(0x7f22e80729e0 0x7f22e8074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:26.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.354+0000 7f22fcff9640 1 -- 172.21.15.16:0/2852047442 --> [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22e80754b0 con 0x7f22e80729e0 2024-08-01T06:52:26.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.354+0000 7f22fcff9640 1 -- 172.21.15.16:0/2852047442 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22f008c8a0 con 0x7f2300100cb0 2024-08-01T06:52:26.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.354+0000 7f22fffff640 1 --2- 172.21.15.16:0/2852047442 >> [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812] conn(0x7f22e80729e0 0x7f22e8074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:26.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.355+0000 7f22fffff640 1 --2- 172.21.15.16:0/2852047442 >> [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812] conn(0x7f22e80729e0 0x7f22e8074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:26.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.355+0000 7f22feffd640 1 --2- 172.21.15.16:0/2852047442 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f22e806cc50 0x7f22e806f110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f22f4000c00 tx=0x7f22f4005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:26.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.356+0000 7f22fcff9640 1 -- 172.21.15.16:0/2852047442 <== osd.2 v2:172.21.15.16:6818/2241613812 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f22e80754b0 con 0x7f22e80729e0 2024-08-01T06:52:26.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.369+0000 7f230611f640 1 -- 172.21.15.16:0/2852047442 --> [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2300068510 con 0x7f22e80729e0 2024-08-01T06:52:26.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.370+0000 7f22fcff9640 1 -- 172.21.15.16:0/2852047442 <== osd.2 v2:172.21.15.16:6818/2241613812 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2300068510 con 0x7f22e80729e0 2024-08-01T06:52:26.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.370+0000 7f230611f640 1 -- 172.21.15.16:0/2852047442 >> [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812] conn(0x7f22e80729e0 msgr2=0x7f22e8074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:26.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.370+0000 7f230611f640 1 --2- 172.21.15.16:0/2852047442 >> [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812] conn(0x7f22e80729e0 0x7f22e8074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:26.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.370+0000 7f230611f640 1 -- 172.21.15.16:0/2852047442 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f22e806cc50 msgr2=0x7f22e806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:26.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.370+0000 7f230611f640 1 --2- 172.21.15.16:0/2852047442 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f22e806cc50 0x7f22e806f110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f22f4000c00 tx=0x7f22f4005a20 comp rx=0 tx=0).stop 2024-08-01T06:52:26.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.370+0000 7f230611f640 1 -- 172.21.15.16:0/2852047442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2300100cb0 msgr2=0x7f23000fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:26.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.370+0000 7f230611f640 1 --2- 172.21.15.16:0/2852047442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2300100cb0 0x7f23000fe910 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f22f000c8a0 tx=0x7f22f000cd60 comp rx=0 tx=0).stop 2024-08-01T06:52:26.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.370+0000 7f230611f640 1 -- 172.21.15.16:0/2852047442 shutdown_connections 2024-08-01T06:52:26.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.370+0000 7f230611f640 1 --2- 172.21.15.16:0/2852047442 >> [v2:172.21.15.16:6818/2241613812,v1:172.21.15.16:6819/2241613812] conn(0x7f22e80729e0 0x7f22e8074e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:26.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.370+0000 7f230611f640 1 --2- 172.21.15.16:0/2852047442 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f22e806cc50 0x7f22e806f110 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:26.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.370+0000 7f230611f640 1 --2- 172.21.15.16:0/2852047442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23001015d0 0x7f23000fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:26.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.370+0000 7f230611f640 1 --2- 172.21.15.16:0/2852047442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2300100cb0 0x7f23000fe910 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:26.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.370+0000 7f230611f640 1 -- 172.21.15.16:0/2852047442 >> 172.21.15.16:0/2852047442 conn(0x7f23000758a0 msgr2=0x7f2300101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:26.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.370+0000 7f230611f640 1 -- 172.21.15.16:0/2852047442 shutdown_connections 2024-08-01T06:52:26.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.370+0000 7f230611f640 1 -- 172.21.15.16:0/2852047442 wait complete. 2024-08-01T06:52:26.868 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:26 smithi016 ceph-mon[29266]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:26.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.949+0000 7f094d0f4640 1 -- 172.21.15.16:0/488749522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948100d50 msgr2=0x7f0948101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:26.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.949+0000 7f094d0f4640 1 --2- 172.21.15.16:0/488749522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948100d50 0x7f0948101130 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0938009880 tx=0x7f093802a4a0 comp rx=0 tx=0).stop 2024-08-01T06:52:26.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.949+0000 7f094d0f4640 1 -- 172.21.15.16:0/488749522 shutdown_connections 2024-08-01T06:52:26.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.949+0000 7f094d0f4640 1 --2- 172.21.15.16:0/488749522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0948101670 0x7f0948109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:26.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.949+0000 7f094d0f4640 1 --2- 172.21.15.16:0/488749522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948100d50 0x7f0948101130 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:26.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.949+0000 7f094d0f4640 1 -- 172.21.15.16:0/488749522 >> 172.21.15.16:0/488749522 conn(0x7f09480fa730 msgr2=0x7f09480fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:26.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.949+0000 7f094d0f4640 1 -- 172.21.15.16:0/488749522 shutdown_connections 2024-08-01T06:52:26.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.949+0000 7f094d0f4640 1 -- 172.21.15.16:0/488749522 wait complete. 2024-08-01T06:52:26.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.950+0000 7f094d0f4640 1 Processor -- start 2024-08-01T06:52:26.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.950+0000 7f094d0f4640 1 -- start start 2024-08-01T06:52:26.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.950+0000 7f094d0f4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0948100d50 0x7f094819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:26.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.950+0000 7f094d0f4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948101670 0x7f094819be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:26.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.950+0000 7f094d0f4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0948195970 con 0x7f0948101670 2024-08-01T06:52:26.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.950+0000 7f094d0f4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0948195ab0 con 0x7f0948100d50 2024-08-01T06:52:26.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.950+0000 7f094659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948101670 0x7f094819be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:26.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.950+0000 7f094659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948101670 0x7f094819be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40462/0 (socket says 172.21.15.16:40462) 2024-08-01T06:52:26.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.950+0000 7f094659c640 1 -- 172.21.15.16:0/521904209 learned_addr learned my addr 172.21.15.16:0/521904209 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:26.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.951+0000 7f0946d9d640 1 --2- 172.21.15.16:0/521904209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0948100d50 0x7f094819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:26.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.951+0000 7f094659c640 1 -- 172.21.15.16:0/521904209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0948100d50 msgr2=0x7f094819b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:26.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.951+0000 7f094659c640 1 --2- 172.21.15.16:0/521904209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0948100d50 0x7f094819b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:26.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.951+0000 7f094659c640 1 -- 172.21.15.16:0/521904209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0938009560 con 0x7f0948101670 2024-08-01T06:52:26.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.951+0000 7f0946d9d640 1 --2- 172.21.15.16:0/521904209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0948100d50 0x7f094819b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-01T06:52:26.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.951+0000 7f094659c640 1 --2- 172.21.15.16:0/521904209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948101670 0x7f094819be50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f093c00b420 tx=0x7f093c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:26.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.951+0000 7f092ffff640 1 -- 172.21.15.16:0/521904209 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f093c011800 con 0x7f0948101670 2024-08-01T06:52:26.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.951+0000 7f092ffff640 1 -- 172.21.15.16:0/521904209 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f093c011e20 con 0x7f0948101670 2024-08-01T06:52:26.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.951+0000 7f092ffff640 1 -- 172.21.15.16:0/521904209 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f093c00f2e0 con 0x7f0948101670 2024-08-01T06:52:26.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.951+0000 7f094d0f4640 1 -- 172.21.15.16:0/521904209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0948195d90 con 0x7f0948101670 2024-08-01T06:52:26.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.951+0000 7f094d0f4640 1 -- 172.21.15.16:0/521904209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09481962e0 con 0x7f0948101670 2024-08-01T06:52:26.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.952+0000 7f094d0f4640 1 -- 172.21.15.16:0/521904209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0948068cd0 con 0x7f0948101670 2024-08-01T06:52:26.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.953+0000 7f092ffff640 1 -- 172.21.15.16:0/521904209 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f093c010380 con 0x7f0948101670 2024-08-01T06:52:26.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.953+0000 7f092ffff640 1 --2- 172.21.15.16:0/521904209 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f093006cc50 0x7f093006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:26.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.953+0000 7f092ffff640 1 -- 172.21.15.16:0/521904209 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f093c08c2c0 con 0x7f0948101670 2024-08-01T06:52:26.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.953+0000 7f0946d9d640 1 --2- 172.21.15.16:0/521904209 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f093006cc50 0x7f093006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:26.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.953+0000 7f092ffff640 1 --2- 172.21.15.16:0/521904209 >> [v2:172.21.15.89:6808/900847704,v1:172.21.15.89:6809/900847704] conn(0x7f09300729e0 0x7f0930074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:26.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.953+0000 7f092ffff640 1 -- 172.21.15.16:0/521904209 --> [v2:172.21.15.89:6808/900847704,v1:172.21.15.89:6809/900847704] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09300754b0 con 0x7f09300729e0 2024-08-01T06:52:26.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.953+0000 7f092ffff640 1 -- 172.21.15.16:0/521904209 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f093c08c720 con 0x7f0948101670 2024-08-01T06:52:26.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.954+0000 7f0946d9d640 1 --2- 172.21.15.16:0/521904209 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f093006cc50 0x7f093006f110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0938006010 tx=0x7f0938005e60 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:26.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.954+0000 7f094759e640 1 --2- 172.21.15.16:0/521904209 >> [v2:172.21.15.89:6808/900847704,v1:172.21.15.89:6809/900847704] conn(0x7f09300729e0 0x7f0930074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:26.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.954+0000 7f094759e640 1 --2- 172.21.15.16:0/521904209 >> [v2:172.21.15.89:6808/900847704,v1:172.21.15.89:6809/900847704] conn(0x7f09300729e0 0x7f0930074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:26.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.955+0000 7f092ffff640 1 -- 172.21.15.16:0/521904209 <== osd.4 v2:172.21.15.89:6808/900847704 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f09300754b0 con 0x7f09300729e0 2024-08-01T06:52:26.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.968+0000 7f094d0f4640 1 -- 172.21.15.16:0/521904209 --> [v2:172.21.15.89:6808/900847704,v1:172.21.15.89:6809/900847704] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f094810d010 con 0x7f09300729e0 2024-08-01T06:52:26.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.969+0000 7f092ffff640 1 -- 172.21.15.16:0/521904209 <== osd.4 v2:172.21.15.89:6808/900847704 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f094810d010 con 0x7f09300729e0 2024-08-01T06:52:26.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.969+0000 7f094d0f4640 1 -- 172.21.15.16:0/521904209 >> [v2:172.21.15.89:6808/900847704,v1:172.21.15.89:6809/900847704] conn(0x7f09300729e0 msgr2=0x7f0930074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:26.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.969+0000 7f094d0f4640 1 --2- 172.21.15.16:0/521904209 >> [v2:172.21.15.89:6808/900847704,v1:172.21.15.89:6809/900847704] conn(0x7f09300729e0 0x7f0930074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:26.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.969+0000 7f094d0f4640 1 -- 172.21.15.16:0/521904209 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f093006cc50 msgr2=0x7f093006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:26.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.969+0000 7f094d0f4640 1 --2- 172.21.15.16:0/521904209 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f093006cc50 0x7f093006f110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0938006010 tx=0x7f0938005e60 comp rx=0 tx=0).stop 2024-08-01T06:52:26.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.969+0000 7f094d0f4640 1 -- 172.21.15.16:0/521904209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948101670 msgr2=0x7f094819be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:26.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.969+0000 7f094d0f4640 1 --2- 172.21.15.16:0/521904209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948101670 0x7f094819be50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f093c00b420 tx=0x7f093c00b8e0 comp rx=0 tx=0).stop 2024-08-01T06:52:26.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.969+0000 7f094d0f4640 1 -- 172.21.15.16:0/521904209 shutdown_connections 2024-08-01T06:52:26.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.969+0000 7f094d0f4640 1 --2- 172.21.15.16:0/521904209 >> [v2:172.21.15.89:6808/900847704,v1:172.21.15.89:6809/900847704] conn(0x7f09300729e0 0x7f0930074e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:26.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.969+0000 7f094d0f4640 1 --2- 172.21.15.16:0/521904209 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f093006cc50 0x7f093006f110 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:26.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.969+0000 7f094d0f4640 1 --2- 172.21.15.16:0/521904209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0948101670 0x7f094819be50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:26.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.969+0000 7f094d0f4640 1 --2- 172.21.15.16:0/521904209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0948100d50 0x7f094819b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:26.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.969+0000 7f094d0f4640 1 -- 172.21.15.16:0/521904209 >> 172.21.15.16:0/521904209 conn(0x7f09480fa730 msgr2=0x7f0948102030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:26.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.969+0000 7f094d0f4640 1 -- 172.21.15.16:0/521904209 shutdown_connections 2024-08-01T06:52:26.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:26.969+0000 7f094d0f4640 1 -- 172.21.15.16:0/521904209 wait complete. 2024-08-01T06:52:27.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:26 smithi089 ceph-mon[36617]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:27.563 INFO:teuthology.orchestra.run.smithi016.stdout:146028888077 2024-08-01T06:52:27.563 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-08-01T06:52:27.961 INFO:teuthology.orchestra.run.smithi016.stdout:81604378648 2024-08-01T06:52:27.962 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-01T06:52:27.999 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:28.829 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:28 smithi016 ceph-mon[29266]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:29.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:28 smithi089 ceph-mon[36617]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:29.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.487+0000 7f2263a3d640 1 -- 172.21.15.16:0/121759419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f225c072850 msgr2=0x7f225c072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:29.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.487+0000 7f2263a3d640 1 --2- 172.21.15.16:0/121759419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f225c072850 0x7f225c072c30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2258009880 tx=0x7f225802a530 comp rx=0 tx=0).stop 2024-08-01T06:52:29.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.487+0000 7f2263a3d640 1 -- 172.21.15.16:0/121759419 shutdown_connections 2024-08-01T06:52:29.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.487+0000 7f2263a3d640 1 --2- 172.21.15.16:0/121759419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f225c073170 0x7f225c110610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:29.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.487+0000 7f2263a3d640 1 --2- 172.21.15.16:0/121759419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f225c072850 0x7f225c072c30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:29.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.487+0000 7f2263a3d640 1 -- 172.21.15.16:0/121759419 >> 172.21.15.16:0/121759419 conn(0x7f225c0fb840 msgr2=0x7f225c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:29.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.487+0000 7f2263a3d640 1 -- 172.21.15.16:0/121759419 shutdown_connections 2024-08-01T06:52:29.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.487+0000 7f2263a3d640 1 -- 172.21.15.16:0/121759419 wait complete. 2024-08-01T06:52:29.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.488+0000 7f2263a3d640 1 Processor -- start 2024-08-01T06:52:29.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.488+0000 7f2263a3d640 1 -- start start 2024-08-01T06:52:29.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.488+0000 7f2263a3d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f225c072850 0x7f225c19c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:29.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.488+0000 7f2263a3d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f225c073170 0x7f225c19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:29.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.488+0000 7f2263a3d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c19cd30 con 0x7f225c072850 2024-08-01T06:52:29.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.488+0000 7f2263a3d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c1a0aa0 con 0x7f225c073170 2024-08-01T06:52:29.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.488+0000 7f22617d9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f225c072850 0x7f225c19c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:29.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.488+0000 7f22617d9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f225c072850 0x7f225c19c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40166/0 (socket says 172.21.15.16:40166) 2024-08-01T06:52:29.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.488+0000 7f22617d9640 1 -- 172.21.15.16:0/431442054 learned_addr learned my addr 172.21.15.16:0/431442054 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:29.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.489+0000 7f2260fd8640 1 --2- 172.21.15.16:0/431442054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f225c073170 0x7f225c19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:29.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.489+0000 7f22617d9640 1 -- 172.21.15.16:0/431442054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f225c073170 msgr2=0x7f225c19c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:29.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.489+0000 7f22617d9640 1 --2- 172.21.15.16:0/431442054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f225c073170 0x7f225c19c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:29.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.489+0000 7f22617d9640 1 -- 172.21.15.16:0/431442054 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2258009560 con 0x7f225c072850 2024-08-01T06:52:29.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.489+0000 7f22617d9640 1 --2- 172.21.15.16:0/431442054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f225c072850 0x7f225c19c160 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2258005940 tx=0x7f2258032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:29.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.489+0000 7f22527fc640 1 -- 172.21.15.16:0/431442054 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2258005220 con 0x7f225c072850 2024-08-01T06:52:29.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.489+0000 7f22527fc640 1 -- 172.21.15.16:0/431442054 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2258005380 con 0x7f225c072850 2024-08-01T06:52:29.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.489+0000 7f2263a3d640 1 -- 172.21.15.16:0/431442054 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225c1a0d20 con 0x7f225c072850 2024-08-01T06:52:29.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.489+0000 7f2263a3d640 1 -- 172.21.15.16:0/431442054 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225c1a1270 con 0x7f225c072850 2024-08-01T06:52:29.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.489+0000 7f22527fc640 1 -- 172.21.15.16:0/431442054 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2258003a50 con 0x7f225c072850 2024-08-01T06:52:29.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.490+0000 7f2263a3d640 1 -- 172.21.15.16:0/431442054 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f225c1136f0 con 0x7f225c072850 2024-08-01T06:52:29.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.491+0000 7f22527fc640 1 -- 172.21.15.16:0/431442054 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f225802ad50 con 0x7f225c072850 2024-08-01T06:52:29.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.491+0000 7f22527fc640 1 --2- 172.21.15.16:0/431442054 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f224806cc50 0x7f224806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:29.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.491+0000 7f22527fc640 1 -- 172.21.15.16:0/431442054 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f22580ac9c0 con 0x7f225c072850 2024-08-01T06:52:29.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.491+0000 7f2260fd8640 1 --2- 172.21.15.16:0/431442054 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f224806cc50 0x7f224806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:29.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.491+0000 7f22527fc640 1 --2- 172.21.15.16:0/431442054 >> [v2:172.21.15.89:6800/2212217098,v1:172.21.15.89:6801/2212217098] conn(0x7f22480729e0 0x7f2248074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:29.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.491+0000 7f22527fc640 1 -- 172.21.15.16:0/431442054 --> [v2:172.21.15.89:6800/2212217098,v1:172.21.15.89:6801/2212217098] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22480754b0 con 0x7f22480729e0 2024-08-01T06:52:29.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.491+0000 7f22527fc640 1 -- 172.21.15.16:0/431442054 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22580b12a0 con 0x7f225c072850 2024-08-01T06:52:29.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.492+0000 7f2260fd8640 1 --2- 172.21.15.16:0/431442054 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f224806cc50 0x7f224806f110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f225c19d710 tx=0x7f224c008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:29.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.492+0000 7f2261fda640 1 --2- 172.21.15.16:0/431442054 >> [v2:172.21.15.89:6800/2212217098,v1:172.21.15.89:6801/2212217098] conn(0x7f22480729e0 0x7f2248074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:29.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.492+0000 7f2261fda640 1 --2- 172.21.15.16:0/431442054 >> [v2:172.21.15.89:6800/2212217098,v1:172.21.15.89:6801/2212217098] conn(0x7f22480729e0 0x7f2248074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:29.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.493+0000 7f22527fc640 1 -- 172.21.15.16:0/431442054 <== osd.3 v2:172.21.15.89:6800/2212217098 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f22480754b0 con 0x7f22480729e0 2024-08-01T06:52:29.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.506+0000 7f2263a3d640 1 -- 172.21.15.16:0/431442054 --> [v2:172.21.15.89:6800/2212217098,v1:172.21.15.89:6801/2212217098] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f225c073f90 con 0x7f22480729e0 2024-08-01T06:52:29.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.507+0000 7f22527fc640 1 -- 172.21.15.16:0/431442054 <== osd.3 v2:172.21.15.89:6800/2212217098 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f225c073f90 con 0x7f22480729e0 2024-08-01T06:52:29.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.507+0000 7f2263a3d640 1 -- 172.21.15.16:0/431442054 >> [v2:172.21.15.89:6800/2212217098,v1:172.21.15.89:6801/2212217098] conn(0x7f22480729e0 msgr2=0x7f2248074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:29.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.507+0000 7f2263a3d640 1 --2- 172.21.15.16:0/431442054 >> [v2:172.21.15.89:6800/2212217098,v1:172.21.15.89:6801/2212217098] conn(0x7f22480729e0 0x7f2248074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:29.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.507+0000 7f2263a3d640 1 -- 172.21.15.16:0/431442054 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f224806cc50 msgr2=0x7f224806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:29.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.507+0000 7f2263a3d640 1 --2- 172.21.15.16:0/431442054 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f224806cc50 0x7f224806f110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f225c19d710 tx=0x7f224c008040 comp rx=0 tx=0).stop 2024-08-01T06:52:29.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.507+0000 7f2263a3d640 1 -- 172.21.15.16:0/431442054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f225c072850 msgr2=0x7f225c19c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:29.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.507+0000 7f2263a3d640 1 --2- 172.21.15.16:0/431442054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f225c072850 0x7f225c19c160 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2258005940 tx=0x7f2258032bd0 comp rx=0 tx=0).stop 2024-08-01T06:52:29.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.507+0000 7f2263a3d640 1 -- 172.21.15.16:0/431442054 shutdown_connections 2024-08-01T06:52:29.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.507+0000 7f2263a3d640 1 --2- 172.21.15.16:0/431442054 >> [v2:172.21.15.89:6800/2212217098,v1:172.21.15.89:6801/2212217098] conn(0x7f22480729e0 0x7f2248074e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:29.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.507+0000 7f2263a3d640 1 --2- 172.21.15.16:0/431442054 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f224806cc50 0x7f224806f110 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:29.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.507+0000 7f2263a3d640 1 --2- 172.21.15.16:0/431442054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f225c073170 0x7f225c19c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:29.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.507+0000 7f2263a3d640 1 --2- 172.21.15.16:0/431442054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f225c072850 0x7f225c19c160 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:29.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.507+0000 7f2263a3d640 1 -- 172.21.15.16:0/431442054 >> 172.21.15.16:0/431442054 conn(0x7f225c0fb840 msgr2=0x7f225c0ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:29.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.508+0000 7f2263a3d640 1 -- 172.21.15.16:0/431442054 shutdown_connections 2024-08-01T06:52:29.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:29.508+0000 7f2263a3d640 1 -- 172.21.15.16:0/431442054 wait complete. 2024-08-01T06:52:30.180 INFO:teuthology.orchestra.run.smithi016.stdout:111669149716 2024-08-01T06:52:30.180 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-08-01T06:52:30.620 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:30.639 INFO:teuthology.orchestra.run.smithi016.stdout:60129542173 2024-08-01T06:52:30.639 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-01T06:52:30.882 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:30 smithi016 ceph-mon[29266]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:31.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.084+0000 7f5c36154640 1 -- 172.21.15.16:0/2941008844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c300fe8a0 msgr2=0x7f5c300fec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:31.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.084+0000 7f5c36154640 1 --2- 172.21.15.16:0/2941008844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c300fe8a0 0x7f5c300fec80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009880 tx=0x7f5c2002a490 comp rx=0 tx=0).stop 2024-08-01T06:52:31.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.084+0000 7f5c36154640 1 -- 172.21.15.16:0/2941008844 shutdown_connections 2024-08-01T06:52:31.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.084+0000 7f5c36154640 1 --2- 172.21.15.16:0/2941008844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c300ff250 0x7f5c3010bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:31.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.084+0000 7f5c36154640 1 --2- 172.21.15.16:0/2941008844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c300fe8a0 0x7f5c300fec80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:31.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.084+0000 7f5c36154640 1 -- 172.21.15.16:0/2941008844 >> 172.21.15.16:0/2941008844 conn(0x7f5c300758a0 msgr2=0x7f5c300fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:31.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.085+0000 7f5c36154640 1 -- 172.21.15.16:0/2941008844 shutdown_connections 2024-08-01T06:52:31.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.085+0000 7f5c36154640 1 -- 172.21.15.16:0/2941008844 wait complete. 2024-08-01T06:52:31.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.085+0000 7f5c36154640 1 Processor -- start 2024-08-01T06:52:31.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.086+0000 7f5c36154640 1 -- start start 2024-08-01T06:52:31.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.086+0000 7f5c36154640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c300fe8a0 0x7f5c3019da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:31.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.086+0000 7f5c36154640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c300ff250 0x7f5c3019df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:31.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.086+0000 7f5c36154640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3019e5a0 con 0x7f5c300ff250 2024-08-01T06:52:31.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.086+0000 7f5c36154640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c30197b30 con 0x7f5c300fe8a0 2024-08-01T06:52:31.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.086+0000 7f5c2effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c300ff250 0x7f5c3019df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:31.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.086+0000 7f5c2effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c300ff250 0x7f5c3019df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40186/0 (socket says 172.21.15.16:40186) 2024-08-01T06:52:31.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.086+0000 7f5c2effd640 1 -- 172.21.15.16:0/1846460040 learned_addr learned my addr 172.21.15.16:0/1846460040 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:31.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.086+0000 7f5c2f7fe640 1 --2- 172.21.15.16:0/1846460040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c300fe8a0 0x7f5c3019da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:31.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.087+0000 7f5c2effd640 1 -- 172.21.15.16:0/1846460040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c300fe8a0 msgr2=0x7f5c3019da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:31.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.087+0000 7f5c2effd640 1 --2- 172.21.15.16:0/1846460040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c300fe8a0 0x7f5c3019da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:31.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.087+0000 7f5c2effd640 1 -- 172.21.15.16:0/1846460040 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c20009560 con 0x7f5c300ff250 2024-08-01T06:52:31.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.087+0000 7f5c2effd640 1 --2- 172.21.15.16:0/1846460040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c300ff250 0x7f5c3019df80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400c8f0 tx=0x7f5c2400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:31.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.087+0000 7f5c2cff9640 1 -- 172.21.15.16:0/1846460040 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c24007b80 con 0x7f5c300ff250 2024-08-01T06:52:31.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.087+0000 7f5c2cff9640 1 -- 172.21.15.16:0/1846460040 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c240054e0 con 0x7f5c300ff250 2024-08-01T06:52:31.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.088+0000 7f5c2cff9640 1 -- 172.21.15.16:0/1846460040 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c2400f450 con 0x7f5c300ff250 2024-08-01T06:52:31.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.088+0000 7f5c36154640 1 -- 172.21.15.16:0/1846460040 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c30197e10 con 0x7f5c300ff250 2024-08-01T06:52:31.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.088+0000 7f5c36154640 1 -- 172.21.15.16:0/1846460040 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c30198360 con 0x7f5c300ff250 2024-08-01T06:52:31.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.089+0000 7f5c36154640 1 -- 172.21.15.16:0/1846460040 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5c3010f170 con 0x7f5c300ff250 2024-08-01T06:52:31.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.090+0000 7f5c2cff9640 1 -- 172.21.15.16:0/1846460040 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5c24004f60 con 0x7f5c300ff250 2024-08-01T06:52:31.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.091+0000 7f5c2cff9640 1 --2- 172.21.15.16:0/1846460040 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f5c1806cc50 0x7f5c1806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:31.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.091+0000 7f5c2cff9640 1 -- 172.21.15.16:0/1846460040 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f5c2408b900 con 0x7f5c300ff250 2024-08-01T06:52:31.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.091+0000 7f5c2f7fe640 1 --2- 172.21.15.16:0/1846460040 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f5c1806cc50 0x7f5c1806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:31.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.091+0000 7f5c2cff9640 1 --2- 172.21.15.16:0/1846460040 >> [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750] conn(0x7f5c180729e0 0x7f5c18074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:31.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.091+0000 7f5c2cff9640 1 -- 172.21.15.16:0/1846460040 --> [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5c180754b0 con 0x7f5c180729e0 2024-08-01T06:52:31.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.091+0000 7f5c2cff9640 1 -- 172.21.15.16:0/1846460040 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c240902a0 con 0x7f5c300ff250 2024-08-01T06:52:31.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.092+0000 7f5c2ffff640 1 --2- 172.21.15.16:0/1846460040 >> [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750] conn(0x7f5c180729e0 0x7f5c18074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:31.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.092+0000 7f5c2f7fe640 1 --2- 172.21.15.16:0/1846460040 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f5c1806cc50 0x7f5c1806f110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009230 tx=0x7f5c200058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:31.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.092+0000 7f5c2ffff640 1 --2- 172.21.15.16:0/1846460040 >> [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750] conn(0x7f5c180729e0 0x7f5c18074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:31.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.093+0000 7f5c2cff9640 1 -- 172.21.15.16:0/1846460040 <== osd.0 v2:172.21.15.16:6802/1985422750 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f5c180754b0 con 0x7f5c180729e0 2024-08-01T06:52:31.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.106+0000 7f5c36154640 1 -- 172.21.15.16:0/1846460040 --> [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5c30198870 con 0x7f5c180729e0 2024-08-01T06:52:31.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.106+0000 7f5c2cff9640 1 -- 172.21.15.16:0/1846460040 <== osd.0 v2:172.21.15.16:6802/1985422750 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5c30198870 con 0x7f5c180729e0 2024-08-01T06:52:31.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.106+0000 7f5c36154640 1 -- 172.21.15.16:0/1846460040 >> [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750] conn(0x7f5c180729e0 msgr2=0x7f5c18074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:31.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.106+0000 7f5c36154640 1 --2- 172.21.15.16:0/1846460040 >> [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750] conn(0x7f5c180729e0 0x7f5c18074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:31.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.107+0000 7f5c36154640 1 -- 172.21.15.16:0/1846460040 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f5c1806cc50 msgr2=0x7f5c1806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:31.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.107+0000 7f5c36154640 1 --2- 172.21.15.16:0/1846460040 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f5c1806cc50 0x7f5c1806f110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009230 tx=0x7f5c200058d0 comp rx=0 tx=0).stop 2024-08-01T06:52:31.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.107+0000 7f5c36154640 1 -- 172.21.15.16:0/1846460040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c300ff250 msgr2=0x7f5c3019df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:31.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.107+0000 7f5c36154640 1 --2- 172.21.15.16:0/1846460040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c300ff250 0x7f5c3019df80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400c8f0 tx=0x7f5c2400cdb0 comp rx=0 tx=0).stop 2024-08-01T06:52:31.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.107+0000 7f5c36154640 1 -- 172.21.15.16:0/1846460040 shutdown_connections 2024-08-01T06:52:31.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.107+0000 7f5c36154640 1 --2- 172.21.15.16:0/1846460040 >> [v2:172.21.15.16:6802/1985422750,v1:172.21.15.16:6803/1985422750] conn(0x7f5c180729e0 0x7f5c18074e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:31.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.107+0000 7f5c36154640 1 --2- 172.21.15.16:0/1846460040 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f5c1806cc50 0x7f5c1806f110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:31.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.107+0000 7f5c36154640 1 --2- 172.21.15.16:0/1846460040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c300ff250 0x7f5c3019df80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:31.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.107+0000 7f5c36154640 1 --2- 172.21.15.16:0/1846460040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c300fe8a0 0x7f5c3019da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:31.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.107+0000 7f5c36154640 1 -- 172.21.15.16:0/1846460040 >> 172.21.15.16:0/1846460040 conn(0x7f5c300758a0 msgr2=0x7f5c300fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:31.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.107+0000 7f5c36154640 1 -- 172.21.15.16:0/1846460040 shutdown_connections 2024-08-01T06:52:31.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:31.107+0000 7f5c36154640 1 -- 172.21.15.16:0/1846460040 wait complete. 2024-08-01T06:52:31.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:30 smithi089 ceph-mon[36617]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:32.257 INFO:teuthology.orchestra.run.smithi016.stdout:38654705700 2024-08-01T06:52:32.257 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-01T06:52:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:32 smithi089 ceph-mon[36617]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:32 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:52:32.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:32 smithi016 ceph-mon[29266]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:32.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:32 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:52:33.133 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:33.134 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:33.157 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:34.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.731+0000 7ff2b7851640 1 -- 172.21.15.16:0/4001290129 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2b0104a40 msgr2=0x7ff2b0104e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:34.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.731+0000 7ff2b7851640 1 --2- 172.21.15.16:0/4001290129 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2b0104a40 0x7ff2b0104e20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac009880 tx=0x7ff2ac02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:52:34.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.731+0000 7ff2b7851640 1 -- 172.21.15.16:0/4001290129 shutdown_connections 2024-08-01T06:52:34.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.731+0000 7ff2b7851640 1 --2- 172.21.15.16:0/4001290129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2b00fea40 0x7ff2b00feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:34.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.731+0000 7ff2b7851640 1 --2- 172.21.15.16:0/4001290129 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2b0104a40 0x7ff2b0104e20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:34.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.731+0000 7ff2b7851640 1 -- 172.21.15.16:0/4001290129 >> 172.21.15.16:0/4001290129 conn(0x7ff2b00fa700 msgr2=0x7ff2b00fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:34.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.731+0000 7ff2b7851640 1 -- 172.21.15.16:0/4001290129 shutdown_connections 2024-08-01T06:52:34.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.731+0000 7ff2b7851640 1 -- 172.21.15.16:0/4001290129 wait complete. 2024-08-01T06:52:34.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.732+0000 7ff2b7851640 1 Processor -- start 2024-08-01T06:52:34.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.732+0000 7ff2b7851640 1 -- start start 2024-08-01T06:52:34.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.732+0000 7ff2b7851640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2b00fea40 0x7ff2b0194720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:34.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.732+0000 7ff2b7851640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2b0104a40 0x7ff2b0194c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:34.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.732+0000 7ff2b7851640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b01951a0 con 0x7ff2b00fea40 2024-08-01T06:52:34.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.732+0000 7ff2b7851640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b0195310 con 0x7ff2b0104a40 2024-08-01T06:52:34.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.732+0000 7ff2b55ed640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2b00fea40 0x7ff2b0194720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:34.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.732+0000 7ff2b55ed640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2b00fea40 0x7ff2b0194720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40202/0 (socket says 172.21.15.16:40202) 2024-08-01T06:52:34.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.732+0000 7ff2b55ed640 1 -- 172.21.15.16:0/3929065744 learned_addr learned my addr 172.21.15.16:0/3929065744 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:34.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.733+0000 7ff2b4dec640 1 --2- 172.21.15.16:0/3929065744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2b0104a40 0x7ff2b0194c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:34.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.733+0000 7ff2b55ed640 1 -- 172.21.15.16:0/3929065744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2b0104a40 msgr2=0x7ff2b0194c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:34.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.733+0000 7ff2b55ed640 1 --2- 172.21.15.16:0/3929065744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2b0104a40 0x7ff2b0194c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:34.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.733+0000 7ff2b55ed640 1 -- 172.21.15.16:0/3929065744 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ac009560 con 0x7ff2b00fea40 2024-08-01T06:52:34.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.733+0000 7ff2b55ed640 1 --2- 172.21.15.16:0/3929065744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2b00fea40 0x7ff2b0194720 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac006010 tx=0x7ff2ac0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:34.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.733+0000 7ff2a67fc640 1 -- 172.21.15.16:0/3929065744 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2ac004aa0 con 0x7ff2b00fea40 2024-08-01T06:52:34.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.733+0000 7ff2a67fc640 1 -- 172.21.15.16:0/3929065744 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2ac031470 con 0x7ff2b00fea40 2024-08-01T06:52:34.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.733+0000 7ff2b7851640 1 -- 172.21.15.16:0/3929065744 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b0195590 con 0x7ff2b00fea40 2024-08-01T06:52:34.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.733+0000 7ff2a67fc640 1 -- 172.21.15.16:0/3929065744 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2ac003940 con 0x7ff2b00fea40 2024-08-01T06:52:34.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.733+0000 7ff2b7851640 1 -- 172.21.15.16:0/3929065744 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b01a2010 con 0x7ff2b00fea40 2024-08-01T06:52:34.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.734+0000 7ff2b7851640 1 -- 172.21.15.16:0/3929065744 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b0100180 con 0x7ff2b00fea40 2024-08-01T06:52:34.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.735+0000 7ff2a67fc640 1 -- 172.21.15.16:0/3929065744 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff2ac031b90 con 0x7ff2b00fea40 2024-08-01T06:52:34.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.735+0000 7ff2a67fc640 1 --2- 172.21.15.16:0/3929065744 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff29c06cc60 0x7ff29c06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:34.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.735+0000 7ff2a67fc640 1 -- 172.21.15.16:0/3929065744 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff2ac0acea0 con 0x7ff2b00fea40 2024-08-01T06:52:34.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.735+0000 7ff2b4dec640 1 --2- 172.21.15.16:0/3929065744 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff29c06cc60 0x7ff29c06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:34.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.736+0000 7ff2b4dec640 1 --2- 172.21.15.16:0/3929065744 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff29c06cc60 0x7ff29c06f120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0005fd0 tx=0x7ff2a0005850 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:34.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.740+0000 7ff2a67fc640 1 -- 172.21.15.16:0/3929065744 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7ff2ac0775b0 con 0x7ff2b00fea40 2024-08-01T06:52:34.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:34 smithi089 ceph-mon[36617]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:34.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:34 smithi016 ceph-mon[29266]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:34.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.918+0000 7ff2b7851640 1 -- 172.21.15.16:0/3929065744 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff2b0195590 con 0x7ff2b00fea40 2024-08-01T06:52:34.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.918+0000 7ff2a67fc640 1 -- 172.21.15.16:0/3929065744 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2b0195590 con 0x7ff2b00fea40 2024-08-01T06:52:34.920 INFO:teuthology.orchestra.run.smithi016.stdout:167503724555 2024-08-01T06:52:34.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.920+0000 7ff2b7851640 1 -- 172.21.15.16:0/3929065744 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff29c06cc60 msgr2=0x7ff29c06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:34.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.920+0000 7ff2b7851640 1 --2- 172.21.15.16:0/3929065744 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff29c06cc60 0x7ff29c06f120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0005fd0 tx=0x7ff2a0005850 comp rx=0 tx=0).stop 2024-08-01T06:52:34.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.920+0000 7ff2b7851640 1 -- 172.21.15.16:0/3929065744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2b00fea40 msgr2=0x7ff2b0194720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:34.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.920+0000 7ff2b7851640 1 --2- 172.21.15.16:0/3929065744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2b00fea40 0x7ff2b0194720 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac006010 tx=0x7ff2ac0055a0 comp rx=0 tx=0).stop 2024-08-01T06:52:34.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.920+0000 7ff2b7851640 1 -- 172.21.15.16:0/3929065744 shutdown_connections 2024-08-01T06:52:34.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.920+0000 7ff2b7851640 1 --2- 172.21.15.16:0/3929065744 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff29c06cc60 0x7ff29c06f120 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:34.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.920+0000 7ff2b7851640 1 --2- 172.21.15.16:0/3929065744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2b0104a40 0x7ff2b0194c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:34.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.920+0000 7ff2b7851640 1 --2- 172.21.15.16:0/3929065744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2b00fea40 0x7ff2b0194720 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:34.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.920+0000 7ff2b7851640 1 -- 172.21.15.16:0/3929065744 >> 172.21.15.16:0/3929065744 conn(0x7ff2b00fa700 msgr2=0x7ff2b00fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:34.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.920+0000 7ff2b7851640 1 -- 172.21.15.16:0/3929065744 shutdown_connections 2024-08-01T06:52:34.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:34.920+0000 7ff2b7851640 1 -- 172.21.15.16:0/3929065744 wait complete. 2024-08-01T06:52:35.640 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724553 got 167503724555 for osd.5 2024-08-01T06:52:35.641 DEBUG:teuthology.parallel:result is None 2024-08-01T06:52:35.864 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:35 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3929065744' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-01T06:52:36.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:35 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/3929065744' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-01T06:52:36.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.727+0000 7fa0908aa640 1 -- 172.21.15.16:0/876497495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c104a30 msgr2=0x7fa08c104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:36.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.727+0000 7fa0908aa640 1 --2- 172.21.15.16:0/876497495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c104a30 0x7fa08c104e10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009880 tx=0x7fa07c02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:52:36.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.727+0000 7fa0908aa640 1 -- 172.21.15.16:0/876497495 shutdown_connections 2024-08-01T06:52:36.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.727+0000 7fa0908aa640 1 --2- 172.21.15.16:0/876497495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa08c0fea30 0x7fa08c0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:36.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.727+0000 7fa0908aa640 1 --2- 172.21.15.16:0/876497495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c104a30 0x7fa08c104e10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:36.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.727+0000 7fa0908aa640 1 -- 172.21.15.16:0/876497495 >> 172.21.15.16:0/876497495 conn(0x7fa08c0fa730 msgr2=0x7fa08c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:36.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.727+0000 7fa0908aa640 1 -- 172.21.15.16:0/876497495 shutdown_connections 2024-08-01T06:52:36.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.727+0000 7fa0908aa640 1 -- 172.21.15.16:0/876497495 wait complete. 2024-08-01T06:52:36.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.728+0000 7fa0908aa640 1 Processor -- start 2024-08-01T06:52:36.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.728+0000 7fa0908aa640 1 -- start start 2024-08-01T06:52:36.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.728+0000 7fa0908aa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c0fea30 0x7fa08c196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:36.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.728+0000 7fa0908aa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa08c104a30 0x7fa08c196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:36.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.728+0000 7fa0908aa640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c197380 con 0x7fa08c0fea30 2024-08-01T06:52:36.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.728+0000 7fa0908aa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c1974f0 con 0x7fa08c104a30 2024-08-01T06:52:36.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.728+0000 7fa08a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c0fea30 0x7fa08c196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:36.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.728+0000 7fa08a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c0fea30 0x7fa08c196900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40214/0 (socket says 172.21.15.16:40214) 2024-08-01T06:52:36.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.728+0000 7fa08a59c640 1 -- 172.21.15.16:0/1243355650 learned_addr learned my addr 172.21.15.16:0/1243355650 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:36.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.729+0000 7fa08a59c640 1 -- 172.21.15.16:0/1243355650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa08c104a30 msgr2=0x7fa08c196e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:36.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.729+0000 7fa08a59c640 1 --2- 172.21.15.16:0/1243355650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa08c104a30 0x7fa08c196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:36.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.729+0000 7fa08a59c640 1 -- 172.21.15.16:0/1243355650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c009560 con 0x7fa08c0fea30 2024-08-01T06:52:36.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.729+0000 7fa08a59c640 1 --2- 172.21.15.16:0/1243355650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c0fea30 0x7fa08c196900 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa07c006010 tx=0x7fa07c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:36.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.729+0000 7fa0837fe640 1 -- 172.21.15.16:0/1243355650 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa07c004aa0 con 0x7fa08c0fea30 2024-08-01T06:52:36.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.729+0000 7fa0908aa640 1 -- 172.21.15.16:0/1243355650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08c197770 con 0x7fa08c0fea30 2024-08-01T06:52:36.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.729+0000 7fa0837fe640 1 -- 172.21.15.16:0/1243355650 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa07c004c00 con 0x7fa08c0fea30 2024-08-01T06:52:36.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.729+0000 7fa0837fe640 1 -- 172.21.15.16:0/1243355650 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa07c003a20 con 0x7fa08c0fea30 2024-08-01T06:52:36.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.729+0000 7fa0908aa640 1 -- 172.21.15.16:0/1243355650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08c19fc50 con 0x7fa08c0fea30 2024-08-01T06:52:36.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.730+0000 7fa0908aa640 1 -- 172.21.15.16:0/1243355650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08c100170 con 0x7fa08c0fea30 2024-08-01T06:52:36.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.731+0000 7fa0837fe640 1 -- 172.21.15.16:0/1243355650 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa07c031c90 con 0x7fa08c0fea30 2024-08-01T06:52:36.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.731+0000 7fa0837fe640 1 --2- 172.21.15.16:0/1243355650 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fa07806cc60 0x7fa07806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:36.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.731+0000 7fa089d9b640 1 --2- 172.21.15.16:0/1243355650 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fa07806cc60 0x7fa07806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:36.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.731+0000 7fa0837fe640 1 -- 172.21.15.16:0/1243355650 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa07c0acf80 con 0x7fa08c0fea30 2024-08-01T06:52:36.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.732+0000 7fa089d9b640 1 --2- 172.21.15.16:0/1243355650 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fa07806cc60 0x7fa07806f120 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa08c068c90 tx=0x7fa074005c70 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:36.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.736+0000 7fa0837fe640 1 -- 172.21.15.16:0/1243355650 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fa07c077690 con 0x7fa08c0fea30 2024-08-01T06:52:36.748 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:36 smithi016 ceph-mon[29266]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:36.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.908+0000 7fa0908aa640 1 -- 172.21.15.16:0/1243355650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa08c197770 con 0x7fa08c0fea30 2024-08-01T06:52:36.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.908+0000 7fa0837fe640 1 -- 172.21.15.16:0/1243355650 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa08c197770 con 0x7fa08c0fea30 2024-08-01T06:52:36.910 INFO:teuthology.orchestra.run.smithi016.stdout:146028888079 2024-08-01T06:52:36.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.910+0000 7fa0908aa640 1 -- 172.21.15.16:0/1243355650 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fa07806cc60 msgr2=0x7fa07806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:36.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.910+0000 7fa0908aa640 1 --2- 172.21.15.16:0/1243355650 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fa07806cc60 0x7fa07806f120 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa08c068c90 tx=0x7fa074005c70 comp rx=0 tx=0).stop 2024-08-01T06:52:36.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.910+0000 7fa0908aa640 1 -- 172.21.15.16:0/1243355650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c0fea30 msgr2=0x7fa08c196900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:36.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.910+0000 7fa0908aa640 1 --2- 172.21.15.16:0/1243355650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c0fea30 0x7fa08c196900 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa07c006010 tx=0x7fa07c0055a0 comp rx=0 tx=0).stop 2024-08-01T06:52:36.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.910+0000 7fa0908aa640 1 -- 172.21.15.16:0/1243355650 shutdown_connections 2024-08-01T06:52:36.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.910+0000 7fa0908aa640 1 --2- 172.21.15.16:0/1243355650 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fa07806cc60 0x7fa07806f120 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:36.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.910+0000 7fa0908aa640 1 --2- 172.21.15.16:0/1243355650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa08c104a30 0x7fa08c196e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:36.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.910+0000 7fa0908aa640 1 --2- 172.21.15.16:0/1243355650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c0fea30 0x7fa08c196900 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:36.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.910+0000 7fa0908aa640 1 -- 172.21.15.16:0/1243355650 >> 172.21.15.16:0/1243355650 conn(0x7fa08c0fa730 msgr2=0x7fa08c0fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:36.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.911+0000 7fa0908aa640 1 -- 172.21.15.16:0/1243355650 shutdown_connections 2024-08-01T06:52:36.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:36.911+0000 7fa0908aa640 1 -- 172.21.15.16:0/1243355650 wait complete. 2024-08-01T06:52:37.038 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:36 smithi089 ceph-mon[36617]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:38.070 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:37 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/1243355650' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-01T06:52:38.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:37 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/1243355650' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-01T06:52:38.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:38 smithi016 ceph-mon[29266]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:39.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:38 smithi089 ceph-mon[36617]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:39.196 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888077 got 146028888079 for osd.4 2024-08-01T06:52:39.197 DEBUG:teuthology.parallel:result is None 2024-08-01T06:52:40.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:39 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/2788070017' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-01T06:52:40.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:39 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/2788070017' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-01T06:52:40.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.628+0000 7f9ccc32d640 1 -- 172.21.15.16:0/1661189127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cc4101610 msgr2=0x7f9cc4109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:40.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.628+0000 7f9ccc32d640 1 --2- 172.21.15.16:0/1661189127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cc4101610 0x7f9cc4109b00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40098b0 tx=0x7f9cb402a4d0 comp rx=0 tx=0).stop 2024-08-01T06:52:40.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.628+0000 7f9ccc32d640 1 -- 172.21.15.16:0/1661189127 shutdown_connections 2024-08-01T06:52:40.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.628+0000 7f9ccc32d640 1 --2- 172.21.15.16:0/1661189127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cc4101610 0x7f9cc4109b00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:40.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.628+0000 7f9ccc32d640 1 --2- 172.21.15.16:0/1661189127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cc4100c60 0x7f9cc4101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:40.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.628+0000 7f9ccc32d640 1 -- 172.21.15.16:0/1661189127 >> 172.21.15.16:0/1661189127 conn(0x7f9cc40fa730 msgr2=0x7f9cc40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:40.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.628+0000 7f9ccc32d640 1 -- 172.21.15.16:0/1661189127 shutdown_connections 2024-08-01T06:52:40.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.628+0000 7f9ccc32d640 1 -- 172.21.15.16:0/1661189127 wait complete. 2024-08-01T06:52:40.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.629+0000 7f9ccc32d640 1 Processor -- start 2024-08-01T06:52:40.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.629+0000 7f9ccc32d640 1 -- start start 2024-08-01T06:52:40.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.629+0000 7f9ccc32d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cc4100c60 0x7f9cc4197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:40.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.629+0000 7f9ccc32d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cc4101610 0x7f9cc4198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:40.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.629+0000 7f9ccc32d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc41989d0 con 0x7f9cc4101610 2024-08-01T06:52:40.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.629+0000 7f9ccc32d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc419c740 con 0x7f9cc4100c60 2024-08-01T06:52:40.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.629+0000 7f9cc98c8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cc4101610 0x7f9cc4198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:40.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.629+0000 7f9cc98c8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cc4101610 0x7f9cc4198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54996/0 (socket says 172.21.15.16:54996) 2024-08-01T06:52:40.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.629+0000 7f9cc98c8640 1 -- 172.21.15.16:0/4177690323 learned_addr learned my addr 172.21.15.16:0/4177690323 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:40.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.629+0000 7f9cca0c9640 1 --2- 172.21.15.16:0/4177690323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cc4100c60 0x7f9cc4197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:40.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.629+0000 7f9cc98c8640 1 -- 172.21.15.16:0/4177690323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cc4100c60 msgr2=0x7f9cc4197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:40.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.629+0000 7f9cc98c8640 1 --2- 172.21.15.16:0/4177690323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cc4100c60 0x7f9cc4197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:40.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.629+0000 7f9cc98c8640 1 -- 172.21.15.16:0/4177690323 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb4009560 con 0x7f9cc4101610 2024-08-01T06:52:40.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.629+0000 7f9cca0c9640 1 --2- 172.21.15.16:0/4177690323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cc4100c60 0x7f9cc4197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T06:52:40.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.630+0000 7f9cc98c8640 1 --2- 172.21.15.16:0/4177690323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cc4101610 0x7f9cc4198340 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4006010 tx=0x7f9cb40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:40.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.630+0000 7f9cbb7fe640 1 -- 172.21.15.16:0/4177690323 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cb4004aa0 con 0x7f9cc4101610 2024-08-01T06:52:40.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.630+0000 7f9cbb7fe640 1 -- 172.21.15.16:0/4177690323 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9cb4004c00 con 0x7f9cc4101610 2024-08-01T06:52:40.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.630+0000 7f9ccc32d640 1 -- 172.21.15.16:0/4177690323 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc419c9c0 con 0x7f9cc4101610 2024-08-01T06:52:40.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.630+0000 7f9cbb7fe640 1 -- 172.21.15.16:0/4177690323 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cb4003a20 con 0x7f9cc4101610 2024-08-01T06:52:40.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.630+0000 7f9ccc32d640 1 -- 172.21.15.16:0/4177690323 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc419ceb0 con 0x7f9cc4101610 2024-08-01T06:52:40.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.631+0000 7f9ccc32d640 1 -- 172.21.15.16:0/4177690323 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc4068d30 con 0x7f9cc4101610 2024-08-01T06:52:40.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.631+0000 7f9cbb7fe640 1 -- 172.21.15.16:0/4177690323 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9cb4003be0 con 0x7f9cc4101610 2024-08-01T06:52:40.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.632+0000 7f9cbb7fe640 1 --2- 172.21.15.16:0/4177690323 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f9cb006cc50 0x7f9cb006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:40.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.632+0000 7f9cbb7fe640 1 -- 172.21.15.16:0/4177690323 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f9cb40ad040 con 0x7f9cc4101610 2024-08-01T06:52:40.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.632+0000 7f9cca0c9640 1 --2- 172.21.15.16:0/4177690323 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f9cb006cc50 0x7f9cb006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:40.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.632+0000 7f9cca0c9640 1 --2- 172.21.15.16:0/4177690323 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f9cb006cc50 0x7f9cb006f110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009930 tx=0x7f9cc0008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:40.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.636+0000 7f9cbb7fe640 1 -- 172.21.15.16:0/4177690323 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f9cb40777d0 con 0x7f9cc4101610 2024-08-01T06:52:40.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.812+0000 7f9ccc32d640 1 -- 172.21.15.16:0/4177690323 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9cc41010c0 con 0x7f9cc4101610 2024-08-01T06:52:40.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.813+0000 7f9cbb7fe640 1 -- 172.21.15.16:0/4177690323 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9cb407adf0 con 0x7f9cc4101610 2024-08-01T06:52:40.814 INFO:teuthology.orchestra.run.smithi016.stdout:81604378650 2024-08-01T06:52:40.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.815+0000 7f9ccc32d640 1 -- 172.21.15.16:0/4177690323 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f9cb006cc50 msgr2=0x7f9cb006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:40.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.815+0000 7f9ccc32d640 1 --2- 172.21.15.16:0/4177690323 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f9cb006cc50 0x7f9cb006f110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009930 tx=0x7f9cc0008040 comp rx=0 tx=0).stop 2024-08-01T06:52:40.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.815+0000 7f9ccc32d640 1 -- 172.21.15.16:0/4177690323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cc4101610 msgr2=0x7f9cc4198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:40.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.815+0000 7f9ccc32d640 1 --2- 172.21.15.16:0/4177690323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cc4101610 0x7f9cc4198340 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4006010 tx=0x7f9cb40055a0 comp rx=0 tx=0).stop 2024-08-01T06:52:40.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.815+0000 7f9ccc32d640 1 -- 172.21.15.16:0/4177690323 shutdown_connections 2024-08-01T06:52:40.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.815+0000 7f9ccc32d640 1 --2- 172.21.15.16:0/4177690323 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f9cb006cc50 0x7f9cb006f110 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:40.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.815+0000 7f9ccc32d640 1 --2- 172.21.15.16:0/4177690323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cc4101610 0x7f9cc4198340 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:40.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.815+0000 7f9ccc32d640 1 --2- 172.21.15.16:0/4177690323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cc4100c60 0x7f9cc4197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:40.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.815+0000 7f9ccc32d640 1 -- 172.21.15.16:0/4177690323 >> 172.21.15.16:0/4177690323 conn(0x7f9cc40fa730 msgr2=0x7f9cc40fff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:40.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.815+0000 7f9ccc32d640 1 -- 172.21.15.16:0/4177690323 shutdown_connections 2024-08-01T06:52:40.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.815+0000 7f9ccc32d640 1 -- 172.21.15.16:0/4177690323 wait complete. 2024-08-01T06:52:40.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.971+0000 7f537958c640 1 -- 172.21.15.16:0/110229587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53741015d0 msgr2=0x7f5374109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:40.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.971+0000 7f537958c640 1 --2- 172.21.15.16:0/110229587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53741015d0 0x7f5374109ac0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5368009880 tx=0x7f536802a530 comp rx=0 tx=0).stop 2024-08-01T06:52:40.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.972+0000 7f537958c640 1 -- 172.21.15.16:0/110229587 shutdown_connections 2024-08-01T06:52:40.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.972+0000 7f537958c640 1 --2- 172.21.15.16:0/110229587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53741015d0 0x7f5374109ac0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:40.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.972+0000 7f537958c640 1 --2- 172.21.15.16:0/110229587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5374100cb0 0x7f5374101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:40.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.972+0000 7f537958c640 1 -- 172.21.15.16:0/110229587 >> 172.21.15.16:0/110229587 conn(0x7f53740758a0 msgr2=0x7f53740fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:40.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.972+0000 7f537958c640 1 -- 172.21.15.16:0/110229587 shutdown_connections 2024-08-01T06:52:40.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.972+0000 7f537958c640 1 -- 172.21.15.16:0/110229587 wait complete. 2024-08-01T06:52:40.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.972+0000 7f537958c640 1 Processor -- start 2024-08-01T06:52:40.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.972+0000 7f537958c640 1 -- start start 2024-08-01T06:52:40.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.973+0000 7f537958c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5374100cb0 0x7f537419b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:40.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.973+0000 7f537958c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53741015d0 0x7f537419bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:40.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.973+0000 7f537958c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537419c390 con 0x7f5374100cb0 2024-08-01T06:52:40.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.973+0000 7f537958c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5374195920 con 0x7f53741015d0 2024-08-01T06:52:40.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.973+0000 7f5372ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5374100cb0 0x7f537419b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:40.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.973+0000 7f5372ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5374100cb0 0x7f537419b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55016/0 (socket says 172.21.15.16:55016) 2024-08-01T06:52:40.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.973+0000 7f5372ffd640 1 -- 172.21.15.16:0/1034099043 learned_addr learned my addr 172.21.15.16:0/1034099043 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:40.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.973+0000 7f53727fc640 1 --2- 172.21.15.16:0/1034099043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53741015d0 0x7f537419bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:40.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.973+0000 7f5372ffd640 1 -- 172.21.15.16:0/1034099043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53741015d0 msgr2=0x7f537419bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:40.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.973+0000 7f5372ffd640 1 --2- 172.21.15.16:0/1034099043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53741015d0 0x7f537419bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:40.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.973+0000 7f5372ffd640 1 -- 172.21.15.16:0/1034099043 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5368009560 con 0x7f5374100cb0 2024-08-01T06:52:40.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.973+0000 7f5372ffd640 1 --2- 172.21.15.16:0/1034099043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5374100cb0 0x7f537419b830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f536400cc60 tx=0x7f536400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:40.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.973+0000 7f535bfff640 1 -- 172.21.15.16:0/1034099043 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5364004b20 con 0x7f5374100cb0 2024-08-01T06:52:40.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.973+0000 7f535bfff640 1 -- 172.21.15.16:0/1034099043 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5364004c80 con 0x7f5374100cb0 2024-08-01T06:52:40.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.973+0000 7f537958c640 1 -- 172.21.15.16:0/1034099043 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5374195c00 con 0x7f5374100cb0 2024-08-01T06:52:40.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.973+0000 7f535bfff640 1 -- 172.21.15.16:0/1034099043 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f536400f750 con 0x7f5374100cb0 2024-08-01T06:52:40.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.973+0000 7f537958c640 1 -- 172.21.15.16:0/1034099043 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5374196120 con 0x7f5374100cb0 2024-08-01T06:52:40.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.974+0000 7f537958c640 1 -- 172.21.15.16:0/1034099043 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5374068510 con 0x7f5374100cb0 2024-08-01T06:52:40.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.975+0000 7f535bfff640 1 -- 172.21.15.16:0/1034099043 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f536400f9c0 con 0x7f5374100cb0 2024-08-01T06:52:40.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.975+0000 7f535bfff640 1 --2- 172.21.15.16:0/1034099043 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f535c06cc50 0x7f535c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:40.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.975+0000 7f535bfff640 1 -- 172.21.15.16:0/1034099043 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f536408c010 con 0x7f5374100cb0 2024-08-01T06:52:40.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.975+0000 7f53727fc640 1 --2- 172.21.15.16:0/1034099043 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f535c06cc50 0x7f535c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:40.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.976+0000 7f53727fc640 1 --2- 172.21.15.16:0/1034099043 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f535c06cc50 0x7f535c06f110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5368009230 tx=0x7f53680058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:40.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:40.980+0000 7f535bfff640 1 -- 172.21.15.16:0/1034099043 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f53640567d0 con 0x7f5374100cb0 2024-08-01T06:52:41.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:40 smithi016 ceph-mon[29266]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:41.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:40 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/4177690323' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-01T06:52:41.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:41.152+0000 7f537958c640 1 -- 172.21.15.16:0/1034099043 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5374101090 con 0x7f5374100cb0 2024-08-01T06:52:41.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:41.152+0000 7f535bfff640 1 -- 172.21.15.16:0/1034099043 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f536401d020 con 0x7f5374100cb0 2024-08-01T06:52:41.154 INFO:teuthology.orchestra.run.smithi016.stdout:111669149718 2024-08-01T06:52:41.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:41.154+0000 7f537958c640 1 -- 172.21.15.16:0/1034099043 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f535c06cc50 msgr2=0x7f535c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:41.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:41.154+0000 7f537958c640 1 --2- 172.21.15.16:0/1034099043 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f535c06cc50 0x7f535c06f110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5368009230 tx=0x7f53680058d0 comp rx=0 tx=0).stop 2024-08-01T06:52:41.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:41.154+0000 7f537958c640 1 -- 172.21.15.16:0/1034099043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5374100cb0 msgr2=0x7f537419b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:41.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:41.154+0000 7f537958c640 1 --2- 172.21.15.16:0/1034099043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5374100cb0 0x7f537419b830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f536400cc60 tx=0x7f536400a620 comp rx=0 tx=0).stop 2024-08-01T06:52:41.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:41.154+0000 7f537958c640 1 -- 172.21.15.16:0/1034099043 shutdown_connections 2024-08-01T06:52:41.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:41.154+0000 7f537958c640 1 --2- 172.21.15.16:0/1034099043 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f535c06cc50 0x7f535c06f110 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:41.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:41.154+0000 7f537958c640 1 --2- 172.21.15.16:0/1034099043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53741015d0 0x7f537419bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:41.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:41.154+0000 7f537958c640 1 --2- 172.21.15.16:0/1034099043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5374100cb0 0x7f537419b830 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:41.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:41.154+0000 7f537958c640 1 -- 172.21.15.16:0/1034099043 >> 172.21.15.16:0/1034099043 conn(0x7f53740758a0 msgr2=0x7f5374101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:41.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:41.155+0000 7f537958c640 1 -- 172.21.15.16:0/1034099043 shutdown_connections 2024-08-01T06:52:41.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:41.155+0000 7f537958c640 1 -- 172.21.15.16:0/1034099043 wait complete. 2024-08-01T06:52:41.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:40 smithi089 ceph-mon[36617]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:41.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:40 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/4177690323' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-01T06:52:41.936 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149716 got 111669149718 for osd.3 2024-08-01T06:52:41.936 DEBUG:teuthology.parallel:result is None 2024-08-01T06:52:42.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.664+0000 7f18df5a9640 1 -- 172.21.15.16:0/4118821244 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18d8100cb0 msgr2=0x7f18d8101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:42.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.664+0000 7f18df5a9640 1 --2- 172.21.15.16:0/4118821244 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18d8100cb0 0x7f18d8101090 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009880 tx=0x7f18d402a530 comp rx=0 tx=0).stop 2024-08-01T06:52:42.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.664+0000 7f18df5a9640 1 -- 172.21.15.16:0/4118821244 shutdown_connections 2024-08-01T06:52:42.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.664+0000 7f18df5a9640 1 --2- 172.21.15.16:0/4118821244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18d81015d0 0x7f18d8109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:42.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.664+0000 7f18df5a9640 1 --2- 172.21.15.16:0/4118821244 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18d8100cb0 0x7f18d8101090 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:42.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.664+0000 7f18df5a9640 1 -- 172.21.15.16:0/4118821244 >> 172.21.15.16:0/4118821244 conn(0x7f18d80758a0 msgr2=0x7f18d80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:42.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.664+0000 7f18df5a9640 1 -- 172.21.15.16:0/4118821244 shutdown_connections 2024-08-01T06:52:42.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.664+0000 7f18df5a9640 1 -- 172.21.15.16:0/4118821244 wait complete. 2024-08-01T06:52:42.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.665+0000 7f18df5a9640 1 Processor -- start 2024-08-01T06:52:42.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.665+0000 7f18df5a9640 1 -- start start 2024-08-01T06:52:42.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.665+0000 7f18df5a9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18d8100cb0 0x7f18d819b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:42.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.665+0000 7f18df5a9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18d81015d0 0x7f18d819bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:42.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.665+0000 7f18df5a9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d819c410 con 0x7f18d8100cb0 2024-08-01T06:52:42.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.665+0000 7f18df5a9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d81959a0 con 0x7f18d81015d0 2024-08-01T06:52:42.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.665+0000 7f18dd345640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18d8100cb0 0x7f18d819b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:42.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.665+0000 7f18dd345640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18d8100cb0 0x7f18d819b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54978/0 (socket says 172.21.15.16:54978) 2024-08-01T06:52:42.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.665+0000 7f18dd345640 1 -- 172.21.15.16:0/2788070017 learned_addr learned my addr 172.21.15.16:0/2788070017 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:42.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.665+0000 7f18dcb44640 1 --2- 172.21.15.16:0/2788070017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18d81015d0 0x7f18d819bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:42.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.665+0000 7f18dd345640 1 -- 172.21.15.16:0/2788070017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18d81015d0 msgr2=0x7f18d819bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:42.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.665+0000 7f18dd345640 1 --2- 172.21.15.16:0/2788070017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18d81015d0 0x7f18d819bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:42.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.665+0000 7f18dd345640 1 -- 172.21.15.16:0/2788070017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d4009560 con 0x7f18d8100cb0 2024-08-01T06:52:42.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.666+0000 7f18dd345640 1 --2- 172.21.15.16:0/2788070017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18d8100cb0 0x7f18d819b8b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f18d402aa50 tx=0x7f18d40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:42.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.666+0000 7f18ce7fc640 1 -- 172.21.15.16:0/2788070017 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18d4004aa0 con 0x7f18d8100cb0 2024-08-01T06:52:42.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.666+0000 7f18ce7fc640 1 -- 172.21.15.16:0/2788070017 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f18d4004c00 con 0x7f18d8100cb0 2024-08-01T06:52:42.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.666+0000 7f18df5a9640 1 -- 172.21.15.16:0/2788070017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d8195c20 con 0x7f18d8100cb0 2024-08-01T06:52:42.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.666+0000 7f18ce7fc640 1 -- 172.21.15.16:0/2788070017 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18d4003980 con 0x7f18d8100cb0 2024-08-01T06:52:42.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.666+0000 7f18df5a9640 1 -- 172.21.15.16:0/2788070017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d8196110 con 0x7f18d8100cb0 2024-08-01T06:52:42.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.667+0000 7f18df5a9640 1 -- 172.21.15.16:0/2788070017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d8068510 con 0x7f18d8100cb0 2024-08-01T06:52:42.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.667+0000 7f18ce7fc640 1 -- 172.21.15.16:0/2788070017 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f18d402ad50 con 0x7f18d8100cb0 2024-08-01T06:52:42.008 INFO:teuthology.orchestra.run.smithi016.stdout:60129542176 2024-08-01T06:52:42.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.668+0000 7f18ce7fc640 1 --2- 172.21.15.16:0/2788070017 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f18c406cc50 0x7f18c406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:42.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.668+0000 7f18ce7fc640 1 -- 172.21.15.16:0/2788070017 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f18d40acd10 con 0x7f18d8100cb0 2024-08-01T06:52:42.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.668+0000 7f18dcb44640 1 --2- 172.21.15.16:0/2788070017 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f18c406cc50 0x7f18c406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:42.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.668+0000 7f18dcb44640 1 --2- 172.21.15.16:0/2788070017 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f18c406cc50 0x7f18c406f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18c80058c0 tx=0x7f18c8005850 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:42.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.674+0000 7f18ce7fc640 1 -- 172.21.15.16:0/2788070017 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f18d4077420 con 0x7f18d8100cb0 2024-08-01T06:52:42.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.848+0000 7f18df5a9640 1 -- 172.21.15.16:0/2788070017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f18d8104340 con 0x7f18d8100cb0 2024-08-01T06:52:42.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.848+0000 7f18ce7fc640 1 -- 172.21.15.16:0/2788070017 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f18d407aa40 con 0x7f18d8100cb0 2024-08-01T06:52:42.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.851+0000 7f18df5a9640 1 -- 172.21.15.16:0/2788070017 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f18c406cc50 msgr2=0x7f18c406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:42.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.851+0000 7f18df5a9640 1 --2- 172.21.15.16:0/2788070017 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f18c406cc50 0x7f18c406f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18c80058c0 tx=0x7f18c8005850 comp rx=0 tx=0).stop 2024-08-01T06:52:42.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.851+0000 7f18df5a9640 1 -- 172.21.15.16:0/2788070017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18d8100cb0 msgr2=0x7f18d819b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:42.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.851+0000 7f18df5a9640 1 --2- 172.21.15.16:0/2788070017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18d8100cb0 0x7f18d819b8b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f18d402aa50 tx=0x7f18d40055a0 comp rx=0 tx=0).stop 2024-08-01T06:52:42.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.851+0000 7f18df5a9640 1 -- 172.21.15.16:0/2788070017 shutdown_connections 2024-08-01T06:52:42.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.851+0000 7f18df5a9640 1 --2- 172.21.15.16:0/2788070017 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f18c406cc50 0x7f18c406f110 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:42.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.851+0000 7f18df5a9640 1 --2- 172.21.15.16:0/2788070017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18d81015d0 0x7f18d819bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:42.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.851+0000 7f18df5a9640 1 --2- 172.21.15.16:0/2788070017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18d8100cb0 0x7f18d819b8b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:42.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.851+0000 7f18df5a9640 1 -- 172.21.15.16:0/2788070017 >> 172.21.15.16:0/2788070017 conn(0x7f18d80758a0 msgr2=0x7f18d8101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:42.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.851+0000 7f18df5a9640 1 -- 172.21.15.16:0/2788070017 shutdown_connections 2024-08-01T06:52:42.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:39.851+0000 7f18df5a9640 1 -- 172.21.15.16:0/2788070017 wait complete. 2024-08-01T06:52:42.350 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:41 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/1034099043' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-01T06:52:42.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:41 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/1034099043' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-01T06:52:42.703 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542176 for osd.1 2024-08-01T06:52:42.703 DEBUG:teuthology.parallel:result is None 2024-08-01T06:52:42.777 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:43.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:42 smithi016 ceph-mon[29266]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:43.224 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378650 for osd.2 2024-08-01T06:52:43.225 DEBUG:teuthology.parallel:result is None 2024-08-01T06:52:43.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:42 smithi089 ceph-mon[36617]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:44.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.787+0000 7f022bebe640 1 -- 172.21.15.16:0/611761854 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02240fe9f0 msgr2=0x7f02240fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:44.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.787+0000 7f022bebe640 1 --2- 172.21.15.16:0/611761854 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02240fe9f0 0x7f02240fee50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0218009c20 tx=0x7f021802a970 comp rx=0 tx=0).stop 2024-08-01T06:52:44.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.787+0000 7f022bebe640 1 -- 172.21.15.16:0/611761854 shutdown_connections 2024-08-01T06:52:44.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.787+0000 7f022bebe640 1 --2- 172.21.15.16:0/611761854 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02240fe9f0 0x7f02240fee50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:44.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.787+0000 7f022bebe640 1 --2- 172.21.15.16:0/611761854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02241049f0 0x7f0224104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:44.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.787+0000 7f022bebe640 1 -- 172.21.15.16:0/611761854 >> 172.21.15.16:0/611761854 conn(0x7f02240758a0 msgr2=0x7f02240fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:44.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.788+0000 7f022bebe640 1 -- 172.21.15.16:0/611761854 shutdown_connections 2024-08-01T06:52:44.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.788+0000 7f022bebe640 1 -- 172.21.15.16:0/611761854 wait complete. 2024-08-01T06:52:44.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.788+0000 7f022bebe640 1 Processor -- start 2024-08-01T06:52:44.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.788+0000 7f022bebe640 1 -- start start 2024-08-01T06:52:44.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.788+0000 7f022bebe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02240fe9f0 0x7f0224196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:44.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.788+0000 7f022bebe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02241049f0 0x7f0224196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:44.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.788+0000 7f022bebe640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02241974e0 con 0x7f02241049f0 2024-08-01T06:52:44.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.788+0000 7f022bebe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0224197650 con 0x7f02240fe9f0 2024-08-01T06:52:44.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.788+0000 7f0229459640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02241049f0 0x7f0224196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:44.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.788+0000 7f0229459640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02241049f0 0x7f0224196fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55040/0 (socket says 172.21.15.16:55040) 2024-08-01T06:52:44.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.788+0000 7f0229459640 1 -- 172.21.15.16:0/2715855890 learned_addr learned my addr 172.21.15.16:0/2715855890 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:44.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.789+0000 7f0229c5a640 1 --2- 172.21.15.16:0/2715855890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02240fe9f0 0x7f0224196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:44.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.789+0000 7f0229459640 1 -- 172.21.15.16:0/2715855890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02240fe9f0 msgr2=0x7f0224196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:44.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.789+0000 7f0229459640 1 --2- 172.21.15.16:0/2715855890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02240fe9f0 0x7f0224196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:44.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.789+0000 7f0229459640 1 -- 172.21.15.16:0/2715855890 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0218009900 con 0x7f02241049f0 2024-08-01T06:52:44.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.789+0000 7f0229459640 1 --2- 172.21.15.16:0/2715855890 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02241049f0 0x7f0224196fa0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f021802ae90 tx=0x7f02180308a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:44.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.789+0000 7f0222ffd640 1 -- 172.21.15.16:0/2715855890 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f021802f590 con 0x7f02241049f0 2024-08-01T06:52:44.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.789+0000 7f0222ffd640 1 -- 172.21.15.16:0/2715855890 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0218030ca0 con 0x7f02241049f0 2024-08-01T06:52:44.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.789+0000 7f022bebe640 1 -- 172.21.15.16:0/2715855890 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02241978d0 con 0x7f02241049f0 2024-08-01T06:52:44.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.789+0000 7f022bebe640 1 -- 172.21.15.16:0/2715855890 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022419fe00 con 0x7f02241049f0 2024-08-01T06:52:44.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.789+0000 7f0222ffd640 1 -- 172.21.15.16:0/2715855890 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0218039450 con 0x7f02241049f0 2024-08-01T06:52:44.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.790+0000 7f022bebe640 1 -- 172.21.15.16:0/2715855890 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0224100130 con 0x7f02241049f0 2024-08-01T06:52:44.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.791+0000 7f0222ffd640 1 -- 172.21.15.16:0/2715855890 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f021800a040 con 0x7f02241049f0 2024-08-01T06:52:44.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.791+0000 7f0222ffd640 1 --2- 172.21.15.16:0/2715855890 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f020c06cc50 0x7f020c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:44.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.791+0000 7f0222ffd640 1 -- 172.21.15.16:0/2715855890 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f021802c040 con 0x7f02241049f0 2024-08-01T06:52:44.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.791+0000 7f0229c5a640 1 --2- 172.21.15.16:0/2715855890 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f020c06cc50 0x7f020c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:44.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.792+0000 7f0229c5a640 1 --2- 172.21.15.16:0/2715855890 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f020c06cc50 0x7f020c06f110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0214009990 tx=0x7f0214009110 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:44.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.796+0000 7f0222ffd640 1 -- 172.21.15.16:0/2715855890 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f0218077720 con 0x7f02241049f0 2024-08-01T06:52:44.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:44 smithi089 ceph-mon[36617]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:44.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:44 smithi016 ceph-mon[29266]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:44.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.967+0000 7f022bebe640 1 -- 172.21.15.16:0/2715855890 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f02240feed0 con 0x7f02241049f0 2024-08-01T06:52:44.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.967+0000 7f0222ffd640 1 -- 172.21.15.16:0/2715855890 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f021807ad40 con 0x7f02241049f0 2024-08-01T06:52:44.969 INFO:teuthology.orchestra.run.smithi016.stdout:38654705702 2024-08-01T06:52:44.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.969+0000 7f022bebe640 1 -- 172.21.15.16:0/2715855890 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f020c06cc50 msgr2=0x7f020c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:44.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.969+0000 7f022bebe640 1 --2- 172.21.15.16:0/2715855890 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f020c06cc50 0x7f020c06f110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0214009990 tx=0x7f0214009110 comp rx=0 tx=0).stop 2024-08-01T06:52:44.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.969+0000 7f022bebe640 1 -- 172.21.15.16:0/2715855890 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02241049f0 msgr2=0x7f0224196fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:44.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.969+0000 7f022bebe640 1 --2- 172.21.15.16:0/2715855890 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02241049f0 0x7f0224196fa0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f021802ae90 tx=0x7f02180308a0 comp rx=0 tx=0).stop 2024-08-01T06:52:44.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.969+0000 7f022bebe640 1 -- 172.21.15.16:0/2715855890 shutdown_connections 2024-08-01T06:52:44.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.969+0000 7f022bebe640 1 --2- 172.21.15.16:0/2715855890 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f020c06cc50 0x7f020c06f110 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:44.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.969+0000 7f022bebe640 1 --2- 172.21.15.16:0/2715855890 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02241049f0 0x7f0224196fa0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:44.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.969+0000 7f022bebe640 1 --2- 172.21.15.16:0/2715855890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02240fe9f0 0x7f0224196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:44.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.969+0000 7f022bebe640 1 -- 172.21.15.16:0/2715855890 >> 172.21.15.16:0/2715855890 conn(0x7f02240758a0 msgr2=0x7f02240fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:44.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.970+0000 7f022bebe640 1 -- 172.21.15.16:0/2715855890 shutdown_connections 2024-08-01T06:52:44.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:44.970+0000 7f022bebe640 1 -- 172.21.15.16:0/2715855890 wait complete. 2024-08-01T06:52:45.653 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705702 for osd.0 2024-08-01T06:52:45.653 DEBUG:teuthology.parallel:result is None 2024-08-01T06:52:45.654 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-01T06:52:45.654 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph pg dump --format=json 2024-08-01T06:52:45.880 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:45.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:45 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/2715855890' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-01T06:52:46.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:45 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/2715855890' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-01T06:52:46.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:46 smithi016 ceph-mon[29266]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:47.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:46 smithi089 ceph-mon[36617]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:47.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.517+0000 7fd8e6735640 1 -- 172.21.15.16:0/2998423045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8e0101670 msgr2=0x7fd8e0109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:47.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.517+0000 7fd8e6735640 1 --2- 172.21.15.16:0/2998423045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8e0101670 0x7fd8e0109b60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8009880 tx=0x7fd8c802a4a0 comp rx=0 tx=0).stop 2024-08-01T06:52:47.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.517+0000 7fd8e6735640 1 -- 172.21.15.16:0/2998423045 shutdown_connections 2024-08-01T06:52:47.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.517+0000 7fd8e6735640 1 --2- 172.21.15.16:0/2998423045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8e0101670 0x7fd8e0109b60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:47.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.517+0000 7fd8e6735640 1 --2- 172.21.15.16:0/2998423045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8e0100d50 0x7fd8e0101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:47.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.517+0000 7fd8e6735640 1 -- 172.21.15.16:0/2998423045 >> 172.21.15.16:0/2998423045 conn(0x7fd8e00fa730 msgr2=0x7fd8e00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:47.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.517+0000 7fd8e6735640 1 -- 172.21.15.16:0/2998423045 shutdown_connections 2024-08-01T06:52:47.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.517+0000 7fd8e6735640 1 -- 172.21.15.16:0/2998423045 wait complete. 2024-08-01T06:52:47.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.517+0000 7fd8e6735640 1 Processor -- start 2024-08-01T06:52:47.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.517+0000 7fd8e6735640 1 -- start start 2024-08-01T06:52:47.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.518+0000 7fd8e6735640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8e0100d50 0x7fd8e00fe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:47.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.518+0000 7fd8e6735640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8e0101670 0x7fd8e00feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:47.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.518+0000 7fd8e6735640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e00ff430 con 0x7fd8e0101670 2024-08-01T06:52:47.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.518+0000 7fd8e6735640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e00ff5a0 con 0x7fd8e0100d50 2024-08-01T06:52:47.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.518+0000 7fd8d7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8e0101670 0x7fd8e00feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:47.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.518+0000 7fd8d7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8e0101670 0x7fd8e00feef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55056/0 (socket says 172.21.15.16:55056) 2024-08-01T06:52:47.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.518+0000 7fd8d7fff640 1 -- 172.21.15.16:0/3661460401 learned_addr learned my addr 172.21.15.16:0/3661460401 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:47.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.518+0000 7fd8dffff640 1 --2- 172.21.15.16:0/3661460401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8e0100d50 0x7fd8e00fe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:47.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.518+0000 7fd8d7fff640 1 -- 172.21.15.16:0/3661460401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8e0100d50 msgr2=0x7fd8e00fe9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:47.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.518+0000 7fd8d7fff640 1 --2- 172.21.15.16:0/3661460401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8e0100d50 0x7fd8e00fe9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:47.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.518+0000 7fd8d7fff640 1 -- 172.21.15.16:0/3661460401 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c8009560 con 0x7fd8e0101670 2024-08-01T06:52:47.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.518+0000 7fd8d7fff640 1 --2- 172.21.15.16:0/3661460401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8e0101670 0x7fd8e00feef0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8006010 tx=0x7fd8c80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:47.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.518+0000 7fd8ddffb640 1 -- 172.21.15.16:0/3661460401 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8c8004aa0 con 0x7fd8e0101670 2024-08-01T06:52:47.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.518+0000 7fd8ddffb640 1 -- 172.21.15.16:0/3661460401 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd8c8004c00 con 0x7fd8e0101670 2024-08-01T06:52:47.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.518+0000 7fd8e6735640 1 -- 172.21.15.16:0/3661460401 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e01a1d50 con 0x7fd8e0101670 2024-08-01T06:52:47.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.518+0000 7fd8ddffb640 1 -- 172.21.15.16:0/3661460401 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8c80038f0 con 0x7fd8e0101670 2024-08-01T06:52:47.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.519+0000 7fd8e6735640 1 -- 172.21.15.16:0/3661460401 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e01a20b0 con 0x7fd8e0101670 2024-08-01T06:52:47.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.520+0000 7fd8e6735640 1 -- 172.21.15.16:0/3661460401 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e0068cd0 con 0x7fd8e0101670 2024-08-01T06:52:47.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.520+0000 7fd8ddffb640 1 -- 172.21.15.16:0/3661460401 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd8c8003b60 con 0x7fd8e0101670 2024-08-01T06:52:47.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.521+0000 7fd8ddffb640 1 --2- 172.21.15.16:0/3661460401 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd8cc06cc60 0x7fd8cc06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:47.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.521+0000 7fd8ddffb640 1 -- 172.21.15.16:0/3661460401 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd8c80acfe0 con 0x7fd8e0101670 2024-08-01T06:52:47.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.521+0000 7fd8dffff640 1 --2- 172.21.15.16:0/3661460401 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd8cc06cc60 0x7fd8cc06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:47.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.521+0000 7fd8dffff640 1 --2- 172.21.15.16:0/3661460401 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd8cc06cc60 0x7fd8cc06f120 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009990 tx=0x7fd8d0009110 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:47.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.525+0000 7fd8ddffb640 1 -- 172.21.15.16:0/3661460401 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fd8c8077730 con 0x7fd8e0101670 2024-08-01T06:52:47.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.694+0000 7fd8e6735640 1 -- 172.21.15.16:0/3661460401 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8e00ff760 con 0x7fd8cc06cc60 2024-08-01T06:52:47.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.695+0000 7fd8ddffb640 1 -- 172.21.15.16:0/3661460401 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28018 (secure 0 0 0) 0x7fd8e00ff760 con 0x7fd8cc06cc60 2024-08-01T06:52:47.698 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:52:47.698 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-08-01T06:52:47.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.698+0000 7fd8e6735640 1 -- 172.21.15.16:0/3661460401 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd8cc06cc60 msgr2=0x7fd8cc06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:47.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.698+0000 7fd8e6735640 1 --2- 172.21.15.16:0/3661460401 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd8cc06cc60 0x7fd8cc06f120 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009990 tx=0x7fd8d0009110 comp rx=0 tx=0).stop 2024-08-01T06:52:47.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.698+0000 7fd8e6735640 1 -- 172.21.15.16:0/3661460401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8e0101670 msgr2=0x7fd8e00feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:47.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.698+0000 7fd8e6735640 1 --2- 172.21.15.16:0/3661460401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8e0101670 0x7fd8e00feef0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8006010 tx=0x7fd8c80055a0 comp rx=0 tx=0).stop 2024-08-01T06:52:47.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.698+0000 7fd8e6735640 1 -- 172.21.15.16:0/3661460401 shutdown_connections 2024-08-01T06:52:47.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.698+0000 7fd8e6735640 1 --2- 172.21.15.16:0/3661460401 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd8cc06cc60 0x7fd8cc06f120 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:47.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.698+0000 7fd8e6735640 1 --2- 172.21.15.16:0/3661460401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8e0101670 0x7fd8e00feef0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:47.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.698+0000 7fd8e6735640 1 --2- 172.21.15.16:0/3661460401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8e0100d50 0x7fd8e00fe9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:47.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.698+0000 7fd8e6735640 1 -- 172.21.15.16:0/3661460401 >> 172.21.15.16:0/3661460401 conn(0x7fd8e00fa730 msgr2=0x7fd8e0101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:47.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.698+0000 7fd8e6735640 1 -- 172.21.15.16:0/3661460401 shutdown_connections 2024-08-01T06:52:47.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:47.698+0000 7fd8e6735640 1 -- 172.21.15.16:0/3661460401 wait complete. 2024-08-01T06:52:47.989 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:47 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:52:48.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:47 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:52:48.305 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-08-01T06:52:46.570526+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":198780,"kb_used_data":3876,"kb_used_omap":9,"kb_used_meta":194806,"kb_avail":562272132,"statfs":{"total":575970213888,"available":575766663168,"internally_reserved":0,"allocated":3969024,"data_stored":2609166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":199482022},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002344"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":187,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-01T06:51:57.480043+0000","last_change":"2024-08-01T06:51:31.084973+0000","last_active":"2024-08-01T06:51:57.480043+0000","last_peered":"2024-08-01T06:51:57.480043+0000","last_clean":"2024-08-01T06:51:57.480043+0000","last_became_active":"2024-08-01T06:51:31.084562+0000","last_became_peered":"2024-08-01T06:51:31.084562+0000","last_unstale":"2024-08-01T06:51:57.480043+0000","last_undegraded":"2024-08-01T06:51:57.480043+0000","last_fullsized":"2024-08-01T06:51:57.480043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-01T06:50:45.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-01T06:50:45.021630+0000","last_clean_scrub_stamp":"2024-08-01T06:50:45.021630+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-02T17:42:06.435780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31472,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713680,"statfs":{"total":95995035648,"available":95962808320,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":4,"up_from":34,"seq":146028888081,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31476,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713676,"statfs":{"total":95995035648,"available":95962804224,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 1 06:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Aug 1 06:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Aug 1 06:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.432}]},{"osd":3,"last update":"Thu Aug 1 06:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.307},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.35199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 1 06:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.57099999999999995}]},{"osd":1,"last update":"Thu Aug 1 06:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Aug 1 06:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":5.0949999999999998,"5min":5.0949999999999998,"15min":5.0949999999999998},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Aug 1 06:52:35 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.27000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":39668,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":93705484,"statfs":{"total":95995035648,"available":95954415616,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 1 06:51:44 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.38500000000000001}]},{"osd":1,"last update":"Thu Aug 1 06:51:44 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Aug 1 06:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Aug 1 06:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 1 06:52:20 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.23000000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.47199999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.33400000000000002,"15min":0.32800000000000001},"min":{"1min":0.27400000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.50900000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Aug 1 06:51:46 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.26000000000000001}]},{"osd":3,"last update":"Thu Aug 1 06:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Aug 1 06:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40248,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":93704904,"statfs":{"total":95995035648,"available":95953821696,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 1 06:52:18 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32000000000000001,"15min":0.318},"min":{"1min":0.221,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.442,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.317,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.22700000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.45200000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.36599999999999999}]},{"osd":2,"last update":"Thu Aug 1 06:51:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.38900000000000001}]},{"osd":3,"last update":"Thu Aug 1 06:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.442},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.502}]},{"osd":4,"last update":"Thu Aug 1 06:52:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-01T06:52:48.307 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph pg dump --format=json 2024-08-01T06:52:48.519 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:48.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:48 smithi016 ceph-mon[29266]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-01T06:52:48.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:48 smithi016 ceph-mon[29266]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:49.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:48 smithi089 ceph-mon[36617]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-01T06:52:49.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:48 smithi089 ceph-mon[36617]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:50.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.132+0000 7f1b2163e640 1 -- 172.21.15.16:0/2232550136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c100c60 msgr2=0x7f1b1c101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:50.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.132+0000 7f1b2163e640 1 --2- 172.21.15.16:0/2232550136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c100c60 0x7f1b1c101040 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0098b0 tx=0x7f1b0c02a4d0 comp rx=0 tx=0).stop 2024-08-01T06:52:50.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.132+0000 7f1b2163e640 1 -- 172.21.15.16:0/2232550136 shutdown_connections 2024-08-01T06:52:50.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.132+0000 7f1b2163e640 1 --2- 172.21.15.16:0/2232550136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b1c101610 0x7f1b1c109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:50.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.132+0000 7f1b2163e640 1 --2- 172.21.15.16:0/2232550136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c100c60 0x7f1b1c101040 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:50.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.132+0000 7f1b2163e640 1 -- 172.21.15.16:0/2232550136 >> 172.21.15.16:0/2232550136 conn(0x7f1b1c0fa730 msgr2=0x7f1b1c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:50.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.132+0000 7f1b2163e640 1 -- 172.21.15.16:0/2232550136 shutdown_connections 2024-08-01T06:52:50.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.132+0000 7f1b2163e640 1 -- 172.21.15.16:0/2232550136 wait complete. 2024-08-01T06:52:50.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.133+0000 7f1b2163e640 1 Processor -- start 2024-08-01T06:52:50.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.133+0000 7f1b2163e640 1 -- start start 2024-08-01T06:52:50.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.134+0000 7f1b2163e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b1c100c60 0x7f1b1c19b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.134+0000 7f1b2163e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c101610 0x7f1b1c19bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.134+0000 7f1b2163e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c19c3a0 con 0x7f1b1c101610 2024-08-01T06:52:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.134+0000 7f1b2163e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c195930 con 0x7f1b1c100c60 2024-08-01T06:52:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.134+0000 7f1b1a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c101610 0x7f1b1c19bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.134+0000 7f1b1a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c101610 0x7f1b1c19bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56124/0 (socket says 172.21.15.16:56124) 2024-08-01T06:52:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.134+0000 7f1b1a7fc640 1 -- 172.21.15.16:0/1158799355 learned_addr learned my addr 172.21.15.16:0/1158799355 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.134+0000 7f1b1affd640 1 --2- 172.21.15.16:0/1158799355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b1c100c60 0x7f1b1c19b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.134+0000 7f1b1a7fc640 1 -- 172.21.15.16:0/1158799355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b1c100c60 msgr2=0x7f1b1c19b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.134+0000 7f1b1a7fc640 1 --2- 172.21.15.16:0/1158799355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b1c100c60 0x7f1b1c19b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.134+0000 7f1b1a7fc640 1 -- 172.21.15.16:0/1158799355 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c009560 con 0x7f1b1c101610 2024-08-01T06:52:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.134+0000 7f1b1a7fc640 1 --2- 172.21.15.16:0/1158799355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c101610 0x7f1b1c19bd80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000d6f0 tx=0x7f1b1000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.134+0000 7f1b03fff640 1 -- 172.21.15.16:0/1158799355 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b10009a30 con 0x7f1b1c101610 2024-08-01T06:52:50.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.134+0000 7f1b2163e640 1 -- 172.21.15.16:0/1158799355 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b1c195c10 con 0x7f1b1c101610 2024-08-01T06:52:50.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.134+0000 7f1b03fff640 1 -- 172.21.15.16:0/1158799355 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1b100054e0 con 0x7f1b1c101610 2024-08-01T06:52:50.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.134+0000 7f1b03fff640 1 -- 172.21.15.16:0/1158799355 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b10010460 con 0x7f1b1c101610 2024-08-01T06:52:50.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.134+0000 7f1b2163e640 1 -- 172.21.15.16:0/1158799355 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1c196160 con 0x7f1b1c101610 2024-08-01T06:52:50.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.135+0000 7f1b2163e640 1 -- 172.21.15.16:0/1158799355 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1c068d30 con 0x7f1b1c101610 2024-08-01T06:52:50.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.136+0000 7f1b03fff640 1 -- 172.21.15.16:0/1158799355 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1b10009b90 con 0x7f1b1c101610 2024-08-01T06:52:50.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.136+0000 7f1b03fff640 1 --2- 172.21.15.16:0/1158799355 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f1b0406cc50 0x7f1b0406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:50.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.136+0000 7f1b03fff640 1 -- 172.21.15.16:0/1158799355 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f1b1008bac0 con 0x7f1b1c101610 2024-08-01T06:52:50.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.136+0000 7f1b1affd640 1 --2- 172.21.15.16:0/1158799355 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f1b0406cc50 0x7f1b0406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:50.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.137+0000 7f1b1affd640 1 --2- 172.21.15.16:0/1158799355 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f1b0406cc50 0x7f1b0406f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009230 tx=0x7f1b0c005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:50.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.141+0000 7f1b03fff640 1 -- 172.21.15.16:0/1158799355 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f1b100561d0 con 0x7f1b1c101610 2024-08-01T06:52:50.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.309+0000 7f1b2163e640 1 -- 172.21.15.16:0/1158799355 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b1c104380 con 0x7f1b0406cc50 2024-08-01T06:52:50.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.310+0000 7f1b03fff640 1 -- 172.21.15.16:0/1158799355 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27878 (secure 0 0 0) 0x7f1b1c104380 con 0x7f1b0406cc50 2024-08-01T06:52:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:52:50.313 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-08-01T06:52:50.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.313+0000 7f1b2163e640 1 -- 172.21.15.16:0/1158799355 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f1b0406cc50 msgr2=0x7f1b0406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:50.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.313+0000 7f1b2163e640 1 --2- 172.21.15.16:0/1158799355 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f1b0406cc50 0x7f1b0406f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009230 tx=0x7f1b0c005a20 comp rx=0 tx=0).stop 2024-08-01T06:52:50.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.313+0000 7f1b2163e640 1 -- 172.21.15.16:0/1158799355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c101610 msgr2=0x7f1b1c19bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:50.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.313+0000 7f1b2163e640 1 --2- 172.21.15.16:0/1158799355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c101610 0x7f1b1c19bd80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000d6f0 tx=0x7f1b1000dbb0 comp rx=0 tx=0).stop 2024-08-01T06:52:50.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.313+0000 7f1b2163e640 1 -- 172.21.15.16:0/1158799355 shutdown_connections 2024-08-01T06:52:50.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.313+0000 7f1b2163e640 1 --2- 172.21.15.16:0/1158799355 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f1b0406cc50 0x7f1b0406f110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:50.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.313+0000 7f1b2163e640 1 --2- 172.21.15.16:0/1158799355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b1c101610 0x7f1b1c19bd80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:50.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.313+0000 7f1b2163e640 1 --2- 172.21.15.16:0/1158799355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b1c100c60 0x7f1b1c19b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:50.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.313+0000 7f1b2163e640 1 -- 172.21.15.16:0/1158799355 >> 172.21.15.16:0/1158799355 conn(0x7f1b1c0fa730 msgr2=0x7f1b1c101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:50.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.313+0000 7f1b2163e640 1 -- 172.21.15.16:0/1158799355 shutdown_connections 2024-08-01T06:52:50.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:50.313+0000 7f1b2163e640 1 -- 172.21.15.16:0/1158799355 wait complete. 2024-08-01T06:52:50.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:50 smithi016 ceph-mon[29266]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-01T06:52:50.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:50 smithi016 ceph-mon[29266]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:51.053 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-08-01T06:52:48.570915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":198780,"kb_used_data":3876,"kb_used_omap":9,"kb_used_meta":194806,"kb_avail":562272132,"statfs":{"total":575970213888,"available":575766663168,"internally_reserved":0,"allocated":3969024,"data_stored":2609166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":199482022},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002385"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":187,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-01T06:51:57.480043+0000","last_change":"2024-08-01T06:51:31.084973+0000","last_active":"2024-08-01T06:51:57.480043+0000","last_peered":"2024-08-01T06:51:57.480043+0000","last_clean":"2024-08-01T06:51:57.480043+0000","last_became_active":"2024-08-01T06:51:31.084562+0000","last_became_peered":"2024-08-01T06:51:31.084562+0000","last_unstale":"2024-08-01T06:51:57.480043+0000","last_undegraded":"2024-08-01T06:51:57.480043+0000","last_fullsized":"2024-08-01T06:51:57.480043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-01T06:50:45.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-01T06:50:45.021630+0000","last_clean_scrub_stamp":"2024-08-01T06:50:45.021630+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-02T17:42:06.435780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31472,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713680,"statfs":{"total":95995035648,"available":95962808320,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]}]},{"osd":4,"up_from":34,"seq":146028888082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31476,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713676,"statfs":{"total":95995035648,"available":95962804224,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 1 06:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Aug 1 06:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Aug 1 06:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.433},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Aug 1 06:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.443}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 1 06:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Aug 1 06:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Aug 1 06:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":5.0949999999999998,"5min":5.0949999999999998,"15min":5.0949999999999998},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Aug 1 06:52:35 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.34999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":39668,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":93705484,"statfs":{"total":95995035648,"available":95954415616,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 1 06:51:44 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.38500000000000001}]},{"osd":1,"last update":"Thu Aug 1 06:51:44 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Aug 1 06:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Aug 1 06:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 1 06:52:20 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.23000000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.47199999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.216},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.33400000000000002,"15min":0.32800000000000001},"min":{"1min":0.27400000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.50900000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Aug 1 06:52:47 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.39000000000000001,"15min":0.39800000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.49199999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.318},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.375,"15min":0.38100000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.499,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.24299999999999999}]},{"osd":3,"last update":"Thu Aug 1 06:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.497},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Aug 1 06:52:31 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40248,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":93704904,"statfs":{"total":95995035648,"available":95953821696,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 1 06:52:18 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32000000000000001,"15min":0.318},"min":{"1min":0.221,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.442,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.317,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.22700000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.45200000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.36599999999999999}]},{"osd":2,"last update":"Thu Aug 1 06:51:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.38900000000000001}]},{"osd":3,"last update":"Thu Aug 1 06:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.442},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.502}]},{"osd":4,"last update":"Thu Aug 1 06:52:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-01T06:52:51.054 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-01T06:52:51.054 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-01T06:52:51.054 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-01T06:52:51.054 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph health --format=json 2024-08-01T06:52:51.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:50 smithi089 ceph-mon[36617]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-01T06:52:51.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:50 smithi089 ceph-mon[36617]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:51.267 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:52.933 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:52 smithi016 ceph-mon[29266]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:53.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.014+0000 7f97de75a640 1 -- 172.21.15.16:0/2014742647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97d8101610 msgr2=0x7f97d8109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:53.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.014+0000 7f97de75a640 1 --2- 172.21.15.16:0/2014742647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97d8101610 0x7f97d8109b00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f97cc0098b0 tx=0x7f97cc02a4d0 comp rx=0 tx=0).stop 2024-08-01T06:52:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.014+0000 7f97de75a640 1 -- 172.21.15.16:0/2014742647 shutdown_connections 2024-08-01T06:52:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.014+0000 7f97de75a640 1 --2- 172.21.15.16:0/2014742647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97d8101610 0x7f97d8109b00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.014+0000 7f97de75a640 1 --2- 172.21.15.16:0/2014742647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97d8100c60 0x7f97d8101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.014+0000 7f97de75a640 1 -- 172.21.15.16:0/2014742647 >> 172.21.15.16:0/2014742647 conn(0x7f97d80fa730 msgr2=0x7f97d80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.014+0000 7f97de75a640 1 -- 172.21.15.16:0/2014742647 shutdown_connections 2024-08-01T06:52:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.014+0000 7f97de75a640 1 -- 172.21.15.16:0/2014742647 wait complete. 2024-08-01T06:52:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.015+0000 7f97de75a640 1 Processor -- start 2024-08-01T06:52:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.015+0000 7f97de75a640 1 -- start start 2024-08-01T06:52:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.015+0000 7f97de75a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97d8100c60 0x7f97d819b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.015+0000 7f97de75a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97d8101610 0x7f97d819bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.015+0000 7f97de75a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d819c330 con 0x7f97d8100c60 2024-08-01T06:52:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.015+0000 7f97de75a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d8195950 con 0x7f97d8101610 2024-08-01T06:52:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.016+0000 7f97d7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97d8100c60 0x7f97d819b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:53.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.016+0000 7f97d7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97d8100c60 0x7f97d819b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56138/0 (socket says 172.21.15.16:56138) 2024-08-01T06:52:53.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.016+0000 7f97d7fff640 1 -- 172.21.15.16:0/2023075246 learned_addr learned my addr 172.21.15.16:0/2023075246 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:53.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.016+0000 7f97d77fe640 1 --2- 172.21.15.16:0/2023075246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97d8101610 0x7f97d819bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:53.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.016+0000 7f97d7fff640 1 -- 172.21.15.16:0/2023075246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97d8101610 msgr2=0x7f97d819bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:53.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.016+0000 7f97d7fff640 1 --2- 172.21.15.16:0/2023075246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97d8101610 0x7f97d819bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:53.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.016+0000 7f97d7fff640 1 -- 172.21.15.16:0/2023075246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc009560 con 0x7f97d8100c60 2024-08-01T06:52:53.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.016+0000 7f97d7fff640 1 --2- 172.21.15.16:0/2023075246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97d8100c60 0x7f97d819b860 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f97c800c8a0 tx=0x7f97c800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:53.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.016+0000 7f97d57fa640 1 -- 172.21.15.16:0/2023075246 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97c8007b80 con 0x7f97d8100c60 2024-08-01T06:52:53.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.016+0000 7f97d57fa640 1 -- 172.21.15.16:0/2023075246 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f97c8007ce0 con 0x7f97d8100c60 2024-08-01T06:52:53.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.016+0000 7f97de75a640 1 -- 172.21.15.16:0/2023075246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d8195c30 con 0x7f97d8100c60 2024-08-01T06:52:53.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.016+0000 7f97d57fa640 1 -- 172.21.15.16:0/2023075246 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97c8018810 con 0x7f97d8100c60 2024-08-01T06:52:53.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.016+0000 7f97de75a640 1 -- 172.21.15.16:0/2023075246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d8196150 con 0x7f97d8100c60 2024-08-01T06:52:53.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.017+0000 7f97de75a640 1 -- 172.21.15.16:0/2023075246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d8068d30 con 0x7f97d8100c60 2024-08-01T06:52:53.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.018+0000 7f97d57fa640 1 -- 172.21.15.16:0/2023075246 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f97c8018970 con 0x7f97d8100c60 2024-08-01T06:52:53.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.018+0000 7f97d57fa640 1 --2- 172.21.15.16:0/2023075246 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f97c006cc50 0x7f97c006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:53.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.018+0000 7f97d57fa640 1 -- 172.21.15.16:0/2023075246 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f97c808bfb0 con 0x7f97d8100c60 2024-08-01T06:52:53.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.019+0000 7f97d77fe640 1 --2- 172.21.15.16:0/2023075246 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f97c006cc50 0x7f97c006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:53.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.019+0000 7f97d77fe640 1 --2- 172.21.15.16:0/2023075246 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f97c006cc50 0x7f97c006f110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009880 tx=0x7f97cc0058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:53.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.023+0000 7f97d57fa640 1 -- 172.21.15.16:0/2023075246 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f97c8056740 con 0x7f97d8100c60 2024-08-01T06:52:53.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:52 smithi089 ceph-mon[36617]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:53.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.230+0000 7f97de75a640 1 -- 172.21.15.16:0/2023075246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f97d8101040 con 0x7f97d8100c60 2024-08-01T06:52:53.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.230+0000 7f97d57fa640 1 -- 172.21.15.16:0/2023075246 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f97c8059d60 con 0x7f97d8100c60 2024-08-01T06:52:53.232 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:52:53.232 INFO:teuthology.orchestra.run.smithi016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-01T06:52:53.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.232+0000 7f97de75a640 1 -- 172.21.15.16:0/2023075246 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f97c006cc50 msgr2=0x7f97c006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:53.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.232+0000 7f97de75a640 1 --2- 172.21.15.16:0/2023075246 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f97c006cc50 0x7f97c006f110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009880 tx=0x7f97cc0058d0 comp rx=0 tx=0).stop 2024-08-01T06:52:53.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.232+0000 7f97de75a640 1 -- 172.21.15.16:0/2023075246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97d8100c60 msgr2=0x7f97d819b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:53.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.232+0000 7f97de75a640 1 --2- 172.21.15.16:0/2023075246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97d8100c60 0x7f97d819b860 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f97c800c8a0 tx=0x7f97c800cd60 comp rx=0 tx=0).stop 2024-08-01T06:52:53.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.232+0000 7f97de75a640 1 -- 172.21.15.16:0/2023075246 shutdown_connections 2024-08-01T06:52:53.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.232+0000 7f97de75a640 1 --2- 172.21.15.16:0/2023075246 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f97c006cc50 0x7f97c006f110 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:53.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.232+0000 7f97de75a640 1 --2- 172.21.15.16:0/2023075246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97d8101610 0x7f97d819bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:53.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.232+0000 7f97de75a640 1 --2- 172.21.15.16:0/2023075246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97d8100c60 0x7f97d819b860 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:53.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.232+0000 7f97de75a640 1 -- 172.21.15.16:0/2023075246 >> 172.21.15.16:0/2023075246 conn(0x7f97d80fa730 msgr2=0x7f97d8101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:53.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.232+0000 7f97de75a640 1 -- 172.21.15.16:0/2023075246 shutdown_connections 2024-08-01T06:52:53.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:53.232+0000 7f97de75a640 1 -- 172.21.15.16:0/2023075246 wait complete. 2024-08-01T06:52:53.887 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:53 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/2023075246' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-01T06:52:53.912 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-01T06:52:53.912 INFO:tasks.cephadm:Setup complete, yielding 2024-08-01T06:52:53.913 INFO:teuthology.run_tasks:Running task print... 2024-08-01T06:52:53.922 INFO:teuthology.task.print:**** done end installing reef cephadm ... 2024-08-01T06:52:53.923 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-01T06:52:53.941 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi016.front.sepia.ceph.com 2024-08-01T06:52:53.941 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-08-01T06:52:54.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:53 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/2023075246' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-01T06:52:54.161 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:54.894 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:54 smithi016 ceph-mon[29266]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:55.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:54 smithi089 ceph-mon[36617]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:55.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.687+0000 7f0319b4d640 1 -- 172.21.15.16:0/1579230257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03140ff410 msgr2=0x7f03140ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:55.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.687+0000 7f0319b4d640 1 --2- 172.21.15.16:0/1579230257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03140ff410 0x7f03140ff890 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0308009880 tx=0x7f030802a4a0 comp rx=0 tx=0).stop 2024-08-01T06:52:55.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.687+0000 7f0319b4d640 1 -- 172.21.15.16:0/1579230257 shutdown_connections 2024-08-01T06:52:55.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.687+0000 7f0319b4d640 1 --2- 172.21.15.16:0/1579230257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03140ff410 0x7f03140ff890 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:55.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.687+0000 7f0319b4d640 1 --2- 172.21.15.16:0/1579230257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03140fe210 0x7f03140fe610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:55.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.687+0000 7f0319b4d640 1 -- 172.21.15.16:0/1579230257 >> 172.21.15.16:0/1579230257 conn(0x7f03140f99c0 msgr2=0x7f03140fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:55.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.687+0000 7f0319b4d640 1 -- 172.21.15.16:0/1579230257 shutdown_connections 2024-08-01T06:52:55.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.687+0000 7f0319b4d640 1 -- 172.21.15.16:0/1579230257 wait complete. 2024-08-01T06:52:55.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.688+0000 7f0319b4d640 1 Processor -- start 2024-08-01T06:52:55.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.688+0000 7f0319b4d640 1 -- start start 2024-08-01T06:52:55.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.688+0000 7f0319b4d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03140fe210 0x7f0314195700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:55.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.688+0000 7f0319b4d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03140ff410 0x7f0314195c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:55.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.688+0000 7f0319b4d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0314196210 con 0x7f03140ff410 2024-08-01T06:52:55.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.688+0000 7f0319b4d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0314196380 con 0x7f03140fe210 2024-08-01T06:52:55.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.689+0000 7f0312ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03140ff410 0x7f0314195c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.689+0000 7f0312ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03140ff410 0x7f0314195c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56144/0 (socket says 172.21.15.16:56144) 2024-08-01T06:52:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.689+0000 7f0312ffd640 1 -- 172.21.15.16:0/3397653329 learned_addr learned my addr 172.21.15.16:0/3397653329 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.689+0000 7f03137fe640 1 --2- 172.21.15.16:0/3397653329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03140fe210 0x7f0314195700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.689+0000 7f0312ffd640 1 -- 172.21.15.16:0/3397653329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03140fe210 msgr2=0x7f0314195700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.689+0000 7f0312ffd640 1 --2- 172.21.15.16:0/3397653329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03140fe210 0x7f0314195700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.689+0000 7f0312ffd640 1 -- 172.21.15.16:0/3397653329 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0308009560 con 0x7f03140ff410 2024-08-01T06:52:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.689+0000 7f03137fe640 1 --2- 172.21.15.16:0/3397653329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03140fe210 0x7f0314195700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T06:52:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.689+0000 7f0312ffd640 1 --2- 172.21.15.16:0/3397653329 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03140ff410 0x7f0314195c40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f03080055f0 tx=0x7f0308005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.689+0000 7f0310ff9640 1 -- 172.21.15.16:0/3397653329 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0308004b20 con 0x7f03140ff410 2024-08-01T06:52:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.689+0000 7f0310ff9640 1 -- 172.21.15.16:0/3397653329 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0308004c80 con 0x7f03140ff410 2024-08-01T06:52:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.689+0000 7f0319b4d640 1 -- 172.21.15.16:0/3397653329 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f031419adc0 con 0x7f03140ff410 2024-08-01T06:52:55.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.689+0000 7f0310ff9640 1 -- 172.21.15.16:0/3397653329 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0308003bc0 con 0x7f03140ff410 2024-08-01T06:52:55.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.689+0000 7f0319b4d640 1 -- 172.21.15.16:0/3397653329 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f031419b330 con 0x7f03140ff410 2024-08-01T06:52:55.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.690+0000 7f0319b4d640 1 -- 172.21.15.16:0/3397653329 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0314106610 con 0x7f03140ff410 2024-08-01T06:52:55.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.691+0000 7f0310ff9640 1 -- 172.21.15.16:0/3397653329 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0308031640 con 0x7f03140ff410 2024-08-01T06:52:55.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.691+0000 7f0310ff9640 1 --2- 172.21.15.16:0/3397653329 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f02fc06cc60 0x7f02fc06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:55.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.692+0000 7f0310ff9640 1 -- 172.21.15.16:0/3397653329 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f03080ad160 con 0x7f03140ff410 2024-08-01T06:52:55.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.692+0000 7f03137fe640 1 --2- 172.21.15.16:0/3397653329 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f02fc06cc60 0x7f02fc06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:55.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.692+0000 7f03137fe640 1 --2- 172.21.15.16:0/3397653329 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f02fc06cc60 0x7f02fc06f120 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f03140ff270 tx=0x7f0304008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:55.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.696+0000 7f0310ff9640 1 -- 172.21.15.16:0/3397653329 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f03080778f0 con 0x7f03140ff410 2024-08-01T06:52:55.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.867+0000 7f0319b4d640 1 -- 172.21.15.16:0/3397653329 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f03141067a0 con 0x7f03140ff410 2024-08-01T06:52:55.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.871+0000 7f0310ff9640 1 -- 172.21.15.16:0/3397653329 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v24)=0 v24) v1 ==== 143+0+0 (secure 0 0 0) 0x7f030807af10 con 0x7f03140ff410 2024-08-01T06:52:55.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.873+0000 7f0319b4d640 1 -- 172.21.15.16:0/3397653329 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f02fc06cc60 msgr2=0x7f02fc06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:55.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.873+0000 7f0319b4d640 1 --2- 172.21.15.16:0/3397653329 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f02fc06cc60 0x7f02fc06f120 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f03140ff270 tx=0x7f0304008040 comp rx=0 tx=0).stop 2024-08-01T06:52:55.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.873+0000 7f0319b4d640 1 -- 172.21.15.16:0/3397653329 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03140ff410 msgr2=0x7f0314195c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:55.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.873+0000 7f0319b4d640 1 --2- 172.21.15.16:0/3397653329 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03140ff410 0x7f0314195c40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f03080055f0 tx=0x7f0308005620 comp rx=0 tx=0).stop 2024-08-01T06:52:55.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.873+0000 7f0319b4d640 1 -- 172.21.15.16:0/3397653329 shutdown_connections 2024-08-01T06:52:55.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.873+0000 7f0319b4d640 1 --2- 172.21.15.16:0/3397653329 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f02fc06cc60 0x7f02fc06f120 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:55.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.873+0000 7f0319b4d640 1 --2- 172.21.15.16:0/3397653329 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03140ff410 0x7f0314195c40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:55.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.873+0000 7f0319b4d640 1 --2- 172.21.15.16:0/3397653329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03140fe210 0x7f0314195700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:55.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.873+0000 7f0319b4d640 1 -- 172.21.15.16:0/3397653329 >> 172.21.15.16:0/3397653329 conn(0x7f03140f99c0 msgr2=0x7f03140fb840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:55.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.873+0000 7f0319b4d640 1 -- 172.21.15.16:0/3397653329 shutdown_connections 2024-08-01T06:52:55.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:55.874+0000 7f0319b4d640 1 -- 172.21.15.16:0/3397653329 wait complete. 2024-08-01T06:52:56.627 INFO:teuthology.run_tasks:Running task print... 2024-08-01T06:52:56.636 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-08-01T06:52:56.637 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-01T06:52:56.652 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi016.front.sepia.ceph.com 2024-08-01T06:52:56.653 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- bash -c 'ceph orch status' 2024-08-01T06:52:56.879 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:57.002 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:56 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3397653329' entity='client.admin' 2024-08-01T06:52:57.003 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:56 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:52:57.003 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:56 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:52:57.003 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:56 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:52:57.003 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:56 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:52:57.003 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:56 smithi016 ceph-mon[29266]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:57.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:56 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/3397653329' entity='client.admin' 2024-08-01T06:52:57.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:56 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:52:57.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:56 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:52:57.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:56 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:52:57.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:56 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:52:57.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:56 smithi089 ceph-mon[36617]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:58.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.502+0000 7ff0a5908640 1 -- 172.21.15.16:0/2249181182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0a00ffb90 msgr2=0x7ff0a00fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:58.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.502+0000 7ff0a5908640 1 --2- 172.21.15.16:0/2249181182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0a00ffb90 0x7ff0a00fff90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff090009880 tx=0x7ff09002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:52:58.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.502+0000 7ff0a5908640 1 -- 172.21.15.16:0/2249181182 shutdown_connections 2024-08-01T06:52:58.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.502+0000 7ff0a5908640 1 --2- 172.21.15.16:0/2249181182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0a0100d90 0x7ff0a0101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:58.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.502+0000 7ff0a5908640 1 --2- 172.21.15.16:0/2249181182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0a00ffb90 0x7ff0a00fff90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:58.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.502+0000 7ff0a5908640 1 -- 172.21.15.16:0/2249181182 >> 172.21.15.16:0/2249181182 conn(0x7ff0a00fb320 msgr2=0x7ff0a00fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:58.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.502+0000 7ff0a5908640 1 -- 172.21.15.16:0/2249181182 shutdown_connections 2024-08-01T06:52:58.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.502+0000 7ff0a5908640 1 -- 172.21.15.16:0/2249181182 wait complete. 2024-08-01T06:52:58.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.503+0000 7ff0a5908640 1 Processor -- start 2024-08-01T06:52:58.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.503+0000 7ff0a5908640 1 -- start start 2024-08-01T06:52:58.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.503+0000 7ff0a5908640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0a00ffb90 0x7ff0a0195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:58.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.503+0000 7ff0a5908640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0a0100d90 0x7ff0a0195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:58.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.503+0000 7ff0a5908640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a0196180 con 0x7ff0a0100d90 2024-08-01T06:52:58.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.503+0000 7ff0a5908640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a01962f0 con 0x7ff0a00ffb90 2024-08-01T06:52:58.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.504+0000 7ff09e7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0a0100d90 0x7ff0a0195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:58.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.504+0000 7ff09e7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0a0100d90 0x7ff0a0195bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56168/0 (socket says 172.21.15.16:56168) 2024-08-01T06:52:58.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.504+0000 7ff09e7fc640 1 -- 172.21.15.16:0/1714475849 learned_addr learned my addr 172.21.15.16:0/1714475849 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:52:58.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.504+0000 7ff09effd640 1 --2- 172.21.15.16:0/1714475849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0a00ffb90 0x7ff0a0195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:58.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.504+0000 7ff09e7fc640 1 -- 172.21.15.16:0/1714475849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0a00ffb90 msgr2=0x7ff0a0195670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:58.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.504+0000 7ff09e7fc640 1 --2- 172.21.15.16:0/1714475849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0a00ffb90 0x7ff0a0195670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:58.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.504+0000 7ff09e7fc640 1 -- 172.21.15.16:0/1714475849 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff090009560 con 0x7ff0a0100d90 2024-08-01T06:52:58.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.504+0000 7ff09e7fc640 1 --2- 172.21.15.16:0/1714475849 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0a0100d90 0x7ff0a0195bb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff09400c840 tx=0x7ff09400cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:58.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.504+0000 7ff0a4906640 1 -- 172.21.15.16:0/1714475849 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0940041f0 con 0x7ff0a0100d90 2024-08-01T06:52:58.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.504+0000 7ff0a4906640 1 -- 172.21.15.16:0/1714475849 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff094007e70 con 0x7ff0a0100d90 2024-08-01T06:52:58.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.504+0000 7ff0a5908640 1 -- 172.21.15.16:0/1714475849 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a019ad20 con 0x7ff0a0100d90 2024-08-01T06:52:58.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.504+0000 7ff0a4906640 1 -- 172.21.15.16:0/1714475849 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0940049d0 con 0x7ff0a0100d90 2024-08-01T06:52:58.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.504+0000 7ff0a5908640 1 -- 172.21.15.16:0/1714475849 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a019b2f0 con 0x7ff0a0100d90 2024-08-01T06:52:58.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.505+0000 7ff0a5908640 1 -- 172.21.15.16:0/1714475849 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a018f710 con 0x7ff0a0100d90 2024-08-01T06:52:58.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.506+0000 7ff0a4906640 1 -- 172.21.15.16:0/1714475849 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff0940079b0 con 0x7ff0a0100d90 2024-08-01T06:52:58.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.506+0000 7ff0a4906640 1 --2- 172.21.15.16:0/1714475849 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff08806cc50 0x7ff08806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:52:58.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.506+0000 7ff0a4906640 1 -- 172.21.15.16:0/1714475849 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff09408bcc0 con 0x7ff0a0100d90 2024-08-01T06:52:58.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.506+0000 7ff09effd640 1 --2- 172.21.15.16:0/1714475849 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff08806cc50 0x7ff08806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:52:58.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.507+0000 7ff09effd640 1 --2- 172.21.15.16:0/1714475849 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff08806cc50 0x7ff08806f110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff090005940 tx=0x7ff0900058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:52:58.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.511+0000 7ff0a4906640 1 -- 172.21.15.16:0/1714475849 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7ff094056480 con 0x7ff0a0100d90 2024-08-01T06:52:58.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.698+0000 7ff0a5908640 1 -- 172.21.15.16:0/1714475849 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0a002c4f0 con 0x7ff08806cc50 2024-08-01T06:52:58.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.699+0000 7ff0a4906640 1 -- 172.21.15.16:0/1714475849 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7ff0a002c4f0 con 0x7ff08806cc50 2024-08-01T06:52:58.701 INFO:teuthology.orchestra.run.smithi016.stdout:Backend: cephadm 2024-08-01T06:52:58.701 INFO:teuthology.orchestra.run.smithi016.stdout:Available: Yes 2024-08-01T06:52:58.702 INFO:teuthology.orchestra.run.smithi016.stdout:Paused: No 2024-08-01T06:52:58.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.701+0000 7ff0a5908640 1 -- 172.21.15.16:0/1714475849 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff08806cc50 msgr2=0x7ff08806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:58.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.701+0000 7ff0a5908640 1 --2- 172.21.15.16:0/1714475849 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff08806cc50 0x7ff08806f110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff090005940 tx=0x7ff0900058d0 comp rx=0 tx=0).stop 2024-08-01T06:52:58.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.701+0000 7ff0a5908640 1 -- 172.21.15.16:0/1714475849 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0a0100d90 msgr2=0x7ff0a0195bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:52:58.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.701+0000 7ff0a5908640 1 --2- 172.21.15.16:0/1714475849 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0a0100d90 0x7ff0a0195bb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff09400c840 tx=0x7ff09400cd00 comp rx=0 tx=0).stop 2024-08-01T06:52:58.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.701+0000 7ff0a5908640 1 -- 172.21.15.16:0/1714475849 shutdown_connections 2024-08-01T06:52:58.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.701+0000 7ff0a5908640 1 --2- 172.21.15.16:0/1714475849 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff08806cc50 0x7ff08806f110 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:58.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.701+0000 7ff0a5908640 1 --2- 172.21.15.16:0/1714475849 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0a0100d90 0x7ff0a0195bb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:58.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.701+0000 7ff0a5908640 1 --2- 172.21.15.16:0/1714475849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0a00ffb90 0x7ff0a0195670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:52:58.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.701+0000 7ff0a5908640 1 -- 172.21.15.16:0/1714475849 >> 172.21.15.16:0/1714475849 conn(0x7ff0a00fb320 msgr2=0x7ff0a0104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:52:58.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.701+0000 7ff0a5908640 1 -- 172.21.15.16:0/1714475849 shutdown_connections 2024-08-01T06:52:58.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:52:58.701+0000 7ff0a5908640 1 -- 172.21.15.16:0/1714475849 wait complete. 2024-08-01T06:52:58.998 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:58 smithi016 ceph-mon[29266]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:59.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:58 smithi089 ceph-mon[36617]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:52:59.434 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- bash -c 'ceph orch ps' 2024-08-01T06:52:59.654 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:52:59.986 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:52:59 smithi016 ceph-mon[29266]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:53:00.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:52:59 smithi089 ceph-mon[36617]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:53:00.971 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:00 smithi016 ceph-mon[29266]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:01.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:00 smithi089 ceph-mon[36617]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:01.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.195+0000 7f8a0bc6e640 1 -- 172.21.15.16:0/3317536899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a04100d90 msgr2=0x7f8a04101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:01.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.195+0000 7f8a0bc6e640 1 --2- 172.21.15.16:0/3317536899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a04100d90 0x7f8a04101210 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009880 tx=0x7f89f402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:53:01.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.195+0000 7f8a0bc6e640 1 -- 172.21.15.16:0/3317536899 shutdown_connections 2024-08-01T06:53:01.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.195+0000 7f8a0bc6e640 1 --2- 172.21.15.16:0/3317536899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a04100d90 0x7f8a04101210 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:01.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.195+0000 7f8a0bc6e640 1 --2- 172.21.15.16:0/3317536899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a040ffb90 0x7f8a040fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:01.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.195+0000 7f8a0bc6e640 1 -- 172.21.15.16:0/3317536899 >> 172.21.15.16:0/3317536899 conn(0x7f8a040fb320 msgr2=0x7f8a040fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:01.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.195+0000 7f8a0bc6e640 1 -- 172.21.15.16:0/3317536899 shutdown_connections 2024-08-01T06:53:01.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.195+0000 7f8a0bc6e640 1 -- 172.21.15.16:0/3317536899 wait complete. 2024-08-01T06:53:01.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.196+0000 7f8a0bc6e640 1 Processor -- start 2024-08-01T06:53:01.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.196+0000 7f8a0bc6e640 1 -- start start 2024-08-01T06:53:01.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.196+0000 7f8a0bc6e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a040ffb90 0x7f8a04195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:01.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.196+0000 7f8a0bc6e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a04100d90 0x7f8a04195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:01.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.196+0000 7f8a0bc6e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a04196140 con 0x7f8a04100d90 2024-08-01T06:53:01.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.196+0000 7f8a0bc6e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a041962b0 con 0x7f8a040ffb90 2024-08-01T06:53:01.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.196+0000 7f8a09209640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a04100d90 0x7f8a04195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:01.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.196+0000 7f8a09209640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a04100d90 0x7f8a04195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40428/0 (socket says 172.21.15.16:40428) 2024-08-01T06:53:01.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.196+0000 7f8a09209640 1 -- 172.21.15.16:0/2351200289 learned_addr learned my addr 172.21.15.16:0/2351200289 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:53:01.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.196+0000 7f8a09a0a640 1 --2- 172.21.15.16:0/2351200289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a040ffb90 0x7f8a04195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:01.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.197+0000 7f8a09209640 1 -- 172.21.15.16:0/2351200289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a040ffb90 msgr2=0x7f8a04195630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:01.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.197+0000 7f8a09209640 1 --2- 172.21.15.16:0/2351200289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a040ffb90 0x7f8a04195630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:01.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.197+0000 7f8a09209640 1 -- 172.21.15.16:0/2351200289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f4009560 con 0x7f8a04100d90 2024-08-01T06:53:01.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.197+0000 7f8a09209640 1 --2- 172.21.15.16:0/2351200289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a04100d90 0x7f8a04195b70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f89f4005520 tx=0x7f89f4005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:01.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.197+0000 7f89faffd640 1 -- 172.21.15.16:0/2351200289 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89f4004aa0 con 0x7f8a04100d90 2024-08-01T06:53:01.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.197+0000 7f89faffd640 1 -- 172.21.15.16:0/2351200289 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f89f4004c00 con 0x7f8a04100d90 2024-08-01T06:53:01.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.197+0000 7f8a0bc6e640 1 -- 172.21.15.16:0/2351200289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0419acf0 con 0x7f8a04100d90 2024-08-01T06:53:01.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.197+0000 7f89faffd640 1 -- 172.21.15.16:0/2351200289 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89f4003b10 con 0x7f8a04100d90 2024-08-01T06:53:01.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.197+0000 7f8a0bc6e640 1 -- 172.21.15.16:0/2351200289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0419b260 con 0x7f8a04100d90 2024-08-01T06:53:01.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.198+0000 7f8a0bc6e640 1 -- 172.21.15.16:0/2351200289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0418f730 con 0x7f8a04100d90 2024-08-01T06:53:01.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.199+0000 7f89faffd640 1 -- 172.21.15.16:0/2351200289 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f89f4031d20 con 0x7f8a04100d90 2024-08-01T06:53:01.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.200+0000 7f89faffd640 1 --2- 172.21.15.16:0/2351200289 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f89f006cc50 0x7f89f006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:01.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.200+0000 7f89faffd640 1 -- 172.21.15.16:0/2351200289 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f89f40ad060 con 0x7f8a04100d90 2024-08-01T06:53:01.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.200+0000 7f8a09a0a640 1 --2- 172.21.15.16:0/2351200289 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f89f006cc50 0x7f89f006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:01.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.200+0000 7f8a09a0a640 1 --2- 172.21.15.16:0/2351200289 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f89f006cc50 0x7f89f006f110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8a00005fd0 tx=0x7f8a0000b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:01.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.204+0000 7f89faffd640 1 -- 172.21.15.16:0/2351200289 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f89f4077820 con 0x7f8a04100d90 2024-08-01T06:53:01.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.386+0000 7f8a0bc6e640 1 -- 172.21.15.16:0/2351200289 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a0402c4f0 con 0x7f89f006cc50 2024-08-01T06:53:01.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.394+0000 7f89faffd640 1 -- 172.21.15.16:0/2351200289 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3100 (secure 0 0 0) 0x7f8a0402c4f0 con 0x7f89f006cc50 2024-08-01T06:53:01.396 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T06:53:01.396 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (3m) 2m ago 4m 26.7M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T06:53:01.396 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (5m) 2m ago 5m 7130k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T06:53:01.396 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (4m) 66s ago 4m 7050k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T06:53:01.396 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (5m) 2m ago 5m 6895k - 18.2.2-1767-ga3bbd728 d280790d1980 81c723a6ae35 2024-08-01T06:53:01.397 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (4m) 66s ago 4m 6891k - 18.2.2-1767-ga3bbd728 d280790d1980 73e7778d1e26 2024-08-01T06:53:01.397 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (3m) 2m ago 4m 80.2M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T06:53:01.397 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:9283,8765,8443 running (6m) 2m ago 6m 480M - 18.2.2-1767-ga3bbd728 d280790d1980 3cf8ca2d43c6 2024-08-01T06:53:01.397 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (4m) 66s ago 4m 440M - 18.2.2-1767-ga3bbd728 d280790d1980 c70860f1020b 2024-08-01T06:53:01.397 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (6m) 2m ago 6m 49.4M 2048M 18.2.2-1767-ga3bbd728 d280790d1980 e6a2e5d7eeec 2024-08-01T06:53:01.397 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (4m) 66s ago 4m 41.0M 2048M 18.2.2-1767-ga3bbd728 d280790d1980 9ca9e3e814cb 2024-08-01T06:53:01.397 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (5m) 2m ago 5m 15.9M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T06:53:01.397 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (4m) 66s ago 4m 16.9M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T06:53:01.397 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (3m) 2m ago 3m 50.1M 3948M 18.2.2-1767-ga3bbd728 d280790d1980 9b7157499583 2024-08-01T06:53:01.397 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (2m) 2m ago 2m 40.8M 3948M 18.2.2-1767-ga3bbd728 d280790d1980 f3b050aed6b7 2024-08-01T06:53:01.397 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (2m) 2m ago 2m 46.5M 3948M 18.2.2-1767-ga3bbd728 d280790d1980 33a72e1a5c91 2024-08-01T06:53:01.397 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (2m) 66s ago 2m 40.5M 4970M 18.2.2-1767-ga3bbd728 d280790d1980 58c175e0f4eb 2024-08-01T06:53:01.397 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (97s) 66s ago 97s 46.5M 4970M 18.2.2-1767-ga3bbd728 d280790d1980 15b8f910bad7 2024-08-01T06:53:01.398 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (72s) 66s ago 71s 11.4M 4970M 18.2.2-1767-ga3bbd728 d280790d1980 ac887841899e 2024-08-01T06:53:01.398 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (3m) 2m ago 4m 42.2M - 2.43.0 a07b618ecd1d 2b370118fafe 2024-08-01T06:53:01.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.397+0000 7f8a0bc6e640 1 -- 172.21.15.16:0/2351200289 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f89f006cc50 msgr2=0x7f89f006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:01.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.397+0000 7f8a0bc6e640 1 --2- 172.21.15.16:0/2351200289 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f89f006cc50 0x7f89f006f110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8a00005fd0 tx=0x7f8a0000b390 comp rx=0 tx=0).stop 2024-08-01T06:53:01.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.397+0000 7f8a0bc6e640 1 -- 172.21.15.16:0/2351200289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a04100d90 msgr2=0x7f8a04195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:01.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.397+0000 7f8a0bc6e640 1 --2- 172.21.15.16:0/2351200289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a04100d90 0x7f8a04195b70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f89f4005520 tx=0x7f89f4005550 comp rx=0 tx=0).stop 2024-08-01T06:53:01.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.397+0000 7f8a0bc6e640 1 -- 172.21.15.16:0/2351200289 shutdown_connections 2024-08-01T06:53:01.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.397+0000 7f8a0bc6e640 1 --2- 172.21.15.16:0/2351200289 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f89f006cc50 0x7f89f006f110 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:01.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.397+0000 7f8a0bc6e640 1 --2- 172.21.15.16:0/2351200289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a04100d90 0x7f8a04195b70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:01.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.397+0000 7f8a0bc6e640 1 --2- 172.21.15.16:0/2351200289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a040ffb90 0x7f8a04195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:01.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.397+0000 7f8a0bc6e640 1 -- 172.21.15.16:0/2351200289 >> 172.21.15.16:0/2351200289 conn(0x7f8a040fb320 msgr2=0x7f8a04104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:01.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.397+0000 7f8a0bc6e640 1 -- 172.21.15.16:0/2351200289 shutdown_connections 2024-08-01T06:53:01.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:01.397+0000 7f8a0bc6e640 1 -- 172.21.15.16:0/2351200289 wait complete. 2024-08-01T06:53:01.972 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:01 smithi016 ceph-mon[29266]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:53:01.993 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- bash -c 'ceph orch ls' 2024-08-01T06:53:02.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:01 smithi089 ceph-mon[36617]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:53:02.205 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:53:02.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:02 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:53:02.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:02 smithi016 ceph-mon[29266]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:03.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:02 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:53:03.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:02 smithi089 ceph-mon[36617]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:03.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.976+0000 7f0e98b9f640 1 -- 172.21.15.16:0/1575452716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e94102e20 msgr2=0x7f0e94105210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:03.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.976+0000 7f0e98b9f640 1 --2- 172.21.15.16:0/1575452716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e94102e20 0x7f0e94105210 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c009880 tx=0x7f0e7c02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:53:03.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.976+0000 7f0e98b9f640 1 -- 172.21.15.16:0/1575452716 shutdown_connections 2024-08-01T06:53:03.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.976+0000 7f0e98b9f640 1 --2- 172.21.15.16:0/1575452716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e94102e20 0x7f0e94105210 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:03.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.976+0000 7f0e98b9f640 1 --2- 172.21.15.16:0/1575452716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e941004f0 0x7f0e941028e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:03.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.976+0000 7f0e98b9f640 1 -- 172.21.15.16:0/1575452716 >> 172.21.15.16:0/1575452716 conn(0x7f0e940fa010 msgr2=0x7f0e940fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:03.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.976+0000 7f0e98b9f640 1 -- 172.21.15.16:0/1575452716 shutdown_connections 2024-08-01T06:53:03.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.976+0000 7f0e98b9f640 1 -- 172.21.15.16:0/1575452716 wait complete. 2024-08-01T06:53:03.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.977+0000 7f0e98b9f640 1 Processor -- start 2024-08-01T06:53:03.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.977+0000 7f0e98b9f640 1 -- start start 2024-08-01T06:53:03.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.977+0000 7f0e98b9f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e941004f0 0x7f0e94195470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:03.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.977+0000 7f0e98b9f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e94102e20 0x7f0e941959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:03.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.977+0000 7f0e98b9f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e94195ef0 con 0x7f0e941004f0 2024-08-01T06:53:03.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.977+0000 7f0e98b9f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e94196060 con 0x7f0e94102e20 2024-08-01T06:53:03.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.977+0000 7f0e937fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e941004f0 0x7f0e94195470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:03.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.977+0000 7f0e937fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e941004f0 0x7f0e94195470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40450/0 (socket says 172.21.15.16:40450) 2024-08-01T06:53:03.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.977+0000 7f0e937fe640 1 -- 172.21.15.16:0/3360832387 learned_addr learned my addr 172.21.15.16:0/3360832387 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:53:03.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.978+0000 7f0e8affd640 1 --2- 172.21.15.16:0/3360832387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e94102e20 0x7f0e941959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:03.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.978+0000 7f0e937fe640 1 -- 172.21.15.16:0/3360832387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e94102e20 msgr2=0x7f0e941959b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:03.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.978+0000 7f0e937fe640 1 --2- 172.21.15.16:0/3360832387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e94102e20 0x7f0e941959b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:03.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.978+0000 7f0e937fe640 1 -- 172.21.15.16:0/3360832387 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c009560 con 0x7f0e941004f0 2024-08-01T06:53:03.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.978+0000 7f0e8affd640 1 --2- 172.21.15.16:0/3360832387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e94102e20 0x7f0e941959b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T06:53:03.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.978+0000 7f0e937fe640 1 --2- 172.21.15.16:0/3360832387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e941004f0 0x7f0e94195470 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400c8a0 tx=0x7f0e8400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:03.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.978+0000 7f0e917fa640 1 -- 172.21.15.16:0/3360832387 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e84007b80 con 0x7f0e941004f0 2024-08-01T06:53:03.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.978+0000 7f0e917fa640 1 -- 172.21.15.16:0/3360832387 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e84007ce0 con 0x7f0e941004f0 2024-08-01T06:53:03.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.978+0000 7f0e98b9f640 1 -- 172.21.15.16:0/3360832387 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9419aaf0 con 0x7f0e941004f0 2024-08-01T06:53:03.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.978+0000 7f0e917fa640 1 -- 172.21.15.16:0/3360832387 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e84018810 con 0x7f0e941004f0 2024-08-01T06:53:03.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.978+0000 7f0e98b9f640 1 -- 172.21.15.16:0/3360832387 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9419b040 con 0x7f0e941004f0 2024-08-01T06:53:03.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.979+0000 7f0e98b9f640 1 -- 172.21.15.16:0/3360832387 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e941008d0 con 0x7f0e941004f0 2024-08-01T06:53:03.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.980+0000 7f0e917fa640 1 -- 172.21.15.16:0/3360832387 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0e84018970 con 0x7f0e941004f0 2024-08-01T06:53:03.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.980+0000 7f0e917fa640 1 --2- 172.21.15.16:0/3360832387 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f0e8006cc50 0x7f0e8006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:03.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.980+0000 7f0e917fa640 1 -- 172.21.15.16:0/3360832387 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f0e8408c040 con 0x7f0e941004f0 2024-08-01T06:53:03.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.980+0000 7f0e8affd640 1 --2- 172.21.15.16:0/3360832387 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f0e8006cc50 0x7f0e8006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:03.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.981+0000 7f0e8affd640 1 --2- 172.21.15.16:0/3360832387 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f0e8006cc50 0x7f0e8006f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c000c00 tx=0x7f0e7c0314a0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:03.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:03.985+0000 7f0e917fa640 1 -- 172.21.15.16:0/3360832387 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f0e840567d0 con 0x7f0e941004f0 2024-08-01T06:53:04.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:04.165+0000 7f0e98b9f640 1 -- 172.21.15.16:0/3360832387 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e94103840 con 0x7f0e8006cc50 2024-08-01T06:53:04.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:04.170+0000 7f0e917fa640 1 -- 172.21.15.16:0/3360832387 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1290 (secure 0 0 0) 0x7f0e94103840 con 0x7f0e8006cc50 2024-08-01T06:53:04.171 INFO:teuthology.orchestra.run.smithi016.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-08-01T06:53:04.171 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-08-01T06:53:04.171 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter 2/2 2m ago 5m * 2024-08-01T06:53:04.171 INFO:teuthology.orchestra.run.smithi016.stdout:crash 2/2 2m ago 5m * 2024-08-01T06:53:04.171 INFO:teuthology.orchestra.run.smithi016.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-08-01T06:53:04.172 INFO:teuthology.orchestra.run.smithi016.stdout:mgr 2/2 2m ago 5m count:2 2024-08-01T06:53:04.172 INFO:teuthology.orchestra.run.smithi016.stdout:mon 2/2 2m ago 5m smithi016:172.21.15.16=smithi016;smithi089:172.21.15.89=smithi089;count:2 2024-08-01T06:53:04.172 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-08-01T06:53:04.172 INFO:teuthology.orchestra.run.smithi016.stdout:osd 6 2m ago - 2024-08-01T06:53:04.172 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-08-01T06:53:04.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:04.171+0000 7f0e98b9f640 1 -- 172.21.15.16:0/3360832387 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f0e8006cc50 msgr2=0x7f0e8006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:04.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:04.171+0000 7f0e98b9f640 1 --2- 172.21.15.16:0/3360832387 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f0e8006cc50 0x7f0e8006f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c000c00 tx=0x7f0e7c0314a0 comp rx=0 tx=0).stop 2024-08-01T06:53:04.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:04.171+0000 7f0e98b9f640 1 -- 172.21.15.16:0/3360832387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e941004f0 msgr2=0x7f0e94195470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:04.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:04.171+0000 7f0e98b9f640 1 --2- 172.21.15.16:0/3360832387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e941004f0 0x7f0e94195470 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400c8a0 tx=0x7f0e8400cd60 comp rx=0 tx=0).stop 2024-08-01T06:53:04.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:04.172+0000 7f0e98b9f640 1 -- 172.21.15.16:0/3360832387 shutdown_connections 2024-08-01T06:53:04.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:04.172+0000 7f0e98b9f640 1 --2- 172.21.15.16:0/3360832387 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f0e8006cc50 0x7f0e8006f110 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:04.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:04.172+0000 7f0e98b9f640 1 --2- 172.21.15.16:0/3360832387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e94102e20 0x7f0e941959b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:04.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:04.172+0000 7f0e98b9f640 1 --2- 172.21.15.16:0/3360832387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e941004f0 0x7f0e94195470 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:04.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:04.172+0000 7f0e98b9f640 1 -- 172.21.15.16:0/3360832387 >> 172.21.15.16:0/3360832387 conn(0x7f0e940fa010 msgr2=0x7f0e940fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:04.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:04.172+0000 7f0e98b9f640 1 -- 172.21.15.16:0/3360832387 shutdown_connections 2024-08-01T06:53:04.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:04.172+0000 7f0e98b9f640 1 -- 172.21.15.16:0/3360832387 wait complete. 2024-08-01T06:53:04.761 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:04 smithi016 ceph-mon[29266]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:53:04.761 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:04 smithi016 ceph-mon[29266]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:04.786 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- bash -c 'ceph orch host ls' 2024-08-01T06:53:05.003 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:53:05.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:04 smithi089 ceph-mon[36617]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:53:05.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:04 smithi089 ceph-mon[36617]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:06.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.581+0000 7fe594530640 1 -- 172.21.15.16:0/4095221918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe58c0ffca0 msgr2=0x7fe58c100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:06.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.581+0000 7fe594530640 1 --2- 172.21.15.16:0/4095221918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe58c0ffca0 0x7fe58c100120 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe580009880 tx=0x7fe58002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:53:06.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.581+0000 7fe594530640 1 -- 172.21.15.16:0/4095221918 shutdown_connections 2024-08-01T06:53:06.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.581+0000 7fe594530640 1 --2- 172.21.15.16:0/4095221918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe58c0ffca0 0x7fe58c100120 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:06.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.581+0000 7fe594530640 1 --2- 172.21.15.16:0/4095221918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe58c0feaa0 0x7fe58c0feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:06.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.581+0000 7fe594530640 1 -- 172.21.15.16:0/4095221918 >> 172.21.15.16:0/4095221918 conn(0x7fe58c0fa250 msgr2=0x7fe58c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:06.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.581+0000 7fe594530640 1 -- 172.21.15.16:0/4095221918 shutdown_connections 2024-08-01T06:53:06.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.581+0000 7fe594530640 1 -- 172.21.15.16:0/4095221918 wait complete. 2024-08-01T06:53:06.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.582+0000 7fe594530640 1 Processor -- start 2024-08-01T06:53:06.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.582+0000 7fe594530640 1 -- start start 2024-08-01T06:53:06.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.582+0000 7fe594530640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe58c0feaa0 0x7fe58c102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:06.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.582+0000 7fe594530640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe58c0ffca0 0x7fe58c101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:06.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.582+0000 7fe594530640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c102f70 con 0x7fe58c0feaa0 2024-08-01T06:53:06.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.582+0000 7fe594530640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c1015f0 con 0x7fe58c0ffca0 2024-08-01T06:53:06.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.582+0000 7fe5922cc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe58c0feaa0 0x7fe58c102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:06.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.582+0000 7fe5922cc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe58c0feaa0 0x7fe58c102a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40460/0 (socket says 172.21.15.16:40460) 2024-08-01T06:53:06.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.582+0000 7fe5922cc640 1 -- 172.21.15.16:0/1119514773 learned_addr learned my addr 172.21.15.16:0/1119514773 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:53:06.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.583+0000 7fe591acb640 1 --2- 172.21.15.16:0/1119514773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe58c0ffca0 0x7fe58c101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:06.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.583+0000 7fe5922cc640 1 -- 172.21.15.16:0/1119514773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe58c0ffca0 msgr2=0x7fe58c101080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:06.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.583+0000 7fe5922cc640 1 --2- 172.21.15.16:0/1119514773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe58c0ffca0 0x7fe58c101080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:06.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.583+0000 7fe5922cc640 1 -- 172.21.15.16:0/1119514773 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe580009560 con 0x7fe58c0feaa0 2024-08-01T06:53:06.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.583+0000 7fe591acb640 1 --2- 172.21.15.16:0/1119514773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe58c0ffca0 0x7fe58c101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T06:53:06.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.583+0000 7fe5922cc640 1 --2- 172.21.15.16:0/1119514773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe58c0feaa0 0x7fe58c102a30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe58800c8f0 tx=0x7fe58800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:06.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.583+0000 7fe57f7fe640 1 -- 172.21.15.16:0/1119514773 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5880041f0 con 0x7fe58c0feaa0 2024-08-01T06:53:06.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.583+0000 7fe57f7fe640 1 -- 172.21.15.16:0/1119514773 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe588007e10 con 0x7fe58c0feaa0 2024-08-01T06:53:06.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.583+0000 7fe57f7fe640 1 -- 172.21.15.16:0/1119514773 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe58800f450 con 0x7fe58c0feaa0 2024-08-01T06:53:06.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.583+0000 7fe594530640 1 -- 172.21.15.16:0/1119514773 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58c1018d0 con 0x7fe58c0feaa0 2024-08-01T06:53:06.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.583+0000 7fe594530640 1 -- 172.21.15.16:0/1119514773 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58c101e70 con 0x7fe58c0feaa0 2024-08-01T06:53:06.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.584+0000 7fe594530640 1 -- 172.21.15.16:0/1119514773 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe58c107690 con 0x7fe58c0feaa0 2024-08-01T06:53:06.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.585+0000 7fe57f7fe640 1 -- 172.21.15.16:0/1119514773 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe588007950 con 0x7fe58c0feaa0 2024-08-01T06:53:06.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.585+0000 7fe57f7fe640 1 --2- 172.21.15.16:0/1119514773 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fe57806cc50 0x7fe57806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:06.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.586+0000 7fe591acb640 1 --2- 172.21.15.16:0/1119514773 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fe57806cc50 0x7fe57806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:06.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.586+0000 7fe57f7fe640 1 -- 172.21.15.16:0/1119514773 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe588013070 con 0x7fe58c0feaa0 2024-08-01T06:53:06.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.586+0000 7fe591acb640 1 --2- 172.21.15.16:0/1119514773 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fe57806cc50 0x7fe57806f110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe580000c00 tx=0x7fe5800314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:06.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.590+0000 7fe57f7fe640 1 -- 172.21.15.16:0/1119514773 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fe588056700 con 0x7fe58c0feaa0 2024-08-01T06:53:06.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.769+0000 7fe594530640 1 -- 172.21.15.16:0/1119514773 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe58c19d720 con 0x7fe57806cc50 2024-08-01T06:53:06.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.770+0000 7fe57f7fe640 1 -- 172.21.15.16:0/1119514773 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+145 (secure 0 0 0) 0x7fe58c19d720 con 0x7fe57806cc50 2024-08-01T06:53:06.772 INFO:teuthology.orchestra.run.smithi016.stdout:HOST ADDR LABELS STATUS 2024-08-01T06:53:06.772 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016 172.21.15.16 2024-08-01T06:53:06.772 INFO:teuthology.orchestra.run.smithi016.stdout:smithi089 172.21.15.89 2024-08-01T06:53:06.772 INFO:teuthology.orchestra.run.smithi016.stdout:2 hosts in cluster 2024-08-01T06:53:06.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.772+0000 7fe594530640 1 -- 172.21.15.16:0/1119514773 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fe57806cc50 msgr2=0x7fe57806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:06.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.772+0000 7fe594530640 1 --2- 172.21.15.16:0/1119514773 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fe57806cc50 0x7fe57806f110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe580000c00 tx=0x7fe5800314e0 comp rx=0 tx=0).stop 2024-08-01T06:53:06.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.772+0000 7fe594530640 1 -- 172.21.15.16:0/1119514773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe58c0feaa0 msgr2=0x7fe58c102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:06.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.772+0000 7fe594530640 1 --2- 172.21.15.16:0/1119514773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe58c0feaa0 0x7fe58c102a30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe58800c8f0 tx=0x7fe58800cdb0 comp rx=0 tx=0).stop 2024-08-01T06:53:06.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.772+0000 7fe594530640 1 -- 172.21.15.16:0/1119514773 shutdown_connections 2024-08-01T06:53:06.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.772+0000 7fe594530640 1 --2- 172.21.15.16:0/1119514773 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fe57806cc50 0x7fe57806f110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:06.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.772+0000 7fe594530640 1 --2- 172.21.15.16:0/1119514773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe58c0ffca0 0x7fe58c101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:06.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.772+0000 7fe594530640 1 --2- 172.21.15.16:0/1119514773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe58c0feaa0 0x7fe58c102a30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:06.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.772+0000 7fe594530640 1 -- 172.21.15.16:0/1119514773 >> 172.21.15.16:0/1119514773 conn(0x7fe58c0fa250 msgr2=0x7fe58c068500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:06.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.773+0000 7fe594530640 1 -- 172.21.15.16:0/1119514773 shutdown_connections 2024-08-01T06:53:06.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:06.773+0000 7fe594530640 1 -- 172.21.15.16:0/1119514773 wait complete. 2024-08-01T06:53:06.970 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:06 smithi016 ceph-mon[29266]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:07.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:06 smithi089 ceph-mon[36617]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:07.416 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- bash -c 'ceph orch device ls' 2024-08-01T06:53:07.634 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:53:07.946 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:07 smithi016 ceph-mon[29266]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:53:08.038 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:07 smithi089 ceph-mon[36617]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:53:08.927 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:08 smithi016 ceph-mon[29266]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:09.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:08 smithi089 ceph-mon[36617]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:09.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.139+0000 7f04f7be6640 1 -- 172.21.15.16:0/261727938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04f00fe420 msgr2=0x7f04f00fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:09.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.139+0000 7f04f7be6640 1 --2- 172.21.15.16:0/261727938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04f00fe420 0x7f04f00fe820 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f04ec009880 tx=0x7f04ec02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:53:09.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.139+0000 7f04f7be6640 1 -- 172.21.15.16:0/261727938 shutdown_connections 2024-08-01T06:53:09.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.139+0000 7f04f7be6640 1 --2- 172.21.15.16:0/261727938 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04f00fed60 0x7f04f00ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:09.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.139+0000 7f04f7be6640 1 --2- 172.21.15.16:0/261727938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04f00fe420 0x7f04f00fe820 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:09.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.139+0000 7f04f7be6640 1 -- 172.21.15.16:0/261727938 >> 172.21.15.16:0/261727938 conn(0x7f04f00fa250 msgr2=0x7f04f00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:09.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.139+0000 7f04f7be6640 1 -- 172.21.15.16:0/261727938 shutdown_connections 2024-08-01T06:53:09.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.139+0000 7f04f7be6640 1 -- 172.21.15.16:0/261727938 wait complete. 2024-08-01T06:53:09.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.140+0000 7f04f7be6640 1 Processor -- start 2024-08-01T06:53:09.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.140+0000 7f04f7be6640 1 -- start start 2024-08-01T06:53:09.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.140+0000 7f04f7be6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04f00fe420 0x7f04f0197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:09.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.140+0000 7f04f7be6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04f00fed60 0x7f04f0197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:09.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.140+0000 7f04f7be6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f01982a0 con 0x7f04f00fe420 2024-08-01T06:53:09.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.140+0000 7f04f7be6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f0198410 con 0x7f04f00fed60 2024-08-01T06:53:09.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.140+0000 7f04f5982640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04f00fe420 0x7f04f0197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:09.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.140+0000 7f04f5982640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04f00fe420 0x7f04f0197790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60688/0 (socket says 172.21.15.16:60688) 2024-08-01T06:53:09.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.140+0000 7f04f5982640 1 -- 172.21.15.16:0/2355923768 learned_addr learned my addr 172.21.15.16:0/2355923768 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:53:09.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.140+0000 7f04f5181640 1 --2- 172.21.15.16:0/2355923768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04f00fed60 0x7f04f0197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:09.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.141+0000 7f04f5982640 1 -- 172.21.15.16:0/2355923768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04f00fed60 msgr2=0x7f04f0197cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:09.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.141+0000 7f04f5982640 1 --2- 172.21.15.16:0/2355923768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04f00fed60 0x7f04f0197cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:09.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.141+0000 7f04f5982640 1 -- 172.21.15.16:0/2355923768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e0009490 con 0x7f04f00fe420 2024-08-01T06:53:09.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.141+0000 7f04f5982640 1 --2- 172.21.15.16:0/2355923768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04f00fe420 0x7f04f0197790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0055a0 tx=0x7f04ec0055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:09.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.141+0000 7f04e6ffd640 1 -- 172.21.15.16:0/2355923768 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04ec004aa0 con 0x7f04f00fe420 2024-08-01T06:53:09.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.141+0000 7f04f7be6640 1 -- 172.21.15.16:0/2355923768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ec009560 con 0x7f04f00fe420 2024-08-01T06:53:09.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.141+0000 7f04e6ffd640 1 -- 172.21.15.16:0/2355923768 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f04ec004c00 con 0x7f04f00fe420 2024-08-01T06:53:09.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.141+0000 7f04e6ffd640 1 -- 172.21.15.16:0/2355923768 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04ec003b10 con 0x7f04f00fe420 2024-08-01T06:53:09.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.141+0000 7f04f7be6640 1 -- 172.21.15.16:0/2355923768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f019d1b0 con 0x7f04f00fe420 2024-08-01T06:53:09.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.142+0000 7f04f7be6640 1 -- 172.21.15.16:0/2355923768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f010a970 con 0x7f04f00fe420 2024-08-01T06:53:09.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.143+0000 7f04e6ffd640 1 -- 172.21.15.16:0/2355923768 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f04ec031d20 con 0x7f04f00fe420 2024-08-01T06:53:09.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.143+0000 7f04e6ffd640 1 --2- 172.21.15.16:0/2355923768 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f04dc06cc50 0x7f04dc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:09.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.143+0000 7f04e6ffd640 1 -- 172.21.15.16:0/2355923768 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f04ec0acf90 con 0x7f04f00fe420 2024-08-01T06:53:09.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.143+0000 7f04f5181640 1 --2- 172.21.15.16:0/2355923768 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f04dc06cc50 0x7f04dc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:09.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.144+0000 7f04f5181640 1 --2- 172.21.15.16:0/2355923768 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f04dc06cc50 0x7f04dc06f110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f04f0198cb0 tx=0x7f04e0005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:09.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.147+0000 7f04e6ffd640 1 -- 172.21.15.16:0/2355923768 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f04ec077810 con 0x7f04f00fe420 2024-08-01T06:53:09.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.326+0000 7f04f7be6640 1 -- 172.21.15.16:0/2355923768 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f04f019d3d0 con 0x7f04dc06cc50 2024-08-01T06:53:09.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.328+0000 7f04e6ffd640 1 -- 172.21.15.16:0/2355923768 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f04f019d3d0 con 0x7f04dc06cc50 2024-08-01T06:53:09.330 INFO:teuthology.orchestra.run.smithi016.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-08-01T06:53:09.330 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513002C480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-08-01T06:53:09.330 INFO:teuthology.orchestra.run.smithi016.stdout:smithi089 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040126400BGN 372G No 71s ago Has a FileSystem, LVM detected 2024-08-01T06:53:09.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.330+0000 7f04f7be6640 1 -- 172.21.15.16:0/2355923768 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f04dc06cc50 msgr2=0x7f04dc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:09.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.330+0000 7f04f7be6640 1 --2- 172.21.15.16:0/2355923768 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f04dc06cc50 0x7f04dc06f110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f04f0198cb0 tx=0x7f04e0005f90 comp rx=0 tx=0).stop 2024-08-01T06:53:09.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.330+0000 7f04f7be6640 1 -- 172.21.15.16:0/2355923768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04f00fe420 msgr2=0x7f04f0197790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:09.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.330+0000 7f04f7be6640 1 --2- 172.21.15.16:0/2355923768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04f00fe420 0x7f04f0197790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0055a0 tx=0x7f04ec0055d0 comp rx=0 tx=0).stop 2024-08-01T06:53:09.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.330+0000 7f04f7be6640 1 -- 172.21.15.16:0/2355923768 shutdown_connections 2024-08-01T06:53:09.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.330+0000 7f04f7be6640 1 --2- 172.21.15.16:0/2355923768 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f04dc06cc50 0x7f04dc06f110 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:09.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.330+0000 7f04f7be6640 1 --2- 172.21.15.16:0/2355923768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04f00fed60 0x7f04f0197cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:09.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.330+0000 7f04f7be6640 1 --2- 172.21.15.16:0/2355923768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04f00fe420 0x7f04f0197790 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:09.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.330+0000 7f04f7be6640 1 -- 172.21.15.16:0/2355923768 >> 172.21.15.16:0/2355923768 conn(0x7f04f00fa250 msgr2=0x7f04f00fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:09.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.330+0000 7f04f7be6640 1 -- 172.21.15.16:0/2355923768 shutdown_connections 2024-08-01T06:53:09.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:09.330+0000 7f04f7be6640 1 -- 172.21.15.16:0/2355923768 wait complete. 2024-08-01T06:53:09.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:09 smithi016 ceph-mon[29266]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:53:09.962 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-01T06:53:09.972 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi016.front.sepia.ceph.com 2024-08-01T06:53:09.972 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-08-01T06:53:10.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:09 smithi089 ceph-mon[36617]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:53:10.207 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:53:10.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:10 smithi016 ceph-mon[29266]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:11.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:10 smithi089 ceph-mon[36617]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:11.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.703+0000 7fd6db45e640 1 -- 172.21.15.16:0/3577069290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d40ffbc0 msgr2=0x7fd6d40fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:11.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.703+0000 7fd6db45e640 1 --2- 172.21.15.16:0/3577069290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d40ffbc0 0x7fd6d40fffc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009880 tx=0x7fd6d002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:53:11.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.703+0000 7fd6db45e640 1 -- 172.21.15.16:0/3577069290 shutdown_connections 2024-08-01T06:53:11.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.703+0000 7fd6db45e640 1 --2- 172.21.15.16:0/3577069290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d4100dc0 0x7fd6d4101240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:11.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.703+0000 7fd6db45e640 1 --2- 172.21.15.16:0/3577069290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d40ffbc0 0x7fd6d40fffc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:11.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.703+0000 7fd6db45e640 1 -- 172.21.15.16:0/3577069290 >> 172.21.15.16:0/3577069290 conn(0x7fd6d40fb350 msgr2=0x7fd6d40fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:11.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.704+0000 7fd6db45e640 1 -- 172.21.15.16:0/3577069290 shutdown_connections 2024-08-01T06:53:11.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.704+0000 7fd6db45e640 1 -- 172.21.15.16:0/3577069290 wait complete. 2024-08-01T06:53:11.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.704+0000 7fd6db45e640 1 Processor -- start 2024-08-01T06:53:11.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.704+0000 7fd6db45e640 1 -- start start 2024-08-01T06:53:11.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.704+0000 7fd6db45e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d40ffbc0 0x7fd6d4195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:11.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.704+0000 7fd6db45e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d4100dc0 0x7fd6d4195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:11.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.704+0000 7fd6db45e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d4196220 con 0x7fd6d4100dc0 2024-08-01T06:53:11.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.704+0000 7fd6db45e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d4196390 con 0x7fd6d40ffbc0 2024-08-01T06:53:11.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.705+0000 7fd6d89f9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d4100dc0 0x7fd6d4195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:11.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.705+0000 7fd6d89f9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d4100dc0 0x7fd6d4195c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60702/0 (socket says 172.21.15.16:60702) 2024-08-01T06:53:11.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.705+0000 7fd6d89f9640 1 -- 172.21.15.16:0/777362157 learned_addr learned my addr 172.21.15.16:0/777362157 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:53:11.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.705+0000 7fd6d91fa640 1 --2- 172.21.15.16:0/777362157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d40ffbc0 0x7fd6d4195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:11.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.705+0000 7fd6d89f9640 1 -- 172.21.15.16:0/777362157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d40ffbc0 msgr2=0x7fd6d4195710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:11.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.705+0000 7fd6d89f9640 1 --2- 172.21.15.16:0/777362157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d40ffbc0 0x7fd6d4195710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:11.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.705+0000 7fd6d89f9640 1 -- 172.21.15.16:0/777362157 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d0009560 con 0x7fd6d4100dc0 2024-08-01T06:53:11.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.705+0000 7fd6d89f9640 1 --2- 172.21.15.16:0/777362157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d4100dc0 0x7fd6d4195c50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400b450 tx=0x7fd6c400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:11.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.705+0000 7fd6ca7fc640 1 -- 172.21.15.16:0/777362157 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6c4011860 con 0x7fd6d4100dc0 2024-08-01T06:53:11.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.705+0000 7fd6ca7fc640 1 -- 172.21.15.16:0/777362157 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6c4011e80 con 0x7fd6d4100dc0 2024-08-01T06:53:11.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.705+0000 7fd6db45e640 1 -- 172.21.15.16:0/777362157 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d419ae30 con 0x7fd6d4100dc0 2024-08-01T06:53:11.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.705+0000 7fd6ca7fc640 1 -- 172.21.15.16:0/777362157 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6c400f570 con 0x7fd6d4100dc0 2024-08-01T06:53:11.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.705+0000 7fd6db45e640 1 -- 172.21.15.16:0/777362157 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d419b3d0 con 0x7fd6d4100dc0 2024-08-01T06:53:11.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.706+0000 7fd6db45e640 1 -- 172.21.15.16:0/777362157 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d4100040 con 0x7fd6d4100dc0 2024-08-01T06:53:11.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.707+0000 7fd6ca7fc640 1 -- 172.21.15.16:0/777362157 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd6c40103e0 con 0x7fd6d4100dc0 2024-08-01T06:53:11.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.707+0000 7fd6ca7fc640 1 --2- 172.21.15.16:0/777362157 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd6c006cc60 0x7fd6c006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:11.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.707+0000 7fd6ca7fc640 1 -- 172.21.15.16:0/777362157 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd6c408be20 con 0x7fd6d4100dc0 2024-08-01T06:53:11.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.707+0000 7fd6d91fa640 1 --2- 172.21.15.16:0/777362157 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd6c006cc60 0x7fd6c006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:11.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.708+0000 7fd6d91fa640 1 --2- 172.21.15.16:0/777362157 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd6c006cc60 0x7fd6c006f120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0006010 tx=0x7fd6d0031500 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:11.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.712+0000 7fd6ca7fc640 1 -- 172.21.15.16:0/777362157 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fd6c4056530 con 0x7fd6d4100dc0 2024-08-01T06:53:11.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:11.908+0000 7fd6db45e640 1 -- 172.21.15.16:0/777362157 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6d4105710 con 0x7fd6c006cc60 2024-08-01T06:53:12.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:12 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-08-01T06:53:12.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:12 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-08-01T06:53:13.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:13.428+0000 7fd6ca7fc640 1 -- 172.21.15.16:0/777362157 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd6d4105710 con 0x7fd6c006cc60 2024-08-01T06:53:13.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:13.431+0000 7fd6db45e640 1 -- 172.21.15.16:0/777362157 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd6c006cc60 msgr2=0x7fd6c006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:13.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:13.431+0000 7fd6db45e640 1 --2- 172.21.15.16:0/777362157 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd6c006cc60 0x7fd6c006f120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0006010 tx=0x7fd6d0031500 comp rx=0 tx=0).stop 2024-08-01T06:53:13.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:13.431+0000 7fd6db45e640 1 -- 172.21.15.16:0/777362157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d4100dc0 msgr2=0x7fd6d4195c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:13.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:13.431+0000 7fd6db45e640 1 --2- 172.21.15.16:0/777362157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d4100dc0 0x7fd6d4195c50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400b450 tx=0x7fd6c400b910 comp rx=0 tx=0).stop 2024-08-01T06:53:13.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:13.431+0000 7fd6db45e640 1 -- 172.21.15.16:0/777362157 shutdown_connections 2024-08-01T06:53:13.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:13.431+0000 7fd6db45e640 1 --2- 172.21.15.16:0/777362157 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd6c006cc60 0x7fd6c006f120 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:13.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:13.431+0000 7fd6db45e640 1 --2- 172.21.15.16:0/777362157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6d4100dc0 0x7fd6d4195c50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:13.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:13.431+0000 7fd6db45e640 1 --2- 172.21.15.16:0/777362157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d40ffbc0 0x7fd6d4195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:13.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:13.431+0000 7fd6db45e640 1 -- 172.21.15.16:0/777362157 >> 172.21.15.16:0/777362157 conn(0x7fd6d40fb350 msgr2=0x7fd6d4103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:13.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:13.431+0000 7fd6db45e640 1 -- 172.21.15.16:0/777362157 shutdown_connections 2024-08-01T06:53:13.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:13.431+0000 7fd6db45e640 1 -- 172.21.15.16:0/777362157 wait complete. 2024-08-01T06:53:13.746 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:13 smithi016 ceph-mon[29266]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:53:13.746 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:13 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-08-01T06:53:13.746 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:13 smithi016 ceph-mon[29266]: osdmap e41: 6 total, 6 up, 6 in 2024-08-01T06:53:13.746 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:13 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-08-01T06:53:13.746 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:13 smithi016 ceph-mon[29266]: pgmap v169: 33 pgs: 9 creating+peering, 1 active+clean, 23 unknown; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:13.746 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:13 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-08-01T06:53:13.747 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:13 smithi016 ceph-mon[29266]: osdmap e42: 6 total, 6 up, 6 in 2024-08-01T06:53:13.747 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:13 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016[29262]: 2024-08-01T06:53:13.409+0000 7f2ba4d29640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-01T06:53:13.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:13 smithi089 ceph-mon[36617]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:53:13.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:13 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-08-01T06:53:13.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:13 smithi089 ceph-mon[36617]: osdmap e41: 6 total, 6 up, 6 in 2024-08-01T06:53:13.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:13 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-08-01T06:53:13.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:13 smithi089 ceph-mon[36617]: pgmap v169: 33 pgs: 9 creating+peering, 1 active+clean, 23 unknown; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:13.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:13 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-08-01T06:53:13.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:13 smithi089 ceph-mon[36617]: osdmap e42: 6 total, 6 up, 6 in 2024-08-01T06:53:14.186 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-01T06:53:14.481 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:14 smithi016 ceph-mon[29266]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-01T06:53:14.481 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:14 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-08-01T06:53:14.481 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:14 smithi016 ceph-mon[29266]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-01T06:53:14.481 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:14 smithi016 ceph-mon[29266]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-01T06:53:14.481 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:14 smithi016 ceph-mon[29266]: osdmap e43: 6 total, 6 up, 6 in 2024-08-01T06:53:14.481 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:14 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-08-01T06:53:14.481 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:14 smithi016 ceph-mon[29266]: fsmap cephfs:0 2024-08-01T06:53:14.481 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:14 smithi016 ceph-mon[29266]: Saving service mds.cephfs spec with placement count:4 2024-08-01T06:53:14.482 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:14 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:14.482 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:14 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:53:14.482 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:14 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:53:14.482 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:14 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:53:14.482 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:14 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:14.482 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:14 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi016.bgqkxu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T06:53:14.482 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:14 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi016.bgqkxu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-01T06:53:14.482 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:14 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:53:14.482 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:14 smithi016 ceph-mon[29266]: Deploying daemon mds.cephfs.smithi016.bgqkxu on smithi016 2024-08-01T06:53:14.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:14 smithi089 ceph-mon[36617]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-01T06:53:14.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:14 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-08-01T06:53:14.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:14 smithi089 ceph-mon[36617]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-01T06:53:14.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:14 smithi089 ceph-mon[36617]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-01T06:53:14.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:14 smithi089 ceph-mon[36617]: osdmap e43: 6 total, 6 up, 6 in 2024-08-01T06:53:14.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:14 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-08-01T06:53:14.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:14 smithi089 ceph-mon[36617]: fsmap cephfs:0 2024-08-01T06:53:14.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:14 smithi089 ceph-mon[36617]: Saving service mds.cephfs spec with placement count:4 2024-08-01T06:53:14.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:14 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:14.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:14 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:53:14.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:14 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:53:14.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:14 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:53:14.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:14 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:14.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:14 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi016.bgqkxu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T06:53:14.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:14 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi016.bgqkxu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-01T06:53:14.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:14 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:53:14.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:14 smithi089 ceph-mon[36617]: Deploying daemon mds.cephfs.smithi016.bgqkxu on smithi016 2024-08-01T06:53:14.966 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:53:15.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:15 smithi089 ceph-mon[36617]: osdmap e44: 6 total, 6 up, 6 in 2024-08-01T06:53:15.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:15 smithi089 ceph-mon[36617]: pgmap v173: 65 pgs: 18 creating+peering, 6 active+clean, 41 unknown; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:15.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:15 smithi016 ceph-mon[29266]: osdmap e44: 6 total, 6 up, 6 in 2024-08-01T06:53:15.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:15 smithi016 ceph-mon[29266]: pgmap v173: 65 pgs: 18 creating+peering, 6 active+clean, 41 unknown; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:16.726 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:16 smithi016 ceph-mon[29266]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-01T06:53:16.726 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:16 smithi016 ceph-mon[29266]: osdmap e45: 6 total, 6 up, 6 in 2024-08-01T06:53:16.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:16 smithi089 ceph-mon[36617]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-01T06:53:16.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:16 smithi089 ceph-mon[36617]: osdmap e45: 6 total, 6 up, 6 in 2024-08-01T06:53:17.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.283+0000 7fe6f6615640 1 -- 172.21.15.16:0/3815900404 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6f00ffb90 msgr2=0x7fe6f00fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:17.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.283+0000 7fe6f6615640 1 --2- 172.21.15.16:0/3815900404 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6f00ffb90 0x7fe6f00fff90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0009880 tx=0x7fe6e002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:53:17.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.283+0000 7fe6f6615640 1 -- 172.21.15.16:0/3815900404 shutdown_connections 2024-08-01T06:53:17.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.283+0000 7fe6f6615640 1 --2- 172.21.15.16:0/3815900404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6f0100d90 0x7fe6f0101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:17.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.283+0000 7fe6f6615640 1 --2- 172.21.15.16:0/3815900404 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6f00ffb90 0x7fe6f00fff90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:17.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.283+0000 7fe6f6615640 1 -- 172.21.15.16:0/3815900404 >> 172.21.15.16:0/3815900404 conn(0x7fe6f00fb320 msgr2=0x7fe6f00fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:17.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.283+0000 7fe6f6615640 1 -- 172.21.15.16:0/3815900404 shutdown_connections 2024-08-01T06:53:17.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.283+0000 7fe6f6615640 1 -- 172.21.15.16:0/3815900404 wait complete. 2024-08-01T06:53:17.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.284+0000 7fe6f6615640 1 Processor -- start 2024-08-01T06:53:17.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.284+0000 7fe6f6615640 1 -- start start 2024-08-01T06:53:17.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.284+0000 7fe6f6615640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6f00ffb90 0x7fe6f0195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:17.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.284+0000 7fe6f6615640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6f0100d90 0x7fe6f0195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:17.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.284+0000 7fe6f6615640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f01961a0 con 0x7fe6f0100d90 2024-08-01T06:53:17.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.284+0000 7fe6f6615640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0196310 con 0x7fe6f00ffb90 2024-08-01T06:53:17.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.284+0000 7fe6ef7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6f0100d90 0x7fe6f0195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:17.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.284+0000 7fe6ef7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6f0100d90 0x7fe6f0195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60720/0 (socket says 172.21.15.16:60720) 2024-08-01T06:53:17.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.284+0000 7fe6ef7fe640 1 -- 172.21.15.16:0/346418302 learned_addr learned my addr 172.21.15.16:0/346418302 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:53:17.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.285+0000 7fe6effff640 1 --2- 172.21.15.16:0/346418302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6f00ffb90 0x7fe6f0195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:17.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.285+0000 7fe6ef7fe640 1 -- 172.21.15.16:0/346418302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6f00ffb90 msgr2=0x7fe6f0195690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:17.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.285+0000 7fe6ef7fe640 1 --2- 172.21.15.16:0/346418302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6f00ffb90 0x7fe6f0195690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:17.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.285+0000 7fe6ef7fe640 1 -- 172.21.15.16:0/346418302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e0009560 con 0x7fe6f0100d90 2024-08-01T06:53:17.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.285+0000 7fe6ef7fe640 1 --2- 172.21.15.16:0/346418302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6f0100d90 0x7fe6f0195bd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400e9a0 tx=0x7fe6e400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:17.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.285+0000 7fe6ed7fa640 1 -- 172.21.15.16:0/346418302 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6e400cd50 con 0x7fe6f0100d90 2024-08-01T06:53:17.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.285+0000 7fe6f6615640 1 -- 172.21.15.16:0/346418302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f019ad60 con 0x7fe6f0100d90 2024-08-01T06:53:17.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.285+0000 7fe6ed7fa640 1 -- 172.21.15.16:0/346418302 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe6e400ceb0 con 0x7fe6f0100d90 2024-08-01T06:53:17.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.285+0000 7fe6ed7fa640 1 -- 172.21.15.16:0/346418302 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6e4010660 con 0x7fe6f0100d90 2024-08-01T06:53:17.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.285+0000 7fe6f6615640 1 -- 172.21.15.16:0/346418302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f019b330 con 0x7fe6f0100d90 2024-08-01T06:53:17.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.286+0000 7fe6f6615640 1 -- 172.21.15.16:0/346418302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f018f730 con 0x7fe6f0100d90 2024-08-01T06:53:17.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.287+0000 7fe6ed7fa640 1 -- 172.21.15.16:0/346418302 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe6e40048a0 con 0x7fe6f0100d90 2024-08-01T06:53:17.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.287+0000 7fe6ed7fa640 1 --2- 172.21.15.16:0/346418302 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fe6d806cc50 0x7fe6d806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:17.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.287+0000 7fe6ed7fa640 1 -- 172.21.15.16:0/346418302 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fe6e4014070 con 0x7fe6f0100d90 2024-08-01T06:53:17.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.287+0000 7fe6effff640 1 --2- 172.21.15.16:0/346418302 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fe6d806cc50 0x7fe6d806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:17.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.288+0000 7fe6effff640 1 --2- 172.21.15.16:0/346418302 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fe6d806cc50 0x7fe6d806f110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0031540 tx=0x7fe6e0000bc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:17.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.292+0000 7fe6ed7fa640 1 -- 172.21.15.16:0/346418302 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fe6e405a660 con 0x7fe6f0100d90 2024-08-01T06:53:17.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.516+0000 7fe6f6615640 1 -- 172.21.15.16:0/346418302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe6f002c520 con 0x7fe6f0100d90 2024-08-01T06:53:17.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.516+0000 7fe6ed7fa640 1 -- 172.21.15.16:0/346418302 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1114 (secure 0 0 0) 0x7fe6e405a1f0 con 0x7fe6f0100d90 2024-08-01T06:53:17.519 INFO:teuthology.orchestra.run.smithi016.stdout:e2 2024-08-01T06:53:17.519 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T06:53:17.519 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:53:17.519 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T06:53:17.519 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:53:17.519 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T06:53:17.520 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T06:53:17.520 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 2 2024-08-01T06:53:17.520 INFO:teuthology.orchestra.run.smithi016.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-01T06:53:17.520 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T06:53:17.520 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T06:53:13.411210+0000 2024-08-01T06:53:17.520 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T06:53:17.520 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T06:53:17.520 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T06:53:17.520 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T06:53:17.520 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T06:53:17.520 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T06:53:17.520 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T06:53:17.520 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T06:53:17.520 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 0 2024-08-01T06:53:17.520 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:53:17.521 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 1 2024-08-01T06:53:17.521 INFO:teuthology.orchestra.run.smithi016.stdout:in 2024-08-01T06:53:17.521 INFO:teuthology.orchestra.run.smithi016.stdout:up {} 2024-08-01T06:53:17.521 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T06:53:17.521 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T06:53:17.521 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T06:53:17.521 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T06:53:17.521 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T06:53:17.521 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T06:53:17.521 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T06:53:17.521 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T06:53:17.521 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 0 2024-08-01T06:53:17.521 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:53:17.521 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:53:17.522 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 2 2024-08-01T06:53:17.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.519+0000 7fe6f6615640 1 -- 172.21.15.16:0/346418302 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fe6d806cc50 msgr2=0x7fe6d806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:17.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.519+0000 7fe6f6615640 1 --2- 172.21.15.16:0/346418302 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fe6d806cc50 0x7fe6d806f110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0031540 tx=0x7fe6e0000bc0 comp rx=0 tx=0).stop 2024-08-01T06:53:17.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.519+0000 7fe6f6615640 1 -- 172.21.15.16:0/346418302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6f0100d90 msgr2=0x7fe6f0195bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:17.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.519+0000 7fe6f6615640 1 --2- 172.21.15.16:0/346418302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6f0100d90 0x7fe6f0195bd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400e9a0 tx=0x7fe6e400eda0 comp rx=0 tx=0).stop 2024-08-01T06:53:17.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.519+0000 7fe6f6615640 1 -- 172.21.15.16:0/346418302 shutdown_connections 2024-08-01T06:53:17.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.519+0000 7fe6f6615640 1 --2- 172.21.15.16:0/346418302 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fe6d806cc50 0x7fe6d806f110 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:17.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.519+0000 7fe6f6615640 1 --2- 172.21.15.16:0/346418302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6f0100d90 0x7fe6f0195bd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:17.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.519+0000 7fe6f6615640 1 --2- 172.21.15.16:0/346418302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6f00ffb90 0x7fe6f0195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:17.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.519+0000 7fe6f6615640 1 -- 172.21.15.16:0/346418302 >> 172.21.15.16:0/346418302 conn(0x7fe6f00fb320 msgr2=0x7fe6f01044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:17.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.519+0000 7fe6f6615640 1 -- 172.21.15.16:0/346418302 shutdown_connections 2024-08-01T06:53:17.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:17.519+0000 7fe6f6615640 1 -- 172.21.15.16:0/346418302 wait complete. 2024-08-01T06:53:17.564 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:17 smithi016 ceph-mon[29266]: pgmap v175: 65 pgs: 18 creating+peering, 15 active+clean, 32 unknown; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:17.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:17 smithi089 ceph-mon[36617]: pgmap v175: 65 pgs: 18 creating+peering, 15 active+clean, 32 unknown; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:18.347 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-01T06:53:18.356 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi016.front.sepia.ceph.com 2024-08-01T06:53:18.357 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-08-01T06:53:18.572 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:53:18.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:18 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/346418302' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:53:18.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:18 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:18.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:18 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:53:18.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:18 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:18.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:18 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:18.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:18 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:18.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:18 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.jhouje", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T06:53:18.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:18 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.jhouje", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-01T06:53:18.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:18 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:53:18.650 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:18 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/346418302' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:53:18.650 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:18 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:18.650 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:18 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:53:18.650 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:18 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:18.650 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:18 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:18.650 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:18 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:18.650 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:18 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.jhouje", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T06:53:18.650 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:18 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.jhouje", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-01T06:53:18.650 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:18 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:53:19.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:19 smithi016 ceph-mon[29266]: Deploying daemon mds.cephfs.smithi089.jhouje on smithi089 2024-08-01T06:53:19.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:19 smithi016 ceph-mon[29266]: mds.? [v2:172.21.15.16:6826/1582990915,v1:172.21.15.16:6827/1582990915] up:boot 2024-08-01T06:53:19.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:19 smithi016 ceph-mon[29266]: daemon mds.cephfs.smithi016.bgqkxu assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-08-01T06:53:19.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:19 smithi016 ceph-mon[29266]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-01T06:53:19.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:19 smithi016 ceph-mon[29266]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-01T06:53:19.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:19 smithi016 ceph-mon[29266]: Cluster is now healthy 2024-08-01T06:53:19.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:19 smithi016 ceph-mon[29266]: fsmap cephfs:0 1 up:standby 2024-08-01T06:53:19.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:19 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.bgqkxu"}]: dispatch 2024-08-01T06:53:19.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:19 smithi016 ceph-mon[29266]: pgmap v176: 65 pgs: 4 creating+peering, 61 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:19.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:19 smithi016 ceph-mon[29266]: fsmap cephfs:1 {0=cephfs.smithi016.bgqkxu=up:creating} 2024-08-01T06:53:19.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:19 smithi016 ceph-mon[29266]: daemon mds.cephfs.smithi016.bgqkxu is now active in filesystem cephfs as rank 0 2024-08-01T06:53:19.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:19 smithi089 ceph-mon[36617]: Deploying daemon mds.cephfs.smithi089.jhouje on smithi089 2024-08-01T06:53:19.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:19 smithi089 ceph-mon[36617]: mds.? [v2:172.21.15.16:6826/1582990915,v1:172.21.15.16:6827/1582990915] up:boot 2024-08-01T06:53:19.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:19 smithi089 ceph-mon[36617]: daemon mds.cephfs.smithi016.bgqkxu assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-08-01T06:53:19.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:19 smithi089 ceph-mon[36617]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-01T06:53:19.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:19 smithi089 ceph-mon[36617]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-01T06:53:19.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:19 smithi089 ceph-mon[36617]: Cluster is now healthy 2024-08-01T06:53:19.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:19 smithi089 ceph-mon[36617]: fsmap cephfs:0 1 up:standby 2024-08-01T06:53:19.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:19 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.bgqkxu"}]: dispatch 2024-08-01T06:53:19.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:19 smithi089 ceph-mon[36617]: pgmap v176: 65 pgs: 4 creating+peering, 61 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:53:19.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:19 smithi089 ceph-mon[36617]: fsmap cephfs:1 {0=cephfs.smithi016.bgqkxu=up:creating} 2024-08-01T06:53:19.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:19 smithi089 ceph-mon[36617]: daemon mds.cephfs.smithi016.bgqkxu is now active in filesystem cephfs as rank 0 2024-08-01T06:53:20.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.081+0000 7fad57974640 1 -- 172.21.15.16:0/659335067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad50100da0 msgr2=0x7fad50101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:20.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.081+0000 7fad57974640 1 --2- 172.21.15.16:0/659335067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad50100da0 0x7fad50101220 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fad40009880 tx=0x7fad4002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:53:20.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.081+0000 7fad57974640 1 -- 172.21.15.16:0/659335067 shutdown_connections 2024-08-01T06:53:20.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.081+0000 7fad57974640 1 --2- 172.21.15.16:0/659335067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad50100da0 0x7fad50101220 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:20.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.081+0000 7fad57974640 1 --2- 172.21.15.16:0/659335067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad500ffba0 0x7fad500fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:20.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.081+0000 7fad57974640 1 -- 172.21.15.16:0/659335067 >> 172.21.15.16:0/659335067 conn(0x7fad500fb330 msgr2=0x7fad500fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:20.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.081+0000 7fad57974640 1 -- 172.21.15.16:0/659335067 shutdown_connections 2024-08-01T06:53:20.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.081+0000 7fad57974640 1 -- 172.21.15.16:0/659335067 wait complete. 2024-08-01T06:53:20.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.081+0000 7fad57974640 1 Processor -- start 2024-08-01T06:53:20.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.082+0000 7fad57974640 1 -- start start 2024-08-01T06:53:20.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.082+0000 7fad57974640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad500ffba0 0x7fad50074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:20.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.082+0000 7fad57974640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad50100da0 0x7fad500728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:20.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.082+0000 7fad57974640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad50072de0 con 0x7fad50100da0 2024-08-01T06:53:20.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.082+0000 7fad57974640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad50072f50 con 0x7fad500ffba0 2024-08-01T06:53:20.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.082+0000 7fad54f0f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad50100da0 0x7fad500728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:20.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.082+0000 7fad54f0f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad50100da0 0x7fad500728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58086/0 (socket says 172.21.15.16:58086) 2024-08-01T06:53:20.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.082+0000 7fad54f0f640 1 -- 172.21.15.16:0/4250758128 learned_addr learned my addr 172.21.15.16:0/4250758128 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:53:20.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.082+0000 7fad55710640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad500ffba0 0x7fad50074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:20.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.082+0000 7fad54f0f640 1 -- 172.21.15.16:0/4250758128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad500ffba0 msgr2=0x7fad50074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:20.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.082+0000 7fad54f0f640 1 --2- 172.21.15.16:0/4250758128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad500ffba0 0x7fad50074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:20.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.082+0000 7fad54f0f640 1 -- 172.21.15.16:0/4250758128 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad40009560 con 0x7fad50100da0 2024-08-01T06:53:20.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.082+0000 7fad55710640 1 --2- 172.21.15.16:0/4250758128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad500ffba0 0x7fad50074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T06:53:20.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.083+0000 7fad54f0f640 1 --2- 172.21.15.16:0/4250758128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad50100da0 0x7fad500728a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fad40006010 tx=0x7fad400055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:20.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.083+0000 7fad467fc640 1 -- 172.21.15.16:0/4250758128 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad40004aa0 con 0x7fad50100da0 2024-08-01T06:53:20.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.083+0000 7fad467fc640 1 -- 172.21.15.16:0/4250758128 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad40004c00 con 0x7fad50100da0 2024-08-01T06:53:20.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.083+0000 7fad57974640 1 -- 172.21.15.16:0/4250758128 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad500731d0 con 0x7fad50100da0 2024-08-01T06:53:20.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.083+0000 7fad467fc640 1 -- 172.21.15.16:0/4250758128 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad40003b10 con 0x7fad50100da0 2024-08-01T06:53:20.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.083+0000 7fad57974640 1 -- 172.21.15.16:0/4250758128 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5019d6d0 con 0x7fad50100da0 2024-08-01T06:53:20.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.084+0000 7fad57974640 1 -- 172.21.15.16:0/4250758128 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad500fffa0 con 0x7fad50100da0 2024-08-01T06:53:20.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.085+0000 7fad467fc640 1 -- 172.21.15.16:0/4250758128 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fad40003d50 con 0x7fad50100da0 2024-08-01T06:53:20.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.085+0000 7fad467fc640 1 --2- 172.21.15.16:0/4250758128 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fad3c06cc50 0x7fad3c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:20.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.085+0000 7fad467fc640 1 -- 172.21.15.16:0/4250758128 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fad400ad450 con 0x7fad50100da0 2024-08-01T06:53:20.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.085+0000 7fad55710640 1 --2- 172.21.15.16:0/4250758128 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fad3c06cc50 0x7fad3c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:20.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.086+0000 7fad55710640 1 --2- 172.21.15.16:0/4250758128 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fad3c06cc50 0x7fad3c06f110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0058c0 tx=0x7fad4c00a2d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:20.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.092+0000 7fad467fc640 1 -- 172.21.15.16:0/4250758128 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fad400778d0 con 0x7fad50100da0 2024-08-01T06:53:20.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.300+0000 7fad57974640 1 -- 172.21.15.16:0/4250758128 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fad5002c3e0 con 0x7fad50100da0 2024-08-01T06:53:20.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.584+0000 7fad467fc640 1 -- 172.21.15.16:0/4250758128 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7fad4007aef0 con 0x7fad50100da0 2024-08-01T06:53:20.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.587+0000 7fad57974640 1 -- 172.21.15.16:0/4250758128 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fad3c06cc50 msgr2=0x7fad3c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:20.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.587+0000 7fad57974640 1 --2- 172.21.15.16:0/4250758128 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fad3c06cc50 0x7fad3c06f110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0058c0 tx=0x7fad4c00a2d0 comp rx=0 tx=0).stop 2024-08-01T06:53:20.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.587+0000 7fad57974640 1 -- 172.21.15.16:0/4250758128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad50100da0 msgr2=0x7fad500728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:20.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.587+0000 7fad57974640 1 --2- 172.21.15.16:0/4250758128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad50100da0 0x7fad500728a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fad40006010 tx=0x7fad400055a0 comp rx=0 tx=0).stop 2024-08-01T06:53:20.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.587+0000 7fad57974640 1 -- 172.21.15.16:0/4250758128 shutdown_connections 2024-08-01T06:53:20.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.587+0000 7fad57974640 1 --2- 172.21.15.16:0/4250758128 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fad3c06cc50 0x7fad3c06f110 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:20.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.587+0000 7fad57974640 1 --2- 172.21.15.16:0/4250758128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad50100da0 0x7fad500728a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:20.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.587+0000 7fad57974640 1 --2- 172.21.15.16:0/4250758128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad500ffba0 0x7fad50074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:20.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.587+0000 7fad57974640 1 -- 172.21.15.16:0/4250758128 >> 172.21.15.16:0/4250758128 conn(0x7fad500fb330 msgr2=0x7fad50104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:20.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.587+0000 7fad57974640 1 -- 172.21.15.16:0/4250758128 shutdown_connections 2024-08-01T06:53:20.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:20.587+0000 7fad57974640 1 -- 172.21.15.16:0/4250758128 wait complete. 2024-08-01T06:53:20.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:20 smithi089 ceph-mon[36617]: mds.? [v2:172.21.15.16:6826/1582990915,v1:172.21.15.16:6827/1582990915] up:active 2024-08-01T06:53:20.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:20 smithi089 ceph-mon[36617]: fsmap cephfs:1 {0=cephfs.smithi016.bgqkxu=up:active} 2024-08-01T06:53:20.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:20 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/4250758128' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-08-01T06:53:20.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:20 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:20.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:20 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:20.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:20 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:20.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:20 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi016.fziqod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T06:53:20.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:20 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi016.fziqod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-01T06:53:20.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:20 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:53:20.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:20 smithi016 ceph-mon[29266]: mds.? [v2:172.21.15.16:6826/1582990915,v1:172.21.15.16:6827/1582990915] up:active 2024-08-01T06:53:20.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:20 smithi016 ceph-mon[29266]: fsmap cephfs:1 {0=cephfs.smithi016.bgqkxu=up:active} 2024-08-01T06:53:20.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:20 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/4250758128' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-08-01T06:53:20.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:20 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:20.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:20 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:20.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:20 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:20.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:20 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi016.fziqod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T06:53:20.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:20 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi016.fziqod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-01T06:53:20.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:20 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:53:21.232 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-01T06:53:21.242 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi016.front.sepia.ceph.com 2024-08-01T06:53:21.242 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-08-01T06:53:21.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:21 smithi089 ceph-mon[36617]: Deploying daemon mds.cephfs.smithi016.fziqod on smithi016 2024-08-01T06:53:21.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:21 smithi089 ceph-mon[36617]: pgmap v177: 65 pgs: 65 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-08-01T06:53:21.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:21 smithi089 ceph-mon[36617]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-01T06:53:21.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:21 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/4250758128' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-08-01T06:53:21.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:21 smithi089 ceph-mon[36617]: mds.? [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] up:boot 2024-08-01T06:53:21.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:21 smithi089 ceph-mon[36617]: daemon mds.cephfs.smithi089.jhouje assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-01T06:53:21.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:21 smithi089 ceph-mon[36617]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-08-01T06:53:21.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:21 smithi089 ceph-mon[36617]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-01T06:53:21.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:21 smithi089 ceph-mon[36617]: fsmap cephfs:1 {0=cephfs.smithi016.bgqkxu=up:active} 1 up:standby 2024-08-01T06:53:21.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:21 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.jhouje"}]: dispatch 2024-08-01T06:53:21.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:21 smithi089 ceph-mon[36617]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi089.jhouje=up:creating} 2024-08-01T06:53:21.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:21 smithi089 ceph-mon[36617]: daemon mds.cephfs.smithi089.jhouje is now active in filesystem cephfs as rank 1 2024-08-01T06:53:21.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:21 smithi016 ceph-mon[29266]: Deploying daemon mds.cephfs.smithi016.fziqod on smithi016 2024-08-01T06:53:21.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:21 smithi016 ceph-mon[29266]: pgmap v177: 65 pgs: 65 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-08-01T06:53:21.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:21 smithi016 ceph-mon[29266]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-01T06:53:21.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:21 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/4250758128' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-08-01T06:53:21.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:21 smithi016 ceph-mon[29266]: mds.? [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] up:boot 2024-08-01T06:53:21.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:21 smithi016 ceph-mon[29266]: daemon mds.cephfs.smithi089.jhouje assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-01T06:53:21.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:21 smithi016 ceph-mon[29266]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-08-01T06:53:21.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:21 smithi016 ceph-mon[29266]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-01T06:53:21.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:21 smithi016 ceph-mon[29266]: fsmap cephfs:1 {0=cephfs.smithi016.bgqkxu=up:active} 1 up:standby 2024-08-01T06:53:21.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:21 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.jhouje"}]: dispatch 2024-08-01T06:53:21.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:21 smithi016 ceph-mon[29266]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi089.jhouje=up:creating} 2024-08-01T06:53:21.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:21 smithi016 ceph-mon[29266]: daemon mds.cephfs.smithi089.jhouje is now active in filesystem cephfs as rank 1 2024-08-01T06:53:22.304 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:53:22.835 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:22 smithi016 ceph-mon[29266]: mds.? [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] up:active 2024-08-01T06:53:22.835 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:22 smithi016 ceph-mon[29266]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi089.jhouje=up:active} 2024-08-01T06:53:22.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:22 smithi089 ceph-mon[36617]: mds.? [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] up:active 2024-08-01T06:53:22.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:22 smithi089 ceph-mon[36617]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi089.jhouje=up:active} 2024-08-01T06:53:23.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:23 smithi089 ceph-mon[36617]: pgmap v178: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s wr, 8 op/s 2024-08-01T06:53:23.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:23 smithi016 ceph-mon[29266]: pgmap v178: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s wr, 8 op/s 2024-08-01T06:53:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.590+0000 7f1578bcf640 1 -- 172.21.15.16:0/678182077 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1574100690 msgr2=0x7f1574102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.590+0000 7f1578bcf640 1 --2- 172.21.15.16:0/678182077 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1574100690 0x7f1574102a80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1564009880 tx=0x7f156402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:53:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.590+0000 7f1578bcf640 1 -- 172.21.15.16:0/678182077 shutdown_connections 2024-08-01T06:53:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.590+0000 7f1578bcf640 1 --2- 172.21.15.16:0/678182077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1574102fc0 0x7f15741053b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.590+0000 7f1578bcf640 1 --2- 172.21.15.16:0/678182077 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1574100690 0x7f1574102a80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.590+0000 7f1578bcf640 1 -- 172.21.15.16:0/678182077 >> 172.21.15.16:0/678182077 conn(0x7f15740fa250 msgr2=0x7f15740fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.590+0000 7f1578bcf640 1 -- 172.21.15.16:0/678182077 shutdown_connections 2024-08-01T06:53:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.590+0000 7f1578bcf640 1 -- 172.21.15.16:0/678182077 wait complete. 2024-08-01T06:53:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.591+0000 7f1578bcf640 1 Processor -- start 2024-08-01T06:53:24.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.591+0000 7f1578bcf640 1 -- start start 2024-08-01T06:53:24.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.591+0000 7f1578bcf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1574100690 0x7f15741955f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:24.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.591+0000 7f1578bcf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1574102fc0 0x7f1574195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:24.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.591+0000 7f1578bcf640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1574196100 con 0x7f1574100690 2024-08-01T06:53:24.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.591+0000 7f1578bcf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1574196270 con 0x7f1574102fc0 2024-08-01T06:53:24.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.591+0000 7f157259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1574100690 0x7f15741955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:24.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.591+0000 7f1571d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1574102fc0 0x7f1574195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:24.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.591+0000 7f157259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1574100690 0x7f15741955f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58130/0 (socket says 172.21.15.16:58130) 2024-08-01T06:53:24.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.591+0000 7f157259c640 1 -- 172.21.15.16:0/43927265 learned_addr learned my addr 172.21.15.16:0/43927265 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:53:24.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.592+0000 7f157259c640 1 -- 172.21.15.16:0/43927265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1574102fc0 msgr2=0x7f1574195b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:24.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.592+0000 7f157259c640 1 --2- 172.21.15.16:0/43927265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1574102fc0 0x7f1574195b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:24.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.592+0000 7f157259c640 1 -- 172.21.15.16:0/43927265 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1564009560 con 0x7f1574100690 2024-08-01T06:53:24.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.592+0000 7f1571d9b640 1 --2- 172.21.15.16:0/43927265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1574102fc0 0x7f1574195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T06:53:24.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.592+0000 7f157259c640 1 --2- 172.21.15.16:0/43927265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1574100690 0x7f15741955f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1564005520 tx=0x7f1564005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:24.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.592+0000 7f15637fe640 1 -- 172.21.15.16:0/43927265 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1564004aa0 con 0x7f1574100690 2024-08-01T06:53:24.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.592+0000 7f15637fe640 1 -- 172.21.15.16:0/43927265 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1564004c00 con 0x7f1574100690 2024-08-01T06:53:24.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.592+0000 7f1578bcf640 1 -- 172.21.15.16:0/43927265 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f157419ad10 con 0x7f1574100690 2024-08-01T06:53:24.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.592+0000 7f15637fe640 1 -- 172.21.15.16:0/43927265 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1564003b10 con 0x7f1574100690 2024-08-01T06:53:24.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.592+0000 7f1578bcf640 1 -- 172.21.15.16:0/43927265 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157419b280 con 0x7f1574100690 2024-08-01T06:53:24.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.593+0000 7f1578bcf640 1 -- 172.21.15.16:0/43927265 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1574108770 con 0x7f1574100690 2024-08-01T06:53:24.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.594+0000 7f15637fe640 1 -- 172.21.15.16:0/43927265 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1564031d20 con 0x7f1574100690 2024-08-01T06:53:24.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.594+0000 7f15637fe640 1 --2- 172.21.15.16:0/43927265 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f155c06cc50 0x7f155c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:24.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.594+0000 7f15637fe640 1 -- 172.21.15.16:0/43927265 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f15640ad280 con 0x7f1574100690 2024-08-01T06:53:24.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.594+0000 7f1571d9b640 1 --2- 172.21.15.16:0/43927265 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f155c06cc50 0x7f155c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:24.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.595+0000 7f1571d9b640 1 --2- 172.21.15.16:0/43927265 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f155c06cc50 0x7f155c06f110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1574196b10 tx=0x7f156800b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:24.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.599+0000 7f15637fe640 1 -- 172.21.15.16:0/43927265 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f1564077780 con 0x7f1574100690 2024-08-01T06:53:24.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:24.806+0000 7f1578bcf640 1 -- 172.21.15.16:0/43927265 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f157419b4f0 con 0x7f1574100690 2024-08-01T06:53:25.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:25.223+0000 7f15637fe640 1 -- 172.21.15.16:0/43927265 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v10) v1 ==== 121+0+0 (secure 0 0 0) 0x7f156407ada0 con 0x7f1574100690 2024-08-01T06:53:25.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:25.226+0000 7f1578bcf640 1 -- 172.21.15.16:0/43927265 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f155c06cc50 msgr2=0x7f155c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:25.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:25.226+0000 7f1578bcf640 1 --2- 172.21.15.16:0/43927265 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f155c06cc50 0x7f155c06f110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1574196b10 tx=0x7f156800b390 comp rx=0 tx=0).stop 2024-08-01T06:53:25.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:25.226+0000 7f1578bcf640 1 -- 172.21.15.16:0/43927265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1574100690 msgr2=0x7f15741955f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:25.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:25.226+0000 7f1578bcf640 1 --2- 172.21.15.16:0/43927265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1574100690 0x7f15741955f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1564005520 tx=0x7f1564005550 comp rx=0 tx=0).stop 2024-08-01T06:53:25.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:25.226+0000 7f1578bcf640 1 -- 172.21.15.16:0/43927265 shutdown_connections 2024-08-01T06:53:25.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:25.226+0000 7f1578bcf640 1 --2- 172.21.15.16:0/43927265 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f155c06cc50 0x7f155c06f110 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:25.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:25.226+0000 7f1578bcf640 1 --2- 172.21.15.16:0/43927265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1574102fc0 0x7f1574195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:25.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:25.226+0000 7f1578bcf640 1 --2- 172.21.15.16:0/43927265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1574100690 0x7f15741955f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:25.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:25.226+0000 7f1578bcf640 1 -- 172.21.15.16:0/43927265 >> 172.21.15.16:0/43927265 conn(0x7f15740fa250 msgr2=0x7f15740fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:25.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:25.226+0000 7f1578bcf640 1 -- 172.21.15.16:0/43927265 shutdown_connections 2024-08-01T06:53:25.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:25.226+0000 7f1578bcf640 1 -- 172.21.15.16:0/43927265 wait complete. 2024-08-01T06:53:25.525 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:25 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:25.526 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:25 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:25.526 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:25 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:25.526 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:25 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.xanuld", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T06:53:25.526 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:25 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.xanuld", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-01T06:53:25.526 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:25 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:53:25.526 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:25 smithi016 ceph-mon[29266]: Deploying daemon mds.cephfs.smithi089.xanuld on smithi089 2024-08-01T06:53:25.526 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:25 smithi016 ceph-mon[29266]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 7 op/s 2024-08-01T06:53:25.526 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:25 smithi016 ceph-mon[29266]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-08-01T06:53:25.526 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:25 smithi016 ceph-mon[29266]: Cluster is now healthy 2024-08-01T06:53:25.526 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:25 smithi016 ceph-mon[29266]: mds.? [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] up:boot 2024-08-01T06:53:25.527 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:25 smithi016 ceph-mon[29266]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi089.jhouje=up:active} 1 up:standby 2024-08-01T06:53:25.527 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:25 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.fziqod"}]: dispatch 2024-08-01T06:53:25.527 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:25 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/43927265' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-01T06:53:25.549 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:25 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:25.549 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:25 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:25.549 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:25 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:25.549 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:25 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.xanuld", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T06:53:25.549 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:25 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.xanuld", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-01T06:53:25.549 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:25 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:53:25.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:25 smithi089 ceph-mon[36617]: Deploying daemon mds.cephfs.smithi089.xanuld on smithi089 2024-08-01T06:53:25.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:25 smithi089 ceph-mon[36617]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 7 op/s 2024-08-01T06:53:25.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:25 smithi089 ceph-mon[36617]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-08-01T06:53:25.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:25 smithi089 ceph-mon[36617]: Cluster is now healthy 2024-08-01T06:53:25.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:25 smithi089 ceph-mon[36617]: mds.? [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] up:boot 2024-08-01T06:53:25.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:25 smithi089 ceph-mon[36617]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi089.jhouje=up:active} 1 up:standby 2024-08-01T06:53:25.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:25 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.fziqod"}]: dispatch 2024-08-01T06:53:25.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:25 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/43927265' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-01T06:53:25.961 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-01T06:53:25.977 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi016.front.sepia.ceph.com 2024-08-01T06:53:25.977 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-08-01T06:53:26.203 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:53:26.511 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:26 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/43927265' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-01T06:53:26.511 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:26 smithi016 ceph-mon[29266]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi089.jhouje=up:active} 1 up:standby-replay 2024-08-01T06:53:26.567 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:26 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/43927265' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-01T06:53:26.567 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:26 smithi089 ceph-mon[36617]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi089.jhouje=up:active} 1 up:standby-replay 2024-08-01T06:53:27.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:27 smithi016 ceph-mon[29266]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 183 B/s rd, 2.3 KiB/s wr, 7 op/s 2024-08-01T06:53:27.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:27 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:27.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:27 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:27.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:27 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:27.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:27 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:27.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:27 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:27.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:27 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:53:27.553 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:27 smithi089 ceph-mon[36617]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 183 B/s rd, 2.3 KiB/s wr, 7 op/s 2024-08-01T06:53:27.554 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:27 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:27.554 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:27 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:27.554 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:27 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:27.554 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:27 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:27.554 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:27 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:27.554 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:27 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:53:27.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.762+0000 7f44d7708640 1 -- 172.21.15.16:0/424503840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44d0072f10 msgr2=0x7f44d0073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:27.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.762+0000 7f44d7708640 1 --2- 172.21.15.16:0/424503840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44d0072f10 0x7f44d0073370 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f44c0009880 tx=0x7f44c002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:53:27.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.762+0000 7f44d7708640 1 -- 172.21.15.16:0/424503840 shutdown_connections 2024-08-01T06:53:27.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.762+0000 7f44d7708640 1 --2- 172.21.15.16:0/424503840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44d0072f10 0x7f44d0073370 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:27.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.762+0000 7f44d7708640 1 --2- 172.21.15.16:0/424503840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44d00744e0 0x7f44d0072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:27.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.762+0000 7f44d7708640 1 -- 172.21.15.16:0/424503840 >> 172.21.15.16:0/424503840 conn(0x7f44d00fb320 msgr2=0x7f44d00fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:27.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.762+0000 7f44d7708640 1 -- 172.21.15.16:0/424503840 shutdown_connections 2024-08-01T06:53:27.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.762+0000 7f44d7708640 1 -- 172.21.15.16:0/424503840 wait complete. 2024-08-01T06:53:27.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.763+0000 7f44d7708640 1 Processor -- start 2024-08-01T06:53:27.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.763+0000 7f44d7708640 1 -- start start 2024-08-01T06:53:27.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.763+0000 7f44d7708640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44d0072f10 0x7f44d0197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:27.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.763+0000 7f44d7708640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44d00744e0 0x7f44d0197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:27.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.763+0000 7f44d7708640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d0198330 con 0x7f44d00744e0 2024-08-01T06:53:27.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.763+0000 7f44d7708640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d01984a0 con 0x7f44d0072f10 2024-08-01T06:53:27.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.764+0000 7f44d4ca3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44d00744e0 0x7f44d0197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:27.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.764+0000 7f44d4ca3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44d00744e0 0x7f44d0197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58152/0 (socket says 172.21.15.16:58152) 2024-08-01T06:53:27.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.764+0000 7f44d4ca3640 1 -- 172.21.15.16:0/3284389129 learned_addr learned my addr 172.21.15.16:0/3284389129 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:53:27.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.764+0000 7f44d54a4640 1 --2- 172.21.15.16:0/3284389129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44d0072f10 0x7f44d0197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:27.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.764+0000 7f44d4ca3640 1 -- 172.21.15.16:0/3284389129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44d0072f10 msgr2=0x7f44d0197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:27.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.764+0000 7f44d4ca3640 1 --2- 172.21.15.16:0/3284389129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44d0072f10 0x7f44d0197820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:27.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.764+0000 7f44d4ca3640 1 -- 172.21.15.16:0/3284389129 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c0009560 con 0x7f44d00744e0 2024-08-01T06:53:27.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.764+0000 7f44d4ca3640 1 --2- 172.21.15.16:0/3284389129 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44d00744e0 0x7f44d0197d60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f44c00055a0 tx=0x7f44c00055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:27.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.764+0000 7f44c67fc640 1 -- 172.21.15.16:0/3284389129 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44c0004aa0 con 0x7f44d00744e0 2024-08-01T06:53:27.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.764+0000 7f44c67fc640 1 -- 172.21.15.16:0/3284389129 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f44c0004c00 con 0x7f44d00744e0 2024-08-01T06:53:27.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.764+0000 7f44d7708640 1 -- 172.21.15.16:0/3284389129 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d019cee0 con 0x7f44d00744e0 2024-08-01T06:53:27.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.764+0000 7f44c67fc640 1 -- 172.21.15.16:0/3284389129 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44c0003b10 con 0x7f44d00744e0 2024-08-01T06:53:27.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.764+0000 7f44d7708640 1 -- 172.21.15.16:0/3284389129 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d019d420 con 0x7f44d00744e0 2024-08-01T06:53:27.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.765+0000 7f44d7708640 1 -- 172.21.15.16:0/3284389129 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d0191940 con 0x7f44d00744e0 2024-08-01T06:53:27.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.766+0000 7f44c67fc640 1 -- 172.21.15.16:0/3284389129 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f44c0003d40 con 0x7f44d00744e0 2024-08-01T06:53:27.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.766+0000 7f44c67fc640 1 --2- 172.21.15.16:0/3284389129 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f44bc06cc50 0x7f44bc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:27.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.767+0000 7f44d54a4640 1 --2- 172.21.15.16:0/3284389129 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f44bc06cc50 0x7f44bc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:27.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.767+0000 7f44c67fc640 1 -- 172.21.15.16:0/3284389129 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f44c00ad2a0 con 0x7f44d00744e0 2024-08-01T06:53:27.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.767+0000 7f44d54a4640 1 --2- 172.21.15.16:0/3284389129 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f44bc06cc50 0x7f44bc06f110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f44d00748c0 tx=0x7f44cc005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:27.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.771+0000 7f44c67fc640 1 -- 172.21.15.16:0/3284389129 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f44c00777e0 con 0x7f44d00744e0 2024-08-01T06:53:27.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:27.987+0000 7f44d7708640 1 -- 172.21.15.16:0/3284389129 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f44d010a9b0 con 0x7f44d00744e0 2024-08-01T06:53:28.331 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:28 smithi016 ceph-mon[29266]: mds.? [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] up:boot 2024-08-01T06:53:28.332 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:28 smithi016 ceph-mon[29266]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi089.jhouje=up:active} 1 up:standby-replay 1 up:standby 2024-08-01T06:53:28.332 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:28 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.xanuld"}]: dispatch 2024-08-01T06:53:28.332 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:28 smithi016 ceph-mon[29266]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi089.jhouje=up:active} 2 up:standby-replay 2024-08-01T06:53:28.332 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:28 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:28.332 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:28 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3284389129' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-08-01T06:53:28.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:28 smithi089 ceph-mon[36617]: mds.? [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] up:boot 2024-08-01T06:53:28.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:28 smithi089 ceph-mon[36617]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi089.jhouje=up:active} 1 up:standby-replay 1 up:standby 2024-08-01T06:53:28.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:28 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.xanuld"}]: dispatch 2024-08-01T06:53:28.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:28 smithi089 ceph-mon[36617]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi089.jhouje=up:active} 2 up:standby-replay 2024-08-01T06:53:28.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:28 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:28.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:28 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/3284389129' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-08-01T06:53:28.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:28.593+0000 7f44c67fc640 1 -- 172.21.15.16:0/3284389129 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v13) v1 ==== 133+0+0 (secure 0 0 0) 0x7f44c007ae00 con 0x7f44d00744e0 2024-08-01T06:53:28.595 INFO:teuthology.orchestra.run.smithi016.stderr:inline data disabled 2024-08-01T06:53:28.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:28.595+0000 7f44d7708640 1 -- 172.21.15.16:0/3284389129 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f44bc06cc50 msgr2=0x7f44bc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:28.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:28.595+0000 7f44d7708640 1 --2- 172.21.15.16:0/3284389129 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f44bc06cc50 0x7f44bc06f110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f44d00748c0 tx=0x7f44cc005f90 comp rx=0 tx=0).stop 2024-08-01T06:53:28.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:28.595+0000 7f44d7708640 1 -- 172.21.15.16:0/3284389129 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44d00744e0 msgr2=0x7f44d0197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:28.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:28.595+0000 7f44d7708640 1 --2- 172.21.15.16:0/3284389129 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44d00744e0 0x7f44d0197d60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f44c00055a0 tx=0x7f44c00055d0 comp rx=0 tx=0).stop 2024-08-01T06:53:28.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:28.596+0000 7f44d7708640 1 -- 172.21.15.16:0/3284389129 shutdown_connections 2024-08-01T06:53:28.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:28.596+0000 7f44d7708640 1 --2- 172.21.15.16:0/3284389129 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f44bc06cc50 0x7f44bc06f110 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:28.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:28.596+0000 7f44d7708640 1 --2- 172.21.15.16:0/3284389129 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44d00744e0 0x7f44d0197d60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:28.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:28.596+0000 7f44d7708640 1 --2- 172.21.15.16:0/3284389129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44d0072f10 0x7f44d0197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:28.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:28.596+0000 7f44d7708640 1 -- 172.21.15.16:0/3284389129 >> 172.21.15.16:0/3284389129 conn(0x7f44d00fb320 msgr2=0x7f44d0105dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:28.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:28.596+0000 7f44d7708640 1 -- 172.21.15.16:0/3284389129 shutdown_connections 2024-08-01T06:53:28.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:28.596+0000 7f44d7708640 1 -- 172.21.15.16:0/3284389129 wait complete. 2024-08-01T06:53:29.309 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-01T06:53:29.321 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi016.front.sepia.ceph.com 2024-08-01T06:53:29.321 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-01T06:53:29.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:29 smithi089 ceph-mon[36617]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-08-01T06:53:29.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:29 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/3284389129' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-08-01T06:53:29.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:29 smithi089 ceph-mon[36617]: mds.? [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] up:standby-replay 2024-08-01T06:53:29.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:29 smithi089 ceph-mon[36617]: Dropping low affinity active daemon mds.cephfs.smithi016.bgqkxu in favor of higher affinity standby. 2024-08-01T06:53:29.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:29 smithi089 ceph-mon[36617]: Replacing daemon mds.cephfs.smithi016.bgqkxu as rank 0 with standby daemon mds.cephfs.smithi016.fziqod 2024-08-01T06:53:29.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:29 smithi089 ceph-mon[36617]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-01T06:53:29.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:29 smithi089 ceph-mon[36617]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi089.jhouje=up:active} 2 up:standby-replay 2024-08-01T06:53:29.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:29 smithi089 ceph-mon[36617]: osdmap e46: 6 total, 6 up, 6 in 2024-08-01T06:53:29.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:29 smithi089 ceph-mon[36617]: fsmap cephfs:2/2 {0=cephfs.smithi016.fziqod=up:replay,1=cephfs.smithi089.jhouje=up:active} 1 up:standby-replay 2024-08-01T06:53:29.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:29 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:29.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:29 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:29.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:29 smithi016 ceph-mon[29266]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-08-01T06:53:29.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:29 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3284389129' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-08-01T06:53:29.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:29 smithi016 ceph-mon[29266]: mds.? [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] up:standby-replay 2024-08-01T06:53:29.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:29 smithi016 ceph-mon[29266]: Dropping low affinity active daemon mds.cephfs.smithi016.bgqkxu in favor of higher affinity standby. 2024-08-01T06:53:29.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:29 smithi016 ceph-mon[29266]: Replacing daemon mds.cephfs.smithi016.bgqkxu as rank 0 with standby daemon mds.cephfs.smithi016.fziqod 2024-08-01T06:53:29.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:29 smithi016 ceph-mon[29266]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-01T06:53:29.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:29 smithi016 ceph-mon[29266]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi089.jhouje=up:active} 2 up:standby-replay 2024-08-01T06:53:29.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:29 smithi016 ceph-mon[29266]: osdmap e46: 6 total, 6 up, 6 in 2024-08-01T06:53:29.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:29 smithi016 ceph-mon[29266]: fsmap cephfs:2/2 {0=cephfs.smithi016.fziqod=up:replay,1=cephfs.smithi089.jhouje=up:active} 1 up:standby-replay 2024-08-01T06:53:29.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:29 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:29.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:29 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:30.139 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:53:30.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:30 smithi089 ceph-mon[36617]: mds.? [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] up:active 2024-08-01T06:53:30.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:30 smithi089 ceph-mon[36617]: mds.? [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] up:boot 2024-08-01T06:53:30.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:30 smithi089 ceph-mon[36617]: mds.? [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] up:resolve 2024-08-01T06:53:30.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:30 smithi089 ceph-mon[36617]: fsmap cephfs:2/2 {0=cephfs.smithi016.fziqod=up:resolve,1=cephfs.smithi089.jhouje=up:active} 1 up:standby-replay 1 up:standby 2024-08-01T06:53:30.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:30 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.bgqkxu"}]: dispatch 2024-08-01T06:53:30.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:30 smithi016 ceph-mon[29266]: mds.? [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] up:active 2024-08-01T06:53:30.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:30 smithi016 ceph-mon[29266]: mds.? [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] up:boot 2024-08-01T06:53:30.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:30 smithi016 ceph-mon[29266]: mds.? [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] up:resolve 2024-08-01T06:53:30.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:30 smithi016 ceph-mon[29266]: fsmap cephfs:2/2 {0=cephfs.smithi016.fziqod=up:resolve,1=cephfs.smithi089.jhouje=up:active} 1 up:standby-replay 1 up:standby 2024-08-01T06:53:30.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:30 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.bgqkxu"}]: dispatch 2024-08-01T06:53:31.686 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:31 smithi016 ceph-mon[29266]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-08-01T06:53:31.686 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:31 smithi016 ceph-mon[29266]: mds.? [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] up:reconnect 2024-08-01T06:53:31.686 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:31 smithi016 ceph-mon[29266]: mds.? [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] up:standby-replay 2024-08-01T06:53:31.686 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:31 smithi016 ceph-mon[29266]: fsmap cephfs:2/2 {0=cephfs.smithi016.fziqod=up:reconnect,1=cephfs.smithi089.jhouje=up:active} 1 up:standby-replay 1 up:standby 2024-08-01T06:53:31.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:31 smithi089 ceph-mon[36617]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-08-01T06:53:31.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:31 smithi089 ceph-mon[36617]: mds.? [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] up:reconnect 2024-08-01T06:53:31.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:31 smithi089 ceph-mon[36617]: mds.? [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] up:standby-replay 2024-08-01T06:53:31.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:31 smithi089 ceph-mon[36617]: fsmap cephfs:2/2 {0=cephfs.smithi016.fziqod=up:reconnect,1=cephfs.smithi089.jhouje=up:active} 1 up:standby-replay 1 up:standby 2024-08-01T06:53:32.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.354+0000 7f856af54640 1 -- 172.21.15.16:0/2252805319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85640ffb90 msgr2=0x7f85640fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:32.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.354+0000 7f856af54640 1 --2- 172.21.15.16:0/2252805319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85640ffb90 0x7f85640fff90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8560009880 tx=0x7f856002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:53:32.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.354+0000 7f856af54640 1 -- 172.21.15.16:0/2252805319 shutdown_connections 2024-08-01T06:53:32.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.354+0000 7f856af54640 1 --2- 172.21.15.16:0/2252805319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8564100d90 0x7f8564101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:32.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.354+0000 7f856af54640 1 --2- 172.21.15.16:0/2252805319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85640ffb90 0x7f85640fff90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:32.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.354+0000 7f856af54640 1 -- 172.21.15.16:0/2252805319 >> 172.21.15.16:0/2252805319 conn(0x7f85640fb320 msgr2=0x7f85640fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:32.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.354+0000 7f856af54640 1 -- 172.21.15.16:0/2252805319 shutdown_connections 2024-08-01T06:53:32.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.354+0000 7f856af54640 1 -- 172.21.15.16:0/2252805319 wait complete. 2024-08-01T06:53:32.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.355+0000 7f856af54640 1 Processor -- start 2024-08-01T06:53:32.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.355+0000 7f856af54640 1 -- start start 2024-08-01T06:53:32.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.355+0000 7f856af54640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85640ffb90 0x7f8564074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:32.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.355+0000 7f856af54640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8564100d90 0x7f85640728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:32.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.355+0000 7f856af54640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8564072de0 con 0x7f8564100d90 2024-08-01T06:53:32.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.355+0000 7f856af54640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8564072f50 con 0x7f85640ffb90 2024-08-01T06:53:32.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.355+0000 7f855bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8564100d90 0x7f85640728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:32.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.355+0000 7f855bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8564100d90 0x7f85640728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50428/0 (socket says 172.21.15.16:50428) 2024-08-01T06:53:32.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.355+0000 7f855bfff640 1 -- 172.21.15.16:0/2850151248 learned_addr learned my addr 172.21.15.16:0/2850151248 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:53:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.355+0000 7f8568cf0640 1 --2- 172.21.15.16:0/2850151248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85640ffb90 0x7f8564074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.355+0000 7f855bfff640 1 -- 172.21.15.16:0/2850151248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85640ffb90 msgr2=0x7f8564074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.355+0000 7f855bfff640 1 --2- 172.21.15.16:0/2850151248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85640ffb90 0x7f8564074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.356+0000 7f855bfff640 1 -- 172.21.15.16:0/2850151248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8560009560 con 0x7f8564100d90 2024-08-01T06:53:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.356+0000 7f855bfff640 1 --2- 172.21.15.16:0/2850151248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8564100d90 0x7f85640728a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f855400b420 tx=0x7f855400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.356+0000 7f8559ffb640 1 -- 172.21.15.16:0/2850151248 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8554011800 con 0x7f8564100d90 2024-08-01T06:53:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.356+0000 7f8559ffb640 1 -- 172.21.15.16:0/2850151248 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8554011e20 con 0x7f8564100d90 2024-08-01T06:53:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.356+0000 7f856af54640 1 -- 172.21.15.16:0/2850151248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8564073230 con 0x7f8564100d90 2024-08-01T06:53:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.356+0000 7f8559ffb640 1 -- 172.21.15.16:0/2850151248 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f855400f2e0 con 0x7f8564100d90 2024-08-01T06:53:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.356+0000 7f856af54640 1 -- 172.21.15.16:0/2850151248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856419d770 con 0x7f8564100d90 2024-08-01T06:53:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.357+0000 7f856af54640 1 -- 172.21.15.16:0/2850151248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8564100010 con 0x7f8564100d90 2024-08-01T06:53:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.358+0000 7f8559ffb640 1 -- 172.21.15.16:0/2850151248 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8554010380 con 0x7f8564100d90 2024-08-01T06:53:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.358+0000 7f8559ffb640 1 --2- 172.21.15.16:0/2850151248 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f854c06cc50 0x7f854c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:32.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.358+0000 7f8559ffb640 1 -- 172.21.15.16:0/2850151248 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f855408bb90 con 0x7f8564100d90 2024-08-01T06:53:32.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.358+0000 7f8568cf0640 1 --2- 172.21.15.16:0/2850151248 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f854c06cc50 0x7f854c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:32.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.359+0000 7f8568cf0640 1 --2- 172.21.15.16:0/2850151248 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f854c06cc50 0x7f854c06f110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8560009230 tx=0x7f85600314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:32.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.363+0000 7f8559ffb640 1 -- 172.21.15.16:0/2850151248 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f8554055f00 con 0x7f8564100d90 2024-08-01T06:53:32.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.575+0000 7f856af54640 1 -- 172.21.15.16:0/2850151248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8564108800 con 0x7f8564100d90 2024-08-01T06:53:32.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.577+0000 7f8559ffb640 1 -- 172.21.15.16:0/2850151248 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f8554059520 con 0x7f8564100d90 2024-08-01T06:53:32.578 INFO:teuthology.orchestra.run.smithi016.stdout:e17 2024-08-01T06:53:32.578 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T06:53:32.578 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:53:32.578 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T06:53:32.579 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:53:32.579 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T06:53:32.579 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T06:53:32.579 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 17 2024-08-01T06:53:32.579 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T06:53:32.579 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T06:53:32.579 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T06:53:31.605960+0000 2024-08-01T06:53:32.579 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T06:53:32.579 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T06:53:32.579 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T06:53:32.579 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T06:53:32.579 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T06:53:32.579 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T06:53:32.580 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T06:53:32.580 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T06:53:32.580 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 46 2024-08-01T06:53:32.580 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:53:32.580 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T06:53:32.580 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T06:53:32.580 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=14482,1=24281} 2024-08-01T06:53:32.580 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T06:53:32.580 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T06:53:32.580 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T06:53:32.580 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T06:53:32.580 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T06:53:32.580 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T06:53:32.581 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T06:53:32.581 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T06:53:32.581 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T06:53:32.581 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{0:14482} state up:rejoin seq 5 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:53:32.581 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{1:24281} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:53:32.581 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:24291} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:53:32.581 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:53:32.581 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:53:32.581 INFO:teuthology.orchestra.run.smithi016.stdout:Standby daemons: 2024-08-01T06:53:32.581 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:53:32.581 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:53:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2024-08-01T06:53:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.579+0000 7f856af54640 1 -- 172.21.15.16:0/2850151248 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f854c06cc50 msgr2=0x7f854c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.579+0000 7f856af54640 1 --2- 172.21.15.16:0/2850151248 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f854c06cc50 0x7f854c06f110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8560009230 tx=0x7f85600314e0 comp rx=0 tx=0).stop 2024-08-01T06:53:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.579+0000 7f856af54640 1 -- 172.21.15.16:0/2850151248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8564100d90 msgr2=0x7f85640728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.579+0000 7f856af54640 1 --2- 172.21.15.16:0/2850151248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8564100d90 0x7f85640728a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f855400b420 tx=0x7f855400b8e0 comp rx=0 tx=0).stop 2024-08-01T06:53:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.579+0000 7f856af54640 1 -- 172.21.15.16:0/2850151248 shutdown_connections 2024-08-01T06:53:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.579+0000 7f856af54640 1 --2- 172.21.15.16:0/2850151248 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f854c06cc50 0x7f854c06f110 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.579+0000 7f856af54640 1 --2- 172.21.15.16:0/2850151248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8564100d90 0x7f85640728a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.579+0000 7f856af54640 1 --2- 172.21.15.16:0/2850151248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85640ffb90 0x7f8564074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.579+0000 7f856af54640 1 -- 172.21.15.16:0/2850151248 >> 172.21.15.16:0/2850151248 conn(0x7f85640fb320 msgr2=0x7f8564103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.579+0000 7f856af54640 1 -- 172.21.15.16:0/2850151248 shutdown_connections 2024-08-01T06:53:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:32.579+0000 7f856af54640 1 -- 172.21.15.16:0/2850151248 wait complete. 2024-08-01T06:53:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:32 smithi089 ceph-mon[36617]: mds.? [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] up:rejoin 2024-08-01T06:53:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:32 smithi089 ceph-mon[36617]: fsmap cephfs:2/2 {0=cephfs.smithi016.fziqod=up:rejoin,1=cephfs.smithi089.jhouje=up:active} 1 up:standby-replay 1 up:standby 2024-08-01T06:53:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:32 smithi089 ceph-mon[36617]: daemon mds.cephfs.smithi016.fziqod is now active in filesystem cephfs as rank 0 2024-08-01T06:53:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:32 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:32 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/2850151248' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:53:32.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:32 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:53:32.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:32 smithi016 ceph-mon[29266]: mds.? [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] up:rejoin 2024-08-01T06:53:32.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:32 smithi016 ceph-mon[29266]: fsmap cephfs:2/2 {0=cephfs.smithi016.fziqod=up:rejoin,1=cephfs.smithi089.jhouje=up:active} 1 up:standby-replay 1 up:standby 2024-08-01T06:53:32.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:32 smithi016 ceph-mon[29266]: daemon mds.cephfs.smithi016.fziqod is now active in filesystem cephfs as rank 0 2024-08-01T06:53:32.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:32 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:32.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:32 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/2850151248' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:53:32.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:32 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:53:33.435 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-08-01T06:53:33.835 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:53:33.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:33 smithi089 ceph-mon[36617]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 716 B/s wr, 5 op/s 2024-08-01T06:53:33.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:33 smithi089 ceph-mon[36617]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-01T06:53:33.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:33 smithi089 ceph-mon[36617]: Cluster is now healthy 2024-08-01T06:53:33.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:33 smithi089 ceph-mon[36617]: mds.? [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] up:active 2024-08-01T06:53:33.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:33 smithi089 ceph-mon[36617]: fsmap cephfs:2 {0=cephfs.smithi016.fziqod=up:active,1=cephfs.smithi089.jhouje=up:active} 1 up:standby-replay 1 up:standby 2024-08-01T06:53:33.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:33 smithi089 ceph-mon[36617]: fsmap cephfs:2 {0=cephfs.smithi016.fziqod=up:active,1=cephfs.smithi089.jhouje=up:active} 2 up:standby-replay 2024-08-01T06:53:33.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:33 smithi016 ceph-mon[29266]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 716 B/s wr, 5 op/s 2024-08-01T06:53:33.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:33 smithi016 ceph-mon[29266]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-01T06:53:33.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:33 smithi016 ceph-mon[29266]: Cluster is now healthy 2024-08-01T06:53:33.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:33 smithi016 ceph-mon[29266]: mds.? [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] up:active 2024-08-01T06:53:33.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:33 smithi016 ceph-mon[29266]: fsmap cephfs:2 {0=cephfs.smithi016.fziqod=up:active,1=cephfs.smithi089.jhouje=up:active} 1 up:standby-replay 1 up:standby 2024-08-01T06:53:33.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:33 smithi016 ceph-mon[29266]: fsmap cephfs:2 {0=cephfs.smithi016.fziqod=up:active,1=cephfs.smithi089.jhouje=up:active} 2 up:standby-replay 2024-08-01T06:53:35.767 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:35 smithi016 ceph-mon[29266]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-01T06:53:35.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:35 smithi089 ceph-mon[36617]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-01T06:53:36.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.268+0000 7faa92831640 1 -- 172.21.15.16:0/2917029265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa8c0ffcf0 msgr2=0x7faa8c100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:36.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.268+0000 7faa92831640 1 --2- 172.21.15.16:0/2917029265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa8c0ffcf0 0x7faa8c100170 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faa80009880 tx=0x7faa8002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:53:36.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.268+0000 7faa92831640 1 -- 172.21.15.16:0/2917029265 shutdown_connections 2024-08-01T06:53:36.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.268+0000 7faa92831640 1 --2- 172.21.15.16:0/2917029265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa8c0ffcf0 0x7faa8c100170 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:36.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.268+0000 7faa92831640 1 --2- 172.21.15.16:0/2917029265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa8c0feaf0 0x7faa8c0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:36.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.268+0000 7faa92831640 1 -- 172.21.15.16:0/2917029265 >> 172.21.15.16:0/2917029265 conn(0x7faa8c0fa280 msgr2=0x7faa8c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:36.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.269+0000 7faa92831640 1 -- 172.21.15.16:0/2917029265 shutdown_connections 2024-08-01T06:53:36.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.269+0000 7faa92831640 1 -- 172.21.15.16:0/2917029265 wait complete. 2024-08-01T06:53:36.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.269+0000 7faa92831640 1 Processor -- start 2024-08-01T06:53:36.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.269+0000 7faa92831640 1 -- start start 2024-08-01T06:53:36.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.269+0000 7faa92831640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa8c0feaf0 0x7faa8c1956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:36.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.270+0000 7faa92831640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa8c0ffcf0 0x7faa8c195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:36.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.270+0000 7faa92831640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c196200 con 0x7faa8c0feaf0 2024-08-01T06:53:36.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.270+0000 7faa92831640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c196370 con 0x7faa8c0ffcf0 2024-08-01T06:53:36.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.270+0000 7faa8bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa8c0feaf0 0x7faa8c1956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:36.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.270+0000 7faa8bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa8c0feaf0 0x7faa8c1956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50434/0 (socket says 172.21.15.16:50434) 2024-08-01T06:53:36.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.270+0000 7faa8bfff640 1 -- 172.21.15.16:0/2933140535 learned_addr learned my addr 172.21.15.16:0/2933140535 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:53:36.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.270+0000 7faa8b7fe640 1 --2- 172.21.15.16:0/2933140535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa8c0ffcf0 0x7faa8c195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:36.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.270+0000 7faa8bfff640 1 -- 172.21.15.16:0/2933140535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa8c0ffcf0 msgr2=0x7faa8c195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:36.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.270+0000 7faa8bfff640 1 --2- 172.21.15.16:0/2933140535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa8c0ffcf0 0x7faa8c195c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:36.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.270+0000 7faa8bfff640 1 -- 172.21.15.16:0/2933140535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa80009560 con 0x7faa8c0feaf0 2024-08-01T06:53:36.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.270+0000 7faa8b7fe640 1 --2- 172.21.15.16:0/2933140535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa8c0ffcf0 0x7faa8c195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T06:53:36.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.270+0000 7faa8bfff640 1 --2- 172.21.15.16:0/2933140535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa8c0feaf0 0x7faa8c1956f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00d720 tx=0x7faa7c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:36.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.270+0000 7faa897fa640 1 -- 172.21.15.16:0/2933140535 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa7c0041f0 con 0x7faa8c0feaf0 2024-08-01T06:53:36.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.270+0000 7faa897fa640 1 -- 172.21.15.16:0/2933140535 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa7c004350 con 0x7faa8c0feaf0 2024-08-01T06:53:36.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.270+0000 7faa92831640 1 -- 172.21.15.16:0/2933140535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8c19ae10 con 0x7faa8c0feaf0 2024-08-01T06:53:36.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.270+0000 7faa897fa640 1 -- 172.21.15.16:0/2933140535 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa7c003df0 con 0x7faa8c0feaf0 2024-08-01T06:53:36.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.270+0000 7faa92831640 1 -- 172.21.15.16:0/2933140535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c19b2d0 con 0x7faa8c0feaf0 2024-08-01T06:53:36.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.271+0000 7faa92831640 1 -- 172.21.15.16:0/2933140535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa8c1076e0 con 0x7faa8c0feaf0 2024-08-01T06:53:36.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.272+0000 7faa897fa640 1 -- 172.21.15.16:0/2933140535 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7faa7c0035f0 con 0x7faa8c0feaf0 2024-08-01T06:53:36.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.272+0000 7faa897fa640 1 --2- 172.21.15.16:0/2933140535 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7faa7406cbf0 0x7faa7406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:36.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.273+0000 7faa897fa640 1 -- 172.21.15.16:0/2933140535 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7faa7c08bd50 con 0x7faa8c0feaf0 2024-08-01T06:53:36.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.273+0000 7faa8b7fe640 1 --2- 172.21.15.16:0/2933140535 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7faa7406cbf0 0x7faa7406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:36.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.273+0000 7faa8b7fe640 1 --2- 172.21.15.16:0/2933140535 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7faa7406cbf0 0x7faa7406f0b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faa80000c00 tx=0x7faa80005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:36.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.277+0000 7faa897fa640 1 -- 172.21.15.16:0/2933140535 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7faa7c0560c0 con 0x7faa8c0feaf0 2024-08-01T06:53:36.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.522+0000 7faa92831640 1 -- 172.21.15.16:0/2933140535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa8c107930 con 0x7faa8c0feaf0 2024-08-01T06:53:36.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.523+0000 7faa897fa640 1 -- 172.21.15.16:0/2933140535 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4856 (secure 0 0 0) 0x7faa7c0596e0 con 0x7faa8c0feaf0 2024-08-01T06:53:36.524 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-08-01T06:53:36.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.525+0000 7faa92831640 1 -- 172.21.15.16:0/2933140535 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7faa7406cbf0 msgr2=0x7faa7406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:36.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.525+0000 7faa92831640 1 --2- 172.21.15.16:0/2933140535 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7faa7406cbf0 0x7faa7406f0b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faa80000c00 tx=0x7faa80005a20 comp rx=0 tx=0).stop 2024-08-01T06:53:36.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.525+0000 7faa92831640 1 -- 172.21.15.16:0/2933140535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa8c0feaf0 msgr2=0x7faa8c1956f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:36.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.525+0000 7faa92831640 1 --2- 172.21.15.16:0/2933140535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa8c0feaf0 0x7faa8c1956f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00d720 tx=0x7faa7c00dbe0 comp rx=0 tx=0).stop 2024-08-01T06:53:36.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.525+0000 7faa92831640 1 -- 172.21.15.16:0/2933140535 shutdown_connections 2024-08-01T06:53:36.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.525+0000 7faa92831640 1 --2- 172.21.15.16:0/2933140535 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7faa7406cbf0 0x7faa7406f0b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:36.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.525+0000 7faa92831640 1 --2- 172.21.15.16:0/2933140535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa8c0ffcf0 0x7faa8c195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:36.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.525+0000 7faa92831640 1 --2- 172.21.15.16:0/2933140535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa8c0feaf0 0x7faa8c1956f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:36.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.525+0000 7faa92831640 1 -- 172.21.15.16:0/2933140535 >> 172.21.15.16:0/2933140535 conn(0x7faa8c0fa280 msgr2=0x7faa8c067cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:36.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.525+0000 7faa92831640 1 -- 172.21.15.16:0/2933140535 shutdown_connections 2024-08-01T06:53:36.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:36.525+0000 7faa92831640 1 -- 172.21.15.16:0/2933140535 wait complete. 2024-08-01T06:53:36.536 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T06:53:37.079 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-08-01T06:53:37.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:37 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:37.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:37 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:37.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:37 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:53:37.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:37 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:53:37.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:37 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:37.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:37 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:53:37.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:37 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/2933140535' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-01T06:53:37.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:37 smithi089 ceph-mon[36617]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 6.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-01T06:53:37.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:37 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:37.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:37 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:37.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:37 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:53:37.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:37 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:53:37.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:37 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:37.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:37 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:53:37.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:37 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/2933140535' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-01T06:53:37.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:37 smithi016 ceph-mon[29266]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 6.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-01T06:53:37.896 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:53:39.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.479+0000 7f2c007a1640 1 -- 172.21.15.16:0/1916941315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf80ffb90 msgr2=0x7f2bf80fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:39.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.479+0000 7f2c007a1640 1 --2- 172.21.15.16:0/1916941315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf80ffb90 0x7f2bf80fff90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009880 tx=0x7f2bf402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:53:39.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.479+0000 7f2c007a1640 1 -- 172.21.15.16:0/1916941315 shutdown_connections 2024-08-01T06:53:39.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.479+0000 7f2c007a1640 1 --2- 172.21.15.16:0/1916941315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bf8100d90 0x7f2bf8101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:39.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.479+0000 7f2c007a1640 1 --2- 172.21.15.16:0/1916941315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf80ffb90 0x7f2bf80fff90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:39.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.479+0000 7f2c007a1640 1 -- 172.21.15.16:0/1916941315 >> 172.21.15.16:0/1916941315 conn(0x7f2bf80fb320 msgr2=0x7f2bf80fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:39.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.479+0000 7f2c007a1640 1 -- 172.21.15.16:0/1916941315 shutdown_connections 2024-08-01T06:53:39.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.479+0000 7f2c007a1640 1 -- 172.21.15.16:0/1916941315 wait complete. 2024-08-01T06:53:39.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.480+0000 7f2c007a1640 1 Processor -- start 2024-08-01T06:53:39.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.480+0000 7f2c007a1640 1 -- start start 2024-08-01T06:53:39.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.480+0000 7f2c007a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bf80ffb90 0x7f2bf8074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:39.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.480+0000 7f2c007a1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf8100d90 0x7f2bf80728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:39.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.480+0000 7f2c007a1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf8072de0 con 0x7f2bf8100d90 2024-08-01T06:53:39.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.480+0000 7f2c007a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf8072f50 con 0x7f2bf80ffb90 2024-08-01T06:53:39.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.480+0000 7f2bfdd3c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf8100d90 0x7f2bf80728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:39.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.480+0000 7f2bfdd3c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf8100d90 0x7f2bf80728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50396/0 (socket says 172.21.15.16:50396) 2024-08-01T06:53:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.480+0000 7f2bfdd3c640 1 -- 172.21.15.16:0/3088800973 learned_addr learned my addr 172.21.15.16:0/3088800973 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:53:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.480+0000 7f2bfe53d640 1 --2- 172.21.15.16:0/3088800973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bf80ffb90 0x7f2bf8074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.480+0000 7f2bfdd3c640 1 -- 172.21.15.16:0/3088800973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bf80ffb90 msgr2=0x7f2bf8074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.480+0000 7f2bfdd3c640 1 --2- 172.21.15.16:0/3088800973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bf80ffb90 0x7f2bf8074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.480+0000 7f2bfdd3c640 1 -- 172.21.15.16:0/3088800973 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf4009560 con 0x7f2bf8100d90 2024-08-01T06:53:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.480+0000 7f2bfdd3c640 1 --2- 172.21.15.16:0/3088800973 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf8100d90 0x7f2bf80728a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2be800e970 tx=0x7f2be800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.481+0000 7f2bef7fe640 1 -- 172.21.15.16:0/3088800973 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2be800cc90 con 0x7f2bf8100d90 2024-08-01T06:53:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.481+0000 7f2bef7fe640 1 -- 172.21.15.16:0/3088800973 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2be800cdf0 con 0x7f2bf8100d90 2024-08-01T06:53:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.481+0000 7f2c007a1640 1 -- 172.21.15.16:0/3088800973 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf8073230 con 0x7f2bf8100d90 2024-08-01T06:53:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.481+0000 7f2bef7fe640 1 -- 172.21.15.16:0/3088800973 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2be8010430 con 0x7f2bf8100d90 2024-08-01T06:53:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.481+0000 7f2c007a1640 1 -- 172.21.15.16:0/3088800973 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf819d6f0 con 0x7f2bf8100d90 2024-08-01T06:53:39.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.482+0000 7f2c007a1640 1 -- 172.21.15.16:0/3088800973 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf818f730 con 0x7f2bf8100d90 2024-08-01T06:53:39.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.482+0000 7f2bef7fe640 1 -- 172.21.15.16:0/3088800973 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2be80046c0 con 0x7f2bf8100d90 2024-08-01T06:53:39.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.483+0000 7f2bef7fe640 1 --2- 172.21.15.16:0/3088800973 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f2be406cc60 0x7f2be406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:39.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.483+0000 7f2bfe53d640 1 --2- 172.21.15.16:0/3088800973 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f2be406cc60 0x7f2be406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:39.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.483+0000 7f2bef7fe640 1 -- 172.21.15.16:0/3088800973 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f2be8014070 con 0x7f2bf8100d90 2024-08-01T06:53:39.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.483+0000 7f2bfe53d640 1 --2- 172.21.15.16:0/3088800973 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f2be406cc60 0x7f2be406f120 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4006010 tx=0x7f2bf40314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:39.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.487+0000 7f2bef7fe640 1 -- 172.21.15.16:0/3088800973 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f2be8056b40 con 0x7f2bf8100d90 2024-08-01T06:53:39.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.733+0000 7f2c007a1640 1 -- 172.21.15.16:0/3088800973 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f2bf8108a10 con 0x7f2bf8100d90 2024-08-01T06:53:39.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.733+0000 7f2bef7fe640 1 -- 172.21.15.16:0/3088800973 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v19) v1 ==== 78+0+98 (secure 0 0 0) 0x7f2be805a160 con 0x7f2bf8100d90 2024-08-01T06:53:39.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.735+0000 7f2c007a1640 1 -- 172.21.15.16:0/3088800973 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f2be406cc60 msgr2=0x7f2be406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:39.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.735+0000 7f2c007a1640 1 --2- 172.21.15.16:0/3088800973 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f2be406cc60 0x7f2be406f120 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4006010 tx=0x7f2bf40314e0 comp rx=0 tx=0).stop 2024-08-01T06:53:39.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.735+0000 7f2c007a1640 1 -- 172.21.15.16:0/3088800973 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf8100d90 msgr2=0x7f2bf80728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:39.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.735+0000 7f2c007a1640 1 --2- 172.21.15.16:0/3088800973 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf8100d90 0x7f2bf80728a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2be800e970 tx=0x7f2be800ed70 comp rx=0 tx=0).stop 2024-08-01T06:53:39.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.736+0000 7f2c007a1640 1 -- 172.21.15.16:0/3088800973 shutdown_connections 2024-08-01T06:53:39.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.736+0000 7f2c007a1640 1 --2- 172.21.15.16:0/3088800973 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f2be406cc60 0x7f2be406f120 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:39.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.736+0000 7f2c007a1640 1 --2- 172.21.15.16:0/3088800973 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf8100d90 0x7f2bf80728a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:39.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.736+0000 7f2c007a1640 1 --2- 172.21.15.16:0/3088800973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bf80ffb90 0x7f2bf8074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:39.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.736+0000 7f2c007a1640 1 -- 172.21.15.16:0/3088800973 >> 172.21.15.16:0/3088800973 conn(0x7f2bf80fb320 msgr2=0x7f2bf81044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:39.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.736+0000 7f2c007a1640 1 -- 172.21.15.16:0/3088800973 shutdown_connections 2024-08-01T06:53:39.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:39.736+0000 7f2c007a1640 1 -- 172.21.15.16:0/3088800973 wait complete. 2024-08-01T06:53:39.747 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T06:53:39.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:39 smithi089 ceph-mon[36617]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 9.9 KiB/s rd, 0 B/s wr, 11 op/s 2024-08-01T06:53:39.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:39 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:39.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:39 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:39.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:39 smithi016 ceph-mon[29266]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 9.9 KiB/s rd, 0 B/s wr, 11 op/s 2024-08-01T06:53:39.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:39.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:39 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:40.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:40 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3088800973' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-08-01T06:53:40.698 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-08-01T06:53:40.791 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-01T06:53:41.088 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:40 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/3088800973' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-08-01T06:53:41.493 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:53:41.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:41 smithi089 ceph-mon[36617]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 8.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-01T06:53:41.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:41 smithi016 ceph-mon[29266]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 8.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-01T06:53:43.783 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:43 smithi016 ceph-mon[29266]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 8.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-08-01T06:53:43.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.863+0000 7fc517e6c640 1 -- 172.21.15.16:0/531075122 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc510100750 msgr2=0x7fc5101047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:43.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.863+0000 7fc517e6c640 1 --2- 172.21.15.16:0/531075122 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc510100750 0x7fc5101047a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc500009880 tx=0x7fc50002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:53:43.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.863+0000 7fc517e6c640 1 -- 172.21.15.16:0/531075122 shutdown_connections 2024-08-01T06:53:43.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.863+0000 7fc517e6c640 1 --2- 172.21.15.16:0/531075122 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc510100750 0x7fc5101047a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:43.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.863+0000 7fc517e6c640 1 --2- 172.21.15.16:0/531075122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5100ffda0 0x7fc510100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:43.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.863+0000 7fc517e6c640 1 -- 172.21.15.16:0/531075122 >> 172.21.15.16:0/531075122 conn(0x7fc5100fb840 msgr2=0x7fc5100fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:43.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.864+0000 7fc517e6c640 1 -- 172.21.15.16:0/531075122 shutdown_connections 2024-08-01T06:53:43.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.864+0000 7fc517e6c640 1 -- 172.21.15.16:0/531075122 wait complete. 2024-08-01T06:53:43.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.864+0000 7fc517e6c640 1 Processor -- start 2024-08-01T06:53:43.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.864+0000 7fc517e6c640 1 -- start start 2024-08-01T06:53:43.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.864+0000 7fc517e6c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5100ffda0 0x7fc5100727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:43.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.864+0000 7fc517e6c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc510100750 0x7fc510072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:43.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.864+0000 7fc517e6c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc510073230 con 0x7fc510100750 2024-08-01T06:53:43.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.864+0000 7fc517e6c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5100733a0 con 0x7fc5100ffda0 2024-08-01T06:53:43.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.865+0000 7fc515407640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc510100750 0x7fc510072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:43.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.865+0000 7fc515407640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc510100750 0x7fc510072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50416/0 (socket says 172.21.15.16:50416) 2024-08-01T06:53:43.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.865+0000 7fc515407640 1 -- 172.21.15.16:0/4059925143 learned_addr learned my addr 172.21.15.16:0/4059925143 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:53:43.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.865+0000 7fc515c08640 1 --2- 172.21.15.16:0/4059925143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5100ffda0 0x7fc5100727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:43.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.865+0000 7fc515407640 1 -- 172.21.15.16:0/4059925143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5100ffda0 msgr2=0x7fc5100727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:43.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.865+0000 7fc515407640 1 --2- 172.21.15.16:0/4059925143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5100ffda0 0x7fc5100727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:43.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.865+0000 7fc515407640 1 -- 172.21.15.16:0/4059925143 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc500009560 con 0x7fc510100750 2024-08-01T06:53:43.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.865+0000 7fc515407640 1 --2- 172.21.15.16:0/4059925143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc510100750 0x7fc510072cf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc50002a9c0 tx=0x7fc5000055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:43.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.865+0000 7fc506ffd640 1 -- 172.21.15.16:0/4059925143 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc500004aa0 con 0x7fc510100750 2024-08-01T06:53:43.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.865+0000 7fc517e6c640 1 -- 172.21.15.16:0/4059925143 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc510073620 con 0x7fc510100750 2024-08-01T06:53:43.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.865+0000 7fc506ffd640 1 -- 172.21.15.16:0/4059925143 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc500004c00 con 0x7fc510100750 2024-08-01T06:53:43.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.865+0000 7fc506ffd640 1 -- 172.21.15.16:0/4059925143 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc500003980 con 0x7fc510100750 2024-08-01T06:53:43.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.865+0000 7fc517e6c640 1 -- 172.21.15.16:0/4059925143 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5101a1f10 con 0x7fc510100750 2024-08-01T06:53:43.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.866+0000 7fc517e6c640 1 -- 172.21.15.16:0/4059925143 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc510101280 con 0x7fc510100750 2024-08-01T06:53:43.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.867+0000 7fc506ffd640 1 -- 172.21.15.16:0/4059925143 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc500003bf0 con 0x7fc510100750 2024-08-01T06:53:43.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.867+0000 7fc506ffd640 1 --2- 172.21.15.16:0/4059925143 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc4fc06cc50 0x7fc4fc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:43.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.868+0000 7fc506ffd640 1 -- 172.21.15.16:0/4059925143 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc5000ad120 con 0x7fc510100750 2024-08-01T06:53:43.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.868+0000 7fc515c08640 1 --2- 172.21.15.16:0/4059925143 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc4fc06cc50 0x7fc4fc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:43.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.868+0000 7fc515c08640 1 --2- 172.21.15.16:0/4059925143 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc4fc06cc50 0x7fc4fc06f110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc50c00bbe0 tx=0x7fc50c00b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:43.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:43.872+0000 7fc506ffd640 1 -- 172.21.15.16:0/4059925143 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fc500077540 con 0x7fc510100750 2024-08-01T06:53:43.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:43 smithi089 ceph-mon[36617]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 8.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-08-01T06:53:44.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:44.079+0000 7fc517e6c640 1 -- 172.21.15.16:0/4059925143 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc510073620 con 0x7fc510100750 2024-08-01T06:53:44.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:44.080+0000 7fc506ffd640 1 -- 172.21.15.16:0/4059925143 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4856 (secure 0 0 0) 0x7fc510073620 con 0x7fc510100750 2024-08-01T06:53:44.082 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:53:44.082 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T06:53:32.617145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14482,"mds_1":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14482":{"gid":14482,"name":"cephfs.smithi016.fziqod","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.16:6829/2984549955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2984549955},{"type":"v1","addr":"172.21.15.16:6829","nonce":2984549955}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24281":{"gid":24281,"name":"cephfs.smithi089.jhouje","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6825/1878606630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1878606630},{"type":"v1","addr":"172.21.15.89:6825","nonce":1878606630}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24291":{"gid":24291,"name":"cephfs.smithi089.xanuld","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.89:6827/1787175373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1787175373},{"type":"v1","addr":"172.21.15.89:6827","nonce":1787175373}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24299":{"gid":24299,"name":"cephfs.smithi016.bgqkxu","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6827/3976091043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3976091043},{"type":"v1","addr":"172.21.15.16:6827","nonce":3976091043}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-08-01T06:53:44.082 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-08-01T06:53:44.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:44.082+0000 7fc517e6c640 1 -- 172.21.15.16:0/4059925143 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc4fc06cc50 msgr2=0x7fc4fc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:44.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:44.082+0000 7fc517e6c640 1 --2- 172.21.15.16:0/4059925143 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc4fc06cc50 0x7fc4fc06f110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc50c00bbe0 tx=0x7fc50c00b390 comp rx=0 tx=0).stop 2024-08-01T06:53:44.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:44.082+0000 7fc517e6c640 1 -- 172.21.15.16:0/4059925143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc510100750 msgr2=0x7fc510072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:44.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:44.082+0000 7fc517e6c640 1 --2- 172.21.15.16:0/4059925143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc510100750 0x7fc510072cf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc50002a9c0 tx=0x7fc5000055a0 comp rx=0 tx=0).stop 2024-08-01T06:53:44.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:44.083+0000 7fc517e6c640 1 -- 172.21.15.16:0/4059925143 shutdown_connections 2024-08-01T06:53:44.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:44.083+0000 7fc517e6c640 1 --2- 172.21.15.16:0/4059925143 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc4fc06cc50 0x7fc4fc06f110 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:44.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:44.083+0000 7fc517e6c640 1 --2- 172.21.15.16:0/4059925143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc510100750 0x7fc510072cf0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:44.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:44.083+0000 7fc517e6c640 1 --2- 172.21.15.16:0/4059925143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5100ffda0 0x7fc5100727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:44.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:44.083+0000 7fc517e6c640 1 -- 172.21.15.16:0/4059925143 >> 172.21.15.16:0/4059925143 conn(0x7fc5100fb840 msgr2=0x7fc5100fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:44.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:44.083+0000 7fc517e6c640 1 -- 172.21.15.16:0/4059925143 shutdown_connections 2024-08-01T06:53:44.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:44.083+0000 7fc517e6c640 1 -- 172.21.15.16:0/4059925143 wait complete. 2024-08-01T06:53:44.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:44 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/4059925143' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-01T06:53:44.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:44 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/4059925143' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-01T06:53:44.931 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 19, 'max_mds': 2, 'flags': 50} 2024-08-01T06:53:44.931 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-08-01T06:53:44.960 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-08-01T06:53:44.960 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-08-01T06:53:44.960 INFO:tasks.ceph_fuse:client.0 config is {} 2024-08-01T06:53:44.960 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-01T06:53:44.960 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-01T06:53:44.961 INFO:tasks.ceph_fuse:client.1 config is {} 2024-08-01T06:53:44.961 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-01T06:53:44.961 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-01T06:53:44.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:44.961 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-08-01T06:53:44.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:44.980 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2024-08-01T06:53:45.053 INFO:teuthology.orchestra.run.smithi016.stderr:Cannot find device "ceph-brx" 2024-08-01T06:53:45.055 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-01T06:53:45.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:45.055 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-08-01T06:53:45.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:45.077 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2024-08-01T06:53:45.151 INFO:teuthology.orchestra.run.smithi089.stderr:Cannot find device "ceph-brx" 2024-08-01T06:53:45.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-01T06:53:45.152 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-08-01T06:53:45.152 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-08-01T06:53:45.153 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs ls 2024-08-01T06:53:45.365 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:53:45.739 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:45 smithi016 ceph-mon[29266]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 8.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-01T06:53:45.739 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:45 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:45.739 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:45 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:45.739 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:45 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:53:45.739 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:45 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:53:45.739 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:45 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:45.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:45 smithi089 ceph-mon[36617]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 8.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-01T06:53:45.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:45 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:45.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:45 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:45.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:45 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:53:45.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:45 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:53:45.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:45 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:46.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.922+0000 7fba55832640 1 -- 172.21.15.16:0/212951339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba500fe9f0 msgr2=0x7fba500fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:46.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.922+0000 7fba55832640 1 --2- 172.21.15.16:0/212951339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba500fe9f0 0x7fba500fee50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fba44009880 tx=0x7fba4402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:53:46.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.922+0000 7fba55832640 1 -- 172.21.15.16:0/212951339 shutdown_connections 2024-08-01T06:53:46.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.922+0000 7fba55832640 1 --2- 172.21.15.16:0/212951339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba500fe9f0 0x7fba500fee50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:46.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.922+0000 7fba55832640 1 --2- 172.21.15.16:0/212951339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba501049f0 0x7fba50104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:46.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.922+0000 7fba55832640 1 -- 172.21.15.16:0/212951339 >> 172.21.15.16:0/212951339 conn(0x7fba500758a0 msgr2=0x7fba500fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:46.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.922+0000 7fba55832640 1 -- 172.21.15.16:0/212951339 shutdown_connections 2024-08-01T06:53:46.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.922+0000 7fba55832640 1 -- 172.21.15.16:0/212951339 wait complete. 2024-08-01T06:53:46.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.922+0000 7fba55832640 1 Processor -- start 2024-08-01T06:53:46.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.923+0000 7fba55832640 1 -- start start 2024-08-01T06:53:46.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.923+0000 7fba55832640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba500fe9f0 0x7fba5019b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:46.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.923+0000 7fba55832640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba501049f0 0x7fba5019bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:46.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.923+0000 7fba55832640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba50195900 con 0x7fba500fe9f0 2024-08-01T06:53:46.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.923+0000 7fba55832640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba50195a70 con 0x7fba501049f0 2024-08-01T06:53:46.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.923+0000 7fba4effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba500fe9f0 0x7fba5019b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:46.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.923+0000 7fba4effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba500fe9f0 0x7fba5019b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50442/0 (socket says 172.21.15.16:50442) 2024-08-01T06:53:46.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.923+0000 7fba4effd640 1 -- 172.21.15.16:0/3303869737 learned_addr learned my addr 172.21.15.16:0/3303869737 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:53:46.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.923+0000 7fba4e7fc640 1 --2- 172.21.15.16:0/3303869737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba501049f0 0x7fba5019bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:46.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.923+0000 7fba4effd640 1 -- 172.21.15.16:0/3303869737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba501049f0 msgr2=0x7fba5019bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:46.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.923+0000 7fba4effd640 1 --2- 172.21.15.16:0/3303869737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba501049f0 0x7fba5019bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:46.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.923+0000 7fba4effd640 1 -- 172.21.15.16:0/3303869737 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba44009560 con 0x7fba500fe9f0 2024-08-01T06:53:46.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.924+0000 7fba4effd640 1 --2- 172.21.15.16:0/3303869737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba500fe9f0 0x7fba5019b810 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fba4000eb10 tx=0x7fba4000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:46.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.924+0000 7fba54830640 1 -- 172.21.15.16:0/3303869737 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba40004b20 con 0x7fba500fe9f0 2024-08-01T06:53:46.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.924+0000 7fba54830640 1 -- 172.21.15.16:0/3303869737 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba40004c80 con 0x7fba500fe9f0 2024-08-01T06:53:46.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.924+0000 7fba55832640 1 -- 172.21.15.16:0/3303869737 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba50195d50 con 0x7fba500fe9f0 2024-08-01T06:53:46.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.924+0000 7fba54830640 1 -- 172.21.15.16:0/3303869737 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba40010640 con 0x7fba500fe9f0 2024-08-01T06:53:46.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.924+0000 7fba55832640 1 -- 172.21.15.16:0/3303869737 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba50196270 con 0x7fba500fe9f0 2024-08-01T06:53:46.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.925+0000 7fba55832640 1 -- 172.21.15.16:0/3303869737 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba50100130 con 0x7fba500fe9f0 2024-08-01T06:53:46.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.925+0000 7fba54830640 1 -- 172.21.15.16:0/3303869737 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fba400055e0 con 0x7fba500fe9f0 2024-08-01T06:53:46.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.926+0000 7fba54830640 1 --2- 172.21.15.16:0/3303869737 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fba3806cc50 0x7fba3806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:46.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.926+0000 7fba54830640 1 -- 172.21.15.16:0/3303869737 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fba40014070 con 0x7fba500fe9f0 2024-08-01T06:53:46.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.926+0000 7fba4e7fc640 1 --2- 172.21.15.16:0/3303869737 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fba3806cc50 0x7fba3806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:46.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.926+0000 7fba4e7fc640 1 --2- 172.21.15.16:0/3303869737 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fba3806cc50 0x7fba3806f110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fba44009230 tx=0x7fba440058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:46.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:46.930+0000 7fba54830640 1 -- 172.21.15.16:0/3303869737 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fba40056d30 con 0x7fba500fe9f0 2024-08-01T06:53:47.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:47.137+0000 7fba55832640 1 -- 172.21.15.16:0/3303869737 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fba501964c0 con 0x7fba500fe9f0 2024-08-01T06:53:47.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:47.137+0000 7fba54830640 1 -- 172.21.15.16:0/3303869737 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+83 (secure 0 0 0) 0x7fba4005a350 con 0x7fba500fe9f0 2024-08-01T06:53:47.139 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-08-01T06:53:47.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:47.140+0000 7fba55832640 1 -- 172.21.15.16:0/3303869737 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fba3806cc50 msgr2=0x7fba3806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:47.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:47.140+0000 7fba55832640 1 --2- 172.21.15.16:0/3303869737 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fba3806cc50 0x7fba3806f110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fba44009230 tx=0x7fba440058d0 comp rx=0 tx=0).stop 2024-08-01T06:53:47.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:47.140+0000 7fba55832640 1 -- 172.21.15.16:0/3303869737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba500fe9f0 msgr2=0x7fba5019b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:47.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:47.140+0000 7fba55832640 1 --2- 172.21.15.16:0/3303869737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba500fe9f0 0x7fba5019b810 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fba4000eb10 tx=0x7fba4000c2d0 comp rx=0 tx=0).stop 2024-08-01T06:53:47.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:47.140+0000 7fba55832640 1 -- 172.21.15.16:0/3303869737 shutdown_connections 2024-08-01T06:53:47.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:47.140+0000 7fba55832640 1 --2- 172.21.15.16:0/3303869737 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fba3806cc50 0x7fba3806f110 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:47.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:47.140+0000 7fba55832640 1 --2- 172.21.15.16:0/3303869737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba501049f0 0x7fba5019bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:47.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:47.140+0000 7fba55832640 1 --2- 172.21.15.16:0/3303869737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba500fe9f0 0x7fba5019b810 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:47.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:47.140+0000 7fba55832640 1 -- 172.21.15.16:0/3303869737 >> 172.21.15.16:0/3303869737 conn(0x7fba500758a0 msgr2=0x7fba50102220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:47.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:47.140+0000 7fba55832640 1 -- 172.21.15.16:0/3303869737 shutdown_connections 2024-08-01T06:53:47.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:47.140+0000 7fba55832640 1 -- 172.21.15.16:0/3303869737 wait complete. 2024-08-01T06:53:47.778 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:47 smithi016 ceph-mon[29266]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-01T06:53:47.778 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:47 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3303869737' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-01T06:53:47.778 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:47 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:47.778 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:47 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:53:47.800 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-01T06:53:47.800 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-01T06:53:47.800 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2024-08-01T06:53:47.800 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-01T06:53:47.800 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-01T06:53:47.800 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-01T06:53:47.800 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-01T06:53:47.800 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-01T06:53:47.800 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-01T06:53:47.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:47.801 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2024-08-01T06:53:47.818 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-01T06:53:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-01T06:53:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2024-08-01T06:53:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-08-01T06:53:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2024-08-01T06:53:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-08-01T06:53:47.818 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-01T06:53:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2024-08-01T06:53:47.818 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2024-08-01T06:53:47.818 INFO:teuthology.orchestra.run.smithi016.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-01T06:53:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2024-08-01T06:53:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2024-08-01T06:53:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-01T06:53:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 42266sec preferred_lft 42266sec 2024-08-01T06:53:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link noprefixroute 2024-08-01T06:53:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-08-01T06:53:47.819 INFO:teuthology.orchestra.run.smithi016.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-01T06:53:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2024-08-01T06:53:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2024-08-01T06:53:47.819 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-01T06:53:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2024-08-01T06:53:47.819 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2024-08-01T06:53:47.820 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-01T06:53:47.820 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-01T06:53:47.820 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-08-01T06:53:47.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add name ceph-brx type bridge 2024-08-01T06:53:47.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr flush dev ceph-brx 2024-08-01T06:53:47.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set ceph-brx up 2024-08-01T06:53:47.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-01T06:53:47.820 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-08-01T06:53:47.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:47 smithi089 ceph-mon[36617]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-01T06:53:47.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:47 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/3303869737' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-01T06:53:47.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:47 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:53:47.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:47 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:53:47.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-01T06:53:48.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-01T06:53:48.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:48.029 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-01T06:53:48.062 INFO:teuthology.orchestra.run.smithi016.stdout:1 2024-08-01T06:53:48.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:48.065 DEBUG:teuthology.orchestra.run.smithi016:> route 2024-08-01T06:53:48.131 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2024-08-01T06:53:48.131 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-01T06:53:48.131 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-01T06:53:48.132 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-01T06:53:48.132 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-01T06:53:48.133 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-01T06:53:48.133 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-08-01T06:53:48.133 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-01T06:53:48.133 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-01T06:53:48.133 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-01T06:53:48.134 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-08-01T06:53:48.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-01T06:53:48.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-01T06:53:48.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:48.483 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-08-01T06:53:48.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:48.499 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list-id 2024-08-01T06:53:48.555 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-01T06:53:48.555 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-08-01T06:53:48.555 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-01T06:53:48.556 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-01T06:53:48.556 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-08-01T06:53:48.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-01T06:53:48.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-01T06:53:48.677 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-01T06:53:48.677 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-01T06:53:48.677 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-08-01T06:53:48.677 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-01T06:53:48.677 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-01T06:53:48.677 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-01T06:53:48.677 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-01T06:53:48.678 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-01T06:53:48.678 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-08-01T06:53:48.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-01T06:53:48.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-01T06:53:48.815 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-01T06:53:48.815 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-08-01T06:53:48.815 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.0 up 2024-08-01T06:53:48.815 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set dev brx.0 master ceph-brx 2024-08-01T06:53:48.816 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-08-01T06:53:48.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-01T06:53:48.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-01T06:53:48.894 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-01T06:53:48.895 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-01T06:53:48.895 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-01T06:53:48.910 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-01T06:53:48.911 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-01T06:53:48.911 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-01T06:53:48.967 DEBUG:teuthology.orchestra.run.smithi016:> sudo modprobe fuse 2024-08-01T06:53:49.034 DEBUG:teuthology.orchestra.run.smithi016:> cat /proc/self/mounts | awk '{print $2}' 2024-08-01T06:53:49.091 INFO:teuthology.orchestra.run.smithi016.stdout:/proc 2024-08-01T06:53:49.091 INFO:teuthology.orchestra.run.smithi016.stdout:/sys 2024-08-01T06:53:49.091 INFO:teuthology.orchestra.run.smithi016.stdout:/dev 2024-08-01T06:53:49.091 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/security 2024-08-01T06:53:49.092 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/shm 2024-08-01T06:53:49.092 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/pts 2024-08-01T06:53:49.092 INFO:teuthology.orchestra.run.smithi016.stdout:/run 2024-08-01T06:53:49.092 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/cgroup 2024-08-01T06:53:49.092 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/pstore 2024-08-01T06:53:49.092 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/bpf 2024-08-01T06:53:49.092 INFO:teuthology.orchestra.run.smithi016.stdout:/ 2024-08-01T06:53:49.092 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/selinux 2024-08-01T06:53:49.092 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/sys/fs/binfmt_misc 2024-08-01T06:53:49.092 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/mqueue 2024-08-01T06:53:49.092 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/hugepages 2024-08-01T06:53:49.092 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/debug 2024-08-01T06:53:49.092 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/tracing 2024-08-01T06:53:49.093 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/fuse/connections 2024-08-01T06:53:49.093 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/config 2024-08-01T06:53:49.093 INFO:teuthology.orchestra.run.smithi016.stdout:/run/credentials/systemd-sysctl.service 2024-08-01T06:53:49.093 INFO:teuthology.orchestra.run.smithi016.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-01T06:53:49.093 INFO:teuthology.orchestra.run.smithi016.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-01T06:53:49.093 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/nfs/rpc_pipefs 2024-08-01T06:53:49.093 INFO:teuthology.orchestra.run.smithi016.stdout:/run/user/1000 2024-08-01T06:53:49.093 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph 2024-08-01T06:53:49.093 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay 2024-08-01T06:53:49.093 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/5c1d7d8cc5b1b969c0830a27dd2a05d1ae927b583ba343cb6a793192599869e1/merged 2024-08-01T06:53:49.093 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/f3371d958f658e6e12e34baebed6459d4c709eab084aad6e32e85bdd0f2c6f0a/merged 2024-08-01T06:53:49.093 INFO:teuthology.orchestra.run.smithi016.stdout:/run/user/0 2024-08-01T06:53:49.093 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/sys/fs/binfmt_misc 2024-08-01T06:53:49.094 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/fc95b53fb50711ae6adc4540e883a5cd00627a2db16c752109967d1b2deb1ee9/merged 2024-08-01T06:53:49.094 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/6edaf89eff1e5eb2d7fc4bdefb37b68e230d998063b8e82c7a4933e0bb9ffe3c/merged 2024-08-01T06:53:49.094 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/56426319ac85c758e3327636ae40b4498bee7b884484a22dc344a3beb1ba8fd6/merged 2024-08-01T06:53:49.094 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/e8404102b971abdf9430b66f0ec8e43b186a64fbe2c4396e267eb1cfceddc4b8/merged 2024-08-01T06:53:49.094 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/a3ea8db1526dcb9540d91b9150ae171de652c7179556e14de6cc17fd8c86563b/merged 2024-08-01T06:53:49.094 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/aefb6b734c16d7a49376a8007c9193bda5aad9d41733f4e68bf0c837be2c0322/merged 2024-08-01T06:53:49.094 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/6a0bebd739652363eeb1de0a43c133df3a2dc481de1524771bceb4dc08c7086f/merged 2024-08-01T06:53:49.094 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/1c0930ba875c3c8444b3c3c3b39cbc0c16780a38f61c2bdddc06ae684ff766ca/merged 2024-08-01T06:53:49.094 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/327f7089eedad3103c23f53867a1f739b1d639ca9c4ee8847ea4e61407b07b45/merged 2024-08-01T06:53:49.094 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/8217a2948e99f5aa3af969499944cb2e0585caaf526d22f5516819c0acace214/merged 2024-08-01T06:53:49.094 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/7d8c3ed15dd6658d8dec44b9a34657131cf38b785bd46159590de5f011e075b3/merged 2024-08-01T06:53:49.094 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns 2024-08-01T06:53:49.095 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-01T06:53:49.095 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-01T06:53:49.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:49.095 DEBUG:teuthology.orchestra.run.smithi016:> ls /sys/fs/fuse/connections 2024-08-01T06:53:49.147 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-01T06:53:49.147 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-01T06:53:49.190 DEBUG:teuthology.orchestra.run.smithi016:> sudo modprobe fuse 2024-08-01T06:53:49.215 DEBUG:teuthology.orchestra.run.smithi016:> cat /proc/self/mounts | awk '{print $2}' 2024-08-01T06:53:49.272 INFO:teuthology.orchestra.run.smithi016.stdout:/proc 2024-08-01T06:53:49.272 INFO:teuthology.orchestra.run.smithi016.stdout:/sys 2024-08-01T06:53:49.272 INFO:teuthology.orchestra.run.smithi016.stdout:/dev 2024-08-01T06:53:49.272 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/security 2024-08-01T06:53:49.272 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/shm 2024-08-01T06:53:49.272 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/pts 2024-08-01T06:53:49.272 INFO:teuthology.orchestra.run.smithi016.stdout:/run 2024-08-01T06:53:49.272 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/cgroup 2024-08-01T06:53:49.273 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/pstore 2024-08-01T06:53:49.273 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/bpf 2024-08-01T06:53:49.273 INFO:teuthology.orchestra.run.smithi016.stdout:/ 2024-08-01T06:53:49.273 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/selinux 2024-08-01T06:53:49.273 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/sys/fs/binfmt_misc 2024-08-01T06:53:49.273 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/mqueue 2024-08-01T06:53:49.273 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/hugepages 2024-08-01T06:53:49.273 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/debug 2024-08-01T06:53:49.273 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/tracing 2024-08-01T06:53:49.273 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/fuse/connections 2024-08-01T06:53:49.273 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/config 2024-08-01T06:53:49.273 INFO:teuthology.orchestra.run.smithi016.stdout:/run/credentials/systemd-sysctl.service 2024-08-01T06:53:49.273 INFO:teuthology.orchestra.run.smithi016.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-01T06:53:49.274 INFO:teuthology.orchestra.run.smithi016.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-01T06:53:49.274 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/nfs/rpc_pipefs 2024-08-01T06:53:49.274 INFO:teuthology.orchestra.run.smithi016.stdout:/run/user/1000 2024-08-01T06:53:49.274 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph 2024-08-01T06:53:49.274 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay 2024-08-01T06:53:49.274 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/5c1d7d8cc5b1b969c0830a27dd2a05d1ae927b583ba343cb6a793192599869e1/merged 2024-08-01T06:53:49.274 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/f3371d958f658e6e12e34baebed6459d4c709eab084aad6e32e85bdd0f2c6f0a/merged 2024-08-01T06:53:49.274 INFO:teuthology.orchestra.run.smithi016.stdout:/run/user/0 2024-08-01T06:53:49.274 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/sys/fs/binfmt_misc 2024-08-01T06:53:49.274 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/fc95b53fb50711ae6adc4540e883a5cd00627a2db16c752109967d1b2deb1ee9/merged 2024-08-01T06:53:49.274 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/6edaf89eff1e5eb2d7fc4bdefb37b68e230d998063b8e82c7a4933e0bb9ffe3c/merged 2024-08-01T06:53:49.275 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/56426319ac85c758e3327636ae40b4498bee7b884484a22dc344a3beb1ba8fd6/merged 2024-08-01T06:53:49.275 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/e8404102b971abdf9430b66f0ec8e43b186a64fbe2c4396e267eb1cfceddc4b8/merged 2024-08-01T06:53:49.275 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/a3ea8db1526dcb9540d91b9150ae171de652c7179556e14de6cc17fd8c86563b/merged 2024-08-01T06:53:49.275 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/aefb6b734c16d7a49376a8007c9193bda5aad9d41733f4e68bf0c837be2c0322/merged 2024-08-01T06:53:49.275 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/6a0bebd739652363eeb1de0a43c133df3a2dc481de1524771bceb4dc08c7086f/merged 2024-08-01T06:53:49.275 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/1c0930ba875c3c8444b3c3c3b39cbc0c16780a38f61c2bdddc06ae684ff766ca/merged 2024-08-01T06:53:49.275 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/327f7089eedad3103c23f53867a1f739b1d639ca9c4ee8847ea4e61407b07b45/merged 2024-08-01T06:53:49.275 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/8217a2948e99f5aa3af969499944cb2e0585caaf526d22f5516819c0acace214/merged 2024-08-01T06:53:49.275 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/containers/storage/overlay/7d8c3ed15dd6658d8dec44b9a34657131cf38b785bd46159590de5f011e075b3/merged 2024-08-01T06:53:49.275 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns 2024-08-01T06:53:49.275 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-01T06:53:49.275 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-01T06:53:49.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:49.276 DEBUG:teuthology.orchestra.run.smithi016:> ls /sys/fs/fuse/connections 2024-08-01T06:53:49.314 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi016.stderr:2024-08-01T06:53:49.313+0000 7fb9b69f4480 -1 init, newargv = 0x55dd193aadf0 newargc=15 2024-08-01T06:53:49.315 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi016.stderr:ceph-fuse[77340]: starting ceph client 2024-08-01T06:53:49.323 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi016.stderr:ceph-fuse[77340]: starting fuse 2024-08-01T06:53:49.331 INFO:teuthology.orchestra.run.smithi016.stdout:164 2024-08-01T06:53:49.331 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [164] 2024-08-01T06:53:49.331 DEBUG:teuthology.orchestra.run.smithi016:> sudo stdin-killer -- python3 -c ' 2024-08-01T06:53:49.331 DEBUG:teuthology.orchestra.run.smithi016:> import glob 2024-08-01T06:53:49.331 DEBUG:teuthology.orchestra.run.smithi016:> import re 2024-08-01T06:53:49.331 DEBUG:teuthology.orchestra.run.smithi016:> import os 2024-08-01T06:53:49.332 DEBUG:teuthology.orchestra.run.smithi016:> import subprocess 2024-08-01T06:53:49.332 DEBUG:teuthology.orchestra.run.smithi016:> 2024-08-01T06:53:49.332 DEBUG:teuthology.orchestra.run.smithi016:> def _find_admin_socket(client_name): 2024-08-01T06:53:49.332 DEBUG:teuthology.orchestra.run.smithi016:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-01T06:53:49.332 DEBUG:teuthology.orchestra.run.smithi016:> files = glob.glob(asok_path) 2024-08-01T06:53:49.332 DEBUG:teuthology.orchestra.run.smithi016:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-01T06:53:49.332 DEBUG:teuthology.orchestra.run.smithi016:> 2024-08-01T06:53:49.332 DEBUG:teuthology.orchestra.run.smithi016:> # Given a non-glob path, it better be there 2024-08-01T06:53:49.332 DEBUG:teuthology.orchestra.run.smithi016:> if "*" not in asok_path: 2024-08-01T06:53:49.332 DEBUG:teuthology.orchestra.run.smithi016:> assert(len(files) == 1) 2024-08-01T06:53:49.332 DEBUG:teuthology.orchestra.run.smithi016:> return files[0] 2024-08-01T06:53:49.332 DEBUG:teuthology.orchestra.run.smithi016:> 2024-08-01T06:53:49.332 DEBUG:teuthology.orchestra.run.smithi016:> for f in files: 2024-08-01T06:53:49.332 DEBUG:teuthology.orchestra.run.smithi016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-01T06:53:49.332 DEBUG:teuthology.orchestra.run.smithi016:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-01T06:53:49.333 DEBUG:teuthology.orchestra.run.smithi016:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-01T06:53:49.333 DEBUG:teuthology.orchestra.run.smithi016:> contents = proc_f.read() 2024-08-01T06:53:49.333 DEBUG:teuthology.orchestra.run.smithi016:> if mountpoint in contents: 2024-08-01T06:53:49.333 DEBUG:teuthology.orchestra.run.smithi016:> return f 2024-08-01T06:53:49.333 DEBUG:teuthology.orchestra.run.smithi016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-01T06:53:49.333 DEBUG:teuthology.orchestra.run.smithi016:> 2024-08-01T06:53:49.333 DEBUG:teuthology.orchestra.run.smithi016:> print(_find_admin_socket("client.0")) 2024-08-01T06:53:49.333 DEBUG:teuthology.orchestra.run.smithi016:> ' 2024-08-01T06:53:49.452 INFO:teuthology.orchestra.run.smithi016.stdout:/var/run/ceph/ceph-client.0.77340.asok 2024-08-01T06:53:49.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-01T06:53:49.463 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.77340.asok 2024-08-01T06:53:49.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:49.463 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.77340.asok status 2024-08-01T06:53:49.603 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:53:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "metadata": { 2024-08-01T06:53:49.603 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_sha1": "a3bbd7289877bdcce87fd1f79da1a2d6578dde36", 2024-08-01T06:53:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_version": "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)", 2024-08-01T06:53:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "entity_id": "0", 2024-08-01T06:53:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "hostname": "smithi016", 2024-08-01T06:53:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-01T06:53:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "pid": "77340", 2024-08-01T06:53:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "root": "/" 2024-08-01T06:53:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:53:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "dentry_count": 0, 2024-08-01T06:53:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "dentry_pinned_count": 0, 2024-08-01T06:53:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 14522, 2024-08-01T06:53:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "inst": { 2024-08-01T06:53:49.604 INFO:teuthology.orchestra.run.smithi016.stdout: "name": { 2024-08-01T06:53:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "client", 2024-08-01T06:53:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "num": 14522 2024-08-01T06:53:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:53:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": { 2024-08-01T06:53:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v1", 2024-08-01T06:53:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "192.168.0.1:0", 2024-08-01T06:53:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 3418530137 2024-08-01T06:53:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T06:53:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:53:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": { 2024-08-01T06:53:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v1", 2024-08-01T06:53:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "192.168.0.1:0", 2024-08-01T06:53:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 3418530137 2024-08-01T06:53:49.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:53:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "inst_str": "client.14522 192.168.0.1:0/3418530137", 2024-08-01T06:53:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "addr_str": "192.168.0.1:0/3418530137", 2024-08-01T06:53:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "inode_count": 1, 2024-08-01T06:53:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_epoch": 19, 2024-08-01T06:53:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_epoch": 46, 2024-08-01T06:53:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_epoch_barrier": 0, 2024-08-01T06:53:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "blocklisted": false, 2024-08-01T06:53:49.606 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs" 2024-08-01T06:53:49.606 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:53:49.612 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-08-01T06:53:49.612 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs ls 2024-08-01T06:53:49.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:49 smithi016 ceph-mon[29266]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 5.5 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-01T06:53:49.826 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:53:49.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:49 smithi089 ceph-mon[36617]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 5.5 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-01T06:53:51.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.431+0000 7f5109557640 1 -- 172.21.15.16:0/2305611616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51041015d0 msgr2=0x7f5104109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:51.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.431+0000 7f5109557640 1 --2- 172.21.15.16:0/2305611616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51041015d0 0x7f5104109ac0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f50ec009880 tx=0x7f50ec02a530 comp rx=0 tx=0).stop 2024-08-01T06:53:51.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.431+0000 7f5109557640 1 -- 172.21.15.16:0/2305611616 shutdown_connections 2024-08-01T06:53:51.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.431+0000 7f5109557640 1 --2- 172.21.15.16:0/2305611616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51041015d0 0x7f5104109ac0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:51.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.431+0000 7f5109557640 1 --2- 172.21.15.16:0/2305611616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5104100cb0 0x7f5104101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:51.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.431+0000 7f5109557640 1 -- 172.21.15.16:0/2305611616 >> 172.21.15.16:0/2305611616 conn(0x7f51040fa730 msgr2=0x7f51040fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:51.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.431+0000 7f5109557640 1 -- 172.21.15.16:0/2305611616 shutdown_connections 2024-08-01T06:53:51.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.431+0000 7f5109557640 1 -- 172.21.15.16:0/2305611616 wait complete. 2024-08-01T06:53:51.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.431+0000 7f5109557640 1 Processor -- start 2024-08-01T06:53:51.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.432+0000 7f5109557640 1 -- start start 2024-08-01T06:53:51.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.432+0000 7f5109557640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5104100cb0 0x7f510419b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:51.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.432+0000 7f5109557640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51041015d0 0x7f510419be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:51.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.432+0000 7f5109557640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510419c4b0 con 0x7f5104100cb0 2024-08-01T06:53:51.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.432+0000 7f5109557640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5104195a40 con 0x7f51041015d0 2024-08-01T06:53:51.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.432+0000 7f5102ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5104100cb0 0x7f510419b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:51.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.432+0000 7f5102ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5104100cb0 0x7f510419b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50788/0 (socket says 172.21.15.16:50788) 2024-08-01T06:53:51.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.432+0000 7f5102ffd640 1 -- 172.21.15.16:0/924833799 learned_addr learned my addr 172.21.15.16:0/924833799 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:53:51.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.432+0000 7f51027fc640 1 --2- 172.21.15.16:0/924833799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51041015d0 0x7f510419be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:51.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.432+0000 7f5102ffd640 1 -- 172.21.15.16:0/924833799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51041015d0 msgr2=0x7f510419be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:51.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.432+0000 7f5102ffd640 1 --2- 172.21.15.16:0/924833799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51041015d0 0x7f510419be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:51.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.433+0000 7f5102ffd640 1 -- 172.21.15.16:0/924833799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec009560 con 0x7f5104100cb0 2024-08-01T06:53:51.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.433+0000 7f5102ffd640 1 --2- 172.21.15.16:0/924833799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5104100cb0 0x7f510419b950 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00b420 tx=0x7f50fc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:51.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.433+0000 7f50fbfff640 1 -- 172.21.15.16:0/924833799 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50fc011800 con 0x7f5104100cb0 2024-08-01T06:53:51.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.433+0000 7f50fbfff640 1 -- 172.21.15.16:0/924833799 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f50fc011e20 con 0x7f5104100cb0 2024-08-01T06:53:51.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.433+0000 7f5109557640 1 -- 172.21.15.16:0/924833799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5104195d20 con 0x7f5104100cb0 2024-08-01T06:53:51.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.433+0000 7f50fbfff640 1 -- 172.21.15.16:0/924833799 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50fc00f2e0 con 0x7f5104100cb0 2024-08-01T06:53:51.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.433+0000 7f5109557640 1 -- 172.21.15.16:0/924833799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5104196240 con 0x7f5104100cb0 2024-08-01T06:53:51.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.434+0000 7f5109557640 1 -- 172.21.15.16:0/924833799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5104068d30 con 0x7f5104100cb0 2024-08-01T06:53:51.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.434+0000 7f50fbfff640 1 -- 172.21.15.16:0/924833799 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f50fc010380 con 0x7f5104100cb0 2024-08-01T06:53:51.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.435+0000 7f50fbfff640 1 --2- 172.21.15.16:0/924833799 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f50f006cc50 0x7f50f006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:53:51.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.435+0000 7f50fbfff640 1 -- 172.21.15.16:0/924833799 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f50fc08bc20 con 0x7f5104100cb0 2024-08-01T06:53:51.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.435+0000 7f51027fc640 1 --2- 172.21.15.16:0/924833799 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f50f006cc50 0x7f50f006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:53:51.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.436+0000 7f51027fc640 1 --2- 172.21.15.16:0/924833799 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f50f006cc50 0x7f50f006f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f50ec000c00 tx=0x7f50ec005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:53:51.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.440+0000 7f50fbfff640 1 -- 172.21.15.16:0/924833799 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f50fc055f90 con 0x7f5104100cb0 2024-08-01T06:53:51.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.648+0000 7f5109557640 1 -- 172.21.15.16:0/924833799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f510410ce00 con 0x7f5104100cb0 2024-08-01T06:53:51.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.648+0000 7f50fbfff640 1 -- 172.21.15.16:0/924833799 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+83 (secure 0 0 0) 0x7f50fc0595b0 con 0x7f5104100cb0 2024-08-01T06:53:51.650 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-08-01T06:53:51.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.650+0000 7f5109557640 1 -- 172.21.15.16:0/924833799 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f50f006cc50 msgr2=0x7f50f006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:51.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.650+0000 7f5109557640 1 --2- 172.21.15.16:0/924833799 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f50f006cc50 0x7f50f006f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f50ec000c00 tx=0x7f50ec005a20 comp rx=0 tx=0).stop 2024-08-01T06:53:51.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.650+0000 7f5109557640 1 -- 172.21.15.16:0/924833799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5104100cb0 msgr2=0x7f510419b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:53:51.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.650+0000 7f5109557640 1 --2- 172.21.15.16:0/924833799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5104100cb0 0x7f510419b950 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00b420 tx=0x7f50fc00b8e0 comp rx=0 tx=0).stop 2024-08-01T06:53:51.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.650+0000 7f5109557640 1 -- 172.21.15.16:0/924833799 shutdown_connections 2024-08-01T06:53:51.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.650+0000 7f5109557640 1 --2- 172.21.15.16:0/924833799 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f50f006cc50 0x7f50f006f110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:51.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.650+0000 7f5109557640 1 --2- 172.21.15.16:0/924833799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51041015d0 0x7f510419be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:51.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.650+0000 7f5109557640 1 --2- 172.21.15.16:0/924833799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5104100cb0 0x7f510419b950 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:53:51.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.650+0000 7f5109557640 1 -- 172.21.15.16:0/924833799 >> 172.21.15.16:0/924833799 conn(0x7f51040fa730 msgr2=0x7f5104101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:53:51.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.650+0000 7f5109557640 1 -- 172.21.15.16:0/924833799 shutdown_connections 2024-08-01T06:53:51.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:53:51.650+0000 7f5109557640 1 -- 172.21.15.16:0/924833799 wait complete. 2024-08-01T06:53:51.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:51 smithi089 ceph-mon[36617]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:53:51.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:51 smithi016 ceph-mon[29266]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:53:52.277 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-01T06:53:52.278 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-01T06:53:52.278 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2024-08-01T06:53:52.278 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-01T06:53:52.278 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-01T06:53:52.278 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-01T06:53:52.278 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-01T06:53:52.278 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-01T06:53:52.278 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-01T06:53:52.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:52.278 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2024-08-01T06:53:52.298 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-01T06:53:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-01T06:53:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2024-08-01T06:53:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-08-01T06:53:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2024-08-01T06:53:52.298 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-08-01T06:53:52.298 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-01T06:53:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2024-08-01T06:53:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2024-08-01T06:53:52.299 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-01T06:53:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2024-08-01T06:53:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2024-08-01T06:53:52.299 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-01T06:53:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2024-08-01T06:53:52.299 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-01T06:53:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2024-08-01T06:53:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-01T06:53:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42259sec preferred_lft 42259sec 2024-08-01T06:53:52.299 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2024-08-01T06:53:52.300 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-08-01T06:53:52.300 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-01T06:53:52.300 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-01T06:53:52.300 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-08-01T06:53:52.300 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add name ceph-brx type bridge 2024-08-01T06:53:52.300 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr flush dev ceph-brx 2024-08-01T06:53:52.300 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set ceph-brx up 2024-08-01T06:53:52.300 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-01T06:53:52.300 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-08-01T06:53:52.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:53:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-01T06:53:52.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:53:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-01T06:53:52.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:52.523 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-01T06:53:52.547 INFO:teuthology.orchestra.run.smithi089.stdout:1 2024-08-01T06:53:52.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:52.549 DEBUG:teuthology.orchestra.run.smithi089:> route 2024-08-01T06:53:52.624 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2024-08-01T06:53:52.624 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-01T06:53:52.624 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-01T06:53:52.624 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-01T06:53:52.624 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-01T06:53:52.625 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-01T06:53:52.625 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-08-01T06:53:52.625 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-01T06:53:52.625 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-01T06:53:52.625 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-01T06:53:52.625 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-08-01T06:53:52.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:53:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-01T06:53:52.721 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:52 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/924833799' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-01T06:53:52.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:52 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/924833799' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-01T06:53:52.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:53:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-01T06:53:52.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:52.917 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-08-01T06:53:52.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:52.932 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list-id 2024-08-01T06:53:52.988 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-01T06:53:52.988 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-08-01T06:53:52.988 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-01T06:53:52.988 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-01T06:53:52.989 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-08-01T06:53:53.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:53:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-01T06:53:53.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:53:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-01T06:53:53.112 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-01T06:53:53.113 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-01T06:53:53.113 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-08-01T06:53:53.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-01T06:53:53.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-01T06:53:53.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-01T06:53:53.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-01T06:53:53.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-01T06:53:53.113 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-08-01T06:53:53.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:53:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-01T06:53:53.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:53:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-01T06:53:53.246 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-01T06:53:53.246 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-08-01T06:53:53.246 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2024-08-01T06:53:53.246 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set dev brx.0 master ceph-brx 2024-08-01T06:53:53.246 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-08-01T06:53:53.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:53:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-01T06:53:53.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:53:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-01T06:53:53.329 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-08-01T06:53:53.329 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-01T06:53:53.329 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-01T06:53:53.344 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-01T06:53:53.344 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-01T06:53:53.344 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-01T06:53:53.400 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2024-08-01T06:53:53.466 DEBUG:teuthology.orchestra.run.smithi089:> cat /proc/self/mounts | awk '{print $2}' 2024-08-01T06:53:53.522 INFO:teuthology.orchestra.run.smithi089.stdout:/proc 2024-08-01T06:53:53.522 INFO:teuthology.orchestra.run.smithi089.stdout:/sys 2024-08-01T06:53:53.522 INFO:teuthology.orchestra.run.smithi089.stdout:/dev 2024-08-01T06:53:53.522 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/security 2024-08-01T06:53:53.522 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/shm 2024-08-01T06:53:53.522 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/pts 2024-08-01T06:53:53.522 INFO:teuthology.orchestra.run.smithi089.stdout:/run 2024-08-01T06:53:53.522 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/cgroup 2024-08-01T06:53:53.522 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/pstore 2024-08-01T06:53:53.522 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/bpf 2024-08-01T06:53:53.523 INFO:teuthology.orchestra.run.smithi089.stdout:/ 2024-08-01T06:53:53.523 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/selinux 2024-08-01T06:53:53.523 INFO:teuthology.orchestra.run.smithi089.stdout:/proc/sys/fs/binfmt_misc 2024-08-01T06:53:53.523 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/mqueue 2024-08-01T06:53:53.523 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/debug 2024-08-01T06:53:53.523 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/hugepages 2024-08-01T06:53:53.523 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/tracing 2024-08-01T06:53:53.523 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/fuse/connections 2024-08-01T06:53:53.523 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/config 2024-08-01T06:53:53.523 INFO:teuthology.orchestra.run.smithi089.stdout:/run/credentials/systemd-sysctl.service 2024-08-01T06:53:53.523 INFO:teuthology.orchestra.run.smithi089.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-01T06:53:53.523 INFO:teuthology.orchestra.run.smithi089.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-01T06:53:53.523 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/nfs/rpc_pipefs 2024-08-01T06:53:53.524 INFO:teuthology.orchestra.run.smithi089.stdout:/run/user/1000 2024-08-01T06:53:53.524 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/ceph 2024-08-01T06:53:53.524 INFO:teuthology.orchestra.run.smithi089.stdout:/run/user/0 2024-08-01T06:53:53.524 INFO:teuthology.orchestra.run.smithi089.stdout:/proc/sys/fs/binfmt_misc 2024-08-01T06:53:53.524 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay 2024-08-01T06:53:53.524 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/26b874643db0cb520bd0ea57c9b13378cbe8529d5eab3d38b432f1f651231f7b/merged 2024-08-01T06:53:53.524 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/0142a21d75900d0f4a5a6c002016f4bbc88883f9f575686ec924799fc68a130b/merged 2024-08-01T06:53:53.524 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/d940bdedeacdbfbf35bc01f02aabb7d63a679a28a1e91aec0c21a41680a64387/merged 2024-08-01T06:53:53.524 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/157b1ec82d0ebd032269549f7714a6a8613d61a1b4bd69e058343c03632ef1ea/merged 2024-08-01T06:53:53.524 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/0456228b4ef6241271cb40d15eed108741c704df66c93ecc92ded0095f0ff669/merged 2024-08-01T06:53:53.524 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/f3df237bbe04012ad77853d0cd159af56cb03b5041fbc9183c53c3666940c0af/merged 2024-08-01T06:53:53.524 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/19fb59aa41832fe9fcaaf08b513b0e6421994c38c464adf6d6d1fb63258419dc/merged 2024-08-01T06:53:53.525 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/0a1d2bf4776a365d1f931fb6451a266e0c7dfeb3560736d4a06d8315e652aa64/merged 2024-08-01T06:53:53.525 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/d2e9521b707311803bad940aa41121ffd21b29f889ec078827cf134f41e53f64/merged 2024-08-01T06:53:53.525 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/26b25b5d8954814e38465e6ae313ebcf367510f3c2453b1dc69aba4c892bae05/merged 2024-08-01T06:53:53.525 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns 2024-08-01T06:53:53.525 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-01T06:53:53.525 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-01T06:53:53.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:53.525 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2024-08-01T06:53:53.577 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-01T06:53:53.578 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-08-01T06:53:53.620 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2024-08-01T06:53:53.645 DEBUG:teuthology.orchestra.run.smithi089:> cat /proc/self/mounts | awk '{print $2}' 2024-08-01T06:53:53.701 INFO:teuthology.orchestra.run.smithi089.stdout:/proc 2024-08-01T06:53:53.701 INFO:teuthology.orchestra.run.smithi089.stdout:/sys 2024-08-01T06:53:53.701 INFO:teuthology.orchestra.run.smithi089.stdout:/dev 2024-08-01T06:53:53.701 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/security 2024-08-01T06:53:53.701 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/shm 2024-08-01T06:53:53.701 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/pts 2024-08-01T06:53:53.701 INFO:teuthology.orchestra.run.smithi089.stdout:/run 2024-08-01T06:53:53.702 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/cgroup 2024-08-01T06:53:53.702 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/pstore 2024-08-01T06:53:53.702 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/bpf 2024-08-01T06:53:53.702 INFO:teuthology.orchestra.run.smithi089.stdout:/ 2024-08-01T06:53:53.702 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/selinux 2024-08-01T06:53:53.702 INFO:teuthology.orchestra.run.smithi089.stdout:/proc/sys/fs/binfmt_misc 2024-08-01T06:53:53.702 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/mqueue 2024-08-01T06:53:53.702 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/debug 2024-08-01T06:53:53.702 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/hugepages 2024-08-01T06:53:53.702 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/tracing 2024-08-01T06:53:53.702 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/fuse/connections 2024-08-01T06:53:53.702 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/config 2024-08-01T06:53:53.702 INFO:teuthology.orchestra.run.smithi089.stdout:/run/credentials/systemd-sysctl.service 2024-08-01T06:53:53.703 INFO:teuthology.orchestra.run.smithi089.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-01T06:53:53.703 INFO:teuthology.orchestra.run.smithi089.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-01T06:53:53.703 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/nfs/rpc_pipefs 2024-08-01T06:53:53.703 INFO:teuthology.orchestra.run.smithi089.stdout:/run/user/1000 2024-08-01T06:53:53.703 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/ceph 2024-08-01T06:53:53.703 INFO:teuthology.orchestra.run.smithi089.stdout:/run/user/0 2024-08-01T06:53:53.703 INFO:teuthology.orchestra.run.smithi089.stdout:/proc/sys/fs/binfmt_misc 2024-08-01T06:53:53.703 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay 2024-08-01T06:53:53.703 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/26b874643db0cb520bd0ea57c9b13378cbe8529d5eab3d38b432f1f651231f7b/merged 2024-08-01T06:53:53.703 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/0142a21d75900d0f4a5a6c002016f4bbc88883f9f575686ec924799fc68a130b/merged 2024-08-01T06:53:53.703 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/d940bdedeacdbfbf35bc01f02aabb7d63a679a28a1e91aec0c21a41680a64387/merged 2024-08-01T06:53:53.703 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/157b1ec82d0ebd032269549f7714a6a8613d61a1b4bd69e058343c03632ef1ea/merged 2024-08-01T06:53:53.703 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/0456228b4ef6241271cb40d15eed108741c704df66c93ecc92ded0095f0ff669/merged 2024-08-01T06:53:53.704 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/f3df237bbe04012ad77853d0cd159af56cb03b5041fbc9183c53c3666940c0af/merged 2024-08-01T06:53:53.704 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/19fb59aa41832fe9fcaaf08b513b0e6421994c38c464adf6d6d1fb63258419dc/merged 2024-08-01T06:53:53.704 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/0a1d2bf4776a365d1f931fb6451a266e0c7dfeb3560736d4a06d8315e652aa64/merged 2024-08-01T06:53:53.704 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/d2e9521b707311803bad940aa41121ffd21b29f889ec078827cf134f41e53f64/merged 2024-08-01T06:53:53.704 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/containers/storage/overlay/26b25b5d8954814e38465e6ae313ebcf367510f3c2453b1dc69aba4c892bae05/merged 2024-08-01T06:53:53.704 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns 2024-08-01T06:53:53.704 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-01T06:53:53.704 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-01T06:53:53.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:53.705 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2024-08-01T06:53:53.735 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi089.stderr:2024-08-01T06:53:53.734+0000 7f2fd8c3e480 -1 init, newargv = 0x555f1e406f00 newargc=15 2024-08-01T06:53:53.736 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi089.stderr:ceph-fuse[61922]: starting ceph client 2024-08-01T06:53:53.743 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi089.stderr:ceph-fuse[61922]: starting fuse 2024-08-01T06:53:53.752 INFO:teuthology.orchestra.run.smithi089.stdout:128 2024-08-01T06:53:53.752 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [128] 2024-08-01T06:53:53.753 DEBUG:teuthology.orchestra.run.smithi089:> sudo stdin-killer -- python3 -c ' 2024-08-01T06:53:53.753 DEBUG:teuthology.orchestra.run.smithi089:> import glob 2024-08-01T06:53:53.753 DEBUG:teuthology.orchestra.run.smithi089:> import re 2024-08-01T06:53:53.753 DEBUG:teuthology.orchestra.run.smithi089:> import os 2024-08-01T06:53:53.753 DEBUG:teuthology.orchestra.run.smithi089:> import subprocess 2024-08-01T06:53:53.753 DEBUG:teuthology.orchestra.run.smithi089:> 2024-08-01T06:53:53.753 DEBUG:teuthology.orchestra.run.smithi089:> def _find_admin_socket(client_name): 2024-08-01T06:53:53.753 DEBUG:teuthology.orchestra.run.smithi089:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-08-01T06:53:53.753 DEBUG:teuthology.orchestra.run.smithi089:> files = glob.glob(asok_path) 2024-08-01T06:53:53.753 DEBUG:teuthology.orchestra.run.smithi089:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-08-01T06:53:53.753 DEBUG:teuthology.orchestra.run.smithi089:> 2024-08-01T06:53:53.753 DEBUG:teuthology.orchestra.run.smithi089:> # Given a non-glob path, it better be there 2024-08-01T06:53:53.753 DEBUG:teuthology.orchestra.run.smithi089:> if "*" not in asok_path: 2024-08-01T06:53:53.754 DEBUG:teuthology.orchestra.run.smithi089:> assert(len(files) == 1) 2024-08-01T06:53:53.754 DEBUG:teuthology.orchestra.run.smithi089:> return files[0] 2024-08-01T06:53:53.754 DEBUG:teuthology.orchestra.run.smithi089:> 2024-08-01T06:53:53.754 DEBUG:teuthology.orchestra.run.smithi089:> for f in files: 2024-08-01T06:53:53.754 DEBUG:teuthology.orchestra.run.smithi089:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-01T06:53:53.754 DEBUG:teuthology.orchestra.run.smithi089:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-01T06:53:53.754 DEBUG:teuthology.orchestra.run.smithi089:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-01T06:53:53.754 DEBUG:teuthology.orchestra.run.smithi089:> contents = proc_f.read() 2024-08-01T06:53:53.754 DEBUG:teuthology.orchestra.run.smithi089:> if mountpoint in contents: 2024-08-01T06:53:53.754 DEBUG:teuthology.orchestra.run.smithi089:> return f 2024-08-01T06:53:53.754 DEBUG:teuthology.orchestra.run.smithi089:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-01T06:53:53.754 DEBUG:teuthology.orchestra.run.smithi089:> 2024-08-01T06:53:53.754 DEBUG:teuthology.orchestra.run.smithi089:> print(_find_admin_socket("client.1")) 2024-08-01T06:53:53.754 DEBUG:teuthology.orchestra.run.smithi089:> ' 2024-08-01T06:53:53.869 INFO:teuthology.orchestra.run.smithi089.stdout:/var/run/ceph/ceph-client.1.61922.asok 2024-08-01T06:53:53.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-01T06:53:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-01T06:53:53.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:53 smithi089 ceph-mon[36617]: pgmap v194: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-01T06:53:53.879 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.61922.asok 2024-08-01T06:53:53.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:53.880 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.61922.asok status 2024-08-01T06:53:53.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:53 smithi016 ceph-mon[29266]: pgmap v194: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-01T06:53:54.015 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-01T06:53:54.015 INFO:teuthology.orchestra.run.smithi089.stdout: "metadata": { 2024-08-01T06:53:54.016 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_sha1": "a3bbd7289877bdcce87fd1f79da1a2d6578dde36", 2024-08-01T06:53:54.016 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_version": "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)", 2024-08-01T06:53:54.016 INFO:teuthology.orchestra.run.smithi089.stdout: "entity_id": "1", 2024-08-01T06:53:54.016 INFO:teuthology.orchestra.run.smithi089.stdout: "hostname": "smithi089", 2024-08-01T06:53:54.016 INFO:teuthology.orchestra.run.smithi089.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-08-01T06:53:54.016 INFO:teuthology.orchestra.run.smithi089.stdout: "pid": "61922", 2024-08-01T06:53:54.016 INFO:teuthology.orchestra.run.smithi089.stdout: "root": "/" 2024-08-01T06:53:54.016 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-01T06:53:54.016 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_count": 0, 2024-08-01T06:53:54.016 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_pinned_count": 0, 2024-08-01T06:53:54.016 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 24325, 2024-08-01T06:53:54.016 INFO:teuthology.orchestra.run.smithi089.stdout: "inst": { 2024-08-01T06:53:54.017 INFO:teuthology.orchestra.run.smithi089.stdout: "name": { 2024-08-01T06:53:54.017 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "client", 2024-08-01T06:53:54.017 INFO:teuthology.orchestra.run.smithi089.stdout: "num": 24325 2024-08-01T06:53:54.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-01T06:53:54.017 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2024-08-01T06:53:54.017 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-08-01T06:53:54.017 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "192.168.0.1:0", 2024-08-01T06:53:54.017 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1592227876 2024-08-01T06:53:54.017 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-01T06:53:54.017 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-01T06:53:54.017 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2024-08-01T06:53:54.017 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-08-01T06:53:54.017 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "192.168.0.1:0", 2024-08-01T06:53:54.017 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1592227876 2024-08-01T06:53:54.018 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-01T06:53:54.018 INFO:teuthology.orchestra.run.smithi089.stdout: "inst_str": "client.24325 192.168.0.1:0/1592227876", 2024-08-01T06:53:54.018 INFO:teuthology.orchestra.run.smithi089.stdout: "addr_str": "192.168.0.1:0/1592227876", 2024-08-01T06:53:54.018 INFO:teuthology.orchestra.run.smithi089.stdout: "inode_count": 1, 2024-08-01T06:53:54.018 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_epoch": 19, 2024-08-01T06:53:54.018 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch": 46, 2024-08-01T06:53:54.018 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch_barrier": 0, 2024-08-01T06:53:54.018 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklisted": false, 2024-08-01T06:53:54.018 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs" 2024-08-01T06:53:54.018 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-01T06:53:54.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:54.024 DEBUG:teuthology.orchestra.run.smithi016:> stat --file-system '--printf=%T 2024-08-01T06:53:54.024 DEBUG:teuthology.orchestra.run.smithi016:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-01T06:53:54.045 INFO:teuthology.orchestra.run.smithi016.stdout:fuseblk 2024-08-01T06:53:54.046 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-01T06:53:54.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:54.046 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-01T06:53:54.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:54.123 DEBUG:teuthology.orchestra.run.smithi089:> stat --file-system '--printf=%T 2024-08-01T06:53:54.123 DEBUG:teuthology.orchestra.run.smithi089:> ' -- /home/ubuntu/cephtest/mnt.1 2024-08-01T06:53:54.139 INFO:teuthology.orchestra.run.smithi089.stdout:fuseblk 2024-08-01T06:53:54.140 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-08-01T06:53:54.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T06:53:54.140 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-01T06:53:54.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:54 smithi089 ceph-mon[36617]: pgmap v195: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-08-01T06:53:54.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:54 smithi016 ceph-mon[29266]: pgmap v195: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-08-01T06:53:57.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:56 smithi089 ceph-mon[36617]: pgmap v196: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-08-01T06:53:57.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:56 smithi016 ceph-mon[29266]: pgmap v196: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-08-01T06:53:59.060 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:53:58 smithi089 ceph-mon[36617]: pgmap v197: 65 pgs: 65 active+clean; 582 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-01T06:53:59.061 INFO:teuthology.run_tasks:Running task print... 2024-08-01T06:53:59.072 INFO:teuthology.task.print:**** done client 2024-08-01T06:53:59.072 INFO:teuthology.run_tasks:Running task parallel... 2024-08-01T06:53:59.158 INFO:teuthology.task.parallel:starting parallel... 2024-08-01T06:53:59.158 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-08-01T06:53:59.159 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-08-01T06:53:59.159 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi016.front.sepia.ceph.com 2024-08-01T06:53:59.160 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -e sha1=f9911e17b12222fbe598fff73cd3ad10d20c5776 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-08-01T06:53:59.160 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-08-01T06:53:59.160 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-08-01T06:53:59.164 INFO:tasks.workunit:Pulling workunits from ref d99c9769be1521395979e8c23d9073adbf1ff43f 2024-08-01T06:53:59.165 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-01T06:53:59.165 INFO:tasks.workunit:timeout=3h 2024-08-01T06:53:59.165 INFO:tasks.workunit:cleanup=True 2024-08-01T06:53:59.165 DEBUG:teuthology.orchestra.run.smithi016:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-01T06:53:59.166 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:53:58 smithi016 ceph-mon[29266]: pgmap v197: 65 pgs: 65 active+clean; 582 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-01T06:53:59.187 INFO:teuthology.orchestra.run.smithi016.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-08-01T06:53:59.188 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-08-01T06:53:59.188 INFO:teuthology.orchestra.run.smithi016.stdout:Device: a4h/164d Inode: 1 Links: 2 2024-08-01T06:53:59.188 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-01T06:53:59.188 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:fusefs_t:s0 2024-08-01T06:53:59.188 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-08-01T06:53:59.188 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-08-01 06:53:18.581126775 +0000 2024-08-01T06:53:59.188 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-08-01 06:53:54.118895420 +0000 2024-08-01T06:53:59.188 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2024-08-01T06:53:59.188 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-08-01T06:53:59.189 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-08-01T06:53:59.262 DEBUG:teuthology.orchestra.run.smithi089:> stat -- /home/ubuntu/cephtest/mnt.1 2024-08-01T06:53:59.283 INFO:teuthology.orchestra.run.smithi089.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-08-01T06:53:59.283 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-08-01T06:53:59.283 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 80h/128d Inode: 1 Links: 3 2024-08-01T06:53:59.283 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-01T06:53:59.283 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:fusefs_t:s0 2024-08-01T06:53:59.283 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-08-01T06:53:59.283 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-08-01 06:53:59.255272028 +0000 2024-08-01T06:53:59.283 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-08-01 06:53:59.255272028 +0000 2024-08-01T06:53:59.283 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2024-08-01T06:53:59.283 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-08-01T06:53:59.284 DEBUG:teuthology.orchestra.run.smithi089:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-08-01T06:53:59.360 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d99c9769be1521395979e8c23d9073adbf1ff43f 2024-08-01T06:53:59.360 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout d99c9769be1521395979e8c23d9073adbf1ff43f 2024-08-01T06:53:59.378 INFO:tasks.workunit.client.0.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-01T06:53:59.396 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:53:59.419 INFO:tasks.workunit.client.1.smithi089.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-08-01T06:54:00.780 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:00 smithi016 ceph-mon[29266]: pgmap v198: 65 pgs: 65 active+clean; 582 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-08-01T06:54:00.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:00 smithi089 ceph-mon[36617]: pgmap v198: 65 pgs: 65 active+clean; 582 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-08-01T06:54:00.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.975+0000 7fc175964640 1 -- 172.21.15.16:0/1695855481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1700ffb80 msgr2=0x7fc1700fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:00.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.975+0000 7fc175964640 1 --2- 172.21.15.16:0/1695855481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1700ffb80 0x7fc1700fff80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc160009880 tx=0x7fc16002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:54:00.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.975+0000 7fc175964640 1 -- 172.21.15.16:0/1695855481 shutdown_connections 2024-08-01T06:54:00.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.975+0000 7fc175964640 1 --2- 172.21.15.16:0/1695855481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc170100d80 0x7fc170101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:00.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.975+0000 7fc175964640 1 --2- 172.21.15.16:0/1695855481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1700ffb80 0x7fc1700fff80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:00.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.975+0000 7fc175964640 1 -- 172.21.15.16:0/1695855481 >> 172.21.15.16:0/1695855481 conn(0x7fc1700fb330 msgr2=0x7fc1700fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:00.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.975+0000 7fc175964640 1 -- 172.21.15.16:0/1695855481 shutdown_connections 2024-08-01T06:54:00.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.975+0000 7fc175964640 1 -- 172.21.15.16:0/1695855481 wait complete. 2024-08-01T06:54:00.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.975+0000 7fc175964640 1 Processor -- start 2024-08-01T06:54:00.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.976+0000 7fc175964640 1 -- start start 2024-08-01T06:54:00.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.976+0000 7fc175964640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1700ffb80 0x7fc170074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:00.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.976+0000 7fc175964640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc170100d80 0x7fc1700728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:00.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.976+0000 7fc175964640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc170072de0 con 0x7fc170100d80 2024-08-01T06:54:00.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.976+0000 7fc175964640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc170072f50 con 0x7fc1700ffb80 2024-08-01T06:54:00.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.976+0000 7fc16e7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc170100d80 0x7fc1700728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:00.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.976+0000 7fc16e7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc170100d80 0x7fc1700728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49234/0 (socket says 172.21.15.16:49234) 2024-08-01T06:54:00.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.976+0000 7fc16e7fc640 1 -- 172.21.15.16:0/1729925870 learned_addr learned my addr 172.21.15.16:0/1729925870 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:54:00.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.976+0000 7fc16effd640 1 --2- 172.21.15.16:0/1729925870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1700ffb80 0x7fc170074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:00.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.976+0000 7fc16e7fc640 1 -- 172.21.15.16:0/1729925870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1700ffb80 msgr2=0x7fc170074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:00.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.976+0000 7fc16e7fc640 1 --2- 172.21.15.16:0/1729925870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1700ffb80 0x7fc170074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:00.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.976+0000 7fc16e7fc640 1 -- 172.21.15.16:0/1729925870 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc160009560 con 0x7fc170100d80 2024-08-01T06:54:00.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.976+0000 7fc16effd640 1 --2- 172.21.15.16:0/1729925870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1700ffb80 0x7fc170074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T06:54:00.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.977+0000 7fc16e7fc640 1 --2- 172.21.15.16:0/1729925870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc170100d80 0x7fc1700728a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc16400c8f0 tx=0x7fc16400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:00.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.977+0000 7fc174962640 1 -- 172.21.15.16:0/1729925870 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc164007b80 con 0x7fc170100d80 2024-08-01T06:54:00.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.977+0000 7fc175964640 1 -- 172.21.15.16:0/1729925870 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc170073230 con 0x7fc170100d80 2024-08-01T06:54:00.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.977+0000 7fc174962640 1 -- 172.21.15.16:0/1729925870 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1640054e0 con 0x7fc170100d80 2024-08-01T06:54:00.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.977+0000 7fc174962640 1 -- 172.21.15.16:0/1729925870 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc16400f450 con 0x7fc170100d80 2024-08-01T06:54:00.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.977+0000 7fc175964640 1 -- 172.21.15.16:0/1729925870 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17019d690 con 0x7fc170100d80 2024-08-01T06:54:00.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.978+0000 7fc175964640 1 -- 172.21.15.16:0/1729925870 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1700fff80 con 0x7fc170100d80 2024-08-01T06:54:00.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.978+0000 7fc174962640 1 -- 172.21.15.16:0/1729925870 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc164004f60 con 0x7fc170100d80 2024-08-01T06:54:00.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.979+0000 7fc174962640 1 --2- 172.21.15.16:0/1729925870 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc15806cc50 0x7fc15806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:00.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.979+0000 7fc174962640 1 -- 172.21.15.16:0/1729925870 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc16408c110 con 0x7fc170100d80 2024-08-01T06:54:00.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.979+0000 7fc16effd640 1 --2- 172.21.15.16:0/1729925870 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc15806cc50 0x7fc15806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:00.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.979+0000 7fc16effd640 1 --2- 172.21.15.16:0/1729925870 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc15806cc50 0x7fc15806f110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc160009230 tx=0x7fc1600314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:00.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:00.983+0000 7fc174962640 1 -- 172.21.15.16:0/1729925870 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fc164056480 con 0x7fc170100d80 2024-08-01T06:54:01.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:01.164+0000 7fc175964640 1 -- 172.21.15.16:0/1729925870 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7fc1701089c0 con 0x7fc170100d80 2024-08-01T06:54:01.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:01.169+0000 7fc174962640 1 -- 172.21.15.16:0/1729925870 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v26)=0 v26) v1 ==== 126+0+0 (secure 0 0 0) 0x7fc164059aa0 con 0x7fc170100d80 2024-08-01T06:54:01.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:01.172+0000 7fc175964640 1 -- 172.21.15.16:0/1729925870 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc15806cc50 msgr2=0x7fc15806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:01.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:01.172+0000 7fc175964640 1 --2- 172.21.15.16:0/1729925870 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc15806cc50 0x7fc15806f110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc160009230 tx=0x7fc1600314e0 comp rx=0 tx=0).stop 2024-08-01T06:54:01.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:01.172+0000 7fc175964640 1 -- 172.21.15.16:0/1729925870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc170100d80 msgr2=0x7fc1700728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:01.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:01.172+0000 7fc175964640 1 --2- 172.21.15.16:0/1729925870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc170100d80 0x7fc1700728a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc16400c8f0 tx=0x7fc16400cdb0 comp rx=0 tx=0).stop 2024-08-01T06:54:01.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:01.172+0000 7fc175964640 1 -- 172.21.15.16:0/1729925870 shutdown_connections 2024-08-01T06:54:01.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:01.172+0000 7fc175964640 1 --2- 172.21.15.16:0/1729925870 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc15806cc50 0x7fc15806f110 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:01.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:01.172+0000 7fc175964640 1 --2- 172.21.15.16:0/1729925870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc170100d80 0x7fc1700728a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:01.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:01.172+0000 7fc175964640 1 --2- 172.21.15.16:0/1729925870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1700ffb80 0x7fc170074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:01.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:01.172+0000 7fc175964640 1 -- 172.21.15.16:0/1729925870 >> 172.21.15.16:0/1729925870 conn(0x7fc1700fb330 msgr2=0x7fc1701044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:01.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:01.172+0000 7fc175964640 1 -- 172.21.15.16:0/1729925870 shutdown_connections 2024-08-01T06:54:01.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:01.172+0000 7fc175964640 1 -- 172.21.15.16:0/1729925870 wait complete. 2024-08-01T06:54:01.850 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-08-01T06:54:01.851 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi016.front.sepia.ceph.com 2024-08-01T06:54:01.851 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -e sha1=f9911e17b12222fbe598fff73cd3ad10d20c5776 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-08-01T06:54:02.114 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:54:02.455 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:02 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/1729925870' entity='client.admin' 2024-08-01T06:54:02.455 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:02 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:54:02.455 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:02 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:54:02.455 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:02 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:54:02.455 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:02 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:54:02.567 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:02 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/1729925870' entity='client.admin' 2024-08-01T06:54:02.567 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:02 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:54:02.567 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:02 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:54:02.567 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:02 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:54:02.567 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:02 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:54:03.442 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:03 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:54:03.442 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:03 smithi089 ceph-mon[36617]: pgmap v199: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-08-01T06:54:03.482 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:03 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:54:03.482 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:03 smithi016 ceph-mon[29266]: pgmap v199: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-08-01T06:54:03.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.711+0000 7fcaaea22640 1 -- 172.21.15.16:0/3538458079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcaa80ffcf0 msgr2=0x7fcaa8100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:03.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.711+0000 7fcaaea22640 1 --2- 172.21.15.16:0/3538458079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcaa80ffcf0 0x7fcaa8100170 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009880 tx=0x7fca9c02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:54:03.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.712+0000 7fcaaea22640 1 -- 172.21.15.16:0/3538458079 shutdown_connections 2024-08-01T06:54:03.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.712+0000 7fcaaea22640 1 --2- 172.21.15.16:0/3538458079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcaa80ffcf0 0x7fcaa8100170 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:03.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.712+0000 7fcaaea22640 1 --2- 172.21.15.16:0/3538458079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcaa80feaf0 0x7fcaa80feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.712+0000 7fcaaea22640 1 -- 172.21.15.16:0/3538458079 >> 172.21.15.16:0/3538458079 conn(0x7fcaa80fa280 msgr2=0x7fcaa80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.712+0000 7fcaaea22640 1 -- 172.21.15.16:0/3538458079 shutdown_connections 2024-08-01T06:54:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.712+0000 7fcaaea22640 1 -- 172.21.15.16:0/3538458079 wait complete. 2024-08-01T06:54:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.712+0000 7fcaaea22640 1 Processor -- start 2024-08-01T06:54:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.712+0000 7fcaaea22640 1 -- start start 2024-08-01T06:54:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.713+0000 7fcaaea22640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcaa80feaf0 0x7fcaa8068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.713+0000 7fcaaea22640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcaa80ffcf0 0x7fcaa819c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.713+0000 7fcaaea22640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa81961e0 con 0x7fcaa80feaf0 2024-08-01T06:54:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.713+0000 7fcaaea22640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa819cd40 con 0x7fcaa80ffcf0 2024-08-01T06:54:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.713+0000 7fcaa7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcaa80feaf0 0x7fcaa8068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.713+0000 7fcaa7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcaa80feaf0 0x7fcaa8068740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49260/0 (socket says 172.21.15.16:49260) 2024-08-01T06:54:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.713+0000 7fcaa7fff640 1 -- 172.21.15.16:0/3842169233 learned_addr learned my addr 172.21.15.16:0/3842169233 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:54:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.713+0000 7fcaa77fe640 1 --2- 172.21.15.16:0/3842169233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcaa80ffcf0 0x7fcaa819c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:03.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.713+0000 7fcaa7fff640 1 -- 172.21.15.16:0/3842169233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcaa80ffcf0 msgr2=0x7fcaa819c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:03.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.713+0000 7fcaa7fff640 1 --2- 172.21.15.16:0/3842169233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcaa80ffcf0 0x7fcaa819c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:03.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.713+0000 7fcaa7fff640 1 -- 172.21.15.16:0/3842169233 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c009560 con 0x7fcaa80feaf0 2024-08-01T06:54:03.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.713+0000 7fcaa7fff640 1 --2- 172.21.15.16:0/3842169233 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcaa80feaf0 0x7fcaa8068740 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fca9800c920 tx=0x7fca9800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:03.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.713+0000 7fcaa57fa640 1 -- 172.21.15.16:0/3842169233 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca98007be0 con 0x7fcaa80feaf0 2024-08-01T06:54:03.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.713+0000 7fcaa57fa640 1 -- 172.21.15.16:0/3842169233 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca98007d40 con 0x7fcaa80feaf0 2024-08-01T06:54:03.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.713+0000 7fcaaea22640 1 -- 172.21.15.16:0/3842169233 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa819cf40 con 0x7fcaa80feaf0 2024-08-01T06:54:03.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.713+0000 7fcaa57fa640 1 -- 172.21.15.16:0/3842169233 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca9800f450 con 0x7fcaa80feaf0 2024-08-01T06:54:03.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.713+0000 7fcaaea22640 1 -- 172.21.15.16:0/3842169233 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa819d400 con 0x7fcaa80feaf0 2024-08-01T06:54:03.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.714+0000 7fcaaea22640 1 -- 172.21.15.16:0/3842169233 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa80feef0 con 0x7fcaa80feaf0 2024-08-01T06:54:03.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.715+0000 7fcaa57fa640 1 -- 172.21.15.16:0/3842169233 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fca98003fa0 con 0x7fcaa80feaf0 2024-08-01T06:54:03.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.715+0000 7fcaa57fa640 1 --2- 172.21.15.16:0/3842169233 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fca9006cc50 0x7fca9006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:03.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.716+0000 7fcaa57fa640 1 -- 172.21.15.16:0/3842169233 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fca98013070 con 0x7fcaa80feaf0 2024-08-01T06:54:03.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.716+0000 7fcaa77fe640 1 --2- 172.21.15.16:0/3842169233 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fca9006cc50 0x7fca9006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:03.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.716+0000 7fcaa77fe640 1 --2- 172.21.15.16:0/3842169233 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fca9006cc50 0x7fca9006f110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fca9c000c00 tx=0x7fca9c0314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:03.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.720+0000 7fcaa57fa640 1 -- 172.21.15.16:0/3842169233 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fca98056600 con 0x7fcaa80feaf0 2024-08-01T06:54:03.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.894+0000 7fcaaea22640 1 -- 172.21.15.16:0/3842169233 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fcaa818e670 con 0x7fcaa80feaf0 2024-08-01T06:54:03.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.895+0000 7fcaa57fa640 1 -- 172.21.15.16:0/3842169233 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v26)=0 v26) v1 ==== 155+0+0 (secure 0 0 0) 0x7fca98059c20 con 0x7fcaa80feaf0 2024-08-01T06:54:03.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.897+0000 7fcaaea22640 1 -- 172.21.15.16:0/3842169233 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fca9006cc50 msgr2=0x7fca9006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:03.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.897+0000 7fcaaea22640 1 --2- 172.21.15.16:0/3842169233 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fca9006cc50 0x7fca9006f110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fca9c000c00 tx=0x7fca9c0314e0 comp rx=0 tx=0).stop 2024-08-01T06:54:03.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.897+0000 7fcaaea22640 1 -- 172.21.15.16:0/3842169233 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcaa80feaf0 msgr2=0x7fcaa8068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:03.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.897+0000 7fcaaea22640 1 --2- 172.21.15.16:0/3842169233 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcaa80feaf0 0x7fcaa8068740 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fca9800c920 tx=0x7fca9800cde0 comp rx=0 tx=0).stop 2024-08-01T06:54:03.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.897+0000 7fcaaea22640 1 -- 172.21.15.16:0/3842169233 shutdown_connections 2024-08-01T06:54:03.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.897+0000 7fcaaea22640 1 --2- 172.21.15.16:0/3842169233 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fca9006cc50 0x7fca9006f110 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:03.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.897+0000 7fcaaea22640 1 --2- 172.21.15.16:0/3842169233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcaa80ffcf0 0x7fcaa819c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:03.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.897+0000 7fcaaea22640 1 --2- 172.21.15.16:0/3842169233 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcaa80feaf0 0x7fcaa8068740 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:03.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.897+0000 7fcaaea22640 1 -- 172.21.15.16:0/3842169233 >> 172.21.15.16:0/3842169233 conn(0x7fcaa80fa280 msgr2=0x7fcaa8103400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:03.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.897+0000 7fcaaea22640 1 -- 172.21.15.16:0/3842169233 shutdown_connections 2024-08-01T06:54:03.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:03.897+0000 7fcaaea22640 1 -- 172.21.15.16:0/3842169233 wait complete. 2024-08-01T06:54:04.639 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -e sha1=f9911e17b12222fbe598fff73cd3ad10d20c5776 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-08-01T06:54:04.859 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:54:04.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:04 smithi016 ceph-mon[29266]: pgmap v200: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 853 B/s wr, 4 op/s 2024-08-01T06:54:05.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:04 smithi089 ceph-mon[36617]: pgmap v200: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 853 B/s wr, 4 op/s 2024-08-01T06:54:06.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.476+0000 7f04aa69f640 1 -- 172.21.15.16:0/2785584314 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a4100680 msgr2=0x7f04a4102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:06.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.476+0000 7f04aa69f640 1 --2- 172.21.15.16:0/2785584314 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a4100680 0x7f04a4102a70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f04940098b0 tx=0x7f049402a4d0 comp rx=0 tx=0).stop 2024-08-01T06:54:06.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.476+0000 7f04aa69f640 1 -- 172.21.15.16:0/2785584314 shutdown_connections 2024-08-01T06:54:06.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.476+0000 7f04aa69f640 1 --2- 172.21.15.16:0/2785584314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04a4102fb0 0x7f04a41053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:06.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.476+0000 7f04aa69f640 1 --2- 172.21.15.16:0/2785584314 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a4100680 0x7f04a4102a70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:06.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.476+0000 7f04aa69f640 1 -- 172.21.15.16:0/2785584314 >> 172.21.15.16:0/2785584314 conn(0x7f04a40fa280 msgr2=0x7f04a40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:06.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.476+0000 7f04aa69f640 1 -- 172.21.15.16:0/2785584314 shutdown_connections 2024-08-01T06:54:06.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.476+0000 7f04aa69f640 1 -- 172.21.15.16:0/2785584314 wait complete. 2024-08-01T06:54:06.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.476+0000 7f04aa69f640 1 Processor -- start 2024-08-01T06:54:06.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.476+0000 7f04aa69f640 1 -- start start 2024-08-01T06:54:06.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.477+0000 7f04aa69f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04a4100680 0x7f04a4195730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:06.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.477+0000 7f04aa69f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a4102fb0 0x7f04a4195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:06.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.477+0000 7f04aa69f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a4196240 con 0x7f04a4102fb0 2024-08-01T06:54:06.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.477+0000 7f04aa69f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a41963b0 con 0x7f04a4100680 2024-08-01T06:54:06.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.477+0000 7f049bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a4102fb0 0x7f04a4195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:06.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.477+0000 7f049bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a4102fb0 0x7f04a4195c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49278/0 (socket says 172.21.15.16:49278) 2024-08-01T06:54:06.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.477+0000 7f049bfff640 1 -- 172.21.15.16:0/3800492141 learned_addr learned my addr 172.21.15.16:0/3800492141 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:54:06.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.477+0000 7f04a3fff640 1 --2- 172.21.15.16:0/3800492141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04a4100680 0x7f04a4195730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:06.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.477+0000 7f049bfff640 1 -- 172.21.15.16:0/3800492141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04a4100680 msgr2=0x7f04a4195730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:06.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.477+0000 7f049bfff640 1 --2- 172.21.15.16:0/3800492141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04a4100680 0x7f04a4195730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:06.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.477+0000 7f049bfff640 1 -- 172.21.15.16:0/3800492141 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0494009560 con 0x7f04a4102fb0 2024-08-01T06:54:06.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.477+0000 7f049bfff640 1 --2- 172.21.15.16:0/3800492141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a4102fb0 0x7f04a4195c70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f048c00b400 tx=0x7f048c00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:06.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.477+0000 7f04a1ffb640 1 -- 172.21.15.16:0/3800492141 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f048c011800 con 0x7f04a4102fb0 2024-08-01T06:54:06.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.477+0000 7f04a1ffb640 1 -- 172.21.15.16:0/3800492141 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f048c011e20 con 0x7f04a4102fb0 2024-08-01T06:54:06.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.477+0000 7f04a1ffb640 1 -- 172.21.15.16:0/3800492141 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f048c00f2e0 con 0x7f04a4102fb0 2024-08-01T06:54:06.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.477+0000 7f04aa69f640 1 -- 172.21.15.16:0/3800492141 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a419ae50 con 0x7f04a4102fb0 2024-08-01T06:54:06.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.478+0000 7f04aa69f640 1 -- 172.21.15.16:0/3800492141 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a419b3f0 con 0x7f04a4102fb0 2024-08-01T06:54:06.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.479+0000 7f04aa69f640 1 -- 172.21.15.16:0/3800492141 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a4100a60 con 0x7f04a4102fb0 2024-08-01T06:54:06.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.479+0000 7f04a1ffb640 1 -- 172.21.15.16:0/3800492141 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f048c010380 con 0x7f04a4102fb0 2024-08-01T06:54:06.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.480+0000 7f04a1ffb640 1 --2- 172.21.15.16:0/3800492141 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f049006cc50 0x7f049006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:06.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.480+0000 7f04a1ffb640 1 -- 172.21.15.16:0/3800492141 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f048c08bdf0 con 0x7f04a4102fb0 2024-08-01T06:54:06.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.480+0000 7f04a3fff640 1 --2- 172.21.15.16:0/3800492141 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f049006cc50 0x7f049006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:06.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.480+0000 7f04a3fff640 1 --2- 172.21.15.16:0/3800492141 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f049006cc50 0x7f049006f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0494006010 tx=0x7f04940314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:06.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.484+0000 7f04a1ffb640 1 -- 172.21.15.16:0/3800492141 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f048c0561e0 con 0x7f04a4102fb0 2024-08-01T06:54:06.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.659+0000 7f04aa69f640 1 -- 172.21.15.16:0/3800492141 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f04a4108880 con 0x7f04a4102fb0 2024-08-01T06:54:06.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.659+0000 7f04a1ffb640 1 -- 172.21.15.16:0/3800492141 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v26)=0 v26) v1 ==== 163+0+0 (secure 0 0 0) 0x7f048c059800 con 0x7f04a4102fb0 2024-08-01T06:54:06.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.661+0000 7f04aa69f640 1 -- 172.21.15.16:0/3800492141 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f049006cc50 msgr2=0x7f049006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:06.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.661+0000 7f04aa69f640 1 --2- 172.21.15.16:0/3800492141 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f049006cc50 0x7f049006f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0494006010 tx=0x7f04940314e0 comp rx=0 tx=0).stop 2024-08-01T06:54:06.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.661+0000 7f04aa69f640 1 -- 172.21.15.16:0/3800492141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a4102fb0 msgr2=0x7f04a4195c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:06.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.661+0000 7f04aa69f640 1 --2- 172.21.15.16:0/3800492141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a4102fb0 0x7f04a4195c70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f048c00b400 tx=0x7f048c00b8c0 comp rx=0 tx=0).stop 2024-08-01T06:54:06.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.661+0000 7f04aa69f640 1 -- 172.21.15.16:0/3800492141 shutdown_connections 2024-08-01T06:54:06.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.661+0000 7f04aa69f640 1 --2- 172.21.15.16:0/3800492141 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f049006cc50 0x7f049006f110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:06.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.661+0000 7f04aa69f640 1 --2- 172.21.15.16:0/3800492141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a4102fb0 0x7f04a4195c70 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:06.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.661+0000 7f04aa69f640 1 --2- 172.21.15.16:0/3800492141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04a4100680 0x7f04a4195730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:06.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.661+0000 7f04aa69f640 1 -- 172.21.15.16:0/3800492141 >> 172.21.15.16:0/3800492141 conn(0x7f04a40fa280 msgr2=0x7f04a40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:06.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.661+0000 7f04aa69f640 1 -- 172.21.15.16:0/3800492141 shutdown_connections 2024-08-01T06:54:06.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:06.661+0000 7f04aa69f640 1 -- 172.21.15.16:0/3800492141 wait complete. 2024-08-01T06:54:06.998 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:06 smithi016 ceph-mon[29266]: pgmap v201: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-08-01T06:54:07.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:06 smithi089 ceph-mon[36617]: pgmap v201: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-08-01T06:54:07.387 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -e sha1=f9911e17b12222fbe598fff73cd3ad10d20c5776 -- bash -c 'ceph config set global log_to_journald false --force' 2024-08-01T06:54:07.609 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:54:08.835 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:08 smithi016 ceph-mon[29266]: pgmap v202: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 853 B/s wr, 6 op/s 2024-08-01T06:54:08.939 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:08 smithi089 ceph-mon[36617]: pgmap v202: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 853 B/s wr, 6 op/s 2024-08-01T06:54:09.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.317+0000 7fae5cda5640 1 -- 172.21.15.16:0/408762859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae580ffcf0 msgr2=0x7fae58100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:09.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.317+0000 7fae5cda5640 1 --2- 172.21.15.16:0/408762859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae580ffcf0 0x7fae58100170 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009880 tx=0x7fae4c02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:54:09.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.317+0000 7fae5cda5640 1 -- 172.21.15.16:0/408762859 shutdown_connections 2024-08-01T06:54:09.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.317+0000 7fae5cda5640 1 --2- 172.21.15.16:0/408762859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae580ffcf0 0x7fae58100170 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:09.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.317+0000 7fae5cda5640 1 --2- 172.21.15.16:0/408762859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae580feaf0 0x7fae580feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:09.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.317+0000 7fae5cda5640 1 -- 172.21.15.16:0/408762859 >> 172.21.15.16:0/408762859 conn(0x7fae580fa280 msgr2=0x7fae580fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:09.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.317+0000 7fae5cda5640 1 -- 172.21.15.16:0/408762859 shutdown_connections 2024-08-01T06:54:09.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.317+0000 7fae5cda5640 1 -- 172.21.15.16:0/408762859 wait complete. 2024-08-01T06:54:09.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.318+0000 7fae5cda5640 1 Processor -- start 2024-08-01T06:54:09.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.318+0000 7fae5cda5640 1 -- start start 2024-08-01T06:54:09.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.318+0000 7fae5cda5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae580feaf0 0x7fae581978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:09.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.318+0000 7fae5cda5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae580ffcf0 0x7fae58197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:09.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.318+0000 7fae5cda5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae581983c0 con 0x7fae580ffcf0 2024-08-01T06:54:09.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.318+0000 7fae5cda5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae58198530 con 0x7fae580feaf0 2024-08-01T06:54:09.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.318+0000 7fae55d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae580ffcf0 0x7fae58197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:09.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.318+0000 7fae55d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae580ffcf0 0x7fae58197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50988/0 (socket says 172.21.15.16:50988) 2024-08-01T06:54:09.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.318+0000 7fae55d9b640 1 -- 172.21.15.16:0/2143255956 learned_addr learned my addr 172.21.15.16:0/2143255956 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:54:09.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.318+0000 7fae5659c640 1 --2- 172.21.15.16:0/2143255956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae580feaf0 0x7fae581978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:09.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.319+0000 7fae55d9b640 1 -- 172.21.15.16:0/2143255956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae580feaf0 msgr2=0x7fae581978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:09.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.319+0000 7fae55d9b640 1 --2- 172.21.15.16:0/2143255956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae580feaf0 0x7fae581978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:09.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.319+0000 7fae55d9b640 1 -- 172.21.15.16:0/2143255956 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c009560 con 0x7fae580ffcf0 2024-08-01T06:54:09.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.319+0000 7fae55d9b640 1 --2- 172.21.15.16:0/2143255956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae580ffcf0 0x7fae58197df0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fae4c005520 tx=0x7fae4c005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:09.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.319+0000 7fae477fe640 1 -- 172.21.15.16:0/2143255956 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae4c004aa0 con 0x7fae580ffcf0 2024-08-01T06:54:09.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.319+0000 7fae5cda5640 1 -- 172.21.15.16:0/2143255956 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5819cf70 con 0x7fae580ffcf0 2024-08-01T06:54:09.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.319+0000 7fae477fe640 1 -- 172.21.15.16:0/2143255956 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae4c004c00 con 0x7fae580ffcf0 2024-08-01T06:54:09.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.319+0000 7fae477fe640 1 -- 172.21.15.16:0/2143255956 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae4c003b10 con 0x7fae580ffcf0 2024-08-01T06:54:09.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.319+0000 7fae5cda5640 1 -- 172.21.15.16:0/2143255956 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5819d430 con 0x7fae580ffcf0 2024-08-01T06:54:09.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.320+0000 7fae5cda5640 1 -- 172.21.15.16:0/2143255956 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae581076e0 con 0x7fae580ffcf0 2024-08-01T06:54:09.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.321+0000 7fae477fe640 1 -- 172.21.15.16:0/2143255956 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fae4c031d20 con 0x7fae580ffcf0 2024-08-01T06:54:09.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.321+0000 7fae477fe640 1 --2- 172.21.15.16:0/2143255956 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fae4006cc50 0x7fae4006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:09.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.321+0000 7fae477fe640 1 -- 172.21.15.16:0/2143255956 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fae4c0ad3e0 con 0x7fae580ffcf0 2024-08-01T06:54:09.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.321+0000 7fae5659c640 1 --2- 172.21.15.16:0/2143255956 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fae4006cc50 0x7fae4006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:09.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.322+0000 7fae5659c640 1 --2- 172.21.15.16:0/2143255956 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fae4006cc50 0x7fae4006f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fae580ffb50 tx=0x7fae4800b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:09.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.326+0000 7fae477fe640 1 -- 172.21.15.16:0/2143255956 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fae4c077800 con 0x7fae580ffcf0 2024-08-01T06:54:09.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.500+0000 7fae5cda5640 1 -- 172.21.15.16:0/2143255956 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fae5819d620 con 0x7fae580ffcf0 2024-08-01T06:54:09.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.500+0000 7fae477fe640 1 -- 172.21.15.16:0/2143255956 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v26)=0 v26) v1 ==== 135+0+0 (secure 0 0 0) 0x7fae4c07ae20 con 0x7fae580ffcf0 2024-08-01T06:54:09.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.502+0000 7fae5cda5640 1 -- 172.21.15.16:0/2143255956 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fae4006cc50 msgr2=0x7fae4006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:09.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.502+0000 7fae5cda5640 1 --2- 172.21.15.16:0/2143255956 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fae4006cc50 0x7fae4006f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fae580ffb50 tx=0x7fae4800b390 comp rx=0 tx=0).stop 2024-08-01T06:54:09.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.502+0000 7fae5cda5640 1 -- 172.21.15.16:0/2143255956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae580ffcf0 msgr2=0x7fae58197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:09.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.502+0000 7fae5cda5640 1 --2- 172.21.15.16:0/2143255956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae580ffcf0 0x7fae58197df0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fae4c005520 tx=0x7fae4c005550 comp rx=0 tx=0).stop 2024-08-01T06:54:09.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.502+0000 7fae5cda5640 1 -- 172.21.15.16:0/2143255956 shutdown_connections 2024-08-01T06:54:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.502+0000 7fae5cda5640 1 --2- 172.21.15.16:0/2143255956 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fae4006cc50 0x7fae4006f110 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.502+0000 7fae5cda5640 1 --2- 172.21.15.16:0/2143255956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae580ffcf0 0x7fae58197df0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.502+0000 7fae5cda5640 1 --2- 172.21.15.16:0/2143255956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae580feaf0 0x7fae581978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.502+0000 7fae5cda5640 1 -- 172.21.15.16:0/2143255956 >> 172.21.15.16:0/2143255956 conn(0x7fae580fa280 msgr2=0x7fae58067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.502+0000 7fae5cda5640 1 -- 172.21.15.16:0/2143255956 shutdown_connections 2024-08-01T06:54:09.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:09.502+0000 7fae5cda5640 1 -- 172.21.15.16:0/2143255956 wait complete. 2024-08-01T06:54:10.302 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -e sha1=f9911e17b12222fbe598fff73cd3ad10d20c5776 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-08-01T06:54:10.522 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:54:10.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:10 smithi016 ceph-mon[29266]: pgmap v203: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 597 B/s wr, 4 op/s 2024-08-01T06:54:11.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:10 smithi089 ceph-mon[36617]: pgmap v203: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 597 B/s wr, 4 op/s 2024-08-01T06:54:12.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.259+0000 7f69aa929640 1 -- 172.21.15.16:0/93180907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a40ffca0 msgr2=0x7f69a4100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:12.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.259+0000 7f69aa929640 1 --2- 172.21.15.16:0/93180907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a40ffca0 0x7f69a4100120 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f698c009880 tx=0x7f698c02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:54:12.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.259+0000 7f69aa929640 1 -- 172.21.15.16:0/93180907 shutdown_connections 2024-08-01T06:54:12.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.259+0000 7f69aa929640 1 --2- 172.21.15.16:0/93180907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a40ffca0 0x7f69a4100120 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:12.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.259+0000 7f69aa929640 1 --2- 172.21.15.16:0/93180907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69a40feaa0 0x7f69a40feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:12.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.259+0000 7f69aa929640 1 -- 172.21.15.16:0/93180907 >> 172.21.15.16:0/93180907 conn(0x7f69a40fa250 msgr2=0x7f69a40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:12.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.259+0000 7f69aa929640 1 -- 172.21.15.16:0/93180907 shutdown_connections 2024-08-01T06:54:12.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.259+0000 7f69aa929640 1 -- 172.21.15.16:0/93180907 wait complete. 2024-08-01T06:54:12.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.259+0000 7f69aa929640 1 Processor -- start 2024-08-01T06:54:12.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.260+0000 7f69aa929640 1 -- start start 2024-08-01T06:54:12.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.260+0000 7f69aa929640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a40feaa0 0x7f69a4194550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:12.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.260+0000 7f69aa929640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69a40ffca0 0x7f69a4194a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:12.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.260+0000 7f69aa929640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a4195060 con 0x7f69a40feaa0 2024-08-01T06:54:12.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.260+0000 7f69aa929640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a41951d0 con 0x7f69a40ffca0 2024-08-01T06:54:12.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.260+0000 7f69a3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a40feaa0 0x7f69a4194550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:12.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.260+0000 7f69a3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a40feaa0 0x7f69a4194550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50996/0 (socket says 172.21.15.16:50996) 2024-08-01T06:54:12.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.260+0000 7f69a3fff640 1 -- 172.21.15.16:0/3699101786 learned_addr learned my addr 172.21.15.16:0/3699101786 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:54:12.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.260+0000 7f699bfff640 1 --2- 172.21.15.16:0/3699101786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69a40ffca0 0x7f69a4194a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:12.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.260+0000 7f69a3fff640 1 -- 172.21.15.16:0/3699101786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69a40ffca0 msgr2=0x7f69a4194a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:12.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.260+0000 7f69a3fff640 1 --2- 172.21.15.16:0/3699101786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69a40ffca0 0x7f69a4194a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:12.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.260+0000 7f69a3fff640 1 -- 172.21.15.16:0/3699101786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698c009560 con 0x7f69a40feaa0 2024-08-01T06:54:12.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.260+0000 7f699bfff640 1 --2- 172.21.15.16:0/3699101786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69a40ffca0 0x7f69a4194a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-01T06:54:12.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.261+0000 7f69a3fff640 1 --2- 172.21.15.16:0/3699101786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a40feaa0 0x7f69a4194550 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f699400d720 tx=0x7f699400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:12.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.261+0000 7f69a1ffb640 1 -- 172.21.15.16:0/3699101786 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69940041f0 con 0x7f69a40feaa0 2024-08-01T06:54:12.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.261+0000 7f69a1ffb640 1 -- 172.21.15.16:0/3699101786 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6994004350 con 0x7f69a40feaa0 2024-08-01T06:54:12.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.261+0000 7f69aa929640 1 -- 172.21.15.16:0/3699101786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a4199c70 con 0x7f69a40feaa0 2024-08-01T06:54:12.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.261+0000 7f69a1ffb640 1 -- 172.21.15.16:0/3699101786 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6994003df0 con 0x7f69a40feaa0 2024-08-01T06:54:12.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.261+0000 7f69aa929640 1 -- 172.21.15.16:0/3699101786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a419a1c0 con 0x7f69a40feaa0 2024-08-01T06:54:12.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.262+0000 7f69aa929640 1 -- 172.21.15.16:0/3699101786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a418e620 con 0x7f69a40feaa0 2024-08-01T06:54:12.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.262+0000 7f69a1ffb640 1 -- 172.21.15.16:0/3699101786 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f69940035f0 con 0x7f69a40feaa0 2024-08-01T06:54:12.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.263+0000 7f69a1ffb640 1 --2- 172.21.15.16:0/3699101786 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f699006cbf0 0x7f699006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:12.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.263+0000 7f69a1ffb640 1 -- 172.21.15.16:0/3699101786 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f699408bdf0 con 0x7f69a40feaa0 2024-08-01T06:54:12.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.263+0000 7f699bfff640 1 --2- 172.21.15.16:0/3699101786 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f699006cbf0 0x7f699006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:12.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.263+0000 7f699bfff640 1 --2- 172.21.15.16:0/3699101786 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f699006cbf0 0x7f699006f0b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f698c000c00 tx=0x7f698c005d50 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.267+0000 7f69a1ffb640 1 -- 172.21.15.16:0/3699101786 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f69940560c0 con 0x7f69a40feaa0 2024-08-01T06:54:12.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.459+0000 7f69aa929640 1 -- 172.21.15.16:0/3699101786 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f9911e17b12222fbe598fff73cd3ad10d20c5776", "target": ["mon-mgr", ""]}) v1 -- 0x7f69a402c5e0 con 0x7f699006cbf0 2024-08-01T06:54:12.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.465+0000 7f69a1ffb640 1 -- 172.21.15.16:0/3699101786 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f69a402c5e0 con 0x7f699006cbf0 2024-08-01T06:54:12.467 INFO:teuthology.orchestra.run.smithi016.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f9911e17b12222fbe598fff73cd3ad10d20c5776 2024-08-01T06:54:12.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.467+0000 7f69aa929640 1 -- 172.21.15.16:0/3699101786 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f699006cbf0 msgr2=0x7f699006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:12.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.467+0000 7f69aa929640 1 --2- 172.21.15.16:0/3699101786 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f699006cbf0 0x7f699006f0b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f698c000c00 tx=0x7f698c005d50 comp rx=0 tx=0).stop 2024-08-01T06:54:12.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.467+0000 7f69aa929640 1 -- 172.21.15.16:0/3699101786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a40feaa0 msgr2=0x7f69a4194550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:12.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.467+0000 7f69aa929640 1 --2- 172.21.15.16:0/3699101786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a40feaa0 0x7f69a4194550 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f699400d720 tx=0x7f699400dbe0 comp rx=0 tx=0).stop 2024-08-01T06:54:12.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.467+0000 7f69aa929640 1 -- 172.21.15.16:0/3699101786 shutdown_connections 2024-08-01T06:54:12.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.467+0000 7f69aa929640 1 --2- 172.21.15.16:0/3699101786 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f699006cbf0 0x7f699006f0b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:12.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.467+0000 7f69aa929640 1 --2- 172.21.15.16:0/3699101786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69a40ffca0 0x7f69a4194a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:12.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.467+0000 7f69aa929640 1 --2- 172.21.15.16:0/3699101786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69a40feaa0 0x7f69a4194550 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:12.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.467+0000 7f69aa929640 1 -- 172.21.15.16:0/3699101786 >> 172.21.15.16:0/3699101786 conn(0x7f69a40fa250 msgr2=0x7f69a4103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:12.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.467+0000 7f69aa929640 1 -- 172.21.15.16:0/3699101786 shutdown_connections 2024-08-01T06:54:12.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:12.468+0000 7f69aa929640 1 -- 172.21.15.16:0/3699101786 wait complete. 2024-08-01T06:54:13.264 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-08-01T06:54:13.265 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi016.front.sepia.ceph.com 2024-08-01T06:54:13.265 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -e sha1=f9911e17b12222fbe598fff73cd3ad10d20c5776 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-08-01T06:54:13.491 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T06:54:13.615 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:13 smithi016 ceph-mon[29266]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f9911e17b12222fbe598fff73cd3ad10d20c5776", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:54:13.615 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:13 smithi016 ceph-mon[29266]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f9911e17b12222fbe598fff73cd3ad10d20c5776 2024-08-01T06:54:13.615 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:13 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:54:13.615 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:13 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:54:13.615 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:13 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:54:13.616 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:13 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:54:13.616 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:13 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:54:13.616 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:13 smithi016 ceph-mon[29266]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f9911e17b12222fbe598fff73cd3ad10d20c5776 2024-08-01T06:54:13.616 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:13 smithi016 ceph-mon[29266]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-08-01T06:54:13.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:13 smithi089 ceph-mon[36617]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f9911e17b12222fbe598fff73cd3ad10d20c5776", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:54:13.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:13 smithi089 ceph-mon[36617]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f9911e17b12222fbe598fff73cd3ad10d20c5776 2024-08-01T06:54:13.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:13 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:54:13.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:13 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:54:13.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:13 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:54:13.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:13 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:54:13.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:13 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:54:13.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:13 smithi089 ceph-mon[36617]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f9911e17b12222fbe598fff73cd3ad10d20c5776 2024-08-01T06:54:13.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:13 smithi089 ceph-mon[36617]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-08-01T06:54:15.000 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:14 smithi016 ceph-mon[29266]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-08-01T06:54:15.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:14 smithi089 ceph-mon[36617]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-08-01T06:54:15.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.276+0000 7f6e0e545640 1 -- 172.21.15.16:0/620263719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e080fee10 msgr2=0x7f6e080ff270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:15.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.276+0000 7f6e0e545640 1 --2- 172.21.15.16:0/620263719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e080fee10 0x7f6e080ff270 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc009880 tx=0x7f6dfc02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:54:15.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.276+0000 7f6e0e545640 1 -- 172.21.15.16:0/620263719 shutdown_connections 2024-08-01T06:54:15.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.276+0000 7f6e0e545640 1 --2- 172.21.15.16:0/620263719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e080fee10 0x7f6e080ff270 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:15.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.276+0000 7f6e0e545640 1 --2- 172.21.15.16:0/620263719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e080fe4d0 0x7f6e080fe8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:15.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.276+0000 7f6e0e545640 1 -- 172.21.15.16:0/620263719 >> 172.21.15.16:0/620263719 conn(0x7f6e080fa280 msgr2=0x7f6e080fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:15.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.276+0000 7f6e0e545640 1 -- 172.21.15.16:0/620263719 shutdown_connections 2024-08-01T06:54:15.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.276+0000 7f6e0e545640 1 -- 172.21.15.16:0/620263719 wait complete. 2024-08-01T06:54:15.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.277+0000 7f6e0e545640 1 Processor -- start 2024-08-01T06:54:15.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.277+0000 7f6e0e545640 1 -- start start 2024-08-01T06:54:15.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.277+0000 7f6e0e545640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e080fe4d0 0x7f6e081978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:15.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.277+0000 7f6e0e545640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e080fee10 0x7f6e08197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:15.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.277+0000 7f6e0e545640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e081983e0 con 0x7f6e080fee10 2024-08-01T06:54:15.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.277+0000 7f6e0e545640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e08198550 con 0x7f6e080fe4d0 2024-08-01T06:54:15.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.277+0000 7f6e077fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e080fee10 0x7f6e08197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:15.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.278+0000 7f6e077fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e080fee10 0x7f6e08197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51012/0 (socket says 172.21.15.16:51012) 2024-08-01T06:54:15.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.278+0000 7f6e07fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e080fe4d0 0x7f6e081978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:15.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.278+0000 7f6e077fe640 1 -- 172.21.15.16:0/3618147734 learned_addr learned my addr 172.21.15.16:0/3618147734 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:54:15.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.278+0000 7f6e07fff640 1 -- 172.21.15.16:0/3618147734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e080fee10 msgr2=0x7f6e08197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:15.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.278+0000 7f6e07fff640 1 --2- 172.21.15.16:0/3618147734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e080fee10 0x7f6e08197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:15.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.278+0000 7f6e07fff640 1 -- 172.21.15.16:0/3618147734 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dfc009560 con 0x7f6e080fe4d0 2024-08-01T06:54:15.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.278+0000 7f6e07fff640 1 --2- 172.21.15.16:0/3618147734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e080fe4d0 0x7f6e081978d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6df800e970 tx=0x7f6df800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:15.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.278+0000 7f6e057fa640 1 -- 172.21.15.16:0/3618147734 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6df8009620 con 0x7f6e080fe4d0 2024-08-01T06:54:15.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.278+0000 7f6e0e545640 1 -- 172.21.15.16:0/3618147734 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0819cfa0 con 0x7f6e080fe4d0 2024-08-01T06:54:15.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.278+0000 7f6e057fa640 1 -- 172.21.15.16:0/3618147734 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6df80044f0 con 0x7f6e080fe4d0 2024-08-01T06:54:15.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.278+0000 7f6e057fa640 1 -- 172.21.15.16:0/3618147734 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6df80049d0 con 0x7f6e080fe4d0 2024-08-01T06:54:15.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.278+0000 7f6e0e545640 1 -- 172.21.15.16:0/3618147734 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0819d460 con 0x7f6e080fe4d0 2024-08-01T06:54:15.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.280+0000 7f6e0e545640 1 -- 172.21.15.16:0/3618147734 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e080fe8d0 con 0x7f6e080fe4d0 2024-08-01T06:54:15.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.280+0000 7f6e057fa640 1 -- 172.21.15.16:0/3618147734 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6df8004c40 con 0x7f6e080fe4d0 2024-08-01T06:54:15.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.281+0000 7f6e057fa640 1 --2- 172.21.15.16:0/3618147734 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f6df006cc50 0x7f6df006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:15.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.281+0000 7f6e077fe640 1 --2- 172.21.15.16:0/3618147734 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f6df006cc50 0x7f6df006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:15.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.281+0000 7f6e057fa640 1 -- 172.21.15.16:0/3618147734 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f6df8014070 con 0x7f6e080fe4d0 2024-08-01T06:54:15.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.281+0000 7f6e077fe640 1 --2- 172.21.15.16:0/3618147734 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f6df006cc50 0x7f6df006f110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6e08198da0 tx=0x7f6dfc0314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:15.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.286+0000 7f6e057fa640 1 -- 172.21.15.16:0/3618147734 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f6df8056910 con 0x7f6e080fe4d0 2024-08-01T06:54:15.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.544+0000 7f6e0e545640 1 -- 172.21.15.16:0/3618147734 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e0802c550 con 0x7f6df006cc50 2024-08-01T06:54:15.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.546+0000 7f6e057fa640 1 -- 172.21.15.16:0/3618147734 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f6e0802c550 con 0x7f6df006cc50 2024-08-01T06:54:15.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.549+0000 7f6e0e545640 1 -- 172.21.15.16:0/3618147734 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f6df006cc50 msgr2=0x7f6df006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:15.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.549+0000 7f6e0e545640 1 --2- 172.21.15.16:0/3618147734 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f6df006cc50 0x7f6df006f110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6e08198da0 tx=0x7f6dfc0314e0 comp rx=0 tx=0).stop 2024-08-01T06:54:15.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.549+0000 7f6e0e545640 1 -- 172.21.15.16:0/3618147734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e080fe4d0 msgr2=0x7f6e081978d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:15.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.549+0000 7f6e0e545640 1 --2- 172.21.15.16:0/3618147734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e080fe4d0 0x7f6e081978d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6df800e970 tx=0x7f6df800ee30 comp rx=0 tx=0).stop 2024-08-01T06:54:15.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.549+0000 7f6e0e545640 1 -- 172.21.15.16:0/3618147734 shutdown_connections 2024-08-01T06:54:15.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.549+0000 7f6e0e545640 1 --2- 172.21.15.16:0/3618147734 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f6df006cc50 0x7f6df006f110 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:15.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.549+0000 7f6e0e545640 1 --2- 172.21.15.16:0/3618147734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e080fee10 0x7f6e08197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:15.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.549+0000 7f6e0e545640 1 --2- 172.21.15.16:0/3618147734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e080fe4d0 0x7f6e081978d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:15.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.549+0000 7f6e0e545640 1 -- 172.21.15.16:0/3618147734 >> 172.21.15.16:0/3618147734 conn(0x7f6e080fa280 msgr2=0x7f6e08106f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:15.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.549+0000 7f6e0e545640 1 -- 172.21.15.16:0/3618147734 shutdown_connections 2024-08-01T06:54:15.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.549+0000 7f6e0e545640 1 -- 172.21.15.16:0/3618147734 wait complete. 2024-08-01T06:54:15.559 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T06:54:15.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.646+0000 7f6542d1f640 1 -- 172.21.15.16:0/415593034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f653c0feaf0 msgr2=0x7f653c0feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:15.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.646+0000 7f6542d1f640 1 --2- 172.21.15.16:0/415593034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f653c0feaf0 0x7f653c0feef0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6530009880 tx=0x7f653002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:54:15.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.647+0000 7f6542d1f640 1 -- 172.21.15.16:0/415593034 shutdown_connections 2024-08-01T06:54:15.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.647+0000 7f6542d1f640 1 --2- 172.21.15.16:0/415593034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f653c0ffcf0 0x7f653c100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:15.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.647+0000 7f6542d1f640 1 --2- 172.21.15.16:0/415593034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f653c0feaf0 0x7f653c0feef0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:15.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.647+0000 7f6542d1f640 1 -- 172.21.15.16:0/415593034 >> 172.21.15.16:0/415593034 conn(0x7f653c0fa280 msgr2=0x7f653c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:15.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.647+0000 7f6542d1f640 1 -- 172.21.15.16:0/415593034 shutdown_connections 2024-08-01T06:54:15.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.647+0000 7f6542d1f640 1 -- 172.21.15.16:0/415593034 wait complete. 2024-08-01T06:54:15.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.648+0000 7f6542d1f640 1 Processor -- start 2024-08-01T06:54:15.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.648+0000 7f6542d1f640 1 -- start start 2024-08-01T06:54:15.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.648+0000 7f6542d1f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f653c0feaf0 0x7f653c068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:15.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.648+0000 7f6542d1f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f653c0ffcf0 0x7f653c19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:15.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.648+0000 7f6542d1f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c19a9f0 con 0x7f653c0feaf0 2024-08-01T06:54:15.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.648+0000 7f6542d1f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c19ab30 con 0x7f653c0ffcf0 2024-08-01T06:54:15.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.648+0000 7f6540abb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f653c0feaf0 0x7f653c068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:15.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.648+0000 7f6540abb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f653c0feaf0 0x7f653c068790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51032/0 (socket says 172.21.15.16:51032) 2024-08-01T06:54:15.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.648+0000 7f6540abb640 1 -- 172.21.15.16:0/1769418013 learned_addr learned my addr 172.21.15.16:0/1769418013 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:54:15.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.648+0000 7f653bfff640 1 --2- 172.21.15.16:0/1769418013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f653c0ffcf0 0x7f653c19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:15.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.649+0000 7f653bfff640 1 -- 172.21.15.16:0/1769418013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f653c0feaf0 msgr2=0x7f653c068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:15.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.649+0000 7f653bfff640 1 --2- 172.21.15.16:0/1769418013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f653c0feaf0 0x7f653c068790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:15.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.649+0000 7f653bfff640 1 -- 172.21.15.16:0/1769418013 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6530009560 con 0x7f653c0ffcf0 2024-08-01T06:54:15.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.649+0000 7f653bfff640 1 --2- 172.21.15.16:0/1769418013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f653c0ffcf0 0x7f653c19a420 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f652800e970 tx=0x7f652800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:15.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.649+0000 7f6539ffb640 1 -- 172.21.15.16:0/1769418013 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6528009620 con 0x7f653c0ffcf0 2024-08-01T06:54:15.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.649+0000 7f6539ffb640 1 -- 172.21.15.16:0/1769418013 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f65280044f0 con 0x7f653c0ffcf0 2024-08-01T06:54:15.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.649+0000 7f6542d1f640 1 -- 172.21.15.16:0/1769418013 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653c19ade0 con 0x7f653c0ffcf0 2024-08-01T06:54:15.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.649+0000 7f6539ffb640 1 -- 172.21.15.16:0/1769418013 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65280049d0 con 0x7f653c0ffcf0 2024-08-01T06:54:15.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.649+0000 7f6542d1f640 1 -- 172.21.15.16:0/1769418013 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653c19b300 con 0x7f653c0ffcf0 2024-08-01T06:54:15.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.651+0000 7f6542d1f640 1 -- 172.21.15.16:0/1769418013 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653c0feef0 con 0x7f653c0ffcf0 2024-08-01T06:54:15.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.651+0000 7f6539ffb640 1 -- 172.21.15.16:0/1769418013 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6528004c40 con 0x7f653c0ffcf0 2024-08-01T06:54:15.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.651+0000 7f6539ffb640 1 --2- 172.21.15.16:0/1769418013 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f652c06cc60 0x7f652c06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:15.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.652+0000 7f6539ffb640 1 -- 172.21.15.16:0/1769418013 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f6528014070 con 0x7f653c0ffcf0 2024-08-01T06:54:15.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.652+0000 7f6540abb640 1 --2- 172.21.15.16:0/1769418013 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f652c06cc60 0x7f652c06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:15.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.652+0000 7f6540abb640 1 --2- 172.21.15.16:0/1769418013 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f652c06cc60 0x7f652c06f120 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6530000c00 tx=0x7f65300314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:15.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.655+0000 7f6539ffb640 1 -- 172.21.15.16:0/1769418013 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f6528056980 con 0x7f653c0ffcf0 2024-08-01T06:54:15.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:15 smithi016 ceph-mon[29266]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:54:15.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.904+0000 7f6542d1f640 1 -- 172.21.15.16:0/1769418013 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f653c02c540 con 0x7f652c06cc60 2024-08-01T06:54:15.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.905+0000 7f6539ffb640 1 -- 172.21.15.16:0/1769418013 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f653c02c540 con 0x7f652c06cc60 2024-08-01T06:54:15.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.908+0000 7f6542d1f640 1 -- 172.21.15.16:0/1769418013 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f652c06cc60 msgr2=0x7f652c06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:15.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.908+0000 7f6542d1f640 1 --2- 172.21.15.16:0/1769418013 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f652c06cc60 0x7f652c06f120 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6530000c00 tx=0x7f65300314e0 comp rx=0 tx=0).stop 2024-08-01T06:54:15.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.908+0000 7f6542d1f640 1 -- 172.21.15.16:0/1769418013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f653c0ffcf0 msgr2=0x7f653c19a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:15.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.908+0000 7f6542d1f640 1 --2- 172.21.15.16:0/1769418013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f653c0ffcf0 0x7f653c19a420 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f652800e970 tx=0x7f652800ee30 comp rx=0 tx=0).stop 2024-08-01T06:54:15.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.908+0000 7f6542d1f640 1 -- 172.21.15.16:0/1769418013 shutdown_connections 2024-08-01T06:54:15.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.908+0000 7f6542d1f640 1 --2- 172.21.15.16:0/1769418013 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f652c06cc60 0x7f652c06f120 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:15.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.908+0000 7f6542d1f640 1 --2- 172.21.15.16:0/1769418013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f653c0ffcf0 0x7f653c19a420 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:15.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.908+0000 7f6542d1f640 1 --2- 172.21.15.16:0/1769418013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f653c0feaf0 0x7f653c068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:15.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.908+0000 7f6542d1f640 1 -- 172.21.15.16:0/1769418013 >> 172.21.15.16:0/1769418013 conn(0x7f653c0fa280 msgr2=0x7f653c1033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:15.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.908+0000 7f6542d1f640 1 -- 172.21.15.16:0/1769418013 shutdown_connections 2024-08-01T06:54:15.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:15.908+0000 7f6542d1f640 1 -- 172.21.15.16:0/1769418013 wait complete. 2024-08-01T06:54:16.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.007+0000 7fc0de3be640 1 -- 172.21.15.16:0/3721608014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0d8100d90 msgr2=0x7fc0d8101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:16.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.007+0000 7fc0de3be640 1 --2- 172.21.15.16:0/3721608014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0d8100d90 0x7fc0d8101210 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc009880 tx=0x7fc0cc02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.007+0000 7fc0de3be640 1 -- 172.21.15.16:0/3721608014 shutdown_connections 2024-08-01T06:54:16.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.007+0000 7fc0de3be640 1 --2- 172.21.15.16:0/3721608014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0d8100d90 0x7fc0d8101210 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.007+0000 7fc0de3be640 1 --2- 172.21.15.16:0/3721608014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0d80ffb90 0x7fc0d80fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.008+0000 7fc0de3be640 1 -- 172.21.15.16:0/3721608014 >> 172.21.15.16:0/3721608014 conn(0x7fc0d80fb360 msgr2=0x7fc0d80fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:16.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.008+0000 7fc0de3be640 1 -- 172.21.15.16:0/3721608014 shutdown_connections 2024-08-01T06:54:16.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.008+0000 7fc0de3be640 1 -- 172.21.15.16:0/3721608014 wait complete. 2024-08-01T06:54:16.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.008+0000 7fc0de3be640 1 Processor -- start 2024-08-01T06:54:16.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.008+0000 7fc0de3be640 1 -- start start 2024-08-01T06:54:16.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.009+0000 7fc0de3be640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0d80ffb90 0x7fc0d8195600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.009+0000 7fc0de3be640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0d8100d90 0x7fc0d8195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.009+0000 7fc0de3be640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d8196110 con 0x7fc0d80ffb90 2024-08-01T06:54:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.009+0000 7fc0de3be640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d8196280 con 0x7fc0d8100d90 2024-08-01T06:54:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.009+0000 7fc0d7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0d80ffb90 0x7fc0d8195600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.009+0000 7fc0d7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0d80ffb90 0x7fc0d8195600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51050/0 (socket says 172.21.15.16:51050) 2024-08-01T06:54:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.009+0000 7fc0d7fff640 1 -- 172.21.15.16:0/408943574 learned_addr learned my addr 172.21.15.16:0/408943574 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:54:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.009+0000 7fc0d77fe640 1 --2- 172.21.15.16:0/408943574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0d8100d90 0x7fc0d8195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.009+0000 7fc0d7fff640 1 -- 172.21.15.16:0/408943574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0d8100d90 msgr2=0x7fc0d8195b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.009+0000 7fc0d7fff640 1 --2- 172.21.15.16:0/408943574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0d8100d90 0x7fc0d8195b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.009+0000 7fc0d7fff640 1 -- 172.21.15.16:0/408943574 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0cc009560 con 0x7fc0d80ffb90 2024-08-01T06:54:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.010+0000 7fc0d7fff640 1 --2- 172.21.15.16:0/408943574 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0d80ffb90 0x7fc0d8195600 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc0c800e970 tx=0x7fc0c800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.010+0000 7fc0d57fa640 1 -- 172.21.15.16:0/408943574 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0c80096e0 con 0x7fc0d80ffb90 2024-08-01T06:54:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.010+0000 7fc0d57fa640 1 -- 172.21.15.16:0/408943574 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc0c80044f0 con 0x7fc0d80ffb90 2024-08-01T06:54:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.010+0000 7fc0de3be640 1 -- 172.21.15.16:0/408943574 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d819ad20 con 0x7fc0d80ffb90 2024-08-01T06:54:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.010+0000 7fc0de3be640 1 -- 172.21.15.16:0/408943574 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d819b260 con 0x7fc0d80ffb90 2024-08-01T06:54:16.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.010+0000 7fc0d57fa640 1 -- 172.21.15.16:0/408943574 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0c8010430 con 0x7fc0d80ffb90 2024-08-01T06:54:16.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.011+0000 7fc0de3be640 1 -- 172.21.15.16:0/408943574 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d818f730 con 0x7fc0d80ffb90 2024-08-01T06:54:16.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.012+0000 7fc0d57fa640 1 -- 172.21.15.16:0/408943574 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc0c800cc90 con 0x7fc0d80ffb90 2024-08-01T06:54:16.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.012+0000 7fc0d57fa640 1 --2- 172.21.15.16:0/408943574 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc0c006cc50 0x7fc0c006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:16.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.013+0000 7fc0d57fa640 1 -- 172.21.15.16:0/408943574 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc0c8014070 con 0x7fc0d80ffb90 2024-08-01T06:54:16.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.013+0000 7fc0d77fe640 1 --2- 172.21.15.16:0/408943574 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc0c006cc50 0x7fc0c006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:16.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.013+0000 7fc0d77fe640 1 --2- 172.21.15.16:0/408943574 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc0c006cc50 0x7fc0c006f110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc000c00 tx=0x7fc0cc0314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:16.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.018+0000 7fc0d57fa640 1 -- 172.21.15.16:0/408943574 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fc0c8056af0 con 0x7fc0d80ffb90 2024-08-01T06:54:16.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:15 smithi089 ceph-mon[36617]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:54:16.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.227+0000 7fc0de3be640 1 -- 172.21.15.16:0/408943574 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0d802c560 con 0x7fc0c006cc50 2024-08-01T06:54:16.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.239+0000 7fc0d57fa640 1 -- 172.21.15.16:0/408943574 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fc0d802c560 con 0x7fc0c006cc50 2024-08-01T06:54:16.241 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T06:54:16.241 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (4m) 31s ago 6m 25.5M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T06:54:16.241 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (6m) 31s ago 6m 7554k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T06:54:16.241 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (5m) 37s ago 5m 7541k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T06:54:16.242 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (6m) 31s ago 6m 6895k - 18.2.2-1767-ga3bbd728 d280790d1980 81c723a6ae35 2024-08-01T06:54:16.242 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (5m) 37s ago 5m 6891k - 18.2.2-1767-ga3bbd728 d280790d1980 73e7778d1e26 2024-08-01T06:54:16.242 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (4m) 31s ago 6m 82.9M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T06:54:16.242 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (58s) 31s ago 58s 12.5M - 18.2.2-1767-ga3bbd728 d280790d1980 96e46c28d16c 2024-08-01T06:54:16.242 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (52s) 31s ago 52s 18.4M - 18.2.2-1767-ga3bbd728 d280790d1980 4bbe1a388689 2024-08-01T06:54:16.242 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (56s) 37s ago 55s 16.7M - 18.2.2-1767-ga3bbd728 d280790d1980 65ca121a6fbb 2024-08-01T06:54:16.242 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (49s) 37s ago 49s 14.0M - 18.2.2-1767-ga3bbd728 d280790d1980 05bb46c6fe94 2024-08-01T06:54:16.242 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:9283,8765,8443 running (7m) 31s ago 7m 487M - 18.2.2-1767-ga3bbd728 d280790d1980 3cf8ca2d43c6 2024-08-01T06:54:16.242 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (5m) 37s ago 5m 441M - 18.2.2-1767-ga3bbd728 d280790d1980 c70860f1020b 2024-08-01T06:54:16.242 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (7m) 31s ago 7m 49.4M 2048M 18.2.2-1767-ga3bbd728 d280790d1980 e6a2e5d7eeec 2024-08-01T06:54:16.242 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (5m) 37s ago 5m 35.5M 2048M 18.2.2-1767-ga3bbd728 d280790d1980 9ca9e3e814cb 2024-08-01T06:54:16.242 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (6m) 31s ago 6m 15.7M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T06:54:16.243 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (5m) 37s ago 5m 16.7M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T06:54:16.243 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (4m) 31s ago 4m 54.0M 3948M 18.2.2-1767-ga3bbd728 d280790d1980 9b7157499583 2024-08-01T06:54:16.243 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (4m) 31s ago 4m 48.8M 3948M 18.2.2-1767-ga3bbd728 d280790d1980 f3b050aed6b7 2024-08-01T06:54:16.243 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (3m) 31s ago 3m 53.4M 3948M 18.2.2-1767-ga3bbd728 d280790d1980 33a72e1a5c91 2024-08-01T06:54:16.243 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (3m) 37s ago 3m 45.6M 4970M 18.2.2-1767-ga3bbd728 d280790d1980 58c175e0f4eb 2024-08-01T06:54:16.243 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (2m) 37s ago 2m 50.9M 4970M 18.2.2-1767-ga3bbd728 d280790d1980 15b8f910bad7 2024-08-01T06:54:16.243 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (2m) 37s ago 2m 51.0M 4970M 18.2.2-1767-ga3bbd728 d280790d1980 ac887841899e 2024-08-01T06:54:16.243 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (4m) 31s ago 5m 60.3M - 2.43.0 a07b618ecd1d 2b370118fafe 2024-08-01T06:54:16.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.242+0000 7fc0de3be640 1 -- 172.21.15.16:0/408943574 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc0c006cc50 msgr2=0x7fc0c006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:16.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.242+0000 7fc0de3be640 1 --2- 172.21.15.16:0/408943574 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc0c006cc50 0x7fc0c006f110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc000c00 tx=0x7fc0cc0314e0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.242+0000 7fc0de3be640 1 -- 172.21.15.16:0/408943574 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0d80ffb90 msgr2=0x7fc0d8195600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:16.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.242+0000 7fc0de3be640 1 --2- 172.21.15.16:0/408943574 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0d80ffb90 0x7fc0d8195600 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc0c800e970 tx=0x7fc0c800ee30 comp rx=0 tx=0).stop 2024-08-01T06:54:16.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.242+0000 7fc0de3be640 1 -- 172.21.15.16:0/408943574 shutdown_connections 2024-08-01T06:54:16.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.242+0000 7fc0de3be640 1 --2- 172.21.15.16:0/408943574 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc0c006cc50 0x7fc0c006f110 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.242+0000 7fc0de3be640 1 --2- 172.21.15.16:0/408943574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0d8100d90 0x7fc0d8195b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.242+0000 7fc0de3be640 1 --2- 172.21.15.16:0/408943574 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0d80ffb90 0x7fc0d8195600 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.242+0000 7fc0de3be640 1 -- 172.21.15.16:0/408943574 >> 172.21.15.16:0/408943574 conn(0x7fc0d80fb360 msgr2=0x7fc0d8104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:16.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.242+0000 7fc0de3be640 1 -- 172.21.15.16:0/408943574 shutdown_connections 2024-08-01T06:54:16.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.242+0000 7fc0de3be640 1 -- 172.21.15.16:0/408943574 wait complete. 2024-08-01T06:54:16.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.342+0000 7fb46f236640 1 -- 172.21.15.16:0/3250668021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb468100630 msgr2=0x7fb468102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:16.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.342+0000 7fb46f236640 1 --2- 172.21.15.16:0/3250668021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb468100630 0x7fb468102a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0098b0 tx=0x7fb45c02a4d0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.342+0000 7fb46f236640 1 -- 172.21.15.16:0/3250668021 shutdown_connections 2024-08-01T06:54:16.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.342+0000 7fb46f236640 1 --2- 172.21.15.16:0/3250668021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb468102f60 0x7fb468105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.342+0000 7fb46f236640 1 --2- 172.21.15.16:0/3250668021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb468100630 0x7fb468102a20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.342+0000 7fb46f236640 1 -- 172.21.15.16:0/3250668021 >> 172.21.15.16:0/3250668021 conn(0x7fb4680fa230 msgr2=0x7fb4680fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:16.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.342+0000 7fb46f236640 1 -- 172.21.15.16:0/3250668021 shutdown_connections 2024-08-01T06:54:16.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.342+0000 7fb46f236640 1 -- 172.21.15.16:0/3250668021 wait complete. 2024-08-01T06:54:16.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.343+0000 7fb46f236640 1 Processor -- start 2024-08-01T06:54:16.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.343+0000 7fb46f236640 1 -- start start 2024-08-01T06:54:16.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.343+0000 7fb46f236640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb468100630 0x7fb4680fff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:16.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.343+0000 7fb46f236640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb468102f60 0x7fb4680fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:16.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.343+0000 7fb46f236640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4680feb20 con 0x7fb468102f60 2024-08-01T06:54:16.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.343+0000 7fb46f236640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4680fec90 con 0x7fb468100630 2024-08-01T06:54:16.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.343+0000 7fb467fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb468102f60 0x7fb4680fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:16.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.343+0000 7fb467fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb468102f60 0x7fb4680fe5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51080/0 (socket says 172.21.15.16:51080) 2024-08-01T06:54:16.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.343+0000 7fb467fff640 1 -- 172.21.15.16:0/2244415689 learned_addr learned my addr 172.21.15.16:0/2244415689 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:54:16.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.343+0000 7fb46cfd2640 1 --2- 172.21.15.16:0/2244415689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb468100630 0x7fb4680fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:16.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.344+0000 7fb467fff640 1 -- 172.21.15.16:0/2244415689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb468100630 msgr2=0x7fb4680fff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:16.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.344+0000 7fb467fff640 1 --2- 172.21.15.16:0/2244415689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb468100630 0x7fb4680fff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.344+0000 7fb467fff640 1 -- 172.21.15.16:0/2244415689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb454009490 con 0x7fb468102f60 2024-08-01T06:54:16.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.344+0000 7fb467fff640 1 --2- 172.21.15.16:0/2244415689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb468102f60 0x7fb4680fe5e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb45400e920 tx=0x7fb45400ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:16.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.344+0000 7fb465ffb640 1 -- 172.21.15.16:0/2244415689 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb454009790 con 0x7fb468102f60 2024-08-01T06:54:16.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.344+0000 7fb46f236640 1 -- 172.21.15.16:0/2244415689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c009560 con 0x7fb468102f60 2024-08-01T06:54:16.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.344+0000 7fb465ffb640 1 -- 172.21.15.16:0/2244415689 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb45400cd50 con 0x7fb468102f60 2024-08-01T06:54:16.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.344+0000 7fb465ffb640 1 -- 172.21.15.16:0/2244415689 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb454004a60 con 0x7fb468102f60 2024-08-01T06:54:16.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.344+0000 7fb46f236640 1 -- 172.21.15.16:0/2244415689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4680ff3b0 con 0x7fb468102f60 2024-08-01T06:54:16.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.346+0000 7fb46f236640 1 -- 172.21.15.16:0/2244415689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4681087c0 con 0x7fb468102f60 2024-08-01T06:54:16.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.346+0000 7fb465ffb640 1 -- 172.21.15.16:0/2244415689 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb454004d20 con 0x7fb468102f60 2024-08-01T06:54:16.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.347+0000 7fb465ffb640 1 --2- 172.21.15.16:0/2244415689 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb45806cc50 0x7fb45806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:16.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.347+0000 7fb465ffb640 1 -- 172.21.15.16:0/2244415689 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb454014070 con 0x7fb468102f60 2024-08-01T06:54:16.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.347+0000 7fb46cfd2640 1 --2- 172.21.15.16:0/2244415689 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb45806cc50 0x7fb45806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:16.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.347+0000 7fb46cfd2640 1 --2- 172.21.15.16:0/2244415689 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb45806cc50 0x7fb45806f110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb45c006010 tx=0x7fb45c0314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:16.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.355+0000 7fb465ffb640 1 -- 172.21.15.16:0/2244415689 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fb454056810 con 0x7fb468102f60 2024-08-01T06:54:16.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.668+0000 7fb46f236640 1 -- 172.21.15.16:0/2244415689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb468108950 con 0x7fb468102f60 2024-08-01T06:54:16.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.669+0000 7fb465ffb640 1 -- 172.21.15.16:0/2244415689 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fb454059e30 con 0x7fb468102f60 2024-08-01T06:54:16.670 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:54:16.670 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T06:54:16.670 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 2 2024-08-01T06:54:16.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:54:16.671 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T06:54:16.671 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 2 2024-08-01T06:54:16.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:54:16.671 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T06:54:16.671 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 6 2024-08-01T06:54:16.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:54:16.671 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T06:54:16.671 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4 2024-08-01T06:54:16.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:54:16.671 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T06:54:16.671 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 14 2024-08-01T06:54:16.671 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T06:54:16.671 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:54:16.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.671+0000 7fb46f236640 1 -- 172.21.15.16:0/2244415689 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb45806cc50 msgr2=0x7fb45806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:16.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.671+0000 7fb46f236640 1 --2- 172.21.15.16:0/2244415689 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb45806cc50 0x7fb45806f110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb45c006010 tx=0x7fb45c0314e0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.671+0000 7fb46f236640 1 -- 172.21.15.16:0/2244415689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb468102f60 msgr2=0x7fb4680fe5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:16.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.671+0000 7fb46f236640 1 --2- 172.21.15.16:0/2244415689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb468102f60 0x7fb4680fe5e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb45400e920 tx=0x7fb45400ede0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.671+0000 7fb46f236640 1 -- 172.21.15.16:0/2244415689 shutdown_connections 2024-08-01T06:54:16.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.671+0000 7fb46f236640 1 --2- 172.21.15.16:0/2244415689 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb45806cc50 0x7fb45806f110 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.671+0000 7fb46f236640 1 --2- 172.21.15.16:0/2244415689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb468102f60 0x7fb4680fe5e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.671+0000 7fb46f236640 1 --2- 172.21.15.16:0/2244415689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb468100630 0x7fb4680fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.671+0000 7fb46f236640 1 -- 172.21.15.16:0/2244415689 >> 172.21.15.16:0/2244415689 conn(0x7fb4680fa230 msgr2=0x7fb4680fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:16.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.671+0000 7fb46f236640 1 -- 172.21.15.16:0/2244415689 shutdown_connections 2024-08-01T06:54:16.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.672+0000 7fb46f236640 1 -- 172.21.15.16:0/2244415689 wait complete. 2024-08-01T06:54:16.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.767+0000 7f64e8d99640 1 -- 172.21.15.16:0/185806299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64e40feaa0 msgr2=0x7f64e40feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:16.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.767+0000 7f64e8d99640 1 --2- 172.21.15.16:0/185806299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64e40feaa0 0x7f64e40feea0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009880 tx=0x7f64d402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.767+0000 7f64e8d99640 1 -- 172.21.15.16:0/185806299 shutdown_connections 2024-08-01T06:54:16.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.767+0000 7f64e8d99640 1 --2- 172.21.15.16:0/185806299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e40ffca0 0x7f64e4100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.767+0000 7f64e8d99640 1 --2- 172.21.15.16:0/185806299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64e40feaa0 0x7f64e40feea0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.767+0000 7f64e8d99640 1 -- 172.21.15.16:0/185806299 >> 172.21.15.16:0/185806299 conn(0x7f64e40fa250 msgr2=0x7f64e40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:16.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.767+0000 7f64e8d99640 1 -- 172.21.15.16:0/185806299 shutdown_connections 2024-08-01T06:54:16.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.767+0000 7f64e8d99640 1 -- 172.21.15.16:0/185806299 wait complete. 2024-08-01T06:54:16.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.768+0000 7f64e8d99640 1 Processor -- start 2024-08-01T06:54:16.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.768+0000 7f64e8d99640 1 -- start start 2024-08-01T06:54:16.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.768+0000 7f64e8d99640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e40feaa0 0x7f64e4195660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:16.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.768+0000 7f64e8d99640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64e40ffca0 0x7f64e4195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:16.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.768+0000 7f64e8d99640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e4196170 con 0x7f64e40ffca0 2024-08-01T06:54:16.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.768+0000 7f64e8d99640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e41962e0 con 0x7f64e40feaa0 2024-08-01T06:54:16.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.769+0000 7f64e1d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64e40ffca0 0x7f64e4195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:16.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.769+0000 7f64e259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e40feaa0 0x7f64e4195660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:16.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.769+0000 7f64e259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e40feaa0 0x7f64e4195660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:39588/0 (socket says 172.21.15.16:39588) 2024-08-01T06:54:16.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.769+0000 7f64e1d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64e40ffca0 0x7f64e4195ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51104/0 (socket says 172.21.15.16:51104) 2024-08-01T06:54:16.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.769+0000 7f64e259c640 1 -- 172.21.15.16:0/3433595481 learned_addr learned my addr 172.21.15.16:0/3433595481 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:54:16.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.769+0000 7f64e259c640 1 -- 172.21.15.16:0/3433595481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64e40ffca0 msgr2=0x7f64e4195ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:16.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.769+0000 7f64e259c640 1 --2- 172.21.15.16:0/3433595481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64e40ffca0 0x7f64e4195ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:16.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.769+0000 7f64e259c640 1 -- 172.21.15.16:0/3433595481 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d4009560 con 0x7f64e40feaa0 2024-08-01T06:54:16.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.769+0000 7f64e259c640 1 --2- 172.21.15.16:0/3433595481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e40feaa0 0x7f64e4195660 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f64d402a9c0 tx=0x7f64d40055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:16.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.769+0000 7f64d37fe640 1 -- 172.21.15.16:0/3433595481 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64d4004aa0 con 0x7f64e40feaa0 2024-08-01T06:54:16.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.770+0000 7f64d37fe640 1 -- 172.21.15.16:0/3433595481 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f64d4005d50 con 0x7f64e40feaa0 2024-08-01T06:54:16.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.770+0000 7f64e8d99640 1 -- 172.21.15.16:0/3433595481 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e419ad20 con 0x7f64e40feaa0 2024-08-01T06:54:16.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.770+0000 7f64d37fe640 1 -- 172.21.15.16:0/3433595481 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64d40039b0 con 0x7f64e40feaa0 2024-08-01T06:54:16.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.770+0000 7f64e8d99640 1 -- 172.21.15.16:0/3433595481 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e419b240 con 0x7f64e40feaa0 2024-08-01T06:54:16.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.771+0000 7f64e8d99640 1 -- 172.21.15.16:0/3433595481 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e4107690 con 0x7f64e40feaa0 2024-08-01T06:54:16.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.771+0000 7f64d37fe640 1 -- 172.21.15.16:0/3433595481 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f64d4003ba0 con 0x7f64e40feaa0 2024-08-01T06:54:16.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.772+0000 7f64d37fe640 1 --2- 172.21.15.16:0/3433595481 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f64cc06cc50 0x7f64cc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:16.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.772+0000 7f64d37fe640 1 -- 172.21.15.16:0/3433595481 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f64d40ad280 con 0x7f64e40feaa0 2024-08-01T06:54:16.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.772+0000 7f64e1d9b640 1 --2- 172.21.15.16:0/3433595481 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f64cc06cc50 0x7f64cc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:16.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.773+0000 7f64e1d9b640 1 --2- 172.21.15.16:0/3433595481 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f64cc06cc50 0x7f64cc06f110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f64e4196b80 tx=0x7f64d8005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:16.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:16.776+0000 7f64d37fe640 1 -- 172.21.15.16:0/3433595481 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f64d40776c0 con 0x7f64e40feaa0 2024-08-01T06:54:17.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.033+0000 7f64e8d99640 1 -- 172.21.15.16:0/3433595481 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f64e419b480 con 0x7f64e40feaa0 2024-08-01T06:54:17.035 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:16 smithi016 ceph-mon[29266]: from='client.24345 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:54:17.035 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:16 smithi016 ceph-mon[29266]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:54:17.036 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:16 smithi016 ceph-mon[29266]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 3 op/s 2024-08-01T06:54:17.036 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:16 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/2244415689' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:54:17.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.034+0000 7f64d37fe640 1 -- 172.21.15.16:0/3433595481 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1868 (secure 0 0 0) 0x7f64d407ace0 con 0x7f64e40feaa0 2024-08-01T06:54:17.036 INFO:teuthology.orchestra.run.smithi016.stdout:e19 2024-08-01T06:54:17.036 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T06:54:17.036 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:54:17.036 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T06:54:17.037 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:54:17.037 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T06:54:17.037 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T06:54:17.037 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 19 2024-08-01T06:54:17.037 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T06:54:17.037 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T06:54:17.038 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T06:53:32.617145+0000 2024-08-01T06:54:17.038 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T06:54:17.038 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T06:54:17.038 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T06:54:17.038 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T06:54:17.038 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T06:54:17.038 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T06:54:17.038 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T06:54:17.038 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T06:54:17.038 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 46 2024-08-01T06:54:17.038 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:54:17.038 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T06:54:17.038 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T06:54:17.038 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=14482,1=24281} 2024-08-01T06:54:17.039 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T06:54:17.039 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T06:54:17.039 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T06:54:17.039 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T06:54:17.039 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T06:54:17.039 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T06:54:17.039 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T06:54:17.039 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T06:54:17.039 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T06:54:17.039 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:54:17.039 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:24299} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:54:17.039 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{1:24281} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:54:17.039 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:24291} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:54:17.039 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:54:17.040 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:54:17.040 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-08-01T06:54:17.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.037+0000 7f64e8d99640 1 -- 172.21.15.16:0/3433595481 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f64cc06cc50 msgr2=0x7f64cc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:17.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.037+0000 7f64e8d99640 1 --2- 172.21.15.16:0/3433595481 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f64cc06cc50 0x7f64cc06f110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f64e4196b80 tx=0x7f64d8005f90 comp rx=0 tx=0).stop 2024-08-01T06:54:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.037+0000 7f64e8d99640 1 -- 172.21.15.16:0/3433595481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e40feaa0 msgr2=0x7f64e4195660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.037+0000 7f64e8d99640 1 --2- 172.21.15.16:0/3433595481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e40feaa0 0x7f64e4195660 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f64d402a9c0 tx=0x7f64d40055a0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.037+0000 7f64e8d99640 1 -- 172.21.15.16:0/3433595481 shutdown_connections 2024-08-01T06:54:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.037+0000 7f64e8d99640 1 --2- 172.21.15.16:0/3433595481 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f64cc06cc50 0x7f64cc06f110 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.037+0000 7f64e8d99640 1 --2- 172.21.15.16:0/3433595481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64e40ffca0 0x7f64e4195ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.037+0000 7f64e8d99640 1 --2- 172.21.15.16:0/3433595481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e40feaa0 0x7f64e4195660 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.037+0000 7f64e8d99640 1 -- 172.21.15.16:0/3433595481 >> 172.21.15.16:0/3433595481 conn(0x7f64e40fa250 msgr2=0x7f64e40fbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.037+0000 7f64e8d99640 1 -- 172.21.15.16:0/3433595481 shutdown_connections 2024-08-01T06:54:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.037+0000 7f64e8d99640 1 -- 172.21.15.16:0/3433595481 wait complete. 2024-08-01T06:54:17.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.133+0000 7fb16750c640 1 -- 172.21.15.16:0/1176995657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1600ffba0 msgr2=0x7fb1600fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:17.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.133+0000 7fb16750c640 1 --2- 172.21.15.16:0/1176995657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1600ffba0 0x7fb1600fffa0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009880 tx=0x7fb15c02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.133+0000 7fb16750c640 1 -- 172.21.15.16:0/1176995657 shutdown_connections 2024-08-01T06:54:17.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.133+0000 7fb16750c640 1 --2- 172.21.15.16:0/1176995657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb160100da0 0x7fb160101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.133+0000 7fb16750c640 1 --2- 172.21.15.16:0/1176995657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1600ffba0 0x7fb1600fffa0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.133+0000 7fb16750c640 1 -- 172.21.15.16:0/1176995657 >> 172.21.15.16:0/1176995657 conn(0x7fb1600fb330 msgr2=0x7fb1600fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:17.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.133+0000 7fb16750c640 1 -- 172.21.15.16:0/1176995657 shutdown_connections 2024-08-01T06:54:17.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.133+0000 7fb16750c640 1 -- 172.21.15.16:0/1176995657 wait complete. 2024-08-01T06:54:17.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.134+0000 7fb16750c640 1 Processor -- start 2024-08-01T06:54:17.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.134+0000 7fb16750c640 1 -- start start 2024-08-01T06:54:17.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.134+0000 7fb16750c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1600ffba0 0x7fb160074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:17.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.134+0000 7fb16750c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb160100da0 0x7fb1600728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:17.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.134+0000 7fb16750c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb160072de0 con 0x7fb160100da0 2024-08-01T06:54:17.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.134+0000 7fb16750c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb160072f50 con 0x7fb1600ffba0 2024-08-01T06:54:17.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.134+0000 7fb164aa7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb160100da0 0x7fb1600728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:17.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.134+0000 7fb1652a8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1600ffba0 0x7fb160074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:17.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.134+0000 7fb164aa7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb160100da0 0x7fb1600728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51130/0 (socket says 172.21.15.16:51130) 2024-08-01T06:54:17.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.134+0000 7fb164aa7640 1 -- 172.21.15.16:0/2782193882 learned_addr learned my addr 172.21.15.16:0/2782193882 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:54:17.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.135+0000 7fb164aa7640 1 -- 172.21.15.16:0/2782193882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1600ffba0 msgr2=0x7fb160074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:17.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.135+0000 7fb164aa7640 1 --2- 172.21.15.16:0/2782193882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1600ffba0 0x7fb160074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.135+0000 7fb164aa7640 1 -- 172.21.15.16:0/2782193882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15c009560 con 0x7fb160100da0 2024-08-01T06:54:17.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.135+0000 7fb1652a8640 1 --2- 172.21.15.16:0/2782193882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1600ffba0 0x7fb160074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T06:54:17.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.135+0000 7fb164aa7640 1 --2- 172.21.15.16:0/2782193882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb160100da0 0x7fb1600728a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb15000e970 tx=0x7fb15000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:17.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.135+0000 7fb1567fc640 1 -- 172.21.15.16:0/2782193882 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb15000cc90 con 0x7fb160100da0 2024-08-01T06:54:17.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.135+0000 7fb1567fc640 1 -- 172.21.15.16:0/2782193882 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb15000cdf0 con 0x7fb160100da0 2024-08-01T06:54:17.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.135+0000 7fb16750c640 1 -- 172.21.15.16:0/2782193882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb160073230 con 0x7fb160100da0 2024-08-01T06:54:17.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:16 smithi089 ceph-mon[36617]: from='client.24345 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:54:17.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:16 smithi089 ceph-mon[36617]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:54:17.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:16 smithi089 ceph-mon[36617]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 3 op/s 2024-08-01T06:54:17.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:16 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/2244415689' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:54:17.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.135+0000 7fb1567fc640 1 -- 172.21.15.16:0/2782193882 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb150018810 con 0x7fb160100da0 2024-08-01T06:54:17.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.135+0000 7fb16750c640 1 -- 172.21.15.16:0/2782193882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16019d690 con 0x7fb160100da0 2024-08-01T06:54:17.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.137+0000 7fb16750c640 1 -- 172.21.15.16:0/2782193882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb16018f720 con 0x7fb160100da0 2024-08-01T06:54:17.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.137+0000 7fb1567fc640 1 -- 172.21.15.16:0/2782193882 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb150010c10 con 0x7fb160100da0 2024-08-01T06:54:17.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.138+0000 7fb1567fc640 1 --2- 172.21.15.16:0/2782193882 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb14c06cc50 0x7fb14c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:17.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.138+0000 7fb1567fc640 1 -- 172.21.15.16:0/2782193882 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb150014070 con 0x7fb160100da0 2024-08-01T06:54:17.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.138+0000 7fb1652a8640 1 --2- 172.21.15.16:0/2782193882 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb14c06cc50 0x7fb14c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:17.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.139+0000 7fb1652a8640 1 --2- 172.21.15.16:0/2782193882 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb14c06cc50 0x7fb14c06f110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009230 tx=0x7fb15c0314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:17.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.143+0000 7fb1567fc640 1 -- 172.21.15.16:0/2782193882 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fb150052de0 con 0x7fb160100da0 2024-08-01T06:54:17.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.394+0000 7fb16750c640 1 -- 172.21.15.16:0/2782193882 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb16002c4f0 con 0x7fb14c06cc50 2024-08-01T06:54:17.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.395+0000 7fb1567fc640 1 -- 172.21.15.16:0/2782193882 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fb16002c4f0 con 0x7fb14c06cc50 2024-08-01T06:54:17.396 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:54:17.396 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f9911e17b12222fbe598fff73cd3ad10d20c5776", 2024-08-01T06:54:17.397 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T06:54:17.397 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T06:54:17.397 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [], 2024-08-01T06:54:17.397 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "", 2024-08-01T06:54:17.397 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:f9911e17b12222fbe598fff73cd3ad10d20c5776 image", 2024-08-01T06:54:17.397 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T06:54:17.397 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:54:17.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.398+0000 7fb16750c640 1 -- 172.21.15.16:0/2782193882 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb14c06cc50 msgr2=0x7fb14c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:17.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.398+0000 7fb16750c640 1 --2- 172.21.15.16:0/2782193882 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb14c06cc50 0x7fb14c06f110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009230 tx=0x7fb15c0314e0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.398+0000 7fb16750c640 1 -- 172.21.15.16:0/2782193882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb160100da0 msgr2=0x7fb1600728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:17.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.398+0000 7fb16750c640 1 --2- 172.21.15.16:0/2782193882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb160100da0 0x7fb1600728a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb15000e970 tx=0x7fb15000ee30 comp rx=0 tx=0).stop 2024-08-01T06:54:17.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.398+0000 7fb16750c640 1 -- 172.21.15.16:0/2782193882 shutdown_connections 2024-08-01T06:54:17.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.398+0000 7fb16750c640 1 --2- 172.21.15.16:0/2782193882 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb14c06cc50 0x7fb14c06f110 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.398+0000 7fb16750c640 1 --2- 172.21.15.16:0/2782193882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb160100da0 0x7fb1600728a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.398+0000 7fb16750c640 1 --2- 172.21.15.16:0/2782193882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1600ffba0 0x7fb160074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.398+0000 7fb16750c640 1 -- 172.21.15.16:0/2782193882 >> 172.21.15.16:0/2782193882 conn(0x7fb1600fb330 msgr2=0x7fb160104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:17.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.398+0000 7fb16750c640 1 -- 172.21.15.16:0/2782193882 shutdown_connections 2024-08-01T06:54:17.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.398+0000 7fb16750c640 1 -- 172.21.15.16:0/2782193882 wait complete. 2024-08-01T06:54:17.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.510+0000 7ff30d374640 1 -- 172.21.15.16:0/4248509182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff308100e40 msgr2=0x7ff3081012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:17.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.510+0000 7ff30d374640 1 --2- 172.21.15.16:0/4248509182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff308100e40 0x7ff3081012c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc009880 tx=0x7ff2fc02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.510+0000 7ff30d374640 1 -- 172.21.15.16:0/4248509182 shutdown_connections 2024-08-01T06:54:17.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.510+0000 7ff30d374640 1 --2- 172.21.15.16:0/4248509182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff308100e40 0x7ff3081012c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.510+0000 7ff30d374640 1 --2- 172.21.15.16:0/4248509182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3080fde60 0x7ff3080fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.510+0000 7ff30d374640 1 -- 172.21.15.16:0/4248509182 >> 172.21.15.16:0/4248509182 conn(0x7ff3080f99b0 msgr2=0x7ff3080fbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:17.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.511+0000 7ff30d374640 1 -- 172.21.15.16:0/4248509182 shutdown_connections 2024-08-01T06:54:17.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.511+0000 7ff30d374640 1 -- 172.21.15.16:0/4248509182 wait complete. 2024-08-01T06:54:17.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.511+0000 7ff30d374640 1 Processor -- start 2024-08-01T06:54:17.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.511+0000 7ff30d374640 1 -- start start 2024-08-01T06:54:17.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.512+0000 7ff30d374640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3080fde60 0x7ff308191970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.512+0000 7ff30d374640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff308100e40 0x7ff308191eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.512+0000 7ff30d374640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30818e460 con 0x7ff308100e40 2024-08-01T06:54:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.512+0000 7ff30d374640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30818e5d0 con 0x7ff3080fde60 2024-08-01T06:54:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.512+0000 7ff306ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3080fde60 0x7ff308191970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.512+0000 7ff3067fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff308100e40 0x7ff308191eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.512+0000 7ff306ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3080fde60 0x7ff308191970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:39618/0 (socket says 172.21.15.16:39618) 2024-08-01T06:54:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.512+0000 7ff306ffd640 1 -- 172.21.15.16:0/480997484 learned_addr learned my addr 172.21.15.16:0/480997484 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:54:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.512+0000 7ff306ffd640 1 -- 172.21.15.16:0/480997484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff308100e40 msgr2=0x7ff308191eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.512+0000 7ff306ffd640 1 --2- 172.21.15.16:0/480997484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff308100e40 0x7ff308191eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.512+0000 7ff306ffd640 1 -- 172.21.15.16:0/480997484 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc009560 con 0x7ff3080fde60 2024-08-01T06:54:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.512+0000 7ff306ffd640 1 --2- 172.21.15.16:0/480997484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3080fde60 0x7ff308191970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800e940 tx=0x7ff2f800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.513+0000 7ff2effff640 1 -- 172.21.15.16:0/480997484 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2f8009700 con 0x7ff3080fde60 2024-08-01T06:54:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.513+0000 7ff30d374640 1 -- 172.21.15.16:0/480997484 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff30818e8b0 con 0x7ff3080fde60 2024-08-01T06:54:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.513+0000 7ff2effff640 1 -- 172.21.15.16:0/480997484 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2f800cc90 con 0x7ff3080fde60 2024-08-01T06:54:17.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.513+0000 7ff2effff640 1 -- 172.21.15.16:0/480997484 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2f8010430 con 0x7ff3080fde60 2024-08-01T06:54:17.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.513+0000 7ff30d374640 1 -- 172.21.15.16:0/480997484 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff30818ee80 con 0x7ff3080fde60 2024-08-01T06:54:17.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.514+0000 7ff30d374640 1 -- 172.21.15.16:0/480997484 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f4005280 con 0x7ff3080fde60 2024-08-01T06:54:17.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.515+0000 7ff2effff640 1 -- 172.21.15.16:0/480997484 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff2f8004020 con 0x7ff3080fde60 2024-08-01T06:54:17.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.516+0000 7ff2effff640 1 --2- 172.21.15.16:0/480997484 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff2f006cc50 0x7ff2f006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:17.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.516+0000 7ff2effff640 1 -- 172.21.15.16:0/480997484 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff2f8014070 con 0x7ff3080fde60 2024-08-01T06:54:17.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.516+0000 7ff3067fc640 1 --2- 172.21.15.16:0/480997484 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff2f006cc50 0x7ff2f006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:17.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.516+0000 7ff3067fc640 1 --2- 172.21.15.16:0/480997484 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff2f006cc50 0x7ff2f006f110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff30818f8f0 tx=0x7ff2fc005df0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:17.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.520+0000 7ff2effff640 1 -- 172.21.15.16:0/480997484 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7ff2f80569a0 con 0x7ff3080fde60 2024-08-01T06:54:17.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.824+0000 7ff30d374640 1 -- 172.21.15.16:0/480997484 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff2f4005530 con 0x7ff3080fde60 2024-08-01T06:54:17.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.824+0000 7ff2effff640 1 -- 172.21.15.16:0/480997484 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff2f8059fc0 con 0x7ff3080fde60 2024-08-01T06:54:17.826 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-08-01T06:54:17.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.827+0000 7ff30d374640 1 -- 172.21.15.16:0/480997484 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff2f006cc50 msgr2=0x7ff2f006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:17.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.827+0000 7ff30d374640 1 --2- 172.21.15.16:0/480997484 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff2f006cc50 0x7ff2f006f110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff30818f8f0 tx=0x7ff2fc005df0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.827+0000 7ff30d374640 1 -- 172.21.15.16:0/480997484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3080fde60 msgr2=0x7ff308191970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:17.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.827+0000 7ff30d374640 1 --2- 172.21.15.16:0/480997484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3080fde60 0x7ff308191970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800e940 tx=0x7ff2f800ee00 comp rx=0 tx=0).stop 2024-08-01T06:54:17.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.827+0000 7ff30d374640 1 -- 172.21.15.16:0/480997484 shutdown_connections 2024-08-01T06:54:17.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.827+0000 7ff30d374640 1 --2- 172.21.15.16:0/480997484 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff2f006cc50 0x7ff2f006f110 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.827+0000 7ff30d374640 1 --2- 172.21.15.16:0/480997484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff308100e40 0x7ff308191eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.827+0000 7ff30d374640 1 --2- 172.21.15.16:0/480997484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3080fde60 0x7ff308191970 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:17.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.827+0000 7ff30d374640 1 -- 172.21.15.16:0/480997484 >> 172.21.15.16:0/480997484 conn(0x7ff3080f99b0 msgr2=0x7ff3080ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:17.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.827+0000 7ff30d374640 1 -- 172.21.15.16:0/480997484 shutdown_connections 2024-08-01T06:54:17.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:17.827+0000 7ff30d374640 1 -- 172.21.15.16:0/480997484 wait complete. 2024-08-01T06:54:17.986 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:17 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3433595481' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:54:17.987 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:17 smithi016 ceph-mon[29266]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:54:17.987 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:17 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:54:18.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:17 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/3433595481' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:54:18.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:17 smithi089 ceph-mon[36617]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:54:18.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:17 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:54:19.116 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:18 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/480997484' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:54:19.116 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:18 smithi016 ceph-mon[29266]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-01T06:54:19.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:18 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/480997484' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:54:19.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:18 smithi089 ceph-mon[36617]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-01T06:54:20.955 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:20 smithi089 ceph-mon[36617]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2024-08-01T06:54:21.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:20 smithi016 ceph-mon[29266]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2024-08-01T06:54:23.092 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:22 smithi016 ceph-mon[29266]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-08-01T06:54:23.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:22 smithi089 ceph-mon[36617]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-08-01T06:54:24.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:24 smithi016 ceph-mon[29266]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T06:54:25.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:24 smithi089 ceph-mon[36617]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T06:54:27.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:26 smithi089 ceph-mon[36617]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:54:27.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:26 smithi016 ceph-mon[29266]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:54:29.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:28 smithi089 ceph-mon[36617]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:54:29.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:28 smithi016 ceph-mon[29266]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:54:31.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:30 smithi089 ceph-mon[36617]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:54:31.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:30 smithi016 ceph-mon[29266]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:54:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:32 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:54:32.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:32 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:54:33.629 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:33 smithi016 ceph-mon[29266]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T06:54:33.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:33 smithi089 ceph-mon[36617]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T06:54:35.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:35 smithi089 ceph-mon[36617]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T06:54:35.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:35 smithi016 ceph-mon[29266]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T06:54:36.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:36 smithi016 ceph-mon[29266]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:54:37.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:36 smithi089 ceph-mon[36617]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:54:38.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:38 smithi016 ceph-mon[29266]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:54:38.939 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:38 smithi089 ceph-mon[36617]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:54:41.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:40 smithi089 ceph-mon[36617]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:54:41.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:40 smithi016 ceph-mon[29266]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:54:43.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:42 smithi089 ceph-mon[36617]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T06:54:43.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:42 smithi016 ceph-mon[29266]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T06:54:44.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:44 smithi016 ceph-mon[29266]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T06:54:45.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:44 smithi089 ceph-mon[36617]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T06:54:47.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:46 smithi089 ceph-mon[36617]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:54:47.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:46 smithi016 ceph-mon[29266]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:54:47.959 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:47 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:54:47.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.957+0000 7f8a51537640 1 -- 172.21.15.16:0/1711868712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4c100d90 msgr2=0x7f8a4c101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:47.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.957+0000 7f8a51537640 1 --2- 172.21.15.16:0/1711868712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4c100d90 0x7f8a4c101210 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009880 tx=0x7f8a4002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:54:47.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.958+0000 7f8a51537640 1 -- 172.21.15.16:0/1711868712 shutdown_connections 2024-08-01T06:54:47.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.958+0000 7f8a51537640 1 --2- 172.21.15.16:0/1711868712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4c100d90 0x7f8a4c101210 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:47.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.958+0000 7f8a51537640 1 --2- 172.21.15.16:0/1711868712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a4c0ffb90 0x7f8a4c0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:47.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.958+0000 7f8a51537640 1 -- 172.21.15.16:0/1711868712 >> 172.21.15.16:0/1711868712 conn(0x7f8a4c0fb320 msgr2=0x7f8a4c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:47.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.958+0000 7f8a51537640 1 -- 172.21.15.16:0/1711868712 shutdown_connections 2024-08-01T06:54:47.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.958+0000 7f8a51537640 1 -- 172.21.15.16:0/1711868712 wait complete. 2024-08-01T06:54:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.959+0000 7f8a51537640 1 Processor -- start 2024-08-01T06:54:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.959+0000 7f8a51537640 1 -- start start 2024-08-01T06:54:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.960+0000 7f8a51537640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4c0ffb90 0x7f8a4c074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.960+0000 7f8a4affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4c0ffb90 0x7f8a4c074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.960+0000 7f8a4affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4c0ffb90 0x7f8a4c074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44324/0 (socket says 172.21.15.16:44324) 2024-08-01T06:54:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.960+0000 7f8a4affd640 1 -- 172.21.15.16:0/279824257 learned_addr learned my addr 172.21.15.16:0/279824257 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:54:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.960+0000 7f8a51537640 1 --2- 172.21.15.16:0/279824257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a4c100d90 0x7f8a4c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.960+0000 7f8a51537640 1 -- 172.21.15.16:0/279824257 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c072de0 con 0x7f8a4c0ffb90 2024-08-01T06:54:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.960+0000 7f8a51537640 1 -- 172.21.15.16:0/279824257 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c072f50 con 0x7f8a4c100d90 2024-08-01T06:54:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.961+0000 7f8a4affd640 1 -- 172.21.15.16:0/279824257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a4c100d90 msgr2=0x7f8a4c0728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.961+0000 7f8a4affd640 1 --2- 172.21.15.16:0/279824257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a4c100d90 0x7f8a4c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.961+0000 7f8a4affd640 1 -- 172.21.15.16:0/279824257 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a40009560 con 0x7f8a4c0ffb90 2024-08-01T06:54:47.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.961+0000 7f8a4affd640 1 --2- 172.21.15.16:0/279824257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4c0ffb90 0x7f8a4c074250 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00ecb0 tx=0x7f8a3c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:47.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.961+0000 7f8a33fff640 1 -- 172.21.15.16:0/279824257 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a3c009700 con 0x7f8a4c0ffb90 2024-08-01T06:54:47.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.961+0000 7f8a51537640 1 -- 172.21.15.16:0/279824257 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4c073230 con 0x7f8a4c0ffb90 2024-08-01T06:54:47.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.961+0000 7f8a33fff640 1 -- 172.21.15.16:0/279824257 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a3c00eda0 con 0x7f8a4c0ffb90 2024-08-01T06:54:47.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.961+0000 7f8a33fff640 1 -- 172.21.15.16:0/279824257 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a3c010660 con 0x7f8a4c0ffb90 2024-08-01T06:54:47.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.961+0000 7f8a51537640 1 -- 172.21.15.16:0/279824257 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4c19d650 con 0x7f8a4c0ffb90 2024-08-01T06:54:47.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.963+0000 7f8a51537640 1 -- 172.21.15.16:0/279824257 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4c18f710 con 0x7f8a4c0ffb90 2024-08-01T06:54:47.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.964+0000 7f8a33fff640 1 -- 172.21.15.16:0/279824257 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8a3c003e40 con 0x7f8a4c0ffb90 2024-08-01T06:54:47.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.964+0000 7f8a33fff640 1 --2- 172.21.15.16:0/279824257 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f8a3406cc50 0x7f8a3406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:47.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.965+0000 7f8a33fff640 1 -- 172.21.15.16:0/279824257 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f8a3c014070 con 0x7f8a4c0ffb90 2024-08-01T06:54:47.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.965+0000 7f8a4a7fc640 1 --2- 172.21.15.16:0/279824257 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f8a3406cc50 0x7f8a3406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:47.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.966+0000 7f8a4a7fc640 1 --2- 172.21.15.16:0/279824257 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f8a3406cc50 0x7f8a3406f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8a4002a9c0 tx=0x7f8a40000bc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:47.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:47.973+0000 7f8a33fff640 1 -- 172.21.15.16:0/279824257 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f8a3c056bc0 con 0x7f8a4c0ffb90 2024-08-01T06:54:48.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:47 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:54:48.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.353+0000 7f8a51537640 1 -- 172.21.15.16:0/279824257 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a4c02c4f0 con 0x7f8a3406cc50 2024-08-01T06:54:48.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.354+0000 7f8a33fff640 1 -- 172.21.15.16:0/279824257 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f8a4c02c4f0 con 0x7f8a3406cc50 2024-08-01T06:54:48.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.357+0000 7f8a51537640 1 -- 172.21.15.16:0/279824257 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f8a3406cc50 msgr2=0x7f8a3406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:48.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.357+0000 7f8a51537640 1 --2- 172.21.15.16:0/279824257 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f8a3406cc50 0x7f8a3406f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8a4002a9c0 tx=0x7f8a40000bc0 comp rx=0 tx=0).stop 2024-08-01T06:54:48.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.357+0000 7f8a51537640 1 -- 172.21.15.16:0/279824257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4c0ffb90 msgr2=0x7f8a4c074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:48.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.357+0000 7f8a51537640 1 --2- 172.21.15.16:0/279824257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4c0ffb90 0x7f8a4c074250 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00ecb0 tx=0x7f8a3c00c6a0 comp rx=0 tx=0).stop 2024-08-01T06:54:48.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.358+0000 7f8a51537640 1 -- 172.21.15.16:0/279824257 shutdown_connections 2024-08-01T06:54:48.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.358+0000 7f8a51537640 1 --2- 172.21.15.16:0/279824257 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f8a3406cc50 0x7f8a3406f110 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:48.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.358+0000 7f8a51537640 1 --2- 172.21.15.16:0/279824257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a4c100d90 0x7f8a4c0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:48.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.358+0000 7f8a51537640 1 --2- 172.21.15.16:0/279824257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4c0ffb90 0x7f8a4c074250 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:48.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.358+0000 7f8a51537640 1 -- 172.21.15.16:0/279824257 >> 172.21.15.16:0/279824257 conn(0x7f8a4c0fb320 msgr2=0x7f8a4c104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:48.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.358+0000 7f8a51537640 1 -- 172.21.15.16:0/279824257 shutdown_connections 2024-08-01T06:54:48.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.358+0000 7f8a51537640 1 -- 172.21.15.16:0/279824257 wait complete. 2024-08-01T06:54:48.371 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T06:54:48.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.489+0000 7f4756a2c640 1 -- 172.21.15.16:0/3765809121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47500ffcf0 msgr2=0x7f4750100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:48.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.489+0000 7f4756a2c640 1 --2- 172.21.15.16:0/3765809121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47500ffcf0 0x7f4750100170 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4744009880 tx=0x7f474402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:54:48.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.489+0000 7f4756a2c640 1 -- 172.21.15.16:0/3765809121 shutdown_connections 2024-08-01T06:54:48.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.489+0000 7f4756a2c640 1 --2- 172.21.15.16:0/3765809121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47500ffcf0 0x7f4750100170 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:48.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.489+0000 7f4756a2c640 1 --2- 172.21.15.16:0/3765809121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47500feaf0 0x7f47500feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:48.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.489+0000 7f4756a2c640 1 -- 172.21.15.16:0/3765809121 >> 172.21.15.16:0/3765809121 conn(0x7f47500fa280 msgr2=0x7f47500fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:48.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.490+0000 7f4756a2c640 1 -- 172.21.15.16:0/3765809121 shutdown_connections 2024-08-01T06:54:48.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.490+0000 7f4756a2c640 1 -- 172.21.15.16:0/3765809121 wait complete. 2024-08-01T06:54:48.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.491+0000 7f4756a2c640 1 Processor -- start 2024-08-01T06:54:48.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.491+0000 7f4756a2c640 1 -- start start 2024-08-01T06:54:48.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.492+0000 7f4756a2c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47500feaf0 0x7f47501945f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:48.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.492+0000 7f4756a2c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47500ffcf0 0x7f4750194b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:48.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.492+0000 7f4756a2c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4750195100 con 0x7f47500ffcf0 2024-08-01T06:54:48.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.492+0000 7f474ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47500feaf0 0x7f47501945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:48.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.492+0000 7f4756a2c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4750195270 con 0x7f47500feaf0 2024-08-01T06:54:48.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.492+0000 7f474ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47500feaf0 0x7f47501945f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:36902/0 (socket says 172.21.15.16:36902) 2024-08-01T06:54:48.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.492+0000 7f474ffff640 1 -- 172.21.15.16:0/4147615356 learned_addr learned my addr 172.21.15.16:0/4147615356 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:54:48.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.492+0000 7f474f7fe640 1 --2- 172.21.15.16:0/4147615356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47500ffcf0 0x7f4750194b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:48.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.493+0000 7f474ffff640 1 -- 172.21.15.16:0/4147615356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47500ffcf0 msgr2=0x7f4750194b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:48.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.493+0000 7f474ffff640 1 --2- 172.21.15.16:0/4147615356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47500ffcf0 0x7f4750194b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:48.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.493+0000 7f474ffff640 1 -- 172.21.15.16:0/4147615356 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4744009560 con 0x7f47500feaf0 2024-08-01T06:54:48.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.493+0000 7f474f7fe640 1 --2- 172.21.15.16:0/4147615356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47500ffcf0 0x7f4750194b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T06:54:48.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.494+0000 7f474ffff640 1 --2- 172.21.15.16:0/4147615356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47500feaf0 0x7f47501945f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f474000e940 tx=0x7f474000ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:48.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.494+0000 7f474d7fa640 1 -- 172.21.15.16:0/4147615356 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47400096e0 con 0x7f47500feaf0 2024-08-01T06:54:48.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.494+0000 7f474d7fa640 1 -- 172.21.15.16:0/4147615356 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f47400044f0 con 0x7f47500feaf0 2024-08-01T06:54:48.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.494+0000 7f4756a2c640 1 -- 172.21.15.16:0/4147615356 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4750067d50 con 0x7f47500feaf0 2024-08-01T06:54:48.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.495+0000 7f474d7fa640 1 -- 172.21.15.16:0/4147615356 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4740010430 con 0x7f47500feaf0 2024-08-01T06:54:48.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.495+0000 7f4756a2c640 1 -- 172.21.15.16:0/4147615356 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4750068270 con 0x7f47500feaf0 2024-08-01T06:54:48.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.497+0000 7f4756a2c640 1 -- 172.21.15.16:0/4147615356 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47500feef0 con 0x7f47500feaf0 2024-08-01T06:54:48.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.498+0000 7f474d7fa640 1 -- 172.21.15.16:0/4147615356 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f474000cc90 con 0x7f47500feaf0 2024-08-01T06:54:48.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.498+0000 7f474d7fa640 1 --2- 172.21.15.16:0/4147615356 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f473806caa0 0x7f473806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:48.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.498+0000 7f474d7fa640 1 -- 172.21.15.16:0/4147615356 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f4740014070 con 0x7f47500feaf0 2024-08-01T06:54:48.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.499+0000 7f474f7fe640 1 --2- 172.21.15.16:0/4147615356 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f473806caa0 0x7f473806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:48.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.499+0000 7f474f7fe640 1 --2- 172.21.15.16:0/4147615356 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f473806caa0 0x7f473806ef60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4744009230 tx=0x7f47440058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:48.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.507+0000 7f474d7fa640 1 -- 172.21.15.16:0/4147615356 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f4740056a30 con 0x7f47500feaf0 2024-08-01T06:54:48.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.865+0000 7f4756a2c640 1 -- 172.21.15.16:0/4147615356 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f475018e2f0 con 0x7f473806caa0 2024-08-01T06:54:48.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.866+0000 7f474d7fa640 1 -- 172.21.15.16:0/4147615356 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f475018e2f0 con 0x7f473806caa0 2024-08-01T06:54:48.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.869+0000 7f4756a2c640 1 -- 172.21.15.16:0/4147615356 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f473806caa0 msgr2=0x7f473806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:48.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.869+0000 7f4756a2c640 1 --2- 172.21.15.16:0/4147615356 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f473806caa0 0x7f473806ef60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4744009230 tx=0x7f47440058d0 comp rx=0 tx=0).stop 2024-08-01T06:54:48.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.869+0000 7f4756a2c640 1 -- 172.21.15.16:0/4147615356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47500feaf0 msgr2=0x7f47501945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:48.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.869+0000 7f4756a2c640 1 --2- 172.21.15.16:0/4147615356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47500feaf0 0x7f47501945f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f474000e940 tx=0x7f474000ee00 comp rx=0 tx=0).stop 2024-08-01T06:54:48.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.869+0000 7f4756a2c640 1 -- 172.21.15.16:0/4147615356 shutdown_connections 2024-08-01T06:54:48.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.869+0000 7f4756a2c640 1 --2- 172.21.15.16:0/4147615356 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f473806caa0 0x7f473806ef60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:48.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.869+0000 7f4756a2c640 1 --2- 172.21.15.16:0/4147615356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47500ffcf0 0x7f4750194b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:48.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.870+0000 7f4756a2c640 1 --2- 172.21.15.16:0/4147615356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47500feaf0 0x7f47501945f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:48.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.870+0000 7f4756a2c640 1 -- 172.21.15.16:0/4147615356 >> 172.21.15.16:0/4147615356 conn(0x7f47500fa280 msgr2=0x7f47501033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:48.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.870+0000 7f4756a2c640 1 -- 172.21.15.16:0/4147615356 shutdown_connections 2024-08-01T06:54:48.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.870+0000 7f4756a2c640 1 -- 172.21.15.16:0/4147615356 wait complete. 2024-08-01T06:54:48.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.957+0000 7f43a1a8b640 1 -- 172.21.15.16:0/1028503186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0fede0 msgr2=0x7f439c0ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:48.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.957+0000 7f43a1a8b640 1 --2- 172.21.15.16:0/1028503186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0fede0 0x7f439c0ff240 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4390009880 tx=0x7f439002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:54:48.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.957+0000 7f43a1a8b640 1 -- 172.21.15.16:0/1028503186 shutdown_connections 2024-08-01T06:54:48.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.957+0000 7f43a1a8b640 1 --2- 172.21.15.16:0/1028503186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0fede0 0x7f439c0ff240 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:48.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.957+0000 7f43a1a8b640 1 --2- 172.21.15.16:0/1028503186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f439c0fe4a0 0x7f439c0fe8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:48.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.957+0000 7f43a1a8b640 1 -- 172.21.15.16:0/1028503186 >> 172.21.15.16:0/1028503186 conn(0x7f439c0fa230 msgr2=0x7f439c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:48.960 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:48 smithi016 ceph-mon[29266]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:54:48.960 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:48 smithi016 ceph-mon[29266]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:54:48.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.958+0000 7f43a1a8b640 1 -- 172.21.15.16:0/1028503186 shutdown_connections 2024-08-01T06:54:48.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.958+0000 7f43a1a8b640 1 -- 172.21.15.16:0/1028503186 wait complete. 2024-08-01T06:54:48.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.959+0000 7f43a1a8b640 1 Processor -- start 2024-08-01T06:54:48.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.959+0000 7f43a1a8b640 1 -- start start 2024-08-01T06:54:48.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.959+0000 7f43a1a8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f439c0fe4a0 0x7f439c197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:48.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.959+0000 7f43a1a8b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0fede0 0x7f439c197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:48.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.959+0000 7f43a1a8b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c198360 con 0x7f439c0fede0 2024-08-01T06:54:48.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.959+0000 7f43a1a8b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c1984d0 con 0x7f439c0fe4a0 2024-08-01T06:54:48.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.959+0000 7f439b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f439c0fe4a0 0x7f439c197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:48.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.959+0000 7f439affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0fede0 0x7f439c197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:48.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.960+0000 7f439b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f439c0fe4a0 0x7f439c197850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:42540/0 (socket says 172.21.15.16:42540) 2024-08-01T06:54:48.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.960+0000 7f439affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0fede0 0x7f439c197d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41642/0 (socket says 172.21.15.16:41642) 2024-08-01T06:54:48.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.960+0000 7f439b7fe640 1 -- 172.21.15.16:0/4132810053 learned_addr learned my addr 172.21.15.16:0/4132810053 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:54:48.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.960+0000 7f439b7fe640 1 -- 172.21.15.16:0/4132810053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0fede0 msgr2=0x7f439c197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:48.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.960+0000 7f439b7fe640 1 --2- 172.21.15.16:0/4132810053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0fede0 0x7f439c197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:48.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.960+0000 7f439b7fe640 1 -- 172.21.15.16:0/4132810053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4390009560 con 0x7f439c0fe4a0 2024-08-01T06:54:48.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.960+0000 7f439affd640 1 --2- 172.21.15.16:0/4132810053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0fede0 0x7f439c197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T06:54:48.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.960+0000 7f439b7fe640 1 --2- 172.21.15.16:0/4132810053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f439c0fe4a0 0x7f439c197850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f438c00e970 tx=0x7f438c00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:48.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.960+0000 7f4398ff9640 1 -- 172.21.15.16:0/4132810053 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f438c00cc90 con 0x7f439c0fe4a0 2024-08-01T06:54:48.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.961+0000 7f4398ff9640 1 -- 172.21.15.16:0/4132810053 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f438c00cdf0 con 0x7f439c0fe4a0 2024-08-01T06:54:48.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.961+0000 7f43a1a8b640 1 -- 172.21.15.16:0/4132810053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439c19cf20 con 0x7f439c0fe4a0 2024-08-01T06:54:48.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.961+0000 7f4398ff9640 1 -- 172.21.15.16:0/4132810053 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f438c018810 con 0x7f439c0fe4a0 2024-08-01T06:54:48.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.961+0000 7f43a1a8b640 1 -- 172.21.15.16:0/4132810053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439c19d460 con 0x7f439c0fe4a0 2024-08-01T06:54:48.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.962+0000 7f43a1a8b640 1 -- 172.21.15.16:0/4132810053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f439c0fe8a0 con 0x7f439c0fe4a0 2024-08-01T06:54:48.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.963+0000 7f4398ff9640 1 -- 172.21.15.16:0/4132810053 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f438c010c10 con 0x7f439c0fe4a0 2024-08-01T06:54:48.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.963+0000 7f4398ff9640 1 --2- 172.21.15.16:0/4132810053 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f438406cc50 0x7f438406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:48.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.964+0000 7f4398ff9640 1 -- 172.21.15.16:0/4132810053 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f438c014070 con 0x7f439c0fe4a0 2024-08-01T06:54:48.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.964+0000 7f439affd640 1 --2- 172.21.15.16:0/4132810053 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f438406cc50 0x7f438406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:48.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.964+0000 7f439affd640 1 --2- 172.21.15.16:0/4132810053 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f438406cc50 0x7f438406f110 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4390000c00 tx=0x7f43900314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:48.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:48.971+0000 7f4398ff9640 1 -- 172.21.15.16:0/4132810053 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f438c052de0 con 0x7f439c0fe4a0 2024-08-01T06:54:49.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:48 smithi089 ceph-mon[36617]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:54:49.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:48 smithi089 ceph-mon[36617]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:54:49.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.338+0000 7f43a1a8b640 1 -- 172.21.15.16:0/4132810053 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f439c02c550 con 0x7f438406cc50 2024-08-01T06:54:49.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.355+0000 7f4398ff9640 1 -- 172.21.15.16:0/4132810053 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f439c02c550 con 0x7f438406cc50 2024-08-01T06:54:49.357 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T06:54:49.357 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (5m) 64s ago 6m 25.5M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T06:54:49.357 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (7m) 64s ago 7m 7554k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T06:54:49.357 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (6m) 70s ago 6m 7541k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T06:54:49.357 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (7m) 64s ago 7m 6895k - 18.2.2-1767-ga3bbd728 d280790d1980 81c723a6ae35 2024-08-01T06:54:49.358 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (6m) 70s ago 6m 6891k - 18.2.2-1767-ga3bbd728 d280790d1980 73e7778d1e26 2024-08-01T06:54:49.358 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (5m) 64s ago 6m 82.9M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T06:54:49.358 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (91s) 64s ago 91s 12.5M - 18.2.2-1767-ga3bbd728 d280790d1980 96e46c28d16c 2024-08-01T06:54:49.358 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (85s) 64s ago 85s 18.4M - 18.2.2-1767-ga3bbd728 d280790d1980 4bbe1a388689 2024-08-01T06:54:49.358 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (89s) 70s ago 88s 16.7M - 18.2.2-1767-ga3bbd728 d280790d1980 65ca121a6fbb 2024-08-01T06:54:49.358 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (83s) 70s ago 82s 14.0M - 18.2.2-1767-ga3bbd728 d280790d1980 05bb46c6fe94 2024-08-01T06:54:49.358 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:9283,8765,8443 running (8m) 64s ago 8m 487M - 18.2.2-1767-ga3bbd728 d280790d1980 3cf8ca2d43c6 2024-08-01T06:54:49.358 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (5m) 70s ago 5m 441M - 18.2.2-1767-ga3bbd728 d280790d1980 c70860f1020b 2024-08-01T06:54:49.358 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (8m) 64s ago 8m 49.4M 2048M 18.2.2-1767-ga3bbd728 d280790d1980 e6a2e5d7eeec 2024-08-01T06:54:49.358 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (5m) 70s ago 5m 35.5M 2048M 18.2.2-1767-ga3bbd728 d280790d1980 9ca9e3e814cb 2024-08-01T06:54:49.358 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (6m) 64s ago 6m 15.7M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T06:54:49.358 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (5m) 70s ago 5m 16.7M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T06:54:49.358 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (5m) 64s ago 5m 54.0M 3948M 18.2.2-1767-ga3bbd728 d280790d1980 9b7157499583 2024-08-01T06:54:49.358 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (4m) 64s ago 4m 48.8M 3948M 18.2.2-1767-ga3bbd728 d280790d1980 f3b050aed6b7 2024-08-01T06:54:49.359 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (4m) 64s ago 4m 53.4M 3948M 18.2.2-1767-ga3bbd728 d280790d1980 33a72e1a5c91 2024-08-01T06:54:49.359 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (3m) 70s ago 3m 45.6M 4970M 18.2.2-1767-ga3bbd728 d280790d1980 58c175e0f4eb 2024-08-01T06:54:49.359 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (3m) 70s ago 3m 50.9M 4970M 18.2.2-1767-ga3bbd728 d280790d1980 15b8f910bad7 2024-08-01T06:54:49.359 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (2m) 70s ago 2m 51.0M 4970M 18.2.2-1767-ga3bbd728 d280790d1980 ac887841899e 2024-08-01T06:54:49.359 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (5m) 64s ago 6m 60.3M - 2.43.0 a07b618ecd1d 2b370118fafe 2024-08-01T06:54:49.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.358+0000 7f43a1a8b640 1 -- 172.21.15.16:0/4132810053 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f438406cc50 msgr2=0x7f438406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:49.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.358+0000 7f43a1a8b640 1 --2- 172.21.15.16:0/4132810053 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f438406cc50 0x7f438406f110 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4390000c00 tx=0x7f43900314e0 comp rx=0 tx=0).stop 2024-08-01T06:54:49.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.358+0000 7f43a1a8b640 1 -- 172.21.15.16:0/4132810053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f439c0fe4a0 msgr2=0x7f439c197850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:49.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.358+0000 7f43a1a8b640 1 --2- 172.21.15.16:0/4132810053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f439c0fe4a0 0x7f439c197850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f438c00e970 tx=0x7f438c00ee30 comp rx=0 tx=0).stop 2024-08-01T06:54:49.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.358+0000 7f43a1a8b640 1 -- 172.21.15.16:0/4132810053 shutdown_connections 2024-08-01T06:54:49.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.358+0000 7f43a1a8b640 1 --2- 172.21.15.16:0/4132810053 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f438406cc50 0x7f438406f110 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:49.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.358+0000 7f43a1a8b640 1 --2- 172.21.15.16:0/4132810053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0fede0 0x7f439c197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:49.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.358+0000 7f43a1a8b640 1 --2- 172.21.15.16:0/4132810053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f439c0fe4a0 0x7f439c197850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:49.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.358+0000 7f43a1a8b640 1 -- 172.21.15.16:0/4132810053 >> 172.21.15.16:0/4132810053 conn(0x7f439c0fa230 msgr2=0x7f439c106fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:49.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.358+0000 7f43a1a8b640 1 -- 172.21.15.16:0/4132810053 shutdown_connections 2024-08-01T06:54:49.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.358+0000 7f43a1a8b640 1 -- 172.21.15.16:0/4132810053 wait complete. 2024-08-01T06:54:49.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.447+0000 7fd2a5842640 1 -- 172.21.15.16:0/3092992026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2a0100680 msgr2=0x7fd2a0102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.447+0000 7fd2a5842640 1 --2- 172.21.15.16:0/3092992026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2a0100680 0x7fd2a0102a70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd2900098b0 tx=0x7fd29002a4d0 comp rx=0 tx=0).stop 2024-08-01T06:54:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.448+0000 7fd2a5842640 1 -- 172.21.15.16:0/3092992026 shutdown_connections 2024-08-01T06:54:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.448+0000 7fd2a5842640 1 --2- 172.21.15.16:0/3092992026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2a0102fb0 0x7fd2a01053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.448+0000 7fd2a5842640 1 --2- 172.21.15.16:0/3092992026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2a0100680 0x7fd2a0102a70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.448+0000 7fd2a5842640 1 -- 172.21.15.16:0/3092992026 >> 172.21.15.16:0/3092992026 conn(0x7fd2a00fa280 msgr2=0x7fd2a00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.448+0000 7fd2a5842640 1 -- 172.21.15.16:0/3092992026 shutdown_connections 2024-08-01T06:54:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.448+0000 7fd2a5842640 1 -- 172.21.15.16:0/3092992026 wait complete. 2024-08-01T06:54:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.449+0000 7fd2a5842640 1 Processor -- start 2024-08-01T06:54:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.449+0000 7fd2a5842640 1 -- start start 2024-08-01T06:54:49.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.449+0000 7fd2a5842640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2a0100680 0x7fd2a01954e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.449+0000 7fd2a5842640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2a0102fb0 0x7fd2a0195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.450+0000 7fd29effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2a0100680 0x7fd2a01954e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.450+0000 7fd29effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2a0100680 0x7fd2a01954e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:42558/0 (socket says 172.21.15.16:42558) 2024-08-01T06:54:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.450+0000 7fd29effd640 1 -- 172.21.15.16:0/926825092 learned_addr learned my addr 172.21.15.16:0/926825092 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:54:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.450+0000 7fd2a5842640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a0195ff0 con 0x7fd2a0102fb0 2024-08-01T06:54:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.450+0000 7fd2a5842640 1 -- 172.21.15.16:0/926825092 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a0196160 con 0x7fd2a0100680 2024-08-01T06:54:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.450+0000 7fd29e7fc640 1 --2- 172.21.15.16:0/926825092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2a0102fb0 0x7fd2a0195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.450+0000 7fd29effd640 1 -- 172.21.15.16:0/926825092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2a0102fb0 msgr2=0x7fd2a0195a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.450+0000 7fd29effd640 1 --2- 172.21.15.16:0/926825092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2a0102fb0 0x7fd2a0195a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.450+0000 7fd29effd640 1 -- 172.21.15.16:0/926825092 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd290009560 con 0x7fd2a0100680 2024-08-01T06:54:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.450+0000 7fd29effd640 1 --2- 172.21.15.16:0/926825092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2a0100680 0x7fd2a01954e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd2900045e0 tx=0x7fd290004610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:49.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.451+0000 7fd2a4840640 1 -- 172.21.15.16:0/926825092 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2900053e0 con 0x7fd2a0100680 2024-08-01T06:54:49.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.451+0000 7fd2a5842640 1 -- 172.21.15.16:0/926825092 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a019aba0 con 0x7fd2a0100680 2024-08-01T06:54:49.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.451+0000 7fd2a5842640 1 -- 172.21.15.16:0/926825092 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a019b090 con 0x7fd2a0100680 2024-08-01T06:54:49.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.451+0000 7fd2a4840640 1 -- 172.21.15.16:0/926825092 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd290005540 con 0x7fd2a0100680 2024-08-01T06:54:49.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.451+0000 7fd2a4840640 1 -- 172.21.15.16:0/926825092 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd290003b10 con 0x7fd2a0100680 2024-08-01T06:54:49.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.452+0000 7fd2a5842640 1 -- 172.21.15.16:0/926825092 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28c005280 con 0x7fd2a0100680 2024-08-01T06:54:49.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.453+0000 7fd2a4840640 1 -- 172.21.15.16:0/926825092 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd290003c70 con 0x7fd2a0100680 2024-08-01T06:54:49.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.454+0000 7fd2a4840640 1 --2- 172.21.15.16:0/926825092 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd28806cca0 0x7fd28806f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:49.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.454+0000 7fd2a4840640 1 -- 172.21.15.16:0/926825092 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd2900ad480 con 0x7fd2a0100680 2024-08-01T06:54:49.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.454+0000 7fd29e7fc640 1 --2- 172.21.15.16:0/926825092 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd28806cca0 0x7fd28806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:49.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.455+0000 7fd29e7fc640 1 --2- 172.21.15.16:0/926825092 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd28806cca0 0x7fd28806f160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0196a00 tx=0x7fd294005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:49.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.462+0000 7fd2a4840640 1 -- 172.21.15.16:0/926825092 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fd2900778b0 con 0x7fd2a0100680 2024-08-01T06:54:49.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.705+0000 7fd2a5842640 1 -- 172.21.15.16:0/926825092 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd28c005d40 con 0x7fd2a0100680 2024-08-01T06:54:49.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.706+0000 7fd2a4840640 1 -- 172.21.15.16:0/926825092 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fd29007aed0 con 0x7fd2a0100680 2024-08-01T06:54:49.708 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:54:49.708 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T06:54:49.708 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 2 2024-08-01T06:54:49.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:54:49.708 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T06:54:49.708 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 2 2024-08-01T06:54:49.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:54:49.708 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T06:54:49.708 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 6 2024-08-01T06:54:49.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:54:49.709 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T06:54:49.709 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4 2024-08-01T06:54:49.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:54:49.709 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T06:54:49.709 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 14 2024-08-01T06:54:49.709 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T06:54:49.709 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:54:49.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.708+0000 7fd2a5842640 1 -- 172.21.15.16:0/926825092 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd28806cca0 msgr2=0x7fd28806f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:49.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.708+0000 7fd2a5842640 1 --2- 172.21.15.16:0/926825092 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd28806cca0 0x7fd28806f160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0196a00 tx=0x7fd294005f90 comp rx=0 tx=0).stop 2024-08-01T06:54:49.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.708+0000 7fd2a5842640 1 -- 172.21.15.16:0/926825092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2a0100680 msgr2=0x7fd2a01954e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:49.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.708+0000 7fd2a5842640 1 --2- 172.21.15.16:0/926825092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2a0100680 0x7fd2a01954e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd2900045e0 tx=0x7fd290004610 comp rx=0 tx=0).stop 2024-08-01T06:54:49.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.708+0000 7fd2a5842640 1 -- 172.21.15.16:0/926825092 shutdown_connections 2024-08-01T06:54:49.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.708+0000 7fd2a5842640 1 --2- 172.21.15.16:0/926825092 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd28806cca0 0x7fd28806f160 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:49.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.708+0000 7fd2a5842640 1 --2- 172.21.15.16:0/926825092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2a0102fb0 0x7fd2a0195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:49.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.708+0000 7fd2a5842640 1 --2- 172.21.15.16:0/926825092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2a0100680 0x7fd2a01954e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:49.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.708+0000 7fd2a5842640 1 -- 172.21.15.16:0/926825092 >> 172.21.15.16:0/926825092 conn(0x7fd2a00fa280 msgr2=0x7fd2a00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:49.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.709+0000 7fd2a5842640 1 -- 172.21.15.16:0/926825092 shutdown_connections 2024-08-01T06:54:49.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.709+0000 7fd2a5842640 1 -- 172.21.15.16:0/926825092 wait complete. 2024-08-01T06:54:49.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.795+0000 7f78e7f34640 1 -- 172.21.15.16:0/2372475479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e00ffcf0 msgr2=0x7f78e0100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:49.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.795+0000 7f78e7f34640 1 --2- 172.21.15.16:0/2372475479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e00ffcf0 0x7f78e0100170 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009880 tx=0x7f78d002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:54:49.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.795+0000 7f78e7f34640 1 -- 172.21.15.16:0/2372475479 shutdown_connections 2024-08-01T06:54:49.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.795+0000 7f78e7f34640 1 --2- 172.21.15.16:0/2372475479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e00ffcf0 0x7f78e0100170 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:49.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.795+0000 7f78e7f34640 1 --2- 172.21.15.16:0/2372475479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e00feaf0 0x7f78e00feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:49.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.795+0000 7f78e7f34640 1 -- 172.21.15.16:0/2372475479 >> 172.21.15.16:0/2372475479 conn(0x7f78e00fa280 msgr2=0x7f78e00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:49.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.795+0000 7f78e7f34640 1 -- 172.21.15.16:0/2372475479 shutdown_connections 2024-08-01T06:54:49.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.795+0000 7f78e7f34640 1 -- 172.21.15.16:0/2372475479 wait complete. 2024-08-01T06:54:49.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.795+0000 7f78e7f34640 1 Processor -- start 2024-08-01T06:54:49.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.796+0000 7f78e7f34640 1 -- start start 2024-08-01T06:54:49.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.796+0000 7f78e7f34640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e00feaf0 0x7f78e0197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:49.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.796+0000 7f78e7f34640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e0198080 0x7f78e019d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:49.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.796+0000 7f78e7f34640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e0198500 con 0x7f78e0198080 2024-08-01T06:54:49.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.796+0000 7f78e7f34640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e0198670 con 0x7f78e00feaf0 2024-08-01T06:54:49.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.796+0000 7f78e54cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e0198080 0x7f78e019d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:49.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.796+0000 7f78e5cd0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e00feaf0 0x7f78e0197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:49.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.796+0000 7f78e54cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e0198080 0x7f78e019d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41686/0 (socket says 172.21.15.16:41686) 2024-08-01T06:54:49.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.796+0000 7f78e54cf640 1 -- 172.21.15.16:0/2477246021 learned_addr learned my addr 172.21.15.16:0/2477246021 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:54:49.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.796+0000 7f78e54cf640 1 -- 172.21.15.16:0/2477246021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e00feaf0 msgr2=0x7f78e0197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:49.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.796+0000 7f78e54cf640 1 --2- 172.21.15.16:0/2477246021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e00feaf0 0x7f78e0197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:49.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.796+0000 7f78e54cf640 1 -- 172.21.15.16:0/2477246021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d0009560 con 0x7f78e0198080 2024-08-01T06:54:49.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.797+0000 7f78e54cf640 1 --2- 172.21.15.16:0/2477246021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e0198080 0x7f78e019d0a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f78d0033000 tx=0x7f78d00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:49.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.798+0000 7f78d6ffd640 1 -- 172.21.15.16:0/2477246021 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78d0004aa0 con 0x7f78e0198080 2024-08-01T06:54:49.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.798+0000 7f78d6ffd640 1 -- 172.21.15.16:0/2477246021 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f78d0005d50 con 0x7f78e0198080 2024-08-01T06:54:49.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.798+0000 7f78d6ffd640 1 -- 172.21.15.16:0/2477246021 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78d0003940 con 0x7f78e0198080 2024-08-01T06:54:49.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.798+0000 7f78e7f34640 1 -- 172.21.15.16:0/2477246021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e019d5e0 con 0x7f78e0198080 2024-08-01T06:54:49.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.798+0000 7f78e7f34640 1 -- 172.21.15.16:0/2477246021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e019d9c0 con 0x7f78e0198080 2024-08-01T06:54:49.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.799+0000 7f78e7f34640 1 -- 172.21.15.16:0/2477246021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e0100170 con 0x7f78e0198080 2024-08-01T06:54:49.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.800+0000 7f78d6ffd640 1 -- 172.21.15.16:0/2477246021 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f78d0031b90 con 0x7f78e0198080 2024-08-01T06:54:49.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.801+0000 7f78d6ffd640 1 --2- 172.21.15.16:0/2477246021 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f78cc06cc50 0x7f78cc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:49.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.801+0000 7f78e5cd0640 1 --2- 172.21.15.16:0/2477246021 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f78cc06cc50 0x7f78cc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:49.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.801+0000 7f78d6ffd640 1 -- 172.21.15.16:0/2477246021 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f78d00ad2a0 con 0x7f78e0198080 2024-08-01T06:54:49.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.802+0000 7f78e5cd0640 1 --2- 172.21.15.16:0/2477246021 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f78cc06cc50 0x7f78cc06f110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f78e00ffb50 tx=0x7f78dc005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:49.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:49.805+0000 7f78d6ffd640 1 -- 172.21.15.16:0/2477246021 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f78d0077610 con 0x7f78e0198080 2024-08-01T06:54:50.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:49 smithi089 ceph-mon[36617]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:54:50.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:49 smithi089 ceph-mon[36617]: from='client.24375 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:54:50.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:49 smithi016 ceph-mon[29266]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:54:50.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:49 smithi016 ceph-mon[29266]: from='client.24375 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:54:50.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.202+0000 7f78e7f34640 1 -- 172.21.15.16:0/2477246021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f78e01078d0 con 0x7f78e0198080 2024-08-01T06:54:50.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.202+0000 7f78d6ffd640 1 -- 172.21.15.16:0/2477246021 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1868 (secure 0 0 0) 0x7f78d007ac30 con 0x7f78e0198080 2024-08-01T06:54:50.204 INFO:teuthology.orchestra.run.smithi016.stdout:e19 2024-08-01T06:54:50.204 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T06:54:50.204 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:54:50.204 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T06:54:50.204 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:54:50.204 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T06:54:50.205 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T06:54:50.205 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 19 2024-08-01T06:54:50.205 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T06:54:50.205 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T06:54:50.205 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T06:53:32.617145+0000 2024-08-01T06:54:50.205 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T06:54:50.205 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T06:54:50.205 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T06:54:50.205 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T06:54:50.205 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T06:54:50.205 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T06:54:50.205 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T06:54:50.205 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T06:54:50.205 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 46 2024-08-01T06:54:50.206 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:54:50.206 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T06:54:50.206 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T06:54:50.206 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=14482,1=24281} 2024-08-01T06:54:50.206 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T06:54:50.206 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T06:54:50.206 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T06:54:50.206 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T06:54:50.206 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T06:54:50.207 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T06:54:50.207 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T06:54:50.207 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T06:54:50.207 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T06:54:50.207 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:54:50.207 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:24299} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:54:50.207 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{1:24281} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:54:50.207 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:24291} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:54:50.207 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:54:50.207 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:54:50.208 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-08-01T06:54:50.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.205+0000 7f78e7f34640 1 -- 172.21.15.16:0/2477246021 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f78cc06cc50 msgr2=0x7f78cc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:50.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.205+0000 7f78e7f34640 1 --2- 172.21.15.16:0/2477246021 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f78cc06cc50 0x7f78cc06f110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f78e00ffb50 tx=0x7f78dc005f90 comp rx=0 tx=0).stop 2024-08-01T06:54:50.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.205+0000 7f78e7f34640 1 -- 172.21.15.16:0/2477246021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e0198080 msgr2=0x7f78e019d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:50.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.205+0000 7f78e7f34640 1 --2- 172.21.15.16:0/2477246021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e0198080 0x7f78e019d0a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f78d0033000 tx=0x7f78d00055a0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.205+0000 7f78e7f34640 1 -- 172.21.15.16:0/2477246021 shutdown_connections 2024-08-01T06:54:50.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.205+0000 7f78e7f34640 1 --2- 172.21.15.16:0/2477246021 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f78cc06cc50 0x7f78cc06f110 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.205+0000 7f78e7f34640 1 --2- 172.21.15.16:0/2477246021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e0198080 0x7f78e019d0a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.205+0000 7f78e7f34640 1 --2- 172.21.15.16:0/2477246021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e00feaf0 0x7f78e0197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.205+0000 7f78e7f34640 1 -- 172.21.15.16:0/2477246021 >> 172.21.15.16:0/2477246021 conn(0x7f78e00fa280 msgr2=0x7f78e00facf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:50.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.205+0000 7f78e7f34640 1 -- 172.21.15.16:0/2477246021 shutdown_connections 2024-08-01T06:54:50.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.206+0000 7f78e7f34640 1 -- 172.21.15.16:0/2477246021 wait complete. 2024-08-01T06:54:50.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.334+0000 7f910e181640 1 -- 172.21.15.16:0/1178809976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9108102fb0 msgr2=0x7f91081053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:50.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.334+0000 7f910e181640 1 --2- 172.21.15.16:0/1178809976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9108102fb0 0x7f91081053a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0098b0 tx=0x7f90fc02a4d0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.334+0000 7f910e181640 1 -- 172.21.15.16:0/1178809976 shutdown_connections 2024-08-01T06:54:50.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.334+0000 7f910e181640 1 --2- 172.21.15.16:0/1178809976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9108102fb0 0x7f91081053a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.334+0000 7f910e181640 1 --2- 172.21.15.16:0/1178809976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9108100680 0x7f9108102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.334+0000 7f910e181640 1 -- 172.21.15.16:0/1178809976 >> 172.21.15.16:0/1178809976 conn(0x7f91080fa280 msgr2=0x7f91080fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:50.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.334+0000 7f910e181640 1 -- 172.21.15.16:0/1178809976 shutdown_connections 2024-08-01T06:54:50.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.334+0000 7f910e181640 1 -- 172.21.15.16:0/1178809976 wait complete. 2024-08-01T06:54:50.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.335+0000 7f910e181640 1 Processor -- start 2024-08-01T06:54:50.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.335+0000 7f910e181640 1 -- start start 2024-08-01T06:54:50.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.335+0000 7f910e181640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9108100680 0x7f910819bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:50.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.336+0000 7f910e181640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f910819c440 0x7f91081a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.336+0000 7f910e181640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910819c8c0 con 0x7f9108100680 2024-08-01T06:54:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.336+0000 7f910e181640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910819ca30 con 0x7f910819c440 2024-08-01T06:54:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.336+0000 7f91077fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9108100680 0x7f910819bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.336+0000 7f91077fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9108100680 0x7f910819bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41704/0 (socket says 172.21.15.16:41704) 2024-08-01T06:54:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.336+0000 7f91077fe640 1 -- 172.21.15.16:0/404945527 learned_addr learned my addr 172.21.15.16:0/404945527 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:54:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.336+0000 7f9106ffd640 1 --2- 172.21.15.16:0/404945527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f910819c440 0x7f91081a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.336+0000 7f91077fe640 1 -- 172.21.15.16:0/404945527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f910819c440 msgr2=0x7f91081a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.336+0000 7f91077fe640 1 --2- 172.21.15.16:0/404945527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f910819c440 0x7f91081a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.336+0000 7f91077fe640 1 -- 172.21.15.16:0/404945527 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90fc009560 con 0x7f9108100680 2024-08-01T06:54:50.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.337+0000 7f91077fe640 1 --2- 172.21.15.16:0/404945527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9108100680 0x7f910819bf00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f90f800d6f0 tx=0x7f90f800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:50.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.337+0000 7f9104ff9640 1 -- 172.21.15.16:0/404945527 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90f8009a30 con 0x7f9108100680 2024-08-01T06:54:50.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.337+0000 7f910e181640 1 -- 172.21.15.16:0/404945527 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91081a1a50 con 0x7f9108100680 2024-08-01T06:54:50.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.337+0000 7f9104ff9640 1 -- 172.21.15.16:0/404945527 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f90f80054e0 con 0x7f9108100680 2024-08-01T06:54:50.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.337+0000 7f910e181640 1 -- 172.21.15.16:0/404945527 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91081a1f20 con 0x7f9108100680 2024-08-01T06:54:50.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.338+0000 7f9104ff9640 1 -- 172.21.15.16:0/404945527 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90f8010460 con 0x7f9108100680 2024-08-01T06:54:50.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.339+0000 7f910e181640 1 -- 172.21.15.16:0/404945527 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9108103390 con 0x7f9108100680 2024-08-01T06:54:50.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.339+0000 7f9104ff9640 1 -- 172.21.15.16:0/404945527 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f90f8009b90 con 0x7f9108100680 2024-08-01T06:54:50.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.340+0000 7f9104ff9640 1 --2- 172.21.15.16:0/404945527 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f90f006cc50 0x7f90f006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:50.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.340+0000 7f9104ff9640 1 -- 172.21.15.16:0/404945527 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f90f808bf60 con 0x7f9108100680 2024-08-01T06:54:50.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.341+0000 7f9106ffd640 1 --2- 172.21.15.16:0/404945527 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f90f006cc50 0x7f90f006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:50.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.341+0000 7f9106ffd640 1 --2- 172.21.15.16:0/404945527 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f90f006cc50 0x7f90f006f110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f90fc008000 tx=0x7f90fc004260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:50.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.349+0000 7f9104ff9640 1 -- 172.21.15.16:0/404945527 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f90f80561a0 con 0x7f9108100680 2024-08-01T06:54:50.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.544+0000 7f910e181640 1 -- 172.21.15.16:0/404945527 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91081010c0 con 0x7f90f006cc50 2024-08-01T06:54:50.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.545+0000 7f9104ff9640 1 -- 172.21.15.16:0/404945527 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f91081010c0 con 0x7f90f006cc50 2024-08-01T06:54:50.547 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:54:50.547 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f9911e17b12222fbe598fff73cd3ad10d20c5776", 2024-08-01T06:54:50.548 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T06:54:50.548 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T06:54:50.548 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [], 2024-08-01T06:54:50.548 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "", 2024-08-01T06:54:50.548 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:f9911e17b12222fbe598fff73cd3ad10d20c5776 image", 2024-08-01T06:54:50.548 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T06:54:50.549 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:54:50.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.547+0000 7f910e181640 1 -- 172.21.15.16:0/404945527 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f90f006cc50 msgr2=0x7f90f006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:50.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.547+0000 7f910e181640 1 --2- 172.21.15.16:0/404945527 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f90f006cc50 0x7f90f006f110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f90fc008000 tx=0x7f90fc004260 comp rx=0 tx=0).stop 2024-08-01T06:54:50.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.547+0000 7f910e181640 1 -- 172.21.15.16:0/404945527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9108100680 msgr2=0x7f910819bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:50.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.547+0000 7f910e181640 1 --2- 172.21.15.16:0/404945527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9108100680 0x7f910819bf00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f90f800d6f0 tx=0x7f90f800dbb0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.547+0000 7f910e181640 1 -- 172.21.15.16:0/404945527 shutdown_connections 2024-08-01T06:54:50.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.547+0000 7f910e181640 1 --2- 172.21.15.16:0/404945527 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f90f006cc50 0x7f90f006f110 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.547+0000 7f910e181640 1 --2- 172.21.15.16:0/404945527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f910819c440 0x7f91081a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.547+0000 7f910e181640 1 --2- 172.21.15.16:0/404945527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9108100680 0x7f910819bf00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.547+0000 7f910e181640 1 -- 172.21.15.16:0/404945527 >> 172.21.15.16:0/404945527 conn(0x7f91080fa280 msgr2=0x7f91080fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:50.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.547+0000 7f910e181640 1 -- 172.21.15.16:0/404945527 shutdown_connections 2024-08-01T06:54:50.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.547+0000 7f910e181640 1 -- 172.21.15.16:0/404945527 wait complete. 2024-08-01T06:54:50.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.642+0000 7ff1355bb640 1 -- 172.21.15.16:0/4107341506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1300ff3e0 msgr2=0x7ff1300ff860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:50.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.642+0000 7ff1355bb640 1 --2- 172.21.15.16:0/4107341506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1300ff3e0 0x7ff1300ff860 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff124009880 tx=0x7ff12402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.642+0000 7ff1355bb640 1 -- 172.21.15.16:0/4107341506 shutdown_connections 2024-08-01T06:54:50.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.642+0000 7ff1355bb640 1 --2- 172.21.15.16:0/4107341506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1300ff3e0 0x7ff1300ff860 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.642+0000 7ff1355bb640 1 --2- 172.21.15.16:0/4107341506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1300fe1e0 0x7ff1300fe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.642+0000 7ff1355bb640 1 -- 172.21.15.16:0/4107341506 >> 172.21.15.16:0/4107341506 conn(0x7ff1300f9950 msgr2=0x7ff1300fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:50.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.642+0000 7ff1355bb640 1 -- 172.21.15.16:0/4107341506 shutdown_connections 2024-08-01T06:54:50.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.643+0000 7ff1355bb640 1 -- 172.21.15.16:0/4107341506 wait complete. 2024-08-01T06:54:50.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.644+0000 7ff1355bb640 1 Processor -- start 2024-08-01T06:54:50.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.644+0000 7ff1355bb640 1 -- start start 2024-08-01T06:54:50.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.644+0000 7ff1355bb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1300fe1e0 0x7ff130197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:50.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.644+0000 7ff1355bb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1300ff3e0 0x7ff130197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:50.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.644+0000 7ff1355bb640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff130198370 con 0x7ff1300fe1e0 2024-08-01T06:54:50.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.644+0000 7ff1355bb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1301984e0 con 0x7ff1300ff3e0 2024-08-01T06:54:50.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.645+0000 7ff12effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1300fe1e0 0x7ff130197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:50.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.645+0000 7ff12effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1300fe1e0 0x7ff130197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41724/0 (socket says 172.21.15.16:41724) 2024-08-01T06:54:50.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.645+0000 7ff12effd640 1 -- 172.21.15.16:0/3590771272 learned_addr learned my addr 172.21.15.16:0/3590771272 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:54:50.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.645+0000 7ff12e7fc640 1 --2- 172.21.15.16:0/3590771272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1300ff3e0 0x7ff130197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:50.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.645+0000 7ff12effd640 1 -- 172.21.15.16:0/3590771272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1300ff3e0 msgr2=0x7ff130197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:50.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.645+0000 7ff12effd640 1 --2- 172.21.15.16:0/3590771272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1300ff3e0 0x7ff130197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.645+0000 7ff12effd640 1 -- 172.21.15.16:0/3590771272 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff124009560 con 0x7ff1300fe1e0 2024-08-01T06:54:50.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.645+0000 7ff12e7fc640 1 --2- 172.21.15.16:0/3590771272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1300ff3e0 0x7ff130197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T06:54:50.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.646+0000 7ff12effd640 1 --2- 172.21.15.16:0/3590771272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1300fe1e0 0x7ff130197860 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff12000ea10 tx=0x7ff12000eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:50.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.646+0000 7ff117fff640 1 -- 172.21.15.16:0/3590771272 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff12000ce50 con 0x7ff1300fe1e0 2024-08-01T06:54:50.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.646+0000 7ff117fff640 1 -- 172.21.15.16:0/3590771272 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff1200044f0 con 0x7ff1300fe1e0 2024-08-01T06:54:50.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.646+0000 7ff1355bb640 1 -- 172.21.15.16:0/3590771272 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13019cf80 con 0x7ff1300fe1e0 2024-08-01T06:54:50.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.646+0000 7ff117fff640 1 -- 172.21.15.16:0/3590771272 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff120016630 con 0x7ff1300fe1e0 2024-08-01T06:54:50.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.647+0000 7ff1355bb640 1 -- 172.21.15.16:0/3590771272 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13019d4c0 con 0x7ff1300fe1e0 2024-08-01T06:54:50.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.648+0000 7ff1355bb640 1 -- 172.21.15.16:0/3590771272 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1300fe610 con 0x7ff1300fe1e0 2024-08-01T06:54:50.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.649+0000 7ff117fff640 1 -- 172.21.15.16:0/3590771272 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff120016790 con 0x7ff1300fe1e0 2024-08-01T06:54:50.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.649+0000 7ff117fff640 1 --2- 172.21.15.16:0/3590771272 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff11806cc50 0x7ff11806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:54:50.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.650+0000 7ff117fff640 1 -- 172.21.15.16:0/3590771272 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff12008c290 con 0x7ff1300fe1e0 2024-08-01T06:54:50.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.650+0000 7ff12e7fc640 1 --2- 172.21.15.16:0/3590771272 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff11806cc50 0x7ff11806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:54:50.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.650+0000 7ff12e7fc640 1 --2- 172.21.15.16:0/3590771272 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff11806cc50 0x7ff11806f110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff124000c00 tx=0x7ff1240314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:54:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.657+0000 7ff117fff640 1 -- 172.21.15.16:0/3590771272 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7ff1200565f0 con 0x7ff1300fe1e0 2024-08-01T06:54:50.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:50 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/926825092' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:54:50.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:50 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/2477246021' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:54:50.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:50 smithi016 ceph-mon[29266]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:54:50.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:50 smithi016 ceph-mon[29266]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:54:50.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.940+0000 7ff1355bb640 1 -- 172.21.15.16:0/3590771272 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff130106660 con 0x7ff1300fe1e0 2024-08-01T06:54:50.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.940+0000 7ff117fff640 1 -- 172.21.15.16:0/3590771272 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff120059c10 con 0x7ff1300fe1e0 2024-08-01T06:54:50.942 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-08-01T06:54:50.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.943+0000 7ff1355bb640 1 -- 172.21.15.16:0/3590771272 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff11806cc50 msgr2=0x7ff11806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:50.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.943+0000 7ff1355bb640 1 --2- 172.21.15.16:0/3590771272 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff11806cc50 0x7ff11806f110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff124000c00 tx=0x7ff1240314e0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.943+0000 7ff1355bb640 1 -- 172.21.15.16:0/3590771272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1300fe1e0 msgr2=0x7ff130197860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:54:50.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.943+0000 7ff1355bb640 1 --2- 172.21.15.16:0/3590771272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1300fe1e0 0x7ff130197860 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff12000ea10 tx=0x7ff12000eed0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.943+0000 7ff1355bb640 1 -- 172.21.15.16:0/3590771272 shutdown_connections 2024-08-01T06:54:50.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.943+0000 7ff1355bb640 1 --2- 172.21.15.16:0/3590771272 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff11806cc50 0x7ff11806f110 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.943+0000 7ff1355bb640 1 --2- 172.21.15.16:0/3590771272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1300ff3e0 0x7ff130197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.943+0000 7ff1355bb640 1 --2- 172.21.15.16:0/3590771272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1300fe1e0 0x7ff130197860 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:54:50.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.943+0000 7ff1355bb640 1 -- 172.21.15.16:0/3590771272 >> 172.21.15.16:0/3590771272 conn(0x7ff1300f9950 msgr2=0x7ff130102a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:54:50.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.943+0000 7ff1355bb640 1 -- 172.21.15.16:0/3590771272 shutdown_connections 2024-08-01T06:54:50.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:54:50.943+0000 7ff1355bb640 1 -- 172.21.15.16:0/3590771272 wait complete. 2024-08-01T06:54:51.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:50 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/926825092' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:54:51.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:50 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/2477246021' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:54:51.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:50 smithi089 ceph-mon[36617]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:54:51.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:50 smithi089 ceph-mon[36617]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:54:51.839 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:51 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3590771272' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:54:52.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:51 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/3590771272' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:54:53.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:52 smithi089 ceph-mon[36617]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T06:54:53.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:52 smithi016 ceph-mon[29266]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T06:54:53.619 INFO:tasks.workunit.client.1.smithi089.stderr:Updating files: 91% (11717/12824) Updating files: 92% (11799/12824) Updating files: 93% (11927/12824) Updating files: 94% (12055/12824) Updating files: 95% (12183/12824) Updating files: 96% (12312/12824) Updating files: 97% (12440/12824) Updating files: 98% (12568/12824) Updating files: 99% (12696/12824) Updating files: 100% (12824/12824) Updating files: 100% (12824/12824), done. 2024-08-01T06:54:54.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:53 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:54:54.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:53 smithi089 ceph-mon[36617]: Upgrade: Target is version 19.1.0-1223-gf9911e17 (unknown) 2024-08-01T06:54:54.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:53 smithi089 ceph-mon[36617]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, digests ['quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483'] 2024-08-01T06:54:54.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:53 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:54:54.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:53 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:54:54.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:53 smithi089 ceph-mon[36617]: Upgrade: Need to upgrade myself (mgr.smithi016.whigbo) 2024-08-01T06:54:54.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:53 smithi089 ceph-mon[36617]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 on smithi089 2024-08-01T06:54:54.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:53 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:54:54.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:53 smithi016 ceph-mon[29266]: Upgrade: Target is version 19.1.0-1223-gf9911e17 (unknown) 2024-08-01T06:54:54.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:53 smithi016 ceph-mon[29266]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, digests ['quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483'] 2024-08-01T06:54:54.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:53 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:54:54.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:53 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:54:54.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:53 smithi016 ceph-mon[29266]: Upgrade: Need to upgrade myself (mgr.smithi016.whigbo) 2024-08-01T06:54:54.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:53 smithi016 ceph-mon[29266]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 on smithi089 2024-08-01T06:54:54.509 INFO:tasks.workunit.client.1.smithi089.stderr:Note: switching to 'd99c9769be1521395979e8c23d9073adbf1ff43f'. 2024-08-01T06:54:54.510 INFO:tasks.workunit.client.1.smithi089.stderr: 2024-08-01T06:54:54.510 INFO:tasks.workunit.client.1.smithi089.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-01T06:54:54.510 INFO:tasks.workunit.client.1.smithi089.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-01T06:54:54.510 INFO:tasks.workunit.client.1.smithi089.stderr:state without impacting any branches by switching back to a branch. 2024-08-01T06:54:54.510 INFO:tasks.workunit.client.1.smithi089.stderr: 2024-08-01T06:54:54.510 INFO:tasks.workunit.client.1.smithi089.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-01T06:54:54.510 INFO:tasks.workunit.client.1.smithi089.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-01T06:54:54.510 INFO:tasks.workunit.client.1.smithi089.stderr: 2024-08-01T06:54:54.510 INFO:tasks.workunit.client.1.smithi089.stderr: git switch -c 2024-08-01T06:54:54.510 INFO:tasks.workunit.client.1.smithi089.stderr: 2024-08-01T06:54:54.510 INFO:tasks.workunit.client.1.smithi089.stderr:Or undo this operation with: 2024-08-01T06:54:54.511 INFO:tasks.workunit.client.1.smithi089.stderr: 2024-08-01T06:54:54.511 INFO:tasks.workunit.client.1.smithi089.stderr: git switch - 2024-08-01T06:54:54.511 INFO:tasks.workunit.client.1.smithi089.stderr: 2024-08-01T06:54:54.511 INFO:tasks.workunit.client.1.smithi089.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-01T06:54:54.511 INFO:tasks.workunit.client.1.smithi089.stderr: 2024-08-01T06:54:54.511 INFO:tasks.workunit.client.1.smithi089.stderr:HEAD is now at d99c9769be1 Merge pull request #58890 from Matan-B/wip-matanb-logentry-string-1 2024-08-01T06:54:54.514 DEBUG:teuthology.orchestra.run.smithi089:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-08-01T06:54:54.577 INFO:tasks.workunit.client.1.smithi089.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-01T06:54:54.579 INFO:tasks.workunit.client.1.smithi089.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-08-01T06:54:54.579 INFO:tasks.workunit.client.1.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-01T06:54:55.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:54 smithi089 ceph-mon[36617]: pgmap v225: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T06:54:55.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:54 smithi016 ceph-mon[29266]: pgmap v225: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T06:54:55.296 INFO:tasks.workunit.client.1.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-01T06:54:55.361 INFO:tasks.workunit.client.1.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-01T06:54:55.416 INFO:tasks.workunit.client.1.smithi089.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-08-01T06:54:55.418 INFO:tasks.workunit.client.1.smithi089.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-08-01T06:54:55.418 INFO:tasks.workunit.client.1.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-01T06:54:55.469 INFO:tasks.workunit.client.1.smithi089.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-08-01T06:54:55.472 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-01T06:54:55.472 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-08-01T06:54:55.531 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-08-01T06:54:55.533 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-08-01T06:54:55.534 DEBUG:teuthology.orchestra.run.smithi089:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d99c9769be1521395979e8c23d9073adbf1ff43f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-08-01T06:54:55.603 INFO:tasks.workunit.client.1.smithi089.stderr:+ mkdir -p fsstress 2024-08-01T06:54:55.605 INFO:tasks.workunit.client.1.smithi089.stderr:+ pushd fsstress 2024-08-01T06:54:55.607 INFO:tasks.workunit.client.1.smithi089.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-08-01T06:54:55.607 INFO:tasks.workunit.client.1.smithi089.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-08-01T06:54:56.193 INFO:tasks.workunit.client.1.smithi089.stderr:+ tar xzf ltp-full.tgz 2024-08-01T06:54:57.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:56 smithi089 ceph-mon[36617]: pgmap v226: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:54:57.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:56 smithi016 ceph-mon[29266]: pgmap v226: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:54:59.098 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:54:58 smithi016 ceph-mon[29266]: pgmap v227: 65 pgs: 65 active+clean; 12 MiB data, 221 MiB used, 536 GiB / 536 GiB avail; 3.7 KiB/s rd, 990 KiB/s wr, 27 op/s 2024-08-01T06:54:59.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:54:58 smithi089 ceph-mon[36617]: pgmap v227: 65 pgs: 65 active+clean; 12 MiB data, 221 MiB used, 536 GiB / 536 GiB avail; 3.7 KiB/s rd, 990 KiB/s wr, 27 op/s 2024-08-01T06:55:01.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:00 smithi089 ceph-mon[36617]: pgmap v228: 65 pgs: 65 active+clean; 13 MiB data, 234 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 1.1 MiB/s wr, 52 op/s 2024-08-01T06:55:01.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:00 smithi016 ceph-mon[29266]: pgmap v228: 65 pgs: 65 active+clean; 13 MiB data, 234 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 1.1 MiB/s wr, 52 op/s 2024-08-01T06:55:02.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:02 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:55:02.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:02 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:55:03.622 INFO:tasks.workunit.client.0.smithi016.stderr:Updating files: 85% (11019/12824) Updating files: 86% (11029/12824) Updating files: 87% (11157/12824) Updating files: 88% (11286/12824) Updating files: 89% (11414/12824) Updating files: 90% (11542/12824) Updating files: 91% (11670/12824) Updating files: 92% (11799/12824) Updating files: 93% (11927/12824) Updating files: 94% (12055/12824) Updating files: 95% (12183/12824) Updating files: 96% (12312/12824) Updating files: 97% (12440/12824) Updating files: 98% (12568/12824) Updating files: 99% (12696/12824) Updating files: 100% (12824/12824) Updating files: 100% (12824/12824), done. 2024-08-01T06:55:03.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:03 smithi089 ceph-mon[36617]: pgmap v229: 65 pgs: 65 active+clean; 19 MiB data, 266 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 1.6 MiB/s wr, 110 op/s 2024-08-01T06:55:03.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:03 smithi016 ceph-mon[29266]: pgmap v229: 65 pgs: 65 active+clean; 19 MiB data, 266 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 1.6 MiB/s wr, 110 op/s 2024-08-01T06:55:04.515 INFO:tasks.workunit.client.0.smithi016.stderr:Note: switching to 'd99c9769be1521395979e8c23d9073adbf1ff43f'. 2024-08-01T06:55:04.516 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-08-01T06:55:04.516 INFO:tasks.workunit.client.0.smithi016.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-01T06:55:04.516 INFO:tasks.workunit.client.0.smithi016.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-01T06:55:04.516 INFO:tasks.workunit.client.0.smithi016.stderr:state without impacting any branches by switching back to a branch. 2024-08-01T06:55:04.516 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-08-01T06:55:04.516 INFO:tasks.workunit.client.0.smithi016.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-01T06:55:04.516 INFO:tasks.workunit.client.0.smithi016.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-01T06:55:04.516 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-08-01T06:55:04.517 INFO:tasks.workunit.client.0.smithi016.stderr: git switch -c 2024-08-01T06:55:04.517 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-08-01T06:55:04.517 INFO:tasks.workunit.client.0.smithi016.stderr:Or undo this operation with: 2024-08-01T06:55:04.517 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-08-01T06:55:04.517 INFO:tasks.workunit.client.0.smithi016.stderr: git switch - 2024-08-01T06:55:04.518 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-08-01T06:55:04.518 INFO:tasks.workunit.client.0.smithi016.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-01T06:55:04.518 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-08-01T06:55:04.518 INFO:tasks.workunit.client.0.smithi016.stderr:HEAD is now at d99c9769be1 Merge pull request #58890 from Matan-B/wip-matanb-logentry-string-1 2024-08-01T06:55:04.520 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-01T06:55:04.543 INFO:tasks.workunit.client.0.smithi016.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-01T06:55:04.546 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-01T06:55:04.546 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-01T06:55:05.408 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-01T06:55:05.469 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-01T06:55:05.515 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-01T06:55:05.517 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-01T06:55:05.517 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-01T06:55:05.562 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-01T06:55:05.565 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-08-01T06:55:05.565 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-01T06:55:05.624 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-08-01T06:55:05.625 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-08-01T06:55:05.625 DEBUG:teuthology.orchestra.run.smithi016:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d99c9769be1521395979e8c23d9073adbf1ff43f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-08-01T06:55:05.693 INFO:tasks.workunit.client.0.smithi016.stderr:+ mkdir -p fsstress 2024-08-01T06:55:05.696 INFO:tasks.workunit.client.0.smithi016.stderr:+ pushd fsstress 2024-08-01T06:55:05.697 INFO:tasks.workunit.client.0.smithi016.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-08-01T06:55:05.697 INFO:tasks.workunit.client.0.smithi016.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-08-01T06:55:05.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:05 smithi089 ceph-mon[36617]: pgmap v230: 65 pgs: 65 active+clean; 21 MiB data, 284 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 1.8 MiB/s wr, 155 op/s 2024-08-01T06:55:05.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:05 smithi016 ceph-mon[29266]: pgmap v230: 65 pgs: 65 active+clean; 21 MiB data, 284 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 1.8 MiB/s wr, 155 op/s 2024-08-01T06:55:06.970 INFO:tasks.workunit.client.0.smithi016.stderr:+ tar xzf ltp-full.tgz 2024-08-01T06:55:07.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:07 smithi089 ceph-mon[36617]: pgmap v231: 65 pgs: 65 active+clean; 22 MiB data, 278 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 1.9 MiB/s wr, 180 op/s 2024-08-01T06:55:07.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:07 smithi016 ceph-mon[29266]: pgmap v231: 65 pgs: 65 active+clean; 22 MiB data, 278 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 1.9 MiB/s wr, 180 op/s 2024-08-01T06:55:09.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:09 smithi089 ceph-mon[36617]: pgmap v232: 65 pgs: 65 active+clean; 42 MiB data, 352 MiB used, 536 GiB / 536 GiB avail; 897 KiB/s rd, 3.7 MiB/s wr, 284 op/s 2024-08-01T06:55:09.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:09 smithi016 ceph-mon[29266]: pgmap v232: 65 pgs: 65 active+clean; 42 MiB data, 352 MiB used, 536 GiB / 536 GiB avail; 897 KiB/s rd, 3.7 MiB/s wr, 284 op/s 2024-08-01T06:55:10.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:10 smithi016 ceph-mon[29266]: pgmap v233: 65 pgs: 65 active+clean; 54 MiB data, 369 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 316 op/s 2024-08-01T06:55:11.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:10 smithi089 ceph-mon[36617]: pgmap v233: 65 pgs: 65 active+clean; 54 MiB data, 369 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 316 op/s 2024-08-01T06:55:13.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:12 smithi089 ceph-mon[36617]: pgmap v234: 65 pgs: 65 active+clean; 66 MiB data, 413 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 382 op/s 2024-08-01T06:55:13.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:12 smithi016 ceph-mon[29266]: pgmap v234: 65 pgs: 65 active+clean; 66 MiB data, 413 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 382 op/s 2024-08-01T06:55:14.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:14 smithi016 ceph-mon[29266]: pgmap v235: 65 pgs: 65 active+clean; 70 MiB data, 425 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.5 MiB/s wr, 401 op/s 2024-08-01T06:55:15.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:14 smithi089 ceph-mon[36617]: pgmap v235: 65 pgs: 65 active+clean; 70 MiB data, 425 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.5 MiB/s wr, 401 op/s 2024-08-01T06:55:17.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:16 smithi089 ceph-mon[36617]: pgmap v236: 65 pgs: 65 active+clean; 71 MiB data, 439 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 4.4 MiB/s wr, 392 op/s 2024-08-01T06:55:17.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:16 smithi016 ceph-mon[29266]: pgmap v236: 65 pgs: 65 active+clean; 71 MiB data, 439 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 4.4 MiB/s wr, 392 op/s 2024-08-01T06:55:18.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:17 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:55:18.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:17 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:55:19.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:18 smithi089 ceph-mon[36617]: pgmap v237: 65 pgs: 65 active+clean; 80 MiB data, 473 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 499 op/s 2024-08-01T06:55:19.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:18 smithi016 ceph-mon[29266]: pgmap v237: 65 pgs: 65 active+clean; 80 MiB data, 473 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 499 op/s 2024-08-01T06:55:20.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:20 smithi089 ceph-mon[36617]: pgmap v238: 65 pgs: 65 active+clean; 85 MiB data, 504 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 460 op/s 2024-08-01T06:55:21.078 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:20 smithi016 ceph-mon[29266]: pgmap v238: 65 pgs: 65 active+clean; 85 MiB data, 504 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 460 op/s 2024-08-01T06:55:21.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.076+0000 7f07cf266640 1 -- 172.21.15.16:0/3503229298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c8102fb0 msgr2=0x7f07c81053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:21.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.076+0000 7f07cf266640 1 --2- 172.21.15.16:0/3503229298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c8102fb0 0x7f07c81053a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009880 tx=0x7f07b802a4a0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.076+0000 7f07cf266640 1 -- 172.21.15.16:0/3503229298 shutdown_connections 2024-08-01T06:55:21.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.076+0000 7f07cf266640 1 --2- 172.21.15.16:0/3503229298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c8102fb0 0x7f07c81053a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.076+0000 7f07cf266640 1 --2- 172.21.15.16:0/3503229298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07c8100680 0x7f07c8102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.076+0000 7f07cf266640 1 -- 172.21.15.16:0/3503229298 >> 172.21.15.16:0/3503229298 conn(0x7f07c80fa280 msgr2=0x7f07c80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:21.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.076+0000 7f07cf266640 1 -- 172.21.15.16:0/3503229298 shutdown_connections 2024-08-01T06:55:21.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.076+0000 7f07cf266640 1 -- 172.21.15.16:0/3503229298 wait complete. 2024-08-01T06:55:21.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.078+0000 7f07cf266640 1 Processor -- start 2024-08-01T06:55:21.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.078+0000 7f07cf266640 1 -- start start 2024-08-01T06:55:21.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.078+0000 7f07cf266640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c8100680 0x7f07c81956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:21.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.078+0000 7f07cf266640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07c8102fb0 0x7f07c8195c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:21.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.078+0000 7f07cf266640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c81961d0 con 0x7f07c8102fb0 2024-08-01T06:55:21.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.078+0000 7f07cf266640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c8196340 con 0x7f07c8100680 2024-08-01T06:55:21.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.079+0000 7f07cc801640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07c8102fb0 0x7f07c8195c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:21.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.079+0000 7f07cd002640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c8100680 0x7f07c81956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:21.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.079+0000 7f07cd002640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c8100680 0x7f07c81956c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:35454/0 (socket says 172.21.15.16:35454) 2024-08-01T06:55:21.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.079+0000 7f07cd002640 1 -- 172.21.15.16:0/4042244665 learned_addr learned my addr 172.21.15.16:0/4042244665 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:55:21.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.079+0000 7f07cd002640 1 -- 172.21.15.16:0/4042244665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07c8102fb0 msgr2=0x7f07c8195c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:21.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.079+0000 7f07cd002640 1 --2- 172.21.15.16:0/4042244665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07c8102fb0 0x7f07c8195c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.079+0000 7f07cd002640 1 -- 172.21.15.16:0/4042244665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c4009490 con 0x7f07c8100680 2024-08-01T06:55:21.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.079+0000 7f07cd002640 1 --2- 172.21.15.16:0/4042244665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c8100680 0x7f07c81956c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f07c400e9e0 tx=0x7f07c400eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:21.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.079+0000 7f07be7fc640 1 -- 172.21.15.16:0/4042244665 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07c400cd20 con 0x7f07c8100680 2024-08-01T06:55:21.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.080+0000 7f07be7fc640 1 -- 172.21.15.16:0/4042244665 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f07c400ce80 con 0x7f07c8100680 2024-08-01T06:55:21.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.080+0000 7f07be7fc640 1 -- 172.21.15.16:0/4042244665 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07c4004af0 con 0x7f07c8100680 2024-08-01T06:55:21.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.080+0000 7f07cf266640 1 -- 172.21.15.16:0/4042244665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b8009560 con 0x7f07c8100680 2024-08-01T06:55:21.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.080+0000 7f07cf266640 1 -- 172.21.15.16:0/4042244665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c819b170 con 0x7f07c8100680 2024-08-01T06:55:21.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.082+0000 7f07cf266640 1 -- 172.21.15.16:0/4042244665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c8100a60 con 0x7f07c8100680 2024-08-01T06:55:21.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.082+0000 7f07be7fc640 1 -- 172.21.15.16:0/4042244665 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f07c4004020 con 0x7f07c8100680 2024-08-01T06:55:21.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.083+0000 7f07be7fc640 1 --2- 172.21.15.16:0/4042244665 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f07b406cca0 0x7f07b406f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:21.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.083+0000 7f07cc801640 1 --2- 172.21.15.16:0/4042244665 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f07b406cca0 0x7f07b406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:21.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.083+0000 7f07be7fc640 1 -- 172.21.15.16:0/4042244665 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f07c4014070 con 0x7f07c8100680 2024-08-01T06:55:21.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.084+0000 7f07cc801640 1 --2- 172.21.15.16:0/4042244665 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f07b406cca0 0x7f07b406f160 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f07b8000c00 tx=0x7f07b8005d90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:21.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.088+0000 7f07be7fc640 1 -- 172.21.15.16:0/4042244665 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f07c4056880 con 0x7f07c8100680 2024-08-01T06:55:21.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.387+0000 7f07cf266640 1 -- 172.21.15.16:0/4042244665 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07c81039d0 con 0x7f07b406cca0 2024-08-01T06:55:21.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.389+0000 7f07be7fc640 1 -- 172.21.15.16:0/4042244665 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f07c81039d0 con 0x7f07b406cca0 2024-08-01T06:55:21.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.392+0000 7f07cf266640 1 -- 172.21.15.16:0/4042244665 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f07b406cca0 msgr2=0x7f07b406f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:21.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.392+0000 7f07cf266640 1 --2- 172.21.15.16:0/4042244665 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f07b406cca0 0x7f07b406f160 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f07b8000c00 tx=0x7f07b8005d90 comp rx=0 tx=0).stop 2024-08-01T06:55:21.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.392+0000 7f07cf266640 1 -- 172.21.15.16:0/4042244665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c8100680 msgr2=0x7f07c81956c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:21.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.392+0000 7f07cf266640 1 --2- 172.21.15.16:0/4042244665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c8100680 0x7f07c81956c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f07c400e9e0 tx=0x7f07c400eea0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.392+0000 7f07cf266640 1 -- 172.21.15.16:0/4042244665 shutdown_connections 2024-08-01T06:55:21.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.392+0000 7f07cf266640 1 --2- 172.21.15.16:0/4042244665 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f07b406cca0 0x7f07b406f160 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.392+0000 7f07cf266640 1 --2- 172.21.15.16:0/4042244665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07c8102fb0 0x7f07c8195c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.392+0000 7f07cf266640 1 --2- 172.21.15.16:0/4042244665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c8100680 0x7f07c81956c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.392+0000 7f07cf266640 1 -- 172.21.15.16:0/4042244665 >> 172.21.15.16:0/4042244665 conn(0x7f07c80fa280 msgr2=0x7f07c80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:21.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.392+0000 7f07cf266640 1 -- 172.21.15.16:0/4042244665 shutdown_connections 2024-08-01T06:55:21.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.392+0000 7f07cf266640 1 -- 172.21.15.16:0/4042244665 wait complete. 2024-08-01T06:55:21.405 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T06:55:21.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.518+0000 7f9ab3af9640 1 -- 172.21.15.16:0/1306857305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9aac0feaf0 msgr2=0x7f9aac0feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:21.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.518+0000 7f9ab3af9640 1 --2- 172.21.15.16:0/1306857305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9aac0feaf0 0x7f9aac0feef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80097e0 tx=0x7f9aa802a3f0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.518+0000 7f9ab3af9640 1 -- 172.21.15.16:0/1306857305 shutdown_connections 2024-08-01T06:55:21.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.518+0000 7f9ab3af9640 1 --2- 172.21.15.16:0/1306857305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aac0ffcf0 0x7f9aac100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.518+0000 7f9ab3af9640 1 --2- 172.21.15.16:0/1306857305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9aac0feaf0 0x7f9aac0feef0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.518+0000 7f9ab3af9640 1 -- 172.21.15.16:0/1306857305 >> 172.21.15.16:0/1306857305 conn(0x7f9aac0fa280 msgr2=0x7f9aac0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:21.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.518+0000 7f9ab3af9640 1 -- 172.21.15.16:0/1306857305 shutdown_connections 2024-08-01T06:55:21.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.518+0000 7f9ab3af9640 1 -- 172.21.15.16:0/1306857305 wait complete. 2024-08-01T06:55:21.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.519+0000 7f9ab3af9640 1 Processor -- start 2024-08-01T06:55:21.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.519+0000 7f9ab3af9640 1 -- start start 2024-08-01T06:55:21.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.519+0000 7f9ab3af9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9aac0feaf0 0x7f9aac193290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:21.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.519+0000 7f9ab3af9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aac0ffcf0 0x7f9aac1937d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:21.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.519+0000 7f9ab3af9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac193da0 con 0x7f9aac0ffcf0 2024-08-01T06:55:21.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.519+0000 7f9ab3af9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac193f10 con 0x7f9aac0feaf0 2024-08-01T06:55:21.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.519+0000 7f9ab1094640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aac0ffcf0 0x7f9aac1937d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:21.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.519+0000 7f9ab1094640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aac0ffcf0 0x7f9aac1937d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47742/0 (socket says 172.21.15.16:47742) 2024-08-01T06:55:21.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.519+0000 7f9ab1094640 1 -- 172.21.15.16:0/1017533327 learned_addr learned my addr 172.21.15.16:0/1017533327 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:55:21.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.520+0000 7f9ab1895640 1 --2- 172.21.15.16:0/1017533327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9aac0feaf0 0x7f9aac193290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:21.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.520+0000 7f9ab1094640 1 -- 172.21.15.16:0/1017533327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9aac0feaf0 msgr2=0x7f9aac193290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:21.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.520+0000 7f9ab1094640 1 --2- 172.21.15.16:0/1017533327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9aac0feaf0 0x7f9aac193290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.520+0000 7f9ab1094640 1 -- 172.21.15.16:0/1017533327 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c009560 con 0x7f9aac0ffcf0 2024-08-01T06:55:21.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.520+0000 7f9ab1094640 1 --2- 172.21.15.16:0/1017533327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aac0ffcf0 0x7f9aac1937d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00e940 tx=0x7f9a9c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:21.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.521+0000 7f9aa2ffd640 1 -- 172.21.15.16:0/1017533327 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a9c00cd50 con 0x7f9aac0ffcf0 2024-08-01T06:55:21.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.521+0000 7f9aa2ffd640 1 -- 172.21.15.16:0/1017533327 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a9c0035f0 con 0x7f9aac0ffcf0 2024-08-01T06:55:21.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.521+0000 7f9aa2ffd640 1 -- 172.21.15.16:0/1017533327 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a9c0044e0 con 0x7f9aac0ffcf0 2024-08-01T06:55:21.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.522+0000 7f9ab3af9640 1 -- 172.21.15.16:0/1017533327 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa8009490 con 0x7f9aac0ffcf0 2024-08-01T06:55:21.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.522+0000 7f9ab3af9640 1 -- 172.21.15.16:0/1017533327 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aac198cf0 con 0x7f9aac0ffcf0 2024-08-01T06:55:21.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.524+0000 7f9ab3af9640 1 -- 172.21.15.16:0/1017533327 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aac105d50 con 0x7f9aac0ffcf0 2024-08-01T06:55:21.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.524+0000 7f9aa2ffd640 1 -- 172.21.15.16:0/1017533327 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9a9c003760 con 0x7f9aac0ffcf0 2024-08-01T06:55:21.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.525+0000 7f9aa2ffd640 1 --2- 172.21.15.16:0/1017533327 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f9a9806ccb0 0x7f9a9806f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:21.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.526+0000 7f9ab1895640 1 --2- 172.21.15.16:0/1017533327 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f9a9806ccb0 0x7f9a9806f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:21.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.526+0000 7f9aa2ffd640 1 -- 172.21.15.16:0/1017533327 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9a9c014070 con 0x7f9aac0ffcf0 2024-08-01T06:55:21.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.526+0000 7f9ab1895640 1 --2- 172.21.15.16:0/1017533327 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f9a9806ccb0 0x7f9a9806f170 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8030960 tx=0x7f9aa8030ef0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:21.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.530+0000 7f9aa2ffd640 1 -- 172.21.15.16:0/1017533327 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f9a9c056c20 con 0x7f9aac0ffcf0 2024-08-01T06:55:21.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.803+0000 7f9ab3af9640 1 -- 172.21.15.16:0/1017533327 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9aac1988c0 con 0x7f9a9806ccb0 2024-08-01T06:55:21.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.804+0000 7f9aa2ffd640 1 -- 172.21.15.16:0/1017533327 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f9aac1988c0 con 0x7f9a9806ccb0 2024-08-01T06:55:21.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.807+0000 7f9ab3af9640 1 -- 172.21.15.16:0/1017533327 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f9a9806ccb0 msgr2=0x7f9a9806f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:21.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.807+0000 7f9ab3af9640 1 --2- 172.21.15.16:0/1017533327 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f9a9806ccb0 0x7f9a9806f170 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8030960 tx=0x7f9aa8030ef0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.807+0000 7f9ab3af9640 1 -- 172.21.15.16:0/1017533327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aac0ffcf0 msgr2=0x7f9aac1937d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:21.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.807+0000 7f9ab3af9640 1 --2- 172.21.15.16:0/1017533327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aac0ffcf0 0x7f9aac1937d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00e940 tx=0x7f9a9c00ee00 comp rx=0 tx=0).stop 2024-08-01T06:55:21.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.807+0000 7f9ab3af9640 1 -- 172.21.15.16:0/1017533327 shutdown_connections 2024-08-01T06:55:21.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.807+0000 7f9ab3af9640 1 --2- 172.21.15.16:0/1017533327 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7f9a9806ccb0 0x7f9a9806f170 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.808+0000 7f9ab3af9640 1 --2- 172.21.15.16:0/1017533327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9aac0ffcf0 0x7f9aac1937d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.808+0000 7f9ab3af9640 1 --2- 172.21.15.16:0/1017533327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9aac0feaf0 0x7f9aac193290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.808+0000 7f9ab3af9640 1 -- 172.21.15.16:0/1017533327 >> 172.21.15.16:0/1017533327 conn(0x7f9aac0fa280 msgr2=0x7f9aac102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:21.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.808+0000 7f9ab3af9640 1 -- 172.21.15.16:0/1017533327 shutdown_connections 2024-08-01T06:55:21.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.808+0000 7f9ab3af9640 1 -- 172.21.15.16:0/1017533327 wait complete. 2024-08-01T06:55:21.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.927+0000 7fd751981640 1 -- 172.21.15.16:0/359967264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd74c0fe470 msgr2=0x7fd74c0fe870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:21.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.927+0000 7fd751981640 1 --2- 172.21.15.16:0/359967264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd74c0fe470 0x7fd74c0fe870 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd744009880 tx=0x7fd74402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.927+0000 7fd751981640 1 -- 172.21.15.16:0/359967264 shutdown_connections 2024-08-01T06:55:21.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.927+0000 7fd751981640 1 --2- 172.21.15.16:0/359967264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd74c0fedb0 0x7fd74c0ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.927+0000 7fd751981640 1 --2- 172.21.15.16:0/359967264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd74c0fe470 0x7fd74c0fe870 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.931 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:21 smithi016 ceph-mon[29266]: from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:55:21.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.927+0000 7fd751981640 1 -- 172.21.15.16:0/359967264 >> 172.21.15.16:0/359967264 conn(0x7fd74c0fa280 msgr2=0x7fd74c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:21.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.928+0000 7fd751981640 1 -- 172.21.15.16:0/359967264 shutdown_connections 2024-08-01T06:55:21.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.928+0000 7fd751981640 1 -- 172.21.15.16:0/359967264 wait complete. 2024-08-01T06:55:21.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.929+0000 7fd751981640 1 Processor -- start 2024-08-01T06:55:21.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.929+0000 7fd751981640 1 -- start start 2024-08-01T06:55:21.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.930+0000 7fd751981640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd74c0fe470 0x7fd74c197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:21.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.930+0000 7fd751981640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd74c0fedb0 0x7fd74c197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:21.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.930+0000 7fd751981640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c198330 con 0x7fd74c0fedb0 2024-08-01T06:55:21.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.930+0000 7fd751981640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c1984a0 con 0x7fd74c0fe470 2024-08-01T06:55:21.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.930+0000 7fd74a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd74c0fedb0 0x7fd74c197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:21.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.930+0000 7fd74affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd74c0fe470 0x7fd74c197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:21.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.930+0000 7fd74a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd74c0fedb0 0x7fd74c197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47756/0 (socket says 172.21.15.16:47756) 2024-08-01T06:55:21.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.930+0000 7fd74a7fc640 1 -- 172.21.15.16:0/2588034189 learned_addr learned my addr 172.21.15.16:0/2588034189 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:55:21.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.930+0000 7fd74affd640 1 -- 172.21.15.16:0/2588034189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd74c0fedb0 msgr2=0x7fd74c197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:21.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.930+0000 7fd74affd640 1 --2- 172.21.15.16:0/2588034189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd74c0fedb0 0x7fd74c197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:21.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.930+0000 7fd74affd640 1 -- 172.21.15.16:0/2588034189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c009840 con 0x7fd74c0fe470 2024-08-01T06:55:21.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.931+0000 7fd74affd640 1 --2- 172.21.15.16:0/2588034189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd74c0fe470 0x7fd74c197820 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd74402a9c0 tx=0x7fd7440045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:21.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.931+0000 7fd75097f640 1 -- 172.21.15.16:0/2588034189 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7440318b0 con 0x7fd74c0fe470 2024-08-01T06:55:21.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.931+0000 7fd75097f640 1 -- 172.21.15.16:0/2588034189 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd744004b80 con 0x7fd74c0fe470 2024-08-01T06:55:21.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.931+0000 7fd75097f640 1 -- 172.21.15.16:0/2588034189 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7440039e0 con 0x7fd74c0fe470 2024-08-01T06:55:21.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.931+0000 7fd751981640 1 -- 172.21.15.16:0/2588034189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd744009560 con 0x7fd74c0fe470 2024-08-01T06:55:21.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.931+0000 7fd751981640 1 -- 172.21.15.16:0/2588034189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd74c19d1e0 con 0x7fd74c0fe470 2024-08-01T06:55:21.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.933+0000 7fd751981640 1 -- 172.21.15.16:0/2588034189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd74c191950 con 0x7fd74c0fe470 2024-08-01T06:55:21.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.933+0000 7fd75097f640 1 -- 172.21.15.16:0/2588034189 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd744003b40 con 0x7fd74c0fe470 2024-08-01T06:55:21.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.934+0000 7fd75097f640 1 --2- 172.21.15.16:0/2588034189 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd73806cd80 0x7fd73806f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:21.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.934+0000 7fd75097f640 1 -- 172.21.15.16:0/2588034189 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd7440ad190 con 0x7fd74c0fe470 2024-08-01T06:55:21.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.934+0000 7fd74a7fc640 1 --2- 172.21.15.16:0/2588034189 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd73806cd80 0x7fd73806f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:21.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.935+0000 7fd74a7fc640 1 --2- 172.21.15.16:0/2588034189 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd73806cd80 0x7fd73806f240 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd74c198d40 tx=0x7fd73c009500 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:21.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:21.939+0000 7fd75097f640 1 -- 172.21.15.16:0/2588034189 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fd744078530 con 0x7fd74c0fe470 2024-08-01T06:55:21.979 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:21 smithi089 ceph-mon[36617]: from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:55:22.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.265+0000 7fd751981640 1 -- 172.21.15.16:0/2588034189 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd74c02c5d0 con 0x7fd73806cd80 2024-08-01T06:55:22.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.278+0000 7fd75097f640 1 -- 172.21.15.16:0/2588034189 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3864 (secure 0 0 0) 0x7fd74c02c5d0 con 0x7fd73806cd80 2024-08-01T06:55:22.279 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T06:55:22.279 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (6m) 97s ago 7m 25.5M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T06:55:22.279 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (7m) 97s ago 7m 7554k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T06:55:22.280 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (6m) 103s ago 6m 7541k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T06:55:22.280 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (7m) 97s ago 7m 6895k - 18.2.2-1767-ga3bbd728 d280790d1980 81c723a6ae35 2024-08-01T06:55:22.280 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (6m) 103s ago 6m 6891k - 18.2.2-1767-ga3bbd728 d280790d1980 73e7778d1e26 2024-08-01T06:55:22.280 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (5m) 97s ago 7m 82.9M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T06:55:22.280 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (2m) 97s ago 2m 12.5M - 18.2.2-1767-ga3bbd728 d280790d1980 96e46c28d16c 2024-08-01T06:55:22.280 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (118s) 97s ago 118s 18.4M - 18.2.2-1767-ga3bbd728 d280790d1980 4bbe1a388689 2024-08-01T06:55:22.280 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (2m) 103s ago 2m 16.7M - 18.2.2-1767-ga3bbd728 d280790d1980 65ca121a6fbb 2024-08-01T06:55:22.280 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (116s) 103s ago 115s 14.0M - 18.2.2-1767-ga3bbd728 d280790d1980 05bb46c6fe94 2024-08-01T06:55:22.280 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:9283,8765,8443 running (8m) 97s ago 8m 487M - 18.2.2-1767-ga3bbd728 d280790d1980 3cf8ca2d43c6 2024-08-01T06:55:22.280 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (6m) 103s ago 6m 441M - 18.2.2-1767-ga3bbd728 d280790d1980 c70860f1020b 2024-08-01T06:55:22.280 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (8m) 97s ago 8m 49.4M 2048M 18.2.2-1767-ga3bbd728 d280790d1980 e6a2e5d7eeec 2024-08-01T06:55:22.280 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (6m) 103s ago 6m 35.5M 2048M 18.2.2-1767-ga3bbd728 d280790d1980 9ca9e3e814cb 2024-08-01T06:55:22.280 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (7m) 97s ago 7m 15.7M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T06:55:22.281 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (6m) 103s ago 6m 16.7M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T06:55:22.281 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (5m) 97s ago 5m 54.0M 3948M 18.2.2-1767-ga3bbd728 d280790d1980 9b7157499583 2024-08-01T06:55:22.281 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (5m) 97s ago 5m 48.8M 3948M 18.2.2-1767-ga3bbd728 d280790d1980 f3b050aed6b7 2024-08-01T06:55:22.281 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (4m) 97s ago 4m 53.4M 3948M 18.2.2-1767-ga3bbd728 d280790d1980 33a72e1a5c91 2024-08-01T06:55:22.281 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (4m) 103s ago 4m 45.6M 4970M 18.2.2-1767-ga3bbd728 d280790d1980 58c175e0f4eb 2024-08-01T06:55:22.281 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (3m) 103s ago 3m 50.9M 4970M 18.2.2-1767-ga3bbd728 d280790d1980 15b8f910bad7 2024-08-01T06:55:22.281 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (3m) 103s ago 3m 51.0M 4970M 18.2.2-1767-ga3bbd728 d280790d1980 ac887841899e 2024-08-01T06:55:22.281 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (5m) 97s ago 6m 60.3M - 2.43.0 a07b618ecd1d 2b370118fafe 2024-08-01T06:55:22.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.280+0000 7fd751981640 1 -- 172.21.15.16:0/2588034189 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd73806cd80 msgr2=0x7fd73806f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:22.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.280+0000 7fd751981640 1 --2- 172.21.15.16:0/2588034189 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd73806cd80 0x7fd73806f240 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd74c198d40 tx=0x7fd73c009500 comp rx=0 tx=0).stop 2024-08-01T06:55:22.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.280+0000 7fd751981640 1 -- 172.21.15.16:0/2588034189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd74c0fe470 msgr2=0x7fd74c197820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:22.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.280+0000 7fd751981640 1 --2- 172.21.15.16:0/2588034189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd74c0fe470 0x7fd74c197820 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd74402a9c0 tx=0x7fd7440045e0 comp rx=0 tx=0).stop 2024-08-01T06:55:22.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.281+0000 7fd751981640 1 -- 172.21.15.16:0/2588034189 shutdown_connections 2024-08-01T06:55:22.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.281+0000 7fd751981640 1 --2- 172.21.15.16:0/2588034189 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fd73806cd80 0x7fd73806f240 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:22.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.281+0000 7fd751981640 1 --2- 172.21.15.16:0/2588034189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd74c0fedb0 0x7fd74c197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:22.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.281+0000 7fd751981640 1 --2- 172.21.15.16:0/2588034189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd74c0fe470 0x7fd74c197820 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:22.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.281+0000 7fd751981640 1 -- 172.21.15.16:0/2588034189 >> 172.21.15.16:0/2588034189 conn(0x7fd74c0fa280 msgr2=0x7fd74c106ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:22.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.281+0000 7fd751981640 1 -- 172.21.15.16:0/2588034189 shutdown_connections 2024-08-01T06:55:22.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.281+0000 7fd751981640 1 -- 172.21.15.16:0/2588034189 wait complete. 2024-08-01T06:55:22.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.392+0000 7fc0819d2640 1 -- 172.21.15.16:0/1764928156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc07c0ffb80 msgr2=0x7fc07c0fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:22.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.392+0000 7fc0819d2640 1 --2- 172.21.15.16:0/1764928156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc07c0ffb80 0x7fc07c0fff80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc06c009880 tx=0x7fc06c02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:55:22.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.393+0000 7fc0819d2640 1 -- 172.21.15.16:0/1764928156 shutdown_connections 2024-08-01T06:55:22.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.393+0000 7fc0819d2640 1 --2- 172.21.15.16:0/1764928156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc07c100d80 0x7fc07c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:22.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.393+0000 7fc0819d2640 1 --2- 172.21.15.16:0/1764928156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc07c0ffb80 0x7fc07c0fff80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:22.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.393+0000 7fc0819d2640 1 -- 172.21.15.16:0/1764928156 >> 172.21.15.16:0/1764928156 conn(0x7fc07c0fb2f0 msgr2=0x7fc07c0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:22.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.393+0000 7fc0819d2640 1 -- 172.21.15.16:0/1764928156 shutdown_connections 2024-08-01T06:55:22.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.393+0000 7fc0819d2640 1 -- 172.21.15.16:0/1764928156 wait complete. 2024-08-01T06:55:22.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.393+0000 7fc0819d2640 1 Processor -- start 2024-08-01T06:55:22.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.394+0000 7fc0819d2640 1 -- start start 2024-08-01T06:55:22.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.394+0000 7fc0819d2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc07c0ffb80 0x7fc07c074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:22.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.394+0000 7fc0819d2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc07c100d80 0x7fc07c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:22.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.394+0000 7fc0819d2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c072de0 con 0x7fc07c100d80 2024-08-01T06:55:22.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.394+0000 7fc0819d2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c072f50 con 0x7fc07c0ffb80 2024-08-01T06:55:22.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.394+0000 7fc07a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc07c100d80 0x7fc07c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:22.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.394+0000 7fc07a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc07c100d80 0x7fc07c0728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47772/0 (socket says 172.21.15.16:47772) 2024-08-01T06:55:22.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.394+0000 7fc07a7fc640 1 -- 172.21.15.16:0/3026690609 learned_addr learned my addr 172.21.15.16:0/3026690609 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:55:22.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.394+0000 7fc07affd640 1 --2- 172.21.15.16:0/3026690609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc07c0ffb80 0x7fc07c074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:22.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.394+0000 7fc07a7fc640 1 -- 172.21.15.16:0/3026690609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc07c0ffb80 msgr2=0x7fc07c074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:22.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.394+0000 7fc07a7fc640 1 --2- 172.21.15.16:0/3026690609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc07c0ffb80 0x7fc07c074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:22.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.394+0000 7fc07a7fc640 1 -- 172.21.15.16:0/3026690609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06c009560 con 0x7fc07c100d80 2024-08-01T06:55:22.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.394+0000 7fc07affd640 1 --2- 172.21.15.16:0/3026690609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc07c0ffb80 0x7fc07c074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T06:55:22.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.394+0000 7fc07a7fc640 1 --2- 172.21.15.16:0/3026690609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc07c100d80 0x7fc07c0728a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc07000e970 tx=0x7fc07000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:22.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.395+0000 7fc0809d0640 1 -- 172.21.15.16:0/3026690609 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc07000cc90 con 0x7fc07c100d80 2024-08-01T06:55:22.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.395+0000 7fc0819d2640 1 -- 172.21.15.16:0/3026690609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07c073230 con 0x7fc07c100d80 2024-08-01T06:55:22.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.395+0000 7fc0809d0640 1 -- 172.21.15.16:0/3026690609 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc07000cdf0 con 0x7fc07c100d80 2024-08-01T06:55:22.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.395+0000 7fc0809d0640 1 -- 172.21.15.16:0/3026690609 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc070010430 con 0x7fc07c100d80 2024-08-01T06:55:22.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.395+0000 7fc0819d2640 1 -- 172.21.15.16:0/3026690609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07c19d6e0 con 0x7fc07c100d80 2024-08-01T06:55:22.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.396+0000 7fc0819d2640 1 -- 172.21.15.16:0/3026690609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc068005280 con 0x7fc07c100d80 2024-08-01T06:55:22.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.396+0000 7fc0809d0640 1 -- 172.21.15.16:0/3026690609 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc0700106a0 con 0x7fc07c100d80 2024-08-01T06:55:22.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.397+0000 7fc0809d0640 1 --2- 172.21.15.16:0/3026690609 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc06406cc60 0x7fc06406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:22.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.397+0000 7fc0809d0640 1 -- 172.21.15.16:0/3026690609 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc070014070 con 0x7fc07c100d80 2024-08-01T06:55:22.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.397+0000 7fc07affd640 1 --2- 172.21.15.16:0/3026690609 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc06406cc60 0x7fc06406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:22.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.398+0000 7fc07affd640 1 --2- 172.21.15.16:0/3026690609 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc06406cc60 0x7fc06406f120 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc06c006010 tx=0x7fc06c005db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:22.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.401+0000 7fc0809d0640 1 -- 172.21.15.16:0/3026690609 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fc070056bd0 con 0x7fc07c100d80 2024-08-01T06:55:22.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.804+0000 7fc0819d2640 1 -- 172.21.15.16:0/3026690609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc068005d40 con 0x7fc07c100d80 2024-08-01T06:55:22.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.805+0000 7fc0809d0640 1 -- 172.21.15.16:0/3026690609 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fc07005a1f0 con 0x7fc07c100d80 2024-08-01T06:55:22.806 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:55:22.806 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T06:55:22.806 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 2 2024-08-01T06:55:22.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:55:22.807 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T06:55:22.807 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 2 2024-08-01T06:55:22.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:55:22.807 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T06:55:22.807 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 6 2024-08-01T06:55:22.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:55:22.807 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T06:55:22.807 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4 2024-08-01T06:55:22.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:55:22.807 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T06:55:22.807 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 14 2024-08-01T06:55:22.807 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T06:55:22.807 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:55:22.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.808+0000 7fc0819d2640 1 -- 172.21.15.16:0/3026690609 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc06406cc60 msgr2=0x7fc06406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:22.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.808+0000 7fc0819d2640 1 --2- 172.21.15.16:0/3026690609 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc06406cc60 0x7fc06406f120 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc06c006010 tx=0x7fc06c005db0 comp rx=0 tx=0).stop 2024-08-01T06:55:22.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.808+0000 7fc0819d2640 1 -- 172.21.15.16:0/3026690609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc07c100d80 msgr2=0x7fc07c0728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:22.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.808+0000 7fc0819d2640 1 --2- 172.21.15.16:0/3026690609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc07c100d80 0x7fc07c0728a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc07000e970 tx=0x7fc07000ed70 comp rx=0 tx=0).stop 2024-08-01T06:55:22.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.808+0000 7fc0819d2640 1 -- 172.21.15.16:0/3026690609 shutdown_connections 2024-08-01T06:55:22.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.808+0000 7fc0819d2640 1 --2- 172.21.15.16:0/3026690609 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fc06406cc60 0x7fc06406f120 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:22.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.808+0000 7fc0819d2640 1 --2- 172.21.15.16:0/3026690609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc07c100d80 0x7fc07c0728a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:22.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.808+0000 7fc0819d2640 1 --2- 172.21.15.16:0/3026690609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc07c0ffb80 0x7fc07c074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:22.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.808+0000 7fc0819d2640 1 -- 172.21.15.16:0/3026690609 >> 172.21.15.16:0/3026690609 conn(0x7fc07c0fb2f0 msgr2=0x7fc07c1044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:22.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.808+0000 7fc0819d2640 1 -- 172.21.15.16:0/3026690609 shutdown_connections 2024-08-01T06:55:22.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.808+0000 7fc0819d2640 1 -- 172.21.15.16:0/3026690609 wait complete. 2024-08-01T06:55:22.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.932+0000 7fb06ab92640 1 -- 172.21.15.16:0/1640450110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0640ffcf0 msgr2=0x7fb064100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:22.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.932+0000 7fb06ab92640 1 --2- 172.21.15.16:0/1640450110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0640ffcf0 0x7fb064100170 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb0500097e0 tx=0x7fb05002a3f0 comp rx=0 tx=0).stop 2024-08-01T06:55:22.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.932+0000 7fb06ab92640 1 -- 172.21.15.16:0/1640450110 shutdown_connections 2024-08-01T06:55:22.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.932+0000 7fb06ab92640 1 --2- 172.21.15.16:0/1640450110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0640ffcf0 0x7fb064100170 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:22.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.932+0000 7fb06ab92640 1 --2- 172.21.15.16:0/1640450110 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0640feaf0 0x7fb0640feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:22.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.932+0000 7fb06ab92640 1 -- 172.21.15.16:0/1640450110 >> 172.21.15.16:0/1640450110 conn(0x7fb0640fa280 msgr2=0x7fb0640fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:22.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.932+0000 7fb06ab92640 1 -- 172.21.15.16:0/1640450110 shutdown_connections 2024-08-01T06:55:22.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.932+0000 7fb06ab92640 1 -- 172.21.15.16:0/1640450110 wait complete. 2024-08-01T06:55:22.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.933+0000 7fb06ab92640 1 Processor -- start 2024-08-01T06:55:22.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.933+0000 7fb06ab92640 1 -- start start 2024-08-01T06:55:22.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.933+0000 7fb06ab92640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0640feaf0 0x7fb064102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:22.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.933+0000 7fb06ab92640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0640ffcf0 0x7fb0641010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:22.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.933+0000 7fb06ab92640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb064101610 con 0x7fb0640feaf0 2024-08-01T06:55:22.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.933+0000 7fb06ab92640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb064101780 con 0x7fb0640ffcf0 2024-08-01T06:55:22.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.933+0000 7fb06892e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0640feaf0 0x7fb064102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:22.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.934+0000 7fb06892e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0640feaf0 0x7fb064102a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47800/0 (socket says 172.21.15.16:47800) 2024-08-01T06:55:22.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.934+0000 7fb06892e640 1 -- 172.21.15.16:0/811310231 learned_addr learned my addr 172.21.15.16:0/811310231 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:55:22.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.934+0000 7fb063fff640 1 --2- 172.21.15.16:0/811310231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0640ffcf0 0x7fb0641010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:22.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.934+0000 7fb06892e640 1 -- 172.21.15.16:0/811310231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0640ffcf0 msgr2=0x7fb0641010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:22.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.934+0000 7fb06892e640 1 --2- 172.21.15.16:0/811310231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0640ffcf0 0x7fb0641010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:22.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.934+0000 7fb06892e640 1 -- 172.21.15.16:0/811310231 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb050009490 con 0x7fb0640feaf0 2024-08-01T06:55:22.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.935+0000 7fb06892e640 1 --2- 172.21.15.16:0/811310231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0640feaf0 0x7fb064102a80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb05800e970 tx=0x7fb05800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:22.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.935+0000 7fb061ffb640 1 -- 172.21.15.16:0/811310231 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb05800cc90 con 0x7fb0640feaf0 2024-08-01T06:55:22.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.935+0000 7fb061ffb640 1 -- 172.21.15.16:0/811310231 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb0580044e0 con 0x7fb0640feaf0 2024-08-01T06:55:22.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.935+0000 7fb06ab92640 1 -- 172.21.15.16:0/811310231 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb064101a60 con 0x7fb0640feaf0 2024-08-01T06:55:22.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.935+0000 7fb061ffb640 1 -- 172.21.15.16:0/811310231 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb058003e50 con 0x7fb0640feaf0 2024-08-01T06:55:22.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.935+0000 7fb06ab92640 1 -- 172.21.15.16:0/811310231 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06419d750 con 0x7fb0640feaf0 2024-08-01T06:55:22.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.937+0000 7fb06ab92640 1 -- 172.21.15.16:0/811310231 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0640feef0 con 0x7fb0640feaf0 2024-08-01T06:55:22.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.938+0000 7fb061ffb640 1 -- 172.21.15.16:0/811310231 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb058003680 con 0x7fb0640feaf0 2024-08-01T06:55:22.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.938+0000 7fb061ffb640 1 --2- 172.21.15.16:0/811310231 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb05406cca0 0x7fb05406f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:22.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.939+0000 7fb063fff640 1 --2- 172.21.15.16:0/811310231 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb05406cca0 0x7fb05406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:22.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.939+0000 7fb061ffb640 1 -- 172.21.15.16:0/811310231 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb058014070 con 0x7fb0640feaf0 2024-08-01T06:55:22.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.940+0000 7fb063fff640 1 --2- 172.21.15.16:0/811310231 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb05406cca0 0x7fb05406f160 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb064102800 tx=0x7fb050005a90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:22.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:22.945+0000 7fb061ffb640 1 -- 172.21.15.16:0/811310231 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fb058056b80 con 0x7fb0640feaf0 2024-08-01T06:55:23.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.294+0000 7fb06ab92640 1 -- 172.21.15.16:0/811310231 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb06419da30 con 0x7fb0640feaf0 2024-08-01T06:55:23.297 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:23 smithi016 ceph-mon[29266]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:55:23.297 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:23 smithi016 ceph-mon[29266]: Upgrade: Updating mgr.smithi089.hfgnsr 2024-08-01T06:55:23.297 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:23 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:23.297 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:23 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.hfgnsr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-01T06:55:23.297 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:23 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-01T06:55:23.297 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:23 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:55:23.297 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:23 smithi016 ceph-mon[29266]: Deploying daemon mgr.smithi089.hfgnsr on smithi089 2024-08-01T06:55:23.297 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:23 smithi016 ceph-mon[29266]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:55:23.297 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:23 smithi016 ceph-mon[29266]: pgmap v239: 65 pgs: 65 active+clean; 99 MiB data, 567 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 494 op/s 2024-08-01T06:55:23.297 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:23 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3026690609' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:55:23.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.295+0000 7fb061ffb640 1 -- 172.21.15.16:0/811310231 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1868 (secure 0 0 0) 0x7fb05805a1a0 con 0x7fb0640feaf0 2024-08-01T06:55:23.298 INFO:teuthology.orchestra.run.smithi016.stdout:e19 2024-08-01T06:55:23.298 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T06:55:23.298 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:55:23.298 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T06:55:23.298 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:55:23.298 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T06:55:23.298 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T06:55:23.299 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 19 2024-08-01T06:55:23.299 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T06:55:23.299 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T06:55:23.299 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T06:53:32.617145+0000 2024-08-01T06:55:23.299 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T06:55:23.299 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T06:55:23.299 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T06:55:23.299 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T06:55:23.299 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T06:55:23.299 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T06:55:23.299 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T06:55:23.299 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T06:55:23.299 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 46 2024-08-01T06:55:23.299 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:55:23.300 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T06:55:23.300 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T06:55:23.300 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=14482,1=24281} 2024-08-01T06:55:23.300 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T06:55:23.300 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T06:55:23.300 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T06:55:23.300 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T06:55:23.300 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T06:55:23.300 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T06:55:23.300 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T06:55:23.300 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T06:55:23.300 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T06:55:23.300 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:55:23.300 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:24299} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:55:23.301 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{1:24281} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:55:23.301 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:24291} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:55:23.301 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:55:23.301 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:55:23.302 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-08-01T06:55:23.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.298+0000 7fb06ab92640 1 -- 172.21.15.16:0/811310231 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb05406cca0 msgr2=0x7fb05406f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:23.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.298+0000 7fb06ab92640 1 --2- 172.21.15.16:0/811310231 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb05406cca0 0x7fb05406f160 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb064102800 tx=0x7fb050005a90 comp rx=0 tx=0).stop 2024-08-01T06:55:23.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.298+0000 7fb06ab92640 1 -- 172.21.15.16:0/811310231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0640feaf0 msgr2=0x7fb064102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:23.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.298+0000 7fb06ab92640 1 --2- 172.21.15.16:0/811310231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0640feaf0 0x7fb064102a80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb05800e970 tx=0x7fb05800ee30 comp rx=0 tx=0).stop 2024-08-01T06:55:23.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.298+0000 7fb06ab92640 1 -- 172.21.15.16:0/811310231 shutdown_connections 2024-08-01T06:55:23.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.298+0000 7fb06ab92640 1 --2- 172.21.15.16:0/811310231 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb05406cca0 0x7fb05406f160 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:23.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.298+0000 7fb06ab92640 1 --2- 172.21.15.16:0/811310231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0640ffcf0 0x7fb0641010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:23.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.298+0000 7fb06ab92640 1 --2- 172.21.15.16:0/811310231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0640feaf0 0x7fb064102a80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:23.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.298+0000 7fb06ab92640 1 -- 172.21.15.16:0/811310231 >> 172.21.15.16:0/811310231 conn(0x7fb0640fa280 msgr2=0x7fb064067cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:23.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.298+0000 7fb06ab92640 1 -- 172.21.15.16:0/811310231 shutdown_connections 2024-08-01T06:55:23.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.299+0000 7fb06ab92640 1 -- 172.21.15.16:0/811310231 wait complete. 2024-08-01T06:55:23.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:23 smithi089 ceph-mon[36617]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:55:23.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:23 smithi089 ceph-mon[36617]: Upgrade: Updating mgr.smithi089.hfgnsr 2024-08-01T06:55:23.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:23 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:23.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:23 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.hfgnsr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-01T06:55:23.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:23 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-01T06:55:23.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:23 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:55:23.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:23 smithi089 ceph-mon[36617]: Deploying daemon mgr.smithi089.hfgnsr on smithi089 2024-08-01T06:55:23.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:23 smithi089 ceph-mon[36617]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:55:23.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:23 smithi089 ceph-mon[36617]: pgmap v239: 65 pgs: 65 active+clean; 99 MiB data, 567 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 494 op/s 2024-08-01T06:55:23.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:23 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/3026690609' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:55:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.412+0000 7ff7a973d640 1 -- 172.21.15.16:0/1356749071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7a4100e00 msgr2=0x7ff7a4101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.412+0000 7ff7a973d640 1 --2- 172.21.15.16:0/1356749071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7a4100e00 0x7ff7a4101280 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff7980097e0 tx=0x7ff79802a3f0 comp rx=0 tx=0).stop 2024-08-01T06:55:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.412+0000 7ff7a973d640 1 -- 172.21.15.16:0/1356749071 shutdown_connections 2024-08-01T06:55:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.412+0000 7ff7a973d640 1 --2- 172.21.15.16:0/1356749071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7a4100e00 0x7ff7a4101280 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.412+0000 7ff7a973d640 1 --2- 172.21.15.16:0/1356749071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7a40fde20 0x7ff7a40fe220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:23.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.412+0000 7ff7a973d640 1 -- 172.21.15.16:0/1356749071 >> 172.21.15.16:0/1356749071 conn(0x7ff7a40f9950 msgr2=0x7ff7a40fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:23.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.412+0000 7ff7a973d640 1 -- 172.21.15.16:0/1356749071 shutdown_connections 2024-08-01T06:55:23.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.412+0000 7ff7a973d640 1 -- 172.21.15.16:0/1356749071 wait complete. 2024-08-01T06:55:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.413+0000 7ff7a973d640 1 Processor -- start 2024-08-01T06:55:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.413+0000 7ff7a973d640 1 -- start start 2024-08-01T06:55:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.414+0000 7ff7a973d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7a40fde20 0x7ff7a4195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.414+0000 7ff7a973d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7a4100e00 0x7ff7a4195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.414+0000 7ff7a973d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a4196140 con 0x7ff7a4100e00 2024-08-01T06:55:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.414+0000 7ff7a973d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a41962b0 con 0x7ff7a40fde20 2024-08-01T06:55:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.414+0000 7ff7a27fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7a4100e00 0x7ff7a4195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.414+0000 7ff7a2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7a40fde20 0x7ff7a4195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.414+0000 7ff7a27fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7a4100e00 0x7ff7a4195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47804/0 (socket says 172.21.15.16:47804) 2024-08-01T06:55:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.414+0000 7ff7a27fc640 1 -- 172.21.15.16:0/1281375962 learned_addr learned my addr 172.21.15.16:0/1281375962 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:55:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.414+0000 7ff7a2ffd640 1 -- 172.21.15.16:0/1281375962 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7a4100e00 msgr2=0x7ff7a4195b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.414+0000 7ff7a2ffd640 1 --2- 172.21.15.16:0/1281375962 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7a4100e00 0x7ff7a4195b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.414+0000 7ff7a2ffd640 1 -- 172.21.15.16:0/1281375962 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff798009490 con 0x7ff7a40fde20 2024-08-01T06:55:23.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.415+0000 7ff7a2ffd640 1 --2- 172.21.15.16:0/1281375962 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7a40fde20 0x7ff7a4195630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff794005fd0 tx=0x7ff79400eba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:23.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.415+0000 7ff78bfff640 1 -- 172.21.15.16:0/1281375962 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7940041f0 con 0x7ff7a40fde20 2024-08-01T06:55:23.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.415+0000 7ff78bfff640 1 -- 172.21.15.16:0/1281375962 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff79400cd70 con 0x7ff7a40fde20 2024-08-01T06:55:23.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.415+0000 7ff7a973d640 1 -- 172.21.15.16:0/1281375962 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a40febf0 con 0x7ff7a40fde20 2024-08-01T06:55:23.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.415+0000 7ff78bfff640 1 -- 172.21.15.16:0/1281375962 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff794003e40 con 0x7ff7a40fde20 2024-08-01T06:55:23.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.415+0000 7ff7a973d640 1 -- 172.21.15.16:0/1281375962 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a40ff140 con 0x7ff7a40fde20 2024-08-01T06:55:23.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.417+0000 7ff7a973d640 1 -- 172.21.15.16:0/1281375962 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a418f6d0 con 0x7ff7a40fde20 2024-08-01T06:55:23.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.417+0000 7ff78bfff640 1 -- 172.21.15.16:0/1281375962 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff794018490 con 0x7ff7a40fde20 2024-08-01T06:55:23.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.418+0000 7ff78bfff640 1 --2- 172.21.15.16:0/1281375962 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff78c071070 0x7ff78c073530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:23.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.418+0000 7ff78bfff640 1 -- 172.21.15.16:0/1281375962 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff794014070 con 0x7ff7a40fde20 2024-08-01T06:55:23.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.418+0000 7ff7a27fc640 1 --2- 172.21.15.16:0/1281375962 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff78c071070 0x7ff78c073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:23.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.419+0000 7ff7a27fc640 1 --2- 172.21.15.16:0/1281375962 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff78c071070 0x7ff78c073530 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4196b50 tx=0x7ff798030870 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:23.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.423+0000 7ff78bfff640 1 -- 172.21.15.16:0/1281375962 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7ff794056940 con 0x7ff7a40fde20 2024-08-01T06:55:23.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.723+0000 7ff7a973d640 1 -- 172.21.15.16:0/1281375962 --> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7a402c610 con 0x7ff78c071070 2024-08-01T06:55:23.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.724+0000 7ff78bfff640 1 -- 172.21.15.16:0/1281375962 <== mgr.14213 v2:172.21.15.16:6800/1423663197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7ff7a402c610 con 0x7ff78c071070 2024-08-01T06:55:23.726 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:55:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T06:55:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T06:55:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T06:55:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [], 2024-08-01T06:55:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "0/23 daemons upgraded", 2024-08-01T06:55:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading mgr daemons", 2024-08-01T06:55:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T06:55:23.727 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:55:23.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.726+0000 7ff7a973d640 1 -- 172.21.15.16:0/1281375962 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff78c071070 msgr2=0x7ff78c073530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:23.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.726+0000 7ff7a973d640 1 --2- 172.21.15.16:0/1281375962 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff78c071070 0x7ff78c073530 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4196b50 tx=0x7ff798030870 comp rx=0 tx=0).stop 2024-08-01T06:55:23.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.726+0000 7ff7a973d640 1 -- 172.21.15.16:0/1281375962 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7a40fde20 msgr2=0x7ff7a4195630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:23.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.726+0000 7ff7a973d640 1 --2- 172.21.15.16:0/1281375962 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7a40fde20 0x7ff7a4195630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff794005fd0 tx=0x7ff79400eba0 comp rx=0 tx=0).stop 2024-08-01T06:55:23.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.726+0000 7ff7a973d640 1 -- 172.21.15.16:0/1281375962 shutdown_connections 2024-08-01T06:55:23.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.726+0000 7ff7a973d640 1 --2- 172.21.15.16:0/1281375962 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7ff78c071070 0x7ff78c073530 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:23.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.726+0000 7ff7a973d640 1 --2- 172.21.15.16:0/1281375962 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7a4100e00 0x7ff7a4195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:23.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.726+0000 7ff7a973d640 1 --2- 172.21.15.16:0/1281375962 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7a40fde20 0x7ff7a4195630 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:23.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.726+0000 7ff7a973d640 1 -- 172.21.15.16:0/1281375962 >> 172.21.15.16:0/1281375962 conn(0x7ff7a40f9950 msgr2=0x7ff7a41044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:23.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.726+0000 7ff7a973d640 1 -- 172.21.15.16:0/1281375962 shutdown_connections 2024-08-01T06:55:23.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.726+0000 7ff7a973d640 1 -- 172.21.15.16:0/1281375962 wait complete. 2024-08-01T06:55:23.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.834+0000 7fb8cef1e640 1 -- 172.21.15.16:0/1230318152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c80ffcf0 msgr2=0x7fb8c8100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:23.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.834+0000 7fb8cef1e640 1 --2- 172.21.15.16:0/1230318152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c80ffcf0 0x7fb8c8100170 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009880 tx=0x7fb8b402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:55:23.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.835+0000 7fb8cef1e640 1 -- 172.21.15.16:0/1230318152 shutdown_connections 2024-08-01T06:55:23.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.835+0000 7fb8cef1e640 1 --2- 172.21.15.16:0/1230318152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c80ffcf0 0x7fb8c8100170 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:23.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.835+0000 7fb8cef1e640 1 --2- 172.21.15.16:0/1230318152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c80feaf0 0x7fb8c80feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:23.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.835+0000 7fb8cef1e640 1 -- 172.21.15.16:0/1230318152 >> 172.21.15.16:0/1230318152 conn(0x7fb8c80fa280 msgr2=0x7fb8c80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:23.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.835+0000 7fb8cef1e640 1 -- 172.21.15.16:0/1230318152 shutdown_connections 2024-08-01T06:55:23.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.835+0000 7fb8cef1e640 1 -- 172.21.15.16:0/1230318152 wait complete. 2024-08-01T06:55:23.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.836+0000 7fb8cef1e640 1 Processor -- start 2024-08-01T06:55:23.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.836+0000 7fb8cef1e640 1 -- start start 2024-08-01T06:55:23.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.836+0000 7fb8cef1e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c80feaf0 0x7fb8c8102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:23.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.836+0000 7fb8cef1e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c80ffcf0 0x7fb8c81010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:23.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.836+0000 7fb8cef1e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c8101610 con 0x7fb8c80ffcf0 2024-08-01T06:55:23.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.836+0000 7fb8cef1e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c8101780 con 0x7fb8c80feaf0 2024-08-01T06:55:23.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.836+0000 7fb8c7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c80ffcf0 0x7fb8c81010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:23.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.836+0000 7fb8cccba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c80feaf0 0x7fb8c8102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:23.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.836+0000 7fb8c7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c80ffcf0 0x7fb8c81010d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47832/0 (socket says 172.21.15.16:47832) 2024-08-01T06:55:23.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.836+0000 7fb8c7fff640 1 -- 172.21.15.16:0/4268288551 learned_addr learned my addr 172.21.15.16:0/4268288551 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:55:23.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.836+0000 7fb8cccba640 1 -- 172.21.15.16:0/4268288551 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c80ffcf0 msgr2=0x7fb8c81010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:23.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.837+0000 7fb8cccba640 1 --2- 172.21.15.16:0/4268288551 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c80ffcf0 0x7fb8c81010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:23.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.837+0000 7fb8cccba640 1 -- 172.21.15.16:0/4268288551 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b4009560 con 0x7fb8c80feaf0 2024-08-01T06:55:23.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.837+0000 7fb8cccba640 1 --2- 172.21.15.16:0/4268288551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c80feaf0 0x7fb8c8102a80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00e940 tx=0x7fb8bc00ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:23.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.837+0000 7fb8c5ffb640 1 -- 172.21.15.16:0/4268288551 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8bc00cc90 con 0x7fb8c80feaf0 2024-08-01T06:55:23.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.837+0000 7fb8cef1e640 1 -- 172.21.15.16:0/4268288551 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c8101a60 con 0x7fb8c80feaf0 2024-08-01T06:55:23.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.837+0000 7fb8c5ffb640 1 -- 172.21.15.16:0/4268288551 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb8bc0044f0 con 0x7fb8c80feaf0 2024-08-01T06:55:23.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.837+0000 7fb8cef1e640 1 -- 172.21.15.16:0/4268288551 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c819d730 con 0x7fb8c80feaf0 2024-08-01T06:55:23.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.838+0000 7fb8c5ffb640 1 -- 172.21.15.16:0/4268288551 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8bc010430 con 0x7fb8c80feaf0 2024-08-01T06:55:23.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.839+0000 7fb8cef1e640 1 -- 172.21.15.16:0/4268288551 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c8107700 con 0x7fb8c80feaf0 2024-08-01T06:55:23.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.839+0000 7fb8c5ffb640 1 -- 172.21.15.16:0/4268288551 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb8bc0106f0 con 0x7fb8c80feaf0 2024-08-01T06:55:23.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.840+0000 7fb8c5ffb640 1 --2- 172.21.15.16:0/4268288551 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb8b806cc60 0x7fb8b806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:23.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.840+0000 7fb8c5ffb640 1 -- 172.21.15.16:0/4268288551 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb8bc014070 con 0x7fb8c80feaf0 2024-08-01T06:55:23.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.840+0000 7fb8c7fff640 1 --2- 172.21.15.16:0/4268288551 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb8b806cc60 0x7fb8b806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:23.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.841+0000 7fb8c7fff640 1 --2- 172.21.15.16:0/4268288551 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb8b806cc60 0x7fb8b806f120 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8102800 tx=0x7fb8b40314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:23.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:23.845+0000 7fb8c5ffb640 1 -- 172.21.15.16:0/4268288551 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fb8bc056a10 con 0x7fb8c80feaf0 2024-08-01T06:55:24.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:24.257+0000 7fb8cef1e640 1 -- 172.21.15.16:0/4268288551 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb8c8107900 con 0x7fb8c80feaf0 2024-08-01T06:55:24.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:24.258+0000 7fb8c5ffb640 1 -- 172.21.15.16:0/4268288551 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb8bc05a030 con 0x7fb8c80feaf0 2024-08-01T06:55:24.261 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-08-01T06:55:24.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:24.260+0000 7fb8cef1e640 1 -- 172.21.15.16:0/4268288551 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb8b806cc60 msgr2=0x7fb8b806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:24.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:24.260+0000 7fb8cef1e640 1 --2- 172.21.15.16:0/4268288551 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb8b806cc60 0x7fb8b806f120 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8102800 tx=0x7fb8b40314e0 comp rx=0 tx=0).stop 2024-08-01T06:55:24.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:24.260+0000 7fb8cef1e640 1 -- 172.21.15.16:0/4268288551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c80feaf0 msgr2=0x7fb8c8102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:24.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:24.260+0000 7fb8cef1e640 1 --2- 172.21.15.16:0/4268288551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c80feaf0 0x7fb8c8102a80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00e940 tx=0x7fb8bc00ee00 comp rx=0 tx=0).stop 2024-08-01T06:55:24.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:24.261+0000 7fb8cef1e640 1 -- 172.21.15.16:0/4268288551 shutdown_connections 2024-08-01T06:55:24.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:24.261+0000 7fb8cef1e640 1 --2- 172.21.15.16:0/4268288551 >> [v2:172.21.15.16:6800/1423663197,v1:172.21.15.16:6801/1423663197] conn(0x7fb8b806cc60 0x7fb8b806f120 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:24.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:24.261+0000 7fb8cef1e640 1 --2- 172.21.15.16:0/4268288551 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c80ffcf0 0x7fb8c81010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:24.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:24.261+0000 7fb8cef1e640 1 --2- 172.21.15.16:0/4268288551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c80feaf0 0x7fb8c8102a80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:24.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:24.261+0000 7fb8cef1e640 1 -- 172.21.15.16:0/4268288551 >> 172.21.15.16:0/4268288551 conn(0x7fb8c80fa280 msgr2=0x7fb8c8067d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:24.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:24.261+0000 7fb8cef1e640 1 -- 172.21.15.16:0/4268288551 shutdown_connections 2024-08-01T06:55:24.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:24.261+0000 7fb8cef1e640 1 -- 172.21.15.16:0/4268288551 wait complete. 2024-08-01T06:55:24.266 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:24 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/811310231' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:55:24.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:24 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/811310231' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:55:25.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:25 smithi089 ceph-mon[36617]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:55:25.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:25 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/4268288551' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:55:25.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:25 smithi089 ceph-mon[36617]: pgmap v240: 65 pgs: 65 active+clean; 105 MiB data, 599 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 468 op/s 2024-08-01T06:55:25.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:25 smithi016 ceph-mon[29266]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:55:25.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:25 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/4268288551' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:55:25.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:25 smithi016 ceph-mon[29266]: pgmap v240: 65 pgs: 65 active+clean; 105 MiB data, 599 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 468 op/s 2024-08-01T06:55:26.721 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:26 smithi089 ceph-mon[36617]: pgmap v241: 65 pgs: 65 active+clean; 111 MiB data, 603 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 425 op/s 2024-08-01T06:55:27.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:26 smithi016 ceph-mon[29266]: pgmap v241: 65 pgs: 65 active+clean; 111 MiB data, 603 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 425 op/s 2024-08-01T06:55:29.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:28 smithi089 ceph-mon[36617]: pgmap v242: 65 pgs: 65 active+clean; 126 MiB data, 654 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.9 MiB/s wr, 529 op/s 2024-08-01T06:55:29.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:28 smithi016 ceph-mon[29266]: pgmap v242: 65 pgs: 65 active+clean; 126 MiB data, 654 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.9 MiB/s wr, 529 op/s 2024-08-01T06:55:31.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:31 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:31.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:31 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:31.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:31 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:55:31.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:31 smithi089 ceph-mon[36617]: pgmap v243: 65 pgs: 65 active+clean; 134 MiB data, 671 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 457 op/s 2024-08-01T06:55:31.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:31 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:31.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:31 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:31.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:31 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:55:31.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:31 smithi016 ceph-mon[29266]: pgmap v243: 65 pgs: 65 active+clean; 134 MiB data, 671 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 457 op/s 2024-08-01T06:55:32.806 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:32 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:55:32.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:32 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:55:33.869 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:33 smithi089 ceph-mon[36617]: pgmap v244: 65 pgs: 65 active+clean; 136 MiB data, 686 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 469 op/s 2024-08-01T06:55:33.869 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:33 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:33.869 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:33 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:33.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:33 smithi016 ceph-mon[29266]: pgmap v244: 65 pgs: 65 active+clean; 136 MiB data, 686 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 469 op/s 2024-08-01T06:55:33.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:33 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:33.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:33 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:35.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:35 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:35.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:35 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:35.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:35 smithi089 ceph-mon[36617]: pgmap v245: 65 pgs: 65 active+clean; 143 MiB data, 696 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 452 op/s 2024-08-01T06:55:35.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:35 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:35.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:35 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:35.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:35 smithi016 ceph-mon[29266]: pgmap v245: 65 pgs: 65 active+clean; 143 MiB data, 696 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 452 op/s 2024-08-01T06:55:36.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:36 smithi089 ceph-mon[36617]: Standby manager daemon smithi089.hfgnsr restarted 2024-08-01T06:55:36.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:36 smithi089 ceph-mon[36617]: Standby manager daemon smithi089.hfgnsr started 2024-08-01T06:55:36.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:36 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/crt"}]: dispatch 2024-08-01T06:55:36.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:36 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-01T06:55:36.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:36 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/key"}]: dispatch 2024-08-01T06:55:36.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:36 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-01T06:55:36.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:36 smithi016 ceph-mon[29266]: Standby manager daemon smithi089.hfgnsr restarted 2024-08-01T06:55:36.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:36 smithi016 ceph-mon[29266]: Standby manager daemon smithi089.hfgnsr started 2024-08-01T06:55:36.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:36 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/crt"}]: dispatch 2024-08-01T06:55:36.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:36 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-01T06:55:36.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:36 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/key"}]: dispatch 2024-08-01T06:55:36.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:36 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-01T06:55:37.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:37 smithi089 ceph-mon[36617]: mgrmap e20: smithi016.whigbo(active, since 7m), standbys: smithi089.hfgnsr 2024-08-01T06:55:37.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:37 smithi089 ceph-mon[36617]: pgmap v246: 65 pgs: 65 active+clean; 144 MiB data, 709 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 419 op/s 2024-08-01T06:55:37.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:37 smithi016 ceph-mon[29266]: mgrmap e20: smithi016.whigbo(active, since 7m), standbys: smithi089.hfgnsr 2024-08-01T06:55:37.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:37 smithi016 ceph-mon[29266]: pgmap v246: 65 pgs: 65 active+clean; 144 MiB data, 709 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 419 op/s 2024-08-01T06:55:38.751 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:38.751 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:38.751 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:55:38.751 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:55:38.751 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:38.751 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:55:38.751 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr fail", "who": "smithi016.whigbo"}]: dispatch 2024-08-01T06:55:38.751 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: Activating manager daemon smithi089.hfgnsr 2024-08-01T06:55:38.752 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:55:38.752 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:55:38.752 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.fziqod"}]: dispatch 2024-08-01T06:55:38.752 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: osdmap e47: 6 total, 6 up, 6 in 2024-08-01T06:55:38.752 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.jhouje"}]: dispatch 2024-08-01T06:55:38.752 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.xanuld"}]: dispatch 2024-08-01T06:55:38.752 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "mgr fail", "who": "smithi016.whigbo"}]': finished 2024-08-01T06:55:38.752 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: mgrmap e21: smithi089.hfgnsr(active, starting, since 0.00930002s) 2024-08-01T06:55:38.752 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.bgqkxu"}]: dispatch 2024-08-01T06:55:38.752 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mgr metadata", "who": "smithi089.hfgnsr", "id": "smithi089.hfgnsr"}]: dispatch 2024-08-01T06:55:38.752 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:55:38.752 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-01T06:55:38.752 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T06:55:38.753 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-01T06:55:38.753 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T06:55:38.753 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T06:55:38.753 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-01T06:55:38.753 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-01T06:55:38.753 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-01T06:55:38.753 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: Manager daemon smithi089.hfgnsr is now available 2024-08-01T06:55:38.753 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: Migrating agent root cert to cert store 2024-08-01T06:55:38.753 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:38.753 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: Migrating agent root key to cert store 2024-08-01T06:55:38.753 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:38.753 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: Checking for cert/key for grafana.smithi016 2024-08-01T06:55:38.753 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: Migrating grafana.smithi016 cert to cert store 2024-08-01T06:55:38.753 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:38.754 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: Migrating grafana.smithi016 key to cert store 2024-08-01T06:55:38.754 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:38.754 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:38.754 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:55:38.754 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:55:38.754 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.hfgnsr/mirror_snapshot_schedule"}]: dispatch 2024-08-01T06:55:38.754 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.hfgnsr/mirror_snapshot_schedule"}]: dispatch 2024-08-01T06:55:38.754 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.hfgnsr/trash_purge_schedule"}]: dispatch 2024-08-01T06:55:38.754 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:38 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.hfgnsr/trash_purge_schedule"}]: dispatch 2024-08-01T06:55:38.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:38.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:38.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:55:38.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:55:38.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' 2024-08-01T06:55:38.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:55:38.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr fail", "who": "smithi016.whigbo"}]: dispatch 2024-08-01T06:55:38.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: Activating manager daemon smithi089.hfgnsr 2024-08-01T06:55:38.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:55:38.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:55:38.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.fziqod"}]: dispatch 2024-08-01T06:55:38.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: osdmap e47: 6 total, 6 up, 6 in 2024-08-01T06:55:38.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.jhouje"}]: dispatch 2024-08-01T06:55:38.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.xanuld"}]: dispatch 2024-08-01T06:55:38.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.14213 172.21.15.16:0/2350150049' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "mgr fail", "who": "smithi016.whigbo"}]': finished 2024-08-01T06:55:38.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: mgrmap e21: smithi089.hfgnsr(active, starting, since 0.00930002s) 2024-08-01T06:55:38.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.bgqkxu"}]: dispatch 2024-08-01T06:55:38.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mgr metadata", "who": "smithi089.hfgnsr", "id": "smithi089.hfgnsr"}]: dispatch 2024-08-01T06:55:38.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:55:38.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-01T06:55:38.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T06:55:38.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-01T06:55:38.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T06:55:38.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T06:55:38.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-01T06:55:38.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-01T06:55:38.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-01T06:55:38.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: Manager daemon smithi089.hfgnsr is now available 2024-08-01T06:55:38.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: Migrating agent root cert to cert store 2024-08-01T06:55:38.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:38.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: Migrating agent root key to cert store 2024-08-01T06:55:38.890 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:38.890 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: Checking for cert/key for grafana.smithi016 2024-08-01T06:55:38.890 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: Migrating grafana.smithi016 cert to cert store 2024-08-01T06:55:38.890 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:38.890 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: Migrating grafana.smithi016 key to cert store 2024-08-01T06:55:38.890 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:38.890 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:38.890 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:55:38.890 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:55:38.890 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.hfgnsr/mirror_snapshot_schedule"}]: dispatch 2024-08-01T06:55:38.890 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.hfgnsr/mirror_snapshot_schedule"}]: dispatch 2024-08-01T06:55:38.890 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.hfgnsr/trash_purge_schedule"}]: dispatch 2024-08-01T06:55:38.890 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:38 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.hfgnsr/trash_purge_schedule"}]: dispatch 2024-08-01T06:55:40.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:39 smithi089 ceph-mon[36617]: Deploying cephadm binary to smithi089 2024-08-01T06:55:40.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:39 smithi089 ceph-mon[36617]: Deploying cephadm binary to smithi016 2024-08-01T06:55:40.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:39 smithi089 ceph-mon[36617]: mgrmap e22: smithi089.hfgnsr(active, since 1.01058s) 2024-08-01T06:55:40.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:39 smithi089 ceph-mon[36617]: pgmap v3: 65 pgs: 65 active+clean; 173 MiB data, 849 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:55:40.141 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:39 smithi016 ceph-mon[29266]: Deploying cephadm binary to smithi089 2024-08-01T06:55:40.141 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:39 smithi016 ceph-mon[29266]: Deploying cephadm binary to smithi016 2024-08-01T06:55:40.141 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:39 smithi016 ceph-mon[29266]: mgrmap e22: smithi089.hfgnsr(active, since 1.01058s) 2024-08-01T06:55:40.141 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:39 smithi016 ceph-mon[29266]: pgmap v3: 65 pgs: 65 active+clean; 173 MiB data, 849 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:55:41.065 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:40 smithi016 ceph-mon[29266]: [01/Aug/2024:06:55:39] ENGINE Bus STARTING 2024-08-01T06:55:41.065 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:40 smithi016 ceph-mon[29266]: pgmap v4: 65 pgs: 65 active+clean; 173 MiB data, 849 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:55:41.066 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:40 smithi016 ceph-mon[29266]: [01/Aug/2024:06:55:39] ENGINE Serving on https://172.21.15.89:7150 2024-08-01T06:55:41.066 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:40 smithi016 ceph-mon[29266]: [01/Aug/2024:06:55:39] ENGINE Error in HTTPServer.serve 2024-08-01T06:55:41.066 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Traceback (most recent call last): 2024-08-01T06:55:41.066 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-01T06:55:41.066 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self._connections.run(self.expiration_interval) 2024-08-01T06:55:41.066 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-01T06:55:41.066 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self._run(expiration_interval) 2024-08-01T06:55:41.066 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-01T06:55:41.066 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-01T06:55:41.066 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-01T06:55:41.066 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-01T06:55:41.066 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-01T06:55:41.067 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: s = self.context.wrap_socket( 2024-08-01T06:55:41.067 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-01T06:55:41.067 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: return self.sslsocket_class._create( 2024-08-01T06:55:41.067 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-01T06:55:41.067 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self.do_handshake() 2024-08-01T06:55:41.067 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-01T06:55:41.067 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self._sslobj.do_handshake() 2024-08-01T06:55:41.067 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-01T06:55:41.067 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:40 smithi016 ceph-mon[29266]: [01/Aug/2024:06:55:39] ENGINE Serving on http://172.21.15.89:8765 2024-08-01T06:55:41.067 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:40 smithi016 ceph-mon[29266]: [01/Aug/2024:06:55:39] ENGINE Bus STARTED 2024-08-01T06:55:41.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:40 smithi089 ceph-mon[36617]: [01/Aug/2024:06:55:39] ENGINE Bus STARTING 2024-08-01T06:55:41.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:40 smithi089 ceph-mon[36617]: pgmap v4: 65 pgs: 65 active+clean; 173 MiB data, 849 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:55:41.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:40 smithi089 ceph-mon[36617]: [01/Aug/2024:06:55:39] ENGINE Serving on https://172.21.15.89:7150 2024-08-01T06:55:41.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:40 smithi089 ceph-mon[36617]: [01/Aug/2024:06:55:39] ENGINE Error in HTTPServer.serve 2024-08-01T06:55:41.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Traceback (most recent call last): 2024-08-01T06:55:41.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-01T06:55:41.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-08-01T06:55:41.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-01T06:55:41.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._run(expiration_interval) 2024-08-01T06:55:41.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-01T06:55:41.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-01T06:55:41.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-01T06:55:41.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-01T06:55:41.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-01T06:55:41.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s = self.context.wrap_socket( 2024-08-01T06:55:41.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-01T06:55:41.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: return self.sslsocket_class._create( 2024-08-01T06:55:41.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-01T06:55:41.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self.do_handshake() 2024-08-01T06:55:41.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-01T06:55:41.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._sslobj.do_handshake() 2024-08-01T06:55:41.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-01T06:55:41.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:40 smithi089 ceph-mon[36617]: [01/Aug/2024:06:55:39] ENGINE Serving on http://172.21.15.89:8765 2024-08-01T06:55:41.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:40 smithi089 ceph-mon[36617]: [01/Aug/2024:06:55:39] ENGINE Bus STARTED 2024-08-01T06:55:41.372 INFO:tasks.workunit.client.1.smithi089.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-08-01T06:55:41.379 INFO:tasks.workunit.client.1.smithi089.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-08-01T06:55:41.379 INFO:tasks.workunit.client.1.smithi089.stderr:+ make 2024-08-01T06:55:42.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:41 smithi089 ceph-mon[36617]: mgrmap e23: smithi089.hfgnsr(active, since 3s) 2024-08-01T06:55:42.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:41 smithi016 ceph-mon[29266]: mgrmap e23: smithi089.hfgnsr(active, since 3s) 2024-08-01T06:55:42.422 INFO:tasks.workunit.client.1.smithi089.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-08-01T06:55:42.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:42 smithi016 ceph-mon[29266]: pgmap v5: 65 pgs: 65 active+clean; 173 MiB data, 849 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:55:42.952 INFO:tasks.workunit.client.1.smithi089.stderr:++ readlink -f fsstress 2024-08-01T06:55:42.954 INFO:tasks.workunit.client.1.smithi089.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-08-01T06:55:42.954 INFO:tasks.workunit.client.1.smithi089.stderr:+ popd 2024-08-01T06:55:42.955 INFO:tasks.workunit.client.1.smithi089.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-08-01T06:55:42.955 INFO:tasks.workunit.client.1.smithi089.stderr:+ popd 2024-08-01T06:55:42.955 INFO:tasks.workunit.client.1.smithi089.stdout:~/cephtest/mnt.1/client.1/tmp 2024-08-01T06:55:42.956 INFO:tasks.workunit.client.1.smithi089.stderr:++ mktemp -d -p . 2024-08-01T06:55:42.959 INFO:tasks.workunit.client.1.smithi089.stderr:+ T=./tmp.t4vdJmP4Nw 2024-08-01T06:55:42.959 INFO:tasks.workunit.client.1.smithi089.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.t4vdJmP4Nw -l 1 -n 1000 -p 10 -v 2024-08-01T06:55:42.964 INFO:tasks.workunit.client.1.smithi089.stdout:seed = 1722124747 2024-08-01T06:55:42.970 INFO:tasks.workunit.client.1.smithi089.stdout:0/0: dwrite - no filename 2024-08-01T06:55:42.975 INFO:tasks.workunit.client.1.smithi089.stdout:2/0: dwrite - no filename 2024-08-01T06:55:42.975 INFO:tasks.workunit.client.1.smithi089.stdout:2/1: dwrite - no filename 2024-08-01T06:55:42.975 INFO:tasks.workunit.client.1.smithi089.stdout:2/2: unlink - no file 2024-08-01T06:55:42.978 INFO:tasks.workunit.client.1.smithi089.stdout:0/1: symlink l0 0 2024-08-01T06:55:42.978 INFO:tasks.workunit.client.1.smithi089.stdout:0/2: dread - no filename 2024-08-01T06:55:42.978 INFO:tasks.workunit.client.1.smithi089.stdout:0/3: dread - no filename 2024-08-01T06:55:42.981 INFO:tasks.workunit.client.1.smithi089.stdout:3/0: chown . 892 1 2024-08-01T06:55:42.981 INFO:tasks.workunit.client.1.smithi089.stdout:3/1: rmdir - no directory 2024-08-01T06:55:42.981 INFO:tasks.workunit.client.1.smithi089.stdout:3/2: dwrite - no filename 2024-08-01T06:55:42.981 INFO:tasks.workunit.client.1.smithi089.stdout:3/3: dwrite - no filename 2024-08-01T06:55:42.981 INFO:tasks.workunit.client.1.smithi089.stdout:3/4: link - no file 2024-08-01T06:55:42.984 INFO:tasks.workunit.client.1.smithi089.stdout:1/0: mkdir d0 0 2024-08-01T06:55:42.986 INFO:tasks.workunit.client.1.smithi089.stdout:0/4: creat f1 x:0 0 0 2024-08-01T06:55:42.986 INFO:tasks.workunit.client.1.smithi089.stdout:0/5: chown l0 505 1 2024-08-01T06:55:42.989 INFO:tasks.workunit.client.1.smithi089.stdout:4/0: link - no file 2024-08-01T06:55:42.989 INFO:tasks.workunit.client.1.smithi089.stdout:4/1: chown . 5421 1 2024-08-01T06:55:42.989 INFO:tasks.workunit.client.1.smithi089.stdout:4/2: unlink - no file 2024-08-01T06:55:42.989 INFO:tasks.workunit.client.1.smithi089.stdout:4/3: dread - no filename 2024-08-01T06:55:42.989 INFO:tasks.workunit.client.1.smithi089.stdout:4/4: stat - no entries 2024-08-01T06:55:42.989 INFO:tasks.workunit.client.1.smithi089.stdout:4/5: write - no filename 2024-08-01T06:55:42.991 INFO:tasks.workunit.client.1.smithi089.stdout:2/3: mknod c0 0 2024-08-01T06:55:42.991 INFO:tasks.workunit.client.1.smithi089.stdout:2/4: stat c0 0 2024-08-01T06:55:42.997 INFO:tasks.workunit.client.1.smithi089.stdout:5/0: readlink - no filename 2024-08-01T06:55:42.997 INFO:tasks.workunit.client.1.smithi089.stdout:5/1: write - no filename 2024-08-01T06:55:43.002 INFO:tasks.workunit.client.1.smithi089.stdout:3/5: symlink l0 0 2024-08-01T06:55:43.005 INFO:tasks.workunit.client.1.smithi089.stdout:2/5: symlink l1 0 2024-08-01T06:55:43.006 INFO:tasks.workunit.client.1.smithi089.stdout:1/1: getdents d0 0 2024-08-01T06:55:43.006 INFO:tasks.workunit.client.1.smithi089.stdout:1/2: dwrite - no filename 2024-08-01T06:55:43.008 INFO:tasks.workunit.client.1.smithi089.stdout:0/6: link f1 f2 0 2024-08-01T06:55:43.009 INFO:tasks.workunit.client.1.smithi089.stdout:6/0: truncate - no filename 2024-08-01T06:55:43.010 INFO:tasks.workunit.client.1.smithi089.stdout:6/1: readlink - no filename 2024-08-01T06:55:43.035 INFO:tasks.workunit.client.1.smithi089.stdout:4/6: creat f0 x:0 0 0 2024-08-01T06:55:43.035 INFO:tasks.workunit.client.1.smithi089.stdout:4/7: chown f0 43 1 2024-08-01T06:55:43.036 INFO:tasks.workunit.client.1.smithi089.stdout:3/6: rename l0 to l1 0 2024-08-01T06:55:43.036 INFO:tasks.workunit.client.1.smithi089.stdout:3/7: dread - no filename 2024-08-01T06:55:43.036 INFO:tasks.workunit.client.1.smithi089.stdout:3/8: dread - no filename 2024-08-01T06:55:43.045 INFO:tasks.workunit.client.1.smithi089.stdout:2/6: creat f2 x:0 0 0 2024-08-01T06:55:43.046 INFO:tasks.workunit.client.1.smithi089.stdout:2/7: fdatasync f2 0 2024-08-01T06:55:43.046 INFO:tasks.workunit.client.1.smithi089.stdout:2/8: dread - f2 zero size 2024-08-01T06:55:43.052 INFO:tasks.workunit.client.1.smithi089.stdout:5/2: creat f0 x:0 0 0 2024-08-01T06:55:43.054 INFO:tasks.workunit.client.1.smithi089.stdout:4/8: rename f0 to f1 0 2024-08-01T06:55:43.055 INFO:tasks.workunit.client.1.smithi089.stdout:5/3: dread - f0 zero size 2024-08-01T06:55:43.056 INFO:tasks.workunit.client.1.smithi089.stdout:1/3: symlink d0/l1 0 2024-08-01T06:55:43.057 INFO:tasks.workunit.client.1.smithi089.stdout:6/2: creat f0 x:0 0 0 2024-08-01T06:55:43.058 INFO:tasks.workunit.client.1.smithi089.stdout:1/4: chown d0 209842030 1 2024-08-01T06:55:43.058 INFO:tasks.workunit.client.1.smithi089.stdout:1/5: write - no filename 2024-08-01T06:55:43.059 INFO:tasks.workunit.client.1.smithi089.stdout:2/9: dwrite f2 [0,4194304] 0 2024-08-01T06:55:43.059 INFO:tasks.workunit.client.1.smithi089.stdout:1/6: rename d0 to d0/d2 22 2024-08-01T06:55:43.060 INFO:tasks.workunit.client.1.smithi089.stdout:1/7: truncate - no filename 2024-08-01T06:55:43.060 INFO:tasks.workunit.client.1.smithi089.stdout:6/3: chown f0 3 1 2024-08-01T06:55:43.061 INFO:tasks.workunit.client.1.smithi089.stdout:0/7: dwrite f2 [0,4194304] 0 2024-08-01T06:55:43.062 INFO:tasks.workunit.client.1.smithi089.stdout:8/0: dread - no filename 2024-08-01T06:55:43.064 INFO:tasks.workunit.client.1.smithi089.stdout:5/4: symlink l1 0 2024-08-01T06:55:43.069 INFO:tasks.workunit.client.1.smithi089.stdout:1/8: mknod d0/c3 0 2024-08-01T06:55:43.070 INFO:tasks.workunit.client.1.smithi089.stdout:6/4: rename f0 to f1 0 2024-08-01T06:55:43.075 INFO:tasks.workunit.client.1.smithi089.stdout:9/0: dwrite - no filename 2024-08-01T06:55:43.075 INFO:tasks.workunit.client.1.smithi089.stdout:9/1: dread - no filename 2024-08-01T06:55:43.075 INFO:tasks.workunit.client.1.smithi089.stdout:9/2: rename - no filename 2024-08-01T06:55:43.076 INFO:tasks.workunit.client.1.smithi089.stdout:9/3: dread - no filename 2024-08-01T06:55:43.076 INFO:tasks.workunit.client.1.smithi089.stdout:9/4: dwrite - no filename 2024-08-01T06:55:43.076 INFO:tasks.workunit.client.1.smithi089.stdout:9/5: write - no filename 2024-08-01T06:55:43.076 INFO:tasks.workunit.client.1.smithi089.stdout:9/6: dread - no filename 2024-08-01T06:55:43.076 INFO:tasks.workunit.client.1.smithi089.stdout:9/7: chown . 17 1 2024-08-01T06:55:43.077 INFO:tasks.workunit.client.1.smithi089.stdout:9/8: dread - no filename 2024-08-01T06:55:43.077 INFO:tasks.workunit.client.1.smithi089.stdout:9/9: fsync - no filename 2024-08-01T06:55:43.077 INFO:tasks.workunit.client.1.smithi089.stdout:9/10: dwrite - no filename 2024-08-01T06:55:43.077 INFO:tasks.workunit.client.1.smithi089.stdout:9/11: fsync - no filename 2024-08-01T06:55:43.077 INFO:tasks.workunit.client.1.smithi089.stdout:9/12: write - no filename 2024-08-01T06:55:43.077 INFO:tasks.workunit.client.1.smithi089.stdout:9/13: rename - no filename 2024-08-01T06:55:43.077 INFO:tasks.workunit.client.1.smithi089.stdout:9/14: dread - no filename 2024-08-01T06:55:43.077 INFO:tasks.workunit.client.1.smithi089.stdout:4/9: dwrite f1 [0,4194304] 0 2024-08-01T06:55:43.077 INFO:tasks.workunit.client.1.smithi089.stdout:9/15: chown . 388 1 2024-08-01T06:55:43.077 INFO:tasks.workunit.client.1.smithi089.stdout:9/16: dwrite - no filename 2024-08-01T06:55:43.078 INFO:tasks.workunit.client.1.smithi089.stdout:7/0: creat f0 x:0 0 0 2024-08-01T06:55:43.079 INFO:tasks.workunit.client.1.smithi089.stdout:7/1: write f0 [70488,25272] 0 2024-08-01T06:55:43.080 INFO:tasks.workunit.client.1.smithi089.stdout:7/2: truncate f0 447818 0 2024-08-01T06:55:43.081 INFO:tasks.workunit.client.1.smithi089.stdout:7/3: write f0 [1208172,126034] 0 2024-08-01T06:55:43.082 INFO:tasks.workunit.client.1.smithi089.stdout:5/5: unlink l1 0 2024-08-01T06:55:43.083 INFO:tasks.workunit.client.1.smithi089.stdout:5/6: dread - f0 zero size 2024-08-01T06:55:43.084 INFO:tasks.workunit.client.1.smithi089.stdout:7/4: write f0 [1018211,81951] 0 2024-08-01T06:55:43.084 INFO:tasks.workunit.client.1.smithi089.stdout:0/8: fdatasync f2 0 2024-08-01T06:55:43.084 INFO:tasks.workunit.client.1.smithi089.stdout:0/9: rmdir - no directory 2024-08-01T06:55:43.086 INFO:tasks.workunit.client.1.smithi089.stdout:1/9: unlink d0/l1 0 2024-08-01T06:55:43.086 INFO:tasks.workunit.client.1.smithi089.stdout:1/10: write - no filename 2024-08-01T06:55:43.086 INFO:tasks.workunit.client.1.smithi089.stdout:1/11: dread - no filename 2024-08-01T06:55:43.086 INFO:tasks.workunit.client.1.smithi089.stdout:0/10: write f2 [1111319,106927] 0 2024-08-01T06:55:43.094 INFO:tasks.workunit.client.1.smithi089.stdout:6/5: mkdir d2 0 2024-08-01T06:55:43.098 INFO:tasks.workunit.client.1.smithi089.stdout:8/1: mknod c0 0 2024-08-01T06:55:43.099 INFO:tasks.workunit.client.1.smithi089.stdout:8/2: chown c0 206020558 1 2024-08-01T06:55:43.099 INFO:tasks.workunit.client.1.smithi089.stdout:8/3: chown c0 4194246 1 2024-08-01T06:55:43.103 INFO:tasks.workunit.client.1.smithi089.stdout:5/7: symlink l2 0 2024-08-01T06:55:43.104 INFO:tasks.workunit.client.1.smithi089.stdout:5/8: write f0 [681324,129025] 0 2024-08-01T06:55:43.104 INFO:tasks.workunit.client.1.smithi089.stdout:5/9: chown l2 26 1 2024-08-01T06:55:43.108 INFO:tasks.workunit.client.1.smithi089.stdout:5/10: read f0 [558935,121806] 0 2024-08-01T06:55:43.109 INFO:tasks.workunit.client.1.smithi089.stdout:9/17: mknod c0 0 2024-08-01T06:55:43.111 INFO:tasks.workunit.client.1.smithi089.stdout:4/10: link f1 f2 0 2024-08-01T06:55:43.113 INFO:tasks.workunit.client.1.smithi089.stdout:8/4: mknod c1 0 2024-08-01T06:55:43.113 INFO:tasks.workunit.client.1.smithi089.stdout:8/5: dread - no filename 2024-08-01T06:55:43.113 INFO:tasks.workunit.client.1.smithi089.stdout:8/6: dread - no filename 2024-08-01T06:55:43.113 INFO:tasks.workunit.client.1.smithi089.stdout:8/7: dwrite - no filename 2024-08-01T06:55:43.113 INFO:tasks.workunit.client.1.smithi089.stdout:8/8: rmdir - no directory 2024-08-01T06:55:43.113 INFO:tasks.workunit.client.1.smithi089.stdout:8/9: dread - no filename 2024-08-01T06:55:43.120 INFO:tasks.workunit.client.1.smithi089.stdout:6/6: mknod d2/c3 0 2024-08-01T06:55:43.121 INFO:tasks.workunit.client.1.smithi089.stdout:5/11: symlink l3 0 2024-08-01T06:55:43.123 INFO:tasks.workunit.client.1.smithi089.stdout:9/18: rename c0 to c1 0 2024-08-01T06:55:43.123 INFO:tasks.workunit.client.1.smithi089.stdout:9/19: truncate - no filename 2024-08-01T06:55:43.126 INFO:tasks.workunit.client.1.smithi089.stdout:8/10: creat f2 x:0 0 0 2024-08-01T06:55:43.127 INFO:tasks.workunit.client.1.smithi089.stdout:8/11: dread - f2 zero size 2024-08-01T06:55:43.127 INFO:tasks.workunit.client.1.smithi089.stdout:8/12: rmdir - no directory 2024-08-01T06:55:43.131 INFO:tasks.workunit.client.1.smithi089.stdout:6/7: mknod d2/c4 0 2024-08-01T06:55:43.133 INFO:tasks.workunit.client.1.smithi089.stdout:5/12: mknod c4 0 2024-08-01T06:55:43.133 INFO:tasks.workunit.client.1.smithi089.stdout:8/13: dwrite f2 [0,4194304] 0 2024-08-01T06:55:43.134 INFO:tasks.workunit.client.1.smithi089.stdout:8/14: stat c0 0 2024-08-01T06:55:43.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:42 smithi089 ceph-mon[36617]: pgmap v5: 65 pgs: 65 active+clean; 173 MiB data, 849 MiB used, 536 GiB / 536 GiB avail 2024-08-01T06:55:43.139 INFO:tasks.workunit.client.1.smithi089.stdout:6/8: write f1 [187866,54023] 0 2024-08-01T06:55:43.144 INFO:tasks.workunit.client.1.smithi089.stdout:8/15: mknod c3 0 2024-08-01T06:55:43.147 INFO:tasks.workunit.client.1.smithi089.stdout:5/13: dread f0 [0,4194304] 0 2024-08-01T06:55:43.149 INFO:tasks.workunit.client.1.smithi089.stdout:6/9: dwrite f1 [0,4194304] 0 2024-08-01T06:55:43.149 INFO:tasks.workunit.client.1.smithi089.stdout:8/16: rename c1 to c4 0 2024-08-01T06:55:43.150 INFO:tasks.workunit.client.1.smithi089.stdout:8/17: chown c3 7 1 2024-08-01T06:55:43.151 INFO:tasks.workunit.client.1.smithi089.stdout:8/18: write f2 [1492219,69246] 0 2024-08-01T06:55:43.155 INFO:tasks.workunit.client.1.smithi089.stdout:8/19: mkdir d5 0 2024-08-01T06:55:43.161 INFO:tasks.workunit.client.1.smithi089.stdout:8/20: mkdir d5/d6 0 2024-08-01T06:55:43.165 INFO:tasks.workunit.client.1.smithi089.stdout:8/21: mknod d5/d6/c7 0 2024-08-01T06:55:43.167 INFO:tasks.workunit.client.1.smithi089.stdout:8/22: dread f2 [0,4194304] 0 2024-08-01T06:55:43.170 INFO:tasks.workunit.client.1.smithi089.stdout:8/23: dread f2 [0,4194304] 0 2024-08-01T06:55:43.172 INFO:tasks.workunit.client.1.smithi089.stdout:8/24: symlink d5/d6/l8 0 2024-08-01T06:55:43.174 INFO:tasks.workunit.client.1.smithi089.stdout:8/25: creat d5/d6/f9 x:0 0 0 2024-08-01T06:55:43.174 INFO:tasks.workunit.client.1.smithi089.stdout:8/26: dread - d5/d6/f9 zero size 2024-08-01T06:55:43.810 INFO:tasks.workunit.client.1.smithi089.stdout:3/9: chown l1 0 1 2024-08-01T06:55:43.811 INFO:tasks.workunit.client.1.smithi089.stdout:3/10: chown l1 23147 1 2024-08-01T06:55:43.811 INFO:tasks.workunit.client.1.smithi089.stdout:3/11: dwrite - no filename 2024-08-01T06:55:43.811 INFO:tasks.workunit.client.1.smithi089.stdout:3/12: chown l1 8733 1 2024-08-01T06:55:43.811 INFO:tasks.workunit.client.1.smithi089.stdout:3/13: dwrite - no filename 2024-08-01T06:55:43.813 INFO:tasks.workunit.client.1.smithi089.stdout:3/14: mknod c2 0 2024-08-01T06:55:43.813 INFO:tasks.workunit.client.1.smithi089.stdout:3/15: chown l1 54222 1 2024-08-01T06:55:43.813 INFO:tasks.workunit.client.1.smithi089.stdout:3/16: write - no filename 2024-08-01T06:55:43.815 INFO:tasks.workunit.client.1.smithi089.stdout:3/17: creat f3 x:0 0 0 2024-08-01T06:55:43.816 INFO:tasks.workunit.client.1.smithi089.stdout:3/18: write f3 [589459,110119] 0 2024-08-01T06:55:43.816 INFO:tasks.workunit.client.1.smithi089.stdout:3/19: truncate f3 705989 0 2024-08-01T06:55:43.818 INFO:tasks.workunit.client.1.smithi089.stdout:3/20: symlink l4 0 2024-08-01T06:55:43.820 INFO:tasks.workunit.client.1.smithi089.stdout:3/21: mknod c5 0 2024-08-01T06:55:43.822 INFO:tasks.workunit.client.1.smithi089.stdout:3/22: mknod c6 0 2024-08-01T06:55:43.826 INFO:tasks.workunit.client.1.smithi089.stdout:3/23: dread f3 [0,4194304] 0 2024-08-01T06:55:43.828 INFO:tasks.workunit.client.1.smithi089.stdout:3/24: mkdir d7 0 2024-08-01T06:55:43.836 INFO:tasks.workunit.client.1.smithi089.stdout:3/25: dwrite f3 [0,4194304] 0 2024-08-01T06:55:43.838 INFO:tasks.workunit.client.1.smithi089.stdout:7/5: getdents . 0 2024-08-01T06:55:43.839 INFO:tasks.workunit.client.1.smithi089.stdout:7/6: read f0 [421322,36672] 0 2024-08-01T06:55:43.843 INFO:tasks.workunit.client.1.smithi089.stdout:7/7: mknod c1 0 2024-08-01T06:55:43.848 INFO:tasks.workunit.client.1.smithi089.stdout:4/11: write f2 [4542298,6797] 0 2024-08-01T06:55:43.848 INFO:tasks.workunit.client.1.smithi089.stdout:4/12: readlink - no filename 2024-08-01T06:55:43.850 INFO:tasks.workunit.client.1.smithi089.stdout:4/13: write f2 [4517209,103198] 0 2024-08-01T06:55:43.852 INFO:tasks.workunit.client.1.smithi089.stdout:2/10: truncate f2 2030152 0 2024-08-01T06:55:44.015 INFO:tasks.workunit.client.1.smithi089.stdout:2/11: symlink l3 0 2024-08-01T06:55:44.016 INFO:tasks.workunit.client.1.smithi089.stdout:7/8: dwrite f0 [0,4194304] 0 2024-08-01T06:55:44.016 INFO:tasks.workunit.client.1.smithi089.stdout:0/11: truncate f1 3550318 0 2024-08-01T06:55:44.017 INFO:tasks.workunit.client.1.smithi089.stdout:9/20: chown c1 27 1 2024-08-01T06:55:44.019 INFO:tasks.workunit.client.1.smithi089.stdout:6/10: truncate f1 156908 0 2024-08-01T06:55:44.022 INFO:tasks.workunit.client.1.smithi089.stdout:7/9: dwrite f0 [0,4194304] 0 2024-08-01T06:55:44.023 INFO:tasks.workunit.client.1.smithi089.stdout:7/10: write f0 [2188070,78853] 0 2024-08-01T06:55:44.034 INFO:tasks.workunit.client.1.smithi089.stdout:2/12: creat f4 x:0 0 0 2024-08-01T06:55:44.034 INFO:tasks.workunit.client.1.smithi089.stdout:2/13: stat l3 0 2024-08-01T06:55:44.037 INFO:tasks.workunit.client.1.smithi089.stdout:0/12: rename l0 to l3 0 2024-08-01T06:55:44.039 INFO:tasks.workunit.client.1.smithi089.stdout:9/21: mknod c2 0 2024-08-01T06:55:44.039 INFO:tasks.workunit.client.1.smithi089.stdout:9/22: dread - no filename 2024-08-01T06:55:44.039 INFO:tasks.workunit.client.1.smithi089.stdout:9/23: chown c2 1813529772 1 2024-08-01T06:55:44.040 INFO:tasks.workunit.client.1.smithi089.stdout:9/24: write - no filename 2024-08-01T06:55:44.040 INFO:tasks.workunit.client.1.smithi089.stdout:9/25: read - no filename 2024-08-01T06:55:44.040 INFO:tasks.workunit.client.1.smithi089.stdout:9/26: fdatasync - no filename 2024-08-01T06:55:44.040 INFO:tasks.workunit.client.1.smithi089.stdout:9/27: dread - no filename 2024-08-01T06:55:44.040 INFO:tasks.workunit.client.1.smithi089.stdout:9/28: dread - no filename 2024-08-01T06:55:44.042 INFO:tasks.workunit.client.1.smithi089.stdout:8/27: rename c4 to d5/ca 0 2024-08-01T06:55:44.043 INFO:tasks.workunit.client.1.smithi089.stdout:8/28: dread - d5/d6/f9 zero size 2024-08-01T06:55:44.043 INFO:tasks.workunit.client.1.smithi089.stdout:8/29: chown c0 25 1 2024-08-01T06:55:44.043 INFO:tasks.workunit.client.1.smithi089.stdout:8/30: readlink d5/d6/l8 0 2024-08-01T06:55:44.044 INFO:tasks.workunit.client.1.smithi089.stdout:8/31: dread - d5/d6/f9 zero size 2024-08-01T06:55:44.045 INFO:tasks.workunit.client.1.smithi089.stdout:8/32: read f2 [3166449,107823] 0 2024-08-01T06:55:44.049 INFO:tasks.workunit.client.1.smithi089.stdout:7/11: creat f2 x:0 0 0 2024-08-01T06:55:44.049 INFO:tasks.workunit.client.1.smithi089.stdout:7/12: dread - f2 zero size 2024-08-01T06:55:44.049 INFO:tasks.workunit.client.1.smithi089.stdout:7/13: rmdir - no directory 2024-08-01T06:55:44.051 INFO:tasks.workunit.client.1.smithi089.stdout:2/14: creat f5 x:0 0 0 2024-08-01T06:55:44.057 INFO:tasks.workunit.client.1.smithi089.stdout:9/29: unlink c1 0 2024-08-01T06:55:44.057 INFO:tasks.workunit.client.1.smithi089.stdout:9/30: truncate - no filename 2024-08-01T06:55:44.061 INFO:tasks.workunit.client.1.smithi089.stdout:7/14: creat f3 x:0 0 0 2024-08-01T06:55:44.062 INFO:tasks.workunit.client.1.smithi089.stdout:2/15: creat f6 x:0 0 0 2024-08-01T06:55:44.063 INFO:tasks.workunit.client.1.smithi089.stdout:2/16: truncate f5 195978 0 2024-08-01T06:55:44.067 INFO:tasks.workunit.client.1.smithi089.stdout:7/15: dwrite f3 [0,4194304] 0 2024-08-01T06:55:44.102 INFO:tasks.workunit.client.1.smithi089.stdout:2/17: mkdir d7 0 2024-08-01T06:55:44.105 INFO:tasks.workunit.client.1.smithi089.stdout:7/16: creat f4 x:0 0 0 2024-08-01T06:55:44.107 INFO:tasks.workunit.client.1.smithi089.stdout:7/17: mknod c5 0 2024-08-01T06:55:44.108 INFO:tasks.workunit.client.1.smithi089.stdout:2/18: getdents d7 0 2024-08-01T06:55:44.108 INFO:tasks.workunit.client.1.smithi089.stdout:2/19: chown c0 6 1 2024-08-01T06:55:44.108 INFO:tasks.workunit.client.1.smithi089.stdout:2/20: chown f2 54993836 1 2024-08-01T06:55:44.109 INFO:tasks.workunit.client.1.smithi089.stdout:2/21: stat f6 0 2024-08-01T06:55:44.109 INFO:tasks.workunit.client.1.smithi089.stdout:7/18: creat f6 x:0 0 0 2024-08-01T06:55:44.112 INFO:tasks.workunit.client.1.smithi089.stdout:2/22: mknod d7/c8 0 2024-08-01T06:55:44.283 INFO:tasks.workunit.client.1.smithi089.stdout:0/13: read f1 [780448,28692] 0 2024-08-01T06:55:44.285 INFO:tasks.workunit.client.1.smithi089.stdout:2/23: dwrite f2 [0,4194304] 0 2024-08-01T06:55:44.290 INFO:tasks.workunit.client.1.smithi089.stdout:6/11: dread f1 [0,4194304] 0 2024-08-01T06:55:44.294 INFO:tasks.workunit.client.1.smithi089.stdout:2/24: dwrite f5 [0,4194304] 0 2024-08-01T06:55:44.294 INFO:tasks.workunit.client.1.smithi089.stdout:2/25: read - f6 zero size 2024-08-01T06:55:44.298 INFO:tasks.workunit.client.1.smithi089.stdout:2/26: mknod d7/c9 0 2024-08-01T06:55:44.299 INFO:tasks.workunit.client.1.smithi089.stdout:6/12: getdents d2 0 2024-08-01T06:55:44.303 INFO:tasks.workunit.client.1.smithi089.stdout:6/13: write f1 [478775,115262] 0 2024-08-01T06:55:44.303 INFO:tasks.workunit.client.1.smithi089.stdout:2/27: dread f2 [0,4194304] 0 2024-08-01T06:55:44.309 INFO:tasks.workunit.client.1.smithi089.stdout:6/14: dwrite f1 [0,4194304] 0 2024-08-01T06:55:44.310 INFO:tasks.workunit.client.1.smithi089.stdout:6/15: write f1 [792850,119160] 0 2024-08-01T06:55:44.314 INFO:tasks.workunit.client.1.smithi089.stdout:6/16: getdents d2 0 2024-08-01T06:55:44.314 INFO:tasks.workunit.client.1.smithi089.stdout:6/17: stat f1 0 2024-08-01T06:55:44.315 INFO:tasks.workunit.client.1.smithi089.stdout:6/18: chown d2/c4 14285299 1 2024-08-01T06:55:44.321 INFO:tasks.workunit.client.1.smithi089.stdout:4/14: truncate f2 221651 0 2024-08-01T06:55:44.322 INFO:tasks.workunit.client.1.smithi089.stdout:6/19: dwrite f1 [0,4194304] 0 2024-08-01T06:55:44.324 INFO:tasks.workunit.client.1.smithi089.stdout:4/15: mkdir d3 0 2024-08-01T06:55:44.325 INFO:tasks.workunit.client.1.smithi089.stdout:2/28: fsync f4 0 2024-08-01T06:55:44.327 INFO:tasks.workunit.client.1.smithi089.stdout:6/20: dread f1 [0,4194304] 0 2024-08-01T06:55:44.329 INFO:tasks.workunit.client.1.smithi089.stdout:2/29: creat d7/fa x:0 0 0 2024-08-01T06:55:44.330 INFO:tasks.workunit.client.1.smithi089.stdout:4/16: stat f1 0 2024-08-01T06:55:44.330 INFO:tasks.workunit.client.1.smithi089.stdout:2/30: chown f5 0 1 2024-08-01T06:55:44.331 INFO:tasks.workunit.client.1.smithi089.stdout:2/31: fsync f4 0 2024-08-01T06:55:44.333 INFO:tasks.workunit.client.1.smithi089.stdout:6/21: creat d2/f5 x:0 0 0 2024-08-01T06:55:44.337 INFO:tasks.workunit.client.1.smithi089.stdout:2/32: unlink l3 0 2024-08-01T06:55:44.340 INFO:tasks.workunit.client.1.smithi089.stdout:4/17: fdatasync f1 0 2024-08-01T06:55:44.345 INFO:tasks.workunit.client.1.smithi089.stdout:6/22: link d2/c3 d2/c6 0 2024-08-01T06:55:44.346 INFO:tasks.workunit.client.1.smithi089.stdout:4/18: creat d3/f4 x:0 0 0 2024-08-01T06:55:44.352 INFO:tasks.workunit.client.1.smithi089.stdout:4/19: dwrite d3/f4 [0,4194304] 0 2024-08-01T06:55:44.353 INFO:tasks.workunit.client.1.smithi089.stdout:6/23: link d2/c3 d2/c7 0 2024-08-01T06:55:44.356 INFO:tasks.workunit.client.1.smithi089.stdout:4/20: mknod d3/c5 0 2024-08-01T06:55:44.357 INFO:tasks.workunit.client.1.smithi089.stdout:6/24: creat d2/f8 x:0 0 0 2024-08-01T06:55:44.359 INFO:tasks.workunit.client.1.smithi089.stdout:4/21: mknod d3/c6 0 2024-08-01T06:55:44.361 INFO:tasks.workunit.client.1.smithi089.stdout:6/25: write f1 [457520,13634] 0 2024-08-01T06:55:44.362 INFO:tasks.workunit.client.1.smithi089.stdout:4/22: fdatasync f2 0 2024-08-01T06:55:44.365 INFO:tasks.workunit.client.1.smithi089.stdout:6/26: dread f1 [0,4194304] 0 2024-08-01T06:55:44.371 INFO:tasks.workunit.client.1.smithi089.stdout:6/27: link d2/c4 d2/c9 0 2024-08-01T06:55:44.373 INFO:tasks.workunit.client.1.smithi089.stdout:6/28: mknod d2/ca 0 2024-08-01T06:55:44.385 INFO:tasks.workunit.client.1.smithi089.stdout:8/33: truncate f2 3222256 0 2024-08-01T06:55:44.389 INFO:tasks.workunit.client.1.smithi089.stdout:8/34: fdatasync f2 0 2024-08-01T06:55:44.390 INFO:tasks.workunit.client.1.smithi089.stdout:7/19: write f3 [4641631,84083] 0 2024-08-01T06:55:44.390 INFO:tasks.workunit.client.1.smithi089.stdout:7/20: chown f4 1 1 2024-08-01T06:55:44.393 INFO:tasks.workunit.client.1.smithi089.stdout:7/21: mkdir d7 0 2024-08-01T06:55:44.398 INFO:tasks.workunit.client.1.smithi089.stdout:7/22: link c5 d7/c8 0 2024-08-01T06:55:44.398 INFO:tasks.workunit.client.1.smithi089.stdout:7/23: fdatasync f4 0 2024-08-01T06:55:44.401 INFO:tasks.workunit.client.1.smithi089.stdout:7/24: chown d7/c8 86 1 2024-08-01T06:55:44.404 INFO:tasks.workunit.client.1.smithi089.stdout:7/25: symlink d7/l9 0 2024-08-01T06:55:44.408 INFO:tasks.workunit.client.1.smithi089.stdout:7/26: rename f2 to d7/fa 0 2024-08-01T06:55:44.411 INFO:tasks.workunit.client.1.smithi089.stdout:7/27: creat d7/fb x:0 0 0 2024-08-01T06:55:44.414 INFO:tasks.workunit.client.1.smithi089.stdout:7/28: mkdir d7/dc 0 2024-08-01T06:55:44.418 INFO:tasks.workunit.client.1.smithi089.stdout:7/29: write d7/fa [779604,113795] 0 2024-08-01T06:55:44.418 INFO:tasks.workunit.client.1.smithi089.stdout:7/30: creat d7/fd x:0 0 0 2024-08-01T06:55:44.424 INFO:tasks.workunit.client.1.smithi089.stdout:7/31: dwrite f4 [0,4194304] 0 2024-08-01T06:55:44.428 INFO:tasks.workunit.client.1.smithi089.stdout:7/32: dread d7/fa [0,4194304] 0 2024-08-01T06:55:44.433 INFO:tasks.workunit.client.1.smithi089.stdout:0/14: write f1 [29855,62108] 0 2024-08-01T06:55:44.436 INFO:tasks.workunit.client.1.smithi089.stdout:0/15: dread f1 [0,4194304] 0 2024-08-01T06:55:44.438 INFO:tasks.workunit.client.1.smithi089.stdout:0/16: readlink l3 0 2024-08-01T06:55:44.441 INFO:tasks.workunit.client.1.smithi089.stdout:0/17: symlink l4 0 2024-08-01T06:55:44.443 INFO:tasks.workunit.client.1.smithi089.stdout:0/18: write f1 [4015474,58369] 0 2024-08-01T06:55:44.443 INFO:tasks.workunit.client.1.smithi089.stdout:0/19: chown f2 14 1 2024-08-01T06:55:44.444 INFO:tasks.workunit.client.1.smithi089.stdout:0/20: chown l4 382 1 2024-08-01T06:55:44.447 INFO:tasks.workunit.client.1.smithi089.stdout:0/21: dread f1 [0,4194304] 0 2024-08-01T06:55:44.448 INFO:tasks.workunit.client.1.smithi089.stdout:4/23: write f1 [1080994,14399] 0 2024-08-01T06:55:44.450 INFO:tasks.workunit.client.1.smithi089.stdout:0/22: creat f5 x:0 0 0 2024-08-01T06:55:44.450 INFO:tasks.workunit.client.1.smithi089.stdout:0/23: readlink l4 0 2024-08-01T06:55:44.464 INFO:tasks.workunit.client.1.smithi089.stdout:4/24: rename d3/c6 to d3/c7 0 2024-08-01T06:55:44.465 INFO:tasks.workunit.client.1.smithi089.stdout:0/24: write f1 [1933878,115073] 0 2024-08-01T06:55:44.495 INFO:tasks.workunit.client.1.smithi089.stdout:6/29: truncate f1 4179058 0 2024-08-01T06:55:44.501 INFO:tasks.workunit.client.1.smithi089.stdout:8/35: fsync f2 0 2024-08-01T06:55:44.762 INFO:tasks.workunit.client.1.smithi089.stdout:4/25: mkdir d3/d8 0 2024-08-01T06:55:44.762 INFO:tasks.workunit.client.1.smithi089.stdout:0/25: unlink l3 0 2024-08-01T06:55:44.763 INFO:tasks.workunit.client.1.smithi089.stdout:0/26: write f5 [869227,54441] 0 2024-08-01T06:55:44.765 INFO:tasks.workunit.client.1.smithi089.stdout:0/27: mknod c6 0 2024-08-01T06:55:44.767 INFO:tasks.workunit.client.1.smithi089.stdout:4/26: creat d3/d8/f9 x:0 0 0 2024-08-01T06:55:44.767 INFO:tasks.workunit.client.1.smithi089.stdout:6/30: link d2/ca d2/cb 0 2024-08-01T06:55:44.769 INFO:tasks.workunit.client.1.smithi089.stdout:4/27: mknod d3/ca 0 2024-08-01T06:55:44.770 INFO:tasks.workunit.client.1.smithi089.stdout:4/28: mkdir d3/db 0 2024-08-01T06:55:44.771 INFO:tasks.workunit.client.1.smithi089.stdout:4/29: stat d3/c5 0 2024-08-01T06:55:44.771 INFO:tasks.workunit.client.1.smithi089.stdout:4/30: readlink - no filename 2024-08-01T06:55:44.772 INFO:tasks.workunit.client.1.smithi089.stdout:0/28: dwrite f5 [0,4194304] 0 2024-08-01T06:55:44.774 INFO:tasks.workunit.client.1.smithi089.stdout:6/31: link d2/c9 d2/cc 0 2024-08-01T06:55:44.775 INFO:tasks.workunit.client.1.smithi089.stdout:0/29: creat f7 x:0 0 0 2024-08-01T06:55:44.776 INFO:tasks.workunit.client.1.smithi089.stdout:0/30: write f7 [57030,48660] 0 2024-08-01T06:55:44.779 INFO:tasks.workunit.client.1.smithi089.stdout:0/31: mknod c8 0 2024-08-01T06:55:44.780 INFO:tasks.workunit.client.1.smithi089.stdout:4/31: dwrite f2 [0,4194304] 0 2024-08-01T06:55:44.782 INFO:tasks.workunit.client.1.smithi089.stdout:0/32: mkdir d9 0 2024-08-01T06:55:44.782 INFO:tasks.workunit.client.1.smithi089.stdout:0/33: chown c6 16 1 2024-08-01T06:55:44.787 INFO:tasks.workunit.client.1.smithi089.stdout:0/34: creat d9/fa x:0 0 0 2024-08-01T06:55:44.789 INFO:tasks.workunit.client.1.smithi089.stdout:4/32: dwrite d3/d8/f9 [0,4194304] 0 2024-08-01T06:55:44.791 INFO:tasks.workunit.client.1.smithi089.stdout:0/35: creat d9/fb x:0 0 0 2024-08-01T06:55:44.792 INFO:tasks.workunit.client.1.smithi089.stdout:0/36: write f5 [612335,122259] 0 2024-08-01T06:55:44.793 INFO:tasks.workunit.client.1.smithi089.stdout:0/37: write f2 [1630734,46902] 0 2024-08-01T06:55:44.796 INFO:tasks.workunit.client.1.smithi089.stdout:0/38: symlink d9/lc 0 2024-08-01T06:55:44.798 INFO:tasks.workunit.client.1.smithi089.stdout:4/33: fsync f2 0 2024-08-01T06:55:44.802 INFO:tasks.workunit.client.1.smithi089.stdout:0/39: dread f1 [0,4194304] 0 2024-08-01T06:55:44.802 INFO:tasks.workunit.client.1.smithi089.stdout:0/40: chown d9/fb 252429884 1 2024-08-01T06:55:44.803 INFO:tasks.workunit.client.1.smithi089.stdout:4/34: dread d3/d8/f9 [0,4194304] 0 2024-08-01T06:55:44.805 INFO:tasks.workunit.client.1.smithi089.stdout:0/41: write f1 [3549074,53088] 0 2024-08-01T06:55:44.806 INFO:tasks.workunit.client.1.smithi089.stdout:4/35: unlink f2 0 2024-08-01T06:55:44.811 INFO:tasks.workunit.client.1.smithi089.stdout:0/42: dwrite f1 [0,4194304] 0 2024-08-01T06:55:44.812 INFO:tasks.workunit.client.1.smithi089.stdout:4/36: dread d3/d8/f9 [0,4194304] 0 2024-08-01T06:55:44.812 INFO:tasks.workunit.client.1.smithi089.stdout:4/37: readlink - no filename 2024-08-01T06:55:44.812 INFO:tasks.workunit.client.1.smithi089.stdout:0/43: chown d9/lc 1049759855 1 2024-08-01T06:55:44.815 INFO:tasks.workunit.client.1.smithi089.stdout:0/44: creat d9/fd x:0 0 0 2024-08-01T06:55:44.816 INFO:tasks.workunit.client.1.smithi089.stdout:0/45: truncate d9/fd 188565 0 2024-08-01T06:55:44.816 INFO:tasks.workunit.client.1.smithi089.stdout:0/46: readlink d9/lc 0 2024-08-01T06:55:44.820 INFO:tasks.workunit.client.1.smithi089.stdout:0/47: mknod d9/ce 0 2024-08-01T06:55:44.825 INFO:tasks.workunit.client.1.smithi089.stdout:0/48: rename f1 to d9/ff 0 2024-08-01T06:55:44.895 INFO:tasks.workunit.client.1.smithi089.stdout:4/38: getdents d3 0 2024-08-01T06:55:44.895 INFO:tasks.workunit.client.1.smithi089.stdout:6/32: rmdir d2 39 2024-08-01T06:55:44.895 INFO:tasks.workunit.client.1.smithi089.stdout:4/39: read d3/f4 [2869346,95236] 0 2024-08-01T06:55:44.898 INFO:tasks.workunit.client.1.smithi089.stdout:6/33: write d2/f5 [952363,49034] 0 2024-08-01T06:55:44.898 INFO:tasks.workunit.client.1.smithi089.stdout:6/34: rename d2 to d2/dd 22 2024-08-01T06:55:44.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:44 smithi016 ceph-mon[29266]: pgmap v6: 65 pgs: 65 active+clean; 175 MiB data, 858 MiB used, 536 GiB / 536 GiB avail; 205 B/s rd, 267 KiB/s wr, 42 op/s 2024-08-01T06:55:44.899 INFO:tasks.workunit.client.1.smithi089.stdout:4/40: symlink d3/d8/lc 0 2024-08-01T06:55:44.899 INFO:tasks.workunit.client.1.smithi089.stdout:4/41: chown d3/d8 126239027 1 2024-08-01T06:55:44.899 INFO:tasks.workunit.client.1.smithi089.stdout:4/42: stat d3/d8 0 2024-08-01T06:55:44.901 INFO:tasks.workunit.client.1.smithi089.stdout:6/35: creat d2/fe x:0 0 0 2024-08-01T06:55:44.903 INFO:tasks.workunit.client.1.smithi089.stdout:4/43: symlink d3/ld 0 2024-08-01T06:55:44.917 INFO:tasks.workunit.client.1.smithi089.stdout:0/49: getdents d9 0 2024-08-01T06:55:44.919 INFO:tasks.workunit.client.1.smithi089.stdout:0/50: symlink d9/l10 0 2024-08-01T06:55:44.919 INFO:tasks.workunit.client.1.smithi089.stdout:0/51: readlink d9/l10 0 2024-08-01T06:55:44.937 INFO:tasks.workunit.client.1.smithi089.stdout:6/36: rmdir d2 39 2024-08-01T06:55:44.943 INFO:tasks.workunit.client.1.smithi089.stdout:6/37: creat d2/ff x:0 0 0 2024-08-01T06:55:44.945 INFO:tasks.workunit.client.1.smithi089.stdout:6/38: mknod d2/c10 0 2024-08-01T06:55:44.946 INFO:tasks.workunit.client.1.smithi089.stdout:4/44: dwrite f1 [4194304,4194304] 0 2024-08-01T06:55:44.948 INFO:tasks.workunit.client.1.smithi089.stdout:6/39: mkdir d2/d11 0 2024-08-01T06:55:44.951 INFO:tasks.workunit.client.1.smithi089.stdout:4/45: dread f1 [4194304,4194304] 0 2024-08-01T06:55:44.956 INFO:tasks.workunit.client.1.smithi089.stdout:4/46: mkdir d3/db/de 0 2024-08-01T06:55:44.959 INFO:tasks.workunit.client.1.smithi089.stdout:4/47: rmdir d3/d8 39 2024-08-01T06:55:44.962 INFO:tasks.workunit.client.1.smithi089.stdout:4/48: dread f1 [0,4194304] 0 2024-08-01T06:55:44.966 INFO:tasks.workunit.client.1.smithi089.stdout:4/49: symlink d3/d8/lf 0 2024-08-01T06:55:44.976 INFO:tasks.workunit.client.1.smithi089.stdout:6/40: write f1 [852823,51654] 0 2024-08-01T06:55:44.979 INFO:tasks.workunit.client.1.smithi089.stdout:6/41: mknod d2/c12 0 2024-08-01T06:55:44.984 INFO:tasks.workunit.client.1.smithi089.stdout:6/42: dwrite d2/f5 [0,4194304] 0 2024-08-01T06:55:44.992 INFO:tasks.workunit.client.1.smithi089.stdout:6/43: dwrite d2/f5 [0,4194304] 0 2024-08-01T06:55:44.999 INFO:tasks.workunit.client.1.smithi089.stdout:6/44: rename d2/c4 to d2/d11/c13 0 2024-08-01T06:55:45.005 INFO:tasks.workunit.client.1.smithi089.stdout:6/45: rename d2/c3 to d2/d11/c14 0 2024-08-01T06:55:45.009 INFO:tasks.workunit.client.1.smithi089.stdout:6/46: dwrite f1 [0,4194304] 0 2024-08-01T06:55:45.048 INFO:tasks.workunit.client.1.smithi089.stdout:6/47: getdents d2 0 2024-08-01T06:55:45.048 INFO:tasks.workunit.client.1.smithi089.stdout:6/48: read - d2/f8 zero size 2024-08-01T06:55:45.051 INFO:tasks.workunit.client.1.smithi089.stdout:6/49: creat d2/d11/f15 x:0 0 0 2024-08-01T06:55:45.057 INFO:tasks.workunit.client.1.smithi089.stdout:6/50: dwrite d2/d11/f15 [0,4194304] 0 2024-08-01T06:55:45.062 INFO:tasks.workunit.client.1.smithi089.stdout:6/51: symlink d2/d11/l16 0 2024-08-01T06:55:45.063 INFO:tasks.workunit.client.1.smithi089.stdout:6/52: write d2/f5 [2616883,40687] 0 2024-08-01T06:55:45.067 INFO:tasks.workunit.client.1.smithi089.stdout:6/53: stat d2/c6 0 2024-08-01T06:55:45.070 INFO:tasks.workunit.client.1.smithi089.stdout:6/54: creat d2/d11/f17 x:0 0 0 2024-08-01T06:55:45.073 INFO:tasks.workunit.client.1.smithi089.stdout:6/55: creat d2/f18 x:0 0 0 2024-08-01T06:55:45.075 INFO:tasks.workunit.client.1.smithi089.stdout:6/56: symlink d2/l19 0 2024-08-01T06:55:45.075 INFO:tasks.workunit.client.1.smithi089.stdout:6/57: read - d2/fe zero size 2024-08-01T06:55:45.078 INFO:tasks.workunit.client.1.smithi089.stdout:6/58: mkdir d2/d11/d1a 0 2024-08-01T06:55:45.078 INFO:tasks.workunit.client.1.smithi089.stdout:6/59: chown d2/ff 723503647 1 2024-08-01T06:55:45.079 INFO:tasks.workunit.client.1.smithi089.stdout:6/60: dread - d2/f18 zero size 2024-08-01T06:55:45.079 INFO:tasks.workunit.client.1.smithi089.stdout:6/61: write d2/fe [133719,36428] 0 2024-08-01T06:55:45.109 INFO:tasks.workunit.client.1.smithi089.stdout:6/62: rmdir d2/d11 39 2024-08-01T06:55:45.111 INFO:tasks.workunit.client.1.smithi089.stdout:6/63: fdatasync d2/d11/f15 0 2024-08-01T06:55:45.112 INFO:tasks.workunit.client.1.smithi089.stdout:6/64: mknod d2/d11/c1b 0 2024-08-01T06:55:45.126 INFO:tasks.workunit.client.1.smithi089.stdout:6/65: rmdir d2 39 2024-08-01T06:55:45.129 INFO:tasks.workunit.client.1.smithi089.stdout:6/66: write d2/d11/f15 [2277267,126804] 0 2024-08-01T06:55:45.131 INFO:tasks.workunit.client.1.smithi089.stdout:6/67: read d2/fe [14393,13583] 0 2024-08-01T06:55:45.131 INFO:tasks.workunit.client.1.smithi089.stdout:6/68: chown d2 3017573 1 2024-08-01T06:55:45.131 INFO:tasks.workunit.client.1.smithi089.stdout:6/69: dread - d2/ff zero size 2024-08-01T06:55:45.132 INFO:tasks.workunit.client.1.smithi089.stdout:6/70: truncate d2/d11/f17 877294 0 2024-08-01T06:55:45.133 INFO:tasks.workunit.client.1.smithi089.stdout:6/71: readlink d2/l19 0 2024-08-01T06:55:45.133 INFO:tasks.workunit.client.1.smithi089.stdout:6/72: write f1 [4271653,29182] 0 2024-08-01T06:55:45.134 INFO:tasks.workunit.client.1.smithi089.stdout:6/73: dread - d2/ff zero size 2024-08-01T06:55:45.136 INFO:tasks.workunit.client.1.smithi089.stdout:6/74: mkdir d2/d11/d1a/d1c 0 2024-08-01T06:55:45.136 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:44 smithi089 ceph-mon[36617]: pgmap v6: 65 pgs: 65 active+clean; 175 MiB data, 858 MiB used, 536 GiB / 536 GiB avail; 205 B/s rd, 267 KiB/s wr, 42 op/s 2024-08-01T06:55:45.138 INFO:tasks.workunit.client.1.smithi089.stdout:6/75: dread d2/d11/f17 [0,4194304] 0 2024-08-01T06:55:45.144 INFO:tasks.workunit.client.1.smithi089.stdout:6/76: dwrite f1 [4194304,4194304] 0 2024-08-01T06:55:45.145 INFO:tasks.workunit.client.1.smithi089.stdout:6/77: read d2/f5 [1134038,61746] 0 2024-08-01T06:55:45.147 INFO:tasks.workunit.client.1.smithi089.stdout:6/78: creat d2/d11/f1d x:0 0 0 2024-08-01T06:55:45.150 INFO:tasks.workunit.client.1.smithi089.stdout:6/79: mknod d2/d11/c1e 0 2024-08-01T06:55:45.150 INFO:tasks.workunit.client.1.smithi089.stdout:6/80: dread - d2/d11/f1d zero size 2024-08-01T06:55:45.153 INFO:tasks.workunit.client.1.smithi089.stdout:6/81: mkdir d2/d11/d1f 0 2024-08-01T06:55:45.153 INFO:tasks.workunit.client.1.smithi089.stdout:6/82: write d2/f8 [575668,101907] 0 2024-08-01T06:55:45.156 INFO:tasks.workunit.client.1.smithi089.stdout:6/83: rename d2/d11/c14 to d2/d11/d1a/d1c/c20 0 2024-08-01T06:55:45.156 INFO:tasks.workunit.client.1.smithi089.stdout:6/84: readlink d2/l19 0 2024-08-01T06:55:45.186 INFO:tasks.workunit.client.1.smithi089.stdout:6/85: fdatasync f1 0 2024-08-01T06:55:45.192 INFO:tasks.workunit.client.1.smithi089.stdout:6/86: dwrite d2/d11/f1d [0,4194304] 0 2024-08-01T06:55:45.193 INFO:tasks.workunit.client.1.smithi089.stdout:6/87: truncate d2/f8 1639898 0 2024-08-01T06:55:45.298 INFO:tasks.workunit.client.1.smithi089.stdout:6/88: dwrite d2/f5 [0,4194304] 0 2024-08-01T06:55:45.306 INFO:tasks.workunit.client.1.smithi089.stdout:6/89: dwrite d2/f8 [0,4194304] 0 2024-08-01T06:55:45.309 INFO:tasks.workunit.client.1.smithi089.stdout:6/90: mkdir d2/d11/d1a/d21 0 2024-08-01T06:55:45.312 INFO:tasks.workunit.client.1.smithi089.stdout:6/91: symlink d2/d11/d1f/l22 0 2024-08-01T06:55:45.315 INFO:tasks.workunit.client.1.smithi089.stdout:6/92: creat d2/d11/d1f/f23 x:0 0 0 2024-08-01T06:55:45.318 INFO:tasks.workunit.client.1.smithi089.stdout:6/93: creat d2/f24 x:0 0 0 2024-08-01T06:55:45.326 INFO:tasks.workunit.client.1.smithi089.stdout:6/94: dwrite d2/f18 [0,4194304] 0 2024-08-01T06:55:45.326 INFO:tasks.workunit.client.1.smithi089.stdout:6/95: chown d2/d11/d1f 4930 1 2024-08-01T06:55:45.335 INFO:tasks.workunit.client.1.smithi089.stdout:6/96: rename d2/d11/c13 to d2/c25 0 2024-08-01T06:55:45.337 INFO:tasks.workunit.client.1.smithi089.stdout:6/97: chown d2/c7 0 1 2024-08-01T06:55:45.338 INFO:tasks.workunit.client.1.smithi089.stdout:6/98: dread - d2/f24 zero size 2024-08-01T06:55:45.341 INFO:tasks.workunit.client.1.smithi089.stdout:6/99: dread d2/f18 [0,4194304] 0 2024-08-01T06:55:45.437 INFO:tasks.workunit.client.1.smithi089.stdout:6/100: getdents d2/d11/d1a/d21 0 2024-08-01T06:55:45.442 INFO:tasks.workunit.client.1.smithi089.stdout:6/101: dwrite f1 [0,4194304] 0 2024-08-01T06:55:45.443 INFO:tasks.workunit.client.1.smithi089.stdout:6/102: fdatasync d2/f5 0 2024-08-01T06:55:45.444 INFO:tasks.workunit.client.1.smithi089.stdout:6/103: write d2/d11/f15 [4505802,47783] 0 2024-08-01T06:55:45.448 INFO:tasks.workunit.client.1.smithi089.stdout:6/104: dread d2/f18 [0,4194304] 0 2024-08-01T06:55:45.464 INFO:tasks.workunit.client.1.smithi089.stdout:6/105: truncate d2/d11/f1d 2985542 0 2024-08-01T06:55:45.476 INFO:tasks.workunit.client.1.smithi089.stdout:6/106: truncate d2/f24 322731 0 2024-08-01T06:55:45.476 INFO:tasks.workunit.client.1.smithi089.stdout:6/107: readlink d2/l19 0 2024-08-01T06:55:46.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:45 smithi089 ceph-mon[36617]: Standby manager daemon smithi016.whigbo started 2024-08-01T06:55:46.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:45 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.16:0/658415173' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi016.whigbo/crt"}]: dispatch 2024-08-01T06:55:46.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:45 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.16:0/658415173' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-01T06:55:46.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:45 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.16:0/658415173' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi016.whigbo/key"}]: dispatch 2024-08-01T06:55:46.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:45 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.16:0/658415173' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-01T06:55:46.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:45 smithi016 ceph-mon[29266]: Standby manager daemon smithi016.whigbo started 2024-08-01T06:55:46.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:45 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.16:0/658415173' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi016.whigbo/crt"}]: dispatch 2024-08-01T06:55:46.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:45 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.16:0/658415173' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-01T06:55:46.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:45 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.16:0/658415173' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi016.whigbo/key"}]: dispatch 2024-08-01T06:55:46.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:45 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.16:0/658415173' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-01T06:55:47.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:46 smithi089 ceph-mon[36617]: pgmap v7: 65 pgs: 65 active+clean; 214 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 5.7 MiB/s wr, 223 op/s 2024-08-01T06:55:47.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:46 smithi089 ceph-mon[36617]: mgrmap e24: smithi089.hfgnsr(active, since 8s), standbys: smithi016.whigbo 2024-08-01T06:55:47.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:46 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mgr metadata", "who": "smithi016.whigbo", "id": "smithi016.whigbo"}]: dispatch 2024-08-01T06:55:47.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:46 smithi016 ceph-mon[29266]: pgmap v7: 65 pgs: 65 active+clean; 214 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 5.7 MiB/s wr, 223 op/s 2024-08-01T06:55:47.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:46 smithi016 ceph-mon[29266]: mgrmap e24: smithi089.hfgnsr(active, since 8s), standbys: smithi016.whigbo 2024-08-01T06:55:47.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:46 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mgr metadata", "who": "smithi016.whigbo", "id": "smithi016.whigbo"}]: dispatch 2024-08-01T06:55:48.897 INFO:tasks.workunit.client.1.smithi089.stdout:1/12: sync 2024-08-01T06:55:48.899 INFO:tasks.workunit.client.1.smithi089.stdout:1/13: mknod d0/c4 0 2024-08-01T06:55:48.900 INFO:tasks.workunit.client.1.smithi089.stdout:1/14: symlink d0/l5 0 2024-08-01T06:55:48.901 INFO:tasks.workunit.client.1.smithi089.stdout:5/14: sync 2024-08-01T06:55:48.902 INFO:tasks.workunit.client.1.smithi089.stdout:1/15: creat d0/f6 x:0 0 0 2024-08-01T06:55:48.902 INFO:tasks.workunit.client.1.smithi089.stdout:5/15: mkdir d5 0 2024-08-01T06:55:48.902 INFO:tasks.workunit.client.1.smithi089.stdout:1/16: read - d0/f6 zero size 2024-08-01T06:55:48.903 INFO:tasks.workunit.client.1.smithi089.stdout:1/17: readlink d0/l5 0 2024-08-01T06:55:48.903 INFO:tasks.workunit.client.1.smithi089.stdout:1/18: dread - d0/f6 zero size 2024-08-01T06:55:48.903 INFO:tasks.workunit.client.1.smithi089.stdout:5/16: dread f0 [0,4194304] 0 2024-08-01T06:55:48.905 INFO:tasks.workunit.client.1.smithi089.stdout:5/17: dread f0 [0,4194304] 0 2024-08-01T06:55:48.906 INFO:tasks.workunit.client.1.smithi089.stdout:1/19: link d0/c3 d0/c7 0 2024-08-01T06:55:48.907 INFO:tasks.workunit.client.1.smithi089.stdout:1/20: creat d0/f8 x:0 0 0 2024-08-01T06:55:48.908 INFO:tasks.workunit.client.1.smithi089.stdout:1/21: chown d0/c4 0 1 2024-08-01T06:55:48.908 INFO:tasks.workunit.client.1.smithi089.stdout:1/22: truncate d0/f8 122140 0 2024-08-01T06:55:48.908 INFO:tasks.workunit.client.1.smithi089.stdout:1/23: fdatasync d0/f6 0 2024-08-01T06:55:48.909 INFO:tasks.workunit.client.1.smithi089.stdout:1/24: write d0/f8 [718711,29992] 0 2024-08-01T06:55:48.911 INFO:tasks.workunit.client.1.smithi089.stdout:1/25: mkdir d0/d9 0 2024-08-01T06:55:48.913 INFO:tasks.workunit.client.1.smithi089.stdout:1/26: chown d0/c3 401774 1 2024-08-01T06:55:48.913 INFO:tasks.workunit.client.1.smithi089.stdout:1/27: write d0/f6 [844810,117565] 0 2024-08-01T06:55:48.917 INFO:tasks.workunit.client.1.smithi089.stdout:1/28: link d0/l5 d0/d9/la 0 2024-08-01T06:55:48.922 INFO:tasks.workunit.client.1.smithi089.stdout:1/29: dwrite d0/f8 [0,4194304] 0 2024-08-01T06:55:48.930 INFO:tasks.workunit.client.1.smithi089.stdout:1/30: dwrite d0/f8 [0,4194304] 0 2024-08-01T06:55:48.933 INFO:tasks.workunit.client.1.smithi089.stdout:1/31: symlink d0/lb 0 2024-08-01T06:55:48.933 INFO:tasks.workunit.client.1.smithi089.stdout:1/32: rename d0 to d0/dc 22 2024-08-01T06:55:48.934 INFO:tasks.workunit.client.1.smithi089.stdout:1/33: read d0/f6 [906035,21656] 0 2024-08-01T06:55:49.055 INFO:tasks.workunit.client.1.smithi089.stdout:9/31: sync 2024-08-01T06:55:49.055 INFO:tasks.workunit.client.1.smithi089.stdout:3/26: sync 2024-08-01T06:55:49.055 INFO:tasks.workunit.client.1.smithi089.stdout:9/32: write - no filename 2024-08-01T06:55:49.055 INFO:tasks.workunit.client.1.smithi089.stdout:9/33: dwrite - no filename 2024-08-01T06:55:49.059 INFO:tasks.workunit.client.1.smithi089.stdout:9/34: symlink l3 0 2024-08-01T06:55:49.059 INFO:tasks.workunit.client.1.smithi089.stdout:9/35: chown l3 4551 1 2024-08-01T06:55:49.061 INFO:tasks.workunit.client.1.smithi089.stdout:9/36: creat f4 x:0 0 0 2024-08-01T06:55:49.090 INFO:tasks.workunit.client.1.smithi089.stdout:8/36: sync 2024-08-01T06:55:49.090 INFO:tasks.workunit.client.1.smithi089.stdout:4/50: sync 2024-08-01T06:55:49.090 INFO:tasks.workunit.client.1.smithi089.stdout:6/108: sync 2024-08-01T06:55:49.090 INFO:tasks.workunit.client.1.smithi089.stdout:0/52: sync 2024-08-01T06:55:49.090 INFO:tasks.workunit.client.1.smithi089.stdout:7/33: sync 2024-08-01T06:55:49.090 INFO:tasks.workunit.client.1.smithi089.stdout:2/33: sync 2024-08-01T06:55:49.090 INFO:tasks.workunit.client.1.smithi089.stdout:5/18: sync 2024-08-01T06:55:49.092 INFO:tasks.workunit.client.1.smithi089.stdout:0/53: write d9/fb [483683,41914] 0 2024-08-01T06:55:49.093 INFO:tasks.workunit.client.1.smithi089.stdout:9/37: creat f5 x:0 0 0 2024-08-01T06:55:49.097 INFO:tasks.workunit.client.1.smithi089.stdout:2/34: mknod d7/cb 0 2024-08-01T06:55:49.098 INFO:tasks.workunit.client.1.smithi089.stdout:2/35: fsync f4 0 2024-08-01T06:55:49.099 INFO:tasks.workunit.client.1.smithi089.stdout:4/51: dwrite f1 [4194304,4194304] 0 2024-08-01T06:55:49.101 INFO:tasks.workunit.client.1.smithi089.stdout:0/54: creat d9/f11 x:0 0 0 2024-08-01T06:55:49.102 INFO:tasks.workunit.client.1.smithi089.stdout:6/109: truncate d2/d11/f17 1822256 0 2024-08-01T06:55:49.103 INFO:tasks.workunit.client.1.smithi089.stdout:0/55: chown d9/fd 190287 1 2024-08-01T06:55:49.103 INFO:tasks.workunit.client.1.smithi089.stdout:0/56: stat d9 0 2024-08-01T06:55:49.105 INFO:tasks.workunit.client.1.smithi089.stdout:0/57: write d9/fd [1031557,81692] 0 2024-08-01T06:55:49.106 INFO:tasks.workunit.client.1.smithi089.stdout:2/36: dwrite f5 [0,4194304] 0 2024-08-01T06:55:49.106 INFO:tasks.workunit.client.1.smithi089.stdout:0/58: fdatasync d9/f11 0 2024-08-01T06:55:49.107 INFO:tasks.workunit.client.1.smithi089.stdout:5/19: symlink d5/l6 0 2024-08-01T06:55:49.107 INFO:tasks.workunit.client.1.smithi089.stdout:5/20: chown l3 3143643 1 2024-08-01T06:55:49.108 INFO:tasks.workunit.client.1.smithi089.stdout:0/59: write d9/fd [96468,118128] 0 2024-08-01T06:55:49.110 INFO:tasks.workunit.client.1.smithi089.stdout:7/34: mknod d7/dc/ce 0 2024-08-01T06:55:49.116 INFO:tasks.workunit.client.1.smithi089.stdout:2/37: mkdir d7/dc 0 2024-08-01T06:55:49.119 INFO:tasks.workunit.client.1.smithi089.stdout:5/21: fdatasync f0 0 2024-08-01T06:55:49.120 INFO:tasks.workunit.client.1.smithi089.stdout:0/60: creat d9/f12 x:0 0 0 2024-08-01T06:55:49.122 INFO:tasks.workunit.client.1.smithi089.stdout:7/35: mkdir d7/df 0 2024-08-01T06:55:49.124 INFO:tasks.workunit.client.1.smithi089.stdout:4/52: link d3/d8/f9 d3/db/f10 0 2024-08-01T06:55:49.127 INFO:tasks.workunit.client.1.smithi089.stdout:2/38: rename c0 to d7/dc/cd 0 2024-08-01T06:55:49.128 INFO:tasks.workunit.client.1.smithi089.stdout:2/39: chown d7/fa 0 1 2024-08-01T06:55:49.128 INFO:tasks.workunit.client.1.smithi089.stdout:2/40: read - f4 zero size 2024-08-01T06:55:49.129 INFO:tasks.workunit.client.1.smithi089.stdout:5/22: rmdir d5 39 2024-08-01T06:55:49.131 INFO:tasks.workunit.client.1.smithi089.stdout:0/61: creat d9/f13 x:0 0 0 2024-08-01T06:55:49.131 INFO:tasks.workunit.client.1.smithi089.stdout:0/62: stat d9/f13 0 2024-08-01T06:55:49.136 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:48 smithi089 ceph-mon[36617]: pgmap v8: 65 pgs: 65 active+clean; 214 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 935 KiB/s rd, 4.4 MiB/s wr, 174 op/s 2024-08-01T06:55:49.138 INFO:tasks.workunit.client.1.smithi089.stdout:0/63: rename f5 to d9/f14 0 2024-08-01T06:55:49.145 INFO:tasks.workunit.client.1.smithi089.stdout:4/53: link d3/ld d3/l11 0 2024-08-01T06:55:49.146 INFO:tasks.workunit.client.1.smithi089.stdout:0/64: dwrite d9/f14 [0,4194304] 0 2024-08-01T06:55:49.146 INFO:tasks.workunit.client.1.smithi089.stdout:4/54: read d3/d8/f9 [3032403,44777] 0 2024-08-01T06:55:49.146 INFO:tasks.workunit.client.1.smithi089.stdout:4/55: chown d3/d8 11424789 1 2024-08-01T06:55:49.147 INFO:tasks.workunit.client.1.smithi089.stdout:0/65: write d9/f14 [202577,111929] 0 2024-08-01T06:55:49.147 INFO:tasks.workunit.client.1.smithi089.stdout:4/56: write f1 [1480298,1582] 0 2024-08-01T06:55:49.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:48 smithi016 ceph-mon[29266]: pgmap v8: 65 pgs: 65 active+clean; 214 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 935 KiB/s rd, 4.4 MiB/s wr, 174 op/s 2024-08-01T06:55:49.151 INFO:tasks.workunit.client.1.smithi089.stdout:0/66: dread f2 [0,4194304] 0 2024-08-01T06:55:49.155 INFO:tasks.workunit.client.1.smithi089.stdout:0/67: dread d9/fb [0,4194304] 0 2024-08-01T06:55:49.160 INFO:tasks.workunit.client.1.smithi089.stdout:0/68: symlink d9/l15 0 2024-08-01T06:55:49.161 INFO:tasks.workunit.client.1.smithi089.stdout:0/69: rename d9 to d9/d16 22 2024-08-01T06:55:49.163 INFO:tasks.workunit.client.1.smithi089.stdout:0/70: creat d9/f17 x:0 0 0 2024-08-01T06:55:49.165 INFO:tasks.workunit.client.1.smithi089.stdout:0/71: creat d9/f18 x:0 0 0 2024-08-01T06:55:49.228 INFO:tasks.workunit.client.1.smithi089.stdout:5/23: creat d5/f7 x:0 0 0 2024-08-01T06:55:49.229 INFO:tasks.workunit.client.1.smithi089.stdout:5/24: dread - d5/f7 zero size 2024-08-01T06:55:49.234 INFO:tasks.workunit.client.1.smithi089.stdout:1/34: getdents d0/d9 0 2024-08-01T06:55:49.236 INFO:tasks.workunit.client.1.smithi089.stdout:1/35: dread d0/f8 [0,4194304] 0 2024-08-01T06:55:49.238 INFO:tasks.workunit.client.1.smithi089.stdout:1/36: write d0/f8 [2420374,74187] 0 2024-08-01T06:55:49.239 INFO:tasks.workunit.client.1.smithi089.stdout:1/37: fsync d0/f6 0 2024-08-01T06:55:49.240 INFO:tasks.workunit.client.1.smithi089.stdout:7/36: sync 2024-08-01T06:55:49.244 INFO:tasks.workunit.client.1.smithi089.stdout:7/37: mkdir d7/df/d10 0 2024-08-01T06:55:49.248 INFO:tasks.workunit.client.1.smithi089.stdout:7/38: rename f0 to d7/df/f11 0 2024-08-01T06:55:49.248 INFO:tasks.workunit.client.1.smithi089.stdout:1/38: link d0/c3 d0/cd 0 2024-08-01T06:55:49.251 INFO:tasks.workunit.client.1.smithi089.stdout:1/39: mknod d0/ce 0 2024-08-01T06:55:49.252 INFO:tasks.workunit.client.1.smithi089.stdout:7/39: mknod d7/df/d10/c12 0 2024-08-01T06:55:49.252 INFO:tasks.workunit.client.1.smithi089.stdout:7/40: write d7/fb [602910,27643] 0 2024-08-01T06:55:49.253 INFO:tasks.workunit.client.1.smithi089.stdout:1/40: symlink d0/lf 0 2024-08-01T06:55:49.258 INFO:tasks.workunit.client.1.smithi089.stdout:7/41: rename d7/c8 to d7/df/d10/c13 0 2024-08-01T06:55:49.258 INFO:tasks.workunit.client.1.smithi089.stdout:7/42: stat d7/dc 0 2024-08-01T06:55:49.261 INFO:tasks.workunit.client.1.smithi089.stdout:7/43: mknod d7/c14 0 2024-08-01T06:55:49.261 INFO:tasks.workunit.client.1.smithi089.stdout:7/44: fsync f3 0 2024-08-01T06:55:49.270 INFO:tasks.workunit.client.1.smithi089.stdout:7/45: dwrite d7/df/f11 [0,4194304] 0 2024-08-01T06:55:49.274 INFO:tasks.workunit.client.1.smithi089.stdout:7/46: mkdir d7/d15 0 2024-08-01T06:55:49.276 INFO:tasks.workunit.client.1.smithi089.stdout:7/47: mknod d7/df/d10/c16 0 2024-08-01T06:55:49.280 INFO:tasks.workunit.client.1.smithi089.stdout:7/48: getdents d7/d15 0 2024-08-01T06:55:49.283 INFO:tasks.workunit.client.1.smithi089.stdout:7/49: creat d7/df/d10/f17 x:0 0 0 2024-08-01T06:55:49.286 INFO:tasks.workunit.client.1.smithi089.stdout:7/50: dread f3 [0,4194304] 0 2024-08-01T06:55:49.289 INFO:tasks.workunit.client.1.smithi089.stdout:7/51: rename d7/df/d10/c16 to d7/df/c18 0 2024-08-01T06:55:49.314 INFO:tasks.workunit.client.1.smithi089.stdout:3/27: truncate f3 543392 0 2024-08-01T06:55:49.314 INFO:tasks.workunit.client.1.smithi089.stdout:3/28: stat c5 0 2024-08-01T06:55:49.342 INFO:tasks.workunit.client.1.smithi089.stdout:9/38: fsync f5 0 2024-08-01T06:55:49.342 INFO:tasks.workunit.client.1.smithi089.stdout:9/39: rmdir - no directory 2024-08-01T06:55:49.342 INFO:tasks.workunit.client.1.smithi089.stdout:8/37: write f2 [47287,101431] 0 2024-08-01T06:55:49.346 INFO:tasks.workunit.client.1.smithi089.stdout:8/38: rename d5/d6/c7 to d5/d6/cb 0 2024-08-01T06:55:49.348 INFO:tasks.workunit.client.1.smithi089.stdout:9/40: dwrite f5 [0,4194304] 0 2024-08-01T06:55:49.353 INFO:tasks.workunit.client.1.smithi089.stdout:9/41: symlink l6 0 2024-08-01T06:55:49.356 INFO:tasks.workunit.client.1.smithi089.stdout:9/42: mknod c7 0 2024-08-01T06:55:49.357 INFO:tasks.workunit.client.1.smithi089.stdout:9/43: read f5 [1454230,5741] 0 2024-08-01T06:55:49.361 INFO:tasks.workunit.client.1.smithi089.stdout:9/44: creat f8 x:0 0 0 2024-08-01T06:55:49.363 INFO:tasks.workunit.client.1.smithi089.stdout:9/45: creat f9 x:0 0 0 2024-08-01T06:55:49.369 INFO:tasks.workunit.client.1.smithi089.stdout:9/46: link f8 fa 0 2024-08-01T06:55:49.374 INFO:tasks.workunit.client.1.smithi089.stdout:9/47: link c7 cb 0 2024-08-01T06:55:49.380 INFO:tasks.workunit.client.1.smithi089.stdout:2/41: rmdir d7 39 2024-08-01T06:55:49.380 INFO:tasks.workunit.client.1.smithi089.stdout:9/48: dwrite f9 [0,4194304] 0 2024-08-01T06:55:49.380 INFO:tasks.workunit.client.1.smithi089.stdout:9/49: chown f9 418 1 2024-08-01T06:55:49.386 INFO:tasks.workunit.client.1.smithi089.stdout:9/50: mknod cc 0 2024-08-01T06:55:49.386 INFO:tasks.workunit.client.1.smithi089.stdout:2/42: dwrite f5 [4194304,4194304] 0 2024-08-01T06:55:49.386 INFO:tasks.workunit.client.1.smithi089.stdout:9/51: dread - f8 zero size 2024-08-01T06:55:49.392 INFO:tasks.workunit.client.1.smithi089.stdout:9/52: fdatasync fa 0 2024-08-01T06:55:49.395 INFO:tasks.workunit.client.1.smithi089.stdout:2/43: mknod d7/ce 0 2024-08-01T06:55:49.397 INFO:tasks.workunit.client.1.smithi089.stdout:9/53: mknod cd 0 2024-08-01T06:55:49.398 INFO:tasks.workunit.client.1.smithi089.stdout:9/54: truncate f5 5000678 0 2024-08-01T06:55:49.402 INFO:tasks.workunit.client.1.smithi089.stdout:2/44: dwrite f5 [0,4194304] 0 2024-08-01T06:55:49.403 INFO:tasks.workunit.client.1.smithi089.stdout:2/45: write f5 [5242522,80429] 0 2024-08-01T06:55:49.412 INFO:tasks.workunit.client.1.smithi089.stdout:4/57: write d3/f4 [5101450,8272] 0 2024-08-01T06:55:49.412 INFO:tasks.workunit.client.1.smithi089.stdout:2/46: dwrite f5 [0,4194304] 0 2024-08-01T06:55:49.421 INFO:tasks.workunit.client.1.smithi089.stdout:2/47: dwrite f4 [0,4194304] 0 2024-08-01T06:55:49.422 INFO:tasks.workunit.client.1.smithi089.stdout:4/58: creat d3/f12 x:0 0 0 2024-08-01T06:55:49.423 INFO:tasks.workunit.client.1.smithi089.stdout:0/72: truncate f2 1850330 0 2024-08-01T06:55:49.426 INFO:tasks.workunit.client.1.smithi089.stdout:2/48: dread f4 [0,4194304] 0 2024-08-01T06:55:49.426 INFO:tasks.workunit.client.1.smithi089.stdout:0/73: symlink d9/l19 0 2024-08-01T06:55:49.431 INFO:tasks.workunit.client.1.smithi089.stdout:2/49: write f2 [3235492,30488] 0 2024-08-01T06:55:49.436 INFO:tasks.workunit.client.1.smithi089.stdout:0/74: mkdir d9/d1a 0 2024-08-01T06:55:49.437 INFO:tasks.workunit.client.1.smithi089.stdout:2/50: mknod d7/dc/cf 0 2024-08-01T06:55:49.438 INFO:tasks.workunit.client.1.smithi089.stdout:0/75: symlink d9/l1b 0 2024-08-01T06:55:49.440 INFO:tasks.workunit.client.1.smithi089.stdout:2/51: creat d7/f10 x:0 0 0 2024-08-01T06:55:49.441 INFO:tasks.workunit.client.1.smithi089.stdout:2/52: rename d7/dc to d7/dc/d11 22 2024-08-01T06:55:49.442 INFO:tasks.workunit.client.1.smithi089.stdout:2/53: truncate f2 4200341 0 2024-08-01T06:55:49.443 INFO:tasks.workunit.client.1.smithi089.stdout:0/76: link d9/f18 d9/d1a/f1c 0 2024-08-01T06:55:49.445 INFO:tasks.workunit.client.1.smithi089.stdout:2/54: mknod d7/c12 0 2024-08-01T06:55:49.448 INFO:tasks.workunit.client.1.smithi089.stdout:5/25: rmdir d5 39 2024-08-01T06:55:49.449 INFO:tasks.workunit.client.1.smithi089.stdout:2/55: dwrite f6 [0,4194304] 0 2024-08-01T06:55:49.450 INFO:tasks.workunit.client.1.smithi089.stdout:2/56: fdatasync f2 0 2024-08-01T06:55:49.455 INFO:tasks.workunit.client.1.smithi089.stdout:2/57: dread f4 [0,4194304] 0 2024-08-01T06:55:49.456 INFO:tasks.workunit.client.1.smithi089.stdout:0/77: link d9/l10 d9/l1d 0 2024-08-01T06:55:49.461 INFO:tasks.workunit.client.1.smithi089.stdout:5/26: dwrite d5/f7 [0,4194304] 0 2024-08-01T06:55:49.463 INFO:tasks.workunit.client.1.smithi089.stdout:0/78: creat d9/d1a/f1e x:0 0 0 2024-08-01T06:55:49.465 INFO:tasks.workunit.client.1.smithi089.stdout:0/79: write f7 [187685,89686] 0 2024-08-01T06:55:49.466 INFO:tasks.workunit.client.1.smithi089.stdout:2/58: dwrite f2 [4194304,4194304] 0 2024-08-01T06:55:49.467 INFO:tasks.workunit.client.1.smithi089.stdout:0/80: write f7 [654275,86973] 0 2024-08-01T06:55:49.469 INFO:tasks.workunit.client.1.smithi089.stdout:1/41: getdents d0 0 2024-08-01T06:55:49.472 INFO:tasks.workunit.client.1.smithi089.stdout:2/59: mknod d7/c13 0 2024-08-01T06:55:49.473 INFO:tasks.workunit.client.1.smithi089.stdout:2/60: write d7/f10 [555569,1190] 0 2024-08-01T06:55:49.473 INFO:tasks.workunit.client.1.smithi089.stdout:1/42: dread d0/f6 [0,4194304] 0 2024-08-01T06:55:49.474 INFO:tasks.workunit.client.1.smithi089.stdout:0/81: creat d9/f1f x:0 0 0 2024-08-01T06:55:49.477 INFO:tasks.workunit.client.1.smithi089.stdout:0/82: symlink d9/l20 0 2024-08-01T06:55:49.480 INFO:tasks.workunit.client.1.smithi089.stdout:1/43: dwrite d0/f6 [0,4194304] 0 2024-08-01T06:55:49.481 INFO:tasks.workunit.client.1.smithi089.stdout:0/83: mknod d9/d1a/c21 0 2024-08-01T06:55:49.486 INFO:tasks.workunit.client.1.smithi089.stdout:1/44: getdents d0/d9 0 2024-08-01T06:55:49.487 INFO:tasks.workunit.client.1.smithi089.stdout:1/45: chown d0 33818966 1 2024-08-01T06:55:49.487 INFO:tasks.workunit.client.1.smithi089.stdout:7/52: truncate d7/df/f11 2923370 0 2024-08-01T06:55:49.500 INFO:tasks.workunit.client.1.smithi089.stdout:1/46: creat d0/d9/f10 x:0 0 0 2024-08-01T06:55:49.504 INFO:tasks.workunit.client.1.smithi089.stdout:3/29: dread f3 [0,4194304] 0 2024-08-01T06:55:49.505 INFO:tasks.workunit.client.1.smithi089.stdout:1/47: creat d0/f11 x:0 0 0 2024-08-01T06:55:49.508 INFO:tasks.workunit.client.1.smithi089.stdout:1/48: dread d0/f6 [0,4194304] 0 2024-08-01T06:55:49.508 INFO:tasks.workunit.client.1.smithi089.stdout:1/49: read d0/f8 [1454032,67834] 0 2024-08-01T06:55:49.514 INFO:tasks.workunit.client.1.smithi089.stdout:1/50: dwrite d0/d9/f10 [0,4194304] 0 2024-08-01T06:55:49.517 INFO:tasks.workunit.client.1.smithi089.stdout:3/30: link l1 d7/l8 0 2024-08-01T06:55:49.518 INFO:tasks.workunit.client.1.smithi089.stdout:3/31: dread f3 [0,4194304] 0 2024-08-01T06:55:49.519 INFO:tasks.workunit.client.1.smithi089.stdout:1/51: write d0/f8 [5066598,11359] 0 2024-08-01T06:55:49.525 INFO:tasks.workunit.client.1.smithi089.stdout:8/39: rename d5/d6 to d5/dc 0 2024-08-01T06:55:49.526 INFO:tasks.workunit.client.1.smithi089.stdout:8/40: write f2 [2898098,1824] 0 2024-08-01T06:55:49.527 INFO:tasks.workunit.client.1.smithi089.stdout:3/32: rename l1 to d7/l9 0 2024-08-01T06:55:49.528 INFO:tasks.workunit.client.1.smithi089.stdout:3/33: dread f3 [0,4194304] 0 2024-08-01T06:55:49.530 INFO:tasks.workunit.client.1.smithi089.stdout:6/110: write d2/d11/f17 [1926290,116149] 0 2024-08-01T06:55:49.532 INFO:tasks.workunit.client.1.smithi089.stdout:8/41: fdatasync d5/dc/f9 0 2024-08-01T06:55:49.533 INFO:tasks.workunit.client.1.smithi089.stdout:8/42: chown c0 8220633 1 2024-08-01T06:55:49.540 INFO:tasks.workunit.client.1.smithi089.stdout:8/43: mkdir d5/dd 0 2024-08-01T06:55:49.543 INFO:tasks.workunit.client.1.smithi089.stdout:6/111: dwrite d2/f18 [4194304,4194304] 0 2024-08-01T06:55:49.544 INFO:tasks.workunit.client.1.smithi089.stdout:8/44: dread f2 [0,4194304] 0 2024-08-01T06:55:49.546 INFO:tasks.workunit.client.1.smithi089.stdout:6/112: mknod d2/d11/d1a/d1c/c26 0 2024-08-01T06:55:49.549 INFO:tasks.workunit.client.1.smithi089.stdout:6/113: creat d2/d11/d1f/f27 x:0 0 0 2024-08-01T06:55:49.550 INFO:tasks.workunit.client.1.smithi089.stdout:6/114: chown d2/d11/d1f/f23 3584 1 2024-08-01T06:55:49.550 INFO:tasks.workunit.client.1.smithi089.stdout:6/115: rename d2 to d2/d11/d1f/d28 22 2024-08-01T06:55:49.551 INFO:tasks.workunit.client.1.smithi089.stdout:6/116: chown d2/d11/c1b 793249487 1 2024-08-01T06:55:49.552 INFO:tasks.workunit.client.1.smithi089.stdout:8/45: rmdir d5/dd 0 2024-08-01T06:55:49.554 INFO:tasks.workunit.client.1.smithi089.stdout:8/46: mknod d5/ce 0 2024-08-01T06:55:49.556 INFO:tasks.workunit.client.1.smithi089.stdout:6/117: dwrite d2/f5 [0,4194304] 0 2024-08-01T06:55:49.556 INFO:tasks.workunit.client.1.smithi089.stdout:8/47: rmdir d5 39 2024-08-01T06:55:49.558 INFO:tasks.workunit.client.1.smithi089.stdout:6/118: write f1 [8260696,113776] 0 2024-08-01T06:55:49.558 INFO:tasks.workunit.client.1.smithi089.stdout:6/119: readlink d2/d11/d1f/l22 0 2024-08-01T06:55:49.565 INFO:tasks.workunit.client.1.smithi089.stdout:8/48: creat d5/ff x:0 0 0 2024-08-01T06:55:49.566 INFO:tasks.workunit.client.1.smithi089.stdout:8/49: truncate d5/dc/f9 942705 0 2024-08-01T06:55:49.567 INFO:tasks.workunit.client.1.smithi089.stdout:8/50: chown c0 1359 1 2024-08-01T06:55:49.568 INFO:tasks.workunit.client.1.smithi089.stdout:4/59: truncate d3/f4 1269885 0 2024-08-01T06:55:49.569 INFO:tasks.workunit.client.1.smithi089.stdout:8/51: dread d5/dc/f9 [0,4194304] 0 2024-08-01T06:55:49.572 INFO:tasks.workunit.client.1.smithi089.stdout:8/52: creat d5/f10 x:0 0 0 2024-08-01T06:55:49.574 INFO:tasks.workunit.client.1.smithi089.stdout:4/60: dwrite f1 [4194304,4194304] 0 2024-08-01T06:55:49.578 INFO:tasks.workunit.client.1.smithi089.stdout:4/61: unlink d3/d8/lf 0 2024-08-01T06:55:49.582 INFO:tasks.workunit.client.1.smithi089.stdout:8/53: dwrite d5/dc/f9 [0,4194304] 0 2024-08-01T06:55:49.592 INFO:tasks.workunit.client.1.smithi089.stdout:8/54: dwrite d5/f10 [0,4194304] 0 2024-08-01T06:55:49.595 INFO:tasks.workunit.client.1.smithi089.stdout:9/55: sync 2024-08-01T06:55:49.596 INFO:tasks.workunit.client.1.smithi089.stdout:9/56: readlink l6 0 2024-08-01T06:55:49.596 INFO:tasks.workunit.client.1.smithi089.stdout:5/27: dwrite f0 [0,4194304] 0 2024-08-01T06:55:49.596 INFO:tasks.workunit.client.1.smithi089.stdout:5/28: chown d5 675598322 1 2024-08-01T06:55:49.597 INFO:tasks.workunit.client.1.smithi089.stdout:8/55: creat d5/dc/f11 x:0 0 0 2024-08-01T06:55:49.603 INFO:tasks.workunit.client.1.smithi089.stdout:9/57: dread f9 [0,4194304] 0 2024-08-01T06:55:49.605 INFO:tasks.workunit.client.1.smithi089.stdout:1/52: getdents d0/d9 0 2024-08-01T06:55:49.607 INFO:tasks.workunit.client.1.smithi089.stdout:1/53: chown d0/d9 5031626 1 2024-08-01T06:55:49.607 INFO:tasks.workunit.client.1.smithi089.stdout:5/29: dwrite d5/f7 [0,4194304] 0 2024-08-01T06:55:49.610 INFO:tasks.workunit.client.1.smithi089.stdout:9/58: creat fe x:0 0 0 2024-08-01T06:55:49.611 INFO:tasks.workunit.client.1.smithi089.stdout:9/59: readlink l6 0 2024-08-01T06:55:49.612 INFO:tasks.workunit.client.1.smithi089.stdout:1/54: mkdir d0/d12 0 2024-08-01T06:55:49.613 INFO:tasks.workunit.client.1.smithi089.stdout:5/30: creat d5/f8 x:0 0 0 2024-08-01T06:55:49.615 INFO:tasks.workunit.client.1.smithi089.stdout:9/60: creat ff x:0 0 0 2024-08-01T06:55:49.616 INFO:tasks.workunit.client.1.smithi089.stdout:5/31: chown d5/f7 204 1 2024-08-01T06:55:49.616 INFO:tasks.workunit.client.1.smithi089.stdout:8/56: dwrite f2 [0,4194304] 0 2024-08-01T06:55:49.617 INFO:tasks.workunit.client.1.smithi089.stdout:9/61: chown l6 142287 1 2024-08-01T06:55:49.618 INFO:tasks.workunit.client.1.smithi089.stdout:1/55: creat d0/f13 x:0 0 0 2024-08-01T06:55:49.619 INFO:tasks.workunit.client.1.smithi089.stdout:5/32: mkdir d5/d9 0 2024-08-01T06:55:49.619 INFO:tasks.workunit.client.1.smithi089.stdout:5/33: readlink l3 0 2024-08-01T06:55:49.621 INFO:tasks.workunit.client.1.smithi089.stdout:8/57: mkdir d5/dc/d12 0 2024-08-01T06:55:49.625 INFO:tasks.workunit.client.1.smithi089.stdout:1/56: mkdir d0/d9/d14 0 2024-08-01T06:55:49.628 INFO:tasks.workunit.client.1.smithi089.stdout:9/62: dwrite f4 [0,4194304] 0 2024-08-01T06:55:49.629 INFO:tasks.workunit.client.1.smithi089.stdout:9/63: rmdir - no directory 2024-08-01T06:55:49.630 INFO:tasks.workunit.client.1.smithi089.stdout:1/57: write d0/f8 [3029703,13714] 0 2024-08-01T06:55:49.631 INFO:tasks.workunit.client.1.smithi089.stdout:9/64: stat fe 0 2024-08-01T06:55:49.634 INFO:tasks.workunit.client.1.smithi089.stdout:1/58: write d0/f8 [1119050,9450] 0 2024-08-01T06:55:49.634 INFO:tasks.workunit.client.1.smithi089.stdout:5/34: dwrite d5/f8 [0,4194304] 0 2024-08-01T06:55:49.635 INFO:tasks.workunit.client.1.smithi089.stdout:5/35: readlink l2 0 2024-08-01T06:55:49.639 INFO:tasks.workunit.client.1.smithi089.stdout:3/34: dwrite f3 [0,4194304] 0 2024-08-01T06:55:49.642 INFO:tasks.workunit.client.1.smithi089.stdout:6/120: write d2/fe [849314,10601] 0 2024-08-01T06:55:49.644 INFO:tasks.workunit.client.1.smithi089.stdout:5/36: unlink d5/l6 0 2024-08-01T06:55:49.648 INFO:tasks.workunit.client.1.smithi089.stdout:4/62: rename d3/f4 to d3/db/f13 0 2024-08-01T06:55:49.649 INFO:tasks.workunit.client.1.smithi089.stdout:3/35: mkdir d7/da 0 2024-08-01T06:55:49.652 INFO:tasks.workunit.client.1.smithi089.stdout:3/36: read f3 [2125018,41092] 0 2024-08-01T06:55:49.652 INFO:tasks.workunit.client.1.smithi089.stdout:9/65: dwrite ff [0,4194304] 0 2024-08-01T06:55:49.654 INFO:tasks.workunit.client.1.smithi089.stdout:3/37: chown l4 124526 1 2024-08-01T06:55:49.654 INFO:tasks.workunit.client.1.smithi089.stdout:0/84: dwrite d9/ff [0,4194304] 0 2024-08-01T06:55:49.655 INFO:tasks.workunit.client.1.smithi089.stdout:5/37: rename d5/f7 to d5/d9/fa 0 2024-08-01T06:55:49.657 INFO:tasks.workunit.client.1.smithi089.stdout:0/85: write d9/f11 [395079,34840] 0 2024-08-01T06:55:49.658 INFO:tasks.workunit.client.1.smithi089.stdout:6/121: dread f1 [0,4194304] 0 2024-08-01T06:55:49.659 INFO:tasks.workunit.client.1.smithi089.stdout:1/59: fsync d0/f8 0 2024-08-01T06:55:49.664 INFO:tasks.workunit.client.1.smithi089.stdout:4/63: dread d3/db/f10 [0,4194304] 0 2024-08-01T06:55:49.664 INFO:tasks.workunit.client.1.smithi089.stdout:6/122: write d2/f24 [1112376,58492] 0 2024-08-01T06:55:49.667 INFO:tasks.workunit.client.1.smithi089.stdout:3/38: unlink c2 0 2024-08-01T06:55:49.671 INFO:tasks.workunit.client.1.smithi089.stdout:1/60: fsync d0/f6 0 2024-08-01T06:55:49.672 INFO:tasks.workunit.client.1.smithi089.stdout:6/123: chown d2/f24 5827402 1 2024-08-01T06:55:49.674 INFO:tasks.workunit.client.1.smithi089.stdout:2/61: sync 2024-08-01T06:55:49.679 INFO:tasks.workunit.client.1.smithi089.stdout:8/58: dwrite d5/f10 [4194304,4194304] 0 2024-08-01T06:55:49.682 INFO:tasks.workunit.client.1.smithi089.stdout:5/38: link l2 d5/d9/lb 0 2024-08-01T06:55:49.688 INFO:tasks.workunit.client.1.smithi089.stdout:7/53: dwrite d7/df/f11 [0,4194304] 0 2024-08-01T06:55:49.690 INFO:tasks.workunit.client.1.smithi089.stdout:6/124: truncate d2/d11/d1f/f27 900461 0 2024-08-01T06:55:49.692 INFO:tasks.workunit.client.1.smithi089.stdout:8/59: symlink d5/l13 0 2024-08-01T06:55:49.695 INFO:tasks.workunit.client.1.smithi089.stdout:9/66: dwrite f5 [4194304,4194304] 0 2024-08-01T06:55:49.695 INFO:tasks.workunit.client.1.smithi089.stdout:8/60: fsync d5/ff 0 2024-08-01T06:55:49.701 INFO:tasks.workunit.client.1.smithi089.stdout:5/39: unlink d5/d9/fa 0 2024-08-01T06:55:49.703 INFO:tasks.workunit.client.1.smithi089.stdout:0/86: dwrite d9/fb [0,4194304] 0 2024-08-01T06:55:49.704 INFO:tasks.workunit.client.1.smithi089.stdout:3/39: getdents d7 0 2024-08-01T06:55:49.704 INFO:tasks.workunit.client.1.smithi089.stdout:8/61: chown c0 109 1 2024-08-01T06:55:49.706 INFO:tasks.workunit.client.1.smithi089.stdout:5/40: chown d5/f8 27 1 2024-08-01T06:55:49.708 INFO:tasks.workunit.client.1.smithi089.stdout:3/40: chown f3 3 1 2024-08-01T06:55:49.708 INFO:tasks.workunit.client.1.smithi089.stdout:1/61: dwrite d0/d9/f10 [4194304,4194304] 0 2024-08-01T06:55:49.709 INFO:tasks.workunit.client.1.smithi089.stdout:8/62: chown d5/l13 3977133 1 2024-08-01T06:55:49.709 INFO:tasks.workunit.client.1.smithi089.stdout:0/87: dread - d9/d1a/f1e zero size 2024-08-01T06:55:49.710 INFO:tasks.workunit.client.1.smithi089.stdout:9/67: creat f10 x:0 0 0 2024-08-01T06:55:49.712 INFO:tasks.workunit.client.1.smithi089.stdout:6/125: creat d2/d11/d1a/f29 x:0 0 0 2024-08-01T06:55:49.712 INFO:tasks.workunit.client.1.smithi089.stdout:0/88: stat c6 0 2024-08-01T06:55:49.712 INFO:tasks.workunit.client.1.smithi089.stdout:2/62: dwrite f5 [0,4194304] 0 2024-08-01T06:55:49.716 INFO:tasks.workunit.client.1.smithi089.stdout:7/54: dwrite f3 [0,4194304] 0 2024-08-01T06:55:49.716 INFO:tasks.workunit.client.1.smithi089.stdout:4/64: truncate f1 7659779 0 2024-08-01T06:55:49.716 INFO:tasks.workunit.client.1.smithi089.stdout:8/63: read - d5/dc/f11 zero size 2024-08-01T06:55:49.717 INFO:tasks.workunit.client.1.smithi089.stdout:5/41: readlink l2 0 2024-08-01T06:55:49.722 INFO:tasks.workunit.client.1.smithi089.stdout:3/41: rename c5 to d7/da/cb 0 2024-08-01T06:55:49.722 INFO:tasks.workunit.client.1.smithi089.stdout:1/62: mkdir d0/d9/d15 0 2024-08-01T06:55:49.724 INFO:tasks.workunit.client.1.smithi089.stdout:7/55: creat d7/f19 x:0 0 0 2024-08-01T06:55:49.725 INFO:tasks.workunit.client.1.smithi089.stdout:2/63: rename d7/cb to d7/c14 0 2024-08-01T06:55:49.727 INFO:tasks.workunit.client.1.smithi089.stdout:6/126: dread d2/f18 [4194304,4194304] 0 2024-08-01T06:55:49.728 INFO:tasks.workunit.client.1.smithi089.stdout:9/68: creat f11 x:0 0 0 2024-08-01T06:55:49.728 INFO:tasks.workunit.client.1.smithi089.stdout:8/64: dread f2 [0,4194304] 0 2024-08-01T06:55:49.729 INFO:tasks.workunit.client.1.smithi089.stdout:5/42: rename l3 to d5/lc 0 2024-08-01T06:55:49.730 INFO:tasks.workunit.client.1.smithi089.stdout:5/43: chown c4 1385 1 2024-08-01T06:55:49.732 INFO:tasks.workunit.client.1.smithi089.stdout:4/65: symlink d3/db/de/l14 0 2024-08-01T06:55:49.733 INFO:tasks.workunit.client.1.smithi089.stdout:7/56: truncate f6 80629 0 2024-08-01T06:55:49.733 INFO:tasks.workunit.client.1.smithi089.stdout:2/64: chown d7/dc/cd 109 1 2024-08-01T06:55:49.734 INFO:tasks.workunit.client.1.smithi089.stdout:9/69: rename f9 to f12 0 2024-08-01T06:55:49.735 INFO:tasks.workunit.client.1.smithi089.stdout:9/70: chown c2 260541 1 2024-08-01T06:55:49.737 INFO:tasks.workunit.client.1.smithi089.stdout:4/66: mknod d3/db/c15 0 2024-08-01T06:55:49.737 INFO:tasks.workunit.client.1.smithi089.stdout:8/65: dwrite d5/dc/f9 [0,4194304] 0 2024-08-01T06:55:49.741 INFO:tasks.workunit.client.1.smithi089.stdout:1/63: rmdir d0/d9/d14 0 2024-08-01T06:55:49.743 INFO:tasks.workunit.client.1.smithi089.stdout:1/64: dread - d0/f13 zero size 2024-08-01T06:55:49.743 INFO:tasks.workunit.client.1.smithi089.stdout:5/44: link d5/f8 d5/d9/fd 0 2024-08-01T06:55:49.743 INFO:tasks.workunit.client.1.smithi089.stdout:2/65: dwrite f5 [0,4194304] 0 2024-08-01T06:55:49.743 INFO:tasks.workunit.client.1.smithi089.stdout:5/45: stat f0 0 2024-08-01T06:55:49.745 INFO:tasks.workunit.client.1.smithi089.stdout:1/65: write d0/f13 [728419,38803] 0 2024-08-01T06:55:49.746 INFO:tasks.workunit.client.1.smithi089.stdout:7/57: link d7/fb d7/dc/f1a 0 2024-08-01T06:55:49.748 INFO:tasks.workunit.client.1.smithi089.stdout:6/127: rename d2/d11/d1f/f27 to d2/f2a 0 2024-08-01T06:55:49.751 INFO:tasks.workunit.client.1.smithi089.stdout:9/71: link f12 f13 0 2024-08-01T06:55:49.756 INFO:tasks.workunit.client.1.smithi089.stdout:7/58: fdatasync d7/fb 0 2024-08-01T06:55:49.757 INFO:tasks.workunit.client.1.smithi089.stdout:8/66: creat d5/dc/d12/f14 x:0 0 0 2024-08-01T06:55:49.758 INFO:tasks.workunit.client.1.smithi089.stdout:3/42: getdents d7/da 0 2024-08-01T06:55:49.761 INFO:tasks.workunit.client.1.smithi089.stdout:4/67: rename d3/d8 to d3/db/d16 0 2024-08-01T06:55:49.762 INFO:tasks.workunit.client.1.smithi089.stdout:9/72: rename cc to c14 0 2024-08-01T06:55:49.763 INFO:tasks.workunit.client.1.smithi089.stdout:1/66: mknod d0/d12/c16 0 2024-08-01T06:55:49.765 INFO:tasks.workunit.client.1.smithi089.stdout:1/67: write d0/f11 [874350,6993] 0 2024-08-01T06:55:49.765 INFO:tasks.workunit.client.1.smithi089.stdout:2/66: chown d7/c14 2894650 1 2024-08-01T06:55:49.769 INFO:tasks.workunit.client.1.smithi089.stdout:2/67: dread f2 [0,4194304] 0 2024-08-01T06:55:49.775 INFO:tasks.workunit.client.1.smithi089.stdout:7/59: creat d7/d15/f1b x:0 0 0 2024-08-01T06:55:49.776 INFO:tasks.workunit.client.1.smithi089.stdout:6/128: creat d2/f2b x:0 0 0 2024-08-01T06:55:49.778 INFO:tasks.workunit.client.1.smithi089.stdout:5/46: rename d5/d9 to d5/de 0 2024-08-01T06:55:49.780 INFO:tasks.workunit.client.1.smithi089.stdout:4/68: mkdir d3/d17 0 2024-08-01T06:55:49.780 INFO:tasks.workunit.client.1.smithi089.stdout:3/43: dwrite f3 [0,4194304] 0 2024-08-01T06:55:49.781 INFO:tasks.workunit.client.1.smithi089.stdout:2/68: rename f6 to d7/dc/f15 0 2024-08-01T06:55:49.782 INFO:tasks.workunit.client.1.smithi089.stdout:4/69: readlink d3/db/de/l14 0 2024-08-01T06:55:49.783 INFO:tasks.workunit.client.1.smithi089.stdout:9/73: dwrite f13 [4194304,4194304] 0 2024-08-01T06:55:49.783 INFO:tasks.workunit.client.1.smithi089.stdout:4/70: read - d3/f12 zero size 2024-08-01T06:55:49.785 INFO:tasks.workunit.client.1.smithi089.stdout:7/60: symlink d7/l1c 0 2024-08-01T06:55:49.787 INFO:tasks.workunit.client.1.smithi089.stdout:1/68: mknod d0/d9/d15/c17 0 2024-08-01T06:55:49.788 INFO:tasks.workunit.client.1.smithi089.stdout:1/69: rename d0 to d0/d9/d15/d18 22 2024-08-01T06:55:49.793 INFO:tasks.workunit.client.1.smithi089.stdout:5/47: mkdir d5/de/df 0 2024-08-01T06:55:49.796 INFO:tasks.workunit.client.1.smithi089.stdout:3/44: mknod d7/cc 0 2024-08-01T06:55:49.799 INFO:tasks.workunit.client.1.smithi089.stdout:3/45: dread f3 [0,4194304] 0 2024-08-01T06:55:49.802 INFO:tasks.workunit.client.1.smithi089.stdout:4/71: creat d3/db/d16/f18 x:0 0 0 2024-08-01T06:55:49.803 INFO:tasks.workunit.client.1.smithi089.stdout:7/61: creat d7/dc/f1d x:0 0 0 2024-08-01T06:55:49.804 INFO:tasks.workunit.client.1.smithi089.stdout:8/67: getdents d5/dc/d12 0 2024-08-01T06:55:49.805 INFO:tasks.workunit.client.1.smithi089.stdout:1/70: creat d0/f19 x:0 0 0 2024-08-01T06:55:49.809 INFO:tasks.workunit.client.1.smithi089.stdout:6/129: fdatasync d2/d11/f1d 0 2024-08-01T06:55:49.809 INFO:tasks.workunit.client.1.smithi089.stdout:5/48: mkdir d5/de/d10 0 2024-08-01T06:55:49.810 INFO:tasks.workunit.client.1.smithi089.stdout:6/130: fdatasync d2/f8 0 2024-08-01T06:55:49.811 INFO:tasks.workunit.client.1.smithi089.stdout:4/72: dwrite d3/f12 [0,4194304] 0 2024-08-01T06:55:49.813 INFO:tasks.workunit.client.1.smithi089.stdout:4/73: write d3/f12 [1025211,85550] 0 2024-08-01T06:55:49.814 INFO:tasks.workunit.client.1.smithi089.stdout:4/74: chown d3/db/d16/f18 1211131 1 2024-08-01T06:55:49.814 INFO:tasks.workunit.client.1.smithi089.stdout:3/46: rename d7/da to d7/dd 0 2024-08-01T06:55:49.815 INFO:tasks.workunit.client.1.smithi089.stdout:9/74: link f11 f15 0 2024-08-01T06:55:49.817 INFO:tasks.workunit.client.1.smithi089.stdout:4/75: dread d3/db/f10 [0,4194304] 0 2024-08-01T06:55:49.819 INFO:tasks.workunit.client.1.smithi089.stdout:8/68: mkdir d5/d15 0 2024-08-01T06:55:49.826 INFO:tasks.workunit.client.1.smithi089.stdout:5/49: unlink d5/f8 0 2024-08-01T06:55:49.829 INFO:tasks.workunit.client.1.smithi089.stdout:6/131: rmdir d2/d11 39 2024-08-01T06:55:49.831 INFO:tasks.workunit.client.1.smithi089.stdout:2/69: link d7/c14 d7/dc/c16 0 2024-08-01T06:55:49.833 INFO:tasks.workunit.client.1.smithi089.stdout:9/75: creat f16 x:0 0 0 2024-08-01T06:55:49.835 INFO:tasks.workunit.client.1.smithi089.stdout:4/76: symlink d3/db/de/l19 0 2024-08-01T06:55:49.847 INFO:tasks.workunit.client.1.smithi089.stdout:2/70: dread f2 [4194304,4194304] 0 2024-08-01T06:55:49.848 INFO:tasks.workunit.client.1.smithi089.stdout:8/69: link d5/ff d5/dc/f16 0 2024-08-01T06:55:49.849 INFO:tasks.workunit.client.1.smithi089.stdout:8/70: write d5/f10 [2647035,56693] 0 2024-08-01T06:55:49.853 INFO:tasks.workunit.client.1.smithi089.stdout:6/132: symlink d2/d11/d1a/d1c/l2c 0 2024-08-01T06:55:49.855 INFO:tasks.workunit.client.1.smithi089.stdout:9/76: link fe f17 0 2024-08-01T06:55:49.856 INFO:tasks.workunit.client.1.smithi089.stdout:8/71: dwrite d5/dc/f11 [0,4194304] 0 2024-08-01T06:55:49.856 INFO:tasks.workunit.client.1.smithi089.stdout:4/77: truncate d3/db/f13 890108 0 2024-08-01T06:55:49.857 INFO:tasks.workunit.client.1.smithi089.stdout:8/72: fdatasync d5/dc/d12/f14 0 2024-08-01T06:55:49.860 INFO:tasks.workunit.client.1.smithi089.stdout:5/50: write d5/de/fd [4175496,96364] 0 2024-08-01T06:55:49.861 INFO:tasks.workunit.client.1.smithi089.stdout:1/71: getdents d0/d9 0 2024-08-01T06:55:49.863 INFO:tasks.workunit.client.1.smithi089.stdout:3/47: getdents d7 0 2024-08-01T06:55:49.864 INFO:tasks.workunit.client.1.smithi089.stdout:6/133: creat d2/d11/d1f/f2d x:0 0 0 2024-08-01T06:55:49.864 INFO:tasks.workunit.client.1.smithi089.stdout:9/77: mkdir d18 0 2024-08-01T06:55:49.865 INFO:tasks.workunit.client.1.smithi089.stdout:6/134: stat d2/l19 0 2024-08-01T06:55:49.867 INFO:tasks.workunit.client.1.smithi089.stdout:4/78: chown d3/l11 13 1 2024-08-01T06:55:49.868 INFO:tasks.workunit.client.1.smithi089.stdout:6/135: chown d2/d11/d1f/l22 453 1 2024-08-01T06:55:49.868 INFO:tasks.workunit.client.1.smithi089.stdout:8/73: mknod d5/dc/c17 0 2024-08-01T06:55:49.872 INFO:tasks.workunit.client.1.smithi089.stdout:2/71: write d7/fa [658983,53258] 0 2024-08-01T06:55:49.874 INFO:tasks.workunit.client.1.smithi089.stdout:1/72: dwrite d0/f13 [0,4194304] 0 2024-08-01T06:55:49.880 INFO:tasks.workunit.client.1.smithi089.stdout:4/79: unlink d3/c5 0 2024-08-01T06:55:49.884 INFO:tasks.workunit.client.1.smithi089.stdout:2/72: truncate f2 2522726 0 2024-08-01T06:55:49.886 INFO:tasks.workunit.client.1.smithi089.stdout:9/78: link ff d18/f19 0 2024-08-01T06:55:49.887 INFO:tasks.workunit.client.1.smithi089.stdout:4/80: dwrite d3/f12 [0,4194304] 0 2024-08-01T06:55:49.887 INFO:tasks.workunit.client.1.smithi089.stdout:6/136: mkdir d2/d2e 0 2024-08-01T06:55:49.888 INFO:tasks.workunit.client.1.smithi089.stdout:6/137: read - d2/d11/d1a/f29 zero size 2024-08-01T06:55:49.890 INFO:tasks.workunit.client.1.smithi089.stdout:5/51: chown d5/de/lb 126003120 1 2024-08-01T06:55:49.891 INFO:tasks.workunit.client.1.smithi089.stdout:2/73: fdatasync f4 0 2024-08-01T06:55:49.891 INFO:tasks.workunit.client.1.smithi089.stdout:3/48: getdents d7 0 2024-08-01T06:55:49.891 INFO:tasks.workunit.client.1.smithi089.stdout:5/52: chown l2 19731 1 2024-08-01T06:55:49.892 INFO:tasks.workunit.client.1.smithi089.stdout:5/53: write f0 [2640067,16163] 0 2024-08-01T06:55:49.893 INFO:tasks.workunit.client.1.smithi089.stdout:1/73: rename d0/cd to d0/c1a 0 2024-08-01T06:55:49.894 INFO:tasks.workunit.client.1.smithi089.stdout:6/138: dread d2/f24 [0,4194304] 0 2024-08-01T06:55:49.894 INFO:tasks.workunit.client.1.smithi089.stdout:1/74: write d0/f11 [119688,85196] 0 2024-08-01T06:55:49.898 INFO:tasks.workunit.client.1.smithi089.stdout:5/54: dread f0 [0,4194304] 0 2024-08-01T06:55:49.901 INFO:tasks.workunit.client.1.smithi089.stdout:0/89: sync 2024-08-01T06:55:49.902 INFO:tasks.workunit.client.1.smithi089.stdout:2/74: mknod d7/dc/c17 0 2024-08-01T06:55:49.907 INFO:tasks.workunit.client.1.smithi089.stdout:9/79: unlink c14 0 2024-08-01T06:55:49.910 INFO:tasks.workunit.client.1.smithi089.stdout:0/90: dwrite d9/fb [0,4194304] 0 2024-08-01T06:55:49.911 INFO:tasks.workunit.client.1.smithi089.stdout:1/75: symlink d0/l1b 0 2024-08-01T06:55:49.911 INFO:tasks.workunit.client.1.smithi089.stdout:9/80: chown f11 1605283045 1 2024-08-01T06:55:49.911 INFO:tasks.workunit.client.1.smithi089.stdout:1/76: fsync d0/d9/f10 0 2024-08-01T06:55:49.914 INFO:tasks.workunit.client.1.smithi089.stdout:8/74: getdents d5 0 2024-08-01T06:55:49.921 INFO:tasks.workunit.client.1.smithi089.stdout:6/139: mkdir d2/d2e/d2f 0 2024-08-01T06:55:49.926 INFO:tasks.workunit.client.1.smithi089.stdout:0/91: dwrite d9/fd [0,4194304] 0 2024-08-01T06:55:49.930 INFO:tasks.workunit.client.1.smithi089.stdout:5/55: truncate f0 2058534 0 2024-08-01T06:55:49.930 INFO:tasks.workunit.client.1.smithi089.stdout:8/75: truncate d5/dc/d12/f14 656427 0 2024-08-01T06:55:49.930 INFO:tasks.workunit.client.1.smithi089.stdout:6/140: unlink d2/l19 0 2024-08-01T06:55:49.932 INFO:tasks.workunit.client.1.smithi089.stdout:2/75: link d7/c12 d7/c18 0 2024-08-01T06:55:49.933 INFO:tasks.workunit.client.1.smithi089.stdout:1/77: dwrite d0/f11 [0,4194304] 0 2024-08-01T06:55:49.936 INFO:tasks.workunit.client.1.smithi089.stdout:7/62: sync 2024-08-01T06:55:49.939 INFO:tasks.workunit.client.1.smithi089.stdout:9/81: write f11 [425852,73200] 0 2024-08-01T06:55:49.939 INFO:tasks.workunit.client.1.smithi089.stdout:3/49: dwrite f3 [4194304,4194304] 0 2024-08-01T06:55:49.941 INFO:tasks.workunit.client.1.smithi089.stdout:8/76: creat d5/d15/f18 x:0 0 0 2024-08-01T06:55:49.941 INFO:tasks.workunit.client.1.smithi089.stdout:9/82: stat f17 0 2024-08-01T06:55:49.944 INFO:tasks.workunit.client.1.smithi089.stdout:4/81: dwrite d3/db/d16/f9 [0,4194304] 0 2024-08-01T06:55:49.946 INFO:tasks.workunit.client.1.smithi089.stdout:2/76: unlink d7/dc/c17 0 2024-08-01T06:55:49.950 INFO:tasks.workunit.client.1.smithi089.stdout:0/92: dwrite d9/fb [0,4194304] 0 2024-08-01T06:55:49.951 INFO:tasks.workunit.client.1.smithi089.stdout:1/78: symlink d0/d9/l1c 0 2024-08-01T06:55:49.952 INFO:tasks.workunit.client.1.smithi089.stdout:9/83: unlink c2 0 2024-08-01T06:55:49.952 INFO:tasks.workunit.client.1.smithi089.stdout:6/141: dread d2/f5 [0,4194304] 0 2024-08-01T06:55:49.953 INFO:tasks.workunit.client.1.smithi089.stdout:3/50: symlink d7/dd/le 0 2024-08-01T06:55:49.954 INFO:tasks.workunit.client.1.smithi089.stdout:6/142: chown d2/d11/d1a/d1c 52 1 2024-08-01T06:55:49.954 INFO:tasks.workunit.client.1.smithi089.stdout:9/84: truncate f17 131032 0 2024-08-01T06:55:49.954 INFO:tasks.workunit.client.1.smithi089.stdout:8/77: dread d5/f10 [4194304,4194304] 0 2024-08-01T06:55:49.955 INFO:tasks.workunit.client.1.smithi089.stdout:3/51: write f3 [9414884,25782] 0 2024-08-01T06:55:49.956 INFO:tasks.workunit.client.1.smithi089.stdout:9/85: truncate f13 9102651 0 2024-08-01T06:55:49.956 INFO:tasks.workunit.client.1.smithi089.stdout:9/86: chown l6 247 1 2024-08-01T06:55:49.957 INFO:tasks.workunit.client.1.smithi089.stdout:1/79: fdatasync d0/f11 0 2024-08-01T06:55:49.959 INFO:tasks.workunit.client.1.smithi089.stdout:1/80: chown d0/f11 230 1 2024-08-01T06:55:49.966 INFO:tasks.workunit.client.1.smithi089.stdout:0/93: unlink d9/l20 0 2024-08-01T06:55:49.970 INFO:tasks.workunit.client.1.smithi089.stdout:1/81: dwrite d0/f8 [0,4194304] 0 2024-08-01T06:55:49.970 INFO:tasks.workunit.client.1.smithi089.stdout:8/78: rmdir d5 39 2024-08-01T06:55:49.972 INFO:tasks.workunit.client.1.smithi089.stdout:8/79: chown f2 1753 1 2024-08-01T06:55:49.974 INFO:tasks.workunit.client.1.smithi089.stdout:2/77: dwrite d7/dc/f15 [0,4194304] 0 2024-08-01T06:55:49.976 INFO:tasks.workunit.client.1.smithi089.stdout:6/143: mkdir d2/d30 0 2024-08-01T06:55:49.976 INFO:tasks.workunit.client.1.smithi089.stdout:0/94: mkdir d9/d22 0 2024-08-01T06:55:49.979 INFO:tasks.workunit.client.1.smithi089.stdout:1/82: mknod d0/d9/c1d 0 2024-08-01T06:55:49.980 INFO:tasks.workunit.client.1.smithi089.stdout:1/83: dread - d0/f19 zero size 2024-08-01T06:55:49.981 INFO:tasks.workunit.client.1.smithi089.stdout:8/80: rmdir d5 39 2024-08-01T06:55:49.983 INFO:tasks.workunit.client.1.smithi089.stdout:0/95: mkdir d9/d23 0 2024-08-01T06:55:49.984 INFO:tasks.workunit.client.1.smithi089.stdout:1/84: fsync d0/f6 0 2024-08-01T06:55:49.985 INFO:tasks.workunit.client.1.smithi089.stdout:7/63: dwrite d7/fd [0,4194304] 0 2024-08-01T06:55:49.985 INFO:tasks.workunit.client.1.smithi089.stdout:0/96: chown d9/f17 3467675 1 2024-08-01T06:55:49.986 INFO:tasks.workunit.client.1.smithi089.stdout:4/82: fdatasync d3/db/d16/f9 0 2024-08-01T06:55:49.988 INFO:tasks.workunit.client.1.smithi089.stdout:1/85: write d0/f8 [1170350,76735] 0 2024-08-01T06:55:49.989 INFO:tasks.workunit.client.1.smithi089.stdout:8/81: readlink d5/dc/l8 0 2024-08-01T06:55:49.989 INFO:tasks.workunit.client.1.smithi089.stdout:4/83: fsync d3/db/f10 0 2024-08-01T06:55:49.991 INFO:tasks.workunit.client.1.smithi089.stdout:6/144: mkdir d2/d2e/d2f/d31 0 2024-08-01T06:55:49.991 INFO:tasks.workunit.client.1.smithi089.stdout:5/56: write f0 [2965653,77266] 0 2024-08-01T06:55:49.997 INFO:tasks.workunit.client.1.smithi089.stdout:1/86: dwrite d0/f19 [0,4194304] 0 2024-08-01T06:55:49.998 INFO:tasks.workunit.client.1.smithi089.stdout:1/87: chown d0/c4 116095041 1 2024-08-01T06:55:49.998 INFO:tasks.workunit.client.1.smithi089.stdout:0/97: symlink d9/d1a/l24 0 2024-08-01T06:55:49.998 INFO:tasks.workunit.client.1.smithi089.stdout:3/52: fdatasync f3 0 2024-08-01T06:55:49.999 INFO:tasks.workunit.client.1.smithi089.stdout:1/88: fdatasync d0/d9/f10 0 2024-08-01T06:55:50.001 INFO:tasks.workunit.client.1.smithi089.stdout:0/98: write d9/fa [765989,53625] 0 2024-08-01T06:55:50.004 INFO:tasks.workunit.client.1.smithi089.stdout:8/82: symlink d5/dc/l19 0 2024-08-01T06:55:50.006 INFO:tasks.workunit.client.1.smithi089.stdout:9/87: write d18/f19 [3035563,17088] 0 2024-08-01T06:55:50.011 INFO:tasks.workunit.client.1.smithi089.stdout:5/57: chown d5/de/d10 25 1 2024-08-01T06:55:50.012 INFO:tasks.workunit.client.1.smithi089.stdout:3/53: symlink d7/dd/lf 0 2024-08-01T06:55:50.014 INFO:tasks.workunit.client.1.smithi089.stdout:5/58: write f0 [2910552,116864] 0 2024-08-01T06:55:50.014 INFO:tasks.workunit.client.1.smithi089.stdout:3/54: chown l4 68 1 2024-08-01T06:55:50.015 INFO:tasks.workunit.client.1.smithi089.stdout:2/78: write f2 [1885444,39068] 0 2024-08-01T06:55:50.017 INFO:tasks.workunit.client.1.smithi089.stdout:8/83: creat d5/f1a x:0 0 0 2024-08-01T06:55:50.018 INFO:tasks.workunit.client.1.smithi089.stdout:4/84: rename f1 to d3/db/d16/f1a 0 2024-08-01T06:55:50.018 INFO:tasks.workunit.client.1.smithi089.stdout:1/89: dwrite d0/f11 [0,4194304] 0 2024-08-01T06:55:50.019 INFO:tasks.workunit.client.1.smithi089.stdout:0/99: dwrite d9/ff [0,4194304] 0 2024-08-01T06:55:50.021 INFO:tasks.workunit.client.1.smithi089.stdout:8/84: chown d5/dc/d12/f14 24997757 1 2024-08-01T06:55:50.021 INFO:tasks.workunit.client.1.smithi089.stdout:8/85: fdatasync d5/d15/f18 0 2024-08-01T06:55:50.021 INFO:tasks.workunit.client.1.smithi089.stdout:0/100: chown d9/f14 1588703 1 2024-08-01T06:55:50.022 INFO:tasks.workunit.client.1.smithi089.stdout:3/55: unlink d7/cc 0 2024-08-01T06:55:50.022 INFO:tasks.workunit.client.1.smithi089.stdout:7/64: write d7/fa [1291242,67034] 0 2024-08-01T06:55:50.023 INFO:tasks.workunit.client.1.smithi089.stdout:2/79: mkdir d7/d19 0 2024-08-01T06:55:50.023 INFO:tasks.workunit.client.1.smithi089.stdout:0/101: write d9/f11 [1204824,103659] 0 2024-08-01T06:55:50.023 INFO:tasks.workunit.client.1.smithi089.stdout:8/86: chown d5/dc/f11 535956024 1 2024-08-01T06:55:50.025 INFO:tasks.workunit.client.1.smithi089.stdout:6/145: rename d2/d11/d1a/d21 to d2/d11/d1a/d1c/d32 0 2024-08-01T06:55:50.026 INFO:tasks.workunit.client.1.smithi089.stdout:2/80: read f4 [4057472,39330] 0 2024-08-01T06:55:50.028 INFO:tasks.workunit.client.1.smithi089.stdout:4/85: symlink d3/db/l1b 0 2024-08-01T06:55:50.029 INFO:tasks.workunit.client.1.smithi089.stdout:4/86: chown d3/db/d16 3 1 2024-08-01T06:55:50.034 INFO:tasks.workunit.client.1.smithi089.stdout:3/56: dwrite f3 [0,4194304] 0 2024-08-01T06:55:50.034 INFO:tasks.workunit.client.1.smithi089.stdout:4/87: truncate d3/db/f10 4741252 0 2024-08-01T06:55:50.034 INFO:tasks.workunit.client.1.smithi089.stdout:7/65: dwrite d7/fd [0,4194304] 0 2024-08-01T06:55:50.044 INFO:tasks.workunit.client.1.smithi089.stdout:2/81: chown d7/c18 3587 1 2024-08-01T06:55:50.051 INFO:tasks.workunit.client.1.smithi089.stdout:3/57: mkdir d7/dd/d10 0 2024-08-01T06:55:50.052 INFO:tasks.workunit.client.1.smithi089.stdout:7/66: mknod d7/dc/c1e 0 2024-08-01T06:55:50.053 INFO:tasks.workunit.client.1.smithi089.stdout:7/67: stat d7/d15 0 2024-08-01T06:55:50.054 INFO:tasks.workunit.client.1.smithi089.stdout:0/102: mkdir d9/d23/d25 0 2024-08-01T06:55:50.055 INFO:tasks.workunit.client.1.smithi089.stdout:0/103: chown d9/d1a/f1e 0 1 2024-08-01T06:55:50.057 INFO:tasks.workunit.client.1.smithi089.stdout:2/82: creat d7/dc/f1a x:0 0 0 2024-08-01T06:55:50.057 INFO:tasks.workunit.client.1.smithi089.stdout:0/104: truncate d9/f12 81502 0 2024-08-01T06:55:50.059 INFO:tasks.workunit.client.1.smithi089.stdout:4/88: creat d3/d17/f1c x:0 0 0 2024-08-01T06:55:50.059 INFO:tasks.workunit.client.1.smithi089.stdout:8/87: write d5/dc/f16 [449121,84733] 0 2024-08-01T06:55:50.059 INFO:tasks.workunit.client.1.smithi089.stdout:1/90: dwrite d0/f6 [4194304,4194304] 0 2024-08-01T06:55:50.061 INFO:tasks.workunit.client.1.smithi089.stdout:1/91: fsync d0/f11 0 2024-08-01T06:55:50.062 INFO:tasks.workunit.client.1.smithi089.stdout:0/105: write d9/ff [158815,59568] 0 2024-08-01T06:55:50.064 INFO:tasks.workunit.client.1.smithi089.stdout:8/88: write d5/dc/d12/f14 [1385127,125798] 0 2024-08-01T06:55:50.067 INFO:tasks.workunit.client.1.smithi089.stdout:2/83: dwrite d7/dc/f15 [0,4194304] 0 2024-08-01T06:55:50.070 INFO:tasks.workunit.client.1.smithi089.stdout:7/68: rename d7/dc to d7/d1f 0 2024-08-01T06:55:50.075 INFO:tasks.workunit.client.1.smithi089.stdout:1/92: rename d0/d12 to d0/d9/d1e 0 2024-08-01T06:55:50.075 INFO:tasks.workunit.client.1.smithi089.stdout:1/93: read d0/d9/f10 [6333695,51577] 0 2024-08-01T06:55:50.077 INFO:tasks.workunit.client.1.smithi089.stdout:8/89: mknod d5/dc/d12/c1b 0 2024-08-01T06:55:50.080 INFO:tasks.workunit.client.1.smithi089.stdout:7/69: symlink d7/d1f/l20 0 2024-08-01T06:55:50.082 INFO:tasks.workunit.client.1.smithi089.stdout:1/94: dwrite d0/f6 [4194304,4194304] 0 2024-08-01T06:55:50.083 INFO:tasks.workunit.client.1.smithi089.stdout:1/95: write d0/f6 [2524341,109072] 0 2024-08-01T06:55:50.085 INFO:tasks.workunit.client.1.smithi089.stdout:8/90: creat d5/d15/f1c x:0 0 0 2024-08-01T06:55:50.088 INFO:tasks.workunit.client.1.smithi089.stdout:7/70: mknod d7/c21 0 2024-08-01T06:55:50.093 INFO:tasks.workunit.client.1.smithi089.stdout:0/106: dwrite d9/f18 [0,4194304] 0 2024-08-01T06:55:50.094 INFO:tasks.workunit.client.1.smithi089.stdout:8/91: mknod d5/c1d 0 2024-08-01T06:55:50.095 INFO:tasks.workunit.client.1.smithi089.stdout:4/89: write d3/db/d16/f1a [3921552,111404] 0 2024-08-01T06:55:50.096 INFO:tasks.workunit.client.1.smithi089.stdout:7/71: read f4 [635900,64374] 0 2024-08-01T06:55:50.097 INFO:tasks.workunit.client.1.smithi089.stdout:7/72: dread - d7/f19 zero size 2024-08-01T06:55:50.098 INFO:tasks.workunit.client.1.smithi089.stdout:7/73: chown d7/df/f11 3988017 1 2024-08-01T06:55:50.098 INFO:tasks.workunit.client.1.smithi089.stdout:7/74: write d7/fb [1361846,62118] 0 2024-08-01T06:55:50.099 INFO:tasks.workunit.client.1.smithi089.stdout:7/75: chown f3 277 1 2024-08-01T06:55:50.099 INFO:tasks.workunit.client.1.smithi089.stdout:7/76: chown d7/df/d10 1061560660 1 2024-08-01T06:55:50.100 INFO:tasks.workunit.client.1.smithi089.stdout:8/92: truncate d5/f10 383376 0 2024-08-01T06:55:50.107 INFO:tasks.workunit.client.1.smithi089.stdout:8/93: mkdir d5/dc/d1e 0 2024-08-01T06:55:50.107 INFO:tasks.workunit.client.1.smithi089.stdout:8/94: fdatasync d5/dc/d12/f14 0 2024-08-01T06:55:50.111 INFO:tasks.workunit.client.1.smithi089.stdout:8/95: creat d5/d15/f1f x:0 0 0 2024-08-01T06:55:50.112 INFO:tasks.workunit.client.1.smithi089.stdout:8/96: chown d5/l13 44 1 2024-08-01T06:55:50.114 INFO:tasks.workunit.client.1.smithi089.stdout:8/97: rmdir d5/dc 39 2024-08-01T06:55:50.116 INFO:tasks.workunit.client.1.smithi089.stdout:1/96: truncate d0/f8 2479421 0 2024-08-01T06:55:50.120 INFO:tasks.workunit.client.1.smithi089.stdout:8/98: dwrite d5/d15/f18 [0,4194304] 0 2024-08-01T06:55:50.120 INFO:tasks.workunit.client.1.smithi089.stdout:1/97: mknod d0/d9/c1f 0 2024-08-01T06:55:50.123 INFO:tasks.workunit.client.1.smithi089.stdout:0/107: truncate d9/fd 877572 0 2024-08-01T06:55:50.124 INFO:tasks.workunit.client.1.smithi089.stdout:0/108: stat d9/f14 0 2024-08-01T06:55:50.125 INFO:tasks.workunit.client.1.smithi089.stdout:4/90: truncate d3/db/f10 420549 0 2024-08-01T06:55:50.126 INFO:tasks.workunit.client.1.smithi089.stdout:1/98: rename d0/d9/f10 to d0/f20 0 2024-08-01T06:55:50.127 INFO:tasks.workunit.client.1.smithi089.stdout:1/99: chown d0/d9/d15 376 1 2024-08-01T06:55:50.128 INFO:tasks.workunit.client.1.smithi089.stdout:0/109: mkdir d9/d23/d26 0 2024-08-01T06:55:50.130 INFO:tasks.workunit.client.1.smithi089.stdout:8/99: dwrite f2 [0,4194304] 0 2024-08-01T06:55:50.132 INFO:tasks.workunit.client.1.smithi089.stdout:4/91: rename d3/c7 to d3/db/c1d 0 2024-08-01T06:55:50.135 INFO:tasks.workunit.client.1.smithi089.stdout:0/110: dread d9/ff [0,4194304] 0 2024-08-01T06:55:50.137 INFO:tasks.workunit.client.1.smithi089.stdout:0/111: dread - d9/f17 zero size 2024-08-01T06:55:50.138 INFO:tasks.workunit.client.1.smithi089.stdout:7/77: dwrite f6 [0,4194304] 0 2024-08-01T06:55:50.141 INFO:tasks.workunit.client.1.smithi089.stdout:8/100: dwrite d5/d15/f18 [0,4194304] 0 2024-08-01T06:55:50.144 INFO:tasks.workunit.client.1.smithi089.stdout:8/101: stat d5 0 2024-08-01T06:55:50.146 INFO:tasks.workunit.client.1.smithi089.stdout:1/100: rename d0/c1a to d0/d9/d1e/c21 0 2024-08-01T06:55:50.147 INFO:tasks.workunit.client.1.smithi089.stdout:1/101: chown d0/d9/d15/c17 1 1 2024-08-01T06:55:50.148 INFO:tasks.workunit.client.1.smithi089.stdout:0/112: creat d9/d23/f27 x:0 0 0 2024-08-01T06:55:50.151 INFO:tasks.workunit.client.1.smithi089.stdout:4/92: mkdir d3/d1e 0 2024-08-01T06:55:50.157 INFO:tasks.workunit.client.1.smithi089.stdout:1/102: mknod d0/c22 0 2024-08-01T06:55:50.157 INFO:tasks.workunit.client.1.smithi089.stdout:1/103: chown d0/c4 2034 1 2024-08-01T06:55:50.161 INFO:tasks.workunit.client.1.smithi089.stdout:0/113: rename d9/f12 to d9/d1a/f28 0 2024-08-01T06:55:50.161 INFO:tasks.workunit.client.1.smithi089.stdout:8/102: rename d5 to d5/dc/d1e/d20 22 2024-08-01T06:55:50.164 INFO:tasks.workunit.client.1.smithi089.stdout:7/78: fdatasync f6 0 2024-08-01T06:55:50.166 INFO:tasks.workunit.client.1.smithi089.stdout:0/114: write d9/d1a/f28 [877820,75215] 0 2024-08-01T06:55:50.166 INFO:tasks.workunit.client.1.smithi089.stdout:7/79: write d7/d15/f1b [54459,44485] 0 2024-08-01T06:55:50.167 INFO:tasks.workunit.client.1.smithi089.stdout:0/115: chown d9/d23/d26 934 1 2024-08-01T06:55:50.167 INFO:tasks.workunit.client.1.smithi089.stdout:8/103: mknod d5/d15/c21 0 2024-08-01T06:55:50.169 INFO:tasks.workunit.client.1.smithi089.stdout:0/116: write d9/f17 [110270,39269] 0 2024-08-01T06:55:50.169 INFO:tasks.workunit.client.1.smithi089.stdout:4/93: mkdir d3/d1f 0 2024-08-01T06:55:50.172 INFO:tasks.workunit.client.1.smithi089.stdout:7/80: mknod d7/c22 0 2024-08-01T06:55:50.177 INFO:tasks.workunit.client.1.smithi089.stdout:0/117: rename f2 to d9/d22/f29 0 2024-08-01T06:55:50.178 INFO:tasks.workunit.client.1.smithi089.stdout:7/81: rename d7/df to d7/df/d23 22 2024-08-01T06:55:50.179 INFO:tasks.workunit.client.1.smithi089.stdout:7/82: write d7/df/d10/f17 [678484,53902] 0 2024-08-01T06:55:50.181 INFO:tasks.workunit.client.1.smithi089.stdout:8/104: symlink d5/dc/d1e/l22 0 2024-08-01T06:55:50.182 INFO:tasks.workunit.client.1.smithi089.stdout:0/118: dread d9/ff [0,4194304] 0 2024-08-01T06:55:50.183 INFO:tasks.workunit.client.1.smithi089.stdout:0/119: write d9/fb [2372760,68953] 0 2024-08-01T06:55:50.186 INFO:tasks.workunit.client.1.smithi089.stdout:1/104: getdents d0/d9/d15 0 2024-08-01T06:55:50.189 INFO:tasks.workunit.client.1.smithi089.stdout:1/105: dread d0/f13 [0,4194304] 0 2024-08-01T06:55:50.195 INFO:tasks.workunit.client.1.smithi089.stdout:9/88: sync 2024-08-01T06:55:50.195 INFO:tasks.workunit.client.1.smithi089.stdout:9/89: write f15 [74155,116677] 0 2024-08-01T06:55:50.201 INFO:tasks.workunit.client.1.smithi089.stdout:8/105: mkdir d5/d23 0 2024-08-01T06:55:50.201 INFO:tasks.workunit.client.1.smithi089.stdout:8/106: readlink d5/dc/l8 0 2024-08-01T06:55:50.202 INFO:tasks.workunit.client.1.smithi089.stdout:8/107: read - d5/f1a zero size 2024-08-01T06:55:50.202 INFO:tasks.workunit.client.1.smithi089.stdout:8/108: chown d5/dc/d12/c1b 259728752 1 2024-08-01T06:55:50.203 INFO:tasks.workunit.client.1.smithi089.stdout:4/94: write d3/db/f13 [1713218,116603] 0 2024-08-01T06:55:50.205 INFO:tasks.workunit.client.1.smithi089.stdout:1/106: dread d0/f8 [0,4194304] 0 2024-08-01T06:55:50.206 INFO:tasks.workunit.client.1.smithi089.stdout:1/107: read d0/f20 [4918482,18958] 0 2024-08-01T06:55:50.211 INFO:tasks.workunit.client.1.smithi089.stdout:8/109: rmdir d5/dc/d12 39 2024-08-01T06:55:50.215 INFO:tasks.workunit.client.1.smithi089.stdout:1/108: creat d0/f23 x:0 0 0 2024-08-01T06:55:50.217 INFO:tasks.workunit.client.1.smithi089.stdout:9/90: creat d18/f1a x:0 0 0 2024-08-01T06:55:50.217 INFO:tasks.workunit.client.1.smithi089.stdout:7/83: truncate d7/d1f/f1a 1417756 0 2024-08-01T06:55:50.217 INFO:tasks.workunit.client.1.smithi089.stdout:8/110: dwrite d5/d15/f1c [0,4194304] 0 2024-08-01T06:55:50.219 INFO:tasks.workunit.client.1.smithi089.stdout:7/84: write d7/fd [4678188,10213] 0 2024-08-01T06:55:50.220 INFO:tasks.workunit.client.1.smithi089.stdout:9/91: write f12 [2243878,107084] 0 2024-08-01T06:55:50.220 INFO:tasks.workunit.client.1.smithi089.stdout:8/111: write d5/d15/f18 [2032486,121796] 0 2024-08-01T06:55:50.222 INFO:tasks.workunit.client.1.smithi089.stdout:1/109: creat d0/f24 x:0 0 0 2024-08-01T06:55:50.223 INFO:tasks.workunit.client.1.smithi089.stdout:0/120: fsync d9/d1a/f28 0 2024-08-01T06:55:50.223 INFO:tasks.workunit.client.1.smithi089.stdout:1/110: chown d0 1606673 1 2024-08-01T06:55:50.228 INFO:tasks.workunit.client.1.smithi089.stdout:9/92: creat d18/f1b x:0 0 0 2024-08-01T06:55:50.232 INFO:tasks.workunit.client.1.smithi089.stdout:0/121: rename d9/fb to d9/d23/d25/f2a 0 2024-08-01T06:55:50.234 INFO:tasks.workunit.client.1.smithi089.stdout:1/111: write d0/f20 [5009420,54273] 0 2024-08-01T06:55:50.238 INFO:tasks.workunit.client.1.smithi089.stdout:7/85: link d7/df/d10/f17 d7/df/d10/f24 0 2024-08-01T06:55:50.243 INFO:tasks.workunit.client.1.smithi089.stdout:1/112: mknod d0/d9/c25 0 2024-08-01T06:55:50.244 INFO:tasks.workunit.client.1.smithi089.stdout:4/95: dwrite d3/db/d16/f9 [0,4194304] 0 2024-08-01T06:55:50.244 INFO:tasks.workunit.client.1.smithi089.stdout:1/113: chown d0/d9/d1e/c16 928379 1 2024-08-01T06:55:50.246 INFO:tasks.workunit.client.1.smithi089.stdout:7/86: creat d7/d15/f25 x:0 0 0 2024-08-01T06:55:50.246 INFO:tasks.workunit.client.1.smithi089.stdout:4/96: truncate d3/db/d16/f18 50920 0 2024-08-01T06:55:50.260 INFO:tasks.workunit.client.1.smithi089.stdout:4/97: rename d3/d17/f1c to d3/d17/f20 0 2024-08-01T06:55:50.261 INFO:tasks.workunit.client.1.smithi089.stdout:4/98: chown d3/db/d16/f9 208 1 2024-08-01T06:55:50.261 INFO:tasks.workunit.client.1.smithi089.stdout:9/93: link cb d18/c1c 0 2024-08-01T06:55:50.261 INFO:tasks.workunit.client.1.smithi089.stdout:9/94: stat d18 0 2024-08-01T06:55:50.265 INFO:tasks.workunit.client.1.smithi089.stdout:0/122: getdents d9/d1a 0 2024-08-01T06:55:50.268 INFO:tasks.workunit.client.1.smithi089.stdout:4/99: dwrite d3/db/f13 [0,4194304] 0 2024-08-01T06:55:50.269 INFO:tasks.workunit.client.1.smithi089.stdout:9/95: creat d18/f1d x:0 0 0 2024-08-01T06:55:50.270 INFO:tasks.workunit.client.1.smithi089.stdout:7/87: write d7/df/d10/f24 [947678,5175] 0 2024-08-01T06:55:50.270 INFO:tasks.workunit.client.1.smithi089.stdout:0/123: mkdir d9/d22/d2b 0 2024-08-01T06:55:50.272 INFO:tasks.workunit.client.1.smithi089.stdout:4/100: write d3/db/d16/f9 [1961739,11360] 0 2024-08-01T06:55:50.274 INFO:tasks.workunit.client.1.smithi089.stdout:7/88: read d7/fd [2994281,99344] 0 2024-08-01T06:55:50.276 INFO:tasks.workunit.client.1.smithi089.stdout:0/124: write d9/f1f [680253,116625] 0 2024-08-01T06:55:50.277 INFO:tasks.workunit.client.1.smithi089.stdout:4/101: read d3/db/f10 [1230060,80930] 0 2024-08-01T06:55:50.277 INFO:tasks.workunit.client.1.smithi089.stdout:1/114: dwrite d0/f13 [0,4194304] 0 2024-08-01T06:55:50.283 INFO:tasks.workunit.client.1.smithi089.stdout:9/96: dread ff [0,4194304] 0 2024-08-01T06:55:50.284 INFO:tasks.workunit.client.1.smithi089.stdout:7/89: dread d7/df/d10/f24 [0,4194304] 0 2024-08-01T06:55:50.284 INFO:tasks.workunit.client.1.smithi089.stdout:9/97: write f12 [6063353,117728] 0 2024-08-01T06:55:50.285 INFO:tasks.workunit.client.1.smithi089.stdout:9/98: write d18/f1b [193510,4714] 0 2024-08-01T06:55:50.286 INFO:tasks.workunit.client.1.smithi089.stdout:1/115: truncate d0/f8 1084688 0 2024-08-01T06:55:50.287 INFO:tasks.workunit.client.1.smithi089.stdout:1/116: write d0/f20 [7639634,25142] 0 2024-08-01T06:55:50.291 INFO:tasks.workunit.client.1.smithi089.stdout:0/125: getdents d9/d1a 0 2024-08-01T06:55:50.291 INFO:tasks.workunit.client.1.smithi089.stdout:0/126: readlink d9/l15 0 2024-08-01T06:55:50.293 INFO:tasks.workunit.client.1.smithi089.stdout:7/90: rmdir d7/d1f 39 2024-08-01T06:55:50.293 INFO:tasks.workunit.client.1.smithi089.stdout:9/99: dwrite f16 [0,4194304] 0 2024-08-01T06:55:50.293 INFO:tasks.workunit.client.1.smithi089.stdout:7/91: stat c1 0 2024-08-01T06:55:50.295 INFO:tasks.workunit.client.1.smithi089.stdout:4/102: mkdir d3/d1e/d21 0 2024-08-01T06:55:50.297 INFO:tasks.workunit.client.1.smithi089.stdout:1/117: mknod d0/d9/d1e/c26 0 2024-08-01T06:55:50.301 INFO:tasks.workunit.client.1.smithi089.stdout:7/92: symlink d7/d15/l26 0 2024-08-01T06:55:50.301 INFO:tasks.workunit.client.1.smithi089.stdout:4/103: fsync d3/d17/f20 0 2024-08-01T06:55:50.304 INFO:tasks.workunit.client.1.smithi089.stdout:0/127: creat d9/d23/d26/f2c x:0 0 0 2024-08-01T06:55:50.304 INFO:tasks.workunit.client.1.smithi089.stdout:7/93: symlink d7/df/l27 0 2024-08-01T06:55:50.306 INFO:tasks.workunit.client.1.smithi089.stdout:4/104: mkdir d3/d17/d22 0 2024-08-01T06:55:50.308 INFO:tasks.workunit.client.1.smithi089.stdout:0/128: symlink d9/l2d 0 2024-08-01T06:55:50.309 INFO:tasks.workunit.client.1.smithi089.stdout:0/129: chown d9/d22/d2b 111727483 1 2024-08-01T06:55:50.309 INFO:tasks.workunit.client.1.smithi089.stdout:0/130: chown d9/d22/f29 1332 1 2024-08-01T06:55:50.310 INFO:tasks.workunit.client.1.smithi089.stdout:9/100: getdents d18 0 2024-08-01T06:55:50.311 INFO:tasks.workunit.client.1.smithi089.stdout:0/131: dread d9/f17 [0,4194304] 0 2024-08-01T06:55:50.312 INFO:tasks.workunit.client.1.smithi089.stdout:7/94: creat d7/d1f/f28 x:0 0 0 2024-08-01T06:55:50.313 INFO:tasks.workunit.client.1.smithi089.stdout:7/95: chown c1 31389 1 2024-08-01T06:55:50.314 INFO:tasks.workunit.client.1.smithi089.stdout:9/101: write d18/f19 [4646229,5658] 0 2024-08-01T06:55:50.317 INFO:tasks.workunit.client.1.smithi089.stdout:7/96: mknod d7/df/c29 0 2024-08-01T06:55:50.320 INFO:tasks.workunit.client.1.smithi089.stdout:7/97: symlink d7/d15/l2a 0 2024-08-01T06:55:50.320 INFO:tasks.workunit.client.1.smithi089.stdout:7/98: fdatasync f3 0 2024-08-01T06:55:50.321 INFO:tasks.workunit.client.1.smithi089.stdout:7/99: dread - d7/d1f/f1d zero size 2024-08-01T06:55:50.321 INFO:tasks.workunit.client.1.smithi089.stdout:9/102: rename d18/c1c to d18/c1e 0 2024-08-01T06:55:50.325 INFO:tasks.workunit.client.1.smithi089.stdout:7/100: symlink d7/df/l2b 0 2024-08-01T06:55:50.326 INFO:tasks.workunit.client.1.smithi089.stdout:9/103: creat d18/f1f x:0 0 0 2024-08-01T06:55:50.327 INFO:tasks.workunit.client.1.smithi089.stdout:0/132: getdents d9/d23 0 2024-08-01T06:55:50.329 INFO:tasks.workunit.client.1.smithi089.stdout:7/101: mknod d7/d1f/c2c 0 2024-08-01T06:55:50.329 INFO:tasks.workunit.client.1.smithi089.stdout:7/102: stat d7/df/f11 0 2024-08-01T06:55:50.330 INFO:tasks.workunit.client.1.smithi089.stdout:9/104: creat d18/f20 x:0 0 0 2024-08-01T06:55:50.332 INFO:tasks.workunit.client.1.smithi089.stdout:0/133: mkdir d9/d23/d26/d2e 0 2024-08-01T06:55:50.332 INFO:tasks.workunit.client.1.smithi089.stdout:0/134: dread - d9/f13 zero size 2024-08-01T06:55:50.334 INFO:tasks.workunit.client.1.smithi089.stdout:9/105: creat d18/f21 x:0 0 0 2024-08-01T06:55:50.335 INFO:tasks.workunit.client.1.smithi089.stdout:5/59: sync 2024-08-01T06:55:50.337 INFO:tasks.workunit.client.1.smithi089.stdout:0/135: symlink d9/d23/d26/l2f 0 2024-08-01T06:55:50.338 INFO:tasks.workunit.client.1.smithi089.stdout:0/136: write d9/f13 [218579,46484] 0 2024-08-01T06:55:50.338 INFO:tasks.workunit.client.1.smithi089.stdout:9/106: mkdir d18/d22 0 2024-08-01T06:55:50.339 INFO:tasks.workunit.client.1.smithi089.stdout:9/107: chown f15 9515668 1 2024-08-01T06:55:50.341 INFO:tasks.workunit.client.1.smithi089.stdout:1/118: truncate d0/f19 3692446 0 2024-08-01T06:55:50.343 INFO:tasks.workunit.client.1.smithi089.stdout:5/60: dwrite f0 [0,4194304] 0 2024-08-01T06:55:50.343 INFO:tasks.workunit.client.1.smithi089.stdout:9/108: dread d18/f1b [0,4194304] 0 2024-08-01T06:55:50.344 INFO:tasks.workunit.client.1.smithi089.stdout:4/105: write d3/db/f13 [4457532,45688] 0 2024-08-01T06:55:50.345 INFO:tasks.workunit.client.1.smithi089.stdout:0/137: dread d9/d22/f29 [0,4194304] 0 2024-08-01T06:55:50.345 INFO:tasks.workunit.client.1.smithi089.stdout:4/106: chown d3/f12 418 1 2024-08-01T06:55:50.345 INFO:tasks.workunit.client.1.smithi089.stdout:9/109: creat d18/f23 x:0 0 0 2024-08-01T06:55:50.346 INFO:tasks.workunit.client.1.smithi089.stdout:5/61: creat d5/de/d10/f11 x:0 0 0 2024-08-01T06:55:50.370 INFO:tasks.workunit.client.1.smithi089.stdout:0/138: creat d9/d23/d26/d2e/f30 x:0 0 0 2024-08-01T06:55:50.371 INFO:tasks.workunit.client.1.smithi089.stdout:7/103: write f4 [557682,94811] 0 2024-08-01T06:55:50.372 INFO:tasks.workunit.client.1.smithi089.stdout:4/107: dread d3/db/f10 [0,4194304] 0 2024-08-01T06:55:50.375 INFO:tasks.workunit.client.1.smithi089.stdout:5/62: rename d5/de/fd to d5/de/df/f12 0 2024-08-01T06:55:50.378 INFO:tasks.workunit.client.1.smithi089.stdout:5/63: mkdir d5/d13 0 2024-08-01T06:55:50.382 INFO:tasks.workunit.client.1.smithi089.stdout:0/139: dwrite d9/d23/d25/f2a [0,4194304] 0 2024-08-01T06:55:50.382 INFO:tasks.workunit.client.1.smithi089.stdout:4/108: dwrite d3/db/d16/f18 [0,4194304] 0 2024-08-01T06:55:50.383 INFO:tasks.workunit.client.1.smithi089.stdout:4/109: readlink d3/db/de/l19 0 2024-08-01T06:55:50.386 INFO:tasks.workunit.client.1.smithi089.stdout:0/140: unlink l4 0 2024-08-01T06:55:50.389 INFO:tasks.workunit.client.1.smithi089.stdout:4/110: rename d3/ld to d3/db/d16/l23 0 2024-08-01T06:55:50.390 INFO:tasks.workunit.client.1.smithi089.stdout:0/141: dread d9/d22/f29 [0,4194304] 0 2024-08-01T06:55:50.398 INFO:tasks.workunit.client.1.smithi089.stdout:0/142: dwrite d9/d23/d26/f2c [0,4194304] 0 2024-08-01T06:55:50.401 INFO:tasks.workunit.client.1.smithi089.stdout:0/143: write d9/d23/d26/f2c [2961534,126769] 0 2024-08-01T06:55:50.401 INFO:tasks.workunit.client.1.smithi089.stdout:5/64: creat d5/de/f14 x:0 0 0 2024-08-01T06:55:50.405 INFO:tasks.workunit.client.1.smithi089.stdout:0/144: getdents d9/d1a 0 2024-08-01T06:55:50.405 INFO:tasks.workunit.client.1.smithi089.stdout:7/104: dwrite d7/fd [0,4194304] 0 2024-08-01T06:55:50.405 INFO:tasks.workunit.client.1.smithi089.stdout:0/145: stat d9/d1a/c21 0 2024-08-01T06:55:50.406 INFO:tasks.workunit.client.1.smithi089.stdout:5/65: symlink d5/de/d10/l15 0 2024-08-01T06:55:50.406 INFO:tasks.workunit.client.1.smithi089.stdout:0/146: chown d9/l19 12060 1 2024-08-01T06:55:50.407 INFO:tasks.workunit.client.1.smithi089.stdout:5/66: write f0 [2075667,53448] 0 2024-08-01T06:55:50.407 INFO:tasks.workunit.client.1.smithi089.stdout:7/105: creat d7/d15/f2d x:0 0 0 2024-08-01T06:55:50.408 INFO:tasks.workunit.client.1.smithi089.stdout:5/67: fdatasync d5/de/d10/f11 0 2024-08-01T06:55:50.408 INFO:tasks.workunit.client.1.smithi089.stdout:5/68: stat c4 0 2024-08-01T06:55:50.409 INFO:tasks.workunit.client.1.smithi089.stdout:0/147: rmdir d9/d23/d25 39 2024-08-01T06:55:50.411 INFO:tasks.workunit.client.1.smithi089.stdout:7/106: rename d7/d15/l2a to d7/df/d10/l2e 0 2024-08-01T06:55:50.412 INFO:tasks.workunit.client.1.smithi089.stdout:5/69: mkdir d5/de/d10/d16 0 2024-08-01T06:55:50.413 INFO:tasks.workunit.client.1.smithi089.stdout:5/70: truncate d5/de/f14 165034 0 2024-08-01T06:55:50.414 INFO:tasks.workunit.client.1.smithi089.stdout:7/107: write d7/df/d10/f24 [1626579,40733] 0 2024-08-01T06:55:50.414 INFO:tasks.workunit.client.1.smithi089.stdout:7/108: readlink d7/l9 0 2024-08-01T06:55:50.415 INFO:tasks.workunit.client.1.smithi089.stdout:7/109: truncate d7/d1f/f1d 397252 0 2024-08-01T06:55:50.416 INFO:tasks.workunit.client.1.smithi089.stdout:7/110: chown f3 120461 1 2024-08-01T06:55:50.416 INFO:tasks.workunit.client.1.smithi089.stdout:5/71: mkdir d5/de/d17 0 2024-08-01T06:55:50.417 INFO:tasks.workunit.client.1.smithi089.stdout:5/72: chown f0 1943 1 2024-08-01T06:55:50.419 INFO:tasks.workunit.client.1.smithi089.stdout:7/111: getdents d7/d1f 0 2024-08-01T06:55:50.420 INFO:tasks.workunit.client.1.smithi089.stdout:7/112: write d7/d1f/f1d [1368416,61795] 0 2024-08-01T06:55:50.423 INFO:tasks.workunit.client.1.smithi089.stdout:7/113: creat d7/df/f2f x:0 0 0 2024-08-01T06:55:50.430 INFO:tasks.workunit.client.1.smithi089.stdout:7/114: dwrite d7/d15/f1b [0,4194304] 0 2024-08-01T06:55:50.437 INFO:tasks.workunit.client.1.smithi089.stdout:3/58: sync 2024-08-01T06:55:50.437 INFO:tasks.workunit.client.1.smithi089.stdout:6/146: sync 2024-08-01T06:55:50.437 INFO:tasks.workunit.client.1.smithi089.stdout:2/84: sync 2024-08-01T06:55:50.440 INFO:tasks.workunit.client.1.smithi089.stdout:2/85: mknod d7/c1b 0 2024-08-01T06:55:50.440 INFO:tasks.workunit.client.1.smithi089.stdout:2/86: fsync d7/dc/f1a 0 2024-08-01T06:55:50.441 INFO:tasks.workunit.client.1.smithi089.stdout:6/147: creat d2/d11/d1a/f33 x:0 0 0 2024-08-01T06:55:50.441 INFO:tasks.workunit.client.1.smithi089.stdout:3/59: dread f3 [0,4194304] 0 2024-08-01T06:55:50.442 INFO:tasks.workunit.client.1.smithi089.stdout:3/60: chown d7/dd/d10 46478 1 2024-08-01T06:55:50.443 INFO:tasks.workunit.client.1.smithi089.stdout:2/87: symlink d7/d19/l1c 0 2024-08-01T06:55:50.444 INFO:tasks.workunit.client.1.smithi089.stdout:6/148: symlink d2/d11/l34 0 2024-08-01T06:55:50.444 INFO:tasks.workunit.client.1.smithi089.stdout:3/61: fdatasync f3 0 2024-08-01T06:55:50.447 INFO:tasks.workunit.client.1.smithi089.stdout:6/149: dread d2/f24 [0,4194304] 0 2024-08-01T06:55:50.451 INFO:tasks.workunit.client.1.smithi089.stdout:6/150: creat d2/d11/d1a/f35 x:0 0 0 2024-08-01T06:55:50.451 INFO:tasks.workunit.client.1.smithi089.stdout:2/88: dwrite d7/dc/f1a [0,4194304] 0 2024-08-01T06:55:50.453 INFO:tasks.workunit.client.1.smithi089.stdout:6/151: creat d2/d11/d1f/f36 x:0 0 0 2024-08-01T06:55:50.457 INFO:tasks.workunit.client.1.smithi089.stdout:6/152: truncate d2/d11/f1d 1230727 0 2024-08-01T06:55:50.459 INFO:tasks.workunit.client.1.smithi089.stdout:2/89: dwrite f4 [0,4194304] 0 2024-08-01T06:55:50.463 INFO:tasks.workunit.client.1.smithi089.stdout:2/90: write f2 [1307424,44301] 0 2024-08-01T06:55:50.463 INFO:tasks.workunit.client.1.smithi089.stdout:2/91: stat d7/c13 0 2024-08-01T06:55:50.463 INFO:tasks.workunit.client.1.smithi089.stdout:6/153: link d2/cc d2/d30/c37 0 2024-08-01T06:55:50.464 INFO:tasks.workunit.client.1.smithi089.stdout:6/154: write d2/d11/f15 [2354206,53508] 0 2024-08-01T06:55:50.464 INFO:tasks.workunit.client.1.smithi089.stdout:2/92: symlink d7/d19/l1d 0 2024-08-01T06:55:50.468 INFO:tasks.workunit.client.1.smithi089.stdout:6/155: mknod d2/d11/d1a/d1c/c38 0 2024-08-01T06:55:50.469 INFO:tasks.workunit.client.1.smithi089.stdout:2/93: dread f5 [0,4194304] 0 2024-08-01T06:55:50.470 INFO:tasks.workunit.client.1.smithi089.stdout:2/94: write d7/fa [1135523,22355] 0 2024-08-01T06:55:50.473 INFO:tasks.workunit.client.1.smithi089.stdout:6/156: rename d2/c6 to d2/d2e/d2f/c39 0 2024-08-01T06:55:50.473 INFO:tasks.workunit.client.1.smithi089.stdout:2/95: mkdir d7/d19/d1e 0 2024-08-01T06:55:50.474 INFO:tasks.workunit.client.1.smithi089.stdout:6/157: symlink d2/d11/d1f/l3a 0 2024-08-01T06:55:50.477 INFO:tasks.workunit.client.1.smithi089.stdout:6/158: rename d2/d11/c1b to d2/d11/d1a/c3b 0 2024-08-01T06:55:50.480 INFO:tasks.workunit.client.1.smithi089.stdout:6/159: rename d2/d11/d1a/d1c/d32 to d2/d30/d3c 0 2024-08-01T06:55:50.483 INFO:tasks.workunit.client.1.smithi089.stdout:6/160: unlink d2/d30/c37 0 2024-08-01T06:55:50.484 INFO:tasks.workunit.client.1.smithi089.stdout:6/161: mkdir d2/d30/d3c/d3d 0 2024-08-01T06:55:50.485 INFO:tasks.workunit.client.1.smithi089.stdout:6/162: dread - d2/d11/d1f/f23 zero size 2024-08-01T06:55:50.486 INFO:tasks.workunit.client.1.smithi089.stdout:6/163: truncate d2/d11/d1f/f23 559556 0 2024-08-01T06:55:50.490 INFO:tasks.workunit.client.1.smithi089.stdout:6/164: write d2/d11/d1f/f2d [444507,82490] 0 2024-08-01T06:55:50.492 INFO:tasks.workunit.client.1.smithi089.stdout:6/165: fsync d2/d11/d1f/f2d 0 2024-08-01T06:55:50.496 INFO:tasks.workunit.client.1.smithi089.stdout:6/166: mkdir d2/d11/d3e 0 2024-08-01T06:55:50.497 INFO:tasks.workunit.client.1.smithi089.stdout:6/167: write d2/d11/d1f/f2d [292160,128880] 0 2024-08-01T06:55:50.505 INFO:tasks.workunit.client.1.smithi089.stdout:6/168: mknod d2/d2e/d2f/c3f 0 2024-08-01T06:55:50.514 INFO:tasks.workunit.client.1.smithi089.stdout:6/169: getdents d2/d2e/d2f/d31 0 2024-08-01T06:55:50.519 INFO:tasks.workunit.client.1.smithi089.stdout:6/170: mkdir d2/d11/d1a/d1c/d40 0 2024-08-01T06:55:50.523 INFO:tasks.workunit.client.1.smithi089.stdout:0/148: truncate d9/f18 146300 0 2024-08-01T06:55:50.524 INFO:tasks.workunit.client.1.smithi089.stdout:6/171: unlink f1 0 2024-08-01T06:55:50.527 INFO:tasks.workunit.client.1.smithi089.stdout:6/172: unlink d2/d11/d1f/l3a 0 2024-08-01T06:55:50.528 INFO:tasks.workunit.client.1.smithi089.stdout:0/149: mknod d9/d23/c31 0 2024-08-01T06:55:50.528 INFO:tasks.workunit.client.1.smithi089.stdout:0/150: chown d9/f11 6980 1 2024-08-01T06:55:50.532 INFO:tasks.workunit.client.1.smithi089.stdout:6/173: creat d2/d2e/d2f/d31/f41 x:0 0 0 2024-08-01T06:55:50.533 INFO:tasks.workunit.client.1.smithi089.stdout:0/151: creat d9/d22/d2b/f32 x:0 0 0 2024-08-01T06:55:50.534 INFO:tasks.workunit.client.1.smithi089.stdout:5/73: dwrite d5/de/df/f12 [4194304,4194304] 0 2024-08-01T06:55:50.535 INFO:tasks.workunit.client.1.smithi089.stdout:5/74: stat d5/de 0 2024-08-01T06:55:50.536 INFO:tasks.workunit.client.1.smithi089.stdout:6/174: dread d2/fe [0,4194304] 0 2024-08-01T06:55:50.537 INFO:tasks.workunit.client.1.smithi089.stdout:6/175: dread - d2/d11/d1a/f33 zero size 2024-08-01T06:55:50.565 INFO:tasks.workunit.client.1.smithi089.stdout:8/112: sync 2024-08-01T06:55:50.565 INFO:tasks.workunit.client.1.smithi089.stdout:0/152: creat d9/f33 x:0 0 0 2024-08-01T06:55:50.566 INFO:tasks.workunit.client.1.smithi089.stdout:3/62: truncate f3 5141907 0 2024-08-01T06:55:50.568 INFO:tasks.workunit.client.1.smithi089.stdout:5/75: link d5/de/d10/f11 d5/de/d10/d16/f18 0 2024-08-01T06:55:50.570 INFO:tasks.workunit.client.1.smithi089.stdout:0/153: creat d9/d22/f34 x:0 0 0 2024-08-01T06:55:50.571 INFO:tasks.workunit.client.1.smithi089.stdout:0/154: fdatasync d9/fa 0 2024-08-01T06:55:50.572 INFO:tasks.workunit.client.1.smithi089.stdout:8/113: dwrite d5/ff [0,4194304] 0 2024-08-01T06:55:50.574 INFO:tasks.workunit.client.1.smithi089.stdout:5/76: creat d5/de/d10/f19 x:0 0 0 2024-08-01T06:55:50.576 INFO:tasks.workunit.client.1.smithi089.stdout:5/77: readlink d5/de/d10/l15 0 2024-08-01T06:55:50.579 INFO:tasks.workunit.client.1.smithi089.stdout:0/155: dwrite d9/f13 [0,4194304] 0 2024-08-01T06:55:50.585 INFO:tasks.workunit.client.1.smithi089.stdout:0/156: rename d9/d1a/l24 to d9/d22/d2b/l35 0 2024-08-01T06:55:50.586 INFO:tasks.workunit.client.1.smithi089.stdout:8/114: creat d5/dc/d12/f24 x:0 0 0 2024-08-01T06:55:50.587 INFO:tasks.workunit.client.1.smithi089.stdout:8/115: write d5/ff [3366578,86676] 0 2024-08-01T06:55:50.591 INFO:tasks.workunit.client.1.smithi089.stdout:5/78: symlink d5/de/d17/l1a 0 2024-08-01T06:55:50.593 INFO:tasks.workunit.client.1.smithi089.stdout:8/116: dwrite d5/dc/f11 [0,4194304] 0 2024-08-01T06:55:50.594 INFO:tasks.workunit.client.1.smithi089.stdout:8/117: fdatasync d5/f1a 0 2024-08-01T06:55:50.595 INFO:tasks.workunit.client.1.smithi089.stdout:8/118: truncate f2 5219131 0 2024-08-01T06:55:50.596 INFO:tasks.workunit.client.1.smithi089.stdout:8/119: dread - d5/d15/f1f zero size 2024-08-01T06:55:50.603 INFO:tasks.workunit.client.1.smithi089.stdout:8/120: unlink d5/dc/d12/f24 0 2024-08-01T06:55:50.606 INFO:tasks.workunit.client.1.smithi089.stdout:5/79: mkdir d5/de/d10/d16/d1b 0 2024-08-01T06:55:50.614 INFO:tasks.workunit.client.1.smithi089.stdout:5/80: write d5/de/d10/f11 [231637,36942] 0 2024-08-01T06:55:50.618 INFO:tasks.workunit.client.1.smithi089.stdout:5/81: creat d5/de/d10/f1c x:0 0 0 2024-08-01T06:55:50.618 INFO:tasks.workunit.client.1.smithi089.stdout:5/82: dread - d5/de/d10/f19 zero size 2024-08-01T06:55:50.620 INFO:tasks.workunit.client.1.smithi089.stdout:9/110: sync 2024-08-01T06:55:50.620 INFO:tasks.workunit.client.1.smithi089.stdout:4/111: sync 2024-08-01T06:55:50.620 INFO:tasks.workunit.client.1.smithi089.stdout:1/119: sync 2024-08-01T06:55:50.621 INFO:tasks.workunit.client.1.smithi089.stdout:5/83: creat d5/de/df/f1d x:0 0 0 2024-08-01T06:55:50.621 INFO:tasks.workunit.client.1.smithi089.stdout:5/84: chown d5/de/d10/f19 1881244 1 2024-08-01T06:55:50.622 INFO:tasks.workunit.client.1.smithi089.stdout:5/85: chown c4 347654377 1 2024-08-01T06:55:50.622 INFO:tasks.workunit.client.1.smithi089.stdout:1/120: mknod d0/d9/d1e/c27 0 2024-08-01T06:55:50.628 INFO:tasks.workunit.client.1.smithi089.stdout:5/86: rename c4 to d5/de/d17/c1e 0 2024-08-01T06:55:50.630 INFO:tasks.workunit.client.1.smithi089.stdout:9/111: getdents d18/d22 0 2024-08-01T06:55:50.632 INFO:tasks.workunit.client.1.smithi089.stdout:4/112: creat d3/f24 x:0 0 0 2024-08-01T06:55:50.632 INFO:tasks.workunit.client.1.smithi089.stdout:5/87: symlink d5/de/d17/l1f 0 2024-08-01T06:55:50.633 INFO:tasks.workunit.client.1.smithi089.stdout:1/121: truncate d0/f19 2585240 0 2024-08-01T06:55:50.636 INFO:tasks.workunit.client.1.smithi089.stdout:0/157: getdents d9 0 2024-08-01T06:55:50.637 INFO:tasks.workunit.client.1.smithi089.stdout:1/122: rmdir d0/d9/d1e 39 2024-08-01T06:55:50.642 INFO:tasks.workunit.client.1.smithi089.stdout:3/63: dread f3 [0,4194304] 0 2024-08-01T06:55:50.642 INFO:tasks.workunit.client.1.smithi089.stdout:9/112: rename c7 to d18/d22/c24 0 2024-08-01T06:55:50.643 INFO:tasks.workunit.client.1.smithi089.stdout:1/123: dwrite d0/f6 [8388608,4194304] 0 2024-08-01T06:55:50.644 INFO:tasks.workunit.client.1.smithi089.stdout:3/64: dread f3 [4194304,4194304] 0 2024-08-01T06:55:50.651 INFO:tasks.workunit.client.1.smithi089.stdout:4/113: rename d3/f12 to d3/d1e/f25 0 2024-08-01T06:55:50.652 INFO:tasks.workunit.client.1.smithi089.stdout:1/124: unlink d0/d9/c1f 0 2024-08-01T06:55:50.653 INFO:tasks.workunit.client.1.smithi089.stdout:1/125: read d0/f6 [5027203,51062] 0 2024-08-01T06:55:50.653 INFO:tasks.workunit.client.1.smithi089.stdout:9/113: mknod d18/d22/c25 0 2024-08-01T06:55:50.657 INFO:tasks.workunit.client.1.smithi089.stdout:6/176: write d2/d11/f1d [2148261,35441] 0 2024-08-01T06:55:50.661 INFO:tasks.workunit.client.1.smithi089.stdout:4/114: dwrite d3/f24 [0,4194304] 0 2024-08-01T06:55:50.666 INFO:tasks.workunit.client.1.smithi089.stdout:1/126: dwrite d0/f23 [0,4194304] 0 2024-08-01T06:55:50.670 INFO:tasks.workunit.client.1.smithi089.stdout:6/177: chown d2/d11/d1a/c3b 260708429 1 2024-08-01T06:55:50.672 INFO:tasks.workunit.client.1.smithi089.stdout:9/114: dwrite d18/f1b [0,4194304] 0 2024-08-01T06:55:50.674 INFO:tasks.workunit.client.1.smithi089.stdout:9/115: dread - f8 zero size 2024-08-01T06:55:50.676 INFO:tasks.workunit.client.1.smithi089.stdout:9/116: read - d18/f20 zero size 2024-08-01T06:55:50.677 INFO:tasks.workunit.client.1.smithi089.stdout:6/178: mknod d2/d30/c42 0 2024-08-01T06:55:50.677 INFO:tasks.workunit.client.1.smithi089.stdout:1/127: dwrite d0/f11 [0,4194304] 0 2024-08-01T06:55:50.678 INFO:tasks.workunit.client.1.smithi089.stdout:8/121: truncate d5/d15/f1c 2030075 0 2024-08-01T06:55:50.679 INFO:tasks.workunit.client.1.smithi089.stdout:7/115: sync 2024-08-01T06:55:50.680 INFO:tasks.workunit.client.1.smithi089.stdout:9/117: dread f17 [0,4194304] 0 2024-08-01T06:55:50.681 INFO:tasks.workunit.client.1.smithi089.stdout:6/179: write d2/f5 [2686469,57336] 0 2024-08-01T06:55:50.685 INFO:tasks.workunit.client.1.smithi089.stdout:2/96: sync 2024-08-01T06:55:50.687 INFO:tasks.workunit.client.1.smithi089.stdout:1/128: dread d0/f20 [0,4194304] 0 2024-08-01T06:55:50.687 INFO:tasks.workunit.client.1.smithi089.stdout:2/97: chown d7/dc/cd 500639 1 2024-08-01T06:55:50.689 INFO:tasks.workunit.client.1.smithi089.stdout:8/122: dwrite f2 [0,4194304] 0 2024-08-01T06:55:50.690 INFO:tasks.workunit.client.1.smithi089.stdout:9/118: symlink d18/d22/l26 0 2024-08-01T06:55:50.692 INFO:tasks.workunit.client.1.smithi089.stdout:6/180: mknod d2/d2e/d2f/d31/c43 0 2024-08-01T06:55:50.692 INFO:tasks.workunit.client.1.smithi089.stdout:9/119: readlink l6 0 2024-08-01T06:55:50.694 INFO:tasks.workunit.client.1.smithi089.stdout:6/181: readlink d2/d11/l16 0 2024-08-01T06:55:50.695 INFO:tasks.workunit.client.1.smithi089.stdout:1/129: mknod d0/d9/d15/c28 0 2024-08-01T06:55:50.698 INFO:tasks.workunit.client.1.smithi089.stdout:6/182: stat d2/d11/d1a/f33 0 2024-08-01T06:55:50.700 INFO:tasks.workunit.client.1.smithi089.stdout:5/88: truncate d5/de/d10/f11 81794 0 2024-08-01T06:55:50.700 INFO:tasks.workunit.client.1.smithi089.stdout:3/65: dwrite f3 [0,4194304] 0 2024-08-01T06:55:50.701 INFO:tasks.workunit.client.1.smithi089.stdout:2/98: dread f4 [0,4194304] 0 2024-08-01T06:55:50.704 INFO:tasks.workunit.client.1.smithi089.stdout:0/158: dwrite d9/fd [0,4194304] 0 2024-08-01T06:55:50.706 INFO:tasks.workunit.client.1.smithi089.stdout:5/89: write d5/de/d10/f19 [614329,9344] 0 2024-08-01T06:55:50.706 INFO:tasks.workunit.client.1.smithi089.stdout:6/183: rmdir d2/d2e/d2f 39 2024-08-01T06:55:50.707 INFO:tasks.workunit.client.1.smithi089.stdout:6/184: readlink d2/d11/d1f/l22 0 2024-08-01T06:55:50.708 INFO:tasks.workunit.client.1.smithi089.stdout:6/185: stat d2/d30 0 2024-08-01T06:55:50.708 INFO:tasks.workunit.client.1.smithi089.stdout:5/90: write d5/de/d10/f1c [74090,23633] 0 2024-08-01T06:55:50.711 INFO:tasks.workunit.client.1.smithi089.stdout:2/99: mkdir d7/d1f 0 2024-08-01T06:55:50.714 INFO:tasks.workunit.client.1.smithi089.stdout:1/130: rename d0/l5 to d0/d9/d15/l29 0 2024-08-01T06:55:50.716 INFO:tasks.workunit.client.1.smithi089.stdout:0/159: creat d9/d23/d26/d2e/f36 x:0 0 0 2024-08-01T06:55:50.721 INFO:tasks.workunit.client.1.smithi089.stdout:4/115: truncate d3/db/f10 2550674 0 2024-08-01T06:55:50.722 INFO:tasks.workunit.client.1.smithi089.stdout:3/66: dwrite f3 [0,4194304] 0 2024-08-01T06:55:50.722 INFO:tasks.workunit.client.1.smithi089.stdout:6/186: dwrite d2/f5 [0,4194304] 0 2024-08-01T06:55:50.723 INFO:tasks.workunit.client.1.smithi089.stdout:0/160: truncate d9/f14 5169784 0 2024-08-01T06:55:50.726 INFO:tasks.workunit.client.1.smithi089.stdout:9/120: dread f5 [0,4194304] 0 2024-08-01T06:55:50.726 INFO:tasks.workunit.client.1.smithi089.stdout:8/123: rmdir d5/d15 39 2024-08-01T06:55:50.726 INFO:tasks.workunit.client.1.smithi089.stdout:2/100: dwrite f2 [0,4194304] 0 2024-08-01T06:55:50.727 INFO:tasks.workunit.client.1.smithi089.stdout:0/161: write d9/fd [367298,56082] 0 2024-08-01T06:55:50.731 INFO:tasks.workunit.client.1.smithi089.stdout:3/67: symlink d7/l11 0 2024-08-01T06:55:50.734 INFO:tasks.workunit.client.1.smithi089.stdout:9/121: symlink d18/d22/l27 0 2024-08-01T06:55:50.736 INFO:tasks.workunit.client.1.smithi089.stdout:8/124: rmdir d5/dc/d12 39 2024-08-01T06:55:50.738 INFO:tasks.workunit.client.1.smithi089.stdout:8/125: write d5/dc/f9 [1725532,31127] 0 2024-08-01T06:55:50.739 INFO:tasks.workunit.client.1.smithi089.stdout:4/116: mkdir d3/d1e/d21/d26 0 2024-08-01T06:55:50.739 INFO:tasks.workunit.client.1.smithi089.stdout:4/117: chown d3/d1f 50 1 2024-08-01T06:55:50.741 INFO:tasks.workunit.client.1.smithi089.stdout:4/118: chown d3/db/de/l19 248 1 2024-08-01T06:55:50.742 INFO:tasks.workunit.client.1.smithi089.stdout:6/187: creat d2/d2e/d2f/d31/f44 x:0 0 0 2024-08-01T06:55:50.743 INFO:tasks.workunit.client.1.smithi089.stdout:9/122: creat d18/d22/f28 x:0 0 0 2024-08-01T06:55:50.746 INFO:tasks.workunit.client.1.smithi089.stdout:4/119: dread d3/db/d16/f18 [0,4194304] 0 2024-08-01T06:55:50.746 INFO:tasks.workunit.client.1.smithi089.stdout:1/131: fsync d0/f19 0 2024-08-01T06:55:50.748 INFO:tasks.workunit.client.1.smithi089.stdout:2/101: creat d7/d1f/f20 x:0 0 0 2024-08-01T06:55:50.751 INFO:tasks.workunit.client.1.smithi089.stdout:0/162: rename d9/d23/c31 to d9/d23/d25/c37 0 2024-08-01T06:55:50.752 INFO:tasks.workunit.client.1.smithi089.stdout:3/68: mkdir d7/dd/d10/d12 0 2024-08-01T06:55:50.752 INFO:tasks.workunit.client.1.smithi089.stdout:1/132: dwrite d0/f13 [0,4194304] 0 2024-08-01T06:55:50.753 INFO:tasks.workunit.client.1.smithi089.stdout:0/163: chown d9/d23/d26/l2f 52971857 1 2024-08-01T06:55:50.754 INFO:tasks.workunit.client.1.smithi089.stdout:0/164: readlink d9/l19 0 2024-08-01T06:55:50.756 INFO:tasks.workunit.client.1.smithi089.stdout:9/123: mknod d18/c29 0 2024-08-01T06:55:50.760 INFO:tasks.workunit.client.1.smithi089.stdout:3/69: dwrite f3 [0,4194304] 0 2024-08-01T06:55:50.761 INFO:tasks.workunit.client.1.smithi089.stdout:3/70: write f3 [4172314,15589] 0 2024-08-01T06:55:50.766 INFO:tasks.workunit.client.1.smithi089.stdout:1/133: mknod d0/c2a 0 2024-08-01T06:55:50.770 INFO:tasks.workunit.client.1.smithi089.stdout:9/124: creat d18/f2a x:0 0 0 2024-08-01T06:55:50.773 INFO:tasks.workunit.client.1.smithi089.stdout:5/91: dwrite d5/de/d10/d16/f18 [0,4194304] 0 2024-08-01T06:55:50.782 INFO:tasks.workunit.client.1.smithi089.stdout:1/134: write d0/f20 [2185272,53761] 0 2024-08-01T06:55:50.784 INFO:tasks.workunit.client.1.smithi089.stdout:9/125: truncate fe 175695 0 2024-08-01T06:55:50.786 INFO:tasks.workunit.client.1.smithi089.stdout:3/71: fsync f3 0 2024-08-01T06:55:50.786 INFO:tasks.workunit.client.1.smithi089.stdout:1/135: fdatasync d0/f20 0 2024-08-01T06:55:50.787 INFO:tasks.workunit.client.1.smithi089.stdout:1/136: write d0/f24 [93191,115511] 0 2024-08-01T06:55:50.787 INFO:tasks.workunit.client.1.smithi089.stdout:0/165: link d9/d23/f27 d9/d1a/f38 0 2024-08-01T06:55:50.788 INFO:tasks.workunit.client.1.smithi089.stdout:0/166: readlink d9/l1b 0 2024-08-01T06:55:50.788 INFO:tasks.workunit.client.1.smithi089.stdout:1/137: fdatasync d0/f13 0 2024-08-01T06:55:50.789 INFO:tasks.workunit.client.1.smithi089.stdout:0/167: dread - d9/d22/f34 zero size 2024-08-01T06:55:50.789 INFO:tasks.workunit.client.1.smithi089.stdout:1/138: chown d0/f11 2019 1 2024-08-01T06:55:50.790 INFO:tasks.workunit.client.1.smithi089.stdout:5/92: unlink d5/de/d10/d16/f18 0 2024-08-01T06:55:50.790 INFO:tasks.workunit.client.1.smithi089.stdout:4/120: link d3/db/l1b d3/db/l27 0 2024-08-01T06:55:50.791 INFO:tasks.workunit.client.1.smithi089.stdout:4/121: fdatasync d3/db/d16/f1a 0 2024-08-01T06:55:50.793 INFO:tasks.workunit.client.1.smithi089.stdout:6/188: truncate d2/d11/f17 1250415 0 2024-08-01T06:55:50.793 INFO:tasks.workunit.client.1.smithi089.stdout:9/126: symlink d18/l2b 0 2024-08-01T06:55:50.795 INFO:tasks.workunit.client.1.smithi089.stdout:5/93: dwrite f0 [0,4194304] 0 2024-08-01T06:55:50.797 INFO:tasks.workunit.client.1.smithi089.stdout:5/94: write d5/de/df/f12 [2265920,72066] 0 2024-08-01T06:55:50.798 INFO:tasks.workunit.client.1.smithi089.stdout:0/168: readlink d9/l10 0 2024-08-01T06:55:50.800 INFO:tasks.workunit.client.1.smithi089.stdout:2/102: truncate f4 823603 0 2024-08-01T06:55:50.804 INFO:tasks.workunit.client.1.smithi089.stdout:5/95: dwrite d5/de/df/f1d [0,4194304] 0 2024-08-01T06:55:50.804 INFO:tasks.workunit.client.1.smithi089.stdout:4/122: creat d3/d17/f28 x:0 0 0 2024-08-01T06:55:50.805 INFO:tasks.workunit.client.1.smithi089.stdout:6/189: creat d2/d11/d1f/f45 x:0 0 0 2024-08-01T06:55:50.806 INFO:tasks.workunit.client.1.smithi089.stdout:3/72: getdents d7/dd/d10/d12 0 2024-08-01T06:55:50.809 INFO:tasks.workunit.client.1.smithi089.stdout:9/127: symlink d18/l2c 0 2024-08-01T06:55:50.814 INFO:tasks.workunit.client.1.smithi089.stdout:1/139: truncate d0/f20 2891208 0 2024-08-01T06:55:50.815 INFO:tasks.workunit.client.1.smithi089.stdout:0/169: mknod d9/d1a/c39 0 2024-08-01T06:55:50.816 INFO:tasks.workunit.client.1.smithi089.stdout:0/170: fsync d9/d23/d25/f2a 0 2024-08-01T06:55:50.821 INFO:tasks.workunit.client.1.smithi089.stdout:6/190: mkdir d2/d11/d1f/d46 0 2024-08-01T06:55:50.822 INFO:tasks.workunit.client.1.smithi089.stdout:6/191: write d2/d11/f15 [4200590,18404] 0 2024-08-01T06:55:50.823 INFO:tasks.workunit.client.1.smithi089.stdout:3/73: rename f3 to d7/dd/d10/f13 0 2024-08-01T06:55:50.823 INFO:tasks.workunit.client.1.smithi089.stdout:3/74: readlink l4 0 2024-08-01T06:55:50.829 INFO:tasks.workunit.client.1.smithi089.stdout:4/123: mkdir d3/d29 0 2024-08-01T06:55:50.831 INFO:tasks.workunit.client.1.smithi089.stdout:5/96: symlink d5/de/d10/d16/d1b/l20 0 2024-08-01T06:55:50.831 INFO:tasks.workunit.client.1.smithi089.stdout:9/128: rmdir d18 39 2024-08-01T06:55:50.836 INFO:tasks.workunit.client.1.smithi089.stdout:1/140: dread d0/f6 [0,4194304] 0 2024-08-01T06:55:50.838 INFO:tasks.workunit.client.1.smithi089.stdout:9/129: stat d18/d22/l26 0 2024-08-01T06:55:50.839 INFO:tasks.workunit.client.1.smithi089.stdout:5/97: symlink d5/de/d17/l21 0 2024-08-01T06:55:50.842 INFO:tasks.workunit.client.1.smithi089.stdout:2/103: chown f4 31656 1 2024-08-01T06:55:50.842 INFO:tasks.workunit.client.1.smithi089.stdout:5/98: dread d5/de/f14 [0,4194304] 0 2024-08-01T06:55:50.843 INFO:tasks.workunit.client.1.smithi089.stdout:1/141: dwrite d0/f19 [0,4194304] 0 2024-08-01T06:55:50.844 INFO:tasks.workunit.client.1.smithi089.stdout:1/142: write d0/f19 [1260229,80894] 0 2024-08-01T06:55:50.847 INFO:tasks.workunit.client.1.smithi089.stdout:9/130: creat d18/f2d x:0 0 0 2024-08-01T06:55:50.848 INFO:tasks.workunit.client.1.smithi089.stdout:9/131: write f12 [1737949,121529] 0 2024-08-01T06:55:50.851 INFO:tasks.workunit.client.1.smithi089.stdout:3/75: link c6 d7/dd/d10/c14 0 2024-08-01T06:55:50.854 INFO:tasks.workunit.client.1.smithi089.stdout:0/171: getdents d9/d1a 0 2024-08-01T06:55:50.854 INFO:tasks.workunit.client.1.smithi089.stdout:2/104: fsync f5 0 2024-08-01T06:55:50.855 INFO:tasks.workunit.client.1.smithi089.stdout:5/99: creat d5/de/d10/d16/d1b/f22 x:0 0 0 2024-08-01T06:55:50.856 INFO:tasks.workunit.client.1.smithi089.stdout:1/143: mkdir d0/d9/d15/d2b 0 2024-08-01T06:55:50.857 INFO:tasks.workunit.client.1.smithi089.stdout:1/144: write d0/f13 [2442834,39843] 0 2024-08-01T06:55:50.864 INFO:tasks.workunit.client.1.smithi089.stdout:4/124: truncate d3/d1e/f25 43537 0 2024-08-01T06:55:50.865 INFO:tasks.workunit.client.1.smithi089.stdout:2/105: mknod d7/dc/c21 0 2024-08-01T06:55:50.867 INFO:tasks.workunit.client.1.smithi089.stdout:7/116: sync 2024-08-01T06:55:50.868 INFO:tasks.workunit.client.1.smithi089.stdout:3/76: dwrite d7/dd/d10/f13 [4194304,4194304] 0 2024-08-01T06:55:50.869 INFO:tasks.workunit.client.1.smithi089.stdout:9/132: truncate fe 1100867 0 2024-08-01T06:55:50.870 INFO:tasks.workunit.client.1.smithi089.stdout:9/133: read f13 [1622543,62040] 0 2024-08-01T06:55:50.871 INFO:tasks.workunit.client.1.smithi089.stdout:9/134: dread - d18/f2a zero size 2024-08-01T06:55:50.871 INFO:tasks.workunit.client.1.smithi089.stdout:2/106: symlink d7/d19/l22 0 2024-08-01T06:55:50.872 INFO:tasks.workunit.client.1.smithi089.stdout:2/107: chown d7/dc/cd 91 1 2024-08-01T06:55:50.875 INFO:tasks.workunit.client.1.smithi089.stdout:1/145: mknod d0/d9/d1e/c2c 0 2024-08-01T06:55:50.877 INFO:tasks.workunit.client.1.smithi089.stdout:7/117: mkdir d7/d1f/d30 0 2024-08-01T06:55:50.880 INFO:tasks.workunit.client.1.smithi089.stdout:1/146: dread d0/f6 [8388608,4194304] 0 2024-08-01T06:55:50.882 INFO:tasks.workunit.client.1.smithi089.stdout:4/125: creat d3/d29/f2a x:0 0 0 2024-08-01T06:55:50.884 INFO:tasks.workunit.client.1.smithi089.stdout:6/192: write d2/d11/f17 [646567,5679] 0 2024-08-01T06:55:50.885 INFO:tasks.workunit.client.1.smithi089.stdout:0/172: dwrite d9/d1a/f38 [0,4194304] 0 2024-08-01T06:55:50.886 INFO:tasks.workunit.client.1.smithi089.stdout:0/173: write d9/d23/d26/f2c [1961106,58337] 0 2024-08-01T06:55:50.887 INFO:tasks.workunit.client.1.smithi089.stdout:7/118: mkdir d7/df/d10/d31 0 2024-08-01T06:55:50.888 INFO:tasks.workunit.client.1.smithi089.stdout:5/100: truncate d5/de/df/f1d 2445074 0 2024-08-01T06:55:50.889 INFO:tasks.workunit.client.1.smithi089.stdout:5/101: chown d5/d13 3446 1 2024-08-01T06:55:50.889 INFO:tasks.workunit.client.1.smithi089.stdout:0/174: dread - d9/d22/d2b/f32 zero size 2024-08-01T06:55:50.891 INFO:tasks.workunit.client.1.smithi089.stdout:1/147: mkdir d0/d9/d15/d2d 0 2024-08-01T06:55:50.892 INFO:tasks.workunit.client.1.smithi089.stdout:3/77: fdatasync d7/dd/d10/f13 0 2024-08-01T06:55:50.894 INFO:tasks.workunit.client.1.smithi089.stdout:2/108: link d7/dc/f15 d7/f23 0 2024-08-01T06:55:50.895 INFO:tasks.workunit.client.1.smithi089.stdout:7/119: dwrite f6 [0,4194304] 0 2024-08-01T06:55:50.895 INFO:tasks.workunit.client.1.smithi089.stdout:2/109: write d7/f10 [126424,96190] 0 2024-08-01T06:55:50.897 INFO:tasks.workunit.client.1.smithi089.stdout:1/148: dread d0/f6 [0,4194304] 0 2024-08-01T06:55:50.899 INFO:tasks.workunit.client.1.smithi089.stdout:6/193: unlink d2/d11/d1f/f23 0 2024-08-01T06:55:50.899 INFO:tasks.workunit.client.1.smithi089.stdout:3/78: dread d7/dd/d10/f13 [0,4194304] 0 2024-08-01T06:55:50.905 INFO:tasks.workunit.client.1.smithi089.stdout:0/175: readlink d9/d22/d2b/l35 0 2024-08-01T06:55:50.905 INFO:tasks.workunit.client.1.smithi089.stdout:0/176: readlink d9/l15 0 2024-08-01T06:55:50.907 INFO:tasks.workunit.client.1.smithi089.stdout:6/194: dwrite d2/d2e/d2f/d31/f41 [0,4194304] 0 2024-08-01T06:55:50.908 INFO:tasks.workunit.client.1.smithi089.stdout:4/126: mkdir d3/d1e/d21/d26/d2b 0 2024-08-01T06:55:50.908 INFO:tasks.workunit.client.1.smithi089.stdout:5/102: dread d5/de/d10/f11 [0,4194304] 0 2024-08-01T06:55:50.909 INFO:tasks.workunit.client.1.smithi089.stdout:6/195: chown d2/d11/d1f/f2d 52 1 2024-08-01T06:55:50.909 INFO:tasks.workunit.client.1.smithi089.stdout:4/127: chown d3/db/d16/f18 13 1 2024-08-01T06:55:50.910 INFO:tasks.workunit.client.1.smithi089.stdout:7/120: symlink d7/df/l32 0 2024-08-01T06:55:50.912 INFO:tasks.workunit.client.1.smithi089.stdout:1/149: creat d0/f2e x:0 0 0 2024-08-01T06:55:50.913 INFO:tasks.workunit.client.1.smithi089.stdout:3/79: unlink d7/l11 0 2024-08-01T06:55:50.914 INFO:tasks.workunit.client.1.smithi089.stdout:3/80: stat d7/dd/d10/d12 0 2024-08-01T06:55:50.915 INFO:tasks.workunit.client.1.smithi089.stdout:0/177: mkdir d9/d23/d26/d2e/d3a 0 2024-08-01T06:55:50.916 INFO:tasks.workunit.client.1.smithi089.stdout:0/178: stat d9/ce 0 2024-08-01T06:55:50.918 INFO:tasks.workunit.client.1.smithi089.stdout:5/103: mknod d5/de/d10/d16/c23 0 2024-08-01T06:55:50.921 INFO:tasks.workunit.client.1.smithi089.stdout:4/128: mknod d3/d17/c2c 0 2024-08-01T06:55:50.921 INFO:tasks.workunit.client.1.smithi089.stdout:4/129: readlink d3/db/de/l19 0 2024-08-01T06:55:50.922 INFO:tasks.workunit.client.1.smithi089.stdout:6/196: dread d2/d11/f1d [0,4194304] 0 2024-08-01T06:55:50.923 INFO:tasks.workunit.client.1.smithi089.stdout:6/197: write d2/d2e/d2f/d31/f44 [752938,107911] 0 2024-08-01T06:55:50.927 INFO:tasks.workunit.client.1.smithi089.stdout:3/81: creat d7/dd/f15 x:0 0 0 2024-08-01T06:55:50.927 INFO:tasks.workunit.client.1.smithi089.stdout:3/82: write d7/dd/f15 [655036,73229] 0 2024-08-01T06:55:50.933 INFO:tasks.workunit.client.1.smithi089.stdout:0/179: dwrite d9/d22/f29 [0,4194304] 0 2024-08-01T06:55:50.935 INFO:tasks.workunit.client.1.smithi089.stdout:6/198: symlink d2/d11/l47 0 2024-08-01T06:55:50.937 INFO:tasks.workunit.client.1.smithi089.stdout:3/83: unlink d7/dd/le 0 2024-08-01T06:55:50.938 INFO:tasks.workunit.client.1.smithi089.stdout:2/110: write f4 [1146916,78671] 0 2024-08-01T06:55:50.940 INFO:tasks.workunit.client.1.smithi089.stdout:0/180: dwrite d9/fa [0,4194304] 0 2024-08-01T06:55:50.941 INFO:tasks.workunit.client.1.smithi089.stdout:2/111: write f4 [1867027,42609] 0 2024-08-01T06:55:50.942 INFO:tasks.workunit.client.1.smithi089.stdout:1/150: link d0/d9/d1e/c2c d0/d9/d15/d2b/c2f 0 2024-08-01T06:55:50.942 INFO:tasks.workunit.client.1.smithi089.stdout:2/112: readlink d7/d19/l1d 0 2024-08-01T06:55:50.943 INFO:tasks.workunit.client.1.smithi089.stdout:0/181: dread - d9/d23/d26/d2e/f30 zero size 2024-08-01T06:55:50.947 INFO:tasks.workunit.client.1.smithi089.stdout:6/199: creat d2/d11/d1a/d1c/d40/f48 x:0 0 0 2024-08-01T06:55:50.949 INFO:tasks.workunit.client.1.smithi089.stdout:7/121: write d7/fb [987953,42639] 0 2024-08-01T06:55:50.950 INFO:tasks.workunit.client.1.smithi089.stdout:3/84: dwrite d7/dd/d10/f13 [4194304,4194304] 0 2024-08-01T06:55:50.951 INFO:tasks.workunit.client.1.smithi089.stdout:6/200: dread - d2/d11/d1a/f35 zero size 2024-08-01T06:55:50.952 INFO:tasks.workunit.client.1.smithi089.stdout:2/113: mknod d7/dc/c24 0 2024-08-01T06:55:50.954 INFO:tasks.workunit.client.1.smithi089.stdout:3/85: write d7/dd/d10/f13 [8970777,68420] 0 2024-08-01T06:55:50.955 INFO:tasks.workunit.client.1.smithi089.stdout:1/151: creat d0/d9/f30 x:0 0 0 2024-08-01T06:55:50.957 INFO:tasks.workunit.client.1.smithi089.stdout:7/122: mknod d7/df/d10/c33 0 2024-08-01T06:55:50.957 INFO:tasks.workunit.client.1.smithi089.stdout:0/182: dwrite d9/f13 [0,4194304] 0 2024-08-01T06:55:50.957 INFO:tasks.workunit.client.1.smithi089.stdout:1/152: read d0/f13 [4010726,92637] 0 2024-08-01T06:55:50.958 INFO:tasks.workunit.client.1.smithi089.stdout:0/183: write d9/ff [3188441,92957] 0 2024-08-01T06:55:50.959 INFO:tasks.workunit.client.1.smithi089.stdout:0/184: chown d9 7 1 2024-08-01T06:55:50.959 INFO:tasks.workunit.client.1.smithi089.stdout:0/185: chown d9/l19 0 1 2024-08-01T06:55:50.960 INFO:tasks.workunit.client.1.smithi089.stdout:5/104: truncate d5/de/df/f1d 2950740 0 2024-08-01T06:55:50.963 INFO:tasks.workunit.client.1.smithi089.stdout:3/86: symlink d7/dd/d10/l16 0 2024-08-01T06:55:50.967 INFO:tasks.workunit.client.1.smithi089.stdout:5/105: dread d5/de/d10/f19 [0,4194304] 0 2024-08-01T06:55:50.968 INFO:tasks.workunit.client.1.smithi089.stdout:7/123: creat d7/df/d10/f34 x:0 0 0 2024-08-01T06:55:50.969 INFO:tasks.workunit.client.1.smithi089.stdout:7/124: write d7/fb [412699,112372] 0 2024-08-01T06:55:50.970 INFO:tasks.workunit.client.1.smithi089.stdout:0/186: unlink d9/f14 0 2024-08-01T06:55:50.973 INFO:tasks.workunit.client.1.smithi089.stdout:3/87: chown d7/l9 6665453 1 2024-08-01T06:55:50.981 INFO:tasks.workunit.client.1.smithi089.stdout:3/88: dwrite d7/dd/f15 [0,4194304] 0 2024-08-01T06:55:50.981 INFO:tasks.workunit.client.1.smithi089.stdout:0/187: symlink d9/d22/l3b 0 2024-08-01T06:55:50.984 INFO:tasks.workunit.client.1.smithi089.stdout:6/201: link d2/c25 d2/d11/d1f/c49 0 2024-08-01T06:55:50.986 INFO:tasks.workunit.client.1.smithi089.stdout:6/202: chown d2/d11/d1f/f2d 6596 1 2024-08-01T06:55:50.987 INFO:tasks.workunit.client.1.smithi089.stdout:2/114: getdents d7 0 2024-08-01T06:55:50.989 INFO:tasks.workunit.client.1.smithi089.stdout:7/125: getdents d7/d1f/d30 0 2024-08-01T06:55:50.990 INFO:tasks.workunit.client.1.smithi089.stdout:3/89: dwrite d7/dd/d10/f13 [0,4194304] 0 2024-08-01T06:55:50.991 INFO:tasks.workunit.client.1.smithi089.stdout:0/188: creat d9/d1a/f3c x:0 0 0 2024-08-01T06:55:50.992 INFO:tasks.workunit.client.1.smithi089.stdout:1/153: getdents d0/d9/d15/d2b 0 2024-08-01T06:55:50.999 INFO:tasks.workunit.client.1.smithi089.stdout:7/126: creat d7/df/d10/f35 x:0 0 0 2024-08-01T06:55:50.999 INFO:tasks.workunit.client.1.smithi089.stdout:2/115: dread f2 [0,4194304] 0 2024-08-01T06:55:50.999 INFO:tasks.workunit.client.1.smithi089.stdout:5/106: dread d5/de/df/f12 [0,4194304] 0 2024-08-01T06:55:51.002 INFO:tasks.workunit.client.1.smithi089.stdout:1/154: mknod d0/d9/d1e/c31 0 2024-08-01T06:55:51.002 INFO:tasks.workunit.client.1.smithi089.stdout:2/116: write d7/f10 [1530868,95036] 0 2024-08-01T06:55:51.003 INFO:tasks.workunit.client.1.smithi089.stdout:8/126: sync 2024-08-01T06:55:51.004 INFO:tasks.workunit.client.1.smithi089.stdout:0/189: dwrite d9/d22/f29 [0,4194304] 0 2024-08-01T06:55:51.005 INFO:tasks.workunit.client.1.smithi089.stdout:8/127: readlink d5/dc/d1e/l22 0 2024-08-01T06:55:51.009 INFO:tasks.workunit.client.1.smithi089.stdout:7/127: mkdir d7/df/d10/d36 0 2024-08-01T06:55:51.010 INFO:tasks.workunit.client.1.smithi089.stdout:7/128: truncate d7/df/d10/f34 572248 0 2024-08-01T06:55:51.013 INFO:tasks.workunit.client.1.smithi089.stdout:5/107: creat d5/de/d10/d16/d1b/f24 x:0 0 0 2024-08-01T06:55:51.015 INFO:tasks.workunit.client.1.smithi089.stdout:2/117: rmdir d7 39 2024-08-01T06:55:51.016 INFO:tasks.workunit.client.1.smithi089.stdout:2/118: write f4 [2175967,46925] 0 2024-08-01T06:55:51.017 INFO:tasks.workunit.client.1.smithi089.stdout:1/155: mknod d0/c32 0 2024-08-01T06:55:51.018 INFO:tasks.workunit.client.1.smithi089.stdout:1/156: fsync d0/f2e 0 2024-08-01T06:55:51.023 INFO:tasks.workunit.client.1.smithi089.stdout:0/190: creat d9/d1a/f3d x:0 0 0 2024-08-01T06:55:51.025 INFO:tasks.workunit.client.1.smithi089.stdout:8/128: dread d5/f10 [0,4194304] 0 2024-08-01T06:55:51.025 INFO:tasks.workunit.client.1.smithi089.stdout:6/203: link d2/d30/c42 d2/d11/d1a/d1c/c4a 0 2024-08-01T06:55:51.029 INFO:tasks.workunit.client.1.smithi089.stdout:6/204: dread d2/d2e/d2f/d31/f44 [0,4194304] 0 2024-08-01T06:55:51.031 INFO:tasks.workunit.client.1.smithi089.stdout:3/90: truncate d7/dd/d10/f13 2525692 0 2024-08-01T06:55:51.033 INFO:tasks.workunit.client.1.smithi089.stdout:2/119: dread d7/dc/f15 [0,4194304] 0 2024-08-01T06:55:51.033 INFO:tasks.workunit.client.1.smithi089.stdout:8/129: chown d5/dc/d12 113 1 2024-08-01T06:55:51.035 INFO:tasks.workunit.client.1.smithi089.stdout:7/129: creat d7/df/d10/d36/f37 x:0 0 0 2024-08-01T06:55:51.036 INFO:tasks.workunit.client.1.smithi089.stdout:7/130: chown d7/d1f 933 1 2024-08-01T06:55:51.038 INFO:tasks.workunit.client.1.smithi089.stdout:7/131: read d7/df/d10/f24 [296313,87167] 0 2024-08-01T06:55:51.039 INFO:tasks.workunit.client.1.smithi089.stdout:8/130: dwrite f2 [4194304,4194304] 0 2024-08-01T06:55:51.041 INFO:tasks.workunit.client.1.smithi089.stdout:8/131: chown d5/dc/l19 73 1 2024-08-01T06:55:51.042 INFO:tasks.workunit.client.1.smithi089.stdout:8/132: write d5/ff [4910415,27562] 0 2024-08-01T06:55:51.047 INFO:tasks.workunit.client.1.smithi089.stdout:3/91: truncate d7/dd/d10/f13 2888254 0 2024-08-01T06:55:51.059 INFO:tasks.workunit.client.1.smithi089.stdout:2/120: dwrite d7/f23 [0,4194304] 0 2024-08-01T06:55:51.060 INFO:tasks.workunit.client.1.smithi089.stdout:0/191: truncate d9/d22/f29 3205135 0 2024-08-01T06:55:51.061 INFO:tasks.workunit.client.1.smithi089.stdout:0/192: read - d9/d23/d26/d2e/f30 zero size 2024-08-01T06:55:51.063 INFO:tasks.workunit.client.1.smithi089.stdout:0/193: read d9/d23/d25/f2a [952561,44490] 0 2024-08-01T06:55:51.064 INFO:tasks.workunit.client.1.smithi089.stdout:7/132: rename d7/df/d10/f17 to d7/df/d10/d36/f38 0 2024-08-01T06:55:51.064 INFO:tasks.workunit.client.1.smithi089.stdout:1/157: dwrite d0/f20 [0,4194304] 0 2024-08-01T06:55:51.065 INFO:tasks.workunit.client.1.smithi089.stdout:7/133: stat d7/d1f/l20 0 2024-08-01T06:55:51.066 INFO:tasks.workunit.client.1.smithi089.stdout:0/194: write d9/d1a/f3c [1039727,20171] 0 2024-08-01T06:55:51.073 INFO:tasks.workunit.client.1.smithi089.stdout:7/134: dwrite d7/d1f/f1a [0,4194304] 0 2024-08-01T06:55:51.078 INFO:tasks.workunit.client.1.smithi089.stdout:2/121: truncate f5 441855 0 2024-08-01T06:55:51.081 INFO:tasks.workunit.client.1.smithi089.stdout:2/122: mknod d7/dc/c25 0 2024-08-01T06:55:51.082 INFO:tasks.workunit.client.1.smithi089.stdout:7/135: dwrite d7/df/d10/f35 [0,4194304] 0 2024-08-01T06:55:51.082 INFO:tasks.workunit.client.1.smithi089.stdout:2/123: chown d7/c8 448229751 1 2024-08-01T06:55:51.082 INFO:tasks.workunit.client.1.smithi089.stdout:2/124: stat d7/dc 0 2024-08-01T06:55:51.085 INFO:tasks.workunit.client.1.smithi089.stdout:2/125: mknod d7/d1f/c26 0 2024-08-01T06:55:51.086 INFO:tasks.workunit.client.1.smithi089.stdout:7/136: creat d7/d15/f39 x:0 0 0 2024-08-01T06:55:51.087 INFO:tasks.workunit.client.1.smithi089.stdout:2/126: write d7/fa [805507,32553] 0 2024-08-01T06:55:51.106 INFO:tasks.workunit.client.1.smithi089.stdout:7/137: rmdir d7/df 39 2024-08-01T06:55:51.109 INFO:tasks.workunit.client.1.smithi089.stdout:8/133: truncate d5/dc/f9 2530249 0 2024-08-01T06:55:51.113 INFO:tasks.workunit.client.1.smithi089.stdout:3/92: truncate d7/dd/f15 677270 0 2024-08-01T06:55:51.114 INFO:tasks.workunit.client.1.smithi089.stdout:8/134: dwrite d5/dc/f11 [0,4194304] 0 2024-08-01T06:55:51.115 INFO:tasks.workunit.client.1.smithi089.stdout:8/135: dread d5/f10 [0,4194304] 0 2024-08-01T06:55:51.120 INFO:tasks.workunit.client.1.smithi089.stdout:0/195: write d9/f17 [27798,73552] 0 2024-08-01T06:55:51.127 INFO:tasks.workunit.client.1.smithi089.stdout:8/136: dwrite d5/d15/f18 [4194304,4194304] 0 2024-08-01T06:55:51.127 INFO:tasks.workunit.client.1.smithi089.stdout:1/158: truncate d0/f20 141874 0 2024-08-01T06:55:51.128 INFO:tasks.workunit.client.1.smithi089.stdout:0/196: dwrite d9/fa [0,4194304] 0 2024-08-01T06:55:51.129 INFO:tasks.workunit.client.1.smithi089.stdout:1/159: write d0/f2e [502210,88566] 0 2024-08-01T06:55:51.132 INFO:tasks.workunit.client.1.smithi089.stdout:1/160: chown d0/d9/d1e 84826898 1 2024-08-01T06:55:51.133 INFO:tasks.workunit.client.1.smithi089.stdout:1/161: truncate d0/f2e 905862 0 2024-08-01T06:55:51.135 INFO:tasks.workunit.client.1.smithi089.stdout:0/197: creat d9/d22/f3e x:0 0 0 2024-08-01T06:55:51.136 INFO:tasks.workunit.client.1.smithi089.stdout:7/138: rmdir d7 39 2024-08-01T06:55:51.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:50 smithi089 ceph-mon[36617]: pgmap v9: 65 pgs: 65 active+clean; 283 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 14 MiB/s wr, 271 op/s 2024-08-01T06:55:51.137 INFO:tasks.workunit.client.1.smithi089.stdout:7/139: chown f4 641406691 1 2024-08-01T06:55:51.140 INFO:tasks.workunit.client.1.smithi089.stdout:1/162: unlink d0/c4 0 2024-08-01T06:55:51.142 INFO:tasks.workunit.client.1.smithi089.stdout:8/137: rename d5/d15/f18 to d5/f25 0 2024-08-01T06:55:51.143 INFO:tasks.workunit.client.1.smithi089.stdout:7/140: chown d7/fd 3 1 2024-08-01T06:55:51.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:50 smithi016 ceph-mon[29266]: pgmap v9: 65 pgs: 65 active+clean; 283 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 14 MiB/s wr, 271 op/s 2024-08-01T06:55:51.149 INFO:tasks.workunit.client.1.smithi089.stdout:8/138: rename d5/ce to d5/d23/c26 0 2024-08-01T06:55:51.150 INFO:tasks.workunit.client.1.smithi089.stdout:3/93: dread d7/dd/d10/f13 [0,4194304] 0 2024-08-01T06:55:51.151 INFO:tasks.workunit.client.1.smithi089.stdout:1/163: creat d0/d9/d15/d2d/f33 x:0 0 0 2024-08-01T06:55:51.156 INFO:tasks.workunit.client.1.smithi089.stdout:3/94: mknod d7/dd/c17 0 2024-08-01T06:55:51.163 INFO:tasks.workunit.client.1.smithi089.stdout:7/141: unlink d7/df/c18 0 2024-08-01T06:55:51.166 INFO:tasks.workunit.client.1.smithi089.stdout:3/95: chown d7/dd/d10/c14 7 1 2024-08-01T06:55:51.168 INFO:tasks.workunit.client.1.smithi089.stdout:3/96: dread d7/dd/d10/f13 [0,4194304] 0 2024-08-01T06:55:51.170 INFO:tasks.workunit.client.1.smithi089.stdout:7/142: mkdir d7/d1f/d3a 0 2024-08-01T06:55:51.171 INFO:tasks.workunit.client.1.smithi089.stdout:2/127: write f5 [1230887,80934] 0 2024-08-01T06:55:51.172 INFO:tasks.workunit.client.1.smithi089.stdout:2/128: stat d7/c13 0 2024-08-01T06:55:51.177 INFO:tasks.workunit.client.1.smithi089.stdout:2/129: mknod d7/dc/c27 0 2024-08-01T06:55:51.177 INFO:tasks.workunit.client.1.smithi089.stdout:7/143: dwrite f6 [0,4194304] 0 2024-08-01T06:55:51.180 INFO:tasks.workunit.client.1.smithi089.stdout:2/130: mkdir d7/d1f/d28 0 2024-08-01T06:55:51.184 INFO:tasks.workunit.client.1.smithi089.stdout:7/144: dwrite d7/d1f/f1a [0,4194304] 0 2024-08-01T06:55:51.186 INFO:tasks.workunit.client.1.smithi089.stdout:7/145: write d7/d15/f25 [291100,89555] 0 2024-08-01T06:55:51.190 INFO:tasks.workunit.client.1.smithi089.stdout:7/146: mkdir d7/df/d3b 0 2024-08-01T06:55:51.193 INFO:tasks.workunit.client.1.smithi089.stdout:7/147: creat d7/d15/f3c x:0 0 0 2024-08-01T06:55:51.195 INFO:tasks.workunit.client.1.smithi089.stdout:8/139: getdents d5 0 2024-08-01T06:55:51.208 INFO:tasks.workunit.client.1.smithi089.stdout:1/164: write d0/f8 [1985223,92332] 0 2024-08-01T06:55:51.208 INFO:tasks.workunit.client.1.smithi089.stdout:1/165: read - d0/d9/d15/d2d/f33 zero size 2024-08-01T06:55:51.213 INFO:tasks.workunit.client.1.smithi089.stdout:1/166: creat d0/d9/d15/f34 x:0 0 0 2024-08-01T06:55:51.213 INFO:tasks.workunit.client.1.smithi089.stdout:1/167: write d0/f2e [1645913,130435] 0 2024-08-01T06:55:51.214 INFO:tasks.workunit.client.1.smithi089.stdout:1/168: truncate d0/d9/f30 934382 0 2024-08-01T06:55:51.217 INFO:tasks.workunit.client.1.smithi089.stdout:1/169: unlink d0/f2e 0 2024-08-01T06:55:51.218 INFO:tasks.workunit.client.1.smithi089.stdout:2/131: rename d7/dc to d7/d1f/d29 0 2024-08-01T06:55:51.220 INFO:tasks.workunit.client.1.smithi089.stdout:9/135: sync 2024-08-01T06:55:51.220 INFO:tasks.workunit.client.1.smithi089.stdout:4/130: sync 2024-08-01T06:55:51.221 INFO:tasks.workunit.client.1.smithi089.stdout:9/136: readlink d18/d22/l26 0 2024-08-01T06:55:51.222 INFO:tasks.workunit.client.1.smithi089.stdout:8/140: rename d5/dc/c17 to d5/dc/d12/c27 0 2024-08-01T06:55:51.222 INFO:tasks.workunit.client.1.smithi089.stdout:8/141: chown f2 35229 1 2024-08-01T06:55:51.225 INFO:tasks.workunit.client.1.smithi089.stdout:1/170: dwrite d0/f20 [0,4194304] 0 2024-08-01T06:55:51.225 INFO:tasks.workunit.client.1.smithi089.stdout:1/171: stat d0 0 2024-08-01T06:55:51.226 INFO:tasks.workunit.client.1.smithi089.stdout:1/172: fsync d0/f19 0 2024-08-01T06:55:51.227 INFO:tasks.workunit.client.1.smithi089.stdout:4/131: dread d3/db/d16/f9 [0,4194304] 0 2024-08-01T06:55:51.227 INFO:tasks.workunit.client.1.smithi089.stdout:2/132: mknod d7/d1f/d28/c2a 0 2024-08-01T06:55:51.228 INFO:tasks.workunit.client.1.smithi089.stdout:8/142: creat d5/dc/d12/f28 x:0 0 0 2024-08-01T06:55:51.229 INFO:tasks.workunit.client.1.smithi089.stdout:8/143: chown d5/f10 2 1 2024-08-01T06:55:51.231 INFO:tasks.workunit.client.1.smithi089.stdout:1/173: rename d0/d9/c1d to d0/d9/d15/d2d/c35 0 2024-08-01T06:55:51.231 INFO:tasks.workunit.client.1.smithi089.stdout:7/148: write d7/df/d10/d36/f38 [375975,69782] 0 2024-08-01T06:55:51.241 INFO:tasks.workunit.client.1.smithi089.stdout:1/174: creat d0/d9/d15/d2d/f36 x:0 0 0 2024-08-01T06:55:51.246 INFO:tasks.workunit.client.1.smithi089.stdout:2/133: unlink d7/d1f/d29/c16 0 2024-08-01T06:55:51.249 INFO:tasks.workunit.client.1.smithi089.stdout:5/108: sync 2024-08-01T06:55:51.249 INFO:tasks.workunit.client.1.smithi089.stdout:6/205: sync 2024-08-01T06:55:51.250 INFO:tasks.workunit.client.1.smithi089.stdout:0/198: sync 2024-08-01T06:55:51.250 INFO:tasks.workunit.client.1.smithi089.stdout:2/134: dread f5 [0,4194304] 0 2024-08-01T06:55:51.250 INFO:tasks.workunit.client.1.smithi089.stdout:1/175: rmdir d0/d9/d15/d2b 39 2024-08-01T06:55:51.251 INFO:tasks.workunit.client.1.smithi089.stdout:9/137: getdents d18 0 2024-08-01T06:55:51.259 INFO:tasks.workunit.client.1.smithi089.stdout:2/135: dwrite d7/f10 [0,4194304] 0 2024-08-01T06:55:51.259 INFO:tasks.workunit.client.1.smithi089.stdout:0/199: dwrite d9/fd [4194304,4194304] 0 2024-08-01T06:55:51.261 INFO:tasks.workunit.client.1.smithi089.stdout:5/109: mkdir d5/de/d10/d16/d1b/d25 0 2024-08-01T06:55:51.261 INFO:tasks.workunit.client.1.smithi089.stdout:6/206: dread d2/d2e/d2f/d31/f44 [0,4194304] 0 2024-08-01T06:55:51.263 INFO:tasks.workunit.client.1.smithi089.stdout:5/110: read - d5/de/d10/d16/d1b/f22 zero size 2024-08-01T06:55:51.263 INFO:tasks.workunit.client.1.smithi089.stdout:9/138: chown cb 219371389 1 2024-08-01T06:55:51.267 INFO:tasks.workunit.client.1.smithi089.stdout:8/144: getdents d5/d23 0 2024-08-01T06:55:51.268 INFO:tasks.workunit.client.1.smithi089.stdout:7/149: link c5 d7/df/d10/c3d 0 2024-08-01T06:55:51.271 INFO:tasks.workunit.client.1.smithi089.stdout:0/200: creat d9/d23/d26/f3f x:0 0 0 2024-08-01T06:55:51.272 INFO:tasks.workunit.client.1.smithi089.stdout:7/150: chown d7/df/d10/d36/f37 725 1 2024-08-01T06:55:51.273 INFO:tasks.workunit.client.1.smithi089.stdout:9/139: dwrite d18/f23 [0,4194304] 0 2024-08-01T06:55:51.279 INFO:tasks.workunit.client.1.smithi089.stdout:3/97: write d7/dd/f15 [721286,20264] 0 2024-08-01T06:55:51.279 INFO:tasks.workunit.client.1.smithi089.stdout:0/201: write d9/fd [3890282,43212] 0 2024-08-01T06:55:51.279 INFO:tasks.workunit.client.1.smithi089.stdout:9/140: chown l6 0 1 2024-08-01T06:55:51.279 INFO:tasks.workunit.client.1.smithi089.stdout:4/132: dwrite d3/db/d16/f18 [4194304,4194304] 0 2024-08-01T06:55:51.281 INFO:tasks.workunit.client.1.smithi089.stdout:4/133: chown d3/ca 3 1 2024-08-01T06:55:51.281 INFO:tasks.workunit.client.1.smithi089.stdout:6/207: fdatasync d2/d2e/d2f/d31/f44 0 2024-08-01T06:55:51.283 INFO:tasks.workunit.client.1.smithi089.stdout:8/145: creat d5/f29 x:0 0 0 2024-08-01T06:55:51.285 INFO:tasks.workunit.client.1.smithi089.stdout:7/151: symlink d7/df/l3e 0 2024-08-01T06:55:51.290 INFO:tasks.workunit.client.1.smithi089.stdout:3/98: mknod d7/dd/c18 0 2024-08-01T06:55:51.292 INFO:tasks.workunit.client.1.smithi089.stdout:3/99: dread d7/dd/f15 [0,4194304] 0 2024-08-01T06:55:51.293 INFO:tasks.workunit.client.1.smithi089.stdout:9/141: symlink d18/d22/l2e 0 2024-08-01T06:55:51.293 INFO:tasks.workunit.client.1.smithi089.stdout:3/100: stat d7/dd/d10/c14 0 2024-08-01T06:55:51.293 INFO:tasks.workunit.client.1.smithi089.stdout:9/142: chown cd 10278388 1 2024-08-01T06:55:51.299 INFO:tasks.workunit.client.1.smithi089.stdout:4/134: mknod d3/d1e/d21/d26/c2d 0 2024-08-01T06:55:51.301 INFO:tasks.workunit.client.1.smithi089.stdout:9/143: dwrite d18/f2a [0,4194304] 0 2024-08-01T06:55:51.301 INFO:tasks.workunit.client.1.smithi089.stdout:4/135: dread - d3/d29/f2a zero size 2024-08-01T06:55:51.302 INFO:tasks.workunit.client.1.smithi089.stdout:9/144: chown d18/f20 1 1 2024-08-01T06:55:51.302 INFO:tasks.workunit.client.1.smithi089.stdout:8/146: readlink d5/dc/l8 0 2024-08-01T06:55:51.302 INFO:tasks.workunit.client.1.smithi089.stdout:9/145: write d18/f2d [409635,127534] 0 2024-08-01T06:55:51.304 INFO:tasks.workunit.client.1.smithi089.stdout:7/152: creat d7/d1f/f3f x:0 0 0 2024-08-01T06:55:51.305 INFO:tasks.workunit.client.1.smithi089.stdout:1/176: getdents d0/d9/d15 0 2024-08-01T06:55:51.306 INFO:tasks.workunit.client.1.smithi089.stdout:5/111: rmdir d5 39 2024-08-01T06:55:51.307 INFO:tasks.workunit.client.1.smithi089.stdout:5/112: stat l2 0 2024-08-01T06:55:51.311 INFO:tasks.workunit.client.1.smithi089.stdout:6/208: creat d2/d11/d1f/d46/f4b x:0 0 0 2024-08-01T06:55:51.312 INFO:tasks.workunit.client.1.smithi089.stdout:2/136: truncate f5 328999 0 2024-08-01T06:55:51.312 INFO:tasks.workunit.client.1.smithi089.stdout:7/153: dwrite d7/df/d10/d36/f38 [0,4194304] 0 2024-08-01T06:55:51.314 INFO:tasks.workunit.client.1.smithi089.stdout:7/154: write d7/df/d10/d36/f38 [1772327,14198] 0 2024-08-01T06:55:51.316 INFO:tasks.workunit.client.1.smithi089.stdout:0/202: rename d9/d23 to d9/d40 0 2024-08-01T06:55:51.317 INFO:tasks.workunit.client.1.smithi089.stdout:8/147: chown d5/d15/c21 825657 1 2024-08-01T06:55:51.318 INFO:tasks.workunit.client.1.smithi089.stdout:2/137: dread d7/d1f/d29/f15 [0,4194304] 0 2024-08-01T06:55:51.319 INFO:tasks.workunit.client.1.smithi089.stdout:9/146: mknod d18/c2f 0 2024-08-01T06:55:51.319 INFO:tasks.workunit.client.1.smithi089.stdout:8/148: write d5/dc/f16 [4315869,125075] 0 2024-08-01T06:55:51.320 INFO:tasks.workunit.client.1.smithi089.stdout:9/147: dread - d18/f20 zero size 2024-08-01T06:55:51.327 INFO:tasks.workunit.client.1.smithi089.stdout:6/209: symlink d2/d11/d1a/l4c 0 2024-08-01T06:55:51.327 INFO:tasks.workunit.client.1.smithi089.stdout:6/210: stat d2/d11/f17 0 2024-08-01T06:55:51.337 INFO:tasks.workunit.client.1.smithi089.stdout:8/149: symlink d5/dc/d1e/l2a 0 2024-08-01T06:55:51.339 INFO:tasks.workunit.client.1.smithi089.stdout:9/148: creat d18/f30 x:0 0 0 2024-08-01T06:55:51.340 INFO:tasks.workunit.client.1.smithi089.stdout:1/177: unlink d0/d9/d1e/c21 0 2024-08-01T06:55:51.341 INFO:tasks.workunit.client.1.smithi089.stdout:3/101: write d7/dd/d10/f13 [3361557,39139] 0 2024-08-01T06:55:51.343 INFO:tasks.workunit.client.1.smithi089.stdout:1/178: dread d0/f24 [0,4194304] 0 2024-08-01T06:55:51.344 INFO:tasks.workunit.client.1.smithi089.stdout:6/211: creat d2/d2e/d2f/f4d x:0 0 0 2024-08-01T06:55:51.347 INFO:tasks.workunit.client.1.smithi089.stdout:9/149: dwrite d18/f21 [0,4194304] 0 2024-08-01T06:55:51.348 INFO:tasks.workunit.client.1.smithi089.stdout:4/136: rmdir d3/d17/d22 0 2024-08-01T06:55:51.354 INFO:tasks.workunit.client.1.smithi089.stdout:8/150: creat d5/dc/d1e/f2b x:0 0 0 2024-08-01T06:55:51.360 INFO:tasks.workunit.client.1.smithi089.stdout:1/179: creat d0/d9/d1e/f37 x:0 0 0 2024-08-01T06:55:51.368 INFO:tasks.workunit.client.1.smithi089.stdout:1/180: dwrite d0/d9/d15/d2d/f33 [0,4194304] 0 2024-08-01T06:55:51.370 INFO:tasks.workunit.client.1.smithi089.stdout:6/212: dwrite d2/f2a [0,4194304] 0 2024-08-01T06:55:51.372 INFO:tasks.workunit.client.1.smithi089.stdout:6/213: rename d2/d11 to d2/d11/d1a/d1c/d40/d4e 22 2024-08-01T06:55:51.379 INFO:tasks.workunit.client.1.smithi089.stdout:9/150: link d18/d22/f28 d18/f31 0 2024-08-01T06:55:51.382 INFO:tasks.workunit.client.1.smithi089.stdout:5/113: dwrite d5/de/f14 [0,4194304] 0 2024-08-01T06:55:51.387 INFO:tasks.workunit.client.1.smithi089.stdout:8/151: mkdir d5/d2c 0 2024-08-01T06:55:51.389 INFO:tasks.workunit.client.1.smithi089.stdout:1/181: mknod d0/d9/d15/c38 0 2024-08-01T06:55:51.391 INFO:tasks.workunit.client.1.smithi089.stdout:9/151: dwrite d18/f2d [0,4194304] 0 2024-08-01T06:55:51.394 INFO:tasks.workunit.client.1.smithi089.stdout:0/203: dwrite d9/ff [0,4194304] 0 2024-08-01T06:55:51.396 INFO:tasks.workunit.client.1.smithi089.stdout:0/204: dread - d9/d40/d26/d2e/f36 zero size 2024-08-01T06:55:51.397 INFO:tasks.workunit.client.1.smithi089.stdout:5/114: mknod d5/de/df/c26 0 2024-08-01T06:55:51.399 INFO:tasks.workunit.client.1.smithi089.stdout:6/214: unlink d2/d2e/d2f/c39 0 2024-08-01T06:55:51.400 INFO:tasks.workunit.client.1.smithi089.stdout:4/137: write d3/db/f10 [787774,108403] 0 2024-08-01T06:55:51.401 INFO:tasks.workunit.client.1.smithi089.stdout:6/215: truncate d2/d11/d1a/f33 849036 0 2024-08-01T06:55:51.405 INFO:tasks.workunit.client.1.smithi089.stdout:8/152: mknod d5/dc/d1e/c2d 0 2024-08-01T06:55:51.406 INFO:tasks.workunit.client.1.smithi089.stdout:8/153: readlink d5/dc/l8 0 2024-08-01T06:55:51.407 INFO:tasks.workunit.client.1.smithi089.stdout:3/102: truncate d7/dd/d10/f13 2709827 0 2024-08-01T06:55:51.407 INFO:tasks.workunit.client.1.smithi089.stdout:0/205: chown d9/d40/d25/c37 3983 1 2024-08-01T06:55:51.408 INFO:tasks.workunit.client.1.smithi089.stdout:3/103: chown d7/dd/d10 650492607 1 2024-08-01T06:55:51.410 INFO:tasks.workunit.client.1.smithi089.stdout:4/138: mknod d3/db/de/c2e 0 2024-08-01T06:55:51.415 INFO:tasks.workunit.client.1.smithi089.stdout:0/206: mkdir d9/d40/d26/d41 0 2024-08-01T06:55:51.417 INFO:tasks.workunit.client.1.smithi089.stdout:5/115: rename d5/de/df/f1d to d5/d13/f27 0 2024-08-01T06:55:51.418 INFO:tasks.workunit.client.1.smithi089.stdout:3/104: unlink d7/dd/c18 0 2024-08-01T06:55:51.421 INFO:tasks.workunit.client.1.smithi089.stdout:4/139: creat d3/d1e/d21/f2f x:0 0 0 2024-08-01T06:55:51.423 INFO:tasks.workunit.client.1.smithi089.stdout:8/154: creat d5/d2c/f2e x:0 0 0 2024-08-01T06:55:51.426 INFO:tasks.workunit.client.1.smithi089.stdout:0/207: rename d9/d22/d2b/f32 to d9/d40/d26/d2e/f42 0 2024-08-01T06:55:51.427 INFO:tasks.workunit.client.1.smithi089.stdout:5/116: mknod d5/d13/c28 0 2024-08-01T06:55:51.428 INFO:tasks.workunit.client.1.smithi089.stdout:3/105: mknod d7/c19 0 2024-08-01T06:55:51.429 INFO:tasks.workunit.client.1.smithi089.stdout:4/140: symlink d3/db/de/l30 0 2024-08-01T06:55:51.430 INFO:tasks.workunit.client.1.smithi089.stdout:4/141: write d3/d29/f2a [219790,100027] 0 2024-08-01T06:55:51.432 INFO:tasks.workunit.client.1.smithi089.stdout:6/216: link d2/d11/d1a/d1c/c38 d2/d11/d1a/c4f 0 2024-08-01T06:55:51.438 INFO:tasks.workunit.client.1.smithi089.stdout:5/117: chown d5/de/lb 5902872 1 2024-08-01T06:55:51.439 INFO:tasks.workunit.client.1.smithi089.stdout:3/106: creat d7/dd/f1a x:0 0 0 2024-08-01T06:55:51.440 INFO:tasks.workunit.client.1.smithi089.stdout:3/107: stat d7/c19 0 2024-08-01T06:55:51.441 INFO:tasks.workunit.client.1.smithi089.stdout:4/142: mkdir d3/d29/d31 0 2024-08-01T06:55:51.443 INFO:tasks.workunit.client.1.smithi089.stdout:6/217: rename d2/f24 to d2/d11/d1f/f50 0 2024-08-01T06:55:51.444 INFO:tasks.workunit.client.1.smithi089.stdout:6/218: chown d2/d11/d1f/l22 27601354 1 2024-08-01T06:55:51.444 INFO:tasks.workunit.client.1.smithi089.stdout:1/182: creat d0/d9/d15/d2b/f39 x:0 0 0 2024-08-01T06:55:51.447 INFO:tasks.workunit.client.1.smithi089.stdout:5/118: symlink d5/de/d10/d16/l29 0 2024-08-01T06:55:51.451 INFO:tasks.workunit.client.1.smithi089.stdout:8/155: rename d5/dc/l8 to d5/d23/l2f 0 2024-08-01T06:55:51.452 INFO:tasks.workunit.client.1.smithi089.stdout:8/156: truncate d5/dc/d12/f14 1735856 0 2024-08-01T06:55:51.452 INFO:tasks.workunit.client.1.smithi089.stdout:6/219: unlink d2/c10 0 2024-08-01T06:55:51.453 INFO:tasks.workunit.client.1.smithi089.stdout:6/220: dread - d2/d11/d1a/f35 zero size 2024-08-01T06:55:51.453 INFO:tasks.workunit.client.1.smithi089.stdout:6/221: dread - d2/d11/d1f/f45 zero size 2024-08-01T06:55:51.455 INFO:tasks.workunit.client.1.smithi089.stdout:0/208: rmdir d9/d40/d26/d41 0 2024-08-01T06:55:51.456 INFO:tasks.workunit.client.1.smithi089.stdout:3/108: mkdir d7/dd/d10/d12/d1b 0 2024-08-01T06:55:51.456 INFO:tasks.workunit.client.1.smithi089.stdout:3/109: dread - d7/dd/f1a zero size 2024-08-01T06:55:51.462 INFO:tasks.workunit.client.1.smithi089.stdout:0/209: creat d9/d22/d2b/f43 x:0 0 0 2024-08-01T06:55:51.465 INFO:tasks.workunit.client.1.smithi089.stdout:5/119: mknod d5/de/c2a 0 2024-08-01T06:55:51.465 INFO:tasks.workunit.client.1.smithi089.stdout:5/120: stat d5/de/df 0 2024-08-01T06:55:51.466 INFO:tasks.workunit.client.1.smithi089.stdout:3/110: symlink d7/dd/d10/l1c 0 2024-08-01T06:55:51.473 INFO:tasks.workunit.client.1.smithi089.stdout:0/210: mkdir d9/d40/d26/d2e/d44 0 2024-08-01T06:55:51.476 INFO:tasks.workunit.client.1.smithi089.stdout:5/121: creat d5/d13/f2b x:0 0 0 2024-08-01T06:55:51.478 INFO:tasks.workunit.client.1.smithi089.stdout:4/143: getdents d3/db/d16 0 2024-08-01T06:55:51.482 INFO:tasks.workunit.client.1.smithi089.stdout:1/183: link d0/d9/d15/f34 d0/d9/d15/d2d/f3a 0 2024-08-01T06:55:51.486 INFO:tasks.workunit.client.1.smithi089.stdout:8/157: link d5/dc/d12/c27 d5/dc/d1e/c30 0 2024-08-01T06:55:51.487 INFO:tasks.workunit.client.1.smithi089.stdout:8/158: stat d5/dc/d1e 0 2024-08-01T06:55:51.489 INFO:tasks.workunit.client.1.smithi089.stdout:0/211: mkdir d9/d40/d45 0 2024-08-01T06:55:51.489 INFO:tasks.workunit.client.1.smithi089.stdout:6/222: rmdir d2/d11/d1f 39 2024-08-01T06:55:51.492 INFO:tasks.workunit.client.1.smithi089.stdout:5/122: fsync d5/d13/f27 0 2024-08-01T06:55:51.492 INFO:tasks.workunit.client.1.smithi089.stdout:6/223: write d2/d11/f15 [4454408,5202] 0 2024-08-01T06:55:51.493 INFO:tasks.workunit.client.1.smithi089.stdout:1/184: mkdir d0/d9/d15/d3b 0 2024-08-01T06:55:51.494 INFO:tasks.workunit.client.1.smithi089.stdout:5/123: truncate d5/d13/f2b 617214 0 2024-08-01T06:55:51.496 INFO:tasks.workunit.client.1.smithi089.stdout:5/124: truncate d5/de/d10/d16/d1b/f24 837341 0 2024-08-01T06:55:51.497 INFO:tasks.workunit.client.1.smithi089.stdout:0/212: rename d9/d1a to d9/d40/d25/d46 0 2024-08-01T06:55:51.505 INFO:tasks.workunit.client.1.smithi089.stdout:5/125: unlink d5/de/df/f12 0 2024-08-01T06:55:51.506 INFO:tasks.workunit.client.1.smithi089.stdout:5/126: chown d5/de/d10 0 1 2024-08-01T06:55:51.508 INFO:tasks.workunit.client.1.smithi089.stdout:4/144: getdents d3 0 2024-08-01T06:55:51.510 INFO:tasks.workunit.client.1.smithi089.stdout:1/185: creat d0/d9/d15/d3b/f3c x:0 0 0 2024-08-01T06:55:51.512 INFO:tasks.workunit.client.1.smithi089.stdout:1/186: fdatasync d0/f23 0 2024-08-01T06:55:51.515 INFO:tasks.workunit.client.1.smithi089.stdout:5/127: creat d5/de/d10/f2c x:0 0 0 2024-08-01T06:55:51.516 INFO:tasks.workunit.client.1.smithi089.stdout:4/145: dwrite d3/d1e/d21/f2f [0,4194304] 0 2024-08-01T06:55:51.516 INFO:tasks.workunit.client.1.smithi089.stdout:3/111: dwrite d7/dd/f15 [0,4194304] 0 2024-08-01T06:55:51.517 INFO:tasks.workunit.client.1.smithi089.stdout:8/159: getdents d5/dc 0 2024-08-01T06:55:51.517 INFO:tasks.workunit.client.1.smithi089.stdout:5/128: read f0 [4180244,72779] 0 2024-08-01T06:55:51.519 INFO:tasks.workunit.client.1.smithi089.stdout:6/224: creat d2/d11/f51 x:0 0 0 2024-08-01T06:55:51.519 INFO:tasks.workunit.client.1.smithi089.stdout:5/129: read d5/de/f14 [2406094,21728] 0 2024-08-01T06:55:51.527 INFO:tasks.workunit.client.1.smithi089.stdout:1/187: mkdir d0/d9/d15/d3b/d3d 0 2024-08-01T06:55:51.527 INFO:tasks.workunit.client.1.smithi089.stdout:8/160: dwrite d5/d2c/f2e [0,4194304] 0 2024-08-01T06:55:51.527 INFO:tasks.workunit.client.1.smithi089.stdout:4/146: mknod d3/d1e/c32 0 2024-08-01T06:55:51.529 INFO:tasks.workunit.client.1.smithi089.stdout:3/112: rmdir d7/dd/d10 39 2024-08-01T06:55:51.530 INFO:tasks.workunit.client.1.smithi089.stdout:8/161: write d5/dc/d12/f28 [955722,68217] 0 2024-08-01T06:55:51.534 INFO:tasks.workunit.client.1.smithi089.stdout:6/225: creat d2/d11/d1a/d1c/f52 x:0 0 0 2024-08-01T06:55:51.537 INFO:tasks.workunit.client.1.smithi089.stdout:1/188: dwrite d0/f8 [0,4194304] 0 2024-08-01T06:55:51.537 INFO:tasks.workunit.client.1.smithi089.stdout:0/213: getdents d9/d22/d2b 0 2024-08-01T06:55:51.541 INFO:tasks.workunit.client.1.smithi089.stdout:4/147: mkdir d3/db/d33 0 2024-08-01T06:55:51.543 INFO:tasks.workunit.client.1.smithi089.stdout:8/162: creat d5/d23/f31 x:0 0 0 2024-08-01T06:55:51.547 INFO:tasks.workunit.client.1.smithi089.stdout:6/226: mkdir d2/d2e/d2f/d53 0 2024-08-01T06:55:51.548 INFO:tasks.workunit.client.1.smithi089.stdout:0/214: rmdir d9/d40/d26/d2e 39 2024-08-01T06:55:51.550 INFO:tasks.workunit.client.1.smithi089.stdout:1/189: mknod d0/d9/d15/d3b/c3e 0 2024-08-01T06:55:51.553 INFO:tasks.workunit.client.1.smithi089.stdout:8/163: creat d5/d2c/f32 x:0 0 0 2024-08-01T06:55:51.555 INFO:tasks.workunit.client.1.smithi089.stdout:5/130: link d5/de/d10/d16/c23 d5/de/d17/c2d 0 2024-08-01T06:55:51.555 INFO:tasks.workunit.client.1.smithi089.stdout:5/131: readlink l2 0 2024-08-01T06:55:51.555 INFO:tasks.workunit.client.1.smithi089.stdout:1/190: dread d0/f19 [0,4194304] 0 2024-08-01T06:55:51.556 INFO:tasks.workunit.client.1.smithi089.stdout:5/132: fdatasync d5/d13/f2b 0 2024-08-01T06:55:51.557 INFO:tasks.workunit.client.1.smithi089.stdout:0/215: unlink d9/d40/d25/c37 0 2024-08-01T06:55:51.558 INFO:tasks.workunit.client.1.smithi089.stdout:4/148: mknod d3/d1f/c34 0 2024-08-01T06:55:51.558 INFO:tasks.workunit.client.1.smithi089.stdout:0/216: write d9/ff [4343907,74152] 0 2024-08-01T06:55:51.560 INFO:tasks.workunit.client.1.smithi089.stdout:3/113: truncate d7/dd/d10/f13 2827480 0 2024-08-01T06:55:51.561 INFO:tasks.workunit.client.1.smithi089.stdout:8/164: symlink d5/d15/l33 0 2024-08-01T06:55:51.561 INFO:tasks.workunit.client.1.smithi089.stdout:3/114: fsync d7/dd/f15 0 2024-08-01T06:55:51.629 INFO:tasks.workunit.client.1.smithi089.stdout:7/155: sync 2024-08-01T06:55:51.630 INFO:tasks.workunit.client.1.smithi089.stdout:2/138: sync 2024-08-01T06:55:51.630 INFO:tasks.workunit.client.1.smithi089.stdout:9/152: sync 2024-08-01T06:55:51.637 INFO:tasks.workunit.client.1.smithi089.stdout:1/191: mkdir d0/d9/d15/d3b/d3f 0 2024-08-01T06:55:51.638 INFO:tasks.workunit.client.1.smithi089.stdout:4/149: rename d3/d1e/d21/d26/d2b to d3/db/d16/d35 0 2024-08-01T06:55:51.638 INFO:tasks.workunit.client.1.smithi089.stdout:3/115: dread - d7/dd/f1a zero size 2024-08-01T06:55:51.639 INFO:tasks.workunit.client.1.smithi089.stdout:1/192: stat d0/f20 0 2024-08-01T06:55:51.641 INFO:tasks.workunit.client.1.smithi089.stdout:3/116: chown d7/dd/f15 2023145 1 2024-08-01T06:55:51.641 INFO:tasks.workunit.client.1.smithi089.stdout:4/150: read - d3/d17/f28 zero size 2024-08-01T06:55:51.641 INFO:tasks.workunit.client.1.smithi089.stdout:7/156: truncate d7/d15/f2d 635785 0 2024-08-01T06:55:51.703 INFO:tasks.workunit.client.1.smithi089.stdout:0/217: dwrite d9/d40/d26/f2c [4194304,4194304] 0 2024-08-01T06:55:51.704 INFO:tasks.workunit.client.1.smithi089.stdout:6/227: link d2/d30/c42 d2/d11/d3e/c54 0 2024-08-01T06:55:51.704 INFO:tasks.workunit.client.1.smithi089.stdout:9/153: unlink f11 0 2024-08-01T06:55:51.705 INFO:tasks.workunit.client.1.smithi089.stdout:0/218: chown d9/d40/d25/d46 59 1 2024-08-01T06:55:51.705 INFO:tasks.workunit.client.1.smithi089.stdout:2/139: symlink d7/d1f/d29/l2b 0 2024-08-01T06:55:51.706 INFO:tasks.workunit.client.1.smithi089.stdout:3/117: mknod d7/c1d 0 2024-08-01T06:55:51.707 INFO:tasks.workunit.client.1.smithi089.stdout:4/151: mknod d3/db/c36 0 2024-08-01T06:55:51.708 INFO:tasks.workunit.client.1.smithi089.stdout:1/193: dread - d0/d9/d15/d2d/f36 zero size 2024-08-01T06:55:51.711 INFO:tasks.workunit.client.1.smithi089.stdout:6/228: dread - d2/d11/d1f/d46/f4b zero size 2024-08-01T06:55:51.711 INFO:tasks.workunit.client.1.smithi089.stdout:9/154: truncate f13 2929810 0 2024-08-01T06:55:51.712 INFO:tasks.workunit.client.1.smithi089.stdout:6/229: readlink d2/d11/d1a/l4c 0 2024-08-01T06:55:51.714 INFO:tasks.workunit.client.1.smithi089.stdout:7/157: dwrite d7/d15/f2d [0,4194304] 0 2024-08-01T06:55:51.714 INFO:tasks.workunit.client.1.smithi089.stdout:6/230: fdatasync d2/d11/d1f/f2d 0 2024-08-01T06:55:51.715 INFO:tasks.workunit.client.1.smithi089.stdout:7/158: read - d7/df/d10/d36/f37 zero size 2024-08-01T06:55:51.716 INFO:tasks.workunit.client.1.smithi089.stdout:7/159: fdatasync d7/d15/f39 0 2024-08-01T06:55:51.717 INFO:tasks.workunit.client.1.smithi089.stdout:8/165: getdents d5/d23 0 2024-08-01T06:55:51.718 INFO:tasks.workunit.client.1.smithi089.stdout:7/160: chown d7/d1f/ce 70603 1 2024-08-01T06:55:51.719 INFO:tasks.workunit.client.1.smithi089.stdout:7/161: chown d7/d15/f25 33 1 2024-08-01T06:55:51.719 INFO:tasks.workunit.client.1.smithi089.stdout:7/162: chown d7/df/c29 28292 1 2024-08-01T06:55:51.725 INFO:tasks.workunit.client.1.smithi089.stdout:3/118: rename d7/dd/d10/l16 to d7/dd/d10/l1e 0 2024-08-01T06:55:51.731 INFO:tasks.workunit.client.1.smithi089.stdout:6/231: unlink d2/d11/d1a/c3b 0 2024-08-01T06:55:51.732 INFO:tasks.workunit.client.1.smithi089.stdout:4/152: dread d3/db/d16/f1a [4194304,4194304] 0 2024-08-01T06:55:51.733 INFO:tasks.workunit.client.1.smithi089.stdout:8/166: read d5/f25 [7007884,49054] 0 2024-08-01T06:55:51.733 INFO:tasks.workunit.client.1.smithi089.stdout:0/219: mkdir d9/d40/d45/d47 0 2024-08-01T06:55:51.733 INFO:tasks.workunit.client.1.smithi089.stdout:4/153: readlink d3/db/de/l30 0 2024-08-01T06:55:51.734 INFO:tasks.workunit.client.1.smithi089.stdout:2/140: getdents d7/d19/d1e 0 2024-08-01T06:55:51.735 INFO:tasks.workunit.client.1.smithi089.stdout:2/141: write d7/f10 [1074242,32478] 0 2024-08-01T06:55:51.736 INFO:tasks.workunit.client.1.smithi089.stdout:1/194: mknod d0/d9/c40 0 2024-08-01T06:55:51.737 INFO:tasks.workunit.client.1.smithi089.stdout:4/154: dread d3/db/d16/f9 [0,4194304] 0 2024-08-01T06:55:51.737 INFO:tasks.workunit.client.1.smithi089.stdout:0/220: dread f7 [0,4194304] 0 2024-08-01T06:55:51.738 INFO:tasks.workunit.client.1.smithi089.stdout:3/119: creat d7/f1f x:0 0 0 2024-08-01T06:55:51.741 INFO:tasks.workunit.client.1.smithi089.stdout:2/142: dread d7/fa [0,4194304] 0 2024-08-01T06:55:51.743 INFO:tasks.workunit.client.1.smithi089.stdout:2/143: fsync d7/f10 0 2024-08-01T06:55:51.746 INFO:tasks.workunit.client.1.smithi089.stdout:8/167: creat d5/dc/d1e/f34 x:0 0 0 2024-08-01T06:55:51.747 INFO:tasks.workunit.client.1.smithi089.stdout:4/155: dwrite d3/d29/f2a [0,4194304] 0 2024-08-01T06:55:51.747 INFO:tasks.workunit.client.1.smithi089.stdout:3/120: dwrite d7/dd/f1a [0,4194304] 0 2024-08-01T06:55:51.750 INFO:tasks.workunit.client.1.smithi089.stdout:5/133: sync 2024-08-01T06:55:51.761 INFO:tasks.workunit.client.1.smithi089.stdout:0/221: chown d9/d40/d26/d2e/f42 1918 1 2024-08-01T06:55:51.763 INFO:tasks.workunit.client.1.smithi089.stdout:1/195: dwrite d0/f6 [4194304,4194304] 0 2024-08-01T06:55:51.769 INFO:tasks.workunit.client.1.smithi089.stdout:1/196: dwrite d0/f11 [4194304,4194304] 0 2024-08-01T06:55:51.770 INFO:tasks.workunit.client.1.smithi089.stdout:1/197: fsync d0/d9/d15/d3b/f3c 0 2024-08-01T06:55:51.771 INFO:tasks.workunit.client.1.smithi089.stdout:2/144: symlink d7/d1f/d28/l2c 0 2024-08-01T06:55:51.781 INFO:tasks.workunit.client.1.smithi089.stdout:4/156: rename d3/d17/f28 to d3/d29/f37 0 2024-08-01T06:55:51.782 INFO:tasks.workunit.client.1.smithi089.stdout:8/168: truncate d5/dc/f9 2387114 0 2024-08-01T06:55:51.783 INFO:tasks.workunit.client.1.smithi089.stdout:8/169: write d5/dc/d12/f14 [2349343,13131] 0 2024-08-01T06:55:51.785 INFO:tasks.workunit.client.1.smithi089.stdout:5/134: rmdir d5 39 2024-08-01T06:55:51.786 INFO:tasks.workunit.client.1.smithi089.stdout:7/163: truncate d7/df/d10/d36/f38 1484661 0 2024-08-01T06:55:51.787 INFO:tasks.workunit.client.1.smithi089.stdout:7/164: readlink d7/df/l3e 0 2024-08-01T06:55:51.790 INFO:tasks.workunit.client.1.smithi089.stdout:9/155: write f12 [3300397,59471] 0 2024-08-01T06:55:51.791 INFO:tasks.workunit.client.1.smithi089.stdout:8/170: dwrite d5/dc/d1e/f2b [0,4194304] 0 2024-08-01T06:55:51.791 INFO:tasks.workunit.client.1.smithi089.stdout:6/232: rmdir d2/d2e/d2f/d53 0 2024-08-01T06:55:51.794 INFO:tasks.workunit.client.1.smithi089.stdout:1/198: rename d0/d9/d15 to d0/d9/d15/d41 22 2024-08-01T06:55:51.796 INFO:tasks.workunit.client.1.smithi089.stdout:1/199: fsync d0/f6 0 2024-08-01T06:55:51.800 INFO:tasks.workunit.client.1.smithi089.stdout:6/233: dwrite d2/f2b [0,4194304] 0 2024-08-01T06:55:51.802 INFO:tasks.workunit.client.1.smithi089.stdout:1/200: dread d0/d9/d15/d2d/f33 [0,4194304] 0 2024-08-01T06:55:51.803 INFO:tasks.workunit.client.1.smithi089.stdout:7/165: creat d7/d1f/f40 x:0 0 0 2024-08-01T06:55:51.809 INFO:tasks.workunit.client.1.smithi089.stdout:8/171: rmdir d5/d2c 39 2024-08-01T06:55:51.812 INFO:tasks.workunit.client.1.smithi089.stdout:2/145: rename d7/d19/l1c to d7/d19/d1e/l2d 0 2024-08-01T06:55:51.814 INFO:tasks.workunit.client.1.smithi089.stdout:9/156: dwrite d18/f2a [0,4194304] 0 2024-08-01T06:55:51.817 INFO:tasks.workunit.client.1.smithi089.stdout:4/157: truncate d3/d1e/f25 915791 0 2024-08-01T06:55:51.818 INFO:tasks.workunit.client.1.smithi089.stdout:3/121: truncate d7/dd/f1a 722133 0 2024-08-01T06:55:51.822 INFO:tasks.workunit.client.1.smithi089.stdout:6/234: symlink d2/d11/d1a/d1c/l55 0 2024-08-01T06:55:51.851 INFO:tasks.workunit.client.1.smithi089.stdout:1/201: symlink d0/l42 0 2024-08-01T06:55:51.851 INFO:tasks.workunit.client.1.smithi089.stdout:5/135: rename d5/d13/f27 to d5/de/d10/d16/d1b/f2e 0 2024-08-01T06:55:51.853 INFO:tasks.workunit.client.1.smithi089.stdout:9/157: symlink d18/l32 0 2024-08-01T06:55:51.854 INFO:tasks.workunit.client.1.smithi089.stdout:4/158: creat d3/d1e/d21/d26/f38 x:0 0 0 2024-08-01T06:55:51.856 INFO:tasks.workunit.client.1.smithi089.stdout:5/136: write d5/de/d10/f2c [347422,91585] 0 2024-08-01T06:55:51.858 INFO:tasks.workunit.client.1.smithi089.stdout:7/166: creat d7/d1f/d3a/f41 x:0 0 0 2024-08-01T06:55:51.861 INFO:tasks.workunit.client.1.smithi089.stdout:0/222: dwrite d9/f18 [0,4194304] 0 2024-08-01T06:55:51.862 INFO:tasks.workunit.client.1.smithi089.stdout:1/202: mkdir d0/d9/d43 0 2024-08-01T06:55:51.862 INFO:tasks.workunit.client.1.smithi089.stdout:6/235: dwrite d2/d11/d1a/d1c/f52 [0,4194304] 0 2024-08-01T06:55:51.863 INFO:tasks.workunit.client.1.smithi089.stdout:9/158: truncate f10 1008032 0 2024-08-01T06:55:51.865 INFO:tasks.workunit.client.1.smithi089.stdout:3/122: dread d7/dd/d10/f13 [0,4194304] 0 2024-08-01T06:55:51.870 INFO:tasks.workunit.client.1.smithi089.stdout:7/167: dread d7/fb [0,4194304] 0 2024-08-01T06:55:51.872 INFO:tasks.workunit.client.1.smithi089.stdout:0/223: dwrite d9/d40/d26/f3f [0,4194304] 0 2024-08-01T06:55:51.873 INFO:tasks.workunit.client.1.smithi089.stdout:0/224: chown d9/ff 11 1 2024-08-01T06:55:51.874 INFO:tasks.workunit.client.1.smithi089.stdout:6/236: mkdir d2/d11/d1f/d46/d56 0 2024-08-01T06:55:51.878 INFO:tasks.workunit.client.1.smithi089.stdout:5/137: rename d5/de/d10/d16/c23 to d5/de/d17/c2f 0 2024-08-01T06:55:51.879 INFO:tasks.workunit.client.1.smithi089.stdout:3/123: fdatasync d7/dd/d10/f13 0 2024-08-01T06:55:51.881 INFO:tasks.workunit.client.1.smithi089.stdout:2/146: truncate d7/d1f/d29/f1a 2623793 0 2024-08-01T06:55:51.883 INFO:tasks.workunit.client.1.smithi089.stdout:1/203: mknod d0/d9/d43/c44 0 2024-08-01T06:55:51.884 INFO:tasks.workunit.client.1.smithi089.stdout:1/204: fsync d0/f19 0 2024-08-01T06:55:51.886 INFO:tasks.workunit.client.1.smithi089.stdout:0/225: creat d9/d22/d2b/f48 x:0 0 0 2024-08-01T06:55:51.887 INFO:tasks.workunit.client.1.smithi089.stdout:6/237: mkdir d2/d30/d57 0 2024-08-01T06:55:51.891 INFO:tasks.workunit.client.1.smithi089.stdout:2/147: rename f4 to d7/d19/d1e/f2e 0 2024-08-01T06:55:51.891 INFO:tasks.workunit.client.1.smithi089.stdout:0/226: dread d9/f1f [0,4194304] 0 2024-08-01T06:55:51.892 INFO:tasks.workunit.client.1.smithi089.stdout:2/148: chown d7/d1f/c26 18626 1 2024-08-01T06:55:51.893 INFO:tasks.workunit.client.1.smithi089.stdout:1/205: symlink d0/d9/d15/d2d/l45 0 2024-08-01T06:55:51.893 INFO:tasks.workunit.client.1.smithi089.stdout:0/227: write d9/d22/d2b/f48 [426324,9398] 0 2024-08-01T06:55:51.896 INFO:tasks.workunit.client.1.smithi089.stdout:9/159: dread ff [0,4194304] 0 2024-08-01T06:55:51.896 INFO:tasks.workunit.client.1.smithi089.stdout:0/228: dread - d9/d40/d26/d2e/f42 zero size 2024-08-01T06:55:51.902 INFO:tasks.workunit.client.1.smithi089.stdout:3/124: fdatasync d7/dd/f1a 0 2024-08-01T06:55:51.902 INFO:tasks.workunit.client.1.smithi089.stdout:3/125: stat d7/dd/lf 0 2024-08-01T06:55:51.903 INFO:tasks.workunit.client.1.smithi089.stdout:9/160: chown f15 953 1 2024-08-01T06:55:51.904 INFO:tasks.workunit.client.1.smithi089.stdout:1/206: rename d0/d9/d1e/c31 to d0/d9/d15/d3b/d3d/c46 0 2024-08-01T06:55:51.908 INFO:tasks.workunit.client.1.smithi089.stdout:2/149: link d7/c13 d7/c2f 0 2024-08-01T06:55:51.910 INFO:tasks.workunit.client.1.smithi089.stdout:1/207: dwrite d0/f20 [0,4194304] 0 2024-08-01T06:55:51.913 INFO:tasks.workunit.client.1.smithi089.stdout:5/138: write d5/de/d10/f19 [582927,39149] 0 2024-08-01T06:55:51.916 INFO:tasks.workunit.client.1.smithi089.stdout:0/229: rename d9/f11 to d9/d40/d25/d46/f49 0 2024-08-01T06:55:51.918 INFO:tasks.workunit.client.1.smithi089.stdout:9/161: dwrite f16 [4194304,4194304] 0 2024-08-01T06:55:51.919 INFO:tasks.workunit.client.1.smithi089.stdout:6/238: getdents d2/d11/d1f 0 2024-08-01T06:55:51.919 INFO:tasks.workunit.client.1.smithi089.stdout:6/239: readlink d2/d11/l47 0 2024-08-01T06:55:51.920 INFO:tasks.workunit.client.1.smithi089.stdout:6/240: write d2/d11/f15 [1169585,458] 0 2024-08-01T06:55:51.921 INFO:tasks.workunit.client.1.smithi089.stdout:2/150: creat d7/d19/d1e/f30 x:0 0 0 2024-08-01T06:55:51.924 INFO:tasks.workunit.client.1.smithi089.stdout:1/208: dread d0/f24 [0,4194304] 0 2024-08-01T06:55:51.927 INFO:tasks.workunit.client.1.smithi089.stdout:5/139: creat d5/d13/f30 x:0 0 0 2024-08-01T06:55:51.928 INFO:tasks.workunit.client.1.smithi089.stdout:0/230: rmdir d9/d40/d26/d2e 39 2024-08-01T06:55:51.928 INFO:tasks.workunit.client.1.smithi089.stdout:5/140: chown d5/d13 27211 1 2024-08-01T06:55:51.928 INFO:tasks.workunit.client.1.smithi089.stdout:7/168: dwrite d7/df/d10/d36/f38 [0,4194304] 0 2024-08-01T06:55:51.929 INFO:tasks.workunit.client.1.smithi089.stdout:0/231: stat d9/d40/d25/d46/f28 0 2024-08-01T06:55:51.930 INFO:tasks.workunit.client.1.smithi089.stdout:5/141: dread - d5/de/d10/d16/d1b/f22 zero size 2024-08-01T06:55:51.932 INFO:tasks.workunit.client.1.smithi089.stdout:0/232: write d9/d22/f29 [219255,45192] 0 2024-08-01T06:55:51.932 INFO:tasks.workunit.client.1.smithi089.stdout:5/142: read - d5/d13/f30 zero size 2024-08-01T06:55:51.932 INFO:tasks.workunit.client.1.smithi089.stdout:0/233: rename d9/d40 to d9/d40/d25/d4a 22 2024-08-01T06:55:51.935 INFO:tasks.workunit.client.1.smithi089.stdout:3/126: creat d7/dd/f20 x:0 0 0 2024-08-01T06:55:51.937 INFO:tasks.workunit.client.1.smithi089.stdout:9/162: dwrite f12 [0,4194304] 0 2024-08-01T06:55:51.940 INFO:tasks.workunit.client.1.smithi089.stdout:7/169: mkdir d7/df/d10/d42 0 2024-08-01T06:55:51.941 INFO:tasks.workunit.client.1.smithi089.stdout:7/170: write d7/d1f/f1d [718074,22706] 0 2024-08-01T06:55:51.944 INFO:tasks.workunit.client.1.smithi089.stdout:5/143: fdatasync f0 0 2024-08-01T06:55:51.948 INFO:tasks.workunit.client.1.smithi089.stdout:2/151: write d7/d1f/d29/f15 [1723818,2345] 0 2024-08-01T06:55:51.950 INFO:tasks.workunit.client.1.smithi089.stdout:3/127: symlink d7/dd/d10/l21 0 2024-08-01T06:55:51.951 INFO:tasks.workunit.client.1.smithi089.stdout:1/209: creat d0/d9/d15/d3b/d3f/f47 x:0 0 0 2024-08-01T06:55:51.952 INFO:tasks.workunit.client.1.smithi089.stdout:9/163: mkdir d18/d33 0 2024-08-01T06:55:51.952 INFO:tasks.workunit.client.1.smithi089.stdout:1/210: write d0/d9/d15/d3b/d3f/f47 [802670,109895] 0 2024-08-01T06:55:51.953 INFO:tasks.workunit.client.1.smithi089.stdout:3/128: dread d7/dd/d10/f13 [0,4194304] 0 2024-08-01T06:55:51.957 INFO:tasks.workunit.client.1.smithi089.stdout:7/171: mkdir d7/df/d10/d31/d43 0 2024-08-01T06:55:51.958 INFO:tasks.workunit.client.1.smithi089.stdout:3/129: truncate d7/dd/d10/f13 2550231 0 2024-08-01T06:55:51.960 INFO:tasks.workunit.client.1.smithi089.stdout:1/211: dread d0/f13 [0,4194304] 0 2024-08-01T06:55:51.960 INFO:tasks.workunit.client.1.smithi089.stdout:7/172: creat d7/df/d10/d36/f44 x:0 0 0 2024-08-01T06:55:51.961 INFO:tasks.workunit.client.1.smithi089.stdout:3/130: symlink d7/dd/d10/l22 0 2024-08-01T06:55:51.962 INFO:tasks.workunit.client.1.smithi089.stdout:1/212: symlink d0/d9/d15/d3b/d3f/l48 0 2024-08-01T06:55:51.963 INFO:tasks.workunit.client.1.smithi089.stdout:7/173: creat d7/df/d10/d31/f45 x:0 0 0 2024-08-01T06:55:51.964 INFO:tasks.workunit.client.1.smithi089.stdout:3/131: mkdir d7/dd/d10/d23 0 2024-08-01T06:55:51.965 INFO:tasks.workunit.client.1.smithi089.stdout:1/213: mkdir d0/d9/d1e/d49 0 2024-08-01T06:55:51.966 INFO:tasks.workunit.client.1.smithi089.stdout:3/132: mkdir d7/dd/d10/d24 0 2024-08-01T06:55:51.967 INFO:tasks.workunit.client.1.smithi089.stdout:3/133: dread - d7/dd/f20 zero size 2024-08-01T06:55:51.971 INFO:tasks.workunit.client.1.smithi089.stdout:1/214: getdents d0 0 2024-08-01T06:55:51.972 INFO:tasks.workunit.client.1.smithi089.stdout:3/134: creat d7/dd/f25 x:0 0 0 2024-08-01T06:55:51.977 INFO:tasks.workunit.client.1.smithi089.stdout:3/135: link d7/dd/f15 d7/dd/d10/d12/d1b/f26 0 2024-08-01T06:55:51.977 INFO:tasks.workunit.client.1.smithi089.stdout:3/136: readlink d7/l9 0 2024-08-01T06:55:52.017 INFO:tasks.workunit.client.1.smithi089.stdout:6/241: truncate d2/f5 3011953 0 2024-08-01T06:55:52.022 INFO:tasks.workunit.client.1.smithi089.stdout:5/144: write d5/de/f14 [2456478,115352] 0 2024-08-01T06:55:52.025 INFO:tasks.workunit.client.1.smithi089.stdout:2/152: truncate d7/d19/d1e/f2e 660037 0 2024-08-01T06:55:52.030 INFO:tasks.workunit.client.1.smithi089.stdout:9/164: dwrite f17 [0,4194304] 0 2024-08-01T06:55:52.032 INFO:tasks.workunit.client.1.smithi089.stdout:1/215: rename d0/d9/d15/d3b/d3f to d0/d9/d15/d2d/d4a 0 2024-08-01T06:55:52.032 INFO:tasks.workunit.client.1.smithi089.stdout:2/153: mknod d7/d1f/c31 0 2024-08-01T06:55:52.033 INFO:tasks.workunit.client.1.smithi089.stdout:2/154: chown d7/d1f/d28/l2c 0 1 2024-08-01T06:55:52.041 INFO:tasks.workunit.client.1.smithi089.stdout:7/174: truncate d7/d1f/f1a 543246 0 2024-08-01T06:55:52.041 INFO:tasks.workunit.client.1.smithi089.stdout:7/175: truncate d7/d1f/f3f 5572 0 2024-08-01T06:55:52.042 INFO:tasks.workunit.client.1.smithi089.stdout:1/216: mkdir d0/d9/d43/d4b 0 2024-08-01T06:55:52.042 INFO:tasks.workunit.client.1.smithi089.stdout:7/176: fdatasync d7/df/d10/f24 0 2024-08-01T06:55:52.042 INFO:tasks.workunit.client.1.smithi089.stdout:1/217: stat d0/f8 0 2024-08-01T06:55:52.044 INFO:tasks.workunit.client.1.smithi089.stdout:9/165: creat d18/d33/f34 x:0 0 0 2024-08-01T06:55:52.049 INFO:tasks.workunit.client.1.smithi089.stdout:3/137: fsync d7/dd/f15 0 2024-08-01T06:55:52.049 INFO:tasks.workunit.client.1.smithi089.stdout:3/138: readlink l4 0 2024-08-01T06:55:52.054 INFO:tasks.workunit.client.1.smithi089.stdout:1/218: creat d0/d9/d15/d2d/d4a/f4c x:0 0 0 2024-08-01T06:55:52.054 INFO:tasks.workunit.client.1.smithi089.stdout:9/166: creat d18/d22/f35 x:0 0 0 2024-08-01T06:55:52.055 INFO:tasks.workunit.client.1.smithi089.stdout:9/167: chown f16 21 1 2024-08-01T06:55:52.059 INFO:tasks.workunit.client.1.smithi089.stdout:9/168: dwrite f16 [4194304,4194304] 0 2024-08-01T06:55:52.059 INFO:tasks.workunit.client.1.smithi089.stdout:7/177: mkdir d7/d46 0 2024-08-01T06:55:52.060 INFO:tasks.workunit.client.1.smithi089.stdout:7/178: chown f4 6640 1 2024-08-01T06:55:52.062 INFO:tasks.workunit.client.1.smithi089.stdout:1/219: mkdir d0/d9/d15/d2d/d4a/d4d 0 2024-08-01T06:55:52.073 INFO:tasks.workunit.client.1.smithi089.stdout:7/179: creat d7/df/d10/d36/f47 x:0 0 0 2024-08-01T06:55:52.075 INFO:tasks.workunit.client.1.smithi089.stdout:6/242: dwrite d2/d11/d1f/f50 [0,4194304] 0 2024-08-01T06:55:52.077 INFO:tasks.workunit.client.1.smithi089.stdout:3/139: link l4 d7/dd/d10/d23/l27 0 2024-08-01T06:55:52.078 INFO:tasks.workunit.client.1.smithi089.stdout:3/140: dread - d7/dd/f20 zero size 2024-08-01T06:55:52.078 INFO:tasks.workunit.client.1.smithi089.stdout:5/145: dwrite f0 [0,4194304] 0 2024-08-01T06:55:52.079 INFO:tasks.workunit.client.1.smithi089.stdout:3/141: chown d7/f1f 39322519 1 2024-08-01T06:55:52.084 INFO:tasks.workunit.client.1.smithi089.stdout:6/243: dwrite d2/f2b [0,4194304] 0 2024-08-01T06:55:52.088 INFO:tasks.workunit.client.1.smithi089.stdout:5/146: dwrite d5/d13/f30 [0,4194304] 0 2024-08-01T06:55:52.090 INFO:tasks.workunit.client.1.smithi089.stdout:1/220: mknod d0/d9/d15/d2d/d4a/d4d/c4e 0 2024-08-01T06:55:52.090 INFO:tasks.workunit.client.1.smithi089.stdout:5/147: fsync d5/de/d10/f19 0 2024-08-01T06:55:52.092 INFO:tasks.workunit.client.1.smithi089.stdout:1/221: write d0/d9/d15/d3b/f3c [687169,78604] 0 2024-08-01T06:55:52.105 INFO:tasks.workunit.client.1.smithi089.stdout:3/142: symlink d7/dd/d10/d23/l28 0 2024-08-01T06:55:52.107 INFO:tasks.workunit.client.1.smithi089.stdout:1/222: mknod d0/d9/d15/d3b/d3d/c4f 0 2024-08-01T06:55:52.108 INFO:tasks.workunit.client.1.smithi089.stdout:6/244: creat d2/d11/d1f/d46/d56/f58 x:0 0 0 2024-08-01T06:55:52.110 INFO:tasks.workunit.client.1.smithi089.stdout:1/223: dread d0/f20 [0,4194304] 0 2024-08-01T06:55:52.111 INFO:tasks.workunit.client.1.smithi089.stdout:3/143: mkdir d7/dd/d10/d12/d29 0 2024-08-01T06:55:52.115 INFO:tasks.workunit.client.1.smithi089.stdout:9/169: truncate d18/f23 1930950 0 2024-08-01T06:55:52.116 INFO:tasks.workunit.client.1.smithi089.stdout:1/224: dwrite d0/d9/d15/d2d/d4a/f4c [0,4194304] 0 2024-08-01T06:55:52.120 INFO:tasks.workunit.client.1.smithi089.stdout:6/245: link d2/d11/d1a/l4c d2/d30/l59 0 2024-08-01T06:55:52.122 INFO:tasks.workunit.client.1.smithi089.stdout:1/225: dread - d0/d9/d15/f34 zero size 2024-08-01T06:55:52.129 INFO:tasks.workunit.client.1.smithi089.stdout:6/246: creat d2/d11/d1f/f5a x:0 0 0 2024-08-01T06:55:52.133 INFO:tasks.workunit.client.1.smithi089.stdout:8/172: sync 2024-08-01T06:55:52.134 INFO:tasks.workunit.client.1.smithi089.stdout:1/226: unlink d0/d9/c25 0 2024-08-01T06:55:52.135 INFO:tasks.workunit.client.1.smithi089.stdout:3/144: link d7/dd/d10/d23/l28 d7/dd/d10/d24/l2a 0 2024-08-01T06:55:52.136 INFO:tasks.workunit.client.1.smithi089.stdout:9/170: link d18/l2c d18/d33/l36 0 2024-08-01T06:55:52.139 INFO:tasks.workunit.client.1.smithi089.stdout:9/171: dread d18/f21 [0,4194304] 0 2024-08-01T06:55:52.141 INFO:tasks.workunit.client.1.smithi089.stdout:8/173: fdatasync d5/ff 0 2024-08-01T06:55:52.141 INFO:tasks.workunit.client.1.smithi089.stdout:7/180: truncate d7/df/f11 3878877 0 2024-08-01T06:55:52.144 INFO:tasks.workunit.client.1.smithi089.stdout:3/145: unlink d7/dd/f25 0 2024-08-01T06:55:52.146 INFO:tasks.workunit.client.1.smithi089.stdout:6/247: fsync d2/d11/d1f/d46/d56/f58 0 2024-08-01T06:55:52.148 INFO:tasks.workunit.client.1.smithi089.stdout:9/172: rename d18/f2d to d18/d33/f37 0 2024-08-01T06:55:52.151 INFO:tasks.workunit.client.1.smithi089.stdout:8/174: rmdir d5 39 2024-08-01T06:55:52.152 INFO:tasks.workunit.client.1.smithi089.stdout:5/148: dwrite d5/de/d10/d16/d1b/f2e [0,4194304] 0 2024-08-01T06:55:52.166 INFO:tasks.workunit.client.1.smithi089.stdout:9/173: creat d18/d22/f38 x:0 0 0 2024-08-01T06:55:52.167 INFO:tasks.workunit.client.1.smithi089.stdout:8/175: chown d5/dc 2371416 1 2024-08-01T06:55:52.167 INFO:tasks.workunit.client.1.smithi089.stdout:8/176: read f2 [7519925,111573] 0 2024-08-01T06:55:52.168 INFO:tasks.workunit.client.1.smithi089.stdout:7/181: getdents d7/d46 0 2024-08-01T06:55:52.170 INFO:tasks.workunit.client.1.smithi089.stdout:5/149: rename d5/de/d10/d16/d1b/f24 to d5/d13/f31 0 2024-08-01T06:55:52.175 INFO:tasks.workunit.client.1.smithi089.stdout:6/248: truncate d2/f8 3062022 0 2024-08-01T06:55:52.176 INFO:tasks.workunit.client.1.smithi089.stdout:6/249: truncate d2/d11/f51 129469 0 2024-08-01T06:55:52.176 INFO:tasks.workunit.client.1.smithi089.stdout:2/155: sync 2024-08-01T06:55:52.176 INFO:tasks.workunit.client.1.smithi089.stdout:0/234: sync 2024-08-01T06:55:52.176 INFO:tasks.workunit.client.1.smithi089.stdout:4/159: sync 2024-08-01T06:55:52.178 INFO:tasks.workunit.client.1.smithi089.stdout:2/156: truncate d7/d1f/d29/f15 4683689 0 2024-08-01T06:55:52.181 INFO:tasks.workunit.client.1.smithi089.stdout:8/177: creat d5/dc/d12/f35 x:0 0 0 2024-08-01T06:55:52.181 INFO:tasks.workunit.client.1.smithi089.stdout:9/174: dwrite f4 [0,4194304] 0 2024-08-01T06:55:52.263 INFO:tasks.workunit.client.1.smithi089.stdout:5/150: mknod d5/de/d10/d16/c32 0 2024-08-01T06:55:52.265 INFO:tasks.workunit.client.1.smithi089.stdout:7/182: creat d7/df/d10/d42/f48 x:0 0 0 2024-08-01T06:55:52.266 INFO:tasks.workunit.client.1.smithi089.stdout:9/175: mkdir d18/d22/d39 0 2024-08-01T06:55:52.266 INFO:tasks.workunit.client.1.smithi089.stdout:2/157: dread f5 [0,4194304] 0 2024-08-01T06:55:52.268 INFO:tasks.workunit.client.1.smithi089.stdout:7/183: read d7/d1f/f3f [182,34420] 0 2024-08-01T06:55:52.269 INFO:tasks.workunit.client.1.smithi089.stdout:3/146: link d7/dd/d10/l1e d7/dd/d10/d12/l2b 0 2024-08-01T06:55:52.269 INFO:tasks.workunit.client.1.smithi089.stdout:2/158: read f2 [1238433,70599] 0 2024-08-01T06:55:52.269 INFO:tasks.workunit.client.1.smithi089.stdout:1/227: dwrite d0/f24 [0,4194304] 0 2024-08-01T06:55:52.271 INFO:tasks.workunit.client.1.smithi089.stdout:4/160: truncate d3/db/d16/f1a 132474 0 2024-08-01T06:55:52.272 INFO:tasks.workunit.client.1.smithi089.stdout:2/159: read f2 [2738159,126143] 0 2024-08-01T06:55:52.272 INFO:tasks.workunit.client.1.smithi089.stdout:5/151: mkdir d5/de/d10/d33 0 2024-08-01T06:55:52.272 INFO:tasks.workunit.client.1.smithi089.stdout:4/161: chown d3/db/de/l19 14633885 1 2024-08-01T06:55:52.274 INFO:tasks.workunit.client.1.smithi089.stdout:2/160: chown d7/d19/l22 0 1 2024-08-01T06:55:52.276 INFO:tasks.workunit.client.1.smithi089.stdout:1/228: dread d0/d9/d15/d3b/f3c [0,4194304] 0 2024-08-01T06:55:52.279 INFO:tasks.workunit.client.1.smithi089.stdout:8/178: rename d5/dc/f9 to d5/d23/f36 0 2024-08-01T06:55:52.283 INFO:tasks.workunit.client.1.smithi089.stdout:8/179: dread d5/dc/f11 [0,4194304] 0 2024-08-01T06:55:52.288 INFO:tasks.workunit.client.1.smithi089.stdout:4/162: dread d3/db/f13 [0,4194304] 0 2024-08-01T06:55:52.288 INFO:tasks.workunit.client.1.smithi089.stdout:6/250: link d2/d11/d1f/l22 d2/d2e/d2f/d31/l5b 0 2024-08-01T06:55:52.289 INFO:tasks.workunit.client.1.smithi089.stdout:4/163: truncate d3/d29/f37 1022085 0 2024-08-01T06:55:52.289 INFO:tasks.workunit.client.1.smithi089.stdout:6/251: fsync d2/d11/d1a/f33 0 2024-08-01T06:55:52.289 INFO:tasks.workunit.client.1.smithi089.stdout:4/164: fsync d3/d29/f2a 0 2024-08-01T06:55:52.291 INFO:tasks.workunit.client.1.smithi089.stdout:7/184: symlink d7/df/d10/d31/l49 0 2024-08-01T06:55:52.291 INFO:tasks.workunit.client.1.smithi089.stdout:9/176: dread f5 [0,4194304] 0 2024-08-01T06:55:52.317 INFO:tasks.workunit.client.1.smithi089.stdout:2/161: symlink d7/d19/l32 0 2024-08-01T06:55:52.317 INFO:tasks.workunit.client.1.smithi089.stdout:4/165: creat d3/db/f39 x:0 0 0 2024-08-01T06:55:52.318 INFO:tasks.workunit.client.1.smithi089.stdout:9/177: read d18/f1b [3658622,20533] 0 2024-08-01T06:55:52.319 INFO:tasks.workunit.client.1.smithi089.stdout:9/178: dread - d18/d22/f35 zero size 2024-08-01T06:55:52.320 INFO:tasks.workunit.client.1.smithi089.stdout:9/179: chown d18/f21 457902318 1 2024-08-01T06:55:52.320 INFO:tasks.workunit.client.1.smithi089.stdout:6/252: dwrite d2/f2a [0,4194304] 0 2024-08-01T06:55:52.321 INFO:tasks.workunit.client.1.smithi089.stdout:7/185: fsync d7/d1f/f3f 0 2024-08-01T06:55:52.328 INFO:tasks.workunit.client.1.smithi089.stdout:4/166: mkdir d3/d17/d3a 0 2024-08-01T06:55:52.328 INFO:tasks.workunit.client.1.smithi089.stdout:4/167: readlink d3/db/de/l14 0 2024-08-01T06:55:52.329 INFO:tasks.workunit.client.1.smithi089.stdout:2/162: rename d7/d1f/d29/cf to d7/c33 0 2024-08-01T06:55:52.329 INFO:tasks.workunit.client.1.smithi089.stdout:2/163: dread - d7/d1f/f20 zero size 2024-08-01T06:55:52.330 INFO:tasks.workunit.client.1.smithi089.stdout:2/164: fdatasync d7/f10 0 2024-08-01T06:55:52.336 INFO:tasks.workunit.client.1.smithi089.stdout:7/186: rmdir d7/d1f/d3a 39 2024-08-01T06:55:52.340 INFO:tasks.workunit.client.1.smithi089.stdout:5/152: creat d5/de/f34 x:0 0 0 2024-08-01T06:55:52.347 INFO:tasks.workunit.client.1.smithi089.stdout:6/253: symlink d2/d2e/l5c 0 2024-08-01T06:55:52.351 INFO:tasks.workunit.client.1.smithi089.stdout:9/180: creat d18/d22/d39/f3a x:0 0 0 2024-08-01T06:55:52.352 INFO:tasks.workunit.client.1.smithi089.stdout:7/187: mkdir d7/df/d10/d31/d4a 0 2024-08-01T06:55:52.352 INFO:tasks.workunit.client.1.smithi089.stdout:7/188: chown d7/d15/f2d 12439 1 2024-08-01T06:55:52.353 INFO:tasks.workunit.client.1.smithi089.stdout:5/153: mknod d5/de/d17/c35 0 2024-08-01T06:55:52.354 INFO:tasks.workunit.client.1.smithi089.stdout:5/154: readlink d5/de/d17/l21 0 2024-08-01T06:55:52.355 INFO:tasks.workunit.client.1.smithi089.stdout:1/229: getdents d0/d9/d15 0 2024-08-01T06:55:52.363 INFO:tasks.workunit.client.1.smithi089.stdout:2/165: link d7/d1f/d28/c2a d7/d1f/c34 0 2024-08-01T06:55:52.366 INFO:tasks.workunit.client.1.smithi089.stdout:2/166: dread d7/f10 [0,4194304] 0 2024-08-01T06:55:52.367 INFO:tasks.workunit.client.1.smithi089.stdout:7/189: mknod d7/c4b 0 2024-08-01T06:55:52.368 INFO:tasks.workunit.client.1.smithi089.stdout:7/190: chown d7/df/d10/c12 16784 1 2024-08-01T06:55:52.369 INFO:tasks.workunit.client.1.smithi089.stdout:5/155: mknod d5/de/d10/d16/d1b/d25/c36 0 2024-08-01T06:55:52.370 INFO:tasks.workunit.client.1.smithi089.stdout:5/156: write d5/de/f14 [2550595,93293] 0 2024-08-01T06:55:52.370 INFO:tasks.workunit.client.1.smithi089.stdout:6/254: rmdir d2/d30/d57 0 2024-08-01T06:55:52.373 INFO:tasks.workunit.client.1.smithi089.stdout:5/157: read d5/de/d10/f1c [82248,85088] 0 2024-08-01T06:55:52.374 INFO:tasks.workunit.client.1.smithi089.stdout:7/191: dwrite d7/df/d10/f35 [0,4194304] 0 2024-08-01T06:55:52.381 INFO:tasks.workunit.client.1.smithi089.stdout:6/255: symlink d2/d11/d1a/d1c/d40/l5d 0 2024-08-01T06:55:52.383 INFO:tasks.workunit.client.1.smithi089.stdout:0/235: sync 2024-08-01T06:55:52.388 INFO:tasks.workunit.client.1.smithi089.stdout:6/256: creat d2/d11/d1a/d1c/d40/f5e x:0 0 0 2024-08-01T06:55:52.391 INFO:tasks.workunit.client.1.smithi089.stdout:0/236: dwrite d9/d40/d25/d46/f38 [0,4194304] 0 2024-08-01T06:55:52.391 INFO:tasks.workunit.client.1.smithi089.stdout:0/237: chown d9/l2d 53490007 1 2024-08-01T06:55:52.393 INFO:tasks.workunit.client.1.smithi089.stdout:5/158: dread d5/de/d10/f11 [0,4194304] 0 2024-08-01T06:55:52.394 INFO:tasks.workunit.client.1.smithi089.stdout:6/257: creat d2/d11/d1a/d1c/d40/f5f x:0 0 0 2024-08-01T06:55:52.395 INFO:tasks.workunit.client.1.smithi089.stdout:6/258: chown d2/d2e 13231 1 2024-08-01T06:55:52.396 INFO:tasks.workunit.client.1.smithi089.stdout:3/147: write d7/dd/f1a [831574,112674] 0 2024-08-01T06:55:52.397 INFO:tasks.workunit.client.1.smithi089.stdout:7/192: getdents d7/df 0 2024-08-01T06:55:52.398 INFO:tasks.workunit.client.1.smithi089.stdout:7/193: chown d7/d1f/f1d 225742 1 2024-08-01T06:55:52.402 INFO:tasks.workunit.client.1.smithi089.stdout:0/238: rename d9/d40/d25/d46/f1c to d9/d40/d26/d2e/f4b 0 2024-08-01T06:55:52.404 INFO:tasks.workunit.client.1.smithi089.stdout:3/148: truncate d7/dd/f15 1836105 0 2024-08-01T06:55:52.405 INFO:tasks.workunit.client.1.smithi089.stdout:5/159: symlink d5/de/d10/d33/l37 0 2024-08-01T06:55:52.407 INFO:tasks.workunit.client.1.smithi089.stdout:3/149: dread d7/dd/f1a [0,4194304] 0 2024-08-01T06:55:52.408 INFO:tasks.workunit.client.1.smithi089.stdout:5/160: write d5/de/d10/f19 [1302857,49802] 0 2024-08-01T06:55:52.408 INFO:tasks.workunit.client.1.smithi089.stdout:3/150: dread - d7/dd/f20 zero size 2024-08-01T06:55:52.409 INFO:tasks.workunit.client.1.smithi089.stdout:0/239: dwrite d9/ff [0,4194304] 0 2024-08-01T06:55:52.411 INFO:tasks.workunit.client.1.smithi089.stdout:3/151: chown d7/dd/lf 25 1 2024-08-01T06:55:52.416 INFO:tasks.workunit.client.1.smithi089.stdout:7/194: unlink d7/df/d10/c13 0 2024-08-01T06:55:52.427 INFO:tasks.workunit.client.1.smithi089.stdout:6/259: getdents d2/d11/d3e 0 2024-08-01T06:55:52.428 INFO:tasks.workunit.client.1.smithi089.stdout:0/240: symlink d9/d40/l4c 0 2024-08-01T06:55:52.430 INFO:tasks.workunit.client.1.smithi089.stdout:0/241: dread - d9/d22/f34 zero size 2024-08-01T06:55:52.431 INFO:tasks.workunit.client.1.smithi089.stdout:7/195: dwrite d7/d1f/d3a/f41 [0,4194304] 0 2024-08-01T06:55:52.434 INFO:tasks.workunit.client.1.smithi089.stdout:0/242: creat d9/d40/d26/d2e/f4d x:0 0 0 2024-08-01T06:55:52.436 INFO:tasks.workunit.client.1.smithi089.stdout:7/196: mkdir d7/d1f/d30/d4c 0 2024-08-01T06:55:52.439 INFO:tasks.workunit.client.1.smithi089.stdout:7/197: write d7/fa [1883384,130305] 0 2024-08-01T06:55:52.439 INFO:tasks.workunit.client.1.smithi089.stdout:0/243: mknod d9/c4e 0 2024-08-01T06:55:52.439 INFO:tasks.workunit.client.1.smithi089.stdout:0/244: chown d9/f33 8823 1 2024-08-01T06:55:52.440 INFO:tasks.workunit.client.1.smithi089.stdout:0/245: fsync d9/d40/d26/f3f 0 2024-08-01T06:55:52.443 INFO:tasks.workunit.client.1.smithi089.stdout:7/198: dwrite f3 [0,4194304] 0 2024-08-01T06:55:52.444 INFO:tasks.workunit.client.1.smithi089.stdout:7/199: dread - d7/df/f2f zero size 2024-08-01T06:55:52.446 INFO:tasks.workunit.client.1.smithi089.stdout:4/168: write d3/db/d16/f9 [2390891,108385] 0 2024-08-01T06:55:52.451 INFO:tasks.workunit.client.1.smithi089.stdout:7/200: dwrite d7/df/d10/d36/f47 [0,4194304] 0 2024-08-01T06:55:52.454 INFO:tasks.workunit.client.1.smithi089.stdout:5/161: rename d5/de/d17 to d5/d13/d38 0 2024-08-01T06:55:52.459 INFO:tasks.workunit.client.1.smithi089.stdout:5/162: dread d5/de/d10/f11 [0,4194304] 0 2024-08-01T06:55:52.460 INFO:tasks.workunit.client.1.smithi089.stdout:0/246: rename d9/d40/d26/f2c to d9/f4f 0 2024-08-01T06:55:52.460 INFO:tasks.workunit.client.1.smithi089.stdout:0/247: write d9/ff [4141336,7832] 0 2024-08-01T06:55:52.462 INFO:tasks.workunit.client.1.smithi089.stdout:9/181: write d18/f31 [271035,91443] 0 2024-08-01T06:55:52.465 INFO:tasks.workunit.client.1.smithi089.stdout:7/201: link d7/d15/l26 d7/d1f/d30/d4c/l4d 0 2024-08-01T06:55:52.465 INFO:tasks.workunit.client.1.smithi089.stdout:7/202: truncate d7/d1f/f40 238083 0 2024-08-01T06:55:52.466 INFO:tasks.workunit.client.1.smithi089.stdout:7/203: chown d7/d15/f25 285 1 2024-08-01T06:55:52.466 INFO:tasks.workunit.client.1.smithi089.stdout:9/182: truncate f15 1295030 0 2024-08-01T06:55:52.466 INFO:tasks.workunit.client.1.smithi089.stdout:7/204: dread - d7/df/f2f zero size 2024-08-01T06:55:52.515 INFO:tasks.workunit.client.1.smithi089.stdout:7/205: truncate d7/df/f11 2611281 0 2024-08-01T06:55:52.516 INFO:tasks.workunit.client.1.smithi089.stdout:2/167: write d7/d19/d1e/f2e [1552629,124002] 0 2024-08-01T06:55:52.516 INFO:tasks.workunit.client.1.smithi089.stdout:7/206: fsync d7/d1f/f28 0 2024-08-01T06:55:52.516 INFO:tasks.workunit.client.1.smithi089.stdout:3/152: fsync d7/dd/d10/d12/d1b/f26 0 2024-08-01T06:55:52.517 INFO:tasks.workunit.client.1.smithi089.stdout:7/207: readlink d7/l9 0 2024-08-01T06:55:52.518 INFO:tasks.workunit.client.1.smithi089.stdout:2/168: fdatasync d7/d1f/d29/f15 0 2024-08-01T06:55:52.519 INFO:tasks.workunit.client.1.smithi089.stdout:0/248: truncate d9/d40/d26/f3f 759487 0 2024-08-01T06:55:52.519 INFO:tasks.workunit.client.1.smithi089.stdout:4/169: truncate d3/db/f10 2018417 0 2024-08-01T06:55:52.520 INFO:tasks.workunit.client.1.smithi089.stdout:7/208: read d7/d1f/f40 [84739,38241] 0 2024-08-01T06:55:52.520 INFO:tasks.workunit.client.1.smithi089.stdout:2/169: chown d7/d19/l32 10 1 2024-08-01T06:55:52.521 INFO:tasks.workunit.client.1.smithi089.stdout:0/249: write d9/d40/d25/d46/f1e [1041228,116260] 0 2024-08-01T06:55:52.521 INFO:tasks.workunit.client.1.smithi089.stdout:9/183: fsync d18/f23 0 2024-08-01T06:55:52.522 INFO:tasks.workunit.client.1.smithi089.stdout:3/153: read d7/dd/f1a [96118,78272] 0 2024-08-01T06:55:52.523 INFO:tasks.workunit.client.1.smithi089.stdout:9/184: read f17 [3201995,113663] 0 2024-08-01T06:55:52.523 INFO:tasks.workunit.client.1.smithi089.stdout:4/170: mkdir d3/d29/d3b 0 2024-08-01T06:55:52.524 INFO:tasks.workunit.client.1.smithi089.stdout:7/209: mkdir d7/df/d10/d42/d4e 0 2024-08-01T06:55:52.530 INFO:tasks.workunit.client.1.smithi089.stdout:3/154: rmdir d7/dd/d10/d24 39 2024-08-01T06:55:52.530 INFO:tasks.workunit.client.1.smithi089.stdout:0/250: write d9/d40/d26/d2e/f4b [1877482,47783] 0 2024-08-01T06:55:52.532 INFO:tasks.workunit.client.1.smithi089.stdout:9/185: mkdir d18/d33/d3b 0 2024-08-01T06:55:52.533 INFO:tasks.workunit.client.1.smithi089.stdout:2/170: dwrite f5 [0,4194304] 0 2024-08-01T06:55:52.533 INFO:tasks.workunit.client.1.smithi089.stdout:7/210: creat d7/df/d10/d31/f4f x:0 0 0 2024-08-01T06:55:52.535 INFO:tasks.workunit.client.1.smithi089.stdout:7/211: write d7/df/d10/d36/f44 [98717,18328] 0 2024-08-01T06:55:52.536 INFO:tasks.workunit.client.1.smithi089.stdout:7/212: fsync d7/d1f/f3f 0 2024-08-01T06:55:52.540 INFO:tasks.workunit.client.1.smithi089.stdout:0/251: mknod d9/d40/d25/d46/c50 0 2024-08-01T06:55:52.545 INFO:tasks.workunit.client.1.smithi089.stdout:7/213: dread d7/fb [0,4194304] 0 2024-08-01T06:55:52.545 INFO:tasks.workunit.client.1.smithi089.stdout:9/186: getdents d18/d33/d3b 0 2024-08-01T06:55:52.548 INFO:tasks.workunit.client.1.smithi089.stdout:2/171: rename d7/c13 to d7/d19/d1e/c35 0 2024-08-01T06:55:52.549 INFO:tasks.workunit.client.1.smithi089.stdout:0/252: symlink d9/d40/d26/l51 0 2024-08-01T06:55:52.551 INFO:tasks.workunit.client.1.smithi089.stdout:2/172: mknod d7/d19/d1e/c36 0 2024-08-01T06:55:52.553 INFO:tasks.workunit.client.1.smithi089.stdout:9/187: creat d18/d33/d3b/f3c x:0 0 0 2024-08-01T06:55:52.553 INFO:tasks.workunit.client.1.smithi089.stdout:4/171: write d3/db/f10 [311003,50085] 0 2024-08-01T06:55:52.554 INFO:tasks.workunit.client.1.smithi089.stdout:4/172: chown d3/d1f/c34 11539 1 2024-08-01T06:55:52.555 INFO:tasks.workunit.client.1.smithi089.stdout:4/173: read - d3/db/f39 zero size 2024-08-01T06:55:52.556 INFO:tasks.workunit.client.1.smithi089.stdout:2/173: creat d7/d19/f37 x:0 0 0 2024-08-01T06:55:52.556 INFO:tasks.workunit.client.1.smithi089.stdout:3/155: link d7/dd/d10/d24/l2a d7/dd/d10/d12/d1b/l2c 0 2024-08-01T06:55:52.558 INFO:tasks.workunit.client.1.smithi089.stdout:3/156: chown d7/dd/d10/d12/d1b/f26 16240708 1 2024-08-01T06:55:52.558 INFO:tasks.workunit.client.1.smithi089.stdout:9/188: mkdir d18/d3d 0 2024-08-01T06:55:52.558 INFO:tasks.workunit.client.1.smithi089.stdout:7/214: link d7/df/l3e d7/d1f/d30/d4c/l50 0 2024-08-01T06:55:52.560 INFO:tasks.workunit.client.1.smithi089.stdout:9/189: truncate d18/f2a 4593940 0 2024-08-01T06:55:52.560 INFO:tasks.workunit.client.1.smithi089.stdout:2/174: creat d7/d1f/d29/f38 x:0 0 0 2024-08-01T06:55:52.561 INFO:tasks.workunit.client.1.smithi089.stdout:4/174: dwrite d3/db/d16/f18 [0,4194304] 0 2024-08-01T06:55:52.562 INFO:tasks.workunit.client.1.smithi089.stdout:2/175: chown d7/c8 347335 1 2024-08-01T06:55:52.563 INFO:tasks.workunit.client.1.smithi089.stdout:8/180: sync 2024-08-01T06:55:52.563 INFO:tasks.workunit.client.1.smithi089.stdout:6/260: sync 2024-08-01T06:55:52.563 INFO:tasks.workunit.client.1.smithi089.stdout:1/230: sync 2024-08-01T06:55:52.563 INFO:tasks.workunit.client.1.smithi089.stdout:0/253: getdents d9/d40/d26/d2e 0 2024-08-01T06:55:52.564 INFO:tasks.workunit.client.1.smithi089.stdout:9/190: rename d18/c2f to d18/d22/d39/c3e 0 2024-08-01T06:55:52.565 INFO:tasks.workunit.client.1.smithi089.stdout:0/254: stat d9/l1b 0 2024-08-01T06:55:52.567 INFO:tasks.workunit.client.1.smithi089.stdout:8/181: chown d5/dc/d12/f14 185 1 2024-08-01T06:55:52.567 INFO:tasks.workunit.client.1.smithi089.stdout:4/175: mknod d3/d1e/c3c 0 2024-08-01T06:55:52.569 INFO:tasks.workunit.client.1.smithi089.stdout:4/176: fdatasync d3/d1e/d21/f2f 0 2024-08-01T06:55:52.569 INFO:tasks.workunit.client.1.smithi089.stdout:7/215: dwrite d7/d15/f25 [0,4194304] 0 2024-08-01T06:55:52.571 INFO:tasks.workunit.client.1.smithi089.stdout:6/261: creat d2/d11/d3e/f60 x:0 0 0 2024-08-01T06:55:52.572 INFO:tasks.workunit.client.1.smithi089.stdout:4/177: write d3/db/f10 [1997997,110727] 0 2024-08-01T06:55:52.574 INFO:tasks.workunit.client.1.smithi089.stdout:2/176: mknod d7/d1f/d28/c39 0 2024-08-01T06:55:52.576 INFO:tasks.workunit.client.1.smithi089.stdout:2/177: dread - d7/d19/f37 zero size 2024-08-01T06:55:52.577 INFO:tasks.workunit.client.1.smithi089.stdout:9/191: dwrite d18/d33/f34 [0,4194304] 0 2024-08-01T06:55:52.579 INFO:tasks.workunit.client.1.smithi089.stdout:8/182: creat d5/dc/f37 x:0 0 0 2024-08-01T06:55:52.579 INFO:tasks.workunit.client.1.smithi089.stdout:9/192: fdatasync d18/f30 0 2024-08-01T06:55:52.584 INFO:tasks.workunit.client.1.smithi089.stdout:9/193: chown d18/d33/d3b 1802 1 2024-08-01T06:55:52.585 INFO:tasks.workunit.client.1.smithi089.stdout:7/216: creat d7/df/d10/f51 x:0 0 0 2024-08-01T06:55:52.587 INFO:tasks.workunit.client.1.smithi089.stdout:9/194: chown d18/d3d 1666251 1 2024-08-01T06:55:52.587 INFO:tasks.workunit.client.1.smithi089.stdout:0/255: mknod d9/d40/d45/d47/c52 0 2024-08-01T06:55:52.592 INFO:tasks.workunit.client.1.smithi089.stdout:6/262: dwrite d2/d11/d1a/f29 [0,4194304] 0 2024-08-01T06:55:52.592 INFO:tasks.workunit.client.1.smithi089.stdout:9/195: read - d18/f1a zero size 2024-08-01T06:55:52.593 INFO:tasks.workunit.client.1.smithi089.stdout:4/178: mkdir d3/d17/d3a/d3d 0 2024-08-01T06:55:52.596 INFO:tasks.workunit.client.1.smithi089.stdout:6/263: stat d2/d11/d1f/f5a 0 2024-08-01T06:55:52.598 INFO:tasks.workunit.client.1.smithi089.stdout:2/178: dwrite d7/d19/d1e/f2e [0,4194304] 0 2024-08-01T06:55:52.599 INFO:tasks.workunit.client.1.smithi089.stdout:9/196: fsync f8 0 2024-08-01T06:55:52.602 INFO:tasks.workunit.client.1.smithi089.stdout:3/157: dwrite d7/dd/f15 [0,4194304] 0 2024-08-01T06:55:52.603 INFO:tasks.workunit.client.1.smithi089.stdout:0/256: getdents d9/d22/d2b 0 2024-08-01T06:55:52.604 INFO:tasks.workunit.client.1.smithi089.stdout:8/183: dwrite d5/dc/d1e/f2b [0,4194304] 0 2024-08-01T06:55:52.609 INFO:tasks.workunit.client.1.smithi089.stdout:9/197: creat d18/d22/d39/f3f x:0 0 0 2024-08-01T06:55:52.609 INFO:tasks.workunit.client.1.smithi089.stdout:1/231: dwrite d0/d9/d15/f34 [0,4194304] 0 2024-08-01T06:55:52.612 INFO:tasks.workunit.client.1.smithi089.stdout:8/184: write d5/dc/f37 [341102,14144] 0 2024-08-01T06:55:52.616 INFO:tasks.workunit.client.1.smithi089.stdout:0/257: mkdir d9/d40/d26/d2e/d44/d53 0 2024-08-01T06:55:52.621 INFO:tasks.workunit.client.1.smithi089.stdout:4/179: dwrite d3/d29/f37 [0,4194304] 0 2024-08-01T06:55:52.623 INFO:tasks.workunit.client.1.smithi089.stdout:1/232: creat d0/d9/d15/d2d/d4a/d4d/f50 x:0 0 0 2024-08-01T06:55:52.624 INFO:tasks.workunit.client.1.smithi089.stdout:6/264: dwrite d2/d2e/d2f/f4d [0,4194304] 0 2024-08-01T06:55:52.627 INFO:tasks.workunit.client.1.smithi089.stdout:9/198: dwrite f12 [4194304,4194304] 0 2024-08-01T06:55:52.627 INFO:tasks.workunit.client.1.smithi089.stdout:4/180: stat d3/db/l1b 0 2024-08-01T06:55:52.629 INFO:tasks.workunit.client.1.smithi089.stdout:0/258: creat d9/d40/d26/d2e/d44/d53/f54 x:0 0 0 2024-08-01T06:55:52.631 INFO:tasks.workunit.client.1.smithi089.stdout:8/185: getdents d5/dc/d12 0 2024-08-01T06:55:52.633 INFO:tasks.workunit.client.1.smithi089.stdout:9/199: symlink d18/d22/l40 0 2024-08-01T06:55:52.633 INFO:tasks.workunit.client.1.smithi089.stdout:4/181: symlink d3/db/l3e 0 2024-08-01T06:55:52.635 INFO:tasks.workunit.client.1.smithi089.stdout:0/259: mkdir d9/d22/d2b/d55 0 2024-08-01T06:55:52.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:52 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:52.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:52 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:52.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:52 smithi089 ceph-mon[36617]: pgmap v10: 65 pgs: 65 active+clean; 283 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 13 MiB/s wr, 248 op/s 2024-08-01T06:55:52.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:52 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:52.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:52 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:52.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:52 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:55:52.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:52 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:55:52.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:52 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:55:52.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:52 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:55:52.638 INFO:tasks.workunit.client.1.smithi089.stdout:8/186: creat d5/d23/f38 x:0 0 0 2024-08-01T06:55:52.638 INFO:tasks.workunit.client.1.smithi089.stdout:9/200: truncate fa 352396 0 2024-08-01T06:55:52.639 INFO:tasks.workunit.client.1.smithi089.stdout:4/182: mknod d3/d1e/c3f 0 2024-08-01T06:55:52.643 INFO:tasks.workunit.client.1.smithi089.stdout:9/201: truncate d18/f1a 241508 0 2024-08-01T06:55:52.643 INFO:tasks.workunit.client.1.smithi089.stdout:4/183: chown d3/db/d33 1 1 2024-08-01T06:55:52.644 INFO:tasks.workunit.client.1.smithi089.stdout:0/260: mknod d9/d40/d26/d2e/d44/c56 0 2024-08-01T06:55:52.646 INFO:tasks.workunit.client.1.smithi089.stdout:1/233: getdents d0/d9/d15/d3b/d3d 0 2024-08-01T06:55:52.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:52 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:52.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:52 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:52.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:52 smithi016 ceph-mon[29266]: pgmap v10: 65 pgs: 65 active+clean; 283 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 13 MiB/s wr, 248 op/s 2024-08-01T06:55:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:52 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:52 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:52 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:55:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:52 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:55:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:52 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:55:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:52 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:55:52.651 INFO:tasks.workunit.client.1.smithi089.stdout:4/184: creat d3/d1e/f40 x:0 0 0 2024-08-01T06:55:52.652 INFO:tasks.workunit.client.1.smithi089.stdout:9/202: creat d18/d3d/f41 x:0 0 0 2024-08-01T06:55:52.653 INFO:tasks.workunit.client.1.smithi089.stdout:8/187: rmdir d5/d2c 39 2024-08-01T06:55:52.655 INFO:tasks.workunit.client.1.smithi089.stdout:1/234: dwrite d0/f11 [0,4194304] 0 2024-08-01T06:55:52.655 INFO:tasks.workunit.client.1.smithi089.stdout:8/188: rmdir d5 39 2024-08-01T06:55:52.656 INFO:tasks.workunit.client.1.smithi089.stdout:0/261: link d9/lc d9/d22/d2b/d55/l57 0 2024-08-01T06:55:52.657 INFO:tasks.workunit.client.1.smithi089.stdout:9/203: creat d18/d22/d39/f42 x:0 0 0 2024-08-01T06:55:52.660 INFO:tasks.workunit.client.1.smithi089.stdout:0/262: write d9/d40/d25/d46/f38 [3734723,47695] 0 2024-08-01T06:55:52.662 INFO:tasks.workunit.client.1.smithi089.stdout:0/263: fdatasync d9/d22/f34 0 2024-08-01T06:55:52.663 INFO:tasks.workunit.client.1.smithi089.stdout:4/185: dwrite d3/d17/f20 [0,4194304] 0 2024-08-01T06:55:52.663 INFO:tasks.workunit.client.1.smithi089.stdout:9/204: mkdir d18/d22/d43 0 2024-08-01T06:55:52.665 INFO:tasks.workunit.client.1.smithi089.stdout:8/189: rmdir d5/d2c 39 2024-08-01T06:55:52.665 INFO:tasks.workunit.client.1.smithi089.stdout:9/205: fdatasync d18/d22/d39/f3a 0 2024-08-01T06:55:52.666 INFO:tasks.workunit.client.1.smithi089.stdout:4/186: write d3/db/d16/f18 [9039065,3922] 0 2024-08-01T06:55:52.668 INFO:tasks.workunit.client.1.smithi089.stdout:1/235: dread d0/d9/d15/d2d/d4a/f4c [0,4194304] 0 2024-08-01T06:55:52.670 INFO:tasks.workunit.client.1.smithi089.stdout:9/206: creat d18/d22/f44 x:0 0 0 2024-08-01T06:55:52.670 INFO:tasks.workunit.client.1.smithi089.stdout:4/187: truncate d3/d29/f2a 4266129 0 2024-08-01T06:55:52.670 INFO:tasks.workunit.client.1.smithi089.stdout:1/236: rmdir d0/d9/d15/d2b 39 2024-08-01T06:55:52.670 INFO:tasks.workunit.client.1.smithi089.stdout:9/207: readlink d18/d22/l26 0 2024-08-01T06:55:52.673 INFO:tasks.workunit.client.1.smithi089.stdout:8/190: creat d5/d2c/f39 x:0 0 0 2024-08-01T06:55:52.675 INFO:tasks.workunit.client.1.smithi089.stdout:4/188: creat d3/d1e/d21/f41 x:0 0 0 2024-08-01T06:55:52.679 INFO:tasks.workunit.client.1.smithi089.stdout:1/237: rename d0/lf to d0/d9/d1e/d49/l51 0 2024-08-01T06:55:52.682 INFO:tasks.workunit.client.1.smithi089.stdout:0/264: getdents d9/d40/d26 0 2024-08-01T06:55:52.683 INFO:tasks.workunit.client.1.smithi089.stdout:4/189: mkdir d3/db/d42 0 2024-08-01T06:55:52.683 INFO:tasks.workunit.client.1.smithi089.stdout:3/158: write d7/dd/f1a [101306,84954] 0 2024-08-01T06:55:52.683 INFO:tasks.workunit.client.1.smithi089.stdout:6/265: dread d2/d11/f15 [0,4194304] 0 2024-08-01T06:55:52.685 INFO:tasks.workunit.client.1.smithi089.stdout:6/266: dread - d2/d11/d1f/d46/d56/f58 zero size 2024-08-01T06:55:52.689 INFO:tasks.workunit.client.1.smithi089.stdout:0/265: symlink d9/d40/d26/d2e/l58 0 2024-08-01T06:55:52.690 INFO:tasks.workunit.client.1.smithi089.stdout:6/267: dwrite d2/f2b [0,4194304] 0 2024-08-01T06:55:52.691 INFO:tasks.workunit.client.1.smithi089.stdout:0/266: write d9/fd [5919276,111212] 0 2024-08-01T06:55:52.692 INFO:tasks.workunit.client.1.smithi089.stdout:6/268: chown d2/d11/d1a/d1c/d40/f5e 983854 1 2024-08-01T06:55:52.692 INFO:tasks.workunit.client.1.smithi089.stdout:4/190: rmdir d3/d29 39 2024-08-01T06:55:52.695 INFO:tasks.workunit.client.1.smithi089.stdout:3/159: chown d7/dd/d10/f13 521706 1 2024-08-01T06:55:52.697 INFO:tasks.workunit.client.1.smithi089.stdout:8/191: creat d5/f3a x:0 0 0 2024-08-01T06:55:52.697 INFO:tasks.workunit.client.1.smithi089.stdout:8/192: readlink d5/dc/d1e/l2a 0 2024-08-01T06:55:52.698 INFO:tasks.workunit.client.1.smithi089.stdout:9/208: getdents d18/d33 0 2024-08-01T06:55:52.706 INFO:tasks.workunit.client.1.smithi089.stdout:8/193: rename d5/dc/cb to d5/dc/c3b 0 2024-08-01T06:55:52.707 INFO:tasks.workunit.client.1.smithi089.stdout:9/209: mkdir d18/d22/d45 0 2024-08-01T06:55:52.708 INFO:tasks.workunit.client.1.smithi089.stdout:9/210: chown d18/d33/d3b 201 1 2024-08-01T06:55:52.709 INFO:tasks.workunit.client.1.smithi089.stdout:5/163: sync 2024-08-01T06:55:52.709 INFO:tasks.workunit.client.1.smithi089.stdout:9/211: read d18/d33/f37 [3044866,129476] 0 2024-08-01T06:55:52.710 INFO:tasks.workunit.client.1.smithi089.stdout:0/267: mkdir d9/d22/d2b/d55/d59 0 2024-08-01T06:55:52.710 INFO:tasks.workunit.client.1.smithi089.stdout:9/212: write d18/d33/d3b/f3c [415409,75810] 0 2024-08-01T06:55:52.710 INFO:tasks.workunit.client.1.smithi089.stdout:0/268: chown d9/c4e 17976 1 2024-08-01T06:55:52.714 INFO:tasks.workunit.client.1.smithi089.stdout:6/269: symlink d2/l61 0 2024-08-01T06:55:52.714 INFO:tasks.workunit.client.1.smithi089.stdout:1/238: creat d0/d9/d15/f52 x:0 0 0 2024-08-01T06:55:52.714 INFO:tasks.workunit.client.1.smithi089.stdout:8/194: symlink d5/d15/l3c 0 2024-08-01T06:55:52.716 INFO:tasks.workunit.client.1.smithi089.stdout:4/191: symlink d3/d29/l43 0 2024-08-01T06:55:52.716 INFO:tasks.workunit.client.1.smithi089.stdout:1/239: write d0/d9/f30 [1961425,48827] 0 2024-08-01T06:55:52.717 INFO:tasks.workunit.client.1.smithi089.stdout:5/164: creat d5/de/d10/d16/d1b/f39 x:0 0 0 2024-08-01T06:55:52.719 INFO:tasks.workunit.client.1.smithi089.stdout:0/269: dwrite d9/d40/d25/d46/f28 [0,4194304] 0 2024-08-01T06:55:52.720 INFO:tasks.workunit.client.1.smithi089.stdout:3/160: creat d7/dd/d10/f2d x:0 0 0 2024-08-01T06:55:52.721 INFO:tasks.workunit.client.1.smithi089.stdout:3/161: stat d7/dd/d10/c14 0 2024-08-01T06:55:52.722 INFO:tasks.workunit.client.1.smithi089.stdout:5/165: dread d5/d13/f2b [0,4194304] 0 2024-08-01T06:55:52.728 INFO:tasks.workunit.client.1.smithi089.stdout:9/213: dread d18/f2a [0,4194304] 0 2024-08-01T06:55:52.729 INFO:tasks.workunit.client.1.smithi089.stdout:0/270: unlink d9/d40/d26/d2e/f4d 0 2024-08-01T06:55:52.731 INFO:tasks.workunit.client.1.smithi089.stdout:4/192: dwrite d3/db/f10 [0,4194304] 0 2024-08-01T06:55:52.733 INFO:tasks.workunit.client.1.smithi089.stdout:5/166: mknod d5/de/d10/d16/c3a 0 2024-08-01T06:55:52.734 INFO:tasks.workunit.client.1.smithi089.stdout:9/214: dread f5 [4194304,4194304] 0 2024-08-01T06:55:52.736 INFO:tasks.workunit.client.1.smithi089.stdout:8/195: creat d5/f3d x:0 0 0 2024-08-01T06:55:52.742 INFO:tasks.workunit.client.1.smithi089.stdout:5/167: rename d5/de/f14 to d5/de/d10/f3b 0 2024-08-01T06:55:52.743 INFO:tasks.workunit.client.1.smithi089.stdout:9/215: creat d18/d33/d3b/f46 x:0 0 0 2024-08-01T06:55:52.744 INFO:tasks.workunit.client.1.smithi089.stdout:5/168: truncate d5/d13/f2b 1501530 0 2024-08-01T06:55:52.745 INFO:tasks.workunit.client.1.smithi089.stdout:8/196: unlink d5/dc/d12/f28 0 2024-08-01T06:55:52.746 INFO:tasks.workunit.client.1.smithi089.stdout:4/193: dwrite d3/d1e/d21/f41 [0,4194304] 0 2024-08-01T06:55:52.748 INFO:tasks.workunit.client.1.smithi089.stdout:3/162: creat d7/dd/f2e x:0 0 0 2024-08-01T06:55:52.760 INFO:tasks.workunit.client.1.smithi089.stdout:5/169: rmdir d5 39 2024-08-01T06:55:52.761 INFO:tasks.workunit.client.1.smithi089.stdout:8/197: dread d5/f25 [4194304,4194304] 0 2024-08-01T06:55:52.766 INFO:tasks.workunit.client.1.smithi089.stdout:8/198: dwrite d5/ff [0,4194304] 0 2024-08-01T06:55:52.768 INFO:tasks.workunit.client.1.smithi089.stdout:5/170: chown d5/d13/d38/l21 49384535 1 2024-08-01T06:55:52.771 INFO:tasks.workunit.client.1.smithi089.stdout:1/240: creat d0/d9/d15/d2d/f53 x:0 0 0 2024-08-01T06:55:52.773 INFO:tasks.workunit.client.1.smithi089.stdout:5/171: dwrite d5/d13/f30 [0,4194304] 0 2024-08-01T06:55:52.775 INFO:tasks.workunit.client.1.smithi089.stdout:4/194: getdents d3/d29/d31 0 2024-08-01T06:55:52.776 INFO:tasks.workunit.client.1.smithi089.stdout:0/271: truncate d9/f18 3483650 0 2024-08-01T06:55:52.779 INFO:tasks.workunit.client.1.smithi089.stdout:8/199: creat d5/dc/d1e/f3e x:0 0 0 2024-08-01T06:55:52.781 INFO:tasks.workunit.client.1.smithi089.stdout:8/200: dread - d5/dc/d12/f35 zero size 2024-08-01T06:55:52.781 INFO:tasks.workunit.client.1.smithi089.stdout:5/172: creat d5/f3c x:0 0 0 2024-08-01T06:55:52.783 INFO:tasks.workunit.client.1.smithi089.stdout:9/216: getdents d18/d22 0 2024-08-01T06:55:52.784 INFO:tasks.workunit.client.1.smithi089.stdout:3/163: write d7/dd/d10/f13 [1599220,74018] 0 2024-08-01T06:55:52.785 INFO:tasks.workunit.client.1.smithi089.stdout:9/217: dread f8 [0,4194304] 0 2024-08-01T06:55:52.785 INFO:tasks.workunit.client.1.smithi089.stdout:3/164: fsync d7/dd/f2e 0 2024-08-01T06:55:52.786 INFO:tasks.workunit.client.1.smithi089.stdout:1/241: mkdir d0/d9/d54 0 2024-08-01T06:55:52.790 INFO:tasks.workunit.client.1.smithi089.stdout:5/173: unlink d5/d13/d38/l1f 0 2024-08-01T06:55:52.790 INFO:tasks.workunit.client.1.smithi089.stdout:4/195: dwrite d3/d17/f20 [0,4194304] 0 2024-08-01T06:55:52.792 INFO:tasks.workunit.client.1.smithi089.stdout:1/242: dread d0/f13 [0,4194304] 0 2024-08-01T06:55:52.795 INFO:tasks.workunit.client.1.smithi089.stdout:9/218: creat d18/f47 x:0 0 0 2024-08-01T06:55:52.797 INFO:tasks.workunit.client.1.smithi089.stdout:4/196: truncate d3/db/f13 3699585 0 2024-08-01T06:55:52.798 INFO:tasks.workunit.client.1.smithi089.stdout:1/243: creat d0/d9/d15/d2d/d4a/f55 x:0 0 0 2024-08-01T06:55:52.800 INFO:tasks.workunit.client.1.smithi089.stdout:5/174: dwrite d5/d13/f30 [4194304,4194304] 0 2024-08-01T06:55:52.801 INFO:tasks.workunit.client.1.smithi089.stdout:9/219: creat d18/d22/f48 x:0 0 0 2024-08-01T06:55:52.802 INFO:tasks.workunit.client.1.smithi089.stdout:9/220: dread - d18/d22/f48 zero size 2024-08-01T06:55:52.804 INFO:tasks.workunit.client.1.smithi089.stdout:8/201: getdents d5/d2c 0 2024-08-01T06:55:52.805 INFO:tasks.workunit.client.1.smithi089.stdout:1/244: unlink d0/d9/d1e/c27 0 2024-08-01T06:55:52.806 INFO:tasks.workunit.client.1.smithi089.stdout:4/197: dwrite d3/d1e/d21/f41 [0,4194304] 0 2024-08-01T06:55:52.810 INFO:tasks.workunit.client.1.smithi089.stdout:8/202: symlink d5/dc/d1e/l3f 0 2024-08-01T06:55:52.811 INFO:tasks.workunit.client.1.smithi089.stdout:0/272: dwrite d9/d40/d26/f3f [0,4194304] 0 2024-08-01T06:55:52.812 INFO:tasks.workunit.client.1.smithi089.stdout:1/245: symlink d0/d9/d1e/l56 0 2024-08-01T06:55:52.813 INFO:tasks.workunit.client.1.smithi089.stdout:1/246: write d0/f23 [4213469,116086] 0 2024-08-01T06:55:52.817 INFO:tasks.workunit.client.1.smithi089.stdout:5/175: link f0 d5/de/d10/f3d 0 2024-08-01T06:55:52.818 INFO:tasks.workunit.client.1.smithi089.stdout:9/221: fdatasync f15 0 2024-08-01T06:55:52.820 INFO:tasks.workunit.client.1.smithi089.stdout:5/176: readlink d5/de/d10/l15 0 2024-08-01T06:55:52.821 INFO:tasks.workunit.client.1.smithi089.stdout:9/222: chown d18/d22/c24 7993 1 2024-08-01T06:55:52.822 INFO:tasks.workunit.client.1.smithi089.stdout:4/198: dwrite d3/f24 [0,4194304] 0 2024-08-01T06:55:52.823 INFO:tasks.workunit.client.1.smithi089.stdout:9/223: write f16 [8339457,129384] 0 2024-08-01T06:55:52.823 INFO:tasks.workunit.client.1.smithi089.stdout:4/199: fsync d3/db/f39 0 2024-08-01T06:55:52.824 INFO:tasks.workunit.client.1.smithi089.stdout:8/203: creat d5/dc/d12/f40 x:0 0 0 2024-08-01T06:55:52.825 INFO:tasks.workunit.client.1.smithi089.stdout:9/224: write d18/d3d/f41 [366534,87661] 0 2024-08-01T06:55:52.830 INFO:tasks.workunit.client.1.smithi089.stdout:4/200: dwrite d3/d29/f37 [0,4194304] 0 2024-08-01T06:55:52.831 INFO:tasks.workunit.client.1.smithi089.stdout:4/201: chown d3/db/d16/f18 10230585 1 2024-08-01T06:55:52.833 INFO:tasks.workunit.client.1.smithi089.stdout:5/177: mknod d5/de/d10/c3e 0 2024-08-01T06:55:52.840 INFO:tasks.workunit.client.1.smithi089.stdout:1/247: symlink d0/d9/d15/d3b/l57 0 2024-08-01T06:55:52.842 INFO:tasks.workunit.client.1.smithi089.stdout:5/178: dwrite d5/de/d10/d16/d1b/f39 [0,4194304] 0 2024-08-01T06:55:52.851 INFO:tasks.workunit.client.1.smithi089.stdout:1/248: unlink d0/f6 0 2024-08-01T06:55:52.852 INFO:tasks.workunit.client.1.smithi089.stdout:1/249: chown d0/ce 57 1 2024-08-01T06:55:52.852 INFO:tasks.workunit.client.1.smithi089.stdout:8/204: creat d5/f41 x:0 0 0 2024-08-01T06:55:52.853 INFO:tasks.workunit.client.1.smithi089.stdout:8/205: truncate d5/f3a 888157 0 2024-08-01T06:55:52.854 INFO:tasks.workunit.client.1.smithi089.stdout:9/225: getdents d18/d33 0 2024-08-01T06:55:52.855 INFO:tasks.workunit.client.1.smithi089.stdout:9/226: write d18/d22/f48 [731943,3507] 0 2024-08-01T06:55:52.856 INFO:tasks.workunit.client.1.smithi089.stdout:9/227: chown d18/f1f 14241 1 2024-08-01T06:55:52.856 INFO:tasks.workunit.client.1.smithi089.stdout:8/206: symlink d5/dc/d12/l42 0 2024-08-01T06:55:52.860 INFO:tasks.workunit.client.1.smithi089.stdout:9/228: mkdir d18/d33/d49 0 2024-08-01T06:55:52.861 INFO:tasks.workunit.client.1.smithi089.stdout:8/207: symlink d5/d2c/l43 0 2024-08-01T06:55:52.861 INFO:tasks.workunit.client.1.smithi089.stdout:1/250: link d0/d9/d1e/c26 d0/d9/d15/d2d/c58 0 2024-08-01T06:55:52.864 INFO:tasks.workunit.client.1.smithi089.stdout:1/251: rmdir d0/d9/d15 39 2024-08-01T06:55:52.865 INFO:tasks.workunit.client.1.smithi089.stdout:8/208: rename d5/dc/d1e/f3e to d5/d15/f44 0 2024-08-01T06:55:52.866 INFO:tasks.workunit.client.1.smithi089.stdout:4/202: truncate d3/f24 4036814 0 2024-08-01T06:55:52.866 INFO:tasks.workunit.client.1.smithi089.stdout:8/209: chown f2 74667713 1 2024-08-01T06:55:52.866 INFO:tasks.workunit.client.1.smithi089.stdout:9/229: mknod d18/d22/d45/c4a 0 2024-08-01T06:55:52.869 INFO:tasks.workunit.client.1.smithi089.stdout:4/203: creat d3/d29/f44 x:0 0 0 2024-08-01T06:55:52.869 INFO:tasks.workunit.client.1.smithi089.stdout:8/210: mknod d5/d2c/c45 0 2024-08-01T06:55:52.870 INFO:tasks.workunit.client.1.smithi089.stdout:1/252: dread d0/d9/f30 [0,4194304] 0 2024-08-01T06:55:52.872 INFO:tasks.workunit.client.1.smithi089.stdout:4/204: creat d3/d1e/d21/f45 x:0 0 0 2024-08-01T06:55:52.872 INFO:tasks.workunit.client.1.smithi089.stdout:1/253: chown d0/d9/d1e/f37 26118 1 2024-08-01T06:55:52.874 INFO:tasks.workunit.client.1.smithi089.stdout:0/273: dwrite d9/f18 [0,4194304] 0 2024-08-01T06:55:52.875 INFO:tasks.workunit.client.1.smithi089.stdout:0/274: dread - d9/d40/d26/d2e/d44/d53/f54 zero size 2024-08-01T06:55:52.876 INFO:tasks.workunit.client.1.smithi089.stdout:8/211: getdents d5/dc 0 2024-08-01T06:55:52.877 INFO:tasks.workunit.client.1.smithi089.stdout:4/205: mknod d3/d1e/d21/d26/c46 0 2024-08-01T06:55:52.878 INFO:tasks.workunit.client.1.smithi089.stdout:1/254: dread - d0/d9/d15/d2b/f39 zero size 2024-08-01T06:55:52.880 INFO:tasks.workunit.client.1.smithi089.stdout:0/275: symlink d9/d22/l5a 0 2024-08-01T06:55:52.883 INFO:tasks.workunit.client.1.smithi089.stdout:4/206: unlink d3/d1e/c3f 0 2024-08-01T06:55:52.885 INFO:tasks.workunit.client.1.smithi089.stdout:4/207: write d3/d29/f44 [170398,74042] 0 2024-08-01T06:55:52.886 INFO:tasks.workunit.client.1.smithi089.stdout:0/276: dwrite d9/d40/d25/f2a [4194304,4194304] 0 2024-08-01T06:55:52.889 INFO:tasks.workunit.client.1.smithi089.stdout:8/212: rename d5/d15/l3c to d5/l46 0 2024-08-01T06:55:52.892 INFO:tasks.workunit.client.1.smithi089.stdout:4/208: symlink d3/db/d16/l47 0 2024-08-01T06:55:52.893 INFO:tasks.workunit.client.1.smithi089.stdout:4/209: write d3/d1e/d21/f45 [552230,35094] 0 2024-08-01T06:55:52.894 INFO:tasks.workunit.client.1.smithi089.stdout:8/213: creat d5/dc/d1e/f47 x:0 0 0 2024-08-01T06:55:52.895 INFO:tasks.workunit.client.1.smithi089.stdout:4/210: truncate d3/d1e/d21/d26/f38 777720 0 2024-08-01T06:55:52.896 INFO:tasks.workunit.client.1.smithi089.stdout:4/211: fsync d3/db/f10 0 2024-08-01T06:55:52.898 INFO:tasks.workunit.client.1.smithi089.stdout:8/214: creat d5/d23/f48 x:0 0 0 2024-08-01T06:55:52.900 INFO:tasks.workunit.client.1.smithi089.stdout:0/277: getdents d9/d40/d26/d2e 0 2024-08-01T06:55:52.902 INFO:tasks.workunit.client.1.smithi089.stdout:8/215: write d5/f25 [3989562,103851] 0 2024-08-01T06:55:52.903 INFO:tasks.workunit.client.1.smithi089.stdout:8/216: dread - d5/f3d zero size 2024-08-01T06:55:52.903 INFO:tasks.workunit.client.1.smithi089.stdout:4/212: creat d3/d29/d3b/f48 x:0 0 0 2024-08-01T06:55:52.905 INFO:tasks.workunit.client.1.smithi089.stdout:4/213: fdatasync d3/db/f10 0 2024-08-01T06:55:52.905 INFO:tasks.workunit.client.1.smithi089.stdout:1/255: truncate d0/f11 7722967 0 2024-08-01T06:55:52.905 INFO:tasks.workunit.client.1.smithi089.stdout:8/217: fsync d5/dc/d1e/f2b 0 2024-08-01T06:55:52.909 INFO:tasks.workunit.client.1.smithi089.stdout:0/278: dwrite d9/d40/d26/d2e/f36 [0,4194304] 0 2024-08-01T06:55:52.909 INFO:tasks.workunit.client.1.smithi089.stdout:1/256: mknod d0/d9/d15/c59 0 2024-08-01T06:55:52.911 INFO:tasks.workunit.client.1.smithi089.stdout:4/214: dread d3/db/d16/f9 [0,4194304] 0 2024-08-01T06:55:52.912 INFO:tasks.workunit.client.1.smithi089.stdout:8/218: rename d5/dc/d12/f35 to d5/d23/f49 0 2024-08-01T06:55:52.915 INFO:tasks.workunit.client.1.smithi089.stdout:0/279: symlink d9/l5b 0 2024-08-01T06:55:52.917 INFO:tasks.workunit.client.1.smithi089.stdout:1/257: rename d0/d9/d43/c44 to d0/d9/d43/c5a 0 2024-08-01T06:55:52.922 INFO:tasks.workunit.client.1.smithi089.stdout:8/219: mknod d5/d15/c4a 0 2024-08-01T06:55:52.922 INFO:tasks.workunit.client.1.smithi089.stdout:0/280: creat d9/d40/d45/d47/f5c x:0 0 0 2024-08-01T06:55:52.923 INFO:tasks.workunit.client.1.smithi089.stdout:1/258: mknod d0/d9/d15/d3b/c5b 0 2024-08-01T06:55:52.923 INFO:tasks.workunit.client.1.smithi089.stdout:8/220: fsync d5/d15/f44 0 2024-08-01T06:55:52.924 INFO:tasks.workunit.client.1.smithi089.stdout:1/259: chown d0/d9/d15/d3b/l57 566609 1 2024-08-01T06:55:52.924 INFO:tasks.workunit.client.1.smithi089.stdout:8/221: readlink d5/dc/d1e/l22 0 2024-08-01T06:55:52.926 INFO:tasks.workunit.client.1.smithi089.stdout:4/215: getdents d3/d1e 0 2024-08-01T06:55:52.926 INFO:tasks.workunit.client.1.smithi089.stdout:0/281: getdents d9/d40/d26/d2e/d3a 0 2024-08-01T06:55:52.927 INFO:tasks.workunit.client.1.smithi089.stdout:0/282: truncate d9/d40/d25/d46/f3d 588685 0 2024-08-01T06:55:52.927 INFO:tasks.workunit.client.1.smithi089.stdout:1/260: creat d0/d9/d43/f5c x:0 0 0 2024-08-01T06:55:52.933 INFO:tasks.workunit.client.1.smithi089.stdout:8/222: link d5/f29 d5/dc/f4b 0 2024-08-01T06:55:52.933 INFO:tasks.workunit.client.1.smithi089.stdout:4/216: dwrite d3/db/d16/f18 [4194304,4194304] 0 2024-08-01T06:55:52.935 INFO:tasks.workunit.client.1.smithi089.stdout:1/261: dwrite d0/f24 [0,4194304] 0 2024-08-01T06:55:52.935 INFO:tasks.workunit.client.1.smithi089.stdout:4/217: rename d3/d17/d3a to d3/d17/d3a/d49 22 2024-08-01T06:55:52.938 INFO:tasks.workunit.client.1.smithi089.stdout:4/218: chown d3/l11 29345 1 2024-08-01T06:55:52.939 INFO:tasks.workunit.client.1.smithi089.stdout:1/262: creat d0/d9/d15/d2d/d4a/d4d/f5d x:0 0 0 2024-08-01T06:55:52.952 INFO:tasks.workunit.client.1.smithi089.stdout:4/219: dwrite d3/d1e/f40 [0,4194304] 0 2024-08-01T06:55:52.952 INFO:tasks.workunit.client.1.smithi089.stdout:0/283: dread d9/f13 [0,4194304] 0 2024-08-01T06:55:52.953 INFO:tasks.workunit.client.1.smithi089.stdout:1/263: dwrite d0/d9/d43/f5c [0,4194304] 0 2024-08-01T06:55:52.954 INFO:tasks.workunit.client.1.smithi089.stdout:8/223: dwrite d5/dc/f11 [0,4194304] 0 2024-08-01T06:55:52.958 INFO:tasks.workunit.client.1.smithi089.stdout:8/224: write d5/dc/d1e/f2b [1741157,125093] 0 2024-08-01T06:55:52.963 INFO:tasks.workunit.client.1.smithi089.stdout:0/284: unlink d9/d22/l3b 0 2024-08-01T06:55:52.966 INFO:tasks.workunit.client.1.smithi089.stdout:8/225: write d5/dc/f11 [3243007,128067] 0 2024-08-01T06:55:52.967 INFO:tasks.workunit.client.1.smithi089.stdout:4/220: dwrite d3/db/d16/f18 [0,4194304] 0 2024-08-01T06:55:52.968 INFO:tasks.workunit.client.1.smithi089.stdout:0/285: write d9/d22/f3e [43459,66342] 0 2024-08-01T06:55:52.969 INFO:tasks.workunit.client.1.smithi089.stdout:1/264: getdents d0/d9/d15/d2d/d4a/d4d 0 2024-08-01T06:55:52.969 INFO:tasks.workunit.client.1.smithi089.stdout:4/221: stat d3/db/d16/f9 0 2024-08-01T06:55:52.973 INFO:tasks.workunit.client.1.smithi089.stdout:4/222: mkdir d3/d17/d3a/d4a 0 2024-08-01T06:55:52.974 INFO:tasks.workunit.client.1.smithi089.stdout:8/226: dread d5/dc/f16 [0,4194304] 0 2024-08-01T06:55:52.977 INFO:tasks.workunit.client.1.smithi089.stdout:8/227: read - d5/dc/d1e/f47 zero size 2024-08-01T06:55:52.978 INFO:tasks.workunit.client.1.smithi089.stdout:0/286: dwrite d9/d40/d26/d2e/f30 [0,4194304] 0 2024-08-01T06:55:52.979 INFO:tasks.workunit.client.1.smithi089.stdout:8/228: fsync d5/dc/f37 0 2024-08-01T06:55:52.993 INFO:tasks.workunit.client.1.smithi089.stdout:1/265: dwrite d0/d9/d15/d2d/d4a/f4c [0,4194304] 0 2024-08-01T06:55:52.996 INFO:tasks.workunit.client.1.smithi089.stdout:4/223: write d3/db/f13 [4065991,16061] 0 2024-08-01T06:55:52.996 INFO:tasks.workunit.client.1.smithi089.stdout:8/229: creat d5/dc/d12/f4c x:0 0 0 2024-08-01T06:55:52.996 INFO:tasks.workunit.client.1.smithi089.stdout:1/266: stat d0/d9/d43/d4b 0 2024-08-01T06:55:53.002 INFO:tasks.workunit.client.1.smithi089.stdout:0/287: dwrite d9/d22/d2b/f43 [0,4194304] 0 2024-08-01T06:55:53.002 INFO:tasks.workunit.client.1.smithi089.stdout:4/224: dread d3/d29/f44 [0,4194304] 0 2024-08-01T06:55:53.002 INFO:tasks.workunit.client.1.smithi089.stdout:1/267: creat d0/d9/d15/d2d/d4a/f5e x:0 0 0 2024-08-01T06:55:53.003 INFO:tasks.workunit.client.1.smithi089.stdout:4/225: dread - d3/db/f39 zero size 2024-08-01T06:55:53.003 INFO:tasks.workunit.client.1.smithi089.stdout:8/230: mkdir d5/d4d 0 2024-08-01T06:55:53.004 INFO:tasks.workunit.client.1.smithi089.stdout:1/268: write d0/d9/d15/d2d/d4a/f47 [1868258,96683] 0 2024-08-01T06:55:53.011 INFO:tasks.workunit.client.1.smithi089.stdout:1/269: rename d0/c2a to d0/d9/d15/d3b/d3d/c5f 0 2024-08-01T06:55:53.012 INFO:tasks.workunit.client.1.smithi089.stdout:4/226: dwrite d3/d29/f44 [0,4194304] 0 2024-08-01T06:55:53.014 INFO:tasks.workunit.client.1.smithi089.stdout:4/227: write d3/d29/f37 [796804,66828] 0 2024-08-01T06:55:53.017 INFO:tasks.workunit.client.1.smithi089.stdout:1/270: rename d0/d9/d1e/l56 to d0/d9/d15/d2b/l60 0 2024-08-01T06:55:53.018 INFO:tasks.workunit.client.1.smithi089.stdout:4/228: dread d3/f24 [0,4194304] 0 2024-08-01T06:55:53.018 INFO:tasks.workunit.client.1.smithi089.stdout:1/271: readlink d0/l1b 0 2024-08-01T06:55:53.021 INFO:tasks.workunit.client.1.smithi089.stdout:4/229: rmdir d3/d1e/d21/d26 39 2024-08-01T06:55:53.022 INFO:tasks.workunit.client.1.smithi089.stdout:1/272: mkdir d0/d9/d15/d2d/d4a/d61 0 2024-08-01T06:55:53.025 INFO:tasks.workunit.client.1.smithi089.stdout:4/230: chown d3/ca 164316306 1 2024-08-01T06:55:53.029 INFO:tasks.workunit.client.1.smithi089.stdout:4/231: creat d3/d29/d31/f4b x:0 0 0 2024-08-01T06:55:53.031 INFO:tasks.workunit.client.1.smithi089.stdout:1/273: dwrite d0/d9/d15/d2d/d4a/f55 [0,4194304] 0 2024-08-01T06:55:53.034 INFO:tasks.workunit.client.1.smithi089.stdout:4/232: mknod d3/db/d42/c4c 0 2024-08-01T06:55:53.034 INFO:tasks.workunit.client.1.smithi089.stdout:8/231: dwrite d5/f29 [0,4194304] 0 2024-08-01T06:55:53.036 INFO:tasks.workunit.client.1.smithi089.stdout:8/232: dread - d5/dc/d1e/f47 zero size 2024-08-01T06:55:53.036 INFO:tasks.workunit.client.1.smithi089.stdout:4/233: write d3/d29/f2a [3961010,87488] 0 2024-08-01T06:55:53.038 INFO:tasks.workunit.client.1.smithi089.stdout:8/233: dread - d5/d15/f1f zero size 2024-08-01T06:55:53.040 INFO:tasks.workunit.client.1.smithi089.stdout:1/274: mknod d0/d9/d15/d2d/c62 0 2024-08-01T06:55:53.045 INFO:tasks.workunit.client.1.smithi089.stdout:1/275: symlink d0/d9/d15/d2d/d4a/d4d/l63 0 2024-08-01T06:55:53.049 INFO:tasks.workunit.client.1.smithi089.stdout:8/234: link d5/f25 d5/dc/d12/f4e 0 2024-08-01T06:55:53.051 INFO:tasks.workunit.client.1.smithi089.stdout:1/276: symlink d0/d9/d15/l64 0 2024-08-01T06:55:53.053 INFO:tasks.workunit.client.1.smithi089.stdout:8/235: symlink d5/dc/d12/l4f 0 2024-08-01T06:55:53.057 INFO:tasks.workunit.client.1.smithi089.stdout:1/277: getdents d0/d9/d1e 0 2024-08-01T06:55:53.066 INFO:tasks.workunit.client.1.smithi089.stdout:4/234: truncate d3/d29/f2a 941293 0 2024-08-01T06:55:53.068 INFO:tasks.workunit.client.1.smithi089.stdout:4/235: chown d3/d1e/d21/d26/f38 423491590 1 2024-08-01T06:55:53.069 INFO:tasks.workunit.client.1.smithi089.stdout:4/236: write d3/d1e/d21/f45 [1443303,96581] 0 2024-08-01T06:55:53.069 INFO:tasks.workunit.client.1.smithi089.stdout:4/237: readlink d3/l11 0 2024-08-01T06:55:53.075 INFO:tasks.workunit.client.1.smithi089.stdout:4/238: creat d3/d17/d3a/d3d/f4d x:0 0 0 2024-08-01T06:55:53.077 INFO:tasks.workunit.client.1.smithi089.stdout:4/239: creat d3/d1e/f4e x:0 0 0 2024-08-01T06:55:53.077 INFO:tasks.workunit.client.1.smithi089.stdout:4/240: dread - d3/d17/d3a/d3d/f4d zero size 2024-08-01T06:55:53.078 INFO:tasks.workunit.client.1.smithi089.stdout:4/241: readlink d3/db/d16/l47 0 2024-08-01T06:55:53.081 INFO:tasks.workunit.client.1.smithi089.stdout:1/278: truncate d0/d9/d43/f5c 2431427 0 2024-08-01T06:55:53.082 INFO:tasks.workunit.client.1.smithi089.stdout:4/242: link d3/d1e/d21/f45 d3/db/d16/f4f 0 2024-08-01T06:55:53.084 INFO:tasks.workunit.client.1.smithi089.stdout:1/279: getdents d0/d9/d15/d2d/d4a/d61 0 2024-08-01T06:55:53.085 INFO:tasks.workunit.client.1.smithi089.stdout:4/243: dread d3/db/d16/f1a [0,4194304] 0 2024-08-01T06:55:53.087 INFO:tasks.workunit.client.1.smithi089.stdout:1/280: rename d0/f8 to d0/d9/d1e/d49/f65 0 2024-08-01T06:55:53.088 INFO:tasks.workunit.client.1.smithi089.stdout:1/281: chown d0/d9/d1e/f37 1 1 2024-08-01T06:55:53.092 INFO:tasks.workunit.client.1.smithi089.stdout:1/282: getdents d0/d9/d15/d2d/d4a/d61 0 2024-08-01T06:55:53.120 INFO:tasks.workunit.client.1.smithi089.stdout:4/244: truncate d3/d17/f20 1331221 0 2024-08-01T06:55:53.122 INFO:tasks.workunit.client.1.smithi089.stdout:4/245: creat d3/db/f50 x:0 0 0 2024-08-01T06:55:53.128 INFO:tasks.workunit.client.1.smithi089.stdout:4/246: dwrite d3/d1e/f40 [0,4194304] 0 2024-08-01T06:55:53.128 INFO:tasks.workunit.client.1.smithi089.stdout:4/247: fdatasync d3/d1e/d21/f41 0 2024-08-01T06:55:53.175 INFO:tasks.workunit.client.1.smithi089.stdout:4/248: truncate d3/f24 3840528 0 2024-08-01T06:55:53.180 INFO:tasks.workunit.client.1.smithi089.stdout:4/249: dwrite d3/d1e/d21/d26/f38 [0,4194304] 0 2024-08-01T06:55:53.184 INFO:tasks.workunit.client.1.smithi089.stdout:4/250: mknod d3/d1e/c51 0 2024-08-01T06:55:53.188 INFO:tasks.workunit.client.1.smithi089.stdout:7/217: sync 2024-08-01T06:55:53.188 INFO:tasks.workunit.client.1.smithi089.stdout:6/270: sync 2024-08-01T06:55:53.188 INFO:tasks.workunit.client.1.smithi089.stdout:2/179: sync 2024-08-01T06:55:53.189 INFO:tasks.workunit.client.1.smithi089.stdout:7/218: chown d7/d1f 12932 1 2024-08-01T06:55:53.189 INFO:tasks.workunit.client.1.smithi089.stdout:2/180: fdatasync d7/f23 0 2024-08-01T06:55:53.190 INFO:tasks.workunit.client.1.smithi089.stdout:4/251: dwrite d3/d1e/d21/f2f [0,4194304] 0 2024-08-01T06:55:53.190 INFO:tasks.workunit.client.1.smithi089.stdout:6/271: write d2/d11/d1f/f45 [135959,43420] 0 2024-08-01T06:55:53.191 INFO:tasks.workunit.client.1.smithi089.stdout:4/252: readlink d3/db/d16/l47 0 2024-08-01T06:55:53.191 INFO:tasks.workunit.client.1.smithi089.stdout:2/181: dread - d7/d1f/d29/f38 zero size 2024-08-01T06:55:53.191 INFO:tasks.workunit.client.1.smithi089.stdout:6/272: fdatasync d2/f2b 0 2024-08-01T06:55:53.193 INFO:tasks.workunit.client.1.smithi089.stdout:2/182: write d7/d1f/f20 [436150,120579] 0 2024-08-01T06:55:53.194 INFO:tasks.workunit.client.1.smithi089.stdout:4/253: write d3/d1e/d21/d26/f38 [3268309,100941] 0 2024-08-01T06:55:53.196 INFO:tasks.workunit.client.1.smithi089.stdout:2/183: write d7/d1f/d29/f38 [571907,98756] 0 2024-08-01T06:55:53.196 INFO:tasks.workunit.client.1.smithi089.stdout:7/219: mknod d7/d46/c52 0 2024-08-01T06:55:53.197 INFO:tasks.workunit.client.1.smithi089.stdout:4/254: write d3/db/d16/f9 [3252318,36759] 0 2024-08-01T06:55:53.198 INFO:tasks.workunit.client.1.smithi089.stdout:7/220: truncate d7/df/d10/d36/f37 278027 0 2024-08-01T06:55:53.199 INFO:tasks.workunit.client.1.smithi089.stdout:7/221: write d7/df/d10/d42/f48 [447399,111857] 0 2024-08-01T06:55:53.201 INFO:tasks.workunit.client.1.smithi089.stdout:6/273: creat d2/d11/d1f/d46/f62 x:0 0 0 2024-08-01T06:55:53.203 INFO:tasks.workunit.client.1.smithi089.stdout:2/184: symlink d7/d19/d1e/l3a 0 2024-08-01T06:55:53.206 INFO:tasks.workunit.client.1.smithi089.stdout:7/222: unlink d7/df/d10/d31/f4f 0 2024-08-01T06:55:53.218 INFO:tasks.workunit.client.1.smithi089.stdout:7/223: dread d7/fd [0,4194304] 0 2024-08-01T06:55:53.224 INFO:tasks.workunit.client.1.smithi089.stdout:6/274: link d2/d2e/d2f/d31/f41 d2/d11/f63 0 2024-08-01T06:55:53.226 INFO:tasks.workunit.client.1.smithi089.stdout:7/224: readlink d7/d1f/d30/d4c/l4d 0 2024-08-01T06:55:53.229 INFO:tasks.workunit.client.1.smithi089.stdout:7/225: mknod d7/df/d10/c53 0 2024-08-01T06:55:53.235 INFO:tasks.workunit.client.1.smithi089.stdout:7/226: dwrite d7/f19 [0,4194304] 0 2024-08-01T06:55:53.235 INFO:tasks.workunit.client.1.smithi089.stdout:7/227: chown d7/df 31810942 1 2024-08-01T06:55:53.236 INFO:tasks.workunit.client.1.smithi089.stdout:7/228: chown d7/df/d10/c33 21103153 1 2024-08-01T06:55:53.239 INFO:tasks.workunit.client.1.smithi089.stdout:7/229: creat d7/d46/f54 x:0 0 0 2024-08-01T06:55:53.240 INFO:tasks.workunit.client.1.smithi089.stdout:7/230: write d7/df/d10/d36/f38 [1904055,122942] 0 2024-08-01T06:55:53.244 INFO:tasks.workunit.client.1.smithi089.stdout:7/231: mkdir d7/df/d55 0 2024-08-01T06:55:53.250 INFO:tasks.workunit.client.1.smithi089.stdout:4/255: dread d3/d17/f20 [0,4194304] 0 2024-08-01T06:55:53.251 INFO:tasks.workunit.client.1.smithi089.stdout:7/232: creat d7/d1f/f56 x:0 0 0 2024-08-01T06:55:53.253 INFO:tasks.workunit.client.1.smithi089.stdout:4/256: symlink d3/d17/l52 0 2024-08-01T06:55:53.255 INFO:tasks.workunit.client.1.smithi089.stdout:2/185: truncate d7/d19/d1e/f2e 3428940 0 2024-08-01T06:55:53.257 INFO:tasks.workunit.client.1.smithi089.stdout:7/233: dread d7/fa [0,4194304] 0 2024-08-01T06:55:53.257 INFO:tasks.workunit.client.1.smithi089.stdout:2/186: mkdir d7/d19/d3b 0 2024-08-01T06:55:53.258 INFO:tasks.workunit.client.1.smithi089.stdout:4/257: dwrite d3/d1e/d21/f2f [0,4194304] 0 2024-08-01T06:55:53.259 INFO:tasks.workunit.client.1.smithi089.stdout:4/258: stat d3/db 0 2024-08-01T06:55:53.260 INFO:tasks.workunit.client.1.smithi089.stdout:2/187: symlink d7/l3c 0 2024-08-01T06:55:53.263 INFO:tasks.workunit.client.1.smithi089.stdout:3/165: sync 2024-08-01T06:55:53.263 INFO:tasks.workunit.client.1.smithi089.stdout:8/236: sync 2024-08-01T06:55:53.263 INFO:tasks.workunit.client.1.smithi089.stdout:9/230: sync 2024-08-01T06:55:53.263 INFO:tasks.workunit.client.1.smithi089.stdout:0/288: sync 2024-08-01T06:55:53.263 INFO:tasks.workunit.client.1.smithi089.stdout:1/283: sync 2024-08-01T06:55:53.264 INFO:tasks.workunit.client.1.smithi089.stdout:5/179: sync 2024-08-01T06:55:53.264 INFO:tasks.workunit.client.1.smithi089.stdout:4/259: symlink d3/d17/d3a/l53 0 2024-08-01T06:55:53.265 INFO:tasks.workunit.client.1.smithi089.stdout:2/188: mkdir d7/d19/d1e/d3d 0 2024-08-01T06:55:53.267 INFO:tasks.workunit.client.1.smithi089.stdout:7/234: creat d7/df/d10/d42/d4e/f57 x:0 0 0 2024-08-01T06:55:53.268 INFO:tasks.workunit.client.1.smithi089.stdout:9/231: mkdir d18/d3d/d4b 0 2024-08-01T06:55:53.268 INFO:tasks.workunit.client.1.smithi089.stdout:2/189: write d7/d19/f37 [471381,27440] 0 2024-08-01T06:55:53.271 INFO:tasks.workunit.client.1.smithi089.stdout:6/275: dwrite d2/ff [0,4194304] 0 2024-08-01T06:55:53.272 INFO:tasks.workunit.client.1.smithi089.stdout:6/276: chown d2/d2e/d2f/d31/c43 5 1 2024-08-01T06:55:53.273 INFO:tasks.workunit.client.1.smithi089.stdout:8/237: symlink d5/dc/d1e/l50 0 2024-08-01T06:55:53.273 INFO:tasks.workunit.client.1.smithi089.stdout:5/180: mknod d5/d13/c3f 0 2024-08-01T06:55:53.274 INFO:tasks.workunit.client.1.smithi089.stdout:5/181: write d5/d13/f30 [8521728,60749] 0 2024-08-01T06:55:53.276 INFO:tasks.workunit.client.1.smithi089.stdout:1/284: symlink d0/d9/d15/d3b/d3d/l66 0 2024-08-01T06:55:53.279 INFO:tasks.workunit.client.1.smithi089.stdout:4/260: unlink d3/d17/d3a/d3d/f4d 0 2024-08-01T06:55:53.281 INFO:tasks.workunit.client.1.smithi089.stdout:3/166: rename d7/dd/d10/d24 to d7/dd/d10/d23/d2f 0 2024-08-01T06:55:53.287 INFO:tasks.workunit.client.1.smithi089.stdout:7/235: truncate d7/d1f/f1a 623650 0 2024-08-01T06:55:53.288 INFO:tasks.workunit.client.1.smithi089.stdout:2/190: symlink d7/d1f/d29/l3e 0 2024-08-01T06:55:53.288 INFO:tasks.workunit.client.1.smithi089.stdout:9/232: dread d18/d33/f37 [0,4194304] 0 2024-08-01T06:55:53.290 INFO:tasks.workunit.client.1.smithi089.stdout:3/167: dwrite d7/dd/f20 [0,4194304] 0 2024-08-01T06:55:53.290 INFO:tasks.workunit.client.1.smithi089.stdout:2/191: chown d7/fa 67577220 1 2024-08-01T06:55:53.290 INFO:tasks.workunit.client.1.smithi089.stdout:8/238: creat d5/d23/f51 x:0 0 0 2024-08-01T06:55:53.291 INFO:tasks.workunit.client.1.smithi089.stdout:9/233: read d18/f1a [127728,44703] 0 2024-08-01T06:55:53.297 INFO:tasks.workunit.client.1.smithi089.stdout:3/168: dwrite d7/dd/f15 [0,4194304] 0 2024-08-01T06:55:53.304 INFO:tasks.workunit.client.1.smithi089.stdout:4/261: creat d3/d17/d3a/f54 x:0 0 0 2024-08-01T06:55:53.306 INFO:tasks.workunit.client.1.smithi089.stdout:0/289: rmdir d9/d22/d2b/d55/d59 0 2024-08-01T06:55:53.308 INFO:tasks.workunit.client.1.smithi089.stdout:3/169: dread d7/dd/f1a [0,4194304] 0 2024-08-01T06:55:53.310 INFO:tasks.workunit.client.1.smithi089.stdout:3/170: truncate d7/dd/d10/f2d 477133 0 2024-08-01T06:55:53.314 INFO:tasks.workunit.client.1.smithi089.stdout:8/239: rmdir d5/d15 39 2024-08-01T06:55:53.316 INFO:tasks.workunit.client.1.smithi089.stdout:2/192: chown d7/d19/d1e/c35 9 1 2024-08-01T06:55:53.319 INFO:tasks.workunit.client.1.smithi089.stdout:1/285: creat d0/d9/d15/d2d/d4a/d61/f67 x:0 0 0 2024-08-01T06:55:53.323 INFO:tasks.workunit.client.1.smithi089.stdout:4/262: unlink d3/d29/f44 0 2024-08-01T06:55:53.323 INFO:tasks.workunit.client.1.smithi089.stdout:4/263: fdatasync d3/db/f10 0 2024-08-01T06:55:53.324 INFO:tasks.workunit.client.1.smithi089.stdout:4/264: chown d3/d1e/d21/d26/f38 21966254 1 2024-08-01T06:55:53.324 INFO:tasks.workunit.client.1.smithi089.stdout:0/290: creat d9/d22/f5d x:0 0 0 2024-08-01T06:55:53.325 INFO:tasks.workunit.client.1.smithi089.stdout:4/265: truncate d3/db/f50 628312 0 2024-08-01T06:55:53.330 INFO:tasks.workunit.client.1.smithi089.stdout:0/291: dwrite d9/d40/d25/d46/f28 [0,4194304] 0 2024-08-01T06:55:53.330 INFO:tasks.workunit.client.1.smithi089.stdout:0/292: chown d9/d40/d26/d2e/d44 3142 1 2024-08-01T06:55:53.334 INFO:tasks.workunit.client.1.smithi089.stdout:8/240: rmdir d5/dc/d1e 39 2024-08-01T06:55:53.338 INFO:tasks.workunit.client.1.smithi089.stdout:9/234: symlink d18/d22/d43/l4c 0 2024-08-01T06:55:53.342 INFO:tasks.workunit.client.1.smithi089.stdout:0/293: dread d9/d40/d25/d46/f49 [0,4194304] 0 2024-08-01T06:55:53.349 INFO:tasks.workunit.client.1.smithi089.stdout:7/236: rmdir d7/df/d55 0 2024-08-01T06:55:53.351 INFO:tasks.workunit.client.1.smithi089.stdout:6/277: link d2/c25 d2/d30/c64 0 2024-08-01T06:55:53.353 INFO:tasks.workunit.client.1.smithi089.stdout:8/241: readlink d5/dc/d1e/l3f 0 2024-08-01T06:55:53.358 INFO:tasks.workunit.client.1.smithi089.stdout:9/235: mknod d18/d33/d3b/c4d 0 2024-08-01T06:55:53.359 INFO:tasks.workunit.client.1.smithi089.stdout:5/182: getdents d5/de/d10/d16/d1b/d25 0 2024-08-01T06:55:53.362 INFO:tasks.workunit.client.1.smithi089.stdout:0/294: creat d9/f5e x:0 0 0 2024-08-01T06:55:53.362 INFO:tasks.workunit.client.1.smithi089.stdout:4/266: creat d3/d17/d3a/d4a/f55 x:0 0 0 2024-08-01T06:55:53.363 INFO:tasks.workunit.client.1.smithi089.stdout:4/267: fdatasync d3/d17/d3a/d4a/f55 0 2024-08-01T06:55:53.364 INFO:tasks.workunit.client.1.smithi089.stdout:4/268: chown d3/ca 276835 1 2024-08-01T06:55:53.367 INFO:tasks.workunit.client.1.smithi089.stdout:9/236: fdatasync ff 0 2024-08-01T06:55:53.368 INFO:tasks.workunit.client.1.smithi089.stdout:9/237: fdatasync f16 0 2024-08-01T06:55:53.369 INFO:tasks.workunit.client.1.smithi089.stdout:5/183: write d5/d13/f31 [1027653,117972] 0 2024-08-01T06:55:53.370 INFO:tasks.workunit.client.1.smithi089.stdout:0/295: mknod d9/d22/d2b/c5f 0 2024-08-01T06:55:53.371 INFO:tasks.workunit.client.1.smithi089.stdout:7/237: creat d7/df/d3b/f58 x:0 0 0 2024-08-01T06:55:53.373 INFO:tasks.workunit.client.1.smithi089.stdout:3/171: getdents d7/dd/d10/d12/d1b 0 2024-08-01T06:55:53.373 INFO:tasks.workunit.client.1.smithi089.stdout:0/296: write d9/d22/f29 [5174257,101944] 0 2024-08-01T06:55:53.379 INFO:tasks.workunit.client.1.smithi089.stdout:9/238: dwrite d18/d22/f38 [0,4194304] 0 2024-08-01T06:55:53.379 INFO:tasks.workunit.client.1.smithi089.stdout:4/269: creat d3/db/d33/f56 x:0 0 0 2024-08-01T06:55:53.382 INFO:tasks.workunit.client.1.smithi089.stdout:6/278: creat d2/d11/f65 x:0 0 0 2024-08-01T06:55:53.386 INFO:tasks.workunit.client.1.smithi089.stdout:8/242: rmdir d5/d4d 0 2024-08-01T06:55:53.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:53 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:55:53.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:53 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:55:53.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:53 smithi089 ceph-mon[36617]: Adjusting osd_memory_target on smithi016 to 1217M 2024-08-01T06:55:53.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:53 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:53.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:53 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:55:53.389 INFO:tasks.workunit.client.1.smithi089.stdout:7/238: write d7/fd [2668429,90652] 0 2024-08-01T06:55:53.391 INFO:tasks.workunit.client.1.smithi089.stdout:2/193: write d7/d1f/d29/f1a [52043,71030] 0 2024-08-01T06:55:53.394 INFO:tasks.workunit.client.1.smithi089.stdout:9/239: creat d18/d3d/d4b/f4e x:0 0 0 2024-08-01T06:55:53.395 INFO:tasks.workunit.client.1.smithi089.stdout:4/270: mkdir d3/d1e/d21/d57 0 2024-08-01T06:55:53.396 INFO:tasks.workunit.client.1.smithi089.stdout:5/184: getdents d5/de/d10 0 2024-08-01T06:55:53.398 INFO:tasks.workunit.client.1.smithi089.stdout:7/239: chown d7/l9 12950571 1 2024-08-01T06:55:53.398 INFO:tasks.workunit.client.1.smithi089.stdout:2/194: chown d7/c1b 223169 1 2024-08-01T06:55:53.399 INFO:tasks.workunit.client.1.smithi089.stdout:5/185: read d5/d13/f31 [297251,106460] 0 2024-08-01T06:55:53.402 INFO:tasks.workunit.client.1.smithi089.stdout:6/279: write d2/d11/d1f/f50 [4881399,101256] 0 2024-08-01T06:55:53.402 INFO:tasks.workunit.client.1.smithi089.stdout:3/172: dwrite d7/dd/d10/f2d [0,4194304] 0 2024-08-01T06:55:53.404 INFO:tasks.workunit.client.1.smithi089.stdout:0/297: dwrite d9/f5e [0,4194304] 0 2024-08-01T06:55:53.406 INFO:tasks.workunit.client.1.smithi089.stdout:1/286: dwrite d0/f13 [0,4194304] 0 2024-08-01T06:55:53.406 INFO:tasks.workunit.client.1.smithi089.stdout:4/271: creat d3/d1e/f58 x:0 0 0 2024-08-01T06:55:53.408 INFO:tasks.workunit.client.1.smithi089.stdout:7/240: truncate d7/d46/f54 561011 0 2024-08-01T06:55:53.411 INFO:tasks.workunit.client.1.smithi089.stdout:2/195: mkdir d7/d19/d1e/d3f 0 2024-08-01T06:55:53.412 INFO:tasks.workunit.client.1.smithi089.stdout:4/272: stat d3/db/d16 0 2024-08-01T06:55:53.415 INFO:tasks.workunit.client.1.smithi089.stdout:4/273: readlink d3/db/de/l30 0 2024-08-01T06:55:53.416 INFO:tasks.workunit.client.1.smithi089.stdout:0/298: mknod d9/d40/d25/d46/c60 0 2024-08-01T06:55:53.417 INFO:tasks.workunit.client.1.smithi089.stdout:0/299: chown d9 172 1 2024-08-01T06:55:53.423 INFO:tasks.workunit.client.1.smithi089.stdout:8/243: dwrite d5/d15/f44 [0,4194304] 0 2024-08-01T06:55:53.431 INFO:tasks.workunit.client.1.smithi089.stdout:8/244: dread - d5/dc/d12/f4c zero size 2024-08-01T06:55:53.432 INFO:tasks.workunit.client.1.smithi089.stdout:4/274: unlink d3/db/de/l19 0 2024-08-01T06:55:53.434 INFO:tasks.workunit.client.1.smithi089.stdout:7/241: dwrite d7/d1f/f1d [0,4194304] 0 2024-08-01T06:55:53.436 INFO:tasks.workunit.client.1.smithi089.stdout:9/240: getdents d18/d3d 0 2024-08-01T06:55:53.437 INFO:tasks.workunit.client.1.smithi089.stdout:7/242: readlink d7/df/l32 0 2024-08-01T06:55:53.438 INFO:tasks.workunit.client.1.smithi089.stdout:3/173: dread d7/dd/d10/f13 [0,4194304] 0 2024-08-01T06:55:53.439 INFO:tasks.workunit.client.1.smithi089.stdout:4/275: chown d3/d1e/c3c 69191 1 2024-08-01T06:55:53.440 INFO:tasks.workunit.client.1.smithi089.stdout:1/287: dwrite d0/d9/d15/d2d/d4a/f55 [0,4194304] 0 2024-08-01T06:55:53.440 INFO:tasks.workunit.client.1.smithi089.stdout:6/280: rename d2/f5 to d2/d11/f66 0 2024-08-01T06:55:53.440 INFO:tasks.workunit.client.1.smithi089.stdout:8/245: chown d5/c1d 777156394 1 2024-08-01T06:55:53.445 INFO:tasks.workunit.client.1.smithi089.stdout:9/241: creat d18/f4f x:0 0 0 2024-08-01T06:55:53.445 INFO:tasks.workunit.client.1.smithi089.stdout:3/174: dread - d7/f1f zero size 2024-08-01T06:55:53.445 INFO:tasks.workunit.client.1.smithi089.stdout:6/281: chown d2/d11 204646437 1 2024-08-01T06:55:53.448 INFO:tasks.workunit.client.1.smithi089.stdout:5/186: rename d5/de/d10/d16/c32 to d5/de/d10/d16/d1b/d25/c40 0 2024-08-01T06:55:53.448 INFO:tasks.workunit.client.1.smithi089.stdout:0/300: dwrite d9/f18 [4194304,4194304] 0 2024-08-01T06:55:53.450 INFO:tasks.workunit.client.1.smithi089.stdout:9/242: mkdir d18/d22/d39/d50 0 2024-08-01T06:55:53.450 INFO:tasks.workunit.client.1.smithi089.stdout:1/288: read - d0/d9/d15/d2d/f36 zero size 2024-08-01T06:55:53.452 INFO:tasks.workunit.client.1.smithi089.stdout:3/175: rmdir d7/dd/d10 39 2024-08-01T06:55:53.455 INFO:tasks.workunit.client.1.smithi089.stdout:1/289: chown d0/d9/d15 980 1 2024-08-01T06:55:53.461 INFO:tasks.workunit.client.1.smithi089.stdout:0/301: rename d9/d40 to d9/d40/d26/d2e/d44/d53/d61 22 2024-08-01T06:55:53.463 INFO:tasks.workunit.client.1.smithi089.stdout:9/243: creat d18/d22/d45/f51 x:0 0 0 2024-08-01T06:55:53.464 INFO:tasks.workunit.client.1.smithi089.stdout:3/176: write d7/dd/f15 [1801954,52722] 0 2024-08-01T06:55:53.465 INFO:tasks.workunit.client.1.smithi089.stdout:6/282: unlink d2/d11/d1f/d46/d56/f58 0 2024-08-01T06:55:53.465 INFO:tasks.workunit.client.1.smithi089.stdout:4/276: dwrite d3/d17/d3a/f54 [0,4194304] 0 2024-08-01T06:55:53.466 INFO:tasks.workunit.client.1.smithi089.stdout:8/246: creat d5/dc/f52 x:0 0 0 2024-08-01T06:55:53.467 INFO:tasks.workunit.client.1.smithi089.stdout:0/302: fsync d9/d40/d25/d46/f38 0 2024-08-01T06:55:53.472 INFO:tasks.workunit.client.1.smithi089.stdout:4/277: chown d3 431264 1 2024-08-01T06:55:53.472 INFO:tasks.workunit.client.1.smithi089.stdout:3/177: chown d7/dd/c17 67811 1 2024-08-01T06:55:53.475 INFO:tasks.workunit.client.1.smithi089.stdout:5/187: write f0 [2854444,11116] 0 2024-08-01T06:55:53.476 INFO:tasks.workunit.client.1.smithi089.stdout:9/244: truncate d18/d22/f28 688481 0 2024-08-01T06:55:53.480 INFO:tasks.workunit.client.1.smithi089.stdout:7/243: dwrite d7/d15/f25 [4194304,4194304] 0 2024-08-01T06:55:53.481 INFO:tasks.workunit.client.1.smithi089.stdout:6/283: mknod d2/d11/d1a/d1c/d40/c67 0 2024-08-01T06:55:53.481 INFO:tasks.workunit.client.1.smithi089.stdout:2/196: dwrite d7/fa [0,4194304] 0 2024-08-01T06:55:53.486 INFO:tasks.workunit.client.1.smithi089.stdout:9/245: mkdir d18/d22/d52 0 2024-08-01T06:55:53.487 INFO:tasks.workunit.client.1.smithi089.stdout:7/244: chown d7/l9 48078 1 2024-08-01T06:55:53.489 INFO:tasks.workunit.client.1.smithi089.stdout:1/290: link d0/d9/d15/d2d/c35 d0/d9/d43/c68 0 2024-08-01T06:55:53.489 INFO:tasks.workunit.client.1.smithi089.stdout:5/188: rename d5/de/df/c26 to d5/de/df/c41 0 2024-08-01T06:55:53.492 INFO:tasks.workunit.client.1.smithi089.stdout:4/278: rename d3/db/l1b to d3/d1e/d21/d57/l59 0 2024-08-01T06:55:53.492 INFO:tasks.workunit.client.1.smithi089.stdout:8/247: dread d5/f10 [0,4194304] 0 2024-08-01T06:55:53.494 INFO:tasks.workunit.client.1.smithi089.stdout:7/245: mknod d7/df/d10/d36/c59 0 2024-08-01T06:55:53.495 INFO:tasks.workunit.client.1.smithi089.stdout:1/291: write d0/f19 [3153755,20317] 0 2024-08-01T06:55:53.497 INFO:tasks.workunit.client.1.smithi089.stdout:8/248: read d5/f3a [154876,39688] 0 2024-08-01T06:55:53.497 INFO:tasks.workunit.client.1.smithi089.stdout:2/197: truncate d7/d19/d1e/f30 373741 0 2024-08-01T06:55:53.499 INFO:tasks.workunit.client.1.smithi089.stdout:3/178: dwrite d7/dd/f2e [0,4194304] 0 2024-08-01T06:55:53.503 INFO:tasks.workunit.client.1.smithi089.stdout:0/303: truncate d9/f13 25909 0 2024-08-01T06:55:53.505 INFO:tasks.workunit.client.1.smithi089.stdout:2/198: write d7/d1f/d29/f1a [1281262,50035] 0 2024-08-01T06:55:53.508 INFO:tasks.workunit.client.1.smithi089.stdout:6/284: dwrite d2/d11/d1f/f50 [4194304,4194304] 0 2024-08-01T06:55:53.509 INFO:tasks.workunit.client.1.smithi089.stdout:5/189: dwrite f0 [0,4194304] 0 2024-08-01T06:55:53.509 INFO:tasks.workunit.client.1.smithi089.stdout:2/199: write d7/d19/f37 [1185473,23012] 0 2024-08-01T06:55:53.513 INFO:tasks.workunit.client.1.smithi089.stdout:1/292: mknod d0/d9/d15/d2d/d4a/c69 0 2024-08-01T06:55:53.514 INFO:tasks.workunit.client.1.smithi089.stdout:5/190: read - d5/de/d10/d16/d1b/f22 zero size 2024-08-01T06:55:53.515 INFO:tasks.workunit.client.1.smithi089.stdout:6/285: fdatasync d2/fe 0 2024-08-01T06:55:53.519 INFO:tasks.workunit.client.1.smithi089.stdout:1/293: symlink d0/d9/d15/d2d/d4a/d61/l6a 0 2024-08-01T06:55:53.522 INFO:tasks.workunit.client.1.smithi089.stdout:2/200: truncate d7/d19/d1e/f2e 1370108 0 2024-08-01T06:55:53.525 INFO:tasks.workunit.client.1.smithi089.stdout:6/286: symlink d2/d11/d1a/l68 0 2024-08-01T06:55:53.526 INFO:tasks.workunit.client.1.smithi089.stdout:6/287: write d2/d11/d3e/f60 [298826,31474] 0 2024-08-01T06:55:53.529 INFO:tasks.workunit.client.1.smithi089.stdout:2/201: creat d7/d19/f40 x:0 0 0 2024-08-01T06:55:53.534 INFO:tasks.workunit.client.1.smithi089.stdout:7/246: write d7/d1f/f1a [805561,81209] 0 2024-08-01T06:55:53.536 INFO:tasks.workunit.client.1.smithi089.stdout:2/202: mknod d7/d19/d3b/c41 0 2024-08-01T06:55:53.543 INFO:tasks.workunit.client.1.smithi089.stdout:4/279: dwrite d3/f24 [0,4194304] 0 2024-08-01T06:55:53.545 INFO:tasks.workunit.client.1.smithi089.stdout:2/203: symlink d7/d19/d1e/d3d/l42 0 2024-08-01T06:55:53.546 INFO:tasks.workunit.client.1.smithi089.stdout:6/288: dwrite d2/d11/d1f/f2d [0,4194304] 0 2024-08-01T06:55:53.547 INFO:tasks.workunit.client.1.smithi089.stdout:4/280: dread - d3/d29/d3b/f48 zero size 2024-08-01T06:55:53.548 INFO:tasks.workunit.client.1.smithi089.stdout:2/204: chown d7/d19/d1e 1199 1 2024-08-01T06:55:53.549 INFO:tasks.workunit.client.1.smithi089.stdout:7/247: dwrite d7/d15/f25 [4194304,4194304] 0 2024-08-01T06:55:53.553 INFO:tasks.workunit.client.1.smithi089.stdout:4/281: write d3/d1e/f58 [904853,1163] 0 2024-08-01T06:55:53.554 INFO:tasks.workunit.client.1.smithi089.stdout:6/289: write d2/d11/d1a/d1c/d40/f5e [483309,39884] 0 2024-08-01T06:55:53.555 INFO:tasks.workunit.client.1.smithi089.stdout:2/205: rmdir d7/d1f/d29 39 2024-08-01T06:55:53.556 INFO:tasks.workunit.client.1.smithi089.stdout:1/294: write d0/d9/d15/d2d/f33 [1680218,63268] 0 2024-08-01T06:55:53.556 INFO:tasks.workunit.client.1.smithi089.stdout:7/248: symlink d7/df/d10/d31/l5a 0 2024-08-01T06:55:53.570 INFO:tasks.workunit.client.1.smithi089.stdout:1/295: getdents d0/d9/d54 0 2024-08-01T06:55:53.571 INFO:tasks.workunit.client.1.smithi089.stdout:2/206: creat d7/d1f/d29/f43 x:0 0 0 2024-08-01T06:55:53.572 INFO:tasks.workunit.client.1.smithi089.stdout:2/207: read d7/d1f/f20 [380036,22323] 0 2024-08-01T06:55:53.576 INFO:tasks.workunit.client.1.smithi089.stdout:2/208: creat d7/d19/f44 x:0 0 0 2024-08-01T06:55:53.576 INFO:tasks.workunit.client.1.smithi089.stdout:4/282: write d3/d17/f20 [2269819,76801] 0 2024-08-01T06:55:53.577 INFO:tasks.workunit.client.1.smithi089.stdout:6/290: write d2/d11/f63 [3798583,57358] 0 2024-08-01T06:55:53.583 INFO:tasks.workunit.client.1.smithi089.stdout:6/291: getdents d2/d30/d3c/d3d 0 2024-08-01T06:55:53.584 INFO:tasks.workunit.client.1.smithi089.stdout:2/209: dwrite d7/fa [0,4194304] 0 2024-08-01T06:55:53.584 INFO:tasks.workunit.client.1.smithi089.stdout:4/283: link d3/d1e/f40 d3/d1e/d21/f5a 0 2024-08-01T06:55:53.586 INFO:tasks.workunit.client.1.smithi089.stdout:6/292: write d2/d11/d1a/f35 [653714,22709] 0 2024-08-01T06:55:53.587 INFO:tasks.workunit.client.1.smithi089.stdout:2/210: chown d7/c1b 2564 1 2024-08-01T06:55:53.587 INFO:tasks.workunit.client.1.smithi089.stdout:4/284: readlink d3/db/l3e 0 2024-08-01T06:55:53.588 INFO:tasks.workunit.client.1.smithi089.stdout:1/296: dwrite d0/f20 [0,4194304] 0 2024-08-01T06:55:53.591 INFO:tasks.workunit.client.1.smithi089.stdout:6/293: symlink d2/d30/l69 0 2024-08-01T06:55:53.592 INFO:tasks.workunit.client.1.smithi089.stdout:1/297: write d0/f20 [3283827,51340] 0 2024-08-01T06:55:53.593 INFO:tasks.workunit.client.1.smithi089.stdout:4/285: mkdir d3/db/de/d5b 0 2024-08-01T06:55:53.594 INFO:tasks.workunit.client.1.smithi089.stdout:6/294: dread - d2/d11/d1f/d46/f62 zero size 2024-08-01T06:55:53.597 INFO:tasks.workunit.client.1.smithi089.stdout:4/286: readlink d3/d17/l52 0 2024-08-01T06:55:53.600 INFO:tasks.workunit.client.1.smithi089.stdout:4/287: chown d3/d1e/f25 18 1 2024-08-01T06:55:53.605 INFO:tasks.workunit.client.1.smithi089.stdout:2/211: dwrite d7/d19/f37 [0,4194304] 0 2024-08-01T06:55:53.606 INFO:tasks.workunit.client.1.smithi089.stdout:4/288: rename d3/db/de/c2e to d3/db/d33/c5c 0 2024-08-01T06:55:53.608 INFO:tasks.workunit.client.1.smithi089.stdout:2/212: unlink d7/d1f/d29/f38 0 2024-08-01T06:55:53.615 INFO:tasks.workunit.client.1.smithi089.stdout:1/298: dread d0/f11 [0,4194304] 0 2024-08-01T06:55:53.616 INFO:tasks.workunit.client.1.smithi089.stdout:2/213: dread d7/d1f/f20 [0,4194304] 0 2024-08-01T06:55:53.622 INFO:tasks.workunit.client.1.smithi089.stdout:1/299: creat d0/d9/d15/f6b x:0 0 0 2024-08-01T06:55:53.622 INFO:tasks.workunit.client.1.smithi089.stdout:1/300: chown d0/f11 24494 1 2024-08-01T06:55:53.626 INFO:tasks.workunit.client.1.smithi089.stdout:2/214: rmdir d7/d1f 39 2024-08-01T06:55:53.627 INFO:tasks.workunit.client.1.smithi089.stdout:2/215: write d7/f23 [429178,122536] 0 2024-08-01T06:55:53.628 INFO:tasks.workunit.client.1.smithi089.stdout:6/295: dread d2/f8 [0,4194304] 0 2024-08-01T06:55:53.631 INFO:tasks.workunit.client.1.smithi089.stdout:1/301: write d0/d9/d15/d3b/f3c [929882,25845] 0 2024-08-01T06:55:53.631 INFO:tasks.workunit.client.1.smithi089.stdout:6/296: fdatasync d2/f18 0 2024-08-01T06:55:53.637 INFO:tasks.workunit.client.1.smithi089.stdout:6/297: creat d2/d11/d1a/f6a x:0 0 0 2024-08-01T06:55:53.638 INFO:tasks.workunit.client.1.smithi089.stdout:4/289: dwrite d3/d1e/d21/f45 [0,4194304] 0 2024-08-01T06:55:53.640 INFO:tasks.workunit.client.1.smithi089.stdout:2/216: dwrite d7/d19/f44 [0,4194304] 0 2024-08-01T06:55:53.643 INFO:tasks.workunit.client.1.smithi089.stdout:6/298: mkdir d2/d11/d1f/d46/d6b 0 2024-08-01T06:55:53.645 INFO:tasks.workunit.client.1.smithi089.stdout:1/302: dwrite d0/d9/d15/d2d/d4a/f47 [0,4194304] 0 2024-08-01T06:55:53.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:53 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:55:53.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:53 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:55:53.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:53 smithi016 ceph-mon[29266]: Adjusting osd_memory_target on smithi016 to 1217M 2024-08-01T06:55:53.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:53 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:53.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:53 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:55:53.649 INFO:tasks.workunit.client.1.smithi089.stdout:6/299: mknod d2/d2e/d2f/c6c 0 2024-08-01T06:55:53.649 INFO:tasks.workunit.client.1.smithi089.stdout:6/300: fsync d2/f2b 0 2024-08-01T06:55:53.653 INFO:tasks.workunit.client.1.smithi089.stdout:6/301: write d2/f18 [9207215,94051] 0 2024-08-01T06:55:53.653 INFO:tasks.workunit.client.1.smithi089.stdout:1/303: rename d0/d9/d1e to d0/d6c 0 2024-08-01T06:55:53.655 INFO:tasks.workunit.client.1.smithi089.stdout:1/304: fsync d0/d9/d15/d2d/f33 0 2024-08-01T06:55:53.656 INFO:tasks.workunit.client.1.smithi089.stdout:1/305: stat d0/d9/d15/d2d/f3a 0 2024-08-01T06:55:53.657 INFO:tasks.workunit.client.1.smithi089.stdout:1/306: chown d0/d9/d15/d2d/d4a/f5e 0 1 2024-08-01T06:55:53.658 INFO:tasks.workunit.client.1.smithi089.stdout:6/302: rename d2/d11/d1a/d1c/d40/f5e to d2/d2e/d2f/f6d 0 2024-08-01T06:55:53.659 INFO:tasks.workunit.client.1.smithi089.stdout:6/303: chown d2/d11/d1a/d1c/l55 85653739 1 2024-08-01T06:55:53.661 INFO:tasks.workunit.client.1.smithi089.stdout:1/307: rmdir d0/d9/d15/d2d 39 2024-08-01T06:55:53.662 INFO:tasks.workunit.client.1.smithi089.stdout:1/308: read - d0/d9/d15/d2b/f39 zero size 2024-08-01T06:55:53.663 INFO:tasks.workunit.client.1.smithi089.stdout:6/304: dread d2/ff [0,4194304] 0 2024-08-01T06:55:53.666 INFO:tasks.workunit.client.1.smithi089.stdout:1/309: dread - d0/d9/d15/d2d/d4a/f5e zero size 2024-08-01T06:55:53.670 INFO:tasks.workunit.client.1.smithi089.stdout:4/290: dwrite d3/d29/f2a [0,4194304] 0 2024-08-01T06:55:53.671 INFO:tasks.workunit.client.1.smithi089.stdout:1/310: creat d0/d9/d15/d2d/d4a/d4d/f6d x:0 0 0 2024-08-01T06:55:53.679 INFO:tasks.workunit.client.1.smithi089.stdout:1/311: dwrite d0/d9/d15/f34 [0,4194304] 0 2024-08-01T06:55:53.681 INFO:tasks.workunit.client.1.smithi089.stdout:1/312: dread - d0/d9/d15/d2d/f53 zero size 2024-08-01T06:55:53.682 INFO:tasks.workunit.client.1.smithi089.stdout:4/291: link d3/db/d16/f1a d3/d17/d3a/f5d 0 2024-08-01T06:55:53.684 INFO:tasks.workunit.client.1.smithi089.stdout:1/313: fsync d0/d9/d15/d2d/d4a/d4d/f50 0 2024-08-01T06:55:53.686 INFO:tasks.workunit.client.1.smithi089.stdout:4/292: creat d3/d1e/d21/d57/f5e x:0 0 0 2024-08-01T06:55:53.687 INFO:tasks.workunit.client.1.smithi089.stdout:4/293: write d3/db/d16/f18 [2858161,119485] 0 2024-08-01T06:55:53.687 INFO:tasks.workunit.client.1.smithi089.stdout:1/314: creat d0/d9/d15/d2d/d4a/d4d/f6e x:0 0 0 2024-08-01T06:55:53.688 INFO:tasks.workunit.client.1.smithi089.stdout:6/305: write d2/d11/f66 [3762722,96415] 0 2024-08-01T06:55:53.692 INFO:tasks.workunit.client.1.smithi089.stdout:4/294: rmdir d3/db/de 39 2024-08-01T06:55:53.693 INFO:tasks.workunit.client.1.smithi089.stdout:6/306: mknod d2/d30/c6e 0 2024-08-01T06:55:53.697 INFO:tasks.workunit.client.1.smithi089.stdout:6/307: mknod d2/d11/d1f/d46/c6f 0 2024-08-01T06:55:53.697 INFO:tasks.workunit.client.1.smithi089.stdout:1/315: dwrite d0/d9/d15/d2b/f39 [0,4194304] 0 2024-08-01T06:55:53.699 INFO:tasks.workunit.client.1.smithi089.stdout:4/295: mknod d3/db/de/d5b/c5f 0 2024-08-01T06:55:53.701 INFO:tasks.workunit.client.1.smithi089.stdout:6/308: symlink d2/d2e/d2f/d31/l70 0 2024-08-01T06:55:53.704 INFO:tasks.workunit.client.1.smithi089.stdout:4/296: unlink d3/db/l3e 0 2024-08-01T06:55:53.705 INFO:tasks.workunit.client.1.smithi089.stdout:6/309: write d2/d11/d1a/d1c/d40/f48 [427455,116569] 0 2024-08-01T06:55:53.709 INFO:tasks.workunit.client.1.smithi089.stdout:1/316: dwrite d0/f19 [0,4194304] 0 2024-08-01T06:55:53.711 INFO:tasks.workunit.client.1.smithi089.stdout:4/297: rename d3/db/f50 to d3/d1e/d21/f60 0 2024-08-01T06:55:53.712 INFO:tasks.workunit.client.1.smithi089.stdout:1/317: fsync d0/d9/d15/d2d/d4a/d4d/f50 0 2024-08-01T06:55:53.714 INFO:tasks.workunit.client.1.smithi089.stdout:4/298: unlink d3/db/c15 0 2024-08-01T06:55:53.716 INFO:tasks.workunit.client.1.smithi089.stdout:6/310: rename d2/d11/d1f/f50 to d2/d30/d3c/d3d/f71 0 2024-08-01T06:55:53.717 INFO:tasks.workunit.client.1.smithi089.stdout:1/318: rmdir d0/d9/d15/d2d/d4a/d4d 39 2024-08-01T06:55:53.718 INFO:tasks.workunit.client.1.smithi089.stdout:1/319: fdatasync d0/d9/d15/d2d/d4a/f47 0 2024-08-01T06:55:53.723 INFO:tasks.workunit.client.1.smithi089.stdout:6/311: rename d2/d11/d1a/f35 to d2/d11/d1f/d46/f72 0 2024-08-01T06:55:53.726 INFO:tasks.workunit.client.1.smithi089.stdout:1/320: mknod d0/c6f 0 2024-08-01T06:55:53.729 INFO:tasks.workunit.client.1.smithi089.stdout:6/312: fsync d2/ff 0 2024-08-01T06:55:53.734 INFO:tasks.workunit.client.1.smithi089.stdout:4/299: link d3/d17/d3a/f5d d3/d1e/d21/d26/f61 0 2024-08-01T06:55:53.738 INFO:tasks.workunit.client.1.smithi089.stdout:6/313: link d2/d11/f63 d2/d30/f73 0 2024-08-01T06:55:53.738 INFO:tasks.workunit.client.1.smithi089.stdout:4/300: chown d3/db/d33/c5c 2134836 1 2024-08-01T06:55:53.739 INFO:tasks.workunit.client.1.smithi089.stdout:4/301: dread - d3/db/d33/f56 zero size 2024-08-01T06:55:53.741 INFO:tasks.workunit.client.1.smithi089.stdout:6/314: write d2/d2e/d2f/f6d [855080,74560] 0 2024-08-01T06:55:53.741 INFO:tasks.workunit.client.1.smithi089.stdout:4/302: write d3/d17/f20 [3355357,43083] 0 2024-08-01T06:55:53.743 INFO:tasks.workunit.client.1.smithi089.stdout:1/321: truncate d0/d9/d15/d3b/f3c 552657 0 2024-08-01T06:55:53.744 INFO:tasks.workunit.client.1.smithi089.stdout:6/315: rmdir d2/d30/d3c/d3d 39 2024-08-01T06:55:53.744 INFO:tasks.workunit.client.1.smithi089.stdout:1/322: fdatasync d0/d9/d15/d2d/d4a/d61/f67 0 2024-08-01T06:55:53.744 INFO:tasks.workunit.client.1.smithi089.stdout:1/323: stat d0/d9/d43 0 2024-08-01T06:55:53.750 INFO:tasks.workunit.client.1.smithi089.stdout:6/316: truncate d2/f2b 1065864 0 2024-08-01T06:55:53.752 INFO:tasks.workunit.client.1.smithi089.stdout:6/317: chown d2/d30/c64 115470 1 2024-08-01T06:55:53.798 INFO:tasks.workunit.client.1.smithi089.stdout:9/246: sync 2024-08-01T06:55:53.809 INFO:tasks.workunit.client.1.smithi089.stdout:6/318: rename d2/d11/d1a/d1c/c20 to d2/d30/c74 0 2024-08-01T06:55:53.811 INFO:tasks.workunit.client.1.smithi089.stdout:6/319: write d2/d11/d1f/f5a [726774,121476] 0 2024-08-01T06:55:53.812 INFO:tasks.workunit.client.1.smithi089.stdout:9/247: unlink d18/d22/f44 0 2024-08-01T06:55:53.817 INFO:tasks.workunit.client.1.smithi089.stdout:1/324: dwrite d0/d9/d43/f5c [0,4194304] 0 2024-08-01T06:55:53.820 INFO:tasks.workunit.client.1.smithi089.stdout:6/320: rmdir d2/d11/d1f/d46/d56 0 2024-08-01T06:55:53.820 INFO:tasks.workunit.client.1.smithi089.stdout:1/325: stat d0/d9/d15/d2d/d4a/d61/l6a 0 2024-08-01T06:55:53.822 INFO:tasks.workunit.client.1.smithi089.stdout:9/248: dwrite d18/d33/f37 [0,4194304] 0 2024-08-01T06:55:53.823 INFO:tasks.workunit.client.1.smithi089.stdout:1/326: truncate d0/d6c/f37 947201 0 2024-08-01T06:55:53.827 INFO:tasks.workunit.client.1.smithi089.stdout:9/249: unlink d18/f1f 0 2024-08-01T06:55:53.829 INFO:tasks.workunit.client.1.smithi089.stdout:6/321: dwrite d2/d11/f17 [0,4194304] 0 2024-08-01T06:55:53.875 INFO:tasks.workunit.client.1.smithi089.stdout:1/327: dwrite d0/d9/d15/d2d/d4a/d4d/f50 [0,4194304] 0 2024-08-01T06:55:53.876 INFO:tasks.workunit.client.1.smithi089.stdout:9/250: dwrite d18/d22/d39/f42 [0,4194304] 0 2024-08-01T06:55:53.876 INFO:tasks.workunit.client.1.smithi089.stdout:9/251: chown d18/d3d/f41 425145564 1 2024-08-01T06:55:53.876 INFO:tasks.workunit.client.1.smithi089.stdout:6/322: dwrite d2/ff [4194304,4194304] 0 2024-08-01T06:55:53.876 INFO:tasks.workunit.client.1.smithi089.stdout:1/328: fsync d0/d9/d15/d2d/d4a/f55 0 2024-08-01T06:55:53.876 INFO:tasks.workunit.client.1.smithi089.stdout:1/329: chown d0/d9/d15/d2d/d4a/c69 1680 1 2024-08-01T06:55:53.876 INFO:tasks.workunit.client.1.smithi089.stdout:6/323: creat d2/f75 x:0 0 0 2024-08-01T06:55:53.876 INFO:tasks.workunit.client.1.smithi089.stdout:9/252: dwrite f16 [0,4194304] 0 2024-08-01T06:55:53.876 INFO:tasks.workunit.client.1.smithi089.stdout:6/324: write d2/d11/d1f/f5a [522127,19552] 0 2024-08-01T06:55:53.876 INFO:tasks.workunit.client.1.smithi089.stdout:1/330: read - d0/d9/d15/d2d/d4a/d4d/f5d zero size 2024-08-01T06:55:53.876 INFO:tasks.workunit.client.1.smithi089.stdout:9/253: chown d18/d22/d43 45380 1 2024-08-01T06:55:53.876 INFO:tasks.workunit.client.1.smithi089.stdout:1/331: write d0/d9/d43/f5c [4526945,62670] 0 2024-08-01T06:55:53.876 INFO:tasks.workunit.client.1.smithi089.stdout:9/254: chown f13 24 1 2024-08-01T06:55:53.877 INFO:tasks.workunit.client.1.smithi089.stdout:8/249: sync 2024-08-01T06:55:53.877 INFO:tasks.workunit.client.1.smithi089.stdout:6/325: rename d2/d11/f51 to d2/d11/d3e/f76 0 2024-08-01T06:55:53.877 INFO:tasks.workunit.client.1.smithi089.stdout:6/326: fdatasync d2/d11/d1f/f5a 0 2024-08-01T06:55:53.877 INFO:tasks.workunit.client.1.smithi089.stdout:9/255: mkdir d18/d33/d53 0 2024-08-01T06:55:53.877 INFO:tasks.workunit.client.1.smithi089.stdout:8/250: mkdir d5/dc/d1e/d53 0 2024-08-01T06:55:53.877 INFO:tasks.workunit.client.1.smithi089.stdout:6/327: creat d2/d11/d1f/f77 x:0 0 0 2024-08-01T06:55:53.878 INFO:tasks.workunit.client.1.smithi089.stdout:8/251: mknod d5/d2c/c54 0 2024-08-01T06:55:53.879 INFO:tasks.workunit.client.1.smithi089.stdout:9/256: dwrite f10 [0,4194304] 0 2024-08-01T06:55:53.879 INFO:tasks.workunit.client.1.smithi089.stdout:6/328: rename d2/d2e/d2f/c3f to d2/d30/c78 0 2024-08-01T06:55:53.882 INFO:tasks.workunit.client.1.smithi089.stdout:6/329: truncate d2/d11/d1f/d46/f62 928232 0 2024-08-01T06:55:53.883 INFO:tasks.workunit.client.1.smithi089.stdout:8/252: creat d5/d2c/f55 x:0 0 0 2024-08-01T06:55:53.883 INFO:tasks.workunit.client.1.smithi089.stdout:9/257: truncate fe 3997985 0 2024-08-01T06:55:53.885 INFO:tasks.workunit.client.1.smithi089.stdout:8/253: creat d5/dc/d12/f56 x:0 0 0 2024-08-01T06:55:53.889 INFO:tasks.workunit.client.1.smithi089.stdout:8/254: write d5/dc/f16 [94931,82466] 0 2024-08-01T06:55:53.889 INFO:tasks.workunit.client.1.smithi089.stdout:9/258: creat d18/d22/d52/f54 x:0 0 0 2024-08-01T06:55:53.890 INFO:tasks.workunit.client.1.smithi089.stdout:9/259: write f13 [3820598,37863] 0 2024-08-01T06:55:53.890 INFO:tasks.workunit.client.1.smithi089.stdout:6/330: dread d2/d2e/d2f/d31/f44 [0,4194304] 0 2024-08-01T06:55:53.890 INFO:tasks.workunit.client.1.smithi089.stdout:8/255: chown d5/dc/f52 331 1 2024-08-01T06:55:53.892 INFO:tasks.workunit.client.1.smithi089.stdout:8/256: chown d5/dc/d12/f4c 7 1 2024-08-01T06:55:53.892 INFO:tasks.workunit.client.1.smithi089.stdout:8/257: stat d5/d23/f38 0 2024-08-01T06:55:53.895 INFO:tasks.workunit.client.1.smithi089.stdout:6/331: write d2/d11/d3e/f76 [171429,43313] 0 2024-08-01T06:55:53.899 INFO:tasks.workunit.client.1.smithi089.stdout:5/191: sync 2024-08-01T06:55:53.899 INFO:tasks.workunit.client.1.smithi089.stdout:3/179: sync 2024-08-01T06:55:53.899 INFO:tasks.workunit.client.1.smithi089.stdout:0/304: sync 2024-08-01T06:55:53.900 INFO:tasks.workunit.client.1.smithi089.stdout:3/180: stat d7/c19 0 2024-08-01T06:55:53.901 INFO:tasks.workunit.client.1.smithi089.stdout:9/260: getdents d18/d22/d43 0 2024-08-01T06:55:53.901 INFO:tasks.workunit.client.1.smithi089.stdout:1/332: truncate d0/f19 2570594 0 2024-08-01T06:55:53.903 INFO:tasks.workunit.client.1.smithi089.stdout:5/192: read d5/de/d10/f3b [3775909,64395] 0 2024-08-01T06:55:53.903 INFO:tasks.workunit.client.1.smithi089.stdout:0/305: truncate d9/d22/d2b/f43 4848497 0 2024-08-01T06:55:53.908 INFO:tasks.workunit.client.1.smithi089.stdout:1/333: symlink d0/d6c/d49/l70 0 2024-08-01T06:55:53.913 INFO:tasks.workunit.client.1.smithi089.stdout:8/258: dread d5/dc/f16 [0,4194304] 0 2024-08-01T06:55:53.915 INFO:tasks.workunit.client.1.smithi089.stdout:0/306: mkdir d9/d22/d2b/d55/d62 0 2024-08-01T06:55:53.918 INFO:tasks.workunit.client.1.smithi089.stdout:6/332: getdents d2/d2e/d2f 0 2024-08-01T06:55:53.920 INFO:tasks.workunit.client.1.smithi089.stdout:5/193: dread d5/de/d10/d16/d1b/f2e [0,4194304] 0 2024-08-01T06:55:53.922 INFO:tasks.workunit.client.1.smithi089.stdout:1/334: dread d0/f23 [0,4194304] 0 2024-08-01T06:55:53.929 INFO:tasks.workunit.client.1.smithi089.stdout:0/307: dread f7 [0,4194304] 0 2024-08-01T06:55:53.929 INFO:tasks.workunit.client.1.smithi089.stdout:5/194: mkdir d5/d13/d38/d42 0 2024-08-01T06:55:53.930 INFO:tasks.workunit.client.1.smithi089.stdout:3/181: link d7/c1d d7/dd/d10/d23/d2f/c30 0 2024-08-01T06:55:53.931 INFO:tasks.workunit.client.1.smithi089.stdout:5/195: chown d5/d13/c3f 476 1 2024-08-01T06:55:53.933 INFO:tasks.workunit.client.1.smithi089.stdout:3/182: chown d7/l8 0 1 2024-08-01T06:55:53.935 INFO:tasks.workunit.client.1.smithi089.stdout:6/333: symlink d2/d11/d1f/d46/d6b/l79 0 2024-08-01T06:55:53.936 INFO:tasks.workunit.client.1.smithi089.stdout:9/261: dwrite d18/f2a [4194304,4194304] 0 2024-08-01T06:55:53.937 INFO:tasks.workunit.client.1.smithi089.stdout:6/334: readlink d2/d11/d1a/d1c/l55 0 2024-08-01T06:55:53.937 INFO:tasks.workunit.client.1.smithi089.stdout:1/335: dread d0/d9/d15/d3b/f3c [0,4194304] 0 2024-08-01T06:55:53.937 INFO:tasks.workunit.client.1.smithi089.stdout:0/308: symlink d9/d22/d2b/l63 0 2024-08-01T06:55:53.941 INFO:tasks.workunit.client.1.smithi089.stdout:6/335: dread d2/d11/d1a/f33 [0,4194304] 0 2024-08-01T06:55:53.942 INFO:tasks.workunit.client.1.smithi089.stdout:3/183: mkdir d7/dd/d10/d23/d31 0 2024-08-01T06:55:53.946 INFO:tasks.workunit.client.1.smithi089.stdout:6/336: truncate d2/d2e/d2f/d31/f41 5127401 0 2024-08-01T06:55:53.947 INFO:tasks.workunit.client.1.smithi089.stdout:3/184: truncate d7/dd/d10/f2d 4451857 0 2024-08-01T06:55:53.947 INFO:tasks.workunit.client.1.smithi089.stdout:9/262: mkdir d18/d3d/d55 0 2024-08-01T06:55:53.947 INFO:tasks.workunit.client.1.smithi089.stdout:3/185: chown d7/dd/d10/d23/d2f 4 1 2024-08-01T06:55:53.947 INFO:tasks.workunit.client.1.smithi089.stdout:0/309: mkdir d9/d40/d26/d64 0 2024-08-01T06:55:53.952 INFO:tasks.workunit.client.1.smithi089.stdout:0/310: dwrite d9/ff [0,4194304] 0 2024-08-01T06:55:53.953 INFO:tasks.workunit.client.1.smithi089.stdout:0/311: chown d9/l1d 870 1 2024-08-01T06:55:53.953 INFO:tasks.workunit.client.1.smithi089.stdout:8/259: dwrite d5/d23/f36 [0,4194304] 0 2024-08-01T06:55:53.954 INFO:tasks.workunit.client.1.smithi089.stdout:1/336: link d0/d9/d15/d2d/d4a/f47 d0/d9/d43/f71 0 2024-08-01T06:55:53.956 INFO:tasks.workunit.client.1.smithi089.stdout:9/263: creat d18/d3d/d55/f56 x:0 0 0 2024-08-01T06:55:53.956 INFO:tasks.workunit.client.1.smithi089.stdout:6/337: mknod d2/d30/d3c/c7a 0 2024-08-01T06:55:53.957 INFO:tasks.workunit.client.1.smithi089.stdout:9/264: stat d18/f1b 0 2024-08-01T06:55:53.958 INFO:tasks.workunit.client.1.smithi089.stdout:0/312: unlink d9/f4f 0 2024-08-01T06:55:53.960 INFO:tasks.workunit.client.1.smithi089.stdout:6/338: read d2/d2e/d2f/f4d [4158272,49788] 0 2024-08-01T06:55:53.961 INFO:tasks.workunit.client.1.smithi089.stdout:8/260: dread d5/dc/f16 [0,4194304] 0 2024-08-01T06:55:53.963 INFO:tasks.workunit.client.1.smithi089.stdout:1/337: link d0/d9/d43/f5c d0/d9/d15/d2d/d4a/d61/f72 0 2024-08-01T06:55:53.963 INFO:tasks.workunit.client.1.smithi089.stdout:6/339: chown d2/d11/d3e/f60 24558518 1 2024-08-01T06:55:53.967 INFO:tasks.workunit.client.1.smithi089.stdout:0/313: dwrite d9/d40/d25/d46/f3d [0,4194304] 0 2024-08-01T06:55:53.969 INFO:tasks.workunit.client.1.smithi089.stdout:0/314: dread - d9/d40/d26/d2e/f42 zero size 2024-08-01T06:55:53.976 INFO:tasks.workunit.client.1.smithi089.stdout:1/338: link d0/d9/d15/f52 d0/f73 0 2024-08-01T06:55:53.981 INFO:tasks.workunit.client.1.smithi089.stdout:1/339: creat d0/d9/d15/d2b/f74 x:0 0 0 2024-08-01T06:55:53.983 INFO:tasks.workunit.client.1.smithi089.stdout:8/261: dread d5/dc/f4b [0,4194304] 0 2024-08-01T06:55:53.984 INFO:tasks.workunit.client.1.smithi089.stdout:3/186: rename d7/dd/d10 to d7/d32 0 2024-08-01T06:55:53.987 INFO:tasks.workunit.client.1.smithi089.stdout:9/265: rename d18/f1a to d18/d22/f57 0 2024-08-01T06:55:53.988 INFO:tasks.workunit.client.1.smithi089.stdout:1/340: dwrite d0/d9/d15/d2d/d4a/d61/f67 [0,4194304] 0 2024-08-01T06:55:53.992 INFO:tasks.workunit.client.1.smithi089.stdout:6/340: rename d2/d11/d1a/d1c/d40/f5f to d2/d30/d3c/d3d/f7b 0 2024-08-01T06:55:53.994 INFO:tasks.workunit.client.1.smithi089.stdout:9/266: mknod d18/d33/c58 0 2024-08-01T06:55:54.041 INFO:tasks.workunit.client.1.smithi089.stdout:2/217: sync 2024-08-01T06:55:54.041 INFO:tasks.workunit.client.1.smithi089.stdout:4/303: sync 2024-08-01T06:55:54.041 INFO:tasks.workunit.client.1.smithi089.stdout:7/249: sync 2024-08-01T06:55:54.049 INFO:tasks.workunit.client.1.smithi089.stdout:6/341: dread d2/d11/d1a/f33 [0,4194304] 0 2024-08-01T06:55:54.050 INFO:tasks.workunit.client.1.smithi089.stdout:9/267: stat d18/d33/d3b 0 2024-08-01T06:55:54.050 INFO:tasks.workunit.client.1.smithi089.stdout:8/262: rename d5/d23/f31 to d5/dc/d12/f57 0 2024-08-01T06:55:54.051 INFO:tasks.workunit.client.1.smithi089.stdout:0/315: dread d9/d40/d25/f2a [0,4194304] 0 2024-08-01T06:55:54.052 INFO:tasks.workunit.client.1.smithi089.stdout:6/342: write d2/f2a [1190523,5937] 0 2024-08-01T06:55:54.057 INFO:tasks.workunit.client.1.smithi089.stdout:7/250: dread d7/df/d10/d36/f37 [0,4194304] 0 2024-08-01T06:55:54.057 INFO:tasks.workunit.client.1.smithi089.stdout:0/316: write d9/f18 [1023218,82547] 0 2024-08-01T06:55:54.058 INFO:tasks.workunit.client.1.smithi089.stdout:8/263: read - d5/d2c/f32 zero size 2024-08-01T06:55:54.060 INFO:tasks.workunit.client.1.smithi089.stdout:0/317: fdatasync d9/f33 0 2024-08-01T06:55:54.062 INFO:tasks.workunit.client.1.smithi089.stdout:2/218: dwrite d7/d19/f40 [0,4194304] 0 2024-08-01T06:55:54.063 INFO:tasks.workunit.client.1.smithi089.stdout:0/318: dread - d9/d40/d45/d47/f5c zero size 2024-08-01T06:55:54.066 INFO:tasks.workunit.client.1.smithi089.stdout:9/268: dwrite d18/f47 [0,4194304] 0 2024-08-01T06:55:54.070 INFO:tasks.workunit.client.1.smithi089.stdout:0/319: dread d9/ff [0,4194304] 0 2024-08-01T06:55:54.079 INFO:tasks.workunit.client.1.smithi089.stdout:6/343: mkdir d2/d2e/d7c 0 2024-08-01T06:55:54.087 INFO:tasks.workunit.client.1.smithi089.stdout:8/264: dread d5/f3a [0,4194304] 0 2024-08-01T06:55:54.089 INFO:tasks.workunit.client.1.smithi089.stdout:2/219: chown d7/d1f/d29/c21 471 1 2024-08-01T06:55:54.090 INFO:tasks.workunit.client.1.smithi089.stdout:2/220: fdatasync d7/d1f/d29/f43 0 2024-08-01T06:55:54.093 INFO:tasks.workunit.client.1.smithi089.stdout:9/269: unlink d18/d22/f35 0 2024-08-01T06:55:54.094 INFO:tasks.workunit.client.1.smithi089.stdout:0/320: rmdir d9/d40/d26/d2e/d44/d53 39 2024-08-01T06:55:54.096 INFO:tasks.workunit.client.1.smithi089.stdout:6/344: mkdir d2/d11/d1f/d46/d6b/d7d 0 2024-08-01T06:55:54.097 INFO:tasks.workunit.client.1.smithi089.stdout:6/345: chown d2/d11/d1f/f5a 3431 1 2024-08-01T06:55:54.097 INFO:tasks.workunit.client.1.smithi089.stdout:6/346: dread - d2/d11/d1a/f6a zero size 2024-08-01T06:55:54.098 INFO:tasks.workunit.client.1.smithi089.stdout:2/221: symlink d7/d19/d1e/d3d/l45 0 2024-08-01T06:55:54.108 INFO:tasks.workunit.client.1.smithi089.stdout:2/222: dwrite d7/d1f/d29/f43 [0,4194304] 0 2024-08-01T06:55:54.109 INFO:tasks.workunit.client.1.smithi089.stdout:0/321: fdatasync d9/f13 0 2024-08-01T06:55:54.109 INFO:tasks.workunit.client.1.smithi089.stdout:6/347: dwrite d2/d11/d1a/f29 [0,4194304] 0 2024-08-01T06:55:54.118 INFO:tasks.workunit.client.1.smithi089.stdout:2/223: dread d7/d19/f37 [0,4194304] 0 2024-08-01T06:55:54.120 INFO:tasks.workunit.client.1.smithi089.stdout:4/304: rename d3/d29 to d3/d1f/d62 0 2024-08-01T06:55:54.124 INFO:tasks.workunit.client.1.smithi089.stdout:4/305: read d3/db/f13 [496478,77186] 0 2024-08-01T06:55:54.125 INFO:tasks.workunit.client.1.smithi089.stdout:0/322: dwrite d9/d40/d25/d46/f28 [0,4194304] 0 2024-08-01T06:55:54.129 INFO:tasks.workunit.client.1.smithi089.stdout:0/323: truncate d9/d40/d25/d46/f1e 1986917 0 2024-08-01T06:55:54.130 INFO:tasks.workunit.client.1.smithi089.stdout:2/224: dwrite d7/f10 [4194304,4194304] 0 2024-08-01T06:55:54.131 INFO:tasks.workunit.client.1.smithi089.stdout:0/324: stat d9/d40/d45/d47/c52 0 2024-08-01T06:55:54.134 INFO:tasks.workunit.client.1.smithi089.stdout:4/306: creat d3/d17/d3a/f63 x:0 0 0 2024-08-01T06:55:54.136 INFO:tasks.workunit.client.1.smithi089.stdout:6/348: link d2/d2e/d2f/d31/l5b d2/d30/l7e 0 2024-08-01T06:55:54.141 INFO:tasks.workunit.client.1.smithi089.stdout:2/225: dwrite d7/d19/f44 [0,4194304] 0 2024-08-01T06:55:54.146 INFO:tasks.workunit.client.1.smithi089.stdout:2/226: dread d7/d19/f37 [0,4194304] 0 2024-08-01T06:55:54.150 INFO:tasks.workunit.client.1.smithi089.stdout:7/251: rename d7/df/l3e to d7/l5b 0 2024-08-01T06:55:54.151 INFO:tasks.workunit.client.1.smithi089.stdout:6/349: truncate d2/f8 429599 0 2024-08-01T06:55:54.152 INFO:tasks.workunit.client.1.smithi089.stdout:9/270: write f15 [1600468,114852] 0 2024-08-01T06:55:54.154 INFO:tasks.workunit.client.1.smithi089.stdout:5/196: sync 2024-08-01T06:55:54.157 INFO:tasks.workunit.client.1.smithi089.stdout:2/227: write f2 [1562417,25242] 0 2024-08-01T06:55:54.159 INFO:tasks.workunit.client.1.smithi089.stdout:8/265: rename d5/d2c to d5/d15/d58 0 2024-08-01T06:55:54.160 INFO:tasks.workunit.client.1.smithi089.stdout:0/325: dread d9/d22/d2b/f43 [0,4194304] 0 2024-08-01T06:55:54.161 INFO:tasks.workunit.client.1.smithi089.stdout:7/252: symlink d7/df/d10/d42/l5c 0 2024-08-01T06:55:54.162 INFO:tasks.workunit.client.1.smithi089.stdout:9/271: dread f8 [0,4194304] 0 2024-08-01T06:55:54.164 INFO:tasks.workunit.client.1.smithi089.stdout:6/350: mknod d2/d11/d1f/c7f 0 2024-08-01T06:55:54.165 INFO:tasks.workunit.client.1.smithi089.stdout:2/228: write d7/d1f/d29/f43 [5012335,66436] 0 2024-08-01T06:55:54.171 INFO:tasks.workunit.client.1.smithi089.stdout:8/266: write d5/dc/f16 [2759276,18971] 0 2024-08-01T06:55:54.171 INFO:tasks.workunit.client.1.smithi089.stdout:0/326: rename d9/ce to d9/d40/d26/d2e/c65 0 2024-08-01T06:55:54.173 INFO:tasks.workunit.client.1.smithi089.stdout:2/229: dwrite d7/d19/f40 [0,4194304] 0 2024-08-01T06:55:54.180 INFO:tasks.workunit.client.1.smithi089.stdout:2/230: dwrite d7/d19/d1e/f30 [0,4194304] 0 2024-08-01T06:55:54.185 INFO:tasks.workunit.client.1.smithi089.stdout:8/267: link c3 d5/d23/c59 0 2024-08-01T06:55:54.186 INFO:tasks.workunit.client.1.smithi089.stdout:8/268: stat d5/ff 0 2024-08-01T06:55:54.187 INFO:tasks.workunit.client.1.smithi089.stdout:0/327: dwrite d9/d40/d26/d2e/d44/d53/f54 [0,4194304] 0 2024-08-01T06:55:54.189 INFO:tasks.workunit.client.1.smithi089.stdout:8/269: unlink d5/dc/d12/l42 0 2024-08-01T06:55:54.189 INFO:tasks.workunit.client.1.smithi089.stdout:8/270: read d5/f3a [430814,11270] 0 2024-08-01T06:55:54.193 INFO:tasks.workunit.client.1.smithi089.stdout:0/328: rename d9/d40/d45/d47/c52 to d9/c66 0 2024-08-01T06:55:54.195 INFO:tasks.workunit.client.1.smithi089.stdout:2/231: getdents d7/d19/d1e/d3d 0 2024-08-01T06:55:54.196 INFO:tasks.workunit.client.1.smithi089.stdout:0/329: chown d9/d40/d25/d46/c39 732 1 2024-08-01T06:55:54.198 INFO:tasks.workunit.client.1.smithi089.stdout:4/307: write d3/d17/d3a/f5d [1009195,108332] 0 2024-08-01T06:55:54.201 INFO:tasks.workunit.client.1.smithi089.stdout:4/308: stat d3/db/d42/c4c 0 2024-08-01T06:55:54.202 INFO:tasks.workunit.client.1.smithi089.stdout:8/271: dwrite d5/ff [0,4194304] 0 2024-08-01T06:55:54.204 INFO:tasks.workunit.client.1.smithi089.stdout:0/330: fdatasync d9/d40/d26/d2e/f36 0 2024-08-01T06:55:54.204 INFO:tasks.workunit.client.1.smithi089.stdout:2/232: read d7/f23 [275575,173] 0 2024-08-01T06:55:54.207 INFO:tasks.workunit.client.1.smithi089.stdout:4/309: creat d3/d1f/d62/f64 x:0 0 0 2024-08-01T06:55:54.209 INFO:tasks.workunit.client.1.smithi089.stdout:8/272: mkdir d5/d15/d5a 0 2024-08-01T06:55:54.214 INFO:tasks.workunit.client.1.smithi089.stdout:4/310: rename d3/d1f/d62/l43 to d3/db/d33/l65 0 2024-08-01T06:55:54.221 INFO:tasks.workunit.client.1.smithi089.stdout:4/311: rename d3/d1e/d21/f2f to d3/d17/d3a/f66 0 2024-08-01T06:55:54.222 INFO:tasks.workunit.client.1.smithi089.stdout:0/331: dwrite d9/d22/d2b/f43 [0,4194304] 0 2024-08-01T06:55:54.222 INFO:tasks.workunit.client.1.smithi089.stdout:7/253: dread d7/df/d10/f24 [0,4194304] 0 2024-08-01T06:55:54.229 INFO:tasks.workunit.client.1.smithi089.stdout:4/312: creat d3/d1f/d62/d31/f67 x:0 0 0 2024-08-01T06:55:54.230 INFO:tasks.workunit.client.1.smithi089.stdout:5/197: truncate d5/d13/f30 4456839 0 2024-08-01T06:55:54.236 INFO:tasks.workunit.client.1.smithi089.stdout:5/198: mkdir d5/d13/d43 0 2024-08-01T06:55:54.238 INFO:tasks.workunit.client.1.smithi089.stdout:4/313: mkdir d3/d68 0 2024-08-01T06:55:54.241 INFO:tasks.workunit.client.1.smithi089.stdout:2/233: dread d7/f23 [0,4194304] 0 2024-08-01T06:55:54.241 INFO:tasks.workunit.client.1.smithi089.stdout:5/199: creat d5/de/d10/d16/f44 x:0 0 0 2024-08-01T06:55:54.243 INFO:tasks.workunit.client.1.smithi089.stdout:8/273: dread d5/dc/f11 [0,4194304] 0 2024-08-01T06:55:54.243 INFO:tasks.workunit.client.1.smithi089.stdout:8/274: chown d5/dc/d1e 56 1 2024-08-01T06:55:54.244 INFO:tasks.workunit.client.1.smithi089.stdout:4/314: dread d3/db/d16/f4f [0,4194304] 0 2024-08-01T06:55:54.245 INFO:tasks.workunit.client.1.smithi089.stdout:8/275: truncate d5/dc/d12/f40 692800 0 2024-08-01T06:55:54.246 INFO:tasks.workunit.client.1.smithi089.stdout:8/276: write d5/dc/d1e/f2b [1427846,80004] 0 2024-08-01T06:55:54.247 INFO:tasks.workunit.client.1.smithi089.stdout:5/200: dread d5/de/d10/f19 [0,4194304] 0 2024-08-01T06:55:54.248 INFO:tasks.workunit.client.1.smithi089.stdout:4/315: rename d3/d17/l52 to d3/d17/d3a/l69 0 2024-08-01T06:55:54.249 INFO:tasks.workunit.client.1.smithi089.stdout:4/316: truncate d3/d1e/f58 1525521 0 2024-08-01T06:55:54.251 INFO:tasks.workunit.client.1.smithi089.stdout:8/277: mknod d5/dc/d12/c5b 0 2024-08-01T06:55:54.253 INFO:tasks.workunit.client.1.smithi089.stdout:4/317: mknod d3/d1e/d21/d26/c6a 0 2024-08-01T06:55:54.255 INFO:tasks.workunit.client.1.smithi089.stdout:4/318: write d3/d17/d3a/f5d [2009799,97981] 0 2024-08-01T06:55:54.256 INFO:tasks.workunit.client.1.smithi089.stdout:8/278: dwrite d5/dc/d1e/f2b [0,4194304] 0 2024-08-01T06:55:54.257 INFO:tasks.workunit.client.1.smithi089.stdout:5/201: symlink d5/d13/d38/d42/l45 0 2024-08-01T06:55:54.266 INFO:tasks.workunit.client.1.smithi089.stdout:8/279: creat d5/dc/d1e/d53/f5c x:0 0 0 2024-08-01T06:55:54.269 INFO:tasks.workunit.client.1.smithi089.stdout:8/280: symlink d5/d15/l5d 0 2024-08-01T06:55:54.274 INFO:tasks.workunit.client.1.smithi089.stdout:8/281: dwrite d5/dc/d12/f4c [0,4194304] 0 2024-08-01T06:55:54.288 INFO:tasks.workunit.client.1.smithi089.stdout:3/187: sync 2024-08-01T06:55:54.288 INFO:tasks.workunit.client.1.smithi089.stdout:1/341: sync 2024-08-01T06:55:54.289 INFO:tasks.workunit.client.1.smithi089.stdout:8/282: getdents d5 0 2024-08-01T06:55:54.290 INFO:tasks.workunit.client.1.smithi089.stdout:8/283: dread - d5/f3d zero size 2024-08-01T06:55:54.292 INFO:tasks.workunit.client.1.smithi089.stdout:1/342: dread d0/d9/d15/f34 [0,4194304] 0 2024-08-01T06:55:54.294 INFO:tasks.workunit.client.1.smithi089.stdout:3/188: creat d7/d32/d12/f33 x:0 0 0 2024-08-01T06:55:54.294 INFO:tasks.workunit.client.1.smithi089.stdout:1/343: dread - d0/d9/d15/d2d/f53 zero size 2024-08-01T06:55:54.295 INFO:tasks.workunit.client.1.smithi089.stdout:3/189: stat d7/d32/l21 0 2024-08-01T06:55:54.295 INFO:tasks.workunit.client.1.smithi089.stdout:0/332: dwrite d9/f1f [0,4194304] 0 2024-08-01T06:55:54.296 INFO:tasks.workunit.client.1.smithi089.stdout:1/344: readlink d0/d9/d15/d2d/d4a/l48 0 2024-08-01T06:55:54.296 INFO:tasks.workunit.client.1.smithi089.stdout:3/190: chown d7/d32/d12/d29 0 1 2024-08-01T06:55:54.297 INFO:tasks.workunit.client.1.smithi089.stdout:8/284: mkdir d5/d15/d5e 0 2024-08-01T06:55:54.298 INFO:tasks.workunit.client.1.smithi089.stdout:3/191: fsync d7/d32/d12/d1b/f26 0 2024-08-01T06:55:54.300 INFO:tasks.workunit.client.1.smithi089.stdout:3/192: read - d7/f1f zero size 2024-08-01T06:55:54.303 INFO:tasks.workunit.client.1.smithi089.stdout:1/345: chown d0/d9/d15/d2d/l45 521 1 2024-08-01T06:55:54.306 INFO:tasks.workunit.client.1.smithi089.stdout:3/193: symlink d7/d32/d12/l34 0 2024-08-01T06:55:54.306 INFO:tasks.workunit.client.1.smithi089.stdout:7/254: dwrite d7/df/d10/d36/f37 [0,4194304] 0 2024-08-01T06:55:54.317 INFO:tasks.workunit.client.1.smithi089.stdout:7/255: creat d7/df/d10/d31/f5d x:0 0 0 2024-08-01T06:55:54.318 INFO:tasks.workunit.client.1.smithi089.stdout:7/256: stat d7/df/d10/f51 0 2024-08-01T06:55:54.322 INFO:tasks.workunit.client.1.smithi089.stdout:8/285: link d5/dc/d12/f56 d5/f5f 0 2024-08-01T06:55:54.326 INFO:tasks.workunit.client.1.smithi089.stdout:5/202: rmdir d5/d13 39 2024-08-01T06:55:54.329 INFO:tasks.workunit.client.1.smithi089.stdout:1/346: creat d0/d9/d15/d2d/d4a/f75 x:0 0 0 2024-08-01T06:55:54.335 INFO:tasks.workunit.client.1.smithi089.stdout:4/319: dwrite d3/db/f13 [0,4194304] 0 2024-08-01T06:55:54.335 INFO:tasks.workunit.client.1.smithi089.stdout:1/347: mkdir d0/d9/d15/d76 0 2024-08-01T06:55:54.337 INFO:tasks.workunit.client.1.smithi089.stdout:5/203: dwrite d5/de/d10/f19 [0,4194304] 0 2024-08-01T06:55:54.339 INFO:tasks.workunit.client.1.smithi089.stdout:1/348: write d0/d6c/f37 [1748288,33581] 0 2024-08-01T06:55:54.343 INFO:tasks.workunit.client.1.smithi089.stdout:5/204: read d5/de/d10/f3d [4175621,100347] 0 2024-08-01T06:55:54.349 INFO:tasks.workunit.client.1.smithi089.stdout:1/349: truncate d0/d9/d15/d2d/d4a/f75 703041 0 2024-08-01T06:55:54.349 INFO:tasks.workunit.client.1.smithi089.stdout:4/320: dwrite d3/d1f/d62/d3b/f48 [0,4194304] 0 2024-08-01T06:55:54.349 INFO:tasks.workunit.client.1.smithi089.stdout:4/321: chown d3/db/de/l30 824 1 2024-08-01T06:55:54.358 INFO:tasks.workunit.client.1.smithi089.stdout:5/205: write d5/de/d10/d16/d1b/f2e [1314761,21297] 0 2024-08-01T06:55:54.359 INFO:tasks.workunit.client.1.smithi089.stdout:5/206: truncate d5/de/d10/f19 5233219 0 2024-08-01T06:55:54.360 INFO:tasks.workunit.client.1.smithi089.stdout:1/350: mkdir d0/d9/d15/d3b/d3d/d77 0 2024-08-01T06:55:54.362 INFO:tasks.workunit.client.1.smithi089.stdout:4/322: readlink d3/db/d33/l65 0 2024-08-01T06:55:54.365 INFO:tasks.workunit.client.1.smithi089.stdout:1/351: mkdir d0/d9/d43/d78 0 2024-08-01T06:55:54.369 INFO:tasks.workunit.client.1.smithi089.stdout:1/352: unlink d0/d9/d15/d2d/d4a/f4c 0 2024-08-01T06:55:54.372 INFO:tasks.workunit.client.1.smithi089.stdout:4/323: dwrite d3/d1e/d21/f45 [0,4194304] 0 2024-08-01T06:55:54.375 INFO:tasks.workunit.client.1.smithi089.stdout:3/194: rmdir d7 39 2024-08-01T06:55:54.375 INFO:tasks.workunit.client.1.smithi089.stdout:1/353: dwrite d0/f20 [0,4194304] 0 2024-08-01T06:55:54.377 INFO:tasks.workunit.client.1.smithi089.stdout:5/207: dread f0 [0,4194304] 0 2024-08-01T06:55:54.377 INFO:tasks.workunit.client.1.smithi089.stdout:4/324: read d3/db/d16/f18 [8447295,42364] 0 2024-08-01T06:55:54.379 INFO:tasks.workunit.client.1.smithi089.stdout:4/325: write d3/d1e/f58 [1375015,87253] 0 2024-08-01T06:55:54.381 INFO:tasks.workunit.client.1.smithi089.stdout:4/326: write d3/d1f/d62/d31/f67 [882039,20709] 0 2024-08-01T06:55:54.383 INFO:tasks.workunit.client.1.smithi089.stdout:7/257: fsync d7/df/d10/d31/f5d 0 2024-08-01T06:55:54.385 INFO:tasks.workunit.client.1.smithi089.stdout:0/333: truncate d9/d40/d25/d46/f3d 3063805 0 2024-08-01T06:55:54.388 INFO:tasks.workunit.client.1.smithi089.stdout:9/272: sync 2024-08-01T06:55:54.390 INFO:tasks.workunit.client.1.smithi089.stdout:4/327: mknod d3/d17/d3a/d4a/c6b 0 2024-08-01T06:55:54.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.389+0000 7fefc58ec640 1 -- 172.21.15.16:0/3977124079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefc00fea80 msgr2=0x7fefc00fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:54.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.389+0000 7fefc58ec640 1 --2- 172.21.15.16:0/3977124079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefc00fea80 0x7fefc00fee80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009880 tx=0x7fefb002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:55:54.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.389+0000 7fefc58ec640 1 -- 172.21.15.16:0/3977124079 shutdown_connections 2024-08-01T06:55:54.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.389+0000 7fefc58ec640 1 --2- 172.21.15.16:0/3977124079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefc00ffc80 0x7fefc0100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:54.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.389+0000 7fefc58ec640 1 --2- 172.21.15.16:0/3977124079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefc00fea80 0x7fefc00fee80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:54.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.389+0000 7fefc58ec640 1 -- 172.21.15.16:0/3977124079 >> 172.21.15.16:0/3977124079 conn(0x7fefc00fa230 msgr2=0x7fefc00fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:54.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.389+0000 7fefc58ec640 1 -- 172.21.15.16:0/3977124079 shutdown_connections 2024-08-01T06:55:54.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.389+0000 7fefc58ec640 1 -- 172.21.15.16:0/3977124079 wait complete. 2024-08-01T06:55:54.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.390+0000 7fefc58ec640 1 Processor -- start 2024-08-01T06:55:54.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.390+0000 7fefc58ec640 1 -- start start 2024-08-01T06:55:54.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.390+0000 7fefc58ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefc00fea80 0x7fefc019bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:54.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.390+0000 7fefc58ec640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefc00ffc80 0x7fefc019c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:54.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.390+0000 7fefc58ec640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc019c780 con 0x7fefc00ffc80 2024-08-01T06:55:54.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.390+0000 7fefc58ec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc019c8f0 con 0x7fefc00fea80 2024-08-01T06:55:54.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.391+0000 7fefbeffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefc00fea80 0x7fefc019bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:54.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.391+0000 7fefbe7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefc00ffc80 0x7fefc019c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:54.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.391+0000 7fefbeffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefc00fea80 0x7fefc019bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:44824/0 (socket says 172.21.15.16:44824) 2024-08-01T06:55:54.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.391+0000 7fefbeffd640 1 -- 172.21.15.16:0/1470762587 learned_addr learned my addr 172.21.15.16:0/1470762587 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:55:54.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.391+0000 7fefbe7fc640 1 -- 172.21.15.16:0/1470762587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefc00fea80 msgr2=0x7fefc019bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:54.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.391+0000 7fefbe7fc640 1 --2- 172.21.15.16:0/1470762587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefc00fea80 0x7fefc019bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:54.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.391+0000 7fefbe7fc640 1 -- 172.21.15.16:0/1470762587 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb0009560 con 0x7fefc00ffc80 2024-08-01T06:55:54.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.391+0000 7fefbe7fc640 1 --2- 172.21.15.16:0/1470762587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefc00ffc80 0x7fefc019c1b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fefb400e970 tx=0x7fefb400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:54.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.391+0000 7fefc48ea640 1 -- 172.21.15.16:0/1470762587 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefb4009640 con 0x7fefc00ffc80 2024-08-01T06:55:54.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.391+0000 7fefc48ea640 1 -- 172.21.15.16:0/1470762587 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fefb400cc90 con 0x7fefc00ffc80 2024-08-01T06:55:54.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.391+0000 7fefc58ec640 1 -- 172.21.15.16:0/1470762587 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc01a1380 con 0x7fefc00ffc80 2024-08-01T06:55:54.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.392+0000 7fefc48ea640 1 -- 172.21.15.16:0/1470762587 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefb4018810 con 0x7fefc00ffc80 2024-08-01T06:55:54.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.392+0000 7fefc58ec640 1 -- 172.21.15.16:0/1470762587 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc01a1950 con 0x7fefc00ffc80 2024-08-01T06:55:54.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.393+0000 7fefc58ec640 1 -- 172.21.15.16:0/1470762587 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc0107670 con 0x7fefc00ffc80 2024-08-01T06:55:54.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.394+0000 7fefc48ea640 1 -- 172.21.15.16:0/1470762587 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) v1 ==== 91559+0+0 (secure 0 0 0) 0x7fefb4018970 con 0x7fefc00ffc80 2024-08-01T06:55:54.396 INFO:tasks.workunit.client.1.smithi089.stdout:4/328: write d3/db/d16/f1a [3120883,28430] 0 2024-08-01T06:55:54.396 INFO:tasks.workunit.client.1.smithi089.stdout:0/334: dwrite d9/d40/d26/d2e/f30 [0,4194304] 0 2024-08-01T06:55:54.396 INFO:tasks.workunit.client.1.smithi089.stdout:1/354: unlink d0/d9/d15/c17 0 2024-08-01T06:55:54.397 INFO:tasks.workunit.client.1.smithi089.stdout:4/329: rename d3/d1f to d3/d1f/d62/d31/d6c 22 2024-08-01T06:55:54.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.395+0000 7fefc48ea640 1 --2- 172.21.15.16:0/1470762587 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fefa806d6a0 0x7fefa806fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:54.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.395+0000 7fefc48ea640 1 -- 172.21.15.16:0/1470762587 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fefb4014070 con 0x7fefc00ffc80 2024-08-01T06:55:54.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.395+0000 7fefbeffd640 1 --2- 172.21.15.16:0/1470762587 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fefa806d6a0 0x7fefa806fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:54.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.396+0000 7fefbeffd640 1 --2- 172.21.15.16:0/1470762587 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fefa806d6a0 0x7fefa806fb60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fefb0000c00 tx=0x7fefb00314e0 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:54.400 INFO:tasks.workunit.client.1.smithi089.stdout:4/330: fdatasync d3/d1f/d62/f37 0 2024-08-01T06:55:54.400 INFO:tasks.workunit.client.1.smithi089.stdout:9/273: dwrite d18/d3d/d4b/f4e [0,4194304] 0 2024-08-01T06:55:54.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.403+0000 7fefc48ea640 1 -- 172.21.15.16:0/1470762587 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fefb4053d10 con 0x7fefc00ffc80 2024-08-01T06:55:54.405 INFO:tasks.workunit.client.1.smithi089.stdout:3/195: truncate d7/dd/f15 1715084 0 2024-08-01T06:55:54.410 INFO:tasks.workunit.client.1.smithi089.stdout:7/258: dread d7/d1f/d3a/f41 [0,4194304] 0 2024-08-01T06:55:54.411 INFO:tasks.workunit.client.1.smithi089.stdout:7/259: chown d7/df/d10/f34 465 1 2024-08-01T06:55:54.413 INFO:tasks.workunit.client.1.smithi089.stdout:5/208: mknod d5/d13/d43/c46 0 2024-08-01T06:55:54.413 INFO:tasks.workunit.client.1.smithi089.stdout:5/209: chown d5 1562510532 1 2024-08-01T06:55:54.414 INFO:tasks.workunit.client.1.smithi089.stdout:5/210: dread - d5/de/f34 zero size 2024-08-01T06:55:54.417 INFO:tasks.workunit.client.1.smithi089.stdout:1/355: symlink d0/d9/d15/d2d/d4a/d61/l79 0 2024-08-01T06:55:54.421 INFO:tasks.workunit.client.1.smithi089.stdout:9/274: rename f12 to d18/d22/d45/f59 0 2024-08-01T06:55:54.423 INFO:tasks.workunit.client.1.smithi089.stdout:8/286: creat d5/dc/d1e/d53/f60 x:0 0 0 2024-08-01T06:55:54.425 INFO:tasks.workunit.client.1.smithi089.stdout:6/351: sync 2024-08-01T06:55:54.425 INFO:tasks.workunit.client.1.smithi089.stdout:2/234: sync 2024-08-01T06:55:54.425 INFO:tasks.workunit.client.1.smithi089.stdout:4/331: dwrite d3/d1e/d21/f60 [0,4194304] 0 2024-08-01T06:55:54.426 INFO:tasks.workunit.client.1.smithi089.stdout:2/235: stat d7/d19/d1e/c36 0 2024-08-01T06:55:54.426 INFO:tasks.workunit.client.1.smithi089.stdout:6/352: dread - d2/d11/d1f/d46/f4b zero size 2024-08-01T06:55:54.427 INFO:tasks.workunit.client.1.smithi089.stdout:0/335: mknod d9/d40/c67 0 2024-08-01T06:55:54.430 INFO:tasks.workunit.client.1.smithi089.stdout:6/353: write d2/d11/d1a/f6a [920960,104597] 0 2024-08-01T06:55:54.434 INFO:tasks.workunit.client.1.smithi089.stdout:9/275: write f16 [4618967,53077] 0 2024-08-01T06:55:54.435 INFO:tasks.workunit.client.1.smithi089.stdout:4/332: dwrite d3/d1f/d62/d3b/f48 [0,4194304] 0 2024-08-01T06:55:54.436 INFO:tasks.workunit.client.1.smithi089.stdout:5/211: rename d5/d13/d38/d42/l45 to d5/d13/d43/l47 0 2024-08-01T06:55:54.453 INFO:tasks.workunit.client.1.smithi089.stdout:1/356: mkdir d0/d9/d15/d7a 0 2024-08-01T06:55:54.460 INFO:tasks.workunit.client.1.smithi089.stdout:9/276: write d18/d22/d45/f51 [175794,28626] 0 2024-08-01T06:55:54.461 INFO:tasks.workunit.client.1.smithi089.stdout:6/354: dwrite d2/d30/d3c/d3d/f7b [0,4194304] 0 2024-08-01T06:55:54.463 INFO:tasks.workunit.client.1.smithi089.stdout:8/287: unlink d5/ff 0 2024-08-01T06:55:54.464 INFO:tasks.workunit.client.1.smithi089.stdout:2/236: creat d7/d19/d1e/d3f/f46 x:0 0 0 2024-08-01T06:55:54.466 INFO:tasks.workunit.client.1.smithi089.stdout:5/212: dread d5/d13/f31 [0,4194304] 0 2024-08-01T06:55:54.468 INFO:tasks.workunit.client.1.smithi089.stdout:0/336: link d9/d22/f34 d9/d22/d2b/d55/f68 0 2024-08-01T06:55:54.469 INFO:tasks.workunit.client.1.smithi089.stdout:1/357: symlink d0/d9/d43/l7b 0 2024-08-01T06:55:54.470 INFO:tasks.workunit.client.1.smithi089.stdout:5/213: dread f0 [0,4194304] 0 2024-08-01T06:55:54.472 INFO:tasks.workunit.client.1.smithi089.stdout:2/237: dread d7/d1f/f20 [0,4194304] 0 2024-08-01T06:55:54.476 INFO:tasks.workunit.client.1.smithi089.stdout:9/277: fsync f15 0 2024-08-01T06:55:54.485 INFO:tasks.workunit.client.1.smithi089.stdout:0/337: creat d9/d40/d26/f69 x:0 0 0 2024-08-01T06:55:54.489 INFO:tasks.workunit.client.1.smithi089.stdout:1/358: symlink d0/d9/d15/d2b/l7c 0 2024-08-01T06:55:54.490 INFO:tasks.workunit.client.1.smithi089.stdout:3/196: truncate d7/dd/f20 1407416 0 2024-08-01T06:55:54.498 INFO:tasks.workunit.client.1.smithi089.stdout:7/260: truncate d7/d15/f1b 2273561 0 2024-08-01T06:55:54.500 INFO:tasks.workunit.client.1.smithi089.stdout:9/278: stat d18/l2c 0 2024-08-01T06:55:54.500 INFO:tasks.workunit.client.1.smithi089.stdout:9/279: chown d18/f20 3 1 2024-08-01T06:55:54.502 INFO:tasks.workunit.client.1.smithi089.stdout:6/355: rename d2/cb to d2/d2e/d2f/d31/c80 0 2024-08-01T06:55:54.502 INFO:tasks.workunit.client.1.smithi089.stdout:1/359: dread d0/d9/d15/d2d/d4a/f55 [0,4194304] 0 2024-08-01T06:55:54.502 INFO:tasks.workunit.client.1.smithi089.stdout:9/280: truncate d18/d22/d39/f3a 772958 0 2024-08-01T06:55:54.503 INFO:tasks.workunit.client.1.smithi089.stdout:8/288: symlink d5/dc/d1e/d53/l61 0 2024-08-01T06:55:54.512 INFO:tasks.workunit.client.1.smithi089.stdout:2/238: unlink d7/c14 0 2024-08-01T06:55:54.513 INFO:tasks.workunit.client.1.smithi089.stdout:2/239: dread - d7/d19/d1e/d3f/f46 zero size 2024-08-01T06:55:54.517 INFO:tasks.workunit.client.1.smithi089.stdout:7/261: write d7/df/d10/d36/f38 [2456763,124244] 0 2024-08-01T06:55:54.517 INFO:tasks.workunit.client.1.smithi089.stdout:6/356: symlink d2/d11/d1a/d1c/d40/l81 0 2024-08-01T06:55:54.518 INFO:tasks.workunit.client.1.smithi089.stdout:7/262: fsync d7/df/d10/d42/f48 0 2024-08-01T06:55:54.518 INFO:tasks.workunit.client.1.smithi089.stdout:7/263: fsync d7/f19 0 2024-08-01T06:55:54.522 INFO:tasks.workunit.client.1.smithi089.stdout:0/338: creat d9/d40/d26/d64/f6a x:0 0 0 2024-08-01T06:55:54.523 INFO:tasks.workunit.client.1.smithi089.stdout:3/197: mknod d7/d32/d12/d29/c35 0 2024-08-01T06:55:54.523 INFO:tasks.workunit.client.1.smithi089.stdout:7/264: read d7/df/d10/d36/f38 [3311528,116165] 0 2024-08-01T06:55:54.524 INFO:tasks.workunit.client.1.smithi089.stdout:0/339: chown d9/f13 5648617 1 2024-08-01T06:55:54.526 INFO:tasks.workunit.client.1.smithi089.stdout:0/340: write d9/f18 [761477,88806] 0 2024-08-01T06:55:54.527 INFO:tasks.workunit.client.1.smithi089.stdout:0/341: chown d9/d22/d2b/f43 82781 1 2024-08-01T06:55:54.528 INFO:tasks.workunit.client.1.smithi089.stdout:0/342: write d9/f1f [3971115,17] 0 2024-08-01T06:55:54.528 INFO:tasks.workunit.client.1.smithi089.stdout:9/281: mknod d18/d33/d53/c5a 0 2024-08-01T06:55:54.531 INFO:tasks.workunit.client.1.smithi089.stdout:2/240: dread f2 [0,4194304] 0 2024-08-01T06:55:54.539 INFO:tasks.workunit.client.1.smithi089.stdout:3/198: mkdir d7/d36 0 2024-08-01T06:55:54.540 INFO:tasks.workunit.client.1.smithi089.stdout:5/214: write d5/d13/f30 [882589,108360] 0 2024-08-01T06:55:54.547 INFO:tasks.workunit.client.1.smithi089.stdout:0/343: mkdir d9/d40/d26/d64/d6b 0 2024-08-01T06:55:54.547 INFO:tasks.workunit.client.1.smithi089.stdout:1/360: write d0/d9/d15/f52 [615872,127195] 0 2024-08-01T06:55:54.548 INFO:tasks.workunit.client.1.smithi089.stdout:6/357: mknod d2/d30/d3c/c82 0 2024-08-01T06:55:54.549 INFO:tasks.workunit.client.1.smithi089.stdout:6/358: readlink d2/d11/l16 0 2024-08-01T06:55:54.550 INFO:tasks.workunit.client.1.smithi089.stdout:2/241: symlink d7/d19/d1e/l47 0 2024-08-01T06:55:54.553 INFO:tasks.workunit.client.1.smithi089.stdout:2/242: dread d7/d19/f40 [0,4194304] 0 2024-08-01T06:55:54.561 INFO:tasks.workunit.client.1.smithi089.stdout:1/361: mkdir d0/d9/d15/d2b/d7d 0 2024-08-01T06:55:54.562 INFO:tasks.workunit.client.1.smithi089.stdout:9/282: dwrite f13 [0,4194304] 0 2024-08-01T06:55:54.562 INFO:tasks.workunit.client.1.smithi089.stdout:7/265: stat d7/d15/f1b 0 2024-08-01T06:55:54.565 INFO:tasks.workunit.client.1.smithi089.stdout:3/199: symlink d7/d32/l37 0 2024-08-01T06:55:54.567 INFO:tasks.workunit.client.1.smithi089.stdout:2/243: rename d7/d19/d1e/d3f to d7/d1f/d29/d48 0 2024-08-01T06:55:54.570 INFO:tasks.workunit.client.1.smithi089.stdout:0/344: creat d9/d22/d2b/d55/d62/f6c x:0 0 0 2024-08-01T06:55:54.575 INFO:tasks.workunit.client.1.smithi089.stdout:1/362: creat d0/d9/d15/d2d/d4a/d61/f7e x:0 0 0 2024-08-01T06:55:54.579 INFO:tasks.workunit.client.1.smithi089.stdout:9/283: symlink d18/d3d/d55/l5b 0 2024-08-01T06:55:54.584 INFO:tasks.workunit.client.1.smithi089.stdout:2/244: creat d7/d1f/d29/f49 x:0 0 0 2024-08-01T06:55:54.584 INFO:tasks.workunit.client.1.smithi089.stdout:5/215: write d5/de/d10/f3d [3899827,61100] 0 2024-08-01T06:55:54.585 INFO:tasks.workunit.client.1.smithi089.stdout:2/245: truncate d7/d19/f37 4513740 0 2024-08-01T06:55:54.585 INFO:tasks.workunit.client.1.smithi089.stdout:5/216: dread - d5/de/d10/d16/d1b/f22 zero size 2024-08-01T06:55:54.591 INFO:tasks.workunit.client.1.smithi089.stdout:0/345: symlink d9/d40/l6d 0 2024-08-01T06:55:54.594 INFO:tasks.workunit.client.1.smithi089.stdout:5/217: symlink d5/d13/l48 0 2024-08-01T06:55:54.594 INFO:tasks.workunit.client.1.smithi089.stdout:1/363: dread d0/f13 [0,4194304] 0 2024-08-01T06:55:54.594 INFO:tasks.workunit.client.1.smithi089.stdout:6/359: truncate d2/d11/f17 636769 0 2024-08-01T06:55:54.595 INFO:tasks.workunit.client.1.smithi089.stdout:6/360: chown d2/f75 105 1 2024-08-01T06:55:54.595 INFO:tasks.workunit.client.1.smithi089.stdout:9/284: symlink d18/d22/d39/d50/l5c 0 2024-08-01T06:55:54.596 INFO:tasks.workunit.client.1.smithi089.stdout:3/200: rmdir d7/d36 0 2024-08-01T06:55:54.596 INFO:tasks.workunit.client.1.smithi089.stdout:6/361: write d2/d30/d3c/d3d/f7b [3814760,62268] 0 2024-08-01T06:55:54.597 INFO:tasks.workunit.client.1.smithi089.stdout:2/246: mkdir d7/d4a 0 2024-08-01T06:55:54.598 INFO:tasks.workunit.client.1.smithi089.stdout:2/247: chown d7/d19/d3b/c41 15720 1 2024-08-01T06:55:54.599 INFO:tasks.workunit.client.1.smithi089.stdout:0/346: rename d9/d40/d25/d46/c50 to d9/d22/d2b/d55/d62/c6e 0 2024-08-01T06:55:54.599 INFO:tasks.workunit.client.1.smithi089.stdout:5/218: dread d5/de/d10/f3d [0,4194304] 0 2024-08-01T06:55:54.600 INFO:tasks.workunit.client.1.smithi089.stdout:2/248: chown d7/d19/d1e/f30 119 1 2024-08-01T06:55:54.601 INFO:tasks.workunit.client.1.smithi089.stdout:9/285: creat d18/d3d/f5d x:0 0 0 2024-08-01T06:55:54.602 INFO:tasks.workunit.client.1.smithi089.stdout:9/286: chown d18/d33/l36 464107 1 2024-08-01T06:55:54.602 INFO:tasks.workunit.client.1.smithi089.stdout:9/287: stat d18/d3d/d4b 0 2024-08-01T06:55:54.603 INFO:tasks.workunit.client.1.smithi089.stdout:6/362: creat d2/d11/d1a/d1c/d40/f83 x:0 0 0 2024-08-01T06:55:54.605 INFO:tasks.workunit.client.1.smithi089.stdout:5/219: write d5/de/d10/f3b [3778995,99706] 0 2024-08-01T06:55:54.608 INFO:tasks.workunit.client.1.smithi089.stdout:0/347: rename d9/d22/d2b/d55/d62/f6c to d9/d40/d25/d46/f6f 0 2024-08-01T06:55:54.609 INFO:tasks.workunit.client.1.smithi089.stdout:0/348: stat d9/d22/d2b/l63 0 2024-08-01T06:55:54.610 INFO:tasks.workunit.client.1.smithi089.stdout:9/288: dread fa [0,4194304] 0 2024-08-01T06:55:54.614 INFO:tasks.workunit.client.1.smithi089.stdout:5/220: mknod d5/de/d10/c49 0 2024-08-01T06:55:54.618 INFO:tasks.workunit.client.1.smithi089.stdout:0/349: dwrite d9/fa [4194304,4194304] 0 2024-08-01T06:55:54.620 INFO:tasks.workunit.client.1.smithi089.stdout:0/350: dread - d9/d22/f34 zero size 2024-08-01T06:55:54.623 INFO:tasks.workunit.client.1.smithi089.stdout:2/249: creat d7/d1f/f4b x:0 0 0 2024-08-01T06:55:54.624 INFO:tasks.workunit.client.1.smithi089.stdout:6/363: dread d2/d11/f63 [0,4194304] 0 2024-08-01T06:55:54.624 INFO:tasks.workunit.client.1.smithi089.stdout:0/351: write d9/f33 [861342,64914] 0 2024-08-01T06:55:54.624 INFO:tasks.workunit.client.1.smithi089.stdout:9/289: dwrite d18/d3d/f41 [0,4194304] 0 2024-08-01T06:55:54.625 INFO:tasks.workunit.client.1.smithi089.stdout:5/221: truncate d5/d13/f31 1908134 0 2024-08-01T06:55:54.634 INFO:tasks.workunit.client.1.smithi089.stdout:5/222: dread d5/de/d10/f2c [0,4194304] 0 2024-08-01T06:55:54.639 INFO:tasks.workunit.client.1.smithi089.stdout:9/290: rename d18/f1b to d18/d33/d53/f5e 0 2024-08-01T06:55:54.649 INFO:tasks.workunit.client.1.smithi089.stdout:3/201: dwrite d7/dd/f20 [0,4194304] 0 2024-08-01T06:55:54.651 INFO:tasks.workunit.client.1.smithi089.stdout:9/291: unlink l3 0 2024-08-01T06:55:54.653 INFO:tasks.workunit.client.1.smithi089.stdout:9/292: write d18/d22/d39/f3a [382981,13321] 0 2024-08-01T06:55:54.653 INFO:tasks.workunit.client.1.smithi089.stdout:9/293: write d18/d3d/f5d [287359,1930] 0 2024-08-01T06:55:54.654 INFO:tasks.workunit.client.1.smithi089.stdout:6/364: link d2/d11/d1a/c4f d2/d11/d1f/d46/d6b/c84 0 2024-08-01T06:55:54.656 INFO:tasks.workunit.client.1.smithi089.stdout:6/365: chown d2/d30/d3c/d3d/f71 3714 1 2024-08-01T06:55:54.656 INFO:tasks.workunit.client.1.smithi089.stdout:3/202: read d7/dd/f15 [292714,28078] 0 2024-08-01T06:55:54.657 INFO:tasks.workunit.client.1.smithi089.stdout:5/223: link l2 d5/l4a 0 2024-08-01T06:55:54.660 INFO:tasks.workunit.client.1.smithi089.stdout:9/294: rmdir d18/d3d/d55 39 2024-08-01T06:55:54.661 INFO:tasks.workunit.client.1.smithi089.stdout:9/295: fdatasync f15 0 2024-08-01T06:55:54.666 INFO:tasks.workunit.client.1.smithi089.stdout:6/366: symlink d2/l85 0 2024-08-01T06:55:54.667 INFO:tasks.workunit.client.1.smithi089.stdout:6/367: write d2/d11/d1a/f33 [1039673,103257] 0 2024-08-01T06:55:54.672 INFO:tasks.workunit.client.1.smithi089.stdout:6/368: mkdir d2/d11/d1f/d46/d86 0 2024-08-01T06:55:54.673 INFO:tasks.workunit.client.1.smithi089.stdout:2/250: dwrite d7/d1f/f20 [0,4194304] 0 2024-08-01T06:55:54.674 INFO:tasks.workunit.client.1.smithi089.stdout:3/203: link d7/d32/d23/l27 d7/d32/l38 0 2024-08-01T06:55:54.675 INFO:tasks.workunit.client.1.smithi089.stdout:3/204: readlink d7/d32/d12/l34 0 2024-08-01T06:55:54.675 INFO:tasks.workunit.client.1.smithi089.stdout:2/251: write d7/d1f/d29/d48/f46 [15430,88689] 0 2024-08-01T06:55:54.676 INFO:tasks.workunit.client.1.smithi089.stdout:2/252: fdatasync d7/d19/f44 0 2024-08-01T06:55:54.678 INFO:tasks.workunit.client.1.smithi089.stdout:6/369: symlink d2/d30/l87 0 2024-08-01T06:55:54.679 INFO:tasks.workunit.client.1.smithi089.stdout:6/370: truncate d2/d11/d3e/f60 376598 0 2024-08-01T06:55:54.680 INFO:tasks.workunit.client.1.smithi089.stdout:4/333: sync 2024-08-01T06:55:54.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.681+0000 7fefc58ec640 1 -- 172.21.15.16:0/1470762587 --> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fefc0068c10 con 0x7fefa806d6a0 2024-08-01T06:55:54.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.683+0000 7fefc48ea640 1 -- 172.21.15.16:0/1470762587 <== mgr.24423 v2:172.21.15.89:6828/2589785296 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fefc0068c10 con 0x7fefa806d6a0 2024-08-01T06:55:54.686 INFO:tasks.workunit.client.1.smithi089.stdout:2/253: link d7/l3c d7/d4a/l4c 0 2024-08-01T06:55:54.687 INFO:tasks.workunit.client.1.smithi089.stdout:5/224: write d5/d13/f31 [897081,125553] 0 2024-08-01T06:55:54.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.686+0000 7fefc58ec640 1 -- 172.21.15.16:0/1470762587 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fefa806d6a0 msgr2=0x7fefa806fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:54.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.686+0000 7fefc58ec640 1 --2- 172.21.15.16:0/1470762587 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fefa806d6a0 0x7fefa806fb60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fefb0000c00 tx=0x7fefb00314e0 comp rx=0 tx=0).stop 2024-08-01T06:55:54.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.686+0000 7fefc58ec640 1 -- 172.21.15.16:0/1470762587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefc00ffc80 msgr2=0x7fefc019c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:54.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.686+0000 7fefc58ec640 1 --2- 172.21.15.16:0/1470762587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefc00ffc80 0x7fefc019c1b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fefb400e970 tx=0x7fefb400ee30 comp rx=0 tx=0).stop 2024-08-01T06:55:54.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.686+0000 7fefc58ec640 1 -- 172.21.15.16:0/1470762587 shutdown_connections 2024-08-01T06:55:54.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.686+0000 7fefc58ec640 1 --2- 172.21.15.16:0/1470762587 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fefa806d6a0 0x7fefa806fb60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:54.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.686+0000 7fefc58ec640 1 --2- 172.21.15.16:0/1470762587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefc00ffc80 0x7fefc019c1b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:54.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.686+0000 7fefc58ec640 1 --2- 172.21.15.16:0/1470762587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefc00fea80 0x7fefc019bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:54.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.686+0000 7fefc58ec640 1 -- 172.21.15.16:0/1470762587 >> 172.21.15.16:0/1470762587 conn(0x7fefc00fa230 msgr2=0x7fefc0068500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:54.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.687+0000 7fefc58ec640 1 -- 172.21.15.16:0/1470762587 shutdown_connections 2024-08-01T06:55:54.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.687+0000 7fefc58ec640 1 -- 172.21.15.16:0/1470762587 wait complete. 2024-08-01T06:55:54.689 INFO:tasks.workunit.client.1.smithi089.stdout:6/371: dread d2/d11/d1f/f5a [0,4194304] 0 2024-08-01T06:55:54.691 INFO:tasks.workunit.client.1.smithi089.stdout:4/334: dwrite d3/db/f39 [0,4194304] 0 2024-08-01T06:55:54.691 INFO:tasks.workunit.client.1.smithi089.stdout:5/225: fdatasync d5/de/d10/d16/f44 0 2024-08-01T06:55:54.694 INFO:tasks.workunit.client.1.smithi089.stdout:5/226: chown d5/de/d10/d33 1570060741 1 2024-08-01T06:55:54.698 INFO:tasks.workunit.client.1.smithi089.stdout:4/335: getdents d3/d68 0 2024-08-01T06:55:54.701 INFO:tasks.workunit.client.1.smithi089.stdout:2/254: dwrite d7/d1f/d29/d48/f46 [0,4194304] 0 2024-08-01T06:55:54.704 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T06:55:54.708 INFO:tasks.workunit.client.1.smithi089.stdout:6/372: dwrite d2/d30/d3c/d3d/f71 [4194304,4194304] 0 2024-08-01T06:55:54.713 INFO:tasks.workunit.client.1.smithi089.stdout:5/227: dwrite d5/de/f34 [0,4194304] 0 2024-08-01T06:55:54.717 INFO:tasks.workunit.client.1.smithi089.stdout:4/336: dwrite d3/d1f/d62/f64 [0,4194304] 0 2024-08-01T06:55:54.718 INFO:tasks.workunit.client.1.smithi089.stdout:4/337: stat d3/d1f 0 2024-08-01T06:55:54.721 INFO:tasks.workunit.client.1.smithi089.stdout:6/373: rename d2/c7 to d2/d30/d3c/d3d/c88 0 2024-08-01T06:55:54.726 INFO:tasks.workunit.client.1.smithi089.stdout:5/228: creat d5/d13/d38/d42/f4b x:0 0 0 2024-08-01T06:55:54.726 INFO:tasks.workunit.client.1.smithi089.stdout:2/255: dwrite d7/d19/f37 [4194304,4194304] 0 2024-08-01T06:55:54.727 INFO:tasks.workunit.client.1.smithi089.stdout:5/229: fdatasync d5/de/d10/d16/d1b/f2e 0 2024-08-01T06:55:54.727 INFO:tasks.workunit.client.1.smithi089.stdout:6/374: mknod d2/d2e/c89 0 2024-08-01T06:55:54.730 INFO:tasks.workunit.client.1.smithi089.stdout:6/375: write d2/d11/d1f/f45 [434594,56252] 0 2024-08-01T06:55:54.732 INFO:tasks.workunit.client.1.smithi089.stdout:2/256: write d7/f23 [2409818,80870] 0 2024-08-01T06:55:54.733 INFO:tasks.workunit.client.1.smithi089.stdout:6/376: chown d2/l61 10347 1 2024-08-01T06:55:54.734 INFO:tasks.workunit.client.1.smithi089.stdout:6/377: write d2/d11/d1a/f33 [1936230,97704] 0 2024-08-01T06:55:54.738 INFO:tasks.workunit.client.1.smithi089.stdout:2/257: symlink d7/l4d 0 2024-08-01T06:55:54.740 INFO:tasks.workunit.client.1.smithi089.stdout:6/378: symlink d2/l8a 0 2024-08-01T06:55:54.742 INFO:tasks.workunit.client.1.smithi089.stdout:2/258: mkdir d7/d1f/d29/d48/d4e 0 2024-08-01T06:55:54.745 INFO:tasks.workunit.client.1.smithi089.stdout:6/379: rename d2/d11/d1a/d1c/d40/c67 to d2/d11/d1f/d46/d6b/c8b 0 2024-08-01T06:55:54.747 INFO:tasks.workunit.client.1.smithi089.stdout:2/259: mkdir d7/d19/d1e/d3d/d4f 0 2024-08-01T06:55:54.752 INFO:tasks.workunit.client.1.smithi089.stdout:5/230: dread d5/d13/f30 [0,4194304] 0 2024-08-01T06:55:54.754 INFO:tasks.workunit.client.1.smithi089.stdout:5/231: write d5/de/d10/d16/d1b/f22 [451085,96972] 0 2024-08-01T06:55:54.757 INFO:tasks.workunit.client.1.smithi089.stdout:4/338: dread d3/db/d16/f18 [4194304,4194304] 0 2024-08-01T06:55:54.760 INFO:tasks.workunit.client.1.smithi089.stdout:4/339: rmdir d3/db/de/d5b 39 2024-08-01T06:55:54.762 INFO:tasks.workunit.client.1.smithi089.stdout:4/340: fsync d3/d1e/d21/d26/f61 0 2024-08-01T06:55:54.764 INFO:tasks.workunit.client.1.smithi089.stdout:5/232: dwrite d5/de/d10/d16/d1b/f39 [4194304,4194304] 0 2024-08-01T06:55:54.764 INFO:tasks.workunit.client.1.smithi089.stdout:4/341: write d3/d1e/f58 [456931,66140] 0 2024-08-01T06:55:54.766 INFO:tasks.workunit.client.1.smithi089.stdout:4/342: write d3/d1e/d21/f60 [4581254,51240] 0 2024-08-01T06:55:54.766 INFO:tasks.workunit.client.1.smithi089.stdout:2/260: dread f5 [0,4194304] 0 2024-08-01T06:55:54.768 INFO:tasks.workunit.client.1.smithi089.stdout:4/343: chown d3/db/de/l30 51 1 2024-08-01T06:55:54.769 INFO:tasks.workunit.client.1.smithi089.stdout:5/233: mkdir d5/d13/d4c 0 2024-08-01T06:55:54.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.817+0000 7f2fd44ba640 1 -- 172.21.15.16:0/1673553258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fcc102fb0 msgr2=0x7f2fcc1053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:54.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.817+0000 7f2fd44ba640 1 --2- 172.21.15.16:0/1673553258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fcc102fb0 0x7f2fcc1053a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc0098b0 tx=0x7f2fbc02a4d0 comp rx=0 tx=0).stop 2024-08-01T06:55:54.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.818+0000 7f2fd44ba640 1 -- 172.21.15.16:0/1673553258 shutdown_connections 2024-08-01T06:55:54.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.818+0000 7f2fd44ba640 1 --2- 172.21.15.16:0/1673553258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fcc102fb0 0x7f2fcc1053a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:54.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.818+0000 7f2fd44ba640 1 --2- 172.21.15.16:0/1673553258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fcc100680 0x7f2fcc102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:54.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.818+0000 7f2fd44ba640 1 -- 172.21.15.16:0/1673553258 >> 172.21.15.16:0/1673553258 conn(0x7f2fcc0fa280 msgr2=0x7f2fcc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:54.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.818+0000 7f2fd44ba640 1 -- 172.21.15.16:0/1673553258 shutdown_connections 2024-08-01T06:55:54.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.818+0000 7f2fd44ba640 1 -- 172.21.15.16:0/1673553258 wait complete. 2024-08-01T06:55:54.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.818+0000 7f2fd44ba640 1 Processor -- start 2024-08-01T06:55:54.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.819+0000 7f2fd44ba640 1 -- start start 2024-08-01T06:55:54.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.819+0000 7f2fd44ba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fcc100680 0x7f2fcc1978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:54.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.819+0000 7f2fd44ba640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fcc102fb0 0x7f2fcc197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:54.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.819+0000 7f2fd2256640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fcc100680 0x7f2fcc1978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:54.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.819+0000 7f2fd2256640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fcc100680 0x7f2fcc1978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:44840/0 (socket says 172.21.15.16:44840) 2024-08-01T06:55:54.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.819+0000 7f2fd1a55640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fcc102fb0 0x7f2fcc197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:54.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.819+0000 7f2fd1a55640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fcc102fb0 0x7f2fcc197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53582/0 (socket says 172.21.15.16:53582) 2024-08-01T06:55:54.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.819+0000 7f2fd2256640 1 -- 172.21.15.16:0/3027906901 learned_addr learned my addr 172.21.15.16:0/3027906901 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:55:54.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.819+0000 7f2fd44ba640 1 -- 172.21.15.16:0/3027906901 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc198400 con 0x7f2fcc102fb0 2024-08-01T06:55:54.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.819+0000 7f2fd44ba640 1 -- 172.21.15.16:0/3027906901 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc198570 con 0x7f2fcc100680 2024-08-01T06:55:54.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.820+0000 7f2fd1a55640 1 -- 172.21.15.16:0/3027906901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fcc100680 msgr2=0x7f2fcc1978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:54.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.820+0000 7f2fd1a55640 1 --2- 172.21.15.16:0/3027906901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fcc100680 0x7f2fcc1978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:54.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.820+0000 7f2fd1a55640 1 -- 172.21.15.16:0/3027906901 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc009560 con 0x7f2fcc102fb0 2024-08-01T06:55:54.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.820+0000 7f2fd1a55640 1 --2- 172.21.15.16:0/3027906901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fcc102fb0 0x7f2fcc197e30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc068790 tx=0x7f2fbc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:54.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.820+0000 7f2fc37fe640 1 -- 172.21.15.16:0/3027906901 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fbc004aa0 con 0x7f2fcc102fb0 2024-08-01T06:55:54.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.820+0000 7f2fd44ba640 1 -- 172.21.15.16:0/3027906901 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fcc19cfb0 con 0x7f2fcc102fb0 2024-08-01T06:55:54.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.820+0000 7f2fd44ba640 1 -- 172.21.15.16:0/3027906901 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fcc19d470 con 0x7f2fcc102fb0 2024-08-01T06:55:54.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.821+0000 7f2fc37fe640 1 -- 172.21.15.16:0/3027906901 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2fbc005d50 con 0x7f2fcc102fb0 2024-08-01T06:55:54.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.821+0000 7f2fc37fe640 1 -- 172.21.15.16:0/3027906901 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fbc0038b0 con 0x7f2fcc102fb0 2024-08-01T06:55:54.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.821+0000 7f2fd44ba640 1 -- 172.21.15.16:0/3027906901 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb0005280 con 0x7f2fcc102fb0 2024-08-01T06:55:54.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.822+0000 7f2fc37fe640 1 -- 172.21.15.16:0/3027906901 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) v1 ==== 91559+0+0 (secure 0 0 0) 0x7f2fbc031640 con 0x7f2fcc102fb0 2024-08-01T06:55:54.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.823+0000 7f2fc37fe640 1 --2- 172.21.15.16:0/3027906901 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f2fb806d660 0x7f2fb806fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:54.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.823+0000 7f2fc37fe640 1 -- 172.21.15.16:0/3027906901 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f2fbc0adf00 con 0x7f2fcc102fb0 2024-08-01T06:55:54.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.824+0000 7f2fd2256640 1 --2- 172.21.15.16:0/3027906901 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f2fb806d660 0x7f2fb806fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:54.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.824+0000 7f2fd2256640 1 --2- 172.21.15.16:0/3027906901 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f2fb806d660 0x7f2fb806fb20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8009c90 tx=0x7f2fc8005f90 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:54.828 INFO:tasks.workunit.client.1.smithi089.stdout:8/289: sync 2024-08-01T06:55:54.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:54.828+0000 7f2fc37fe640 1 -- 172.21.15.16:0/3027906901 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f2fbc077770 con 0x7f2fcc102fb0 2024-08-01T06:55:54.832 INFO:tasks.workunit.client.1.smithi089.stdout:5/234: rename d5/d13/d4c to d5/de/d10/d16/d1b/d25/d4d 0 2024-08-01T06:55:54.835 INFO:tasks.workunit.client.1.smithi089.stdout:4/344: link d3/d1e/d21/f45 d3/d1e/d21/f6d 0 2024-08-01T06:55:54.837 INFO:tasks.workunit.client.1.smithi089.stdout:8/290: creat d5/dc/f62 x:0 0 0 2024-08-01T06:55:54.837 INFO:tasks.workunit.client.1.smithi089.stdout:4/345: creat d3/d1e/f6e x:0 0 0 2024-08-01T06:55:54.856 INFO:tasks.workunit.client.1.smithi089.stdout:4/346: write d3/d1e/d21/f5a [1411309,113135] 0 2024-08-01T06:55:54.858 INFO:tasks.workunit.client.1.smithi089.stdout:8/291: fsync d5/dc/d12/f14 0 2024-08-01T06:55:54.860 INFO:tasks.workunit.client.1.smithi089.stdout:5/235: dwrite d5/de/d10/f3d [0,4194304] 0 2024-08-01T06:55:54.862 INFO:tasks.workunit.client.1.smithi089.stdout:5/236: write d5/de/d10/d16/d1b/f39 [8161452,106439] 0 2024-08-01T06:55:54.863 INFO:tasks.workunit.client.1.smithi089.stdout:4/347: rename d3/db/f10 to d3/db/d33/f6f 0 2024-08-01T06:55:54.865 INFO:tasks.workunit.client.1.smithi089.stdout:5/237: dread - d5/de/d10/d16/f44 zero size 2024-08-01T06:55:54.865 INFO:tasks.workunit.client.1.smithi089.stdout:8/292: read - d5/dc/d1e/f34 zero size 2024-08-01T06:55:54.871 INFO:tasks.workunit.client.1.smithi089.stdout:4/348: dwrite d3/d1e/f6e [0,4194304] 0 2024-08-01T06:55:54.873 INFO:tasks.workunit.client.1.smithi089.stdout:8/293: chown d5/d15/f1c 43 1 2024-08-01T06:55:54.879 INFO:tasks.workunit.client.1.smithi089.stdout:4/349: dwrite d3/d1e/f40 [0,4194304] 0 2024-08-01T06:55:54.880 INFO:tasks.workunit.client.1.smithi089.stdout:5/238: truncate d5/de/d10/f3b 2148875 0 2024-08-01T06:55:54.882 INFO:tasks.workunit.client.1.smithi089.stdout:4/350: write d3/d17/d3a/f54 [3101026,55717] 0 2024-08-01T06:55:54.882 INFO:tasks.workunit.client.1.smithi089.stdout:8/294: creat d5/dc/f63 x:0 0 0 2024-08-01T06:55:54.885 INFO:tasks.workunit.client.1.smithi089.stdout:5/239: creat d5/d13/d43/f4e x:0 0 0 2024-08-01T06:55:54.886 INFO:tasks.workunit.client.1.smithi089.stdout:4/351: creat d3/d17/d3a/f70 x:0 0 0 2024-08-01T06:55:54.889 INFO:tasks.workunit.client.1.smithi089.stdout:8/295: creat d5/dc/d12/f64 x:0 0 0 2024-08-01T06:55:54.891 INFO:tasks.workunit.client.1.smithi089.stdout:4/352: mkdir d3/d17/d71 0 2024-08-01T06:55:54.898 INFO:tasks.workunit.client.1.smithi089.stdout:5/240: link d5/de/d10/d16/d1b/f22 d5/de/f4f 0 2024-08-01T06:55:54.899 INFO:tasks.workunit.client.1.smithi089.stdout:8/296: write d5/dc/f11 [3854272,123011] 0 2024-08-01T06:55:54.903 INFO:tasks.workunit.client.1.smithi089.stdout:8/297: fdatasync d5/dc/f52 0 2024-08-01T06:55:54.906 INFO:tasks.workunit.client.1.smithi089.stdout:4/353: link d3/db/de/d5b/c5f d3/d1f/d62/d3b/c72 0 2024-08-01T06:55:54.909 INFO:tasks.workunit.client.1.smithi089.stdout:8/298: dwrite d5/d15/d58/f55 [0,4194304] 0 2024-08-01T06:55:54.911 INFO:tasks.workunit.client.1.smithi089.stdout:4/354: creat d3/db/de/d5b/f73 x:0 0 0 2024-08-01T06:55:54.913 INFO:tasks.workunit.client.1.smithi089.stdout:4/355: creat d3/db/de/d5b/f74 x:0 0 0 2024-08-01T06:55:54.914 INFO:tasks.workunit.client.1.smithi089.stdout:4/356: stat d3/d17/f20 0 2024-08-01T06:55:54.941 INFO:tasks.workunit.client.1.smithi089.stdout:7/266: sync 2024-08-01T06:55:54.942 INFO:tasks.workunit.client.1.smithi089.stdout:7/267: chown c5 0 1 2024-08-01T06:55:54.942 INFO:tasks.workunit.client.1.smithi089.stdout:7/268: write f3 [3875104,130481] 0 2024-08-01T06:55:55.034 INFO:tasks.workunit.client.1.smithi089.stdout:3/205: sync 2024-08-01T06:55:55.034 INFO:tasks.workunit.client.1.smithi089.stdout:9/296: sync 2024-08-01T06:55:55.034 INFO:tasks.workunit.client.1.smithi089.stdout:0/352: sync 2024-08-01T06:55:55.034 INFO:tasks.workunit.client.1.smithi089.stdout:6/380: sync 2024-08-01T06:55:55.034 INFO:tasks.workunit.client.1.smithi089.stdout:1/364: sync 2024-08-01T06:55:55.034 INFO:tasks.workunit.client.1.smithi089.stdout:2/261: sync 2024-08-01T06:55:55.035 INFO:tasks.workunit.client.1.smithi089.stdout:9/297: stat f10 0 2024-08-01T06:55:55.035 INFO:tasks.workunit.client.1.smithi089.stdout:2/262: readlink d7/d19/d1e/d3d/l42 0 2024-08-01T06:55:55.038 INFO:tasks.workunit.client.1.smithi089.stdout:3/206: fsync d7/d32/d12/d1b/f26 0 2024-08-01T06:55:55.040 INFO:tasks.workunit.client.1.smithi089.stdout:3/207: fdatasync d7/d32/d12/f33 0 2024-08-01T06:55:55.042 INFO:tasks.workunit.client.1.smithi089.stdout:3/208: fdatasync d7/d32/f2d 0 2024-08-01T06:55:55.042 INFO:tasks.workunit.client.1.smithi089.stdout:9/298: unlink d18/f19 0 2024-08-01T06:55:55.042 INFO:tasks.workunit.client.1.smithi089.stdout:1/365: dwrite d0/d9/d15/d2d/d4a/d61/f67 [0,4194304] 0 2024-08-01T06:55:55.043 INFO:tasks.workunit.client.1.smithi089.stdout:3/209: write d7/f1f [9328,29165] 0 2024-08-01T06:55:55.044 INFO:tasks.workunit.client.1.smithi089.stdout:6/381: rename d2/d30/c42 to d2/d11/d1a/d1c/d40/c8c 0 2024-08-01T06:55:55.046 INFO:tasks.workunit.client.1.smithi089.stdout:2/263: creat d7/d19/d3b/f50 x:0 0 0 2024-08-01T06:55:55.060 INFO:tasks.workunit.client.1.smithi089.stdout:9/299: rename d18/d3d/d4b/f4e to d18/d22/d43/f5f 0 2024-08-01T06:55:55.060 INFO:tasks.workunit.client.1.smithi089.stdout:1/366: creat d0/d9/d15/d3b/d3d/f7f x:0 0 0 2024-08-01T06:55:55.060 INFO:tasks.workunit.client.1.smithi089.stdout:9/300: chown f10 623 1 2024-08-01T06:55:55.060 INFO:tasks.workunit.client.1.smithi089.stdout:1/367: fsync d0/d9/d15/d2d/f33 0 2024-08-01T06:55:55.061 INFO:tasks.workunit.client.1.smithi089.stdout:9/301: write d18/d22/d39/f3a [1775758,50270] 0 2024-08-01T06:55:55.064 INFO:tasks.workunit.client.1.smithi089.stdout:1/368: write d0/d9/d15/d2d/d4a/d4d/f5d [952339,47926] 0 2024-08-01T06:55:55.064 INFO:tasks.workunit.client.1.smithi089.stdout:2/264: creat d7/d1f/d28/f51 x:0 0 0 2024-08-01T06:55:55.064 INFO:tasks.workunit.client.1.smithi089.stdout:0/353: link d9/l19 d9/d22/l70 0 2024-08-01T06:55:55.065 INFO:tasks.workunit.client.1.smithi089.stdout:1/369: chown d0/d9/d15/c38 9787016 1 2024-08-01T06:55:55.066 INFO:tasks.workunit.client.1.smithi089.stdout:2/265: write d7/d19/f44 [2846104,69784] 0 2024-08-01T06:55:55.067 INFO:tasks.workunit.client.1.smithi089.stdout:2/266: stat d7/d1f/f4b 0 2024-08-01T06:55:55.069 INFO:tasks.workunit.client.1.smithi089.stdout:6/382: symlink d2/d11/d1f/d46/d86/l8d 0 2024-08-01T06:55:55.082 INFO:tasks.workunit.client.1.smithi089.stdout:9/302: link d18/d3d/f5d d18/d33/f60 0 2024-08-01T06:55:55.083 INFO:tasks.workunit.client.1.smithi089.stdout:6/383: dread d2/f18 [0,4194304] 0 2024-08-01T06:55:55.084 INFO:tasks.workunit.client.1.smithi089.stdout:6/384: chown d2/d2e/c89 840 1 2024-08-01T06:55:55.088 INFO:tasks.workunit.client.1.smithi089.stdout:1/370: creat d0/d9/d15/d76/f80 x:0 0 0 2024-08-01T06:55:55.096 INFO:tasks.workunit.client.1.smithi089.stdout:0/354: rename d9/d40/d25/d46/f49 to d9/d40/f71 0 2024-08-01T06:55:55.098 INFO:tasks.workunit.client.1.smithi089.stdout:1/371: symlink d0/d9/d15/d3b/l81 0 2024-08-01T06:55:55.101 INFO:tasks.workunit.client.1.smithi089.stdout:0/355: fsync d9/d22/f34 0 2024-08-01T06:55:55.103 INFO:tasks.workunit.client.1.smithi089.stdout:1/372: mkdir d0/d6c/d49/d82 0 2024-08-01T06:55:55.114 INFO:tasks.workunit.client.1.smithi089.stdout:0/356: dread d9/d40/d26/d2e/f4b [0,4194304] 0 2024-08-01T06:55:55.116 INFO:tasks.workunit.client.1.smithi089.stdout:2/267: rename d7/d19/d1e/d3d/d4f to d7/d1f/d52 0 2024-08-01T06:55:55.118 INFO:tasks.workunit.client.1.smithi089.stdout:2/268: write d7/d1f/f20 [4962113,46303] 0 2024-08-01T06:55:55.120 INFO:tasks.workunit.client.1.smithi089.stdout:2/269: truncate d7/d19/f44 4270954 0 2024-08-01T06:55:55.121 INFO:tasks.workunit.client.1.smithi089.stdout:2/270: write d7/d1f/f4b [541556,45350] 0 2024-08-01T06:55:55.124 INFO:tasks.workunit.client.1.smithi089.stdout:6/385: rename d2/d30/d3c/c7a to d2/d11/d1f/c8e 0 2024-08-01T06:55:55.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.123+0000 7f2fd44ba640 1 -- 172.21.15.16:0/3027906901 --> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fb0000bf0 con 0x7f2fb806d660 2024-08-01T06:55:55.125 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:54 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:55.125 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:54 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:55.125 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:54 smithi016 ceph-mon[29266]: pgmap v11: 65 pgs: 65 active+clean; 362 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 3.4 MiB/s rd, 26 MiB/s wr, 290 op/s 2024-08-01T06:55:55.125 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:54 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:55.125 INFO:tasks.workunit.client.1.smithi089.stdout:5/241: sync 2024-08-01T06:55:55.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.125+0000 7f2fc37fe640 1 -- 172.21.15.16:0/3027906901 <== mgr.24423 v2:172.21.15.89:6828/2589785296 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f2fb0000bf0 con 0x7f2fb806d660 2024-08-01T06:55:55.128 INFO:tasks.workunit.client.1.smithi089.stdout:2/271: dwrite d7/d1f/d29/f43 [0,4194304] 0 2024-08-01T06:55:55.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.127+0000 7f2fd44ba640 1 -- 172.21.15.16:0/3027906901 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f2fb806d660 msgr2=0x7f2fb806fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.127+0000 7f2fd44ba640 1 --2- 172.21.15.16:0/3027906901 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f2fb806d660 0x7f2fb806fb20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8009c90 tx=0x7f2fc8005f90 comp rx=0 tx=0).stop 2024-08-01T06:55:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.127+0000 7f2fd44ba640 1 -- 172.21.15.16:0/3027906901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fcc102fb0 msgr2=0x7f2fcc197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.127+0000 7f2fd44ba640 1 --2- 172.21.15.16:0/3027906901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fcc102fb0 0x7f2fcc197e30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc068790 tx=0x7f2fbc0055a0 comp rx=0 tx=0).stop 2024-08-01T06:55:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.127+0000 7f2fd44ba640 1 -- 172.21.15.16:0/3027906901 shutdown_connections 2024-08-01T06:55:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.127+0000 7f2fd44ba640 1 --2- 172.21.15.16:0/3027906901 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f2fb806d660 0x7f2fb806fb20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.127+0000 7f2fd44ba640 1 --2- 172.21.15.16:0/3027906901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fcc102fb0 0x7f2fcc197e30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.127+0000 7f2fd44ba640 1 --2- 172.21.15.16:0/3027906901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fcc100680 0x7f2fcc1978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.127+0000 7f2fd44ba640 1 -- 172.21.15.16:0/3027906901 >> 172.21.15.16:0/3027906901 conn(0x7f2fcc0fa280 msgr2=0x7f2fcc103a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.128+0000 7f2fd44ba640 1 -- 172.21.15.16:0/3027906901 shutdown_connections 2024-08-01T06:55:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.128+0000 7f2fd44ba640 1 -- 172.21.15.16:0/3027906901 wait complete. 2024-08-01T06:55:55.131 INFO:tasks.workunit.client.1.smithi089.stdout:5/242: symlink d5/d13/d38/l50 0 2024-08-01T06:55:55.133 INFO:tasks.workunit.client.1.smithi089.stdout:5/243: chown d5/d13/d43/c46 1593397966 1 2024-08-01T06:55:55.134 INFO:tasks.workunit.client.1.smithi089.stdout:2/272: mknod d7/d19/d1e/c53 0 2024-08-01T06:55:55.134 INFO:tasks.workunit.client.1.smithi089.stdout:5/244: write f0 [952098,48669] 0 2024-08-01T06:55:55.136 INFO:tasks.workunit.client.1.smithi089.stdout:2/273: fsync d7/d19/d3b/f50 0 2024-08-01T06:55:55.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:54 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:55.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:54 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:55.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:54 smithi089 ceph-mon[36617]: pgmap v11: 65 pgs: 65 active+clean; 362 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 3.4 MiB/s rd, 26 MiB/s wr, 290 op/s 2024-08-01T06:55:55.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:54 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:55.138 INFO:tasks.workunit.client.1.smithi089.stdout:6/386: dwrite d2/d2e/d2f/f4d [0,4194304] 0 2024-08-01T06:55:55.138 INFO:tasks.workunit.client.1.smithi089.stdout:6/387: readlink d2/d11/l16 0 2024-08-01T06:55:55.139 INFO:tasks.workunit.client.1.smithi089.stdout:0/357: dread d9/d40/f27 [0,4194304] 0 2024-08-01T06:55:55.142 INFO:tasks.workunit.client.1.smithi089.stdout:5/245: rmdir d5/de/d10/d16 39 2024-08-01T06:55:55.143 INFO:tasks.workunit.client.1.smithi089.stdout:5/246: truncate d5/d13/f31 2318864 0 2024-08-01T06:55:55.144 INFO:tasks.workunit.client.1.smithi089.stdout:1/373: write d0/d9/d43/f5c [2932002,120548] 0 2024-08-01T06:55:55.145 INFO:tasks.workunit.client.1.smithi089.stdout:6/388: symlink d2/d11/d1f/d46/d86/l8f 0 2024-08-01T06:55:55.149 INFO:tasks.workunit.client.1.smithi089.stdout:3/210: sync 2024-08-01T06:55:55.149 INFO:tasks.workunit.client.1.smithi089.stdout:4/357: sync 2024-08-01T06:55:55.149 INFO:tasks.workunit.client.1.smithi089.stdout:8/299: sync 2024-08-01T06:55:55.149 INFO:tasks.workunit.client.1.smithi089.stdout:7/269: sync 2024-08-01T06:55:55.150 INFO:tasks.workunit.client.1.smithi089.stdout:4/358: chown d3/db/de 13541 1 2024-08-01T06:55:55.150 INFO:tasks.workunit.client.1.smithi089.stdout:9/303: write ff [3762856,24382] 0 2024-08-01T06:55:55.151 INFO:tasks.workunit.client.1.smithi089.stdout:3/211: chown d7/d32/d12/d29/c35 64357 1 2024-08-01T06:55:55.154 INFO:tasks.workunit.client.1.smithi089.stdout:1/374: write d0/d6c/d49/f65 [5119677,17000] 0 2024-08-01T06:55:55.154 INFO:tasks.workunit.client.1.smithi089.stdout:6/389: rmdir d2/d30/d3c/d3d 39 2024-08-01T06:55:55.156 INFO:tasks.workunit.client.1.smithi089.stdout:0/358: mkdir d9/d40/d26/d2e/d44/d72 0 2024-08-01T06:55:55.159 INFO:tasks.workunit.client.1.smithi089.stdout:7/270: dwrite d7/df/d10/f35 [0,4194304] 0 2024-08-01T06:55:55.160 INFO:tasks.workunit.client.1.smithi089.stdout:9/304: dread d18/d22/d45/f59 [0,4194304] 0 2024-08-01T06:55:55.163 INFO:tasks.workunit.client.1.smithi089.stdout:5/247: symlink d5/de/d10/d16/d1b/l51 0 2024-08-01T06:55:55.163 INFO:tasks.workunit.client.1.smithi089.stdout:7/271: truncate d7/df/d10/d42/f48 1593075 0 2024-08-01T06:55:55.163 INFO:tasks.workunit.client.1.smithi089.stdout:6/390: dread d2/d11/d1f/d46/f72 [0,4194304] 0 2024-08-01T06:55:55.164 INFO:tasks.workunit.client.1.smithi089.stdout:3/212: fsync d7/dd/f15 0 2024-08-01T06:55:55.164 INFO:tasks.workunit.client.1.smithi089.stdout:6/391: write d2/d11/d1f/f2d [3662098,74827] 0 2024-08-01T06:55:55.170 INFO:tasks.workunit.client.1.smithi089.stdout:8/300: mkdir d5/d65 0 2024-08-01T06:55:55.172 INFO:tasks.workunit.client.1.smithi089.stdout:1/375: readlink d0/d9/d15/d2b/l60 0 2024-08-01T06:55:55.184 INFO:tasks.workunit.client.1.smithi089.stdout:3/213: mkdir d7/d32/d12/d29/d39 0 2024-08-01T06:55:55.187 INFO:tasks.workunit.client.1.smithi089.stdout:6/392: truncate d2/d11/f63 3787668 0 2024-08-01T06:55:55.188 INFO:tasks.workunit.client.1.smithi089.stdout:6/393: write d2/d11/f65 [373657,38786] 0 2024-08-01T06:55:55.191 INFO:tasks.workunit.client.1.smithi089.stdout:0/359: write d9/ff [5445287,45097] 0 2024-08-01T06:55:55.197 INFO:tasks.workunit.client.1.smithi089.stdout:8/301: dwrite d5/dc/f37 [0,4194304] 0 2024-08-01T06:55:55.199 INFO:tasks.workunit.client.1.smithi089.stdout:3/214: mknod d7/d32/d12/c3a 0 2024-08-01T06:55:55.202 INFO:tasks.workunit.client.1.smithi089.stdout:4/359: truncate d3/d1f/d62/f2a 2458881 0 2024-08-01T06:55:55.203 INFO:tasks.workunit.client.1.smithi089.stdout:7/272: dwrite d7/d1f/f40 [0,4194304] 0 2024-08-01T06:55:55.204 INFO:tasks.workunit.client.1.smithi089.stdout:7/273: fsync f4 0 2024-08-01T06:55:55.204 INFO:tasks.workunit.client.1.smithi089.stdout:7/274: dread - d7/d15/f39 zero size 2024-08-01T06:55:55.211 INFO:tasks.workunit.client.1.smithi089.stdout:7/275: dwrite d7/d15/f25 [0,4194304] 0 2024-08-01T06:55:55.213 INFO:tasks.workunit.client.1.smithi089.stdout:5/248: truncate d5/d13/f30 56634 0 2024-08-01T06:55:55.224 INFO:tasks.workunit.client.1.smithi089.stdout:1/376: rename d0/d9/d15/d3b/c5b to d0/d9/d15/d2d/d4a/c83 0 2024-08-01T06:55:55.227 INFO:tasks.workunit.client.1.smithi089.stdout:9/305: getdents d18/d22 0 2024-08-01T06:55:55.228 INFO:tasks.workunit.client.1.smithi089.stdout:7/276: creat d7/df/d10/d42/f5e x:0 0 0 2024-08-01T06:55:55.229 INFO:tasks.workunit.client.1.smithi089.stdout:9/306: write d18/d33/d3b/f46 [775156,81544] 0 2024-08-01T06:55:55.229 INFO:tasks.workunit.client.1.smithi089.stdout:2/274: sync 2024-08-01T06:55:55.230 INFO:tasks.workunit.client.1.smithi089.stdout:5/249: mkdir d5/de/d10/d16/d1b/d52 0 2024-08-01T06:55:55.230 INFO:tasks.workunit.client.1.smithi089.stdout:3/215: dread d7/d32/d12/d1b/f26 [0,4194304] 0 2024-08-01T06:55:55.232 INFO:tasks.workunit.client.1.smithi089.stdout:4/360: dread d3/d1e/d21/f41 [0,4194304] 0 2024-08-01T06:55:55.232 INFO:tasks.workunit.client.1.smithi089.stdout:8/302: creat d5/dc/d1e/f66 x:0 0 0 2024-08-01T06:55:55.235 INFO:tasks.workunit.client.1.smithi089.stdout:5/250: dread d5/d13/f2b [0,4194304] 0 2024-08-01T06:55:55.235 INFO:tasks.workunit.client.1.smithi089.stdout:0/360: rename d9/d40/d25/d46/f1e to d9/d22/f73 0 2024-08-01T06:55:55.236 INFO:tasks.workunit.client.1.smithi089.stdout:1/377: mknod d0/d9/d15/d2d/d4a/d4d/c84 0 2024-08-01T06:55:55.238 INFO:tasks.workunit.client.1.smithi089.stdout:2/275: read d7/d19/f40 [4150251,15896] 0 2024-08-01T06:55:55.239 INFO:tasks.workunit.client.1.smithi089.stdout:1/378: chown d0/d9/d15/d2d/d4a/d4d/c4e 4138653 1 2024-08-01T06:55:55.239 INFO:tasks.workunit.client.1.smithi089.stdout:2/276: chown d7/d1f/d29/f49 9 1 2024-08-01T06:55:55.241 INFO:tasks.workunit.client.1.smithi089.stdout:4/361: dwrite d3/d1e/d21/d26/f61 [0,4194304] 0 2024-08-01T06:55:55.241 INFO:tasks.workunit.client.1.smithi089.stdout:1/379: dread - d0/d9/d15/d3b/d3d/f7f zero size 2024-08-01T06:55:55.245 INFO:tasks.workunit.client.1.smithi089.stdout:6/394: getdents d2/d30/d3c 0 2024-08-01T06:55:55.246 INFO:tasks.workunit.client.1.smithi089.stdout:6/395: truncate d2/d11/d1f/f5a 1195590 0 2024-08-01T06:55:55.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.248+0000 7f05b82e6640 1 -- 172.21.15.16:0/2622128509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b01000e0 msgr2=0x7f05b01004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:55.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.248+0000 7f05b82e6640 1 --2- 172.21.15.16:0/2622128509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b01000e0 0x7f05b01004e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f05ac009880 tx=0x7f05ac02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:55:55.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.248+0000 7f05b82e6640 1 -- 172.21.15.16:0/2622128509 shutdown_connections 2024-08-01T06:55:55.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.248+0000 7f05b82e6640 1 --2- 172.21.15.16:0/2622128509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05b00fecb0 0x7f05b00ff130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:55.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.248+0000 7f05b82e6640 1 --2- 172.21.15.16:0/2622128509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b01000e0 0x7f05b01004e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:55.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.248+0000 7f05b82e6640 1 -- 172.21.15.16:0/2622128509 >> 172.21.15.16:0/2622128509 conn(0x7f05b00f9950 msgr2=0x7f05b00fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:55.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.248+0000 7f05b82e6640 1 -- 172.21.15.16:0/2622128509 shutdown_connections 2024-08-01T06:55:55.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.248+0000 7f05b82e6640 1 -- 172.21.15.16:0/2622128509 wait complete. 2024-08-01T06:55:55.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.249+0000 7f05b82e6640 1 Processor -- start 2024-08-01T06:55:55.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.249+0000 7f05b82e6640 1 -- start start 2024-08-01T06:55:55.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.249+0000 7f05b82e6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05b00fecb0 0x7f05b00fe740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:55.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.249+0000 7f05b82e6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b01000e0 0x7f05b019a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:55.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.249+0000 7f05b82e6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b019a810 con 0x7f05b01000e0 2024-08-01T06:55:55.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.249+0000 7f05b82e6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b019a980 con 0x7f05b00fecb0 2024-08-01T06:55:55.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.249+0000 7f05b5881640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b01000e0 0x7f05b019a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:55.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.249+0000 7f05b5881640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b01000e0 0x7f05b019a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53608/0 (socket says 172.21.15.16:53608) 2024-08-01T06:55:55.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.249+0000 7f05b5881640 1 -- 172.21.15.16:0/1185299140 learned_addr learned my addr 172.21.15.16:0/1185299140 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:55:55.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.249+0000 7f05b6082640 1 --2- 172.21.15.16:0/1185299140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05b00fecb0 0x7f05b00fe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:55.252 INFO:tasks.workunit.client.1.smithi089.stdout:8/303: rename d5/dc/d12/c1b to d5/d65/c67 0 2024-08-01T06:55:55.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.250+0000 7f05b6082640 1 -- 172.21.15.16:0/1185299140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b01000e0 msgr2=0x7f05b019a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:55.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.250+0000 7f05b6082640 1 --2- 172.21.15.16:0/1185299140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b01000e0 0x7f05b019a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:55.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.250+0000 7f05b6082640 1 -- 172.21.15.16:0/1185299140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac009560 con 0x7f05b00fecb0 2024-08-01T06:55:55.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.250+0000 7f05b5881640 1 --2- 172.21.15.16:0/1185299140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b01000e0 0x7f05b019a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T06:55:55.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.250+0000 7f05b6082640 1 --2- 172.21.15.16:0/1185299140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05b00fecb0 0x7f05b00fe740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f05ac02a9c0 tx=0x7f05ac005610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:55.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.250+0000 7f05a77fe640 1 -- 172.21.15.16:0/1185299140 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05ac004b20 con 0x7f05b00fecb0 2024-08-01T06:55:55.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.251+0000 7f05b82e6640 1 -- 172.21.15.16:0/1185299140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b019ac00 con 0x7f05b00fecb0 2024-08-01T06:55:55.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.251+0000 7f05b82e6640 1 -- 172.21.15.16:0/1185299140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b019b170 con 0x7f05b00fecb0 2024-08-01T06:55:55.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.251+0000 7f05a77fe640 1 -- 172.21.15.16:0/1185299140 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f05ac004c80 con 0x7f05b00fecb0 2024-08-01T06:55:55.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.251+0000 7f05a77fe640 1 -- 172.21.15.16:0/1185299140 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05ac0039b0 con 0x7f05b00fecb0 2024-08-01T06:55:55.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.252+0000 7f05b82e6640 1 -- 172.21.15.16:0/1185299140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0594005280 con 0x7f05b00fecb0 2024-08-01T06:55:55.255 INFO:tasks.workunit.client.1.smithi089.stdout:2/277: creat d7/d19/d1e/f54 x:0 0 0 2024-08-01T06:55:55.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.252+0000 7f05a77fe640 1 -- 172.21.15.16:0/1185299140 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 24) v1 ==== 91559+0+0 (secure 0 0 0) 0x7f05ac003c60 con 0x7f05b00fecb0 2024-08-01T06:55:55.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.253+0000 7f05a77fe640 1 --2- 172.21.15.16:0/1185299140 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f059c06d660 0x7f059c06fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:55.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.253+0000 7f05a77fe640 1 -- 172.21.15.16:0/1185299140 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f05ac0ae240 con 0x7f05b00fecb0 2024-08-01T06:55:55.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.253+0000 7f05b5881640 1 --2- 172.21.15.16:0/1185299140 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f059c06d660 0x7f059c06fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:55.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.254+0000 7f05b5881640 1 --2- 172.21.15.16:0/1185299140 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f059c06d660 0x7f059c06fb20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f05b00fe4c0 tx=0x7f05a000a3b0 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:55.256 INFO:tasks.workunit.client.1.smithi089.stdout:2/278: write d7/d1f/d29/f49 [664190,72512] 0 2024-08-01T06:55:55.256 INFO:tasks.workunit.client.1.smithi089.stdout:2/279: readlink d7/d1f/d29/l3e 0 2024-08-01T06:55:55.258 INFO:tasks.workunit.client.1.smithi089.stdout:1/380: creat d0/d9/d15/d3b/d3d/f85 x:0 0 0 2024-08-01T06:55:55.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.259+0000 7f05a77fe640 1 -- 172.21.15.16:0/1185299140 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f05ac077a10 con 0x7f05b00fecb0 2024-08-01T06:55:55.261 INFO:tasks.workunit.client.1.smithi089.stdout:1/381: truncate d0/d9/d15/d2d/d4a/d4d/f6e 1023839 0 2024-08-01T06:55:55.263 INFO:tasks.workunit.client.1.smithi089.stdout:2/280: dread d7/d1f/d29/f15 [0,4194304] 0 2024-08-01T06:55:55.269 INFO:tasks.workunit.client.1.smithi089.stdout:0/361: mknod d9/d40/d26/d2e/d44/c74 0 2024-08-01T06:55:55.275 INFO:tasks.workunit.client.1.smithi089.stdout:1/382: creat d0/d9/d15/d2d/d4a/d61/f86 x:0 0 0 2024-08-01T06:55:55.278 INFO:tasks.workunit.client.1.smithi089.stdout:3/216: truncate d7/d32/f13 978689 0 2024-08-01T06:55:55.279 INFO:tasks.workunit.client.1.smithi089.stdout:7/277: getdents d7/d1f/d30 0 2024-08-01T06:55:55.280 INFO:tasks.workunit.client.1.smithi089.stdout:7/278: readlink d7/df/l32 0 2024-08-01T06:55:55.281 INFO:tasks.workunit.client.1.smithi089.stdout:5/251: write d5/de/d10/f3b [45471,127567] 0 2024-08-01T06:55:55.281 INFO:tasks.workunit.client.1.smithi089.stdout:3/217: dread d7/dd/f20 [0,4194304] 0 2024-08-01T06:55:55.282 INFO:tasks.workunit.client.1.smithi089.stdout:7/279: read d7/df/d10/d36/f47 [782209,100174] 0 2024-08-01T06:55:55.283 INFO:tasks.workunit.client.1.smithi089.stdout:7/280: write d7/df/d10/d36/f47 [3738765,99451] 0 2024-08-01T06:55:55.284 INFO:tasks.workunit.client.1.smithi089.stdout:8/304: rename d5/dc/d1e/f66 to d5/d15/d5a/f68 0 2024-08-01T06:55:55.285 INFO:tasks.workunit.client.1.smithi089.stdout:8/305: truncate d5/dc/d12/f64 871649 0 2024-08-01T06:55:55.287 INFO:tasks.workunit.client.1.smithi089.stdout:0/362: creat d9/d40/d26/d2e/d44/d53/f75 x:0 0 0 2024-08-01T06:55:55.292 INFO:tasks.workunit.client.1.smithi089.stdout:9/307: getdents d18/d22/d39/d50 0 2024-08-01T06:55:55.299 INFO:tasks.workunit.client.1.smithi089.stdout:6/396: dwrite d2/d30/f73 [0,4194304] 0 2024-08-01T06:55:55.299 INFO:tasks.workunit.client.1.smithi089.stdout:5/252: chown d5/d13/f30 504461886 1 2024-08-01T06:55:55.300 INFO:tasks.workunit.client.1.smithi089.stdout:9/308: dwrite d18/d22/f28 [0,4194304] 0 2024-08-01T06:55:55.304 INFO:tasks.workunit.client.1.smithi089.stdout:9/309: chown d18/d33/l36 1707349326 1 2024-08-01T06:55:55.308 INFO:tasks.workunit.client.1.smithi089.stdout:4/362: getdents d3/d17 0 2024-08-01T06:55:55.312 INFO:tasks.workunit.client.1.smithi089.stdout:5/253: dwrite d5/de/d10/d16/d1b/f2e [4194304,4194304] 0 2024-08-01T06:55:55.316 INFO:tasks.workunit.client.1.smithi089.stdout:9/310: creat d18/d33/f61 x:0 0 0 2024-08-01T06:55:55.317 INFO:tasks.workunit.client.1.smithi089.stdout:0/363: mkdir d9/d40/d26/d2e/d3a/d76 0 2024-08-01T06:55:55.319 INFO:tasks.workunit.client.1.smithi089.stdout:7/281: write d7/d1f/f1d [5090187,18153] 0 2024-08-01T06:55:55.328 INFO:tasks.workunit.client.1.smithi089.stdout:8/306: dwrite f2 [4194304,4194304] 0 2024-08-01T06:55:55.329 INFO:tasks.workunit.client.1.smithi089.stdout:2/281: rename d7/d19/d3b/c41 to d7/c55 0 2024-08-01T06:55:55.335 INFO:tasks.workunit.client.1.smithi089.stdout:8/307: dread d5/d15/d58/f55 [0,4194304] 0 2024-08-01T06:55:55.337 INFO:tasks.workunit.client.1.smithi089.stdout:6/397: dread d2/d11/d1f/f2d [0,4194304] 0 2024-08-01T06:55:55.338 INFO:tasks.workunit.client.1.smithi089.stdout:5/254: creat d5/de/d10/d16/d1b/d52/f53 x:0 0 0 2024-08-01T06:55:55.343 INFO:tasks.workunit.client.1.smithi089.stdout:2/282: dread d7/d1f/d29/f15 [4194304,4194304] 0 2024-08-01T06:55:55.345 INFO:tasks.workunit.client.1.smithi089.stdout:5/255: dwrite d5/de/d10/d16/f44 [0,4194304] 0 2024-08-01T06:55:55.349 INFO:tasks.workunit.client.1.smithi089.stdout:9/311: dread d18/f23 [0,4194304] 0 2024-08-01T06:55:55.350 INFO:tasks.workunit.client.1.smithi089.stdout:9/312: dread - d18/f20 zero size 2024-08-01T06:55:55.355 INFO:tasks.workunit.client.1.smithi089.stdout:4/363: truncate d3/db/d33/f6f 1007121 0 2024-08-01T06:55:55.358 INFO:tasks.workunit.client.1.smithi089.stdout:7/282: dwrite d7/df/d10/f24 [0,4194304] 0 2024-08-01T06:55:55.360 INFO:tasks.workunit.client.1.smithi089.stdout:3/218: truncate d7/d32/f13 327982 0 2024-08-01T06:55:55.361 INFO:tasks.workunit.client.1.smithi089.stdout:3/219: fdatasync d7/d32/d12/f33 0 2024-08-01T06:55:55.365 INFO:tasks.workunit.client.1.smithi089.stdout:1/383: rename d0/d6c/f37 to d0/d9/f87 0 2024-08-01T06:55:55.366 INFO:tasks.workunit.client.1.smithi089.stdout:9/313: creat d18/d33/f62 x:0 0 0 2024-08-01T06:55:55.367 INFO:tasks.workunit.client.1.smithi089.stdout:2/283: symlink d7/d1f/l56 0 2024-08-01T06:55:55.367 INFO:tasks.workunit.client.1.smithi089.stdout:9/314: write d18/d33/f37 [238715,27055] 0 2024-08-01T06:55:55.368 INFO:tasks.workunit.client.1.smithi089.stdout:4/364: rmdir d3/d1f 39 2024-08-01T06:55:55.374 INFO:tasks.workunit.client.1.smithi089.stdout:3/220: readlink d7/d32/d23/d2f/l2a 0 2024-08-01T06:55:55.374 INFO:tasks.workunit.client.1.smithi089.stdout:8/308: link d5/dc/d12/f56 d5/d15/d5e/f69 0 2024-08-01T06:55:55.375 INFO:tasks.workunit.client.1.smithi089.stdout:4/365: dwrite d3/d17/d3a/f63 [0,4194304] 0 2024-08-01T06:55:55.378 INFO:tasks.workunit.client.1.smithi089.stdout:7/283: dwrite d7/d1f/d3a/f41 [0,4194304] 0 2024-08-01T06:55:55.379 INFO:tasks.workunit.client.1.smithi089.stdout:0/364: rename d9/d40/d25/d46/f28 to d9/f77 0 2024-08-01T06:55:55.381 INFO:tasks.workunit.client.1.smithi089.stdout:1/384: creat d0/d9/d15/d76/f88 x:0 0 0 2024-08-01T06:55:55.383 INFO:tasks.workunit.client.1.smithi089.stdout:1/385: dread - d0/d9/d15/d2d/d4a/d61/f7e zero size 2024-08-01T06:55:55.384 INFO:tasks.workunit.client.1.smithi089.stdout:1/386: chown d0/c6f 3742767 1 2024-08-01T06:55:55.388 INFO:tasks.workunit.client.1.smithi089.stdout:8/309: symlink d5/d15/d58/l6a 0 2024-08-01T06:55:55.390 INFO:tasks.workunit.client.1.smithi089.stdout:4/366: creat d3/db/de/d5b/f75 x:0 0 0 2024-08-01T06:55:55.392 INFO:tasks.workunit.client.1.smithi089.stdout:4/367: read d3/d1e/f6e [2565584,71504] 0 2024-08-01T06:55:55.393 INFO:tasks.workunit.client.1.smithi089.stdout:1/387: write d0/d9/f87 [1791207,36470] 0 2024-08-01T06:55:55.396 INFO:tasks.workunit.client.1.smithi089.stdout:9/315: rename l6 to d18/d22/d39/l63 0 2024-08-01T06:55:55.397 INFO:tasks.workunit.client.1.smithi089.stdout:5/256: dwrite d5/de/d10/d16/d1b/f22 [0,4194304] 0 2024-08-01T06:55:55.397 INFO:tasks.workunit.client.1.smithi089.stdout:2/284: link d7/d19/d1e/l3a d7/d19/d1e/l57 0 2024-08-01T06:55:55.402 INFO:tasks.workunit.client.1.smithi089.stdout:9/316: dread d18/d22/d45/f51 [0,4194304] 0 2024-08-01T06:55:55.403 INFO:tasks.workunit.client.1.smithi089.stdout:1/388: mkdir d0/d9/d43/d89 0 2024-08-01T06:55:55.408 INFO:tasks.workunit.client.1.smithi089.stdout:5/257: mknod d5/d13/d38/d42/c54 0 2024-08-01T06:55:55.409 INFO:tasks.workunit.client.1.smithi089.stdout:5/258: read d5/de/d10/d16/d1b/f2e [8132955,52966] 0 2024-08-01T06:55:55.410 INFO:tasks.workunit.client.1.smithi089.stdout:5/259: dread - d5/f3c zero size 2024-08-01T06:55:55.411 INFO:tasks.workunit.client.1.smithi089.stdout:3/221: rename d7/d32/d23/l27 to d7/d32/d23/d2f/l3b 0 2024-08-01T06:55:55.411 INFO:tasks.workunit.client.1.smithi089.stdout:1/389: creat d0/d9/d15/d3b/d3d/f8a x:0 0 0 2024-08-01T06:55:55.416 INFO:tasks.workunit.client.1.smithi089.stdout:7/284: rename d7/d1f/f40 to d7/df/d10/d36/f5f 0 2024-08-01T06:55:55.418 INFO:tasks.workunit.client.1.smithi089.stdout:2/285: creat d7/f58 x:0 0 0 2024-08-01T06:55:55.419 INFO:tasks.workunit.client.1.smithi089.stdout:3/222: creat d7/d32/d12/d1b/f3c x:0 0 0 2024-08-01T06:55:55.420 INFO:tasks.workunit.client.1.smithi089.stdout:3/223: readlink d7/d32/l22 0 2024-08-01T06:55:55.422 INFO:tasks.workunit.client.1.smithi089.stdout:2/286: dread d7/d1f/d29/f43 [0,4194304] 0 2024-08-01T06:55:55.428 INFO:tasks.workunit.client.1.smithi089.stdout:9/317: rename f16 to d18/d22/d43/f64 0 2024-08-01T06:55:55.430 INFO:tasks.workunit.client.1.smithi089.stdout:1/390: truncate d0/d9/d15/d2d/d4a/f47 2181144 0 2024-08-01T06:55:55.432 INFO:tasks.workunit.client.1.smithi089.stdout:8/310: dwrite d5/d15/f1c [0,4194304] 0 2024-08-01T06:55:55.434 INFO:tasks.workunit.client.1.smithi089.stdout:8/311: truncate d5/dc/d1e/d53/f5c 195949 0 2024-08-01T06:55:55.435 INFO:tasks.workunit.client.1.smithi089.stdout:2/287: creat d7/d19/d3b/f59 x:0 0 0 2024-08-01T06:55:55.436 INFO:tasks.workunit.client.1.smithi089.stdout:2/288: chown f5 1262376 1 2024-08-01T06:55:55.436 INFO:tasks.workunit.client.1.smithi089.stdout:4/368: truncate d3/d1e/f6e 4220808 0 2024-08-01T06:55:55.437 INFO:tasks.workunit.client.1.smithi089.stdout:4/369: truncate d3/db/d33/f56 516458 0 2024-08-01T06:55:55.440 INFO:tasks.workunit.client.1.smithi089.stdout:7/285: link d7/d15/f2d d7/d1f/d3a/f60 0 2024-08-01T06:55:55.445 INFO:tasks.workunit.client.1.smithi089.stdout:3/224: mkdir d7/d32/d23/d31/d3d 0 2024-08-01T06:55:55.455 INFO:tasks.workunit.client.1.smithi089.stdout:1/391: symlink d0/d9/d15/d2b/d7d/l8b 0 2024-08-01T06:55:55.456 INFO:tasks.workunit.client.1.smithi089.stdout:5/260: truncate f0 3160946 0 2024-08-01T06:55:55.459 INFO:tasks.workunit.client.1.smithi089.stdout:4/370: symlink d3/l76 0 2024-08-01T06:55:55.459 INFO:tasks.workunit.client.1.smithi089.stdout:9/318: link d18/c29 d18/d22/d52/c65 0 2024-08-01T06:55:55.460 INFO:tasks.workunit.client.1.smithi089.stdout:9/319: write d18/f1d [91837,101785] 0 2024-08-01T06:55:55.462 INFO:tasks.workunit.client.1.smithi089.stdout:3/225: creat d7/d32/d12/d29/d39/f3e x:0 0 0 2024-08-01T06:55:55.464 INFO:tasks.workunit.client.1.smithi089.stdout:5/261: creat d5/d13/d38/d42/f55 x:0 0 0 2024-08-01T06:55:55.465 INFO:tasks.workunit.client.1.smithi089.stdout:2/289: rmdir d7 39 2024-08-01T06:55:55.467 INFO:tasks.workunit.client.1.smithi089.stdout:4/371: write d3/db/d16/f18 [9161138,15648] 0 2024-08-01T06:55:55.470 INFO:tasks.workunit.client.1.smithi089.stdout:1/392: rename d0/d9/d43/c5a to d0/d9/d15/d7a/c8c 0 2024-08-01T06:55:55.472 INFO:tasks.workunit.client.1.smithi089.stdout:3/226: rename d7/d32/d12/d29/c35 to d7/d32/d12/d29/c3f 0 2024-08-01T06:55:55.473 INFO:tasks.workunit.client.1.smithi089.stdout:5/262: creat d5/de/d10/d33/f56 x:0 0 0 2024-08-01T06:55:55.474 INFO:tasks.workunit.client.1.smithi089.stdout:3/227: dread - d7/d32/d12/d1b/f3c zero size 2024-08-01T06:55:55.476 INFO:tasks.workunit.client.1.smithi089.stdout:8/312: rename d5/ca to d5/c6b 0 2024-08-01T06:55:55.476 INFO:tasks.workunit.client.1.smithi089.stdout:9/320: chown d18/c29 21264 1 2024-08-01T06:55:55.478 INFO:tasks.workunit.client.1.smithi089.stdout:1/393: dwrite d0/d9/d15/f6b [0,4194304] 0 2024-08-01T06:55:55.479 INFO:tasks.workunit.client.1.smithi089.stdout:1/394: stat d0/d9/d15/d2d/d4a/d61/l79 0 2024-08-01T06:55:55.484 INFO:tasks.workunit.client.1.smithi089.stdout:4/372: dread d3/d17/d3a/f54 [0,4194304] 0 2024-08-01T06:55:55.485 INFO:tasks.workunit.client.1.smithi089.stdout:9/321: write f13 [2012601,81083] 0 2024-08-01T06:55:55.485 INFO:tasks.workunit.client.1.smithi089.stdout:4/373: fsync d3/d17/d3a/d4a/f55 0 2024-08-01T06:55:55.486 INFO:tasks.workunit.client.1.smithi089.stdout:8/313: symlink d5/d15/d58/l6c 0 2024-08-01T06:55:55.486 INFO:tasks.workunit.client.1.smithi089.stdout:9/322: chown d18/d22/f57 1640 1 2024-08-01T06:55:55.487 INFO:tasks.workunit.client.1.smithi089.stdout:5/263: mkdir d5/de/d57 0 2024-08-01T06:55:55.488 INFO:tasks.workunit.client.1.smithi089.stdout:4/374: write d3/d1e/d21/d26/f38 [1519846,125839] 0 2024-08-01T06:55:55.489 INFO:tasks.workunit.client.1.smithi089.stdout:3/228: symlink d7/d32/d23/d31/d3d/l40 0 2024-08-01T06:55:55.497 INFO:tasks.workunit.client.1.smithi089.stdout:5/264: symlink d5/de/d10/d16/d1b/l58 0 2024-08-01T06:55:55.498 INFO:tasks.workunit.client.1.smithi089.stdout:3/229: unlink d7/d32/d12/c3a 0 2024-08-01T06:55:55.498 INFO:tasks.workunit.client.1.smithi089.stdout:1/395: dread d0/d9/d15/d2d/d4a/d4d/f50 [0,4194304] 0 2024-08-01T06:55:55.498 INFO:tasks.workunit.client.1.smithi089.stdout:3/230: chown d7/d32/f2d 12033 1 2024-08-01T06:55:55.499 INFO:tasks.workunit.client.1.smithi089.stdout:8/314: creat d5/d23/f6d x:0 0 0 2024-08-01T06:55:55.499 INFO:tasks.workunit.client.1.smithi089.stdout:1/396: stat d0/d9/d43/d78 0 2024-08-01T06:55:55.504 INFO:tasks.workunit.client.1.smithi089.stdout:5/265: dwrite d5/de/d10/f19 [0,4194304] 0 2024-08-01T06:55:55.506 INFO:tasks.workunit.client.1.smithi089.stdout:4/375: fdatasync d3/d1f/d62/f2a 0 2024-08-01T06:55:55.506 INFO:tasks.workunit.client.1.smithi089.stdout:4/376: write d3/d1e/f40 [4779070,95115] 0 2024-08-01T06:55:55.512 INFO:tasks.workunit.client.1.smithi089.stdout:3/231: rename d7/d32/d12/d29/d39/f3e to d7/d32/d12/f41 0 2024-08-01T06:55:55.513 INFO:tasks.workunit.client.1.smithi089.stdout:5/266: dwrite d5/d13/d38/d42/f55 [0,4194304] 0 2024-08-01T06:55:55.513 INFO:tasks.workunit.client.1.smithi089.stdout:3/232: dread - d7/d32/d12/f33 zero size 2024-08-01T06:55:55.514 INFO:tasks.workunit.client.1.smithi089.stdout:9/323: getdents d18/d22/d45 0 2024-08-01T06:55:55.520 INFO:tasks.workunit.client.1.smithi089.stdout:8/315: dread d5/f29 [0,4194304] 0 2024-08-01T06:55:55.525 INFO:tasks.workunit.client.1.smithi089.stdout:1/397: write d0/d9/d15/d3b/f3c [237450,5467] 0 2024-08-01T06:55:55.527 INFO:tasks.workunit.client.1.smithi089.stdout:9/324: write d18/d3d/d55/f56 [366516,117206] 0 2024-08-01T06:55:55.528 INFO:tasks.workunit.client.1.smithi089.stdout:3/233: truncate d7/dd/f15 1375913 0 2024-08-01T06:55:55.534 INFO:tasks.workunit.client.1.smithi089.stdout:1/398: dwrite d0/d6c/d49/f65 [4194304,4194304] 0 2024-08-01T06:55:55.537 INFO:tasks.workunit.client.1.smithi089.stdout:5/267: creat d5/de/f59 x:0 0 0 2024-08-01T06:55:55.537 INFO:tasks.workunit.client.1.smithi089.stdout:1/399: readlink d0/d9/d15/d2d/d4a/l48 0 2024-08-01T06:55:55.537 INFO:tasks.workunit.client.1.smithi089.stdout:3/234: rename l4 to d7/d32/d12/d1b/l42 0 2024-08-01T06:55:55.540 INFO:tasks.workunit.client.1.smithi089.stdout:4/377: dwrite d3/db/d16/f9 [0,4194304] 0 2024-08-01T06:55:55.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.539+0000 7f05b82e6640 1 -- 172.21.15.16:0/1185299140 --> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0594000bf0 con 0x7f059c06d660 2024-08-01T06:55:55.541 INFO:tasks.workunit.client.1.smithi089.stdout:5/268: mknod d5/de/d10/d33/c5a 0 2024-08-01T06:55:55.543 INFO:tasks.workunit.client.1.smithi089.stdout:4/378: write d3/d17/d3a/f63 [3349084,81885] 0 2024-08-01T06:55:55.544 INFO:tasks.workunit.client.1.smithi089.stdout:3/235: mknod d7/d32/d12/d29/c43 0 2024-08-01T06:55:55.546 INFO:tasks.workunit.client.1.smithi089.stdout:4/379: creat d3/d1f/d62/d31/f77 x:0 0 0 2024-08-01T06:55:55.549 INFO:tasks.workunit.client.1.smithi089.stdout:1/400: getdents d0/d9/d43 0 2024-08-01T06:55:55.549 INFO:tasks.workunit.client.1.smithi089.stdout:1/401: readlink d0/d9/d15/d2b/l7c 0 2024-08-01T06:55:55.550 INFO:tasks.workunit.client.1.smithi089.stdout:4/380: symlink d3/d1f/d62/d31/l78 0 2024-08-01T06:55:55.552 INFO:tasks.workunit.client.1.smithi089.stdout:3/236: truncate d7/d32/f13 688758 0 2024-08-01T06:55:55.553 INFO:tasks.workunit.client.1.smithi089.stdout:4/381: symlink d3/d1f/d62/d3b/l79 0 2024-08-01T06:55:55.553 INFO:tasks.workunit.client.1.smithi089.stdout:1/402: getdents d0/d6c/d49/d82 0 2024-08-01T06:55:55.554 INFO:tasks.workunit.client.1.smithi089.stdout:4/382: write d3/d1f/d62/f64 [2530807,51218] 0 2024-08-01T06:55:55.556 INFO:tasks.workunit.client.1.smithi089.stdout:4/383: write d3/db/d33/f6f [4027960,65532] 0 2024-08-01T06:55:55.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.556+0000 7f05a77fe640 1 -- 172.21.15.16:0/1185299140 <== mgr.24423 v2:172.21.15.89:6828/2589785296 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f0594000bf0 con 0x7f059c06d660 2024-08-01T06:55:55.558 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T06:55:55.558 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (6m) 4s ago 7m 25.3M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T06:55:55.558 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (8m) 4s ago 8m 7906k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T06:55:55.558 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (7m) 1s ago 7m 7818k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T06:55:55.558 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (8m) 4s ago 8m 6895k - 18.2.2-1767-ga3bbd728 d280790d1980 81c723a6ae35 2024-08-01T06:55:55.558 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (7m) 1s ago 7m 6891k - 18.2.2-1767-ga3bbd728 d280790d1980 73e7778d1e26 2024-08-01T06:55:55.558 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (6m) 4s ago 7m 86.2M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T06:55:55.558 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (2m) 4s ago 2m 92.8M - 18.2.2-1767-ga3bbd728 d280790d1980 96e46c28d16c 2024-08-01T06:55:55.558 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (2m) 4s ago 2m 151M - 18.2.2-1767-ga3bbd728 d280790d1980 4bbe1a388689 2024-08-01T06:55:55.558 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (2m) 1s ago 2m 21.5M - 18.2.2-1767-ga3bbd728 d280790d1980 65ca121a6fbb 2024-08-01T06:55:55.559 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (2m) 1s ago 2m 20.7M - 18.2.2-1767-ga3bbd728 d280790d1980 05bb46c6fe94 2024-08-01T06:55:55.559 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:9283,8765,8443 running (9m) 4s ago 9m 202M - 18.2.2-1767-ga3bbd728 d280790d1980 3cf8ca2d43c6 2024-08-01T06:55:55.559 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (28s) 1s ago 7m 476M - 19.1.0-1223-gf9911e17 93d93c74a2cc 175fc6a24b65 2024-08-01T06:55:55.559 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (9m) 4s ago 9m 53.4M 2048M 18.2.2-1767-ga3bbd728 d280790d1980 e6a2e5d7eeec 2024-08-01T06:55:55.559 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (6m) 1s ago 6m 42.9M 2048M 18.2.2-1767-ga3bbd728 d280790d1980 9ca9e3e814cb 2024-08-01T06:55:55.559 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (8m) 4s ago 8m 15.8M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T06:55:55.559 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (7m) 1s ago 7m 16.5M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T06:55:55.559 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (6m) 4s ago 6m 114M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 9b7157499583 2024-08-01T06:55:55.559 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (5m) 4s ago 5m 124M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 f3b050aed6b7 2024-08-01T06:55:55.559 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (5m) 4s ago 5m 111M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 33a72e1a5c91 2024-08-01T06:55:55.559 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (4m) 1s ago 4m 125M 4970M 18.2.2-1767-ga3bbd728 d280790d1980 58c175e0f4eb 2024-08-01T06:55:55.560 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (4m) 1s ago 4m 123M 4970M 18.2.2-1767-ga3bbd728 d280790d1980 15b8f910bad7 2024-08-01T06:55:55.560 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (4m) 1s ago 4m 116M 4970M 18.2.2-1767-ga3bbd728 d280790d1980 ac887841899e 2024-08-01T06:55:55.560 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (6m) 4s ago 7m 64.5M - 2.43.0 a07b618ecd1d 2b370118fafe 2024-08-01T06:55:55.560 INFO:tasks.workunit.client.1.smithi089.stdout:1/403: chown d0/d9/d15/d2d/d4a/c83 5049 1 2024-08-01T06:55:55.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.559+0000 7f05b82e6640 1 -- 172.21.15.16:0/1185299140 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f059c06d660 msgr2=0x7f059c06fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:55.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.559+0000 7f05b82e6640 1 --2- 172.21.15.16:0/1185299140 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f059c06d660 0x7f059c06fb20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f05b00fe4c0 tx=0x7f05a000a3b0 comp rx=0 tx=0).stop 2024-08-01T06:55:55.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.559+0000 7f05b82e6640 1 -- 172.21.15.16:0/1185299140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05b00fecb0 msgr2=0x7f05b00fe740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:55.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.559+0000 7f05b82e6640 1 --2- 172.21.15.16:0/1185299140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05b00fecb0 0x7f05b00fe740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f05ac02a9c0 tx=0x7f05ac005610 comp rx=0 tx=0).stop 2024-08-01T06:55:55.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.559+0000 7f05b82e6640 1 -- 172.21.15.16:0/1185299140 shutdown_connections 2024-08-01T06:55:55.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.559+0000 7f05b82e6640 1 --2- 172.21.15.16:0/1185299140 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f059c06d660 0x7f059c06fb20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:55.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.559+0000 7f05b82e6640 1 --2- 172.21.15.16:0/1185299140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b01000e0 0x7f05b019a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:55.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.559+0000 7f05b82e6640 1 --2- 172.21.15.16:0/1185299140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05b00fecb0 0x7f05b00fe740 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:55.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.559+0000 7f05b82e6640 1 -- 172.21.15.16:0/1185299140 >> 172.21.15.16:0/1185299140 conn(0x7f05b00f9950 msgr2=0x7f05b0102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:55.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.559+0000 7f05b82e6640 1 -- 172.21.15.16:0/1185299140 shutdown_connections 2024-08-01T06:55:55.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.560+0000 7f05b82e6640 1 -- 172.21.15.16:0/1185299140 wait complete. 2024-08-01T06:55:55.563 INFO:tasks.workunit.client.1.smithi089.stdout:4/384: mknod d3/db/d42/c7a 0 2024-08-01T06:55:55.565 INFO:tasks.workunit.client.1.smithi089.stdout:1/404: dwrite d0/f20 [0,4194304] 0 2024-08-01T06:55:55.571 INFO:tasks.workunit.client.1.smithi089.stdout:3/237: dread d7/dd/f2e [0,4194304] 0 2024-08-01T06:55:55.571 INFO:tasks.workunit.client.1.smithi089.stdout:1/405: creat d0/d6c/d49/f8d x:0 0 0 2024-08-01T06:55:55.575 INFO:tasks.workunit.client.1.smithi089.stdout:4/385: rename d3/d1e/d21/d26/c46 to d3/db/c7b 0 2024-08-01T06:55:55.576 INFO:tasks.workunit.client.1.smithi089.stdout:3/238: mknod d7/d32/d23/d2f/c44 0 2024-08-01T06:55:55.576 INFO:tasks.workunit.client.1.smithi089.stdout:1/406: dwrite d0/f20 [0,4194304] 0 2024-08-01T06:55:55.578 INFO:tasks.workunit.client.1.smithi089.stdout:3/239: dread d7/f1f [0,4194304] 0 2024-08-01T06:55:55.579 INFO:tasks.workunit.client.1.smithi089.stdout:4/386: creat d3/d1f/f7c x:0 0 0 2024-08-01T06:55:55.580 INFO:tasks.workunit.client.1.smithi089.stdout:1/407: fdatasync d0/d9/d15/f34 0 2024-08-01T06:55:55.583 INFO:tasks.workunit.client.1.smithi089.stdout:4/387: fsync d3/d1f/d62/f2a 0 2024-08-01T06:55:55.589 INFO:tasks.workunit.client.1.smithi089.stdout:1/408: dwrite d0/d9/d15/d2d/d4a/d4d/f5d [0,4194304] 0 2024-08-01T06:55:55.592 INFO:tasks.workunit.client.1.smithi089.stdout:4/388: dwrite d3/d17/d3a/f5d [4194304,4194304] 0 2024-08-01T06:55:55.592 INFO:tasks.workunit.client.1.smithi089.stdout:1/409: truncate d0/d9/d15/d3b/d3d/f8a 973705 0 2024-08-01T06:55:55.594 INFO:tasks.workunit.client.1.smithi089.stdout:1/410: chown d0/d9/d15/d2d/d4a/f55 967 1 2024-08-01T06:55:55.600 INFO:tasks.workunit.client.1.smithi089.stdout:1/411: dread d0/d9/d15/f6b [0,4194304] 0 2024-08-01T06:55:55.602 INFO:tasks.workunit.client.1.smithi089.stdout:4/389: getdents d3/d1f/d62 0 2024-08-01T06:55:55.604 INFO:tasks.workunit.client.1.smithi089.stdout:1/412: chown d0/d9/d15/d2d/d4a/f47 110998 1 2024-08-01T06:55:55.605 INFO:tasks.workunit.client.1.smithi089.stdout:4/390: mknod d3/d1f/d62/d31/c7d 0 2024-08-01T06:55:55.606 INFO:tasks.workunit.client.1.smithi089.stdout:4/391: fdatasync d3/d1f/d62/f37 0 2024-08-01T06:55:55.608 INFO:tasks.workunit.client.1.smithi089.stdout:4/392: mkdir d3/d68/d7e 0 2024-08-01T06:55:55.610 INFO:tasks.workunit.client.1.smithi089.stdout:4/393: write d3/d17/d3a/f63 [2689599,81337] 0 2024-08-01T06:55:55.611 INFO:tasks.workunit.client.1.smithi089.stdout:1/413: dwrite d0/d9/d15/d2d/d4a/d4d/f6d [0,4194304] 0 2024-08-01T06:55:55.619 INFO:tasks.workunit.client.1.smithi089.stdout:3/240: dwrite d7/dd/f15 [0,4194304] 0 2024-08-01T06:55:55.622 INFO:tasks.workunit.client.1.smithi089.stdout:4/394: dwrite d3/d17/d3a/f54 [0,4194304] 0 2024-08-01T06:55:55.630 INFO:tasks.workunit.client.1.smithi089.stdout:4/395: dwrite d3/db/d16/f1a [4194304,4194304] 0 2024-08-01T06:55:55.634 INFO:tasks.workunit.client.1.smithi089.stdout:4/396: creat d3/d68/f7f x:0 0 0 2024-08-01T06:55:55.635 INFO:tasks.workunit.client.1.smithi089.stdout:3/241: rename d7/d32/d23/d2f/c30 to d7/dd/c45 0 2024-08-01T06:55:55.635 INFO:tasks.workunit.client.1.smithi089.stdout:4/397: dread - d3/d1f/d62/d31/f77 zero size 2024-08-01T06:55:55.638 INFO:tasks.workunit.client.1.smithi089.stdout:3/242: mkdir d7/d32/d23/d46 0 2024-08-01T06:55:55.639 INFO:tasks.workunit.client.1.smithi089.stdout:3/243: fsync d7/d32/d12/f33 0 2024-08-01T06:55:55.640 INFO:tasks.workunit.client.1.smithi089.stdout:4/398: unlink d3/d1e/d21/f45 0 2024-08-01T06:55:55.641 INFO:tasks.workunit.client.1.smithi089.stdout:4/399: write d3/d1f/f7c [1015496,78078] 0 2024-08-01T06:55:55.643 INFO:tasks.workunit.client.1.smithi089.stdout:3/244: mkdir d7/d32/d23/d46/d47 0 2024-08-01T06:55:55.646 INFO:tasks.workunit.client.1.smithi089.stdout:4/400: dwrite d3/d1e/f58 [0,4194304] 0 2024-08-01T06:55:55.648 INFO:tasks.workunit.client.1.smithi089.stdout:4/401: write d3/db/d16/f18 [193704,90465] 0 2024-08-01T06:55:55.649 INFO:tasks.workunit.client.1.smithi089.stdout:4/402: read d3/d1e/d21/d26/f61 [6019373,13069] 0 2024-08-01T06:55:55.654 INFO:tasks.workunit.client.1.smithi089.stdout:4/403: dwrite d3/d1f/d62/f37 [0,4194304] 0 2024-08-01T06:55:55.658 INFO:tasks.workunit.client.1.smithi089.stdout:4/404: stat d3/d1e/f6e 0 2024-08-01T06:55:55.664 INFO:tasks.workunit.client.1.smithi089.stdout:4/405: dwrite d3/db/f39 [4194304,4194304] 0 2024-08-01T06:55:55.670 INFO:tasks.workunit.client.1.smithi089.stdout:4/406: getdents d3/d17/d3a/d3d 0 2024-08-01T06:55:55.672 INFO:tasks.workunit.client.1.smithi089.stdout:4/407: creat d3/d1e/d21/d57/f80 x:0 0 0 2024-08-01T06:55:55.678 INFO:tasks.workunit.client.1.smithi089.stdout:4/408: dwrite d3/db/d33/f56 [0,4194304] 0 2024-08-01T06:55:55.682 INFO:tasks.workunit.client.1.smithi089.stdout:6/398: sync 2024-08-01T06:55:55.683 INFO:tasks.workunit.client.1.smithi089.stdout:4/409: mknod d3/d1e/d21/c81 0 2024-08-01T06:55:55.687 INFO:tasks.workunit.client.1.smithi089.stdout:6/399: dwrite d2/ff [4194304,4194304] 0 2024-08-01T06:55:55.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.700+0000 7fdbc9d4a640 1 -- 172.21.15.16:0/2768681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbc4071430 msgr2=0x7fdbc4071830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:55.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.700+0000 7fdbc9d4a640 1 --2- 172.21.15.16:0/2768681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbc4071430 0x7fdbc4071830 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc009880 tx=0x7fdbbc02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:55:55.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.700+0000 7fdbc9d4a640 1 -- 172.21.15.16:0/2768681 shutdown_connections 2024-08-01T06:55:55.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.700+0000 7fdbc9d4a640 1 --2- 172.21.15.16:0/2768681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbc41074b0 0x7fdbc4107930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:55.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.700+0000 7fdbc9d4a640 1 --2- 172.21.15.16:0/2768681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbc4071430 0x7fdbc4071830 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:55.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.700+0000 7fdbc9d4a640 1 -- 172.21.15.16:0/2768681 >> 172.21.15.16:0/2768681 conn(0x7fdbc406cc10 msgr2=0x7fdbc406f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:55.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.700+0000 7fdbc9d4a640 1 -- 172.21.15.16:0/2768681 shutdown_connections 2024-08-01T06:55:55.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.700+0000 7fdbc9d4a640 1 -- 172.21.15.16:0/2768681 wait complete. 2024-08-01T06:55:55.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.701+0000 7fdbc9d4a640 1 Processor -- start 2024-08-01T06:55:55.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.701+0000 7fdbc9d4a640 1 -- start start 2024-08-01T06:55:55.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.702+0000 7fdbc9d4a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbc4071430 0x7fdbc41a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:55.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.702+0000 7fdbc9d4a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbc41074b0 0x7fdbc41a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:55.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.702+0000 7fdbc9d4a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc41a4f20 con 0x7fdbc4071430 2024-08-01T06:55:55.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.702+0000 7fdbc9d4a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc41a5090 con 0x7fdbc41074b0 2024-08-01T06:55:55.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.702+0000 7fdbc37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbc4071430 0x7fdbc41a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:55.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.702+0000 7fdbc37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbc4071430 0x7fdbc41a4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53626/0 (socket says 172.21.15.16:53626) 2024-08-01T06:55:55.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.702+0000 7fdbc37fe640 1 -- 172.21.15.16:0/3439563304 learned_addr learned my addr 172.21.15.16:0/3439563304 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:55:55.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.702+0000 7fdbc2ffd640 1 --2- 172.21.15.16:0/3439563304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbc41074b0 0x7fdbc41a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:55.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.702+0000 7fdbc37fe640 1 -- 172.21.15.16:0/3439563304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbc41074b0 msgr2=0x7fdbc41a4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:55.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.702+0000 7fdbc37fe640 1 --2- 172.21.15.16:0/3439563304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbc41074b0 0x7fdbc41a4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:55.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.702+0000 7fdbc37fe640 1 -- 172.21.15.16:0/3439563304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc009560 con 0x7fdbc4071430 2024-08-01T06:55:55.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.703+0000 7fdbc37fe640 1 --2- 172.21.15.16:0/3439563304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbc4071430 0x7fdbc41a4410 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0054f0 tx=0x7fdbbc005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:55.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.703+0000 7fdbc0ff9640 1 -- 172.21.15.16:0/3439563304 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbbc004aa0 con 0x7fdbc4071430 2024-08-01T06:55:55.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.703+0000 7fdbc9d4a640 1 -- 172.21.15.16:0/3439563304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc41a9ad0 con 0x7fdbc4071430 2024-08-01T06:55:55.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.703+0000 7fdbc9d4a640 1 -- 172.21.15.16:0/3439563304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc41aa040 con 0x7fdbc4071430 2024-08-01T06:55:55.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.704+0000 7fdbc0ff9640 1 -- 172.21.15.16:0/3439563304 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdbbc004c00 con 0x7fdbc4071430 2024-08-01T06:55:55.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.704+0000 7fdbc0ff9640 1 -- 172.21.15.16:0/3439563304 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbbc003ac0 con 0x7fdbc4071430 2024-08-01T06:55:55.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.705+0000 7fdbc9d4a640 1 -- 172.21.15.16:0/3439563304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba4005280 con 0x7fdbc4071430 2024-08-01T06:55:55.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.706+0000 7fdbc0ff9640 1 -- 172.21.15.16:0/3439563304 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) v1 ==== 91559+0+0 (secure 0 0 0) 0x7fdbbc003c20 con 0x7fdbc4071430 2024-08-01T06:55:55.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.707+0000 7fdbc0ff9640 1 --2- 172.21.15.16:0/3439563304 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fdbb006d690 0x7fdbb006fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:55.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.707+0000 7fdbc0ff9640 1 -- 172.21.15.16:0/3439563304 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fdbbc0ae100 con 0x7fdbc4071430 2024-08-01T06:55:55.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.707+0000 7fdbc2ffd640 1 --2- 172.21.15.16:0/3439563304 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fdbb006d690 0x7fdbb006fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:55.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.708+0000 7fdbc2ffd640 1 --2- 172.21.15.16:0/3439563304 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fdbb006d690 0x7fdbb006fb50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdbc41a5930 tx=0x7fdbb4009680 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:55.710 INFO:tasks.workunit.client.1.smithi089.stdout:6/400: truncate d2/d11/d1a/f29 2413507 0 2024-08-01T06:55:55.713 INFO:tasks.workunit.client.1.smithi089.stdout:6/401: symlink d2/d11/d1f/d46/d86/l90 0 2024-08-01T06:55:55.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:55.713+0000 7fdbc0ff9640 1 -- 172.21.15.16:0/3439563304 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fdbbc077a10 con 0x7fdbc4071430 2024-08-01T06:55:55.715 INFO:tasks.workunit.client.1.smithi089.stdout:6/402: mkdir d2/d2e/d2f/d91 0 2024-08-01T06:55:55.718 INFO:tasks.workunit.client.1.smithi089.stdout:6/403: rename d2/d11/l34 to d2/d2e/d7c/l92 0 2024-08-01T06:55:55.721 INFO:tasks.workunit.client.1.smithi089.stdout:6/404: creat d2/d11/d1f/d46/d6b/d7d/f93 x:0 0 0 2024-08-01T06:55:55.727 INFO:tasks.workunit.client.1.smithi089.stdout:6/405: dwrite d2/f75 [0,4194304] 0 2024-08-01T06:55:55.734 INFO:tasks.workunit.client.1.smithi089.stdout:6/406: link d2/d11/f15 d2/d30/d3c/d3d/f94 0 2024-08-01T06:55:55.739 INFO:tasks.workunit.client.1.smithi089.stdout:6/407: rename d2/d30/d3c/d3d/f7b to d2/d2e/d7c/f95 0 2024-08-01T06:55:55.756 INFO:tasks.workunit.client.1.smithi089.stdout:6/408: truncate d2/d30/f73 3437773 0 2024-08-01T06:55:55.762 INFO:tasks.workunit.client.1.smithi089.stdout:6/409: dwrite d2/d11/d1f/d46/d6b/d7d/f93 [0,4194304] 0 2024-08-01T06:55:55.768 INFO:tasks.workunit.client.1.smithi089.stdout:6/410: truncate d2/f2b 44625 0 2024-08-01T06:55:55.774 INFO:tasks.workunit.client.1.smithi089.stdout:6/411: link d2/d11/d1f/d46/c6f d2/d2e/d2f/d31/c96 0 2024-08-01T06:55:55.776 INFO:tasks.workunit.client.1.smithi089.stdout:6/412: mkdir d2/d11/d1f/d46/d86/d97 0 2024-08-01T06:55:55.788 INFO:tasks.workunit.client.1.smithi089.stdout:6/413: dread d2/d2e/d2f/d31/f41 [0,4194304] 0 2024-08-01T06:55:55.797 INFO:tasks.workunit.client.1.smithi089.stdout:6/414: dwrite d2/d11/f1d [0,4194304] 0 2024-08-01T06:55:55.799 INFO:tasks.workunit.client.1.smithi089.stdout:6/415: rmdir d2/d2e 39 2024-08-01T06:55:55.827 INFO:tasks.workunit.client.1.smithi089.stdout:0/365: sync 2024-08-01T06:55:55.830 INFO:tasks.workunit.client.1.smithi089.stdout:0/366: mknod d9/d40/d26/d2e/d3a/c78 0 2024-08-01T06:55:55.843 INFO:tasks.workunit.client.1.smithi089.stdout:0/367: dread d9/f5e [0,4194304] 0 2024-08-01T06:55:55.846 INFO:tasks.workunit.client.1.smithi089.stdout:0/368: getdents d9/d40/d26/d2e/d44/d53 0 2024-08-01T06:55:55.852 INFO:tasks.workunit.client.1.smithi089.stdout:0/369: truncate d9/f77 1817616 0 2024-08-01T06:55:55.853 INFO:tasks.workunit.client.1.smithi089.stdout:0/370: truncate d9/f17 1054150 0 2024-08-01T06:55:55.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:55 smithi016 ceph-mon[29266]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:55:55.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:55 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:55.905 INFO:tasks.workunit.client.1.smithi089.stdout:0/371: dread - d9/d40/d26/d64/f6a zero size 2024-08-01T06:55:55.911 INFO:tasks.workunit.client.1.smithi089.stdout:0/372: dwrite d9/fa [4194304,4194304] 0 2024-08-01T06:55:55.914 INFO:tasks.workunit.client.1.smithi089.stdout:0/373: creat d9/d40/d26/f79 x:0 0 0 2024-08-01T06:55:55.916 INFO:tasks.workunit.client.1.smithi089.stdout:0/374: write d9/d40/d26/d64/f6a [665973,125450] 0 2024-08-01T06:55:55.923 INFO:tasks.workunit.client.1.smithi089.stdout:0/375: dwrite d9/d40/d26/f69 [0,4194304] 0 2024-08-01T06:55:55.928 INFO:tasks.workunit.client.1.smithi089.stdout:0/376: rename d9/d22/d2b/d55/d62 to d9/d22/d2b/d55/d7a 0 2024-08-01T06:55:55.931 INFO:tasks.workunit.client.1.smithi089.stdout:0/377: mknod d9/d22/d2b/d55/d7a/c7b 0 2024-08-01T06:55:55.936 INFO:tasks.workunit.client.1.smithi089.stdout:0/378: dwrite d9/d40/d26/f79 [0,4194304] 0 2024-08-01T06:55:55.940 INFO:tasks.workunit.client.1.smithi089.stdout:0/379: link c6 d9/d40/d45/c7c 0 2024-08-01T06:55:55.941 INFO:tasks.workunit.client.1.smithi089.stdout:0/380: chown d9/d22/d2b/d55 50128994 1 2024-08-01T06:55:55.945 INFO:tasks.workunit.client.1.smithi089.stdout:0/381: rename d9/d40/d25/d46/c60 to d9/d22/d2b/d55/c7d 0 2024-08-01T06:55:55.945 INFO:tasks.workunit.client.1.smithi089.stdout:0/382: chown d9/d40/d26/d2e/f36 212072 1 2024-08-01T06:55:55.951 INFO:tasks.workunit.client.1.smithi089.stdout:0/383: dwrite d9/f33 [0,4194304] 0 2024-08-01T06:55:55.951 INFO:tasks.workunit.client.1.smithi089.stdout:0/384: chown d9/l1b 525499126 1 2024-08-01T06:55:55.958 INFO:tasks.workunit.client.1.smithi089.stdout:0/385: dwrite d9/d40/d45/d47/f5c [0,4194304] 0 2024-08-01T06:55:55.961 INFO:tasks.workunit.client.1.smithi089.stdout:0/386: unlink d9/f5e 0 2024-08-01T06:55:55.967 INFO:tasks.workunit.client.1.smithi089.stdout:0/387: rename d9/l1b to d9/d40/d26/d2e/d3a/d76/l7e 0 2024-08-01T06:55:55.970 INFO:tasks.workunit.client.1.smithi089.stdout:0/388: rename d9/d40/f71 to d9/d40/d25/f7f 0 2024-08-01T06:55:55.973 INFO:tasks.workunit.client.1.smithi089.stdout:0/389: creat d9/d22/d2b/f80 x:0 0 0 2024-08-01T06:55:55.973 INFO:tasks.workunit.client.1.smithi089.stdout:0/390: chown d9/d40/d26 693 1 2024-08-01T06:55:55.975 INFO:tasks.workunit.client.1.smithi089.stdout:0/391: unlink d9/f1f 0 2024-08-01T06:55:55.977 INFO:tasks.workunit.client.1.smithi089.stdout:0/392: write d9/d40/d26/f3f [1312759,4205] 0 2024-08-01T06:55:55.977 INFO:tasks.workunit.client.1.smithi089.stdout:0/393: dread - d9/d22/f5d zero size 2024-08-01T06:55:55.978 INFO:tasks.workunit.client.1.smithi089.stdout:0/394: chown d9/d40/c67 0 1 2024-08-01T06:55:55.982 INFO:tasks.workunit.client.1.smithi089.stdout:0/395: rename d9/d40/d25/d46/f38 to d9/d40/d26/d2e/f81 0 2024-08-01T06:55:55.983 INFO:tasks.workunit.client.1.smithi089.stdout:0/396: chown d9/d40/d26/d2e/l58 11 1 2024-08-01T06:55:55.986 INFO:tasks.workunit.client.1.smithi089.stdout:0/397: readlink d9/lc 0 2024-08-01T06:55:55.986 INFO:tasks.workunit.client.1.smithi089.stdout:0/398: chown d9/d40/d26 23 1 2024-08-01T06:55:55.999 INFO:tasks.workunit.client.1.smithi089.stdout:0/399: dread d9/d40/d26/d2e/f36 [0,4194304] 0 2024-08-01T06:55:56.000 INFO:tasks.workunit.client.1.smithi089.stdout:0/400: stat d9/d22/d2b/d55 0 2024-08-01T06:55:56.011 INFO:tasks.workunit.client.1.smithi089.stdout:0/401: dwrite d9/f33 [4194304,4194304] 0 2024-08-01T06:55:56.025 INFO:tasks.workunit.client.1.smithi089.stdout:0/402: dwrite d9/d22/d2b/d55/f68 [0,4194304] 0 2024-08-01T06:55:56.025 INFO:tasks.workunit.client.1.smithi089.stdout:7/286: sync 2024-08-01T06:55:56.025 INFO:tasks.workunit.client.1.smithi089.stdout:2/290: sync 2024-08-01T06:55:56.025 INFO:tasks.workunit.client.1.smithi089.stdout:8/316: sync 2024-08-01T06:55:56.025 INFO:tasks.workunit.client.1.smithi089.stdout:7/287: readlink d7/df/l27 0 2024-08-01T06:55:56.026 INFO:tasks.workunit.client.1.smithi089.stdout:8/317: rename d5/dc/d1e to d5/dc/d1e/d53/d6e 22 2024-08-01T06:55:56.026 INFO:tasks.workunit.client.1.smithi089.stdout:7/288: dread - d7/df/d10/f51 zero size 2024-08-01T06:55:56.027 INFO:tasks.workunit.client.1.smithi089.stdout:8/318: read - d5/dc/d1e/f47 zero size 2024-08-01T06:55:56.028 INFO:tasks.workunit.client.1.smithi089.stdout:0/403: creat d9/d22/d2b/f82 x:0 0 0 2024-08-01T06:55:56.029 INFO:tasks.workunit.client.1.smithi089.stdout:0/404: readlink d9/l15 0 2024-08-01T06:55:56.030 INFO:tasks.workunit.client.1.smithi089.stdout:2/291: symlink d7/d1f/d29/d48/l5a 0 2024-08-01T06:55:56.032 INFO:tasks.workunit.client.1.smithi089.stdout:2/292: rmdir d7/d19 39 2024-08-01T06:55:56.034 INFO:tasks.workunit.client.1.smithi089.stdout:2/293: fsync d7/fa 0 2024-08-01T06:55:56.036 INFO:tasks.workunit.client.1.smithi089.stdout:8/319: dwrite d5/d15/f1c [0,4194304] 0 2024-08-01T06:55:56.038 INFO:tasks.workunit.client.1.smithi089.stdout:0/405: dwrite d9/d22/f3e [0,4194304] 0 2024-08-01T06:55:56.038 INFO:tasks.workunit.client.1.smithi089.stdout:8/320: dread - d5/d23/f38 zero size 2024-08-01T06:55:56.039 INFO:tasks.workunit.client.1.smithi089.stdout:2/294: write d7/d19/d1e/f54 [71756,115823] 0 2024-08-01T06:55:56.041 INFO:tasks.workunit.client.1.smithi089.stdout:2/295: mkdir d7/d19/d1e/d5b 0 2024-08-01T06:55:56.048 INFO:tasks.workunit.client.1.smithi089.stdout:8/321: dwrite d5/dc/d12/f14 [0,4194304] 0 2024-08-01T06:55:56.049 INFO:tasks.workunit.client.1.smithi089.stdout:8/322: write d5/d23/f36 [4056805,21763] 0 2024-08-01T06:55:56.050 INFO:tasks.workunit.client.1.smithi089.stdout:8/323: stat d5/dc/f63 0 2024-08-01T06:55:56.054 INFO:tasks.workunit.client.1.smithi089.stdout:8/324: mknod d5/c6f 0 2024-08-01T06:55:56.057 INFO:tasks.workunit.client.1.smithi089.stdout:8/325: rmdir d5/dc/d1e/d53 39 2024-08-01T06:55:56.063 INFO:tasks.workunit.client.1.smithi089.stdout:8/326: dwrite d5/dc/f63 [0,4194304] 0 2024-08-01T06:55:56.065 INFO:tasks.workunit.client.1.smithi089.stdout:8/327: write d5/d23/f38 [533640,100491] 0 2024-08-01T06:55:56.065 INFO:tasks.workunit.client.1.smithi089.stdout:8/328: stat d5/d23/f38 0 2024-08-01T06:55:56.068 INFO:tasks.workunit.client.1.smithi089.stdout:8/329: rmdir d5/d15 39 2024-08-01T06:55:56.071 INFO:tasks.workunit.client.1.smithi089.stdout:2/296: dread d7/d19/d1e/f30 [0,4194304] 0 2024-08-01T06:55:56.075 INFO:tasks.workunit.client.1.smithi089.stdout:2/297: creat d7/d1f/d52/f5c x:0 0 0 2024-08-01T06:55:56.076 INFO:tasks.workunit.client.1.smithi089.stdout:2/298: write d7/d19/f44 [333843,61317] 0 2024-08-01T06:55:56.078 INFO:tasks.workunit.client.1.smithi089.stdout:2/299: mknod d7/d19/d1e/c5d 0 2024-08-01T06:55:56.081 INFO:tasks.workunit.client.1.smithi089.stdout:2/300: mknod d7/d1f/c5e 0 2024-08-01T06:55:56.084 INFO:tasks.workunit.client.1.smithi089.stdout:8/330: dwrite d5/f10 [0,4194304] 0 2024-08-01T06:55:56.090 INFO:tasks.workunit.client.1.smithi089.stdout:2/301: link d7/d19/d1e/l57 d7/d1f/d28/l5f 0 2024-08-01T06:55:56.097 INFO:tasks.workunit.client.1.smithi089.stdout:2/302: getdents d7/d19 0 2024-08-01T06:55:56.100 INFO:tasks.workunit.client.1.smithi089.stdout:2/303: mkdir d7/d19/d1e/d3d/d60 0 2024-08-01T06:55:56.104 INFO:tasks.workunit.client.1.smithi089.stdout:2/304: unlink d7/d1f/c34 0 2024-08-01T06:55:56.108 INFO:tasks.workunit.client.1.smithi089.stdout:2/305: link l1 d7/d19/l61 0 2024-08-01T06:55:56.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.115+0000 7fdbc9d4a640 1 -- 172.21.15.16:0/3439563304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdba4005800 con 0x7fdbc4071430 2024-08-01T06:55:56.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.116+0000 7fdbc0ff9640 1 -- 172.21.15.16:0/3439563304 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fdbbc07b0d0 con 0x7fdbc4071430 2024-08-01T06:55:56.118 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:55:56.118 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T06:55:56.118 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 2 2024-08-01T06:55:56.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:55:56.118 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T06:55:56.118 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 1, 2024-08-01T06:55:56.119 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 1 2024-08-01T06:55:56.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:55:56.119 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T06:55:56.119 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 6 2024-08-01T06:55:56.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:55:56.119 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T06:55:56.119 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4 2024-08-01T06:55:56.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:55:56.119 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T06:55:56.119 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 13, 2024-08-01T06:55:56.119 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 1 2024-08-01T06:55:56.119 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T06:55:56.119 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:55:56.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.119+0000 7fdbc9d4a640 1 -- 172.21.15.16:0/3439563304 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fdbb006d690 msgr2=0x7fdbb006fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:56.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.119+0000 7fdbc9d4a640 1 --2- 172.21.15.16:0/3439563304 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fdbb006d690 0x7fdbb006fb50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdbc41a5930 tx=0x7fdbb4009680 comp rx=0 tx=0).stop 2024-08-01T06:55:56.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.119+0000 7fdbc9d4a640 1 -- 172.21.15.16:0/3439563304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbc4071430 msgr2=0x7fdbc41a4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:56.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.119+0000 7fdbc9d4a640 1 --2- 172.21.15.16:0/3439563304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbc4071430 0x7fdbc41a4410 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0054f0 tx=0x7fdbbc005520 comp rx=0 tx=0).stop 2024-08-01T06:55:56.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.120+0000 7fdbc9d4a640 1 -- 172.21.15.16:0/3439563304 shutdown_connections 2024-08-01T06:55:56.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.120+0000 7fdbc9d4a640 1 --2- 172.21.15.16:0/3439563304 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fdbb006d690 0x7fdbb006fb50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:56.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.120+0000 7fdbc9d4a640 1 --2- 172.21.15.16:0/3439563304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbc41074b0 0x7fdbc41a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:56.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.120+0000 7fdbc9d4a640 1 --2- 172.21.15.16:0/3439563304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbc4071430 0x7fdbc41a4410 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:56.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.120+0000 7fdbc9d4a640 1 -- 172.21.15.16:0/3439563304 >> 172.21.15.16:0/3439563304 conn(0x7fdbc406cc10 msgr2=0x7fdbc4070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:56.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.120+0000 7fdbc9d4a640 1 -- 172.21.15.16:0/3439563304 shutdown_connections 2024-08-01T06:55:56.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.120+0000 7fdbc9d4a640 1 -- 172.21.15.16:0/3439563304 wait complete. 2024-08-01T06:55:56.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:55 smithi089 ceph-mon[36617]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:55:56.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:55 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:55:56.140 INFO:tasks.workunit.client.1.smithi089.stdout:5/269: sync 2024-08-01T06:55:56.140 INFO:tasks.workunit.client.1.smithi089.stdout:3/245: sync 2024-08-01T06:55:56.140 INFO:tasks.workunit.client.1.smithi089.stdout:1/414: sync 2024-08-01T06:55:56.140 INFO:tasks.workunit.client.1.smithi089.stdout:6/416: sync 2024-08-01T06:55:56.140 INFO:tasks.workunit.client.1.smithi089.stdout:4/410: sync 2024-08-01T06:55:56.140 INFO:tasks.workunit.client.1.smithi089.stdout:9/325: sync 2024-08-01T06:55:56.154 INFO:tasks.workunit.client.1.smithi089.stdout:2/306: truncate d7/d1f/d29/d48/f46 282816 0 2024-08-01T06:55:56.155 INFO:tasks.workunit.client.1.smithi089.stdout:6/417: fsync d2/d11/d1a/f6a 0 2024-08-01T06:55:56.156 INFO:tasks.workunit.client.1.smithi089.stdout:3/246: chown d7/d32/d23/d31/d3d 15570115 1 2024-08-01T06:55:56.156 INFO:tasks.workunit.client.1.smithi089.stdout:6/418: chown d2/d11/f15 137028 1 2024-08-01T06:55:56.157 INFO:tasks.workunit.client.1.smithi089.stdout:5/270: mknod d5/d13/d38/c5b 0 2024-08-01T06:55:56.158 INFO:tasks.workunit.client.1.smithi089.stdout:4/411: mknod d3/c82 0 2024-08-01T06:55:56.158 INFO:tasks.workunit.client.1.smithi089.stdout:9/326: dread d18/d33/d3b/f3c [0,4194304] 0 2024-08-01T06:55:56.159 INFO:tasks.workunit.client.1.smithi089.stdout:5/271: fdatasync d5/d13/d38/d42/f4b 0 2024-08-01T06:55:56.160 INFO:tasks.workunit.client.1.smithi089.stdout:3/247: read d7/f1f [32079,75009] 0 2024-08-01T06:55:56.161 INFO:tasks.workunit.client.1.smithi089.stdout:9/327: mknod d18/d22/d52/c66 0 2024-08-01T06:55:56.162 INFO:tasks.workunit.client.1.smithi089.stdout:4/412: unlink d3/d1f/d62/d31/f77 0 2024-08-01T06:55:56.163 INFO:tasks.workunit.client.1.smithi089.stdout:1/415: dwrite d0/d9/d15/d3b/d3d/f8a [0,4194304] 0 2024-08-01T06:55:56.163 INFO:tasks.workunit.client.1.smithi089.stdout:4/413: read - d3/d1e/f4e zero size 2024-08-01T06:55:56.164 INFO:tasks.workunit.client.1.smithi089.stdout:4/414: readlink d3/l11 0 2024-08-01T06:55:56.165 INFO:tasks.workunit.client.1.smithi089.stdout:5/272: symlink d5/de/d10/d16/d1b/l5c 0 2024-08-01T06:55:56.168 INFO:tasks.workunit.client.1.smithi089.stdout:3/248: creat d7/d32/d23/d2f/f48 x:0 0 0 2024-08-01T06:55:56.169 INFO:tasks.workunit.client.1.smithi089.stdout:9/328: mknod d18/d22/d45/c67 0 2024-08-01T06:55:56.171 INFO:tasks.workunit.client.1.smithi089.stdout:1/416: symlink d0/l8e 0 2024-08-01T06:55:56.172 INFO:tasks.workunit.client.1.smithi089.stdout:1/417: write d0/d9/d15/d2d/f3a [3706894,29954] 0 2024-08-01T06:55:56.176 INFO:tasks.workunit.client.1.smithi089.stdout:5/273: chown d5/de/d10/d16/d1b/d25/c40 3507 1 2024-08-01T06:55:56.176 INFO:tasks.workunit.client.1.smithi089.stdout:5/274: chown d5/d13/f31 339 1 2024-08-01T06:55:56.177 INFO:tasks.workunit.client.1.smithi089.stdout:5/275: truncate d5/de/f59 774018 0 2024-08-01T06:55:56.177 INFO:tasks.workunit.client.1.smithi089.stdout:3/249: fdatasync d7/dd/f1a 0 2024-08-01T06:55:56.179 INFO:tasks.workunit.client.1.smithi089.stdout:9/329: mknod d18/d22/d43/c68 0 2024-08-01T06:55:56.180 INFO:tasks.workunit.client.1.smithi089.stdout:1/418: chown d0/d6c/c26 5298244 1 2024-08-01T06:55:56.180 INFO:tasks.workunit.client.1.smithi089.stdout:1/419: chown d0/d9/d15/c38 16 1 2024-08-01T06:55:56.182 INFO:tasks.workunit.client.1.smithi089.stdout:6/419: rename d2/d11/d1f/d46/d86 to d2/d2e/d98 0 2024-08-01T06:55:56.189 INFO:tasks.workunit.client.1.smithi089.stdout:5/276: unlink d5/d13/d38/d42/f4b 0 2024-08-01T06:55:56.190 INFO:tasks.workunit.client.1.smithi089.stdout:6/420: dwrite d2/d11/f1d [0,4194304] 0 2024-08-01T06:55:56.190 INFO:tasks.workunit.client.1.smithi089.stdout:3/250: creat d7/d32/d23/f49 x:0 0 0 2024-08-01T06:55:56.190 INFO:tasks.workunit.client.1.smithi089.stdout:9/330: creat d18/d33/d3b/f69 x:0 0 0 2024-08-01T06:55:56.192 INFO:tasks.workunit.client.1.smithi089.stdout:1/420: write d0/f23 [5358995,12378] 0 2024-08-01T06:55:56.194 INFO:tasks.workunit.client.1.smithi089.stdout:4/415: dread d3/db/d16/f4f [0,4194304] 0 2024-08-01T06:55:56.196 INFO:tasks.workunit.client.1.smithi089.stdout:3/251: dread d7/dd/f1a [0,4194304] 0 2024-08-01T06:55:56.203 INFO:tasks.workunit.client.1.smithi089.stdout:5/277: mkdir d5/de/d10/d16/d1b/d52/d5d 0 2024-08-01T06:55:56.211 INFO:tasks.workunit.client.1.smithi089.stdout:4/416: symlink d3/db/de/d5b/l83 0 2024-08-01T06:55:56.212 INFO:tasks.workunit.client.1.smithi089.stdout:4/417: truncate d3/d1e/d21/d57/f80 442204 0 2024-08-01T06:55:56.214 INFO:tasks.workunit.client.1.smithi089.stdout:3/252: unlink d7/dd/f15 0 2024-08-01T06:55:56.216 INFO:tasks.workunit.client.1.smithi089.stdout:5/278: mkdir d5/de/d10/d33/d5e 0 2024-08-01T06:55:56.220 INFO:tasks.workunit.client.1.smithi089.stdout:1/421: mkdir d0/d9/d15/d3b/d3d/d77/d8f 0 2024-08-01T06:55:56.222 INFO:tasks.workunit.client.1.smithi089.stdout:4/418: readlink d3/db/d16/lc 0 2024-08-01T06:55:56.225 INFO:tasks.workunit.client.1.smithi089.stdout:1/422: dwrite d0/d9/d15/d3b/d3d/f85 [0,4194304] 0 2024-08-01T06:55:56.226 INFO:tasks.workunit.client.1.smithi089.stdout:1/423: stat d0/d9/d15/c38 0 2024-08-01T06:55:56.227 INFO:tasks.workunit.client.1.smithi089.stdout:1/424: chown d0/d9/d15/d2d/c58 27431 1 2024-08-01T06:55:56.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.226+0000 7f8f9dc8d640 1 -- 172.21.15.16:0/2510105627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f9810b790 msgr2=0x7f8f9810bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:56.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.226+0000 7f8f9dc8d640 1 --2- 172.21.15.16:0/2510105627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f9810b790 0x7f8f9810bc10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009880 tx=0x7f8f8c02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:55:56.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.226+0000 7f8f9dc8d640 1 -- 172.21.15.16:0/2510105627 shutdown_connections 2024-08-01T06:55:56.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.226+0000 7f8f9dc8d640 1 --2- 172.21.15.16:0/2510105627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f9810b790 0x7f8f9810bc10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:56.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.226+0000 7f8f9dc8d640 1 --2- 172.21.15.16:0/2510105627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f9810a8b0 0x7f8f9810acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:56.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.226+0000 7f8f9dc8d640 1 -- 172.21.15.16:0/2510105627 >> 172.21.15.16:0/2510105627 conn(0x7f8f98069fe0 msgr2=0x7f8f9806a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:56.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.226+0000 7f8f9dc8d640 1 -- 172.21.15.16:0/2510105627 shutdown_connections 2024-08-01T06:55:56.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.227+0000 7f8f9dc8d640 1 -- 172.21.15.16:0/2510105627 wait complete. 2024-08-01T06:55:56.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.227+0000 7f8f9dc8d640 1 Processor -- start 2024-08-01T06:55:56.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.228+0000 7f8f9dc8d640 1 -- start start 2024-08-01T06:55:56.229 INFO:tasks.workunit.client.1.smithi089.stdout:4/419: mknod d3/d1f/d62/d31/c84 0 2024-08-01T06:55:56.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.228+0000 7f8f9dc8d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f9810a8b0 0x7f8f981a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:56.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.228+0000 7f8f9dc8d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f9810b790 0x7f8f981a4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:56.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.228+0000 7f8f9dc8d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f981a4ee0 con 0x7f8f9810b790 2024-08-01T06:55:56.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.228+0000 7f8f9dc8d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f981a5050 con 0x7f8f9810a8b0 2024-08-01T06:55:56.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.229+0000 7f8f96ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f9810b790 0x7f8f981a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:56.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.229+0000 7f8f96ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f9810b790 0x7f8f981a4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53648/0 (socket says 172.21.15.16:53648) 2024-08-01T06:55:56.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.229+0000 7f8f96ffd640 1 -- 172.21.15.16:0/1548856165 learned_addr learned my addr 172.21.15.16:0/1548856165 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:55:56.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.229+0000 7f8f977fe640 1 --2- 172.21.15.16:0/1548856165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f9810a8b0 0x7f8f981a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:56.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.229+0000 7f8f96ffd640 1 -- 172.21.15.16:0/1548856165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f9810a8b0 msgr2=0x7f8f981a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:56.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.229+0000 7f8f96ffd640 1 --2- 172.21.15.16:0/1548856165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f9810a8b0 0x7f8f981a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:56.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.229+0000 7f8f96ffd640 1 -- 172.21.15.16:0/1548856165 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8c009560 con 0x7f8f9810b790 2024-08-01T06:55:56.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.230+0000 7f8f96ffd640 1 --2- 172.21.15.16:0/1548856165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f9810b790 0x7f8f981a4910 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0055a0 tx=0x7f8f8c0055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:56.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.230+0000 7f8f94ff9640 1 -- 172.21.15.16:0/1548856165 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f8c004aa0 con 0x7f8f9810b790 2024-08-01T06:55:56.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.230+0000 7f8f94ff9640 1 -- 172.21.15.16:0/1548856165 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f8c004c00 con 0x7f8f9810b790 2024-08-01T06:55:56.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.230+0000 7f8f94ff9640 1 -- 172.21.15.16:0/1548856165 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f8c003b10 con 0x7f8f9810b790 2024-08-01T06:55:56.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.230+0000 7f8f9dc8d640 1 -- 172.21.15.16:0/1548856165 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f981a9a90 con 0x7f8f9810b790 2024-08-01T06:55:56.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.231+0000 7f8f9dc8d640 1 -- 172.21.15.16:0/1548856165 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f981aa000 con 0x7f8f9810b790 2024-08-01T06:55:56.233 INFO:tasks.workunit.client.1.smithi089.stdout:9/331: link d18/d22/d39/c3e d18/d22/d39/d50/c6a 0 2024-08-01T06:55:56.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.232+0000 7f8f9dc8d640 1 -- 172.21.15.16:0/1548856165 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9806ce80 con 0x7f8f9810b790 2024-08-01T06:55:56.234 INFO:tasks.workunit.client.1.smithi089.stdout:9/332: chown d18/d22/l27 30 1 2024-08-01T06:55:56.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.234+0000 7f8f94ff9640 1 -- 172.21.15.16:0/1548856165 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) v1 ==== 91559+0+0 (secure 0 0 0) 0x7f8f8c003c70 con 0x7f8f9810b790 2024-08-01T06:55:56.236 INFO:tasks.workunit.client.1.smithi089.stdout:4/420: rmdir d3/db/d42 39 2024-08-01T06:55:56.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.236+0000 7f8f94ff9640 1 --2- 172.21.15.16:0/1548856165 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f8f8006d760 0x7f8f8006fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:56.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.236+0000 7f8f94ff9640 1 -- 172.21.15.16:0/1548856165 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f8f8c0ae130 con 0x7f8f9810b790 2024-08-01T06:55:56.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.236+0000 7f8f977fe640 1 --2- 172.21.15.16:0/1548856165 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f8f8006d760 0x7f8f8006fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:56.238 INFO:tasks.workunit.client.1.smithi089.stdout:9/333: write d18/d33/d3b/f3c [1362507,114094] 0 2024-08-01T06:55:56.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.237+0000 7f8f977fe640 1 --2- 172.21.15.16:0/1548856165 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f8f8006d760 0x7f8f8006fc20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8f9810b5f0 tx=0x7f8f88005f90 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:56.239 INFO:tasks.workunit.client.1.smithi089.stdout:1/425: creat d0/d9/d15/d3b/d3d/d77/d8f/f90 x:0 0 0 2024-08-01T06:55:56.239 INFO:tasks.workunit.client.1.smithi089.stdout:9/334: write d18/d22/f38 [2389755,100677] 0 2024-08-01T06:55:56.241 INFO:tasks.workunit.client.1.smithi089.stdout:4/421: symlink d3/d17/l85 0 2024-08-01T06:55:56.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.243+0000 7f8f94ff9640 1 -- 172.21.15.16:0/1548856165 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f8f8c077a40 con 0x7f8f9810b790 2024-08-01T06:55:56.245 INFO:tasks.workunit.client.1.smithi089.stdout:1/426: rename d0/d9/d15/d3b/d3d/c4f to d0/d6c/d49/c91 0 2024-08-01T06:55:56.252 INFO:tasks.workunit.client.1.smithi089.stdout:4/422: dread d3/d1f/d62/f64 [0,4194304] 0 2024-08-01T06:55:56.254 INFO:tasks.workunit.client.1.smithi089.stdout:4/423: chown d3/db/d16/f1a 5741 1 2024-08-01T06:55:56.254 INFO:tasks.workunit.client.1.smithi089.stdout:4/424: chown d3/d1f/d62/d31 28045579 1 2024-08-01T06:55:56.257 INFO:tasks.workunit.client.1.smithi089.stdout:4/425: dread d3/d17/d3a/f54 [0,4194304] 0 2024-08-01T06:55:56.259 INFO:tasks.workunit.client.1.smithi089.stdout:4/426: mkdir d3/d86 0 2024-08-01T06:55:56.261 INFO:tasks.workunit.client.1.smithi089.stdout:4/427: mknod d3/d17/d71/c87 0 2024-08-01T06:55:56.266 INFO:tasks.workunit.client.1.smithi089.stdout:4/428: dwrite d3/db/d33/f6f [0,4194304] 0 2024-08-01T06:55:56.298 INFO:tasks.workunit.client.1.smithi089.stdout:9/335: rmdir d18/d33 39 2024-08-01T06:55:56.300 INFO:tasks.workunit.client.1.smithi089.stdout:9/336: chown f17 25445 1 2024-08-01T06:55:56.306 INFO:tasks.workunit.client.1.smithi089.stdout:9/337: creat d18/f6b x:0 0 0 2024-08-01T06:55:56.308 INFO:tasks.workunit.client.1.smithi089.stdout:9/338: write d18/d33/f61 [133854,34588] 0 2024-08-01T06:55:56.309 INFO:tasks.workunit.client.1.smithi089.stdout:9/339: dread - d18/f20 zero size 2024-08-01T06:55:56.309 INFO:tasks.workunit.client.1.smithi089.stdout:9/340: readlink d18/l2b 0 2024-08-01T06:55:56.315 INFO:tasks.workunit.client.1.smithi089.stdout:6/421: truncate d2/d30/d3c/d3d/f71 2142634 0 2024-08-01T06:55:56.316 INFO:tasks.workunit.client.1.smithi089.stdout:6/422: write d2/d11/d1a/f6a [482283,113007] 0 2024-08-01T06:55:56.319 INFO:tasks.workunit.client.1.smithi089.stdout:9/341: getdents d18/d22/d52 0 2024-08-01T06:55:56.321 INFO:tasks.workunit.client.1.smithi089.stdout:6/423: fsync d2/d11/d1f/f36 0 2024-08-01T06:55:56.327 INFO:tasks.workunit.client.1.smithi089.stdout:5/279: dwrite f0 [0,4194304] 0 2024-08-01T06:55:56.329 INFO:tasks.workunit.client.1.smithi089.stdout:6/424: symlink d2/d2e/d2f/l99 0 2024-08-01T06:55:56.331 INFO:tasks.workunit.client.1.smithi089.stdout:1/427: rmdir d0/d6c/d49 39 2024-08-01T06:55:56.332 INFO:tasks.workunit.client.1.smithi089.stdout:9/342: dread d18/d22/d45/f59 [0,4194304] 0 2024-08-01T06:55:56.334 INFO:tasks.workunit.client.1.smithi089.stdout:9/343: write d18/d3d/f41 [3764858,48177] 0 2024-08-01T06:55:56.334 INFO:tasks.workunit.client.1.smithi089.stdout:1/428: dread d0/d9/d15/d2d/d4a/f75 [0,4194304] 0 2024-08-01T06:55:56.335 INFO:tasks.workunit.client.1.smithi089.stdout:9/344: write f15 [1242618,4905] 0 2024-08-01T06:55:56.335 INFO:tasks.workunit.client.1.smithi089.stdout:7/289: sync 2024-08-01T06:55:56.336 INFO:tasks.workunit.client.1.smithi089.stdout:1/429: read d0/d9/f30 [1260788,46084] 0 2024-08-01T06:55:56.337 INFO:tasks.workunit.client.1.smithi089.stdout:4/429: getdents d3 0 2024-08-01T06:55:56.338 INFO:tasks.workunit.client.1.smithi089.stdout:9/345: stat d18/d22/d52 0 2024-08-01T06:55:56.344 INFO:tasks.workunit.client.1.smithi089.stdout:4/430: symlink d3/db/d33/l88 0 2024-08-01T06:55:56.345 INFO:tasks.workunit.client.1.smithi089.stdout:6/425: dread d2/d2e/d7c/f95 [0,4194304] 0 2024-08-01T06:55:56.346 INFO:tasks.workunit.client.1.smithi089.stdout:4/431: dread - d3/db/de/d5b/f74 zero size 2024-08-01T06:55:56.347 INFO:tasks.workunit.client.1.smithi089.stdout:6/426: readlink d2/d11/l47 0 2024-08-01T06:55:56.347 INFO:tasks.workunit.client.1.smithi089.stdout:1/430: write d0/d9/d15/d2d/d4a/f75 [1113150,128722] 0 2024-08-01T06:55:56.349 INFO:tasks.workunit.client.1.smithi089.stdout:6/427: chown d2/f18 2336 1 2024-08-01T06:55:56.351 INFO:tasks.workunit.client.1.smithi089.stdout:4/432: readlink d3/db/l27 0 2024-08-01T06:55:56.352 INFO:tasks.workunit.client.1.smithi089.stdout:6/428: write d2/d11/d1a/f33 [34573,55459] 0 2024-08-01T06:55:56.354 INFO:tasks.workunit.client.1.smithi089.stdout:9/346: dwrite d18/d22/d45/f59 [0,4194304] 0 2024-08-01T06:55:56.355 INFO:tasks.workunit.client.1.smithi089.stdout:7/290: dread d7/fd [0,4194304] 0 2024-08-01T06:55:56.356 INFO:tasks.workunit.client.1.smithi089.stdout:1/431: mkdir d0/d9/d43/d4b/d92 0 2024-08-01T06:55:56.357 INFO:tasks.workunit.client.1.smithi089.stdout:7/291: write d7/df/d10/f34 [20684,128250] 0 2024-08-01T06:55:56.358 INFO:tasks.workunit.client.1.smithi089.stdout:1/432: fdatasync d0/d9/d15/d2d/f53 0 2024-08-01T06:55:56.419 INFO:tasks.workunit.client.1.smithi089.stdout:7/292: read d7/df/d10/d36/f47 [2816844,104453] 0 2024-08-01T06:55:56.421 INFO:tasks.workunit.client.1.smithi089.stdout:3/253: write d7/d32/d12/d1b/f26 [4233448,34100] 0 2024-08-01T06:55:56.422 INFO:tasks.workunit.client.1.smithi089.stdout:7/293: write d7/df/d10/f24 [4885699,52106] 0 2024-08-01T06:55:56.422 INFO:tasks.workunit.client.1.smithi089.stdout:3/254: stat d7/d32/d12 0 2024-08-01T06:55:56.423 INFO:tasks.workunit.client.1.smithi089.stdout:6/429: creat d2/d11/f9a x:0 0 0 2024-08-01T06:55:56.423 INFO:tasks.workunit.client.1.smithi089.stdout:9/347: write fe [2764858,15776] 0 2024-08-01T06:55:56.426 INFO:tasks.workunit.client.1.smithi089.stdout:7/294: unlink d7/df/l27 0 2024-08-01T06:55:56.427 INFO:tasks.workunit.client.1.smithi089.stdout:1/433: dwrite d0/d9/d15/d3b/d3d/f85 [0,4194304] 0 2024-08-01T06:55:56.427 INFO:tasks.workunit.client.1.smithi089.stdout:6/430: write d2/d11/f66 [3861561,81865] 0 2024-08-01T06:55:56.432 INFO:tasks.workunit.client.1.smithi089.stdout:6/431: mknod d2/d11/d1a/d1c/c9b 0 2024-08-01T06:55:56.435 INFO:tasks.workunit.client.1.smithi089.stdout:6/432: stat d2/d2e/d2f/d31/f41 0 2024-08-01T06:55:56.436 INFO:tasks.workunit.client.1.smithi089.stdout:3/255: creat d7/d32/d12/d1b/f4a x:0 0 0 2024-08-01T06:55:56.437 INFO:tasks.workunit.client.1.smithi089.stdout:9/348: dwrite d18/d22/f38 [0,4194304] 0 2024-08-01T06:55:56.443 INFO:tasks.workunit.client.1.smithi089.stdout:9/349: write d18/d22/d39/f3a [148503,1611] 0 2024-08-01T06:55:56.445 INFO:tasks.workunit.client.1.smithi089.stdout:1/434: dwrite d0/d9/d15/d2d/d4a/d61/f7e [0,4194304] 0 2024-08-01T06:55:56.445 INFO:tasks.workunit.client.1.smithi089.stdout:7/295: dwrite d7/df/f2f [0,4194304] 0 2024-08-01T06:55:56.448 INFO:tasks.workunit.client.1.smithi089.stdout:8/331: sync 2024-08-01T06:55:56.448 INFO:tasks.workunit.client.1.smithi089.stdout:2/307: sync 2024-08-01T06:55:56.448 INFO:tasks.workunit.client.1.smithi089.stdout:0/406: sync 2024-08-01T06:55:56.449 INFO:tasks.workunit.client.1.smithi089.stdout:3/256: mkdir d7/d32/d12/d29/d39/d4b 0 2024-08-01T06:55:56.452 INFO:tasks.workunit.client.1.smithi089.stdout:1/435: write d0/d9/d15/d3b/f3c [542675,6470] 0 2024-08-01T06:55:56.452 INFO:tasks.workunit.client.1.smithi089.stdout:7/296: chown d7/df/d10/d36/f47 0 1 2024-08-01T06:55:56.453 INFO:tasks.workunit.client.1.smithi089.stdout:3/257: stat d7/d32/d23/d46/d47 0 2024-08-01T06:55:56.454 INFO:tasks.workunit.client.1.smithi089.stdout:9/350: chown f4 358596 1 2024-08-01T06:55:56.455 INFO:tasks.workunit.client.1.smithi089.stdout:2/308: truncate d7/d1f/f4b 1309782 0 2024-08-01T06:55:56.456 INFO:tasks.workunit.client.1.smithi089.stdout:7/297: dread - d7/df/d10/d31/f5d zero size 2024-08-01T06:55:56.458 INFO:tasks.workunit.client.1.smithi089.stdout:1/436: chown d0/f20 860031 1 2024-08-01T06:55:56.461 INFO:tasks.workunit.client.1.smithi089.stdout:8/332: write d5/d15/d58/f32 [959043,61252] 0 2024-08-01T06:55:56.461 INFO:tasks.workunit.client.1.smithi089.stdout:3/258: mkdir d7/d32/d4c 0 2024-08-01T06:55:56.462 INFO:tasks.workunit.client.1.smithi089.stdout:6/433: dwrite d2/d11/f1d [0,4194304] 0 2024-08-01T06:55:56.464 INFO:tasks.workunit.client.1.smithi089.stdout:2/309: mknod d7/d1f/d29/d48/c62 0 2024-08-01T06:55:56.465 INFO:tasks.workunit.client.1.smithi089.stdout:9/351: creat d18/d33/d49/f6c x:0 0 0 2024-08-01T06:55:56.466 INFO:tasks.workunit.client.1.smithi089.stdout:6/434: write d2/d11/d1f/d46/f4b [493131,25387] 0 2024-08-01T06:55:56.468 INFO:tasks.workunit.client.1.smithi089.stdout:7/298: symlink d7/d1f/d30/l61 0 2024-08-01T06:55:56.469 INFO:tasks.workunit.client.1.smithi089.stdout:7/299: fsync d7/df/d10/d31/f45 0 2024-08-01T06:55:56.472 INFO:tasks.workunit.client.1.smithi089.stdout:3/259: mknod d7/d32/d12/d29/d39/c4d 0 2024-08-01T06:55:56.476 INFO:tasks.workunit.client.1.smithi089.stdout:1/437: write d0/d9/d15/d2d/d4a/d4d/f50 [728317,40950] 0 2024-08-01T06:55:56.477 INFO:tasks.workunit.client.1.smithi089.stdout:6/435: dwrite d2/d2e/d2f/f6d [0,4194304] 0 2024-08-01T06:55:56.479 INFO:tasks.workunit.client.1.smithi089.stdout:9/352: creat d18/d22/d52/f6d x:0 0 0 2024-08-01T06:55:56.481 INFO:tasks.workunit.client.1.smithi089.stdout:1/438: truncate d0/d9/d15/d2d/d4a/d61/f7e 5127800 0 2024-08-01T06:55:56.485 INFO:tasks.workunit.client.1.smithi089.stdout:6/436: mkdir d2/d30/d3c/d9c 0 2024-08-01T06:55:56.487 INFO:tasks.workunit.client.1.smithi089.stdout:9/353: mkdir d18/d33/d6e 0 2024-08-01T06:55:56.488 INFO:tasks.workunit.client.1.smithi089.stdout:9/354: fdatasync d18/d22/d45/f59 0 2024-08-01T06:55:56.490 INFO:tasks.workunit.client.1.smithi089.stdout:5/280: sync 2024-08-01T06:55:56.491 INFO:tasks.workunit.client.1.smithi089.stdout:0/407: dread d9/d40/d26/d2e/d44/d53/f54 [0,4194304] 0 2024-08-01T06:55:56.492 INFO:tasks.workunit.client.1.smithi089.stdout:6/437: unlink d2/l85 0 2024-08-01T06:55:56.493 INFO:tasks.workunit.client.1.smithi089.stdout:0/408: write d9/fd [2898691,1753] 0 2024-08-01T06:55:56.496 INFO:tasks.workunit.client.1.smithi089.stdout:3/260: creat d7/d32/f4e x:0 0 0 2024-08-01T06:55:56.496 INFO:tasks.workunit.client.1.smithi089.stdout:7/300: dread d7/df/d10/d36/f47 [0,4194304] 0 2024-08-01T06:55:56.497 INFO:tasks.workunit.client.1.smithi089.stdout:9/355: creat d18/d33/d53/f6f x:0 0 0 2024-08-01T06:55:56.500 INFO:tasks.workunit.client.1.smithi089.stdout:5/281: dwrite d5/de/d10/d16/d1b/f39 [4194304,4194304] 0 2024-08-01T06:55:56.502 INFO:tasks.workunit.client.1.smithi089.stdout:6/438: symlink d2/d2e/d2f/d31/l9d 0 2024-08-01T06:55:56.507 INFO:tasks.workunit.client.1.smithi089.stdout:3/261: symlink d7/d32/d12/d29/l4f 0 2024-08-01T06:55:56.507 INFO:tasks.workunit.client.1.smithi089.stdout:7/301: mknod d7/df/d10/c62 0 2024-08-01T06:55:56.510 INFO:tasks.workunit.client.1.smithi089.stdout:9/356: symlink d18/d22/d39/l70 0 2024-08-01T06:55:56.510 INFO:tasks.workunit.client.1.smithi089.stdout:0/409: dread d9/fd [4194304,4194304] 0 2024-08-01T06:55:56.514 INFO:tasks.workunit.client.1.smithi089.stdout:8/333: write d5/dc/d12/f4e [5048582,17690] 0 2024-08-01T06:55:56.514 INFO:tasks.workunit.client.1.smithi089.stdout:6/439: fdatasync d2/d11/d1f/f2d 0 2024-08-01T06:55:56.515 INFO:tasks.workunit.client.1.smithi089.stdout:3/262: unlink d7/d32/d12/d29/c43 0 2024-08-01T06:55:56.518 INFO:tasks.workunit.client.1.smithi089.stdout:3/263: readlink d7/d32/d23/d2f/l2a 0 2024-08-01T06:55:56.520 INFO:tasks.workunit.client.1.smithi089.stdout:2/310: truncate d7/d19/d1e/f30 2142580 0 2024-08-01T06:55:56.520 INFO:tasks.workunit.client.1.smithi089.stdout:9/357: dwrite d18/d22/d52/f6d [0,4194304] 0 2024-08-01T06:55:56.520 INFO:tasks.workunit.client.1.smithi089.stdout:7/302: dread d7/df/d10/d42/f48 [0,4194304] 0 2024-08-01T06:55:56.521 INFO:tasks.workunit.client.1.smithi089.stdout:6/440: dread d2/d11/d3e/f60 [0,4194304] 0 2024-08-01T06:55:56.522 INFO:tasks.workunit.client.1.smithi089.stdout:0/410: creat d9/d22/d2b/d55/f83 x:0 0 0 2024-08-01T06:55:56.522 INFO:tasks.workunit.client.1.smithi089.stdout:9/358: dread - d18/f30 zero size 2024-08-01T06:55:56.524 INFO:tasks.workunit.client.1.smithi089.stdout:1/439: getdents d0/d9/d43 0 2024-08-01T06:55:56.525 INFO:tasks.workunit.client.1.smithi089.stdout:9/359: write d18/d22/f48 [155082,14727] 0 2024-08-01T06:55:56.530 INFO:tasks.workunit.client.1.smithi089.stdout:3/264: mkdir d7/d32/d23/d31/d50 0 2024-08-01T06:55:56.531 INFO:tasks.workunit.client.1.smithi089.stdout:9/360: write f15 [1451548,30991] 0 2024-08-01T06:55:56.532 INFO:tasks.workunit.client.1.smithi089.stdout:6/441: truncate d2/d11/d1a/d1c/d40/f48 705783 0 2024-08-01T06:55:56.535 INFO:tasks.workunit.client.1.smithi089.stdout:7/303: dwrite d7/d15/f25 [0,4194304] 0 2024-08-01T06:55:56.537 INFO:tasks.workunit.client.1.smithi089.stdout:1/440: dread d0/d9/f87 [0,4194304] 0 2024-08-01T06:55:56.543 INFO:tasks.workunit.client.1.smithi089.stdout:0/411: creat d9/d22/d2b/d55/d7a/f84 x:0 0 0 2024-08-01T06:55:56.544 INFO:tasks.workunit.client.1.smithi089.stdout:0/412: write d9/f17 [277920,72211] 0 2024-08-01T06:55:56.545 INFO:tasks.workunit.client.1.smithi089.stdout:0/413: chown d9/d40/d26/d2e/f81 25 1 2024-08-01T06:55:56.546 INFO:tasks.workunit.client.1.smithi089.stdout:5/282: truncate d5/de/f4f 2206951 0 2024-08-01T06:55:56.547 INFO:tasks.workunit.client.1.smithi089.stdout:6/442: dread d2/d11/f66 [0,4194304] 0 2024-08-01T06:55:56.548 INFO:tasks.workunit.client.1.smithi089.stdout:0/414: read d9/d22/f73 [768999,103598] 0 2024-08-01T06:55:56.549 INFO:tasks.workunit.client.1.smithi089.stdout:6/443: write d2/d11/d1f/f2d [903120,7133] 0 2024-08-01T06:55:56.551 INFO:tasks.workunit.client.1.smithi089.stdout:0/415: write d9/d22/f5d [973126,60945] 0 2024-08-01T06:55:56.556 INFO:tasks.workunit.client.1.smithi089.stdout:7/304: mknod d7/df/d10/d31/c63 0 2024-08-01T06:55:56.558 INFO:tasks.workunit.client.1.smithi089.stdout:8/334: creat d5/dc/f70 x:0 0 0 2024-08-01T06:55:56.559 INFO:tasks.workunit.client.1.smithi089.stdout:8/335: readlink d5/d15/d58/l6c 0 2024-08-01T06:55:56.559 INFO:tasks.workunit.client.1.smithi089.stdout:5/283: truncate d5/de/d10/f1c 357879 0 2024-08-01T06:55:56.560 INFO:tasks.workunit.client.1.smithi089.stdout:4/433: sync 2024-08-01T06:55:56.561 INFO:tasks.workunit.client.1.smithi089.stdout:3/265: unlink d7/d32/f13 0 2024-08-01T06:55:56.561 INFO:tasks.workunit.client.1.smithi089.stdout:3/266: dread - d7/d32/d12/f33 zero size 2024-08-01T06:55:56.562 INFO:tasks.workunit.client.1.smithi089.stdout:0/416: rmdir d9/d40/d26/d2e 39 2024-08-01T06:55:56.568 INFO:tasks.workunit.client.1.smithi089.stdout:7/305: mkdir d7/df/d3b/d64 0 2024-08-01T06:55:56.568 INFO:tasks.workunit.client.1.smithi089.stdout:7/306: dread - d7/d1f/f56 zero size 2024-08-01T06:55:56.569 INFO:tasks.workunit.client.1.smithi089.stdout:7/307: stat d7/c4b 0 2024-08-01T06:55:56.571 INFO:tasks.workunit.client.1.smithi089.stdout:8/336: chown d5/dc/d12/f56 1 1 2024-08-01T06:55:56.572 INFO:tasks.workunit.client.1.smithi089.stdout:8/337: dread - d5/d15/d58/f39 zero size 2024-08-01T06:55:56.572 INFO:tasks.workunit.client.1.smithi089.stdout:4/434: creat d3/d1f/d62/d31/f89 x:0 0 0 2024-08-01T06:55:56.573 INFO:tasks.workunit.client.1.smithi089.stdout:8/338: dread - d5/dc/d1e/f34 zero size 2024-08-01T06:55:56.574 INFO:tasks.workunit.client.1.smithi089.stdout:4/435: chown d3/d1e/f6e 3310 1 2024-08-01T06:55:56.574 INFO:tasks.workunit.client.1.smithi089.stdout:0/417: symlink d9/d40/d45/d47/l85 0 2024-08-01T06:55:56.576 INFO:tasks.workunit.client.1.smithi089.stdout:3/267: dread d7/dd/f20 [0,4194304] 0 2024-08-01T06:55:56.577 INFO:tasks.workunit.client.1.smithi089.stdout:3/268: truncate d7/d32/f4e 211380 0 2024-08-01T06:55:56.578 INFO:tasks.workunit.client.1.smithi089.stdout:1/441: creat d0/d6c/d49/d82/f93 x:0 0 0 2024-08-01T06:55:56.579 INFO:tasks.workunit.client.1.smithi089.stdout:1/442: chown d0/d9/d43/d4b/d92 334 1 2024-08-01T06:55:56.579 INFO:tasks.workunit.client.1.smithi089.stdout:9/361: write d18/d33/f60 [688216,40038] 0 2024-08-01T06:55:56.581 INFO:tasks.workunit.client.1.smithi089.stdout:5/284: unlink d5/de/lb 0 2024-08-01T06:55:56.582 INFO:tasks.workunit.client.1.smithi089.stdout:5/285: stat d5/de/d10/f19 0 2024-08-01T06:55:56.583 INFO:tasks.workunit.client.1.smithi089.stdout:8/339: chown d5/dc/d12/c27 860408542 1 2024-08-01T06:55:56.583 INFO:tasks.workunit.client.1.smithi089.stdout:5/286: dread - d5/f3c zero size 2024-08-01T06:55:56.585 INFO:tasks.workunit.client.1.smithi089.stdout:0/418: symlink d9/d40/d45/d47/l86 0 2024-08-01T06:55:56.587 INFO:tasks.workunit.client.1.smithi089.stdout:1/443: dwrite d0/d9/d15/d2d/d4a/f55 [0,4194304] 0 2024-08-01T06:55:56.587 INFO:tasks.workunit.client.1.smithi089.stdout:4/436: rmdir d3/d17/d3a 39 2024-08-01T06:55:56.590 INFO:tasks.workunit.client.1.smithi089.stdout:8/340: dread d5/dc/d12/f64 [0,4194304] 0 2024-08-01T06:55:56.591 INFO:tasks.workunit.client.1.smithi089.stdout:1/444: dread - d0/d6c/d49/d82/f93 zero size 2024-08-01T06:55:56.591 INFO:tasks.workunit.client.1.smithi089.stdout:7/308: dread d7/d1f/d3a/f60 [0,4194304] 0 2024-08-01T06:55:56.593 INFO:tasks.workunit.client.1.smithi089.stdout:9/362: chown d18/c29 483484129 1 2024-08-01T06:55:56.595 INFO:tasks.workunit.client.1.smithi089.stdout:7/309: write f3 [2167646,24948] 0 2024-08-01T06:55:56.596 INFO:tasks.workunit.client.1.smithi089.stdout:8/341: chown d5/dc/d1e/l22 5776 1 2024-08-01T06:55:56.597 INFO:tasks.workunit.client.1.smithi089.stdout:2/311: dwrite d7/d1f/d29/d48/f46 [0,4194304] 0 2024-08-01T06:55:56.599 INFO:tasks.workunit.client.1.smithi089.stdout:2/312: write d7/d19/d3b/f50 [165472,117019] 0 2024-08-01T06:55:56.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.603+0000 7f8f9dc8d640 1 -- 172.21.15.16:0/1548856165 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8f981133c0 con 0x7f8f9810b790 2024-08-01T06:55:56.604 INFO:tasks.workunit.client.1.smithi089.stdout:6/444: truncate d2/d11/d1a/d1c/f52 4070117 0 2024-08-01T06:55:56.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.604+0000 7f8f94ff9640 1 -- 172.21.15.16:0/1548856165 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1868 (secure 0 0 0) 0x7f8f8c07b100 con 0x7f8f9810b790 2024-08-01T06:55:56.605 INFO:teuthology.orchestra.run.smithi016.stdout:e19 2024-08-01T06:55:56.605 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T06:55:56.605 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:55:56.606 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T06:55:56.606 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:55:56.606 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T06:55:56.606 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T06:55:56.606 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 19 2024-08-01T06:55:56.606 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T06:55:56.606 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T06:55:56.606 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T06:53:32.617145+0000 2024-08-01T06:55:56.606 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T06:55:56.606 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T06:55:56.606 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T06:55:56.606 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T06:55:56.607 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T06:55:56.607 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T06:55:56.607 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T06:55:56.607 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T06:55:56.607 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 46 2024-08-01T06:55:56.607 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:55:56.607 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T06:55:56.607 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T06:55:56.607 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=14482,1=24281} 2024-08-01T06:55:56.607 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T06:55:56.607 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T06:55:56.607 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T06:55:56.607 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T06:55:56.607 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T06:55:56.608 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T06:55:56.608 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T06:55:56.608 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T06:55:56.608 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T06:55:56.608 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:55:56.608 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:24299} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:55:56.608 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{1:24281} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:55:56.608 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:24291} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:55:56.608 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:55:56.608 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:55:56.609 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-08-01T06:55:56.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.607+0000 7f8f9dc8d640 1 -- 172.21.15.16:0/1548856165 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f8f8006d760 msgr2=0x7f8f8006fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:56.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.607+0000 7f8f9dc8d640 1 --2- 172.21.15.16:0/1548856165 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f8f8006d760 0x7f8f8006fc20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8f9810b5f0 tx=0x7f8f88005f90 comp rx=0 tx=0).stop 2024-08-01T06:55:56.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.607+0000 7f8f9dc8d640 1 -- 172.21.15.16:0/1548856165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f9810b790 msgr2=0x7f8f981a4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:56.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.607+0000 7f8f9dc8d640 1 --2- 172.21.15.16:0/1548856165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f9810b790 0x7f8f981a4910 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0055a0 tx=0x7f8f8c0055d0 comp rx=0 tx=0).stop 2024-08-01T06:55:56.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.607+0000 7f8f9dc8d640 1 -- 172.21.15.16:0/1548856165 shutdown_connections 2024-08-01T06:55:56.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.607+0000 7f8f9dc8d640 1 --2- 172.21.15.16:0/1548856165 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f8f8006d760 0x7f8f8006fc20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:56.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.607+0000 7f8f9dc8d640 1 --2- 172.21.15.16:0/1548856165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f9810b790 0x7f8f981a4910 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:56.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.607+0000 7f8f9dc8d640 1 --2- 172.21.15.16:0/1548856165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f9810a8b0 0x7f8f981a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:56.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.607+0000 7f8f9dc8d640 1 -- 172.21.15.16:0/1548856165 >> 172.21.15.16:0/1548856165 conn(0x7f8f98069fe0 msgr2=0x7f8f9810ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:56.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.608+0000 7f8f9dc8d640 1 -- 172.21.15.16:0/1548856165 shutdown_connections 2024-08-01T06:55:56.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.608+0000 7f8f9dc8d640 1 -- 172.21.15.16:0/1548856165 wait complete. 2024-08-01T06:55:56.611 INFO:tasks.workunit.client.1.smithi089.stdout:9/363: unlink d18/f31 0 2024-08-01T06:55:56.611 INFO:tasks.workunit.client.1.smithi089.stdout:9/364: chown d18/d22/c24 0 1 2024-08-01T06:55:56.611 INFO:tasks.workunit.client.1.smithi089.stdout:0/419: mknod d9/d40/d26/d2e/d3a/c87 0 2024-08-01T06:55:56.611 INFO:tasks.workunit.client.1.smithi089.stdout:8/342: symlink d5/dc/d12/l71 0 2024-08-01T06:55:56.611 INFO:tasks.workunit.client.1.smithi089.stdout:8/343: readlink d5/dc/d12/l71 0 2024-08-01T06:55:56.611 INFO:tasks.workunit.client.1.smithi089.stdout:8/344: write d5/dc/f63 [1915343,113046] 0 2024-08-01T06:55:56.611 INFO:tasks.workunit.client.1.smithi089.stdout:8/345: stat d5/d23/f38 0 2024-08-01T06:55:56.613 INFO:tasks.workunit.client.1.smithi089.stdout:2/313: rename d7/d1f/d29/d48/c62 to d7/d19/d3b/c63 0 2024-08-01T06:55:56.614 INFO:tasks.workunit.client.1.smithi089.stdout:2/314: write d7/d1f/d29/f1a [3555919,87748] 0 2024-08-01T06:55:56.621 INFO:tasks.workunit.client.1.smithi089.stdout:6/445: mkdir d2/d2e/d2f/d9e 0 2024-08-01T06:55:56.622 INFO:tasks.workunit.client.1.smithi089.stdout:9/365: symlink d18/d22/d39/l71 0 2024-08-01T06:55:56.623 INFO:tasks.workunit.client.1.smithi089.stdout:2/315: dwrite d7/d1f/d28/f51 [0,4194304] 0 2024-08-01T06:55:56.624 INFO:tasks.workunit.client.1.smithi089.stdout:0/420: mknod d9/d22/c88 0 2024-08-01T06:55:56.626 INFO:tasks.workunit.client.1.smithi089.stdout:3/269: dwrite d7/f1f [0,4194304] 0 2024-08-01T06:55:56.628 INFO:tasks.workunit.client.1.smithi089.stdout:0/421: write d9/d40/d26/f69 [2242574,97150] 0 2024-08-01T06:55:56.638 INFO:tasks.workunit.client.1.smithi089.stdout:6/446: write d2/d2e/d7c/f95 [674098,35374] 0 2024-08-01T06:55:56.640 INFO:tasks.workunit.client.1.smithi089.stdout:3/270: dwrite d7/d32/d23/f49 [0,4194304] 0 2024-08-01T06:55:56.640 INFO:tasks.workunit.client.1.smithi089.stdout:9/366: mknod d18/d33/d53/c72 0 2024-08-01T06:55:56.641 INFO:tasks.workunit.client.1.smithi089.stdout:4/437: truncate d3/db/d33/f56 3831001 0 2024-08-01T06:55:56.642 INFO:tasks.workunit.client.1.smithi089.stdout:0/422: dread d9/f18 [4194304,4194304] 0 2024-08-01T06:55:56.644 INFO:tasks.workunit.client.1.smithi089.stdout:2/316: unlink d7/d19/l22 0 2024-08-01T06:55:56.645 INFO:tasks.workunit.client.1.smithi089.stdout:9/367: write d18/d33/d53/f6f [296514,119121] 0 2024-08-01T06:55:56.647 INFO:tasks.workunit.client.1.smithi089.stdout:7/310: link d7/d1f/ce d7/d1f/d30/c65 0 2024-08-01T06:55:56.650 INFO:tasks.workunit.client.1.smithi089.stdout:9/368: truncate d18/d3d/d55/f56 1523792 0 2024-08-01T06:55:56.651 INFO:tasks.workunit.client.1.smithi089.stdout:0/423: creat d9/d22/d2b/d55/d7a/f89 x:0 0 0 2024-08-01T06:55:56.651 INFO:tasks.workunit.client.1.smithi089.stdout:6/447: dwrite d2/d11/d1a/f33 [0,4194304] 0 2024-08-01T06:55:56.652 INFO:tasks.workunit.client.1.smithi089.stdout:4/438: rename d3/d1f/d62/d31/c84 to d3/d68/d7e/c8a 0 2024-08-01T06:55:56.653 INFO:tasks.workunit.client.1.smithi089.stdout:1/445: truncate d0/d9/d15/d3b/d3d/f85 528115 0 2024-08-01T06:55:56.659 INFO:tasks.workunit.client.1.smithi089.stdout:0/424: unlink d9/fd 0 2024-08-01T06:55:56.661 INFO:tasks.workunit.client.1.smithi089.stdout:1/446: dwrite d0/d6c/d49/f8d [0,4194304] 0 2024-08-01T06:55:56.666 INFO:tasks.workunit.client.1.smithi089.stdout:2/317: mkdir d7/d1f/d29/d48/d4e/d64 0 2024-08-01T06:55:56.674 INFO:tasks.workunit.client.1.smithi089.stdout:0/425: write d9/d40/d26/d2e/f42 [1033800,88760] 0 2024-08-01T06:55:56.682 INFO:tasks.workunit.client.1.smithi089.stdout:3/271: creat d7/d32/d12/d1b/f51 x:0 0 0 2024-08-01T06:55:56.682 INFO:tasks.workunit.client.1.smithi089.stdout:3/272: chown d7/d32/d23/d31 59698 1 2024-08-01T06:55:56.684 INFO:tasks.workunit.client.1.smithi089.stdout:4/439: stat d3/d68/d7e/c8a 0 2024-08-01T06:55:56.685 INFO:tasks.workunit.client.1.smithi089.stdout:4/440: dread - d3/d1e/f4e zero size 2024-08-01T06:55:56.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.731+0000 7fe85a4d8640 1 -- 172.21.15.16:0/1912623117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8540ff3e0 msgr2=0x7fe8540ff860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:56.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.731+0000 7fe85a4d8640 1 --2- 172.21.15.16:0/1912623117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8540ff3e0 0x7fe8540ff860 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe848009880 tx=0x7fe84802a4a0 comp rx=0 tx=0).stop 2024-08-01T06:55:56.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.731+0000 7fe85a4d8640 1 -- 172.21.15.16:0/1912623117 shutdown_connections 2024-08-01T06:55:56.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.731+0000 7fe85a4d8640 1 --2- 172.21.15.16:0/1912623117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8540ff3e0 0x7fe8540ff860 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:56.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.731+0000 7fe85a4d8640 1 --2- 172.21.15.16:0/1912623117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8540fe1e0 0x7fe8540fe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:56.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.731+0000 7fe85a4d8640 1 -- 172.21.15.16:0/1912623117 >> 172.21.15.16:0/1912623117 conn(0x7fe8540f9950 msgr2=0x7fe8540fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:56.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.731+0000 7fe85a4d8640 1 -- 172.21.15.16:0/1912623117 shutdown_connections 2024-08-01T06:55:56.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.731+0000 7fe85a4d8640 1 -- 172.21.15.16:0/1912623117 wait complete. 2024-08-01T06:55:56.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.732+0000 7fe85a4d8640 1 Processor -- start 2024-08-01T06:55:56.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.732+0000 7fe85a4d8640 1 -- start start 2024-08-01T06:55:56.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.732+0000 7fe85a4d8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8540fe1e0 0x7fe854197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:56.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.732+0000 7fe85a4d8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8540ff3e0 0x7fe854197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:56.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.732+0000 7fe85a4d8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe854198350 con 0x7fe8540fe1e0 2024-08-01T06:55:56.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.732+0000 7fe85a4d8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8541984c0 con 0x7fe8540ff3e0 2024-08-01T06:55:56.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.732+0000 7fe853fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8540fe1e0 0x7fe854197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:56.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.732+0000 7fe8537fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8540ff3e0 0x7fe854197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:56.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.732+0000 7fe853fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8540fe1e0 0x7fe854197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53674/0 (socket says 172.21.15.16:53674) 2024-08-01T06:55:56.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.732+0000 7fe853fff640 1 -- 172.21.15.16:0/2215715722 learned_addr learned my addr 172.21.15.16:0/2215715722 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:55:56.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.733+0000 7fe853fff640 1 -- 172.21.15.16:0/2215715722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8540ff3e0 msgr2=0x7fe854197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:56.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.733+0000 7fe853fff640 1 --2- 172.21.15.16:0/2215715722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8540ff3e0 0x7fe854197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:56.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.733+0000 7fe853fff640 1 -- 172.21.15.16:0/2215715722 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe848009560 con 0x7fe8540fe1e0 2024-08-01T06:55:56.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.733+0000 7fe8537fe640 1 --2- 172.21.15.16:0/2215715722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8540ff3e0 0x7fe854197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T06:55:56.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.733+0000 7fe853fff640 1 --2- 172.21.15.16:0/2215715722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8540fe1e0 0x7fe854197840 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe84400db70 tx=0x7fe84400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:56.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.733+0000 7fe8517fa640 1 -- 172.21.15.16:0/2215715722 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe84400ae50 con 0x7fe8540fe1e0 2024-08-01T06:55:56.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.734+0000 7fe85a4d8640 1 -- 172.21.15.16:0/2215715722 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85419cf10 con 0x7fe8540fe1e0 2024-08-01T06:55:56.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.734+0000 7fe8517fa640 1 -- 172.21.15.16:0/2215715722 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8440035f0 con 0x7fe8540fe1e0 2024-08-01T06:55:56.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.734+0000 7fe8517fa640 1 -- 172.21.15.16:0/2215715722 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe84400e710 con 0x7fe8540fe1e0 2024-08-01T06:55:56.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.734+0000 7fe85a4d8640 1 -- 172.21.15.16:0/2215715722 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85419d450 con 0x7fe8540fe1e0 2024-08-01T06:55:56.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.735+0000 7fe85a4d8640 1 -- 172.21.15.16:0/2215715722 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8540fe5e0 con 0x7fe8540fe1e0 2024-08-01T06:55:56.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.735+0000 7fe8517fa640 1 -- 172.21.15.16:0/2215715722 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) v1 ==== 91559+0+0 (secure 0 0 0) 0x7fe844003760 con 0x7fe8540fe1e0 2024-08-01T06:55:56.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.736+0000 7fe8517fa640 1 --2- 172.21.15.16:0/2215715722 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fe83c06d660 0x7fe83c06fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:56.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.736+0000 7fe8517fa640 1 -- 172.21.15.16:0/2215715722 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fe84408d040 con 0x7fe8540fe1e0 2024-08-01T06:55:56.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.736+0000 7fe8537fe640 1 --2- 172.21.15.16:0/2215715722 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fe83c06d660 0x7fe83c06fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:56.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.737+0000 7fe8537fe640 1 --2- 172.21.15.16:0/2215715722 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fe83c06d660 0x7fe83c06fb20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe848000c00 tx=0x7fe8480314e0 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:56.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:56.741+0000 7fe8517fa640 1 -- 172.21.15.16:0/2215715722 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fe844056920 con 0x7fe8540fe1e0 2024-08-01T06:55:56.749 INFO:tasks.workunit.client.1.smithi089.stdout:0/426: unlink d9/d22/d2b/c5f 0 2024-08-01T06:55:56.749 INFO:tasks.workunit.client.1.smithi089.stdout:1/447: getdents d0/d9/d54 0 2024-08-01T06:55:56.750 INFO:tasks.workunit.client.1.smithi089.stdout:6/448: write d2/d11/d1a/f29 [1804120,39976] 0 2024-08-01T06:55:56.750 INFO:tasks.workunit.client.1.smithi089.stdout:7/311: getdents d7 0 2024-08-01T06:55:56.751 INFO:tasks.workunit.client.1.smithi089.stdout:2/318: rename d7/d19/d1e/l57 to d7/d19/d1e/d3d/d60/l65 0 2024-08-01T06:55:56.751 INFO:tasks.workunit.client.1.smithi089.stdout:3/273: dwrite d7/d32/f2d [0,4194304] 0 2024-08-01T06:55:56.752 INFO:tasks.workunit.client.1.smithi089.stdout:9/369: getdents d18/d33/d53 0 2024-08-01T06:55:56.752 INFO:tasks.workunit.client.1.smithi089.stdout:7/312: readlink d7/d15/l26 0 2024-08-01T06:55:56.753 INFO:tasks.workunit.client.1.smithi089.stdout:4/441: truncate d3/db/de/d5b/f74 243182 0 2024-08-01T06:55:56.805 INFO:tasks.workunit.client.1.smithi089.stdout:6/449: fsync d2/d2e/d2f/f6d 0 2024-08-01T06:55:56.805 INFO:tasks.workunit.client.1.smithi089.stdout:1/448: creat d0/d9/d15/d76/f94 x:0 0 0 2024-08-01T06:55:56.805 INFO:tasks.workunit.client.1.smithi089.stdout:9/370: read - d18/d22/d52/f54 zero size 2024-08-01T06:55:56.806 INFO:tasks.workunit.client.1.smithi089.stdout:2/319: symlink d7/d19/d3b/l66 0 2024-08-01T06:55:56.806 INFO:tasks.workunit.client.1.smithi089.stdout:7/313: readlink d7/d1f/d30/d4c/l4d 0 2024-08-01T06:55:56.807 INFO:tasks.workunit.client.1.smithi089.stdout:3/274: mknod d7/d32/d23/d2f/c52 0 2024-08-01T06:55:56.810 INFO:tasks.workunit.client.1.smithi089.stdout:2/320: stat d7/d19/d1e/f30 0 2024-08-01T06:55:56.812 INFO:tasks.workunit.client.1.smithi089.stdout:6/450: mknod d2/d30/c9f 0 2024-08-01T06:55:56.814 INFO:tasks.workunit.client.1.smithi089.stdout:4/442: rename d3/d17/d71/c87 to d3/db/d33/c8b 0 2024-08-01T06:55:56.816 INFO:tasks.workunit.client.1.smithi089.stdout:0/427: dwrite d9/d22/d2b/d55/f68 [4194304,4194304] 0 2024-08-01T06:55:56.817 INFO:tasks.workunit.client.1.smithi089.stdout:6/451: fdatasync d2/d11/d1f/d46/f4b 0 2024-08-01T06:55:56.819 INFO:tasks.workunit.client.1.smithi089.stdout:2/321: mknod d7/d19/d3b/c67 0 2024-08-01T06:55:56.821 INFO:tasks.workunit.client.1.smithi089.stdout:3/275: write d7/d32/d12/d1b/f3c [790332,19074] 0 2024-08-01T06:55:56.821 INFO:tasks.workunit.client.1.smithi089.stdout:6/452: fdatasync d2/d11/d1f/f2d 0 2024-08-01T06:55:56.821 INFO:tasks.workunit.client.1.smithi089.stdout:7/314: dwrite d7/df/d10/f35 [0,4194304] 0 2024-08-01T06:55:56.824 INFO:tasks.workunit.client.1.smithi089.stdout:9/371: dwrite d18/f47 [0,4194304] 0 2024-08-01T06:55:56.825 INFO:tasks.workunit.client.1.smithi089.stdout:7/315: write d7/df/d10/d36/f44 [876849,4651] 0 2024-08-01T06:55:56.830 INFO:tasks.workunit.client.1.smithi089.stdout:3/276: dread d7/d32/d23/f49 [0,4194304] 0 2024-08-01T06:55:56.835 INFO:tasks.workunit.client.1.smithi089.stdout:9/372: dread d18/d22/d45/f51 [0,4194304] 0 2024-08-01T06:55:56.836 INFO:tasks.workunit.client.1.smithi089.stdout:6/453: mknod d2/d11/d1f/d46/d6b/d7d/ca0 0 2024-08-01T06:55:56.836 INFO:tasks.workunit.client.1.smithi089.stdout:0/428: dwrite d9/d40/d26/d2e/d44/d53/f54 [0,4194304] 0 2024-08-01T06:55:56.838 INFO:tasks.workunit.client.1.smithi089.stdout:2/322: dread d7/d1f/d29/f43 [4194304,4194304] 0 2024-08-01T06:55:56.838 INFO:tasks.workunit.client.1.smithi089.stdout:7/316: fsync d7/df/d10/d36/f47 0 2024-08-01T06:55:56.840 INFO:tasks.workunit.client.1.smithi089.stdout:7/317: chown d7/d15 37164562 1 2024-08-01T06:55:56.841 INFO:tasks.workunit.client.1.smithi089.stdout:0/429: write d9/d22/d2b/f80 [556122,55846] 0 2024-08-01T06:55:56.842 INFO:tasks.workunit.client.1.smithi089.stdout:1/449: dread d0/d9/d15/d2d/d4a/d4d/f6d [0,4194304] 0 2024-08-01T06:55:56.844 INFO:tasks.workunit.client.1.smithi089.stdout:0/430: write d9/d40/d26/f3f [1891583,47655] 0 2024-08-01T06:55:56.844 INFO:tasks.workunit.client.1.smithi089.stdout:9/373: symlink d18/d3d/d4b/l73 0 2024-08-01T06:55:56.846 INFO:tasks.workunit.client.1.smithi089.stdout:3/277: mkdir d7/d32/d4c/d53 0 2024-08-01T06:55:56.847 INFO:tasks.workunit.client.1.smithi089.stdout:2/323: fsync d7/d1f/d29/f43 0 2024-08-01T06:55:56.847 INFO:tasks.workunit.client.1.smithi089.stdout:4/443: getdents d3/d1e 0 2024-08-01T06:55:56.849 INFO:tasks.workunit.client.1.smithi089.stdout:4/444: write d3/d1e/f40 [1622335,95396] 0 2024-08-01T06:55:56.850 INFO:tasks.workunit.client.1.smithi089.stdout:7/318: mknod d7/df/c66 0 2024-08-01T06:55:56.854 INFO:tasks.workunit.client.1.smithi089.stdout:0/431: unlink d9/d40/d45/d47/l86 0 2024-08-01T06:55:56.856 INFO:tasks.workunit.client.1.smithi089.stdout:1/450: rename d0/d6c to d0/d9/d15/d3b/d95 0 2024-08-01T06:55:56.859 INFO:tasks.workunit.client.1.smithi089.stdout:2/324: rmdir d7/d19/d1e/d3d 39 2024-08-01T06:55:56.860 INFO:tasks.workunit.client.1.smithi089.stdout:2/325: fdatasync d7/d1f/d29/d48/f46 0 2024-08-01T06:55:56.861 INFO:tasks.workunit.client.1.smithi089.stdout:4/445: chown d3/db/d33/f56 24977 1 2024-08-01T06:55:56.864 INFO:tasks.workunit.client.1.smithi089.stdout:7/319: rename d7/d1f/f56 to d7/df/d3b/d64/f67 0 2024-08-01T06:55:56.864 INFO:tasks.workunit.client.1.smithi089.stdout:7/320: chown d7/df/d10/d31 5 1 2024-08-01T06:55:56.865 INFO:tasks.workunit.client.1.smithi089.stdout:1/451: symlink d0/d9/d15/d2d/d4a/d4d/l96 0 2024-08-01T06:55:56.866 INFO:tasks.workunit.client.1.smithi089.stdout:7/321: truncate d7/df/d10/d31/f45 615544 0 2024-08-01T06:55:56.867 INFO:tasks.workunit.client.1.smithi089.stdout:2/326: mkdir d7/d19/d68 0 2024-08-01T06:55:56.870 INFO:tasks.workunit.client.1.smithi089.stdout:1/452: symlink d0/d9/d15/d7a/l97 0 2024-08-01T06:55:56.871 INFO:tasks.workunit.client.1.smithi089.stdout:1/453: chown d0/d9/d15/d3b/l81 261 1 2024-08-01T06:55:56.872 INFO:tasks.workunit.client.1.smithi089.stdout:7/322: dwrite d7/df/d10/d36/f47 [0,4194304] 0 2024-08-01T06:55:56.873 INFO:tasks.workunit.client.1.smithi089.stdout:0/432: rename c6 to d9/d22/d2b/c8a 0 2024-08-01T06:55:56.875 INFO:tasks.workunit.client.1.smithi089.stdout:7/323: creat d7/d46/f68 x:0 0 0 2024-08-01T06:55:56.876 INFO:tasks.workunit.client.1.smithi089.stdout:7/324: stat d7/d1f/c2c 0 2024-08-01T06:55:56.878 INFO:tasks.workunit.client.1.smithi089.stdout:1/454: creat d0/d9/d43/d89/f98 x:0 0 0 2024-08-01T06:55:56.880 INFO:tasks.workunit.client.1.smithi089.stdout:1/455: fdatasync d0/d9/d15/d76/f88 0 2024-08-01T06:55:56.881 INFO:tasks.workunit.client.1.smithi089.stdout:2/327: read d7/d1f/d29/f43 [1188727,64480] 0 2024-08-01T06:55:56.882 INFO:tasks.workunit.client.1.smithi089.stdout:7/325: mkdir d7/df/d10/d31/d4a/d69 0 2024-08-01T06:55:56.885 INFO:tasks.workunit.client.1.smithi089.stdout:1/456: rmdir d0/d9/d15/d2b 39 2024-08-01T06:55:56.885 INFO:tasks.workunit.client.1.smithi089.stdout:9/374: dread d18/d22/f28 [0,4194304] 0 2024-08-01T06:55:56.887 INFO:tasks.workunit.client.1.smithi089.stdout:9/375: read f4 [2395763,61] 0 2024-08-01T06:55:56.887 INFO:tasks.workunit.client.1.smithi089.stdout:7/326: creat d7/d1f/d30/f6a x:0 0 0 2024-08-01T06:55:56.889 INFO:tasks.workunit.client.1.smithi089.stdout:6/454: write d2/d30/d3c/d3d/f94 [4445434,26171] 0 2024-08-01T06:55:56.890 INFO:tasks.workunit.client.1.smithi089.stdout:2/328: creat d7/d19/d1e/d5b/f69 x:0 0 0 2024-08-01T06:55:56.894 INFO:tasks.workunit.client.1.smithi089.stdout:9/376: unlink d18/d22/l2e 0 2024-08-01T06:55:56.894 INFO:tasks.workunit.client.1.smithi089.stdout:9/377: dread - d18/d22/d52/f54 zero size 2024-08-01T06:55:56.895 INFO:tasks.workunit.client.1.smithi089.stdout:4/446: write d3/d1e/f25 [1003588,115837] 0 2024-08-01T06:55:56.897 INFO:tasks.workunit.client.1.smithi089.stdout:4/447: read d3/d1e/d21/f41 [3739126,91185] 0 2024-08-01T06:55:56.897 INFO:tasks.workunit.client.1.smithi089.stdout:6/455: unlink d2/d11/d1f/f45 0 2024-08-01T06:55:56.898 INFO:tasks.workunit.client.1.smithi089.stdout:4/448: read d3/d1f/d62/f64 [583591,127797] 0 2024-08-01T06:55:56.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:56 smithi016 ceph-mon[29266]: from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:55:56.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:56 smithi016 ceph-mon[29266]: from='client.24459 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:55:56.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:56 smithi016 ceph-mon[29266]: pgmap v12: 65 pgs: 65 active+clean; 759 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 9.9 MiB/s rd, 99 MiB/s wr, 408 op/s 2024-08-01T06:55:56.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:56 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3439563304' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:55:56.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:56 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/1548856165' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:55:56.906 INFO:tasks.workunit.client.1.smithi089.stdout:9/378: symlink d18/d33/d49/l74 0 2024-08-01T06:55:56.906 INFO:tasks.workunit.client.1.smithi089.stdout:2/329: dread d7/d19/d1e/f2e [0,4194304] 0 2024-08-01T06:55:56.907 INFO:tasks.workunit.client.1.smithi089.stdout:2/330: readlink d7/d19/d3b/l66 0 2024-08-01T06:55:56.909 INFO:tasks.workunit.client.1.smithi089.stdout:6/456: chown d2/d30/d3c/d3d/c88 82075 1 2024-08-01T06:55:56.910 INFO:tasks.workunit.client.1.smithi089.stdout:0/433: dwrite f7 [0,4194304] 0 2024-08-01T06:55:56.911 INFO:tasks.workunit.client.1.smithi089.stdout:4/449: chown d3/d17/d3a/f63 3 1 2024-08-01T06:55:56.913 INFO:tasks.workunit.client.1.smithi089.stdout:7/327: link d7/d1f/d30/d4c/l4d d7/l6b 0 2024-08-01T06:55:56.913 INFO:tasks.workunit.client.1.smithi089.stdout:9/379: mkdir d18/d22/d39/d50/d75 0 2024-08-01T06:55:56.923 INFO:tasks.workunit.client.1.smithi089.stdout:2/331: symlink d7/d19/d68/l6a 0 2024-08-01T06:55:56.924 INFO:tasks.workunit.client.1.smithi089.stdout:0/434: mkdir d9/d40/d26/d2e/d44/d72/d8b 0 2024-08-01T06:55:56.930 INFO:tasks.workunit.client.1.smithi089.stdout:0/435: mkdir d9/d40/d26/d64/d8c 0 2024-08-01T06:55:56.931 INFO:tasks.workunit.client.1.smithi089.stdout:4/450: link d3/d1f/d62/d3b/l79 d3/d86/l8c 0 2024-08-01T06:55:56.934 INFO:tasks.workunit.client.1.smithi089.stdout:2/332: truncate d7/fa 3102380 0 2024-08-01T06:55:56.935 INFO:tasks.workunit.client.1.smithi089.stdout:0/436: creat d9/d40/d26/d2e/d3a/d76/f8d x:0 0 0 2024-08-01T06:55:56.936 INFO:tasks.workunit.client.1.smithi089.stdout:4/451: creat d3/d1f/d62/d3b/f8d x:0 0 0 2024-08-01T06:55:56.938 INFO:tasks.workunit.client.1.smithi089.stdout:7/328: write d7/df/d10/f34 [1521950,2900] 0 2024-08-01T06:55:56.939 INFO:tasks.workunit.client.1.smithi089.stdout:6/457: write d2/d2e/d2f/d31/f44 [1536918,125561] 0 2024-08-01T06:55:56.939 INFO:tasks.workunit.client.1.smithi089.stdout:0/437: creat d9/d40/d26/d2e/d3a/f8e x:0 0 0 2024-08-01T06:55:56.940 INFO:tasks.workunit.client.1.smithi089.stdout:6/458: truncate d2/d11/f9a 728318 0 2024-08-01T06:55:56.940 INFO:tasks.workunit.client.1.smithi089.stdout:4/452: symlink d3/d17/d71/l8e 0 2024-08-01T06:55:56.943 INFO:tasks.workunit.client.1.smithi089.stdout:7/329: symlink d7/df/d10/d31/l6c 0 2024-08-01T06:55:56.944 INFO:tasks.workunit.client.1.smithi089.stdout:0/438: write d9/d40/d25/f2a [908023,33143] 0 2024-08-01T06:55:56.947 INFO:tasks.workunit.client.1.smithi089.stdout:4/453: symlink d3/d17/d71/l8f 0 2024-08-01T06:55:56.950 INFO:tasks.workunit.client.1.smithi089.stdout:0/439: unlink d9/d40/d26/d2e/d3a/c87 0 2024-08-01T06:55:56.950 INFO:tasks.workunit.client.1.smithi089.stdout:7/330: dread d7/d46/f54 [0,4194304] 0 2024-08-01T06:55:56.951 INFO:tasks.workunit.client.1.smithi089.stdout:7/331: chown d7/df 19181 1 2024-08-01T06:55:56.952 INFO:tasks.workunit.client.1.smithi089.stdout:7/332: write d7/df/d3b/f58 [666963,119907] 0 2024-08-01T06:55:56.952 INFO:tasks.workunit.client.1.smithi089.stdout:0/440: dread d9/f13 [0,4194304] 0 2024-08-01T06:55:56.953 INFO:tasks.workunit.client.1.smithi089.stdout:4/454: rmdir d3/d1e/d21/d57 39 2024-08-01T06:55:56.957 INFO:tasks.workunit.client.1.smithi089.stdout:7/333: dread d7/df/d10/f34 [0,4194304] 0 2024-08-01T06:55:56.958 INFO:tasks.workunit.client.1.smithi089.stdout:6/459: write d2/d11/d3e/f60 [779253,64843] 0 2024-08-01T06:55:56.958 INFO:tasks.workunit.client.1.smithi089.stdout:0/441: write d9/f18 [4666325,24709] 0 2024-08-01T06:55:56.958 INFO:tasks.workunit.client.1.smithi089.stdout:4/455: symlink d3/db/de/d5b/l90 0 2024-08-01T06:55:56.962 INFO:tasks.workunit.client.1.smithi089.stdout:7/334: symlink d7/df/d10/d42/d4e/l6d 0 2024-08-01T06:55:56.963 INFO:tasks.workunit.client.1.smithi089.stdout:7/335: chown d7/df/d10/d36/f44 120 1 2024-08-01T06:55:56.964 INFO:tasks.workunit.client.1.smithi089.stdout:0/442: unlink d9/d40/d26/l2f 0 2024-08-01T06:55:56.964 INFO:tasks.workunit.client.1.smithi089.stdout:6/460: creat d2/d30/fa1 x:0 0 0 2024-08-01T06:55:56.965 INFO:tasks.workunit.client.1.smithi089.stdout:6/461: stat d2/d30/d3c/d3d 0 2024-08-01T06:55:56.965 INFO:tasks.workunit.client.1.smithi089.stdout:4/456: creat d3/db/de/d5b/f91 x:0 0 0 2024-08-01T06:55:56.966 INFO:tasks.workunit.client.1.smithi089.stdout:7/336: symlink d7/df/d10/l6e 0 2024-08-01T06:55:56.967 INFO:tasks.workunit.client.1.smithi089.stdout:7/337: write d7/df/d10/d42/f5e [598360,76276] 0 2024-08-01T06:55:56.968 INFO:tasks.workunit.client.1.smithi089.stdout:6/462: chown d2/d11/f17 1529590233 1 2024-08-01T06:55:56.969 INFO:tasks.workunit.client.1.smithi089.stdout:0/443: mknod d9/d40/d26/c8f 0 2024-08-01T06:55:56.969 INFO:tasks.workunit.client.1.smithi089.stdout:7/338: read - d7/df/d3b/d64/f67 zero size 2024-08-01T06:55:56.971 INFO:tasks.workunit.client.1.smithi089.stdout:6/463: creat d2/d11/d1a/fa2 x:0 0 0 2024-08-01T06:55:56.972 INFO:tasks.workunit.client.1.smithi089.stdout:6/464: chown d2/d11/d1a/f33 134761559 1 2024-08-01T06:55:56.974 INFO:tasks.workunit.client.1.smithi089.stdout:7/339: creat d7/d1f/d3a/f6f x:0 0 0 2024-08-01T06:55:56.975 INFO:tasks.workunit.client.1.smithi089.stdout:7/340: fdatasync d7/df/d3b/f58 0 2024-08-01T06:55:56.976 INFO:tasks.workunit.client.1.smithi089.stdout:0/444: dread d9/d22/f73 [0,4194304] 0 2024-08-01T06:55:56.979 INFO:tasks.workunit.client.1.smithi089.stdout:6/465: dread d2/d11/d1a/d1c/d40/f48 [0,4194304] 0 2024-08-01T06:55:56.980 INFO:tasks.workunit.client.1.smithi089.stdout:4/457: dread d3/d1e/f40 [0,4194304] 0 2024-08-01T06:55:56.981 INFO:tasks.workunit.client.1.smithi089.stdout:6/466: creat d2/d30/fa3 x:0 0 0 2024-08-01T06:55:56.981 INFO:tasks.workunit.client.1.smithi089.stdout:7/341: dread d7/fd [0,4194304] 0 2024-08-01T06:55:56.983 INFO:tasks.workunit.client.1.smithi089.stdout:6/467: creat d2/d11/d1a/d1c/fa4 x:0 0 0 2024-08-01T06:55:56.987 INFO:tasks.workunit.client.1.smithi089.stdout:6/468: dread d2/d11/d1f/d46/f4b [0,4194304] 0 2024-08-01T06:55:56.987 INFO:tasks.workunit.client.1.smithi089.stdout:7/342: link c5 d7/df/d10/d31/c70 0 2024-08-01T06:55:56.987 INFO:tasks.workunit.client.1.smithi089.stdout:6/469: dread - d2/d30/fa3 zero size 2024-08-01T06:55:56.988 INFO:tasks.workunit.client.1.smithi089.stdout:6/470: read d2/d11/f65 [126871,63926] 0 2024-08-01T06:55:56.989 INFO:tasks.workunit.client.1.smithi089.stdout:6/471: readlink d2/d11/d1a/l68 0 2024-08-01T06:55:56.990 INFO:tasks.workunit.client.1.smithi089.stdout:7/343: write d7/d15/f25 [6548156,111407] 0 2024-08-01T06:55:56.991 INFO:tasks.workunit.client.1.smithi089.stdout:7/344: stat d7/d1f/f1d 0 2024-08-01T06:55:56.993 INFO:tasks.workunit.client.1.smithi089.stdout:6/472: rename d2/l8a to d2/d11/d1f/d46/d6b/la5 0 2024-08-01T06:55:56.993 INFO:tasks.workunit.client.1.smithi089.stdout:6/473: stat d2/d2e/d2f/d31/l9d 0 2024-08-01T06:55:56.998 INFO:tasks.workunit.client.1.smithi089.stdout:0/445: truncate d9/d22/f29 1241335 0 2024-08-01T06:55:56.999 INFO:tasks.workunit.client.1.smithi089.stdout:6/474: dwrite d2/d2e/d2f/d31/f44 [0,4194304] 0 2024-08-01T06:55:56.999 INFO:tasks.workunit.client.1.smithi089.stdout:0/446: write d9/d22/f3e [2189503,30729] 0 2024-08-01T06:55:57.000 INFO:tasks.workunit.client.1.smithi089.stdout:7/345: chown d7/df/d10/d31/c70 183685 1 2024-08-01T06:55:57.005 INFO:tasks.workunit.client.1.smithi089.stdout:0/447: symlink d9/d40/d26/d2e/d3a/l90 0 2024-08-01T06:55:57.005 INFO:tasks.workunit.client.1.smithi089.stdout:0/448: stat d9/d40/c67 0 2024-08-01T06:55:57.010 INFO:tasks.workunit.client.1.smithi089.stdout:7/346: rename d7/d1f/d3a/f60 to d7/d1f/d30/f71 0 2024-08-01T06:55:57.010 INFO:tasks.workunit.client.1.smithi089.stdout:7/347: write d7/df/d3b/f58 [951222,131044] 0 2024-08-01T06:55:57.014 INFO:tasks.workunit.client.1.smithi089.stdout:6/475: dread d2/f2a [0,4194304] 0 2024-08-01T06:55:57.019 INFO:tasks.workunit.client.1.smithi089.stdout:7/348: dwrite d7/df/d3b/d64/f67 [0,4194304] 0 2024-08-01T06:55:57.019 INFO:tasks.workunit.client.1.smithi089.stdout:6/476: symlink d2/d2e/d7c/la6 0 2024-08-01T06:55:57.022 INFO:tasks.workunit.client.1.smithi089.stdout:7/349: creat d7/d15/f72 x:0 0 0 2024-08-01T06:55:57.024 INFO:tasks.workunit.client.1.smithi089.stdout:7/350: creat d7/d15/f73 x:0 0 0 2024-08-01T06:55:57.025 INFO:tasks.workunit.client.1.smithi089.stdout:0/449: rename d9/d40/d26 to d9/d40/d25/d46/d91 0 2024-08-01T06:55:57.029 INFO:tasks.workunit.client.1.smithi089.stdout:7/351: read d7/fa [284193,105108] 0 2024-08-01T06:55:57.030 INFO:tasks.workunit.client.1.smithi089.stdout:6/477: link d2/d2e/c89 d2/d11/d1f/ca7 0 2024-08-01T06:55:57.031 INFO:tasks.workunit.client.1.smithi089.stdout:0/450: dwrite d9/d40/d45/d47/f5c [0,4194304] 0 2024-08-01T06:55:57.032 INFO:tasks.workunit.client.1.smithi089.stdout:6/478: stat d2/d11/l16 0 2024-08-01T06:55:57.033 INFO:tasks.workunit.client.1.smithi089.stdout:7/352: mknod d7/df/d3b/d64/c74 0 2024-08-01T06:55:57.033 INFO:tasks.workunit.client.1.smithi089.stdout:7/353: read - d7/d15/f39 zero size 2024-08-01T06:55:57.035 INFO:tasks.workunit.client.1.smithi089.stdout:0/451: rmdir d9/d22/d2b/d55/d7a 39 2024-08-01T06:55:57.040 INFO:tasks.workunit.client.1.smithi089.stdout:0/452: fdatasync d9/f77 0 2024-08-01T06:55:57.040 INFO:tasks.workunit.client.1.smithi089.stdout:5/287: sync 2024-08-01T06:55:57.044 INFO:tasks.workunit.client.1.smithi089.stdout:0/453: mknod d9/d22/d2b/c92 0 2024-08-01T06:55:57.045 INFO:tasks.workunit.client.1.smithi089.stdout:5/288: mkdir d5/de/d10/d16/d1b/d52/d5f 0 2024-08-01T06:55:57.046 INFO:tasks.workunit.client.1.smithi089.stdout:5/289: stat d5/de/f34 0 2024-08-01T06:55:57.046 INFO:tasks.workunit.client.1.smithi089.stdout:7/354: rmdir d7/df/d10/d31/d4a/d69 0 2024-08-01T06:55:57.049 INFO:tasks.workunit.client.1.smithi089.stdout:6/479: dwrite d2/d11/d1a/f33 [4194304,4194304] 0 2024-08-01T06:55:57.050 INFO:tasks.workunit.client.1.smithi089.stdout:7/355: read d7/df/d10/d36/f38 [49734,118208] 0 2024-08-01T06:55:57.052 INFO:tasks.workunit.client.1.smithi089.stdout:6/480: readlink d2/d2e/d98/l8f 0 2024-08-01T06:55:57.057 INFO:tasks.workunit.client.1.smithi089.stdout:0/454: dwrite d9/d40/d25/d46/d91/d2e/d44/d53/f54 [0,4194304] 0 2024-08-01T06:55:57.059 INFO:tasks.workunit.client.1.smithi089.stdout:5/290: dwrite d5/de/d10/f3b [0,4194304] 0 2024-08-01T06:55:57.064 INFO:tasks.workunit.client.1.smithi089.stdout:0/455: write d9/d22/f5d [723031,41679] 0 2024-08-01T06:55:57.064 INFO:tasks.workunit.client.1.smithi089.stdout:6/481: truncate d2/fe 206347 0 2024-08-01T06:55:57.065 INFO:tasks.workunit.client.1.smithi089.stdout:6/482: stat d2/d11/f1d 0 2024-08-01T06:55:57.067 INFO:tasks.workunit.client.1.smithi089.stdout:5/291: creat d5/de/d10/d33/f60 x:0 0 0 2024-08-01T06:55:57.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.067+0000 7fe85a4d8640 1 -- 172.21.15.16:0/2215715722 --> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe85402c4f0 con 0x7fe83c06d660 2024-08-01T06:55:57.068 INFO:tasks.workunit.client.1.smithi089.stdout:0/456: fsync d9/f77 0 2024-08-01T06:55:57.070 INFO:tasks.workunit.client.1.smithi089.stdout:0/457: chown d9/d40/d45/d47/f5c 0 1 2024-08-01T06:55:57.070 INFO:tasks.workunit.client.1.smithi089.stdout:5/292: rmdir d5/d13 39 2024-08-01T06:55:57.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.068+0000 7fe8517fa640 1 -- 172.21.15.16:0/2215715722 <== mgr.24423 v2:172.21.15.89:6828/2589785296 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fe85402c4f0 con 0x7fe83c06d660 2024-08-01T06:55:57.070 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:55:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T06:55:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T06:55:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T06:55:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [], 2024-08-01T06:55:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "1/23 daemons upgraded", 2024-08-01T06:55:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "", 2024-08-01T06:55:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T06:55:57.071 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:55:57.072 INFO:tasks.workunit.client.1.smithi089.stdout:0/458: write d9/d40/d25/d46/d91/d2e/f42 [930219,1939] 0 2024-08-01T06:55:57.073 INFO:tasks.workunit.client.1.smithi089.stdout:7/356: write d7/d15/f2d [2523437,64340] 0 2024-08-01T06:55:57.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.073+0000 7fe85a4d8640 1 -- 172.21.15.16:0/2215715722 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fe83c06d660 msgr2=0x7fe83c06fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:57.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.073+0000 7fe85a4d8640 1 --2- 172.21.15.16:0/2215715722 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fe83c06d660 0x7fe83c06fb20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe848000c00 tx=0x7fe8480314e0 comp rx=0 tx=0).stop 2024-08-01T06:55:57.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.073+0000 7fe85a4d8640 1 -- 172.21.15.16:0/2215715722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8540fe1e0 msgr2=0x7fe854197840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:57.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.073+0000 7fe85a4d8640 1 --2- 172.21.15.16:0/2215715722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8540fe1e0 0x7fe854197840 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe84400db70 tx=0x7fe84400a620 comp rx=0 tx=0).stop 2024-08-01T06:55:57.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.074+0000 7fe85a4d8640 1 -- 172.21.15.16:0/2215715722 shutdown_connections 2024-08-01T06:55:57.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.074+0000 7fe85a4d8640 1 --2- 172.21.15.16:0/2215715722 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fe83c06d660 0x7fe83c06fb20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:57.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.074+0000 7fe85a4d8640 1 --2- 172.21.15.16:0/2215715722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8540ff3e0 0x7fe854197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:57.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.074+0000 7fe85a4d8640 1 --2- 172.21.15.16:0/2215715722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8540fe1e0 0x7fe854197840 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:57.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.074+0000 7fe85a4d8640 1 -- 172.21.15.16:0/2215715722 >> 172.21.15.16:0/2215715722 conn(0x7fe8540f9950 msgr2=0x7fe854102a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:57.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.074+0000 7fe85a4d8640 1 -- 172.21.15.16:0/2215715722 shutdown_connections 2024-08-01T06:55:57.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.074+0000 7fe85a4d8640 1 -- 172.21.15.16:0/2215715722 wait complete. 2024-08-01T06:55:57.077 INFO:tasks.workunit.client.1.smithi089.stdout:0/459: unlink d9/d40/d25/d46/d91/d2e/f4b 0 2024-08-01T06:55:57.078 INFO:tasks.workunit.client.1.smithi089.stdout:7/357: mkdir d7/df/d10/d42/d75 0 2024-08-01T06:55:57.079 INFO:tasks.workunit.client.1.smithi089.stdout:6/483: link d2/d11/d1f/d46/d6b/l79 d2/d2e/d2f/d91/la8 0 2024-08-01T06:55:57.082 INFO:tasks.workunit.client.1.smithi089.stdout:5/293: link d5/de/d10/d16/d1b/f39 d5/de/d10/d33/f61 0 2024-08-01T06:55:57.083 INFO:tasks.workunit.client.1.smithi089.stdout:0/460: dwrite d9/f33 [0,4194304] 0 2024-08-01T06:55:57.083 INFO:tasks.workunit.client.1.smithi089.stdout:5/294: chown d5/de/d10/f3b 93693 1 2024-08-01T06:55:57.084 INFO:tasks.workunit.client.1.smithi089.stdout:5/295: dread - d5/de/d10/d16/d1b/d52/f53 zero size 2024-08-01T06:55:57.087 INFO:tasks.workunit.client.1.smithi089.stdout:6/484: symlink d2/d11/d1f/la9 0 2024-08-01T06:55:57.087 INFO:tasks.workunit.client.1.smithi089.stdout:7/358: truncate d7/fb 1877990 0 2024-08-01T06:55:57.091 INFO:tasks.workunit.client.1.smithi089.stdout:5/296: creat d5/de/d10/d16/d1b/d25/f62 x:0 0 0 2024-08-01T06:55:57.092 INFO:tasks.workunit.client.1.smithi089.stdout:7/359: dread d7/df/d10/d36/f47 [0,4194304] 0 2024-08-01T06:55:57.093 INFO:tasks.workunit.client.1.smithi089.stdout:7/360: stat d7/d46/f68 0 2024-08-01T06:55:57.094 INFO:tasks.workunit.client.1.smithi089.stdout:7/361: write d7/d1f/d30/f71 [3648907,115778] 0 2024-08-01T06:55:57.098 INFO:tasks.workunit.client.1.smithi089.stdout:6/485: dread d2/d11/d1a/f29 [0,4194304] 0 2024-08-01T06:55:57.098 INFO:tasks.workunit.client.1.smithi089.stdout:5/297: truncate d5/d13/f30 342798 0 2024-08-01T06:55:57.099 INFO:tasks.workunit.client.1.smithi089.stdout:6/486: dread - d2/d30/fa3 zero size 2024-08-01T06:55:57.100 INFO:tasks.workunit.client.1.smithi089.stdout:5/298: readlink d5/l4a 0 2024-08-01T06:55:57.101 INFO:tasks.workunit.client.1.smithi089.stdout:6/487: chown d2/ca 5660810 1 2024-08-01T06:55:57.102 INFO:tasks.workunit.client.1.smithi089.stdout:5/299: mknod d5/d13/d43/c63 0 2024-08-01T06:55:57.103 INFO:tasks.workunit.client.1.smithi089.stdout:6/488: symlink d2/d2e/d7c/laa 0 2024-08-01T06:55:57.118 INFO:tasks.workunit.client.1.smithi089.stdout:5/300: getdents d5/de/d10/d16/d1b/d52 0 2024-08-01T06:55:57.124 INFO:tasks.workunit.client.1.smithi089.stdout:0/461: dwrite d9/ff [0,4194304] 0 2024-08-01T06:55:57.128 INFO:tasks.workunit.client.1.smithi089.stdout:0/462: fdatasync d9/d22/d2b/d55/d7a/f89 0 2024-08-01T06:55:57.129 INFO:tasks.workunit.client.1.smithi089.stdout:6/489: truncate d2/d2e/d2f/d31/f44 2327403 0 2024-08-01T06:55:57.133 INFO:tasks.workunit.client.1.smithi089.stdout:0/463: dwrite d9/f17 [0,4194304] 0 2024-08-01T06:55:57.134 INFO:tasks.workunit.client.1.smithi089.stdout:6/490: dread d2/d11/d1a/d1c/d40/f48 [0,4194304] 0 2024-08-01T06:55:57.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:56 smithi089 ceph-mon[36617]: from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:55:57.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:56 smithi089 ceph-mon[36617]: from='client.24459 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:55:57.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:56 smithi089 ceph-mon[36617]: pgmap v12: 65 pgs: 65 active+clean; 759 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 9.9 MiB/s rd, 99 MiB/s wr, 408 op/s 2024-08-01T06:55:57.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:56 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/3439563304' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:55:57.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:56 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/1548856165' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:55:57.141 INFO:tasks.workunit.client.1.smithi089.stdout:0/464: mknod d9/d40/d25/d46/d91/d64/d6b/c93 0 2024-08-01T06:55:57.142 INFO:tasks.workunit.client.1.smithi089.stdout:5/301: dwrite d5/d13/f2b [0,4194304] 0 2024-08-01T06:55:57.143 INFO:tasks.workunit.client.1.smithi089.stdout:6/491: rename d2/d11/d1a/d1c/c4a to d2/d2e/d2f/d31/cab 0 2024-08-01T06:55:57.144 INFO:tasks.workunit.client.1.smithi089.stdout:0/465: fdatasync d9/d22/f73 0 2024-08-01T06:55:57.146 INFO:tasks.workunit.client.1.smithi089.stdout:0/466: write d9/d22/f34 [2341126,16316] 0 2024-08-01T06:55:57.147 INFO:tasks.workunit.client.1.smithi089.stdout:6/492: rmdir d2/d11/d1a/d1c/d40 39 2024-08-01T06:55:57.155 INFO:tasks.workunit.client.1.smithi089.stdout:6/493: dwrite d2/d11/d1a/f6a [0,4194304] 0 2024-08-01T06:55:57.155 INFO:tasks.workunit.client.1.smithi089.stdout:0/467: dwrite d9/d40/d25/d46/d91/d2e/f42 [0,4194304] 0 2024-08-01T06:55:57.157 INFO:tasks.workunit.client.1.smithi089.stdout:0/468: readlink d9/lc 0 2024-08-01T06:55:57.158 INFO:tasks.workunit.client.1.smithi089.stdout:0/469: chown d9/l1d 720 1 2024-08-01T06:55:57.162 INFO:tasks.workunit.client.1.smithi089.stdout:5/302: link d5/de/f4f d5/de/d10/d16/d1b/d25/f64 0 2024-08-01T06:55:57.166 INFO:tasks.workunit.client.1.smithi089.stdout:6/494: dwrite d2/d11/d1a/fa2 [0,4194304] 0 2024-08-01T06:55:57.169 INFO:tasks.workunit.client.1.smithi089.stdout:8/346: sync 2024-08-01T06:55:57.169 INFO:tasks.workunit.client.1.smithi089.stdout:5/303: unlink d5/de/d10/d33/f60 0 2024-08-01T06:55:57.170 INFO:tasks.workunit.client.1.smithi089.stdout:8/347: truncate d5/dc/f62 180289 0 2024-08-01T06:55:57.172 INFO:tasks.workunit.client.1.smithi089.stdout:0/470: mknod d9/d40/d25/d46/d91/c94 0 2024-08-01T06:55:57.177 INFO:tasks.workunit.client.1.smithi089.stdout:6/495: rename d2/d30/f73 to d2/d11/d1f/d46/fac 0 2024-08-01T06:55:57.183 INFO:tasks.workunit.client.1.smithi089.stdout:5/304: creat d5/d13/f65 x:0 0 0 2024-08-01T06:55:57.185 INFO:tasks.workunit.client.1.smithi089.stdout:8/348: write d5/dc/d1e/d53/f60 [85763,4700] 0 2024-08-01T06:55:57.188 INFO:tasks.workunit.client.1.smithi089.stdout:6/496: creat d2/d11/d1a/fad x:0 0 0 2024-08-01T06:55:57.194 INFO:tasks.workunit.client.1.smithi089.stdout:0/471: mkdir d9/d40/d95 0 2024-08-01T06:55:57.196 INFO:tasks.workunit.client.1.smithi089.stdout:6/497: read d2/f2b [623,25556] 0 2024-08-01T06:55:57.197 INFO:tasks.workunit.client.1.smithi089.stdout:6/498: fsync d2/d11/d1a/fa2 0 2024-08-01T06:55:57.199 INFO:tasks.workunit.client.1.smithi089.stdout:8/349: symlink d5/d15/d5e/l72 0 2024-08-01T06:55:57.199 INFO:tasks.workunit.client.1.smithi089.stdout:0/472: dwrite d9/d40/d25/d46/d91/d64/f6a [0,4194304] 0 2024-08-01T06:55:57.200 INFO:tasks.workunit.client.1.smithi089.stdout:8/350: truncate d5/f10 5206294 0 2024-08-01T06:55:57.200 INFO:tasks.workunit.client.1.smithi089.stdout:0/473: chown d9/d40/d25/d46/d91/d64/d8c 4091 1 2024-08-01T06:55:57.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.199+0000 7fee434a7640 1 -- 172.21.15.16:0/1964907817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee3c0feaf0 msgr2=0x7fee3c0feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:57.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.199+0000 7fee434a7640 1 --2- 172.21.15.16:0/1964907817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee3c0feaf0 0x7fee3c0feef0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fee38009880 tx=0x7fee3802a4b0 comp rx=0 tx=0).stop 2024-08-01T06:55:57.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.200+0000 7fee434a7640 1 -- 172.21.15.16:0/1964907817 shutdown_connections 2024-08-01T06:55:57.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.200+0000 7fee434a7640 1 --2- 172.21.15.16:0/1964907817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3c0ffcf0 0x7fee3c100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:57.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.200+0000 7fee434a7640 1 --2- 172.21.15.16:0/1964907817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee3c0feaf0 0x7fee3c0feef0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:57.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.200+0000 7fee434a7640 1 -- 172.21.15.16:0/1964907817 >> 172.21.15.16:0/1964907817 conn(0x7fee3c0fa280 msgr2=0x7fee3c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:57.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.200+0000 7fee434a7640 1 -- 172.21.15.16:0/1964907817 shutdown_connections 2024-08-01T06:55:57.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.200+0000 7fee434a7640 1 -- 172.21.15.16:0/1964907817 wait complete. 2024-08-01T06:55:57.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.200+0000 7fee434a7640 1 Processor -- start 2024-08-01T06:55:57.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.200+0000 7fee434a7640 1 -- start start 2024-08-01T06:55:57.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.201+0000 7fee434a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee3c0feaf0 0x7fee3c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:57.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.201+0000 7fee434a7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3c0ffcf0 0x7fee3c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:57.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.201+0000 7fee434a7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c19a920 con 0x7fee3c0feaf0 2024-08-01T06:55:57.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.201+0000 7fee434a7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c19aa90 con 0x7fee3c0ffcf0 2024-08-01T06:55:57.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.201+0000 7fee41243640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee3c0feaf0 0x7fee3c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:57.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.201+0000 7fee41243640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee3c0feaf0 0x7fee3c068740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53692/0 (socket says 172.21.15.16:53692) 2024-08-01T06:55:57.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.201+0000 7fee41243640 1 -- 172.21.15.16:0/3894986780 learned_addr learned my addr 172.21.15.16:0/3894986780 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:55:57.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.201+0000 7fee41243640 1 -- 172.21.15.16:0/3894986780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3c0ffcf0 msgr2=0x7fee3c19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:57.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.201+0000 7fee41243640 1 --2- 172.21.15.16:0/3894986780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3c0ffcf0 0x7fee3c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:57.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.201+0000 7fee41243640 1 -- 172.21.15.16:0/3894986780 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee38009560 con 0x7fee3c0feaf0 2024-08-01T06:55:57.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.202+0000 7fee41243640 1 --2- 172.21.15.16:0/3894986780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee3c0feaf0 0x7fee3c068740 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fee38004650 tx=0x7fee380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:57.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.202+0000 7fee327fc640 1 -- 172.21.15.16:0/3894986780 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee380051f0 con 0x7fee3c0feaf0 2024-08-01T06:55:57.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.202+0000 7fee327fc640 1 -- 172.21.15.16:0/3894986780 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee38004bb0 con 0x7fee3c0feaf0 2024-08-01T06:55:57.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.202+0000 7fee434a7640 1 -- 172.21.15.16:0/3894986780 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee3c19ad10 con 0x7fee3c0feaf0 2024-08-01T06:55:57.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.202+0000 7fee327fc640 1 -- 172.21.15.16:0/3894986780 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee380039c0 con 0x7fee3c0feaf0 2024-08-01T06:55:57.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.202+0000 7fee434a7640 1 -- 172.21.15.16:0/3894986780 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee3c194450 con 0x7fee3c0feaf0 2024-08-01T06:55:57.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.204+0000 7fee434a7640 1 -- 172.21.15.16:0/3894986780 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3c18e670 con 0x7fee3c0feaf0 2024-08-01T06:55:57.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.204+0000 7fee327fc640 1 -- 172.21.15.16:0/3894986780 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) v1 ==== 91559+0+0 (secure 0 0 0) 0x7fee38003b40 con 0x7fee3c0feaf0 2024-08-01T06:55:57.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.205+0000 7fee327fc640 1 --2- 172.21.15.16:0/3894986780 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fee2806d660 0x7fee2806fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:55:57.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.205+0000 7fee327fc640 1 -- 172.21.15.16:0/3894986780 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fee380ae750 con 0x7fee3c0feaf0 2024-08-01T06:55:57.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.206+0000 7fee40a42640 1 --2- 172.21.15.16:0/3894986780 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fee2806d660 0x7fee2806fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:55:57.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.206+0000 7fee40a42640 1 --2- 172.21.15.16:0/3894986780 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fee2806d660 0x7fee2806fb20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0058c0 tx=0x7fee2c005850 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:55:57.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.211+0000 7fee327fc640 1 -- 172.21.15.16:0/3894986780 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fee38077d60 con 0x7fee3c0feaf0 2024-08-01T06:55:57.218 INFO:tasks.workunit.client.1.smithi089.stdout:8/351: dwrite d5/f41 [0,4194304] 0 2024-08-01T06:55:57.224 INFO:tasks.workunit.client.1.smithi089.stdout:8/352: mkdir d5/d15/d5a/d73 0 2024-08-01T06:55:57.225 INFO:tasks.workunit.client.1.smithi089.stdout:5/305: dwrite d5/de/d10/f2c [0,4194304] 0 2024-08-01T06:55:57.230 INFO:tasks.workunit.client.1.smithi089.stdout:8/353: creat d5/d15/d5e/f74 x:0 0 0 2024-08-01T06:55:57.233 INFO:tasks.workunit.client.1.smithi089.stdout:5/306: dwrite d5/f3c [0,4194304] 0 2024-08-01T06:55:57.239 INFO:tasks.workunit.client.1.smithi089.stdout:5/307: unlink d5/de/d10/d16/d1b/d52/f53 0 2024-08-01T06:55:57.241 INFO:tasks.workunit.client.1.smithi089.stdout:6/499: dwrite d2/d11/f17 [0,4194304] 0 2024-08-01T06:55:57.242 INFO:tasks.workunit.client.1.smithi089.stdout:6/500: stat d2/d11/d1f/d46/d6b/d7d 0 2024-08-01T06:55:57.243 INFO:tasks.workunit.client.1.smithi089.stdout:0/474: truncate d9/d22/f29 336472 0 2024-08-01T06:55:57.253 INFO:tasks.workunit.client.1.smithi089.stdout:8/354: rename d5/dc/d12/l4f to d5/dc/d1e/l75 0 2024-08-01T06:55:57.256 INFO:tasks.workunit.client.1.smithi089.stdout:0/475: mkdir d9/d40/d25/d46/d91/d2e/d3a/d76/d96 0 2024-08-01T06:55:57.257 INFO:tasks.workunit.client.1.smithi089.stdout:8/355: dread d5/d23/f38 [0,4194304] 0 2024-08-01T06:55:57.258 INFO:tasks.workunit.client.1.smithi089.stdout:5/308: creat d5/de/d10/d16/d1b/d52/d5f/f66 x:0 0 0 2024-08-01T06:55:57.262 INFO:tasks.workunit.client.1.smithi089.stdout:6/501: rename d2/d11/d1f/d46/d6b/d7d/f93 to d2/d11/d3e/fae 0 2024-08-01T06:55:57.267 INFO:tasks.workunit.client.1.smithi089.stdout:0/476: creat d9/d40/d25/d46/d91/d2e/d3a/f97 x:0 0 0 2024-08-01T06:55:57.269 INFO:tasks.workunit.client.1.smithi089.stdout:8/356: mknod d5/dc/d12/c76 0 2024-08-01T06:55:57.274 INFO:tasks.workunit.client.1.smithi089.stdout:5/309: rename d5/de/d10/d16/d1b/d52/d5f/f66 to d5/d13/d38/d42/f67 0 2024-08-01T06:55:57.281 INFO:tasks.workunit.client.1.smithi089.stdout:8/357: chown d5/dc/l19 0 1 2024-08-01T06:55:57.284 INFO:tasks.workunit.client.1.smithi089.stdout:0/477: getdents d9/d40/d95 0 2024-08-01T06:55:57.288 INFO:tasks.workunit.client.1.smithi089.stdout:8/358: symlink d5/l77 0 2024-08-01T06:55:57.290 INFO:tasks.workunit.client.1.smithi089.stdout:6/502: getdents d2/d11/d1f/d46/d6b/d7d 0 2024-08-01T06:55:57.291 INFO:tasks.workunit.client.1.smithi089.stdout:0/478: mknod d9/d40/d25/d46/d91/d64/d8c/c98 0 2024-08-01T06:55:57.292 INFO:tasks.workunit.client.1.smithi089.stdout:8/359: creat d5/d65/f78 x:0 0 0 2024-08-01T06:55:57.295 INFO:tasks.workunit.client.1.smithi089.stdout:8/360: read d5/dc/d1e/d53/f60 [46514,55672] 0 2024-08-01T06:55:57.297 INFO:tasks.workunit.client.1.smithi089.stdout:0/479: dwrite d9/d22/d2b/f43 [4194304,4194304] 0 2024-08-01T06:55:57.305 INFO:tasks.workunit.client.1.smithi089.stdout:8/361: dwrite d5/d23/f48 [0,4194304] 0 2024-08-01T06:55:57.305 INFO:tasks.workunit.client.1.smithi089.stdout:3/278: sync 2024-08-01T06:55:57.312 INFO:tasks.workunit.client.1.smithi089.stdout:8/362: creat d5/d15/d5a/d73/f79 x:0 0 0 2024-08-01T06:55:57.313 INFO:tasks.workunit.client.1.smithi089.stdout:3/279: mkdir d7/d32/d23/d31/d50/d54 0 2024-08-01T06:55:57.316 INFO:tasks.workunit.client.1.smithi089.stdout:0/480: dread d9/d22/f34 [0,4194304] 0 2024-08-01T06:55:57.317 INFO:tasks.workunit.client.1.smithi089.stdout:6/503: dwrite d2/d11/d1a/d1c/f52 [0,4194304] 0 2024-08-01T06:55:57.321 INFO:tasks.workunit.client.1.smithi089.stdout:0/481: rename d9/d22 to d9/d40/d95/d99 0 2024-08-01T06:55:57.321 INFO:tasks.workunit.client.1.smithi089.stdout:8/363: link d5/dc/d12/l71 d5/d15/d58/l7a 0 2024-08-01T06:55:57.324 INFO:tasks.workunit.client.1.smithi089.stdout:3/280: dwrite d7/d32/d12/f33 [0,4194304] 0 2024-08-01T06:55:57.328 INFO:tasks.workunit.client.1.smithi089.stdout:8/364: symlink d5/d15/d5a/l7b 0 2024-08-01T06:55:57.328 INFO:tasks.workunit.client.1.smithi089.stdout:6/504: dwrite d2/d11/d1f/f77 [0,4194304] 0 2024-08-01T06:55:57.331 INFO:tasks.workunit.client.1.smithi089.stdout:0/482: creat d9/d40/d25/d46/d91/d2e/d44/d53/f9a x:0 0 0 2024-08-01T06:55:57.333 INFO:tasks.workunit.client.1.smithi089.stdout:0/483: truncate d9/d40/d95/d99/d2b/d55/d7a/f89 419465 0 2024-08-01T06:55:57.333 INFO:tasks.workunit.client.1.smithi089.stdout:3/281: mkdir d7/dd/d55 0 2024-08-01T06:55:57.334 INFO:tasks.workunit.client.1.smithi089.stdout:0/484: chown d9/d40/d25/d46/d91/d2e/f36 17839421 1 2024-08-01T06:55:57.336 INFO:tasks.workunit.client.1.smithi089.stdout:8/365: mknod d5/d15/d5e/c7c 0 2024-08-01T06:55:57.342 INFO:tasks.workunit.client.1.smithi089.stdout:0/485: rmdir d9/d40/d25/d46/d91/d2e/d44 39 2024-08-01T06:55:57.349 INFO:tasks.workunit.client.1.smithi089.stdout:8/366: mknod d5/c7d 0 2024-08-01T06:55:57.350 INFO:tasks.workunit.client.1.smithi089.stdout:6/505: creat d2/d11/d1a/d1c/faf x:0 0 0 2024-08-01T06:55:57.351 INFO:tasks.workunit.client.1.smithi089.stdout:6/506: write d2/d30/fa1 [634504,119410] 0 2024-08-01T06:55:57.351 INFO:tasks.workunit.client.1.smithi089.stdout:3/282: creat d7/dd/f56 x:0 0 0 2024-08-01T06:55:57.352 INFO:tasks.workunit.client.1.smithi089.stdout:6/507: fdatasync d2/d11/d1f/d46/f4b 0 2024-08-01T06:55:57.355 INFO:tasks.workunit.client.1.smithi089.stdout:0/486: rename d9/d40/d95/d99/d2b/d55/l57 to d9/d40/d25/d46/d91/d2e/d44/d53/l9b 0 2024-08-01T06:55:57.362 INFO:tasks.workunit.client.1.smithi089.stdout:0/487: creat d9/d40/d25/d46/d91/d2e/d3a/d76/d96/f9c x:0 0 0 2024-08-01T06:55:57.363 INFO:tasks.workunit.client.1.smithi089.stdout:0/488: readlink d9/d40/d25/d46/d91/d2e/d3a/l90 0 2024-08-01T06:55:57.365 INFO:tasks.workunit.client.1.smithi089.stdout:0/489: mkdir d9/d40/d45/d47/d9d 0 2024-08-01T06:55:57.368 INFO:tasks.workunit.client.1.smithi089.stdout:0/490: creat d9/d40/d25/d46/d91/d2e/d44/d72/d8b/f9e x:0 0 0 2024-08-01T06:55:57.369 INFO:tasks.workunit.client.1.smithi089.stdout:0/491: write d9/d40/d25/d46/d91/f69 [4985415,16818] 0 2024-08-01T06:55:57.373 INFO:tasks.workunit.client.1.smithi089.stdout:0/492: unlink d9/d40/d25/d46/f3c 0 2024-08-01T06:55:57.374 INFO:tasks.workunit.client.1.smithi089.stdout:8/367: write d5/dc/f16 [2070256,49107] 0 2024-08-01T06:55:57.378 INFO:tasks.workunit.client.1.smithi089.stdout:8/368: rename d5/dc/d1e/l3f to d5/d15/d5a/d73/l7e 0 2024-08-01T06:55:57.380 INFO:tasks.workunit.client.1.smithi089.stdout:0/493: dread d9/d40/f27 [0,4194304] 0 2024-08-01T06:55:57.380 INFO:tasks.workunit.client.1.smithi089.stdout:8/369: write d5/d15/d58/f32 [1097935,121910] 0 2024-08-01T06:55:57.384 INFO:tasks.workunit.client.1.smithi089.stdout:0/494: rename d9/d40/d25/d46/d91/d64/d6b to d9/d40/d25/d46/d91/d2e/d44/d53/d9f 0 2024-08-01T06:55:57.455 INFO:tasks.workunit.client.1.smithi089.stdout:9/380: sync 2024-08-01T06:55:57.455 INFO:tasks.workunit.client.1.smithi089.stdout:7/362: sync 2024-08-01T06:55:57.455 INFO:tasks.workunit.client.1.smithi089.stdout:2/333: sync 2024-08-01T06:55:57.455 INFO:tasks.workunit.client.1.smithi089.stdout:1/457: sync 2024-08-01T06:55:57.455 INFO:tasks.workunit.client.1.smithi089.stdout:4/458: sync 2024-08-01T06:55:57.458 INFO:tasks.workunit.client.1.smithi089.stdout:2/334: mknod d7/d1f/d52/c6b 0 2024-08-01T06:55:57.459 INFO:tasks.workunit.client.1.smithi089.stdout:1/458: write d0/d9/d15/d2d/f36 [77326,81619] 0 2024-08-01T06:55:57.460 INFO:tasks.workunit.client.1.smithi089.stdout:9/381: symlink d18/d22/d39/d50/d75/l76 0 2024-08-01T06:55:57.463 INFO:tasks.workunit.client.1.smithi089.stdout:9/382: write d18/d3d/f5d [1732234,79418] 0 2024-08-01T06:55:57.465 INFO:tasks.workunit.client.1.smithi089.stdout:1/459: mkdir d0/d9/d15/d3b/d95/d99 0 2024-08-01T06:55:57.467 INFO:tasks.workunit.client.1.smithi089.stdout:4/459: dwrite d3/db/de/d5b/f74 [0,4194304] 0 2024-08-01T06:55:57.467 INFO:tasks.workunit.client.1.smithi089.stdout:2/335: creat d7/d1f/f6c x:0 0 0 2024-08-01T06:55:57.470 INFO:tasks.workunit.client.1.smithi089.stdout:9/383: creat d18/d22/d39/d50/f77 x:0 0 0 2024-08-01T06:55:57.470 INFO:tasks.workunit.client.1.smithi089.stdout:2/336: stat d7/d1f/d29/c25 0 2024-08-01T06:55:57.471 INFO:tasks.workunit.client.1.smithi089.stdout:1/460: truncate d0/d9/d15/d76/f88 86403 0 2024-08-01T06:55:57.471 INFO:tasks.workunit.client.1.smithi089.stdout:9/384: fdatasync d18/d22/d39/f3a 0 2024-08-01T06:55:57.472 INFO:tasks.workunit.client.1.smithi089.stdout:9/385: chown d18/d22/c25 1330122 1 2024-08-01T06:55:57.472 INFO:tasks.workunit.client.1.smithi089.stdout:4/460: mkdir d3/d17/d71/d92 0 2024-08-01T06:55:57.477 INFO:tasks.workunit.client.1.smithi089.stdout:1/461: creat d0/d9/d15/d76/f9a x:0 0 0 2024-08-01T06:55:57.482 INFO:tasks.workunit.client.1.smithi089.stdout:2/337: creat d7/d4a/f6d x:0 0 0 2024-08-01T06:55:57.483 INFO:tasks.workunit.client.1.smithi089.stdout:1/462: rename d0/c32 to d0/d9/d43/d4b/c9b 0 2024-08-01T06:55:57.484 INFO:tasks.workunit.client.1.smithi089.stdout:1/463: fsync d0/d9/d15/d76/f80 0 2024-08-01T06:55:57.507 INFO:tasks.workunit.client.1.smithi089.stdout:2/338: fsync d7/d1f/f6c 0 2024-08-01T06:55:57.512 INFO:tasks.workunit.client.1.smithi089.stdout:4/461: write d3/d1e/f6e [2046322,91678] 0 2024-08-01T06:55:57.513 INFO:tasks.workunit.client.1.smithi089.stdout:4/462: chown d3/d17/d3a/f70 505 1 2024-08-01T06:55:57.513 INFO:tasks.workunit.client.1.smithi089.stdout:4/463: chown d3/d1f/d62/d31/f4b 428 1 2024-08-01T06:55:57.514 INFO:tasks.workunit.client.1.smithi089.stdout:4/464: truncate d3/d1e/f4e 742696 0 2024-08-01T06:55:57.515 INFO:tasks.workunit.client.1.smithi089.stdout:4/465: chown d3/d86 551152 1 2024-08-01T06:55:57.515 INFO:tasks.workunit.client.1.smithi089.stdout:9/386: truncate d18/d33/f37 918107 0 2024-08-01T06:55:57.518 INFO:tasks.workunit.client.1.smithi089.stdout:4/466: unlink d3/d1e/d21/f5a 0 2024-08-01T06:55:57.518 INFO:tasks.workunit.client.1.smithi089.stdout:9/387: mknod d18/d33/d53/c78 0 2024-08-01T06:55:57.520 INFO:tasks.workunit.client.1.smithi089.stdout:4/467: readlink d3/db/d16/l47 0 2024-08-01T06:55:57.522 INFO:tasks.workunit.client.1.smithi089.stdout:9/388: rmdir d18/d22 39 2024-08-01T06:55:57.527 INFO:tasks.workunit.client.1.smithi089.stdout:9/389: symlink d18/d22/l79 0 2024-08-01T06:55:57.527 INFO:tasks.workunit.client.1.smithi089.stdout:4/468: dwrite d3/db/de/d5b/f75 [0,4194304] 0 2024-08-01T06:55:57.544 INFO:tasks.workunit.client.1.smithi089.stdout:5/310: sync 2024-08-01T06:55:57.548 INFO:tasks.workunit.client.1.smithi089.stdout:1/464: dread d0/d9/f87 [0,4194304] 0 2024-08-01T06:55:57.549 INFO:tasks.workunit.client.1.smithi089.stdout:5/311: getdents d5/de/d10/d33 0 2024-08-01T06:55:57.552 INFO:tasks.workunit.client.1.smithi089.stdout:5/312: creat d5/de/d10/d16/d1b/d25/f68 x:0 0 0 2024-08-01T06:55:57.554 INFO:tasks.workunit.client.1.smithi089.stdout:5/313: symlink d5/de/df/l69 0 2024-08-01T06:55:57.555 INFO:tasks.workunit.client.1.smithi089.stdout:2/339: write d7/f23 [3798761,129373] 0 2024-08-01T06:55:57.557 INFO:tasks.workunit.client.1.smithi089.stdout:2/340: write f2 [644296,12958] 0 2024-08-01T06:55:57.561 INFO:tasks.workunit.client.1.smithi089.stdout:2/341: mkdir d7/d1f/d52/d6e 0 2024-08-01T06:55:57.564 INFO:tasks.workunit.client.1.smithi089.stdout:5/314: getdents d5/de 0 2024-08-01T06:55:57.564 INFO:tasks.workunit.client.1.smithi089.stdout:5/315: stat d5/d13/c3f 0 2024-08-01T06:55:57.565 INFO:tasks.workunit.client.1.smithi089.stdout:2/342: truncate d7/d1f/d29/f43 5169471 0 2024-08-01T06:55:57.566 INFO:tasks.workunit.client.1.smithi089.stdout:5/316: read d5/de/d10/f3d [3104561,33785] 0 2024-08-01T06:55:57.566 INFO:tasks.workunit.client.1.smithi089.stdout:2/343: fdatasync d7/d19/d1e/d5b/f69 0 2024-08-01T06:55:57.566 INFO:tasks.workunit.client.1.smithi089.stdout:5/317: readlink d5/d13/d38/l21 0 2024-08-01T06:55:57.567 INFO:tasks.workunit.client.1.smithi089.stdout:4/469: write d3/d1e/d21/f6d [4442386,113871] 0 2024-08-01T06:55:57.571 INFO:tasks.workunit.client.1.smithi089.stdout:2/344: truncate d7/d19/d1e/f30 1711063 0 2024-08-01T06:55:57.578 INFO:tasks.workunit.client.1.smithi089.stdout:4/470: dwrite d3/db/de/d5b/f75 [0,4194304] 0 2024-08-01T06:55:57.578 INFO:tasks.workunit.client.1.smithi089.stdout:1/465: write d0/d9/d15/d2d/d4a/f47 [2475619,5330] 0 2024-08-01T06:55:57.578 INFO:tasks.workunit.client.1.smithi089.stdout:4/471: symlink d3/db/d33/l93 0 2024-08-01T06:55:57.578 INFO:tasks.workunit.client.1.smithi089.stdout:1/466: write d0/d9/d15/d2d/f53 [570592,95324] 0 2024-08-01T06:55:57.589 INFO:tasks.workunit.client.1.smithi089.stdout:5/318: write d5/de/d10/d16/d1b/f2e [2711677,69711] 0 2024-08-01T06:55:57.589 INFO:tasks.workunit.client.1.smithi089.stdout:9/390: dwrite d18/d33/f37 [0,4194304] 0 2024-08-01T06:55:57.590 INFO:tasks.workunit.client.1.smithi089.stdout:2/345: dread d7/d19/f37 [0,4194304] 0 2024-08-01T06:55:57.592 INFO:tasks.workunit.client.1.smithi089.stdout:1/467: link d0/d9/la d0/d9/d15/d2d/d4a/l9c 0 2024-08-01T06:55:57.594 INFO:tasks.workunit.client.1.smithi089.stdout:1/468: write d0/d9/d15/d2d/d4a/f75 [1523827,88754] 0 2024-08-01T06:55:57.595 INFO:tasks.workunit.client.1.smithi089.stdout:5/319: unlink d5/de/d10/f3b 0 2024-08-01T06:55:57.596 INFO:tasks.workunit.client.1.smithi089.stdout:1/469: dread d0/d9/d15/d2d/f36 [0,4194304] 0 2024-08-01T06:55:57.597 INFO:tasks.workunit.client.1.smithi089.stdout:6/508: sync 2024-08-01T06:55:57.597 INFO:tasks.workunit.client.1.smithi089.stdout:3/283: sync 2024-08-01T06:55:57.598 INFO:tasks.workunit.client.1.smithi089.stdout:2/346: mkdir d7/d19/d68/d6f 0 2024-08-01T06:55:57.604 INFO:tasks.workunit.client.1.smithi089.stdout:4/472: dread d3/db/d16/f1a [0,4194304] 0 2024-08-01T06:55:57.605 INFO:tasks.workunit.client.1.smithi089.stdout:9/391: mknod d18/d33/d6e/c7a 0 2024-08-01T06:55:57.606 INFO:tasks.workunit.client.1.smithi089.stdout:1/470: dwrite d0/d9/d15/d2d/f36 [0,4194304] 0 2024-08-01T06:55:57.606 INFO:tasks.workunit.client.1.smithi089.stdout:6/509: write d2/f18 [8559705,23407] 0 2024-08-01T06:55:57.609 INFO:tasks.workunit.client.1.smithi089.stdout:3/284: rmdir d7/d32/d12/d29/d39 39 2024-08-01T06:55:57.614 INFO:tasks.workunit.client.1.smithi089.stdout:5/320: symlink d5/l6a 0 2024-08-01T06:55:57.614 INFO:tasks.workunit.client.1.smithi089.stdout:4/473: symlink d3/d68/l94 0 2024-08-01T06:55:57.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.613+0000 7fee434a7640 1 -- 172.21.15.16:0/3894986780 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fee3c107950 con 0x7fee3c0feaf0 2024-08-01T06:55:57.615 INFO:tasks.workunit.client.1.smithi089.stdout:4/474: fdatasync d3/d1f/d62/d31/f67 0 2024-08-01T06:55:57.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.614+0000 7fee327fc640 1 -- 172.21.15.16:0/3894986780 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fee3807b420 con 0x7fee3c0feaf0 2024-08-01T06:55:57.615 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-08-01T06:55:57.616 INFO:tasks.workunit.client.1.smithi089.stdout:1/471: read d0/d9/f30 [1916935,103668] 0 2024-08-01T06:55:57.617 INFO:tasks.workunit.client.1.smithi089.stdout:6/510: creat d2/d2e/d7c/fb0 x:0 0 0 2024-08-01T06:55:57.617 INFO:tasks.workunit.client.1.smithi089.stdout:1/472: dread - d0/d9/d15/d76/f80 zero size 2024-08-01T06:55:57.618 INFO:tasks.workunit.client.1.smithi089.stdout:1/473: chown d0/d9/d15/d2d/d4a/d4d/l96 27291 1 2024-08-01T06:55:57.618 INFO:tasks.workunit.client.1.smithi089.stdout:6/511: truncate d2/d11/d1a/d1c/fa4 795362 0 2024-08-01T06:55:57.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.618+0000 7fee434a7640 1 -- 172.21.15.16:0/3894986780 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fee2806d660 msgr2=0x7fee2806fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:57.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.618+0000 7fee434a7640 1 --2- 172.21.15.16:0/3894986780 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fee2806d660 0x7fee2806fb20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0058c0 tx=0x7fee2c005850 comp rx=0 tx=0).stop 2024-08-01T06:55:57.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.618+0000 7fee434a7640 1 -- 172.21.15.16:0/3894986780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee3c0feaf0 msgr2=0x7fee3c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:55:57.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.618+0000 7fee434a7640 1 --2- 172.21.15.16:0/3894986780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee3c0feaf0 0x7fee3c068740 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fee38004650 tx=0x7fee380046c0 comp rx=0 tx=0).stop 2024-08-01T06:55:57.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.618+0000 7fee434a7640 1 -- 172.21.15.16:0/3894986780 shutdown_connections 2024-08-01T06:55:57.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.618+0000 7fee434a7640 1 --2- 172.21.15.16:0/3894986780 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fee2806d660 0x7fee2806fb20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:57.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.618+0000 7fee434a7640 1 --2- 172.21.15.16:0/3894986780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee3c0ffcf0 0x7fee3c19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:57.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.618+0000 7fee434a7640 1 --2- 172.21.15.16:0/3894986780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee3c0feaf0 0x7fee3c068740 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:55:57.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.618+0000 7fee434a7640 1 -- 172.21.15.16:0/3894986780 >> 172.21.15.16:0/3894986780 conn(0x7fee3c0fa280 msgr2=0x7fee3c1033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:55:57.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.618+0000 7fee434a7640 1 -- 172.21.15.16:0/3894986780 shutdown_connections 2024-08-01T06:55:57.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:55:57.618+0000 7fee434a7640 1 -- 172.21.15.16:0/3894986780 wait complete. 2024-08-01T06:55:57.622 INFO:tasks.workunit.client.1.smithi089.stdout:9/392: rename d18/d3d to d18/d33/d49/d7b 0 2024-08-01T06:55:57.626 INFO:tasks.workunit.client.1.smithi089.stdout:9/393: chown d18/f1d 24433 1 2024-08-01T06:55:57.628 INFO:tasks.workunit.client.1.smithi089.stdout:4/475: creat d3/d1e/f95 x:0 0 0 2024-08-01T06:55:57.628 INFO:tasks.workunit.client.1.smithi089.stdout:4/476: readlink d3/d17/d3a/l53 0 2024-08-01T06:55:57.629 INFO:tasks.workunit.client.1.smithi089.stdout:4/477: truncate d3/d1f/d62/d31/f67 1149440 0 2024-08-01T06:55:57.630 INFO:tasks.workunit.client.1.smithi089.stdout:1/474: symlink d0/d9/d15/d7a/l9d 0 2024-08-01T06:55:57.633 INFO:tasks.workunit.client.1.smithi089.stdout:2/347: link d7/d1f/d29/f15 d7/d19/d1e/f70 0 2024-08-01T06:55:57.634 INFO:tasks.workunit.client.1.smithi089.stdout:4/478: dwrite d3/d17/f20 [0,4194304] 0 2024-08-01T06:55:57.636 INFO:tasks.workunit.client.1.smithi089.stdout:5/321: truncate d5/d13/f30 817201 0 2024-08-01T06:55:57.636 INFO:tasks.workunit.client.1.smithi089.stdout:4/479: truncate d3/d1f/d62/d31/f89 858477 0 2024-08-01T06:55:57.638 INFO:tasks.workunit.client.1.smithi089.stdout:1/475: creat d0/d9/d15/d2d/d4a/d61/f9e x:0 0 0 2024-08-01T06:55:57.640 INFO:tasks.workunit.client.1.smithi089.stdout:3/285: rename d7/d32/d12/d1b/l2c to d7/d32/d23/d31/d50/d54/l57 0 2024-08-01T06:55:57.641 INFO:tasks.workunit.client.1.smithi089.stdout:2/348: creat d7/d1f/d28/f71 x:0 0 0 2024-08-01T06:55:57.644 INFO:tasks.workunit.client.1.smithi089.stdout:5/322: symlink d5/de/d10/d16/d1b/d25/d4d/l6b 0 2024-08-01T06:55:57.650 INFO:tasks.workunit.client.1.smithi089.stdout:2/349: chown d7/d19/d1e/d3d/l45 0 1 2024-08-01T06:55:57.652 INFO:tasks.workunit.client.1.smithi089.stdout:4/480: unlink d3/db/d33/c8b 0 2024-08-01T06:55:57.653 INFO:tasks.workunit.client.1.smithi089.stdout:3/286: dwrite d7/dd/f2e [0,4194304] 0 2024-08-01T06:55:57.655 INFO:tasks.workunit.client.1.smithi089.stdout:1/476: creat d0/d9/d15/d3b/d95/d99/f9f x:0 0 0 2024-08-01T06:55:57.656 INFO:tasks.workunit.client.1.smithi089.stdout:5/323: mkdir d5/de/d10/d16/d1b/d52/d5d/d6c 0 2024-08-01T06:55:57.658 INFO:tasks.workunit.client.1.smithi089.stdout:2/350: dwrite d7/d1f/f4b [0,4194304] 0 2024-08-01T06:55:57.658 INFO:tasks.workunit.client.1.smithi089.stdout:3/287: fsync d7/d32/d23/f49 0 2024-08-01T06:55:57.663 INFO:tasks.workunit.client.1.smithi089.stdout:9/394: truncate d18/d22/f38 1577106 0 2024-08-01T06:55:57.664 INFO:tasks.workunit.client.1.smithi089.stdout:5/324: creat d5/d13/d38/f6d x:0 0 0 2024-08-01T06:55:57.665 INFO:tasks.workunit.client.1.smithi089.stdout:5/325: chown d5/de/d10/d16/d1b/d25 12267 1 2024-08-01T06:55:57.668 INFO:tasks.workunit.client.1.smithi089.stdout:3/288: creat d7/d32/d23/f58 x:0 0 0 2024-08-01T06:55:57.668 INFO:tasks.workunit.client.1.smithi089.stdout:9/395: truncate d18/d22/f28 3852894 0 2024-08-01T06:55:57.669 INFO:tasks.workunit.client.1.smithi089.stdout:5/326: creat d5/de/d10/d33/f6e x:0 0 0 2024-08-01T06:55:57.670 INFO:tasks.workunit.client.1.smithi089.stdout:4/481: getdents d3/d68 0 2024-08-01T06:55:57.671 INFO:tasks.workunit.client.1.smithi089.stdout:4/482: fdatasync d3/d1f/f7c 0 2024-08-01T06:55:57.674 INFO:tasks.workunit.client.1.smithi089.stdout:5/327: link d5/de/d10/d16/d1b/d25/c36 d5/de/d10/c6f 0 2024-08-01T06:55:57.676 INFO:tasks.workunit.client.1.smithi089.stdout:5/328: write d5/de/d10/d16/f44 [4959028,72662] 0 2024-08-01T06:55:57.679 INFO:tasks.workunit.client.1.smithi089.stdout:5/329: write d5/de/f34 [4087344,97999] 0 2024-08-01T06:55:57.680 INFO:tasks.workunit.client.1.smithi089.stdout:4/483: dwrite d3/d1e/d21/d57/f5e [0,4194304] 0 2024-08-01T06:55:57.683 INFO:tasks.workunit.client.1.smithi089.stdout:5/330: creat d5/de/d10/d16/d1b/d25/f70 x:0 0 0 2024-08-01T06:55:57.684 INFO:tasks.workunit.client.1.smithi089.stdout:4/484: rename d3/d1f/d62/d31/l78 to d3/d1f/d62/d31/l96 0 2024-08-01T06:55:57.685 INFO:tasks.workunit.client.1.smithi089.stdout:5/331: mknod d5/de/df/c71 0 2024-08-01T06:55:57.686 INFO:tasks.workunit.client.1.smithi089.stdout:5/332: dread - d5/d13/d38/f6d zero size 2024-08-01T06:55:57.688 INFO:tasks.workunit.client.1.smithi089.stdout:5/333: fsync d5/de/d10/d16/d1b/d25/f68 0 2024-08-01T06:55:57.689 INFO:tasks.workunit.client.1.smithi089.stdout:4/485: truncate d3/d1f/d62/f2a 1663219 0 2024-08-01T06:55:57.691 INFO:tasks.workunit.client.1.smithi089.stdout:4/486: dread d3/db/d16/f4f [4194304,4194304] 0 2024-08-01T06:55:57.692 INFO:tasks.workunit.client.1.smithi089.stdout:5/334: mknod d5/de/d57/c72 0 2024-08-01T06:55:57.702 INFO:tasks.workunit.client.1.smithi089.stdout:2/351: dwrite d7/d19/f40 [0,4194304] 0 2024-08-01T06:55:57.705 INFO:tasks.workunit.client.1.smithi089.stdout:2/352: mkdir d7/d1f/d52/d72 0 2024-08-01T06:55:57.707 INFO:tasks.workunit.client.1.smithi089.stdout:2/353: unlink d7/d1f/d29/c24 0 2024-08-01T06:55:57.708 INFO:tasks.workunit.client.1.smithi089.stdout:2/354: readlink d7/d19/d68/l6a 0 2024-08-01T06:55:57.709 INFO:tasks.workunit.client.1.smithi089.stdout:5/335: rmdir d5/de/df 39 2024-08-01T06:55:57.712 INFO:tasks.workunit.client.1.smithi089.stdout:2/355: mkdir d7/d73 0 2024-08-01T06:55:57.717 INFO:tasks.workunit.client.1.smithi089.stdout:2/356: truncate d7/d1f/d29/f43 4181566 0 2024-08-01T06:55:57.720 INFO:tasks.workunit.client.1.smithi089.stdout:2/357: rmdir d7/d19 39 2024-08-01T06:55:57.727 INFO:tasks.workunit.client.1.smithi089.stdout:2/358: dwrite d7/d19/d3b/f50 [0,4194304] 0 2024-08-01T06:55:57.730 INFO:tasks.workunit.client.1.smithi089.stdout:2/359: creat d7/d73/f74 x:0 0 0 2024-08-01T06:55:57.730 INFO:tasks.workunit.client.1.smithi089.stdout:2/360: chown d7/d19 14885 1 2024-08-01T06:55:57.733 INFO:tasks.workunit.client.1.smithi089.stdout:5/336: dwrite d5/de/d10/d16/d1b/d25/f64 [0,4194304] 0 2024-08-01T06:55:57.733 INFO:tasks.workunit.client.1.smithi089.stdout:5/337: fdatasync d5/d13/f65 0 2024-08-01T06:55:57.739 INFO:tasks.workunit.client.1.smithi089.stdout:5/338: rename d5/de/d10/d33/f61 to d5/f73 0 2024-08-01T06:55:57.740 INFO:tasks.workunit.client.1.smithi089.stdout:5/339: write d5/d13/f2b [1081086,68115] 0 2024-08-01T06:55:57.746 INFO:tasks.workunit.client.1.smithi089.stdout:8/370: sync 2024-08-01T06:55:57.746 INFO:tasks.workunit.client.1.smithi089.stdout:0/495: sync 2024-08-01T06:55:57.746 INFO:tasks.workunit.client.1.smithi089.stdout:7/363: sync 2024-08-01T06:55:57.746 INFO:tasks.workunit.client.1.smithi089.stdout:5/340: dwrite d5/d13/d38/d42/f55 [0,4194304] 0 2024-08-01T06:55:57.750 INFO:tasks.workunit.client.1.smithi089.stdout:2/361: dread d7/d19/f44 [0,4194304] 0 2024-08-01T06:55:57.757 INFO:tasks.workunit.client.1.smithi089.stdout:5/341: dwrite d5/de/f34 [0,4194304] 0 2024-08-01T06:55:57.757 INFO:tasks.workunit.client.1.smithi089.stdout:5/342: readlink l2 0 2024-08-01T06:55:57.757 INFO:tasks.workunit.client.1.smithi089.stdout:2/362: creat d7/d1f/d52/d6e/f75 x:0 0 0 2024-08-01T06:55:57.758 INFO:tasks.workunit.client.1.smithi089.stdout:5/343: chown d5/de/d10/d33/c5a 789 1 2024-08-01T06:55:57.759 INFO:tasks.workunit.client.1.smithi089.stdout:8/371: truncate d5/f29 3813396 0 2024-08-01T06:55:57.761 INFO:tasks.workunit.client.1.smithi089.stdout:5/344: write d5/f3c [654317,74639] 0 2024-08-01T06:55:57.762 INFO:tasks.workunit.client.1.smithi089.stdout:8/372: stat d5/d15/d5a/d73 0 2024-08-01T06:55:57.768 INFO:tasks.workunit.client.1.smithi089.stdout:2/363: truncate d7/d19/d1e/f30 758706 0 2024-08-01T06:55:57.769 INFO:tasks.workunit.client.1.smithi089.stdout:7/364: dread d7/df/d10/d36/f38 [0,4194304] 0 2024-08-01T06:55:57.769 INFO:tasks.workunit.client.1.smithi089.stdout:0/496: dwrite d9/ff [0,4194304] 0 2024-08-01T06:55:57.773 INFO:tasks.workunit.client.1.smithi089.stdout:7/365: readlink d7/df/d10/d42/l5c 0 2024-08-01T06:55:57.775 INFO:tasks.workunit.client.1.smithi089.stdout:0/497: dread - d9/d40/d25/d46/f6f zero size 2024-08-01T06:55:57.778 INFO:tasks.workunit.client.1.smithi089.stdout:8/373: creat d5/dc/d1e/f7f x:0 0 0 2024-08-01T06:55:57.779 INFO:tasks.workunit.client.1.smithi089.stdout:0/498: creat d9/d40/d45/fa0 x:0 0 0 2024-08-01T06:55:57.780 INFO:tasks.workunit.client.1.smithi089.stdout:5/345: dwrite d5/d13/d43/f4e [0,4194304] 0 2024-08-01T06:55:57.782 INFO:tasks.workunit.client.1.smithi089.stdout:2/364: mknod d7/d1f/d29/d48/d4e/d64/c76 0 2024-08-01T06:55:57.784 INFO:tasks.workunit.client.1.smithi089.stdout:7/366: symlink d7/df/d10/d42/d75/l76 0 2024-08-01T06:55:57.787 INFO:tasks.workunit.client.1.smithi089.stdout:5/346: unlink l2 0 2024-08-01T06:55:57.789 INFO:tasks.workunit.client.1.smithi089.stdout:0/499: unlink d9/d40/d25/d46/d91/f79 0 2024-08-01T06:55:57.789 INFO:tasks.workunit.client.1.smithi089.stdout:5/347: write d5/d13/f31 [2195444,129608] 0 2024-08-01T06:55:57.790 INFO:tasks.workunit.client.1.smithi089.stdout:0/500: readlink d9/l15 0 2024-08-01T06:55:57.792 INFO:tasks.workunit.client.1.smithi089.stdout:7/367: dwrite f4 [0,4194304] 0 2024-08-01T06:55:57.798 INFO:tasks.workunit.client.1.smithi089.stdout:0/501: getdents d9/d40/d25/d46/d91/d2e 0 2024-08-01T06:55:57.799 INFO:tasks.workunit.client.1.smithi089.stdout:7/368: getdents d7/df/d3b/d64 0 2024-08-01T06:55:57.801 INFO:tasks.workunit.client.1.smithi089.stdout:7/369: write d7/d1f/f1a [951708,96867] 0 2024-08-01T06:55:57.801 INFO:tasks.workunit.client.1.smithi089.stdout:7/370: chown d7/d15 1454289 1 2024-08-01T06:55:57.803 INFO:tasks.workunit.client.1.smithi089.stdout:8/374: rmdir d5/dc/d1e 39 2024-08-01T06:55:57.806 INFO:tasks.workunit.client.1.smithi089.stdout:8/375: truncate d5/d15/d5a/f68 470986 0 2024-08-01T06:55:57.809 INFO:tasks.workunit.client.1.smithi089.stdout:8/376: write d5/d15/f1f [205533,104182] 0 2024-08-01T06:55:57.810 INFO:tasks.workunit.client.1.smithi089.stdout:7/371: dwrite d7/df/d10/d36/f44 [0,4194304] 0 2024-08-01T06:55:57.813 INFO:tasks.workunit.client.1.smithi089.stdout:7/372: chown d7/d15/f2d 115046209 1 2024-08-01T06:55:57.817 INFO:tasks.workunit.client.1.smithi089.stdout:8/377: mknod d5/d15/d5a/d73/c80 0 2024-08-01T06:55:57.818 INFO:tasks.workunit.client.1.smithi089.stdout:5/348: truncate d5/f3c 3627124 0 2024-08-01T06:55:57.821 INFO:tasks.workunit.client.1.smithi089.stdout:8/378: truncate d5/d15/d5e/f69 786500 0 2024-08-01T06:55:57.827 INFO:tasks.workunit.client.1.smithi089.stdout:0/502: dwrite d9/d40/d95/d99/d2b/f48 [0,4194304] 0 2024-08-01T06:55:57.827 INFO:tasks.workunit.client.1.smithi089.stdout:8/379: rename d5/f3a to d5/dc/d12/f81 0 2024-08-01T06:55:57.828 INFO:tasks.workunit.client.1.smithi089.stdout:2/365: dread d7/d19/d1e/f30 [0,4194304] 0 2024-08-01T06:55:57.828 INFO:tasks.workunit.client.1.smithi089.stdout:7/373: dread d7/fb [0,4194304] 0 2024-08-01T06:55:57.837 INFO:tasks.workunit.client.1.smithi089.stdout:2/366: chown d7/d1f/d28/l5f 3109417 1 2024-08-01T06:55:57.839 INFO:tasks.workunit.client.1.smithi089.stdout:7/374: creat d7/df/d10/d42/d4e/f77 x:0 0 0 2024-08-01T06:55:57.839 INFO:tasks.workunit.client.1.smithi089.stdout:7/375: readlink d7/df/d10/d42/d75/l76 0 2024-08-01T06:55:57.840 INFO:tasks.workunit.client.1.smithi089.stdout:0/503: unlink d9/d40/d25/d46/d91/d2e/d44/d53/f75 0 2024-08-01T06:55:57.842 INFO:tasks.workunit.client.1.smithi089.stdout:5/349: creat d5/de/d10/d16/d1b/d25/f74 x:0 0 0 2024-08-01T06:55:57.842 INFO:tasks.workunit.client.1.smithi089.stdout:5/350: fdatasync d5/de/d10/f19 0 2024-08-01T06:55:57.846 INFO:tasks.workunit.client.1.smithi089.stdout:7/376: unlink d7/df/d10/d42/d4e/l6d 0 2024-08-01T06:55:57.848 INFO:tasks.workunit.client.1.smithi089.stdout:0/504: rename d9/f17 to d9/d40/d95/d99/fa1 0 2024-08-01T06:55:57.848 INFO:tasks.workunit.client.1.smithi089.stdout:0/505: read - d9/d40/d95/d99/d2b/d55/d7a/f84 zero size 2024-08-01T06:55:57.850 INFO:tasks.workunit.client.1.smithi089.stdout:5/351: mknod d5/de/d10/d16/d1b/d52/d5d/c75 0 2024-08-01T06:55:57.852 INFO:tasks.workunit.client.1.smithi089.stdout:7/377: mknod d7/df/d10/d31/c78 0 2024-08-01T06:55:57.853 INFO:tasks.workunit.client.1.smithi089.stdout:8/380: link d5/d15/d5e/f69 d5/d15/d58/f82 0 2024-08-01T06:55:57.854 INFO:tasks.workunit.client.1.smithi089.stdout:0/506: creat d9/d40/d25/d46/d91/d2e/d44/d53/fa2 x:0 0 0 2024-08-01T06:55:57.856 INFO:tasks.workunit.client.1.smithi089.stdout:2/367: creat d7/d1f/f77 x:0 0 0 2024-08-01T06:55:57.856 INFO:tasks.workunit.client.1.smithi089.stdout:7/378: symlink d7/d15/l79 0 2024-08-01T06:55:57.857 INFO:tasks.workunit.client.1.smithi089.stdout:5/352: read d5/d13/d38/d42/f55 [2645493,82381] 0 2024-08-01T06:55:57.858 INFO:tasks.workunit.client.1.smithi089.stdout:0/507: write d9/d40/d45/d47/f5c [1834545,127941] 0 2024-08-01T06:55:57.861 INFO:tasks.workunit.client.1.smithi089.stdout:2/368: chown d7/d1f/d28/c2a 30327 1 2024-08-01T06:55:57.861 INFO:tasks.workunit.client.1.smithi089.stdout:8/381: dwrite d5/dc/d12/f14 [4194304,4194304] 0 2024-08-01T06:55:57.861 INFO:tasks.workunit.client.1.smithi089.stdout:5/353: creat d5/de/d10/d16/d1b/f76 x:0 0 0 2024-08-01T06:55:57.862 INFO:tasks.workunit.client.1.smithi089.stdout:2/369: dread - d7/d73/f74 zero size 2024-08-01T06:55:57.862 INFO:tasks.workunit.client.1.smithi089.stdout:0/508: rmdir d9/d40/d25/d46/d91/d2e 39 2024-08-01T06:55:57.863 INFO:tasks.workunit.client.1.smithi089.stdout:8/382: write d5/d15/f1c [3554805,47058] 0 2024-08-01T06:55:57.864 INFO:tasks.workunit.client.1.smithi089.stdout:7/379: creat d7/d1f/f7a x:0 0 0 2024-08-01T06:55:57.865 INFO:tasks.workunit.client.1.smithi089.stdout:0/509: readlink d9/l15 0 2024-08-01T06:55:57.866 INFO:tasks.workunit.client.1.smithi089.stdout:5/354: read d5/de/d10/f1c [237903,46629] 0 2024-08-01T06:55:57.868 INFO:tasks.workunit.client.1.smithi089.stdout:0/510: chown d9/d40/d95/d99/d2b/d55 49278576 1 2024-08-01T06:55:57.868 INFO:tasks.workunit.client.1.smithi089.stdout:5/355: fsync d5/d13/f31 0 2024-08-01T06:55:57.870 INFO:tasks.workunit.client.1.smithi089.stdout:5/356: write d5/d13/d43/f4e [1413684,3614] 0 2024-08-01T06:55:57.872 INFO:tasks.workunit.client.1.smithi089.stdout:8/383: rename d5/dc/d12/f81 to d5/d15/f83 0 2024-08-01T06:55:57.872 INFO:tasks.workunit.client.1.smithi089.stdout:2/370: dwrite d7/d1f/d29/f49 [0,4194304] 0 2024-08-01T06:55:57.876 INFO:tasks.workunit.client.1.smithi089.stdout:2/371: read - d7/d1f/d28/f71 zero size 2024-08-01T06:55:57.878 INFO:tasks.workunit.client.1.smithi089.stdout:5/357: mkdir d5/d13/d43/d77 0 2024-08-01T06:55:57.879 INFO:tasks.workunit.client.1.smithi089.stdout:2/372: fsync d7/d19/f44 0 2024-08-01T06:55:57.882 INFO:tasks.workunit.client.1.smithi089.stdout:2/373: write d7/d1f/f20 [4118018,56696] 0 2024-08-01T06:55:57.882 INFO:tasks.workunit.client.1.smithi089.stdout:5/358: mknod d5/d13/d38/c78 0 2024-08-01T06:55:57.884 INFO:tasks.workunit.client.1.smithi089.stdout:2/374: readlink d7/d19/d1e/d3d/l42 0 2024-08-01T06:55:57.894 INFO:tasks.workunit.client.1.smithi089.stdout:5/359: getdents d5/de/d10 0 2024-08-01T06:55:57.894 INFO:tasks.workunit.client.1.smithi089.stdout:5/360: dread - d5/d13/f65 zero size 2024-08-01T06:55:57.895 INFO:tasks.workunit.client.1.smithi089.stdout:2/375: dwrite f5 [0,4194304] 0 2024-08-01T06:55:57.895 INFO:tasks.workunit.client.1.smithi089.stdout:2/376: fsync d7/f58 0 2024-08-01T06:55:57.898 INFO:tasks.workunit.client.1.smithi089.stdout:5/361: mkdir d5/d13/d79 0 2024-08-01T06:55:57.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:57 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/3894986780' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:55:57.904 INFO:tasks.workunit.client.1.smithi089.stdout:5/362: dwrite d5/de/d10/d16/f44 [0,4194304] 0 2024-08-01T06:55:57.905 INFO:tasks.workunit.client.1.smithi089.stdout:5/363: fdatasync d5/d13/f65 0 2024-08-01T06:55:57.907 INFO:tasks.workunit.client.1.smithi089.stdout:5/364: truncate d5/de/d10/d16/d1b/d25/f62 846981 0 2024-08-01T06:55:57.907 INFO:tasks.workunit.client.1.smithi089.stdout:7/380: truncate d7/df/d3b/d64/f67 31719 0 2024-08-01T06:55:57.909 INFO:tasks.workunit.client.1.smithi089.stdout:5/365: mknod d5/d13/d38/c7a 0 2024-08-01T06:55:57.910 INFO:tasks.workunit.client.1.smithi089.stdout:8/384: write d5/d15/d58/f2e [1727725,113780] 0 2024-08-01T06:55:57.913 INFO:tasks.workunit.client.1.smithi089.stdout:8/385: dread d5/d15/d5a/f68 [0,4194304] 0 2024-08-01T06:55:57.914 INFO:tasks.workunit.client.1.smithi089.stdout:5/366: chown d5/d13/d38/c2f 3414253 1 2024-08-01T06:55:57.914 INFO:tasks.workunit.client.1.smithi089.stdout:0/511: truncate d9/d40/d25/d46/d91/d2e/f30 3886091 0 2024-08-01T06:55:57.917 INFO:tasks.workunit.client.1.smithi089.stdout:8/386: mkdir d5/d15/d58/d84 0 2024-08-01T06:55:57.918 INFO:tasks.workunit.client.1.smithi089.stdout:0/512: creat d9/d40/d45/d47/fa3 x:0 0 0 2024-08-01T06:55:57.921 INFO:tasks.workunit.client.1.smithi089.stdout:7/381: dread d7/fd [0,4194304] 0 2024-08-01T06:55:57.923 INFO:tasks.workunit.client.1.smithi089.stdout:8/387: chown d5/d15/d58/f32 1597389 1 2024-08-01T06:55:57.924 INFO:tasks.workunit.client.1.smithi089.stdout:5/367: dwrite d5/de/d10/d16/d1b/d25/f74 [0,4194304] 0 2024-08-01T06:55:57.924 INFO:tasks.workunit.client.1.smithi089.stdout:7/382: unlink c1 0 2024-08-01T06:55:57.925 INFO:tasks.workunit.client.1.smithi089.stdout:0/513: creat d9/d40/d25/d46/d91/d2e/d3a/d76/d96/fa4 x:0 0 0 2024-08-01T06:55:57.928 INFO:tasks.workunit.client.1.smithi089.stdout:7/383: mkdir d7/d46/d7b 0 2024-08-01T06:55:57.930 INFO:tasks.workunit.client.1.smithi089.stdout:0/514: creat d9/d40/d25/d46/fa5 x:0 0 0 2024-08-01T06:55:57.931 INFO:tasks.workunit.client.1.smithi089.stdout:5/368: dread d5/d13/f31 [0,4194304] 0 2024-08-01T06:55:57.934 INFO:tasks.workunit.client.1.smithi089.stdout:8/388: rename d5/f29 to d5/d15/d58/f85 0 2024-08-01T06:55:57.938 INFO:tasks.workunit.client.1.smithi089.stdout:5/369: creat d5/d13/d38/d42/f7b x:0 0 0 2024-08-01T06:55:57.942 INFO:tasks.workunit.client.1.smithi089.stdout:8/389: symlink d5/d15/d58/d84/l86 0 2024-08-01T06:55:57.944 INFO:tasks.workunit.client.1.smithi089.stdout:5/370: symlink d5/l7c 0 2024-08-01T06:55:57.945 INFO:tasks.workunit.client.1.smithi089.stdout:8/390: mkdir d5/d15/d5a/d73/d87 0 2024-08-01T06:55:57.946 INFO:tasks.workunit.client.1.smithi089.stdout:8/391: readlink d5/d15/d5a/l7b 0 2024-08-01T06:55:57.946 INFO:tasks.workunit.client.1.smithi089.stdout:8/392: readlink d5/d15/l5d 0 2024-08-01T06:55:57.947 INFO:tasks.workunit.client.1.smithi089.stdout:5/371: dread - d5/de/d10/d33/f56 zero size 2024-08-01T06:55:57.949 INFO:tasks.workunit.client.1.smithi089.stdout:8/393: chown d5/d15/d5e/f69 437 1 2024-08-01T06:55:57.949 INFO:tasks.workunit.client.1.smithi089.stdout:8/394: dread - d5/d23/f49 zero size 2024-08-01T06:55:57.950 INFO:tasks.workunit.client.1.smithi089.stdout:8/395: write d5/d15/d5a/d73/f79 [168387,27395] 0 2024-08-01T06:55:57.953 INFO:tasks.workunit.client.1.smithi089.stdout:5/372: creat d5/d13/f7d x:0 0 0 2024-08-01T06:55:57.953 INFO:tasks.workunit.client.1.smithi089.stdout:7/384: write d7/d1f/f28 [468830,83068] 0 2024-08-01T06:55:57.955 INFO:tasks.workunit.client.1.smithi089.stdout:5/373: fsync d5/de/d10/d33/f56 0 2024-08-01T06:55:57.956 INFO:tasks.workunit.client.1.smithi089.stdout:7/385: mknod d7/d15/c7c 0 2024-08-01T06:55:57.957 INFO:tasks.workunit.client.1.smithi089.stdout:0/515: truncate d9/fa 4663090 0 2024-08-01T06:55:57.957 INFO:tasks.workunit.client.1.smithi089.stdout:7/386: dread - d7/d15/f39 zero size 2024-08-01T06:55:57.958 INFO:tasks.workunit.client.1.smithi089.stdout:8/396: dwrite d5/d65/f78 [0,4194304] 0 2024-08-01T06:55:57.960 INFO:tasks.workunit.client.1.smithi089.stdout:5/374: read d5/d13/f30 [175955,58007] 0 2024-08-01T06:55:57.961 INFO:tasks.workunit.client.1.smithi089.stdout:0/516: fsync d9/d40/d25/d46/d91/d2e/d44/d72/d8b/f9e 0 2024-08-01T06:55:57.961 INFO:tasks.workunit.client.1.smithi089.stdout:7/387: fdatasync d7/d1f/d30/f71 0 2024-08-01T06:55:57.962 INFO:tasks.workunit.client.1.smithi089.stdout:5/375: stat d5/de/d10/f2c 0 2024-08-01T06:55:57.965 INFO:tasks.workunit.client.1.smithi089.stdout:0/517: symlink d9/d40/d45/la6 0 2024-08-01T06:55:57.967 INFO:tasks.workunit.client.1.smithi089.stdout:8/397: unlink d5/dc/f4b 0 2024-08-01T06:55:57.968 INFO:tasks.workunit.client.1.smithi089.stdout:7/388: mknod d7/df/d10/d42/c7d 0 2024-08-01T06:55:57.971 INFO:tasks.workunit.client.1.smithi089.stdout:5/376: rename d5/d13/d43/d77 to d5/de/d10/d33/d5e/d7e 0 2024-08-01T06:55:57.972 INFO:tasks.workunit.client.1.smithi089.stdout:5/377: chown d5/d13/d38/c2d 30 1 2024-08-01T06:55:57.974 INFO:tasks.workunit.client.1.smithi089.stdout:8/398: write d5/dc/d12/f57 [790209,21003] 0 2024-08-01T06:55:57.975 INFO:tasks.workunit.client.1.smithi089.stdout:7/389: creat d7/d1f/d3a/f7e x:0 0 0 2024-08-01T06:55:57.980 INFO:tasks.workunit.client.1.smithi089.stdout:8/399: mknod d5/d15/d5a/d73/c88 0 2024-08-01T06:55:57.980 INFO:tasks.workunit.client.1.smithi089.stdout:5/378: mknod d5/de/d57/c7f 0 2024-08-01T06:55:57.982 INFO:tasks.workunit.client.1.smithi089.stdout:0/518: getdents d9/d40/d25/d46/d91 0 2024-08-01T06:55:57.983 INFO:tasks.workunit.client.1.smithi089.stdout:8/400: mknod d5/d15/c89 0 2024-08-01T06:55:57.984 INFO:tasks.workunit.client.1.smithi089.stdout:8/401: write d5/d15/d5a/d73/f79 [100814,112000] 0 2024-08-01T06:55:57.984 INFO:tasks.workunit.client.1.smithi089.stdout:5/379: unlink d5/de/d10/d16/d1b/l20 0 2024-08-01T06:55:57.986 INFO:tasks.workunit.client.1.smithi089.stdout:0/519: symlink d9/d40/d25/la7 0 2024-08-01T06:55:57.987 INFO:tasks.workunit.client.1.smithi089.stdout:0/520: fsync d9/d40/d45/d47/f5c 0 2024-08-01T06:55:57.989 INFO:tasks.workunit.client.1.smithi089.stdout:8/402: dwrite d5/d23/f36 [0,4194304] 0 2024-08-01T06:55:57.991 INFO:tasks.workunit.client.1.smithi089.stdout:8/403: write d5/d15/d5e/f74 [710594,13055] 0 2024-08-01T06:55:57.994 INFO:tasks.workunit.client.1.smithi089.stdout:5/380: creat d5/de/f80 x:0 0 0 2024-08-01T06:55:57.994 INFO:tasks.workunit.client.1.smithi089.stdout:5/381: readlink d5/d13/d38/l50 0 2024-08-01T06:55:57.995 INFO:tasks.workunit.client.1.smithi089.stdout:0/521: dwrite d9/d40/d25/d46/d91/d2e/d44/d53/f54 [0,4194304] 0 2024-08-01T06:55:57.996 INFO:tasks.workunit.client.1.smithi089.stdout:8/404: creat d5/d15/d5a/f8a x:0 0 0 2024-08-01T06:55:57.998 INFO:tasks.workunit.client.1.smithi089.stdout:0/522: mkdir d9/d40/d45/d47/da8 0 2024-08-01T06:55:58.000 INFO:tasks.workunit.client.1.smithi089.stdout:0/523: write f7 [942363,103382] 0 2024-08-01T06:55:58.002 INFO:tasks.workunit.client.1.smithi089.stdout:5/382: unlink d5/lc 0 2024-08-01T06:55:58.004 INFO:tasks.workunit.client.1.smithi089.stdout:8/405: mknod d5/c8b 0 2024-08-01T06:55:58.009 INFO:tasks.workunit.client.1.smithi089.stdout:8/406: rename d5/f5f to d5/d15/d58/f8c 0 2024-08-01T06:55:58.011 INFO:tasks.workunit.client.1.smithi089.stdout:0/524: getdents d9 0 2024-08-01T06:55:58.011 INFO:tasks.workunit.client.1.smithi089.stdout:0/525: readlink d9/l1d 0 2024-08-01T06:55:58.011 INFO:tasks.workunit.client.1.smithi089.stdout:8/407: read d5/d15/f1c [3943968,37967] 0 2024-08-01T06:55:58.012 INFO:tasks.workunit.client.1.smithi089.stdout:0/526: stat d9/d40/d25/d46/d91/c8f 0 2024-08-01T06:55:58.013 INFO:tasks.workunit.client.1.smithi089.stdout:8/408: mknod d5/d23/c8d 0 2024-08-01T06:55:58.013 INFO:tasks.workunit.client.1.smithi089.stdout:0/527: chown d9/d40/d25/d46/d91/d2e/d44/d53/fa2 0 1 2024-08-01T06:55:58.014 INFO:tasks.workunit.client.1.smithi089.stdout:0/528: chown d9/l15 170 1 2024-08-01T06:55:58.014 INFO:tasks.workunit.client.1.smithi089.stdout:0/529: chown d9/d40/d25/d46/d91/d64 7666 1 2024-08-01T06:55:58.018 INFO:tasks.workunit.client.1.smithi089.stdout:0/530: creat d9/d40/d95/d99/d2b/d55/fa9 x:0 0 0 2024-08-01T06:55:58.025 INFO:tasks.workunit.client.1.smithi089.stdout:0/531: dwrite d9/d40/d25/d46/d91/d2e/d3a/d76/d96/f9c [0,4194304] 0 2024-08-01T06:55:58.027 INFO:tasks.workunit.client.0.smithi016.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-08-01T06:55:58.030 INFO:tasks.workunit.client.1.smithi089.stdout:5/383: write d5/f73 [3903908,48768] 0 2024-08-01T06:55:58.034 INFO:tasks.workunit.client.1.smithi089.stdout:3/289: sync 2024-08-01T06:55:58.034 INFO:tasks.workunit.client.1.smithi089.stdout:6/512: sync 2024-08-01T06:55:58.034 INFO:tasks.workunit.client.1.smithi089.stdout:1/477: sync 2024-08-01T06:55:58.035 INFO:tasks.workunit.client.0.smithi016.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-08-01T06:55:58.035 INFO:tasks.workunit.client.0.smithi016.stderr:+ make 2024-08-01T06:55:58.035 INFO:tasks.workunit.client.1.smithi089.stdout:5/384: link d5/de/d10/d33/f56 d5/de/d10/d16/d1b/d52/d5d/d6c/f81 0 2024-08-01T06:55:58.036 INFO:tasks.workunit.client.1.smithi089.stdout:8/409: dwrite d5/f1a [0,4194304] 0 2024-08-01T06:55:58.039 INFO:tasks.workunit.client.1.smithi089.stdout:3/290: truncate d7/d32/d23/f58 841856 0 2024-08-01T06:55:58.040 INFO:tasks.workunit.client.1.smithi089.stdout:5/385: write d5/de/d10/d16/d1b/d25/f62 [962369,2988] 0 2024-08-01T06:55:58.041 INFO:tasks.workunit.client.1.smithi089.stdout:8/410: chown d5/d65/c67 3 1 2024-08-01T06:55:58.041 INFO:tasks.workunit.client.1.smithi089.stdout:0/532: dread d9/f77 [0,4194304] 0 2024-08-01T06:55:58.042 INFO:tasks.workunit.client.1.smithi089.stdout:8/411: stat d5/d15/f1c 0 2024-08-01T06:55:58.042 INFO:tasks.workunit.client.1.smithi089.stdout:5/386: chown d5/d13/f65 43006 1 2024-08-01T06:55:58.045 INFO:tasks.workunit.client.1.smithi089.stdout:1/478: rename d0/d9/d15/d3b/d95/d99/f9f to d0/d9/d54/fa0 0 2024-08-01T06:55:58.046 INFO:tasks.workunit.client.1.smithi089.stdout:6/513: link d2/l61 d2/d2e/d98/lb1 0 2024-08-01T06:55:58.048 INFO:tasks.workunit.client.1.smithi089.stdout:5/387: dwrite d5/de/d10/d16/d1b/f76 [0,4194304] 0 2024-08-01T06:55:58.049 INFO:tasks.workunit.client.1.smithi089.stdout:0/533: truncate d9/f13 912386 0 2024-08-01T06:55:58.054 INFO:tasks.workunit.client.1.smithi089.stdout:3/291: dwrite d7/dd/f20 [4194304,4194304] 0 2024-08-01T06:55:58.054 INFO:tasks.workunit.client.1.smithi089.stdout:5/388: rmdir d5/de/d10/d33 39 2024-08-01T06:55:58.057 INFO:tasks.workunit.client.1.smithi089.stdout:3/292: write d7/d32/d12/f33 [2856125,93733] 0 2024-08-01T06:55:58.059 INFO:tasks.workunit.client.1.smithi089.stdout:8/412: truncate d5/d15/d58/f85 2957406 0 2024-08-01T06:55:58.059 INFO:tasks.workunit.client.1.smithi089.stdout:6/514: mknod d2/cb2 0 2024-08-01T06:55:58.060 INFO:tasks.workunit.client.1.smithi089.stdout:5/389: dread d5/d13/f31 [0,4194304] 0 2024-08-01T06:55:58.060 INFO:tasks.workunit.client.1.smithi089.stdout:0/534: rename d9/d40/d25/f7f to d9/d40/d25/d46/d91/d2e/d3a/d76/d96/faa 0 2024-08-01T06:55:58.061 INFO:tasks.workunit.client.1.smithi089.stdout:8/413: readlink d5/d15/d58/d84/l86 0 2024-08-01T06:55:58.062 INFO:tasks.workunit.client.1.smithi089.stdout:3/293: symlink d7/d32/d4c/d53/l59 0 2024-08-01T06:55:58.069 INFO:tasks.workunit.client.1.smithi089.stdout:0/535: rename d9/d40/d95/d99/d2b/f43 to d9/d40/d25/d46/d91/d64/d8c/fab 0 2024-08-01T06:55:58.070 INFO:tasks.workunit.client.1.smithi089.stdout:8/414: symlink d5/dc/l8e 0 2024-08-01T06:55:58.077 INFO:tasks.workunit.client.1.smithi089.stdout:5/390: fdatasync d5/de/d10/f1c 0 2024-08-01T06:55:58.079 INFO:tasks.workunit.client.1.smithi089.stdout:8/415: unlink d5/dc/d12/c27 0 2024-08-01T06:55:58.080 INFO:tasks.workunit.client.1.smithi089.stdout:3/294: dread d7/d32/d12/d1b/f26 [0,4194304] 0 2024-08-01T06:55:58.082 INFO:tasks.workunit.client.0.smithi016.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-08-01T06:55:58.082 INFO:tasks.workunit.client.1.smithi089.stdout:0/536: creat d9/d40/d45/d47/da8/fac x:0 0 0 2024-08-01T06:55:58.084 INFO:tasks.workunit.client.1.smithi089.stdout:6/515: truncate d2/d2e/d2f/f4d 3929335 0 2024-08-01T06:55:58.085 INFO:tasks.workunit.client.1.smithi089.stdout:8/416: dwrite d5/dc/f16 [0,4194304] 0 2024-08-01T06:55:58.086 INFO:tasks.workunit.client.1.smithi089.stdout:5/391: rename d5/d13/d43/l47 to d5/d13/d38/d42/l82 0 2024-08-01T06:55:58.087 INFO:tasks.workunit.client.1.smithi089.stdout:0/537: mknod d9/d40/d25/d46/d91/d2e/d3a/d76/cad 0 2024-08-01T06:55:58.087 INFO:tasks.workunit.client.1.smithi089.stdout:3/295: getdents d7/d32/d23/d46/d47 0 2024-08-01T06:55:58.089 INFO:tasks.workunit.client.1.smithi089.stdout:5/392: mkdir d5/d13/d83 0 2024-08-01T06:55:58.089 INFO:tasks.workunit.client.1.smithi089.stdout:8/417: chown d5/dc/d1e/d53/l61 5839999 1 2024-08-01T06:55:58.093 INFO:tasks.workunit.client.1.smithi089.stdout:8/418: mknod d5/dc/d1e/c8f 0 2024-08-01T06:55:58.094 INFO:tasks.workunit.client.1.smithi089.stdout:0/538: dwrite d9/d40/d25/d46/d91/d2e/d3a/f97 [0,4194304] 0 2024-08-01T06:55:58.098 INFO:tasks.workunit.client.1.smithi089.stdout:5/393: rename d5/de/d10/d16/d1b/f2e to d5/d13/f84 0 2024-08-01T06:55:58.099 INFO:tasks.workunit.client.1.smithi089.stdout:3/296: link d7/d32/d12/d1b/l42 d7/d32/d12/l5a 0 2024-08-01T06:55:58.101 INFO:tasks.workunit.client.1.smithi089.stdout:0/539: rename d9/d40/l4c to d9/d40/d95/d99/d2b/d55/d7a/lae 0 2024-08-01T06:55:58.102 INFO:tasks.workunit.client.1.smithi089.stdout:5/394: mknod d5/d13/d43/c85 0 2024-08-01T06:55:58.103 INFO:tasks.workunit.client.1.smithi089.stdout:5/395: chown d5/de/d10/d16/d1b/f76 334 1 2024-08-01T06:55:58.104 INFO:tasks.workunit.client.1.smithi089.stdout:0/540: dread d9/f77 [0,4194304] 0 2024-08-01T06:55:58.104 INFO:tasks.workunit.client.1.smithi089.stdout:8/419: unlink d5/dc/d12/l71 0 2024-08-01T06:55:58.110 INFO:tasks.workunit.client.1.smithi089.stdout:0/541: dwrite d9/d40/d25/d46/d91/f3f [0,4194304] 0 2024-08-01T06:55:58.112 INFO:tasks.workunit.client.1.smithi089.stdout:5/396: symlink d5/de/d10/d16/d1b/d52/d5f/l86 0 2024-08-01T06:55:58.114 INFO:tasks.workunit.client.1.smithi089.stdout:8/420: creat d5/d15/d5a/d73/f90 x:0 0 0 2024-08-01T06:55:58.117 INFO:tasks.workunit.client.1.smithi089.stdout:0/542: mkdir d9/d40/d25/d46/d91/d2e/d44/d53/daf 0 2024-08-01T06:55:58.118 INFO:tasks.workunit.client.1.smithi089.stdout:0/543: write d9/d40/d95/d99/f73 [1022806,105953] 0 2024-08-01T06:55:58.121 INFO:tasks.workunit.client.1.smithi089.stdout:5/397: symlink d5/de/d10/d16/d1b/d52/d5d/l87 0 2024-08-01T06:55:58.121 INFO:tasks.workunit.client.1.smithi089.stdout:5/398: dread - d5/de/d10/d16/d1b/d25/f70 zero size 2024-08-01T06:55:58.122 INFO:tasks.workunit.client.1.smithi089.stdout:5/399: read - d5/d13/d38/d42/f67 zero size 2024-08-01T06:55:58.122 INFO:tasks.workunit.client.1.smithi089.stdout:5/400: stat d5/de 0 2024-08-01T06:55:58.124 INFO:tasks.workunit.client.1.smithi089.stdout:0/544: mknod d9/d40/d25/d46/d91/d64/cb0 0 2024-08-01T06:55:58.129 INFO:tasks.workunit.client.1.smithi089.stdout:3/297: dwrite d7/dd/f1a [0,4194304] 0 2024-08-01T06:55:58.134 INFO:tasks.workunit.client.1.smithi089.stdout:8/421: stat d5/dc/d1e/d53 0 2024-08-01T06:55:58.134 INFO:tasks.workunit.client.1.smithi089.stdout:8/422: dread - d5/d23/f6d zero size 2024-08-01T06:55:58.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:57 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/3894986780' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:55:58.137 INFO:tasks.workunit.client.1.smithi089.stdout:5/401: unlink d5/de/d10/l15 0 2024-08-01T06:55:58.141 INFO:tasks.workunit.client.1.smithi089.stdout:0/545: rename d9/d40/d25/f2a to d9/d40/d25/d46/d91/d2e/d44/d53/d9f/fb1 0 2024-08-01T06:55:58.142 INFO:tasks.workunit.client.1.smithi089.stdout:0/546: stat d9/d40/d95/d99/d2b/d55/d7a/f84 0 2024-08-01T06:55:58.143 INFO:tasks.workunit.client.1.smithi089.stdout:0/547: truncate d9/d40/d25/d46/f6f 799737 0 2024-08-01T06:55:58.144 INFO:tasks.workunit.client.1.smithi089.stdout:3/298: mknod d7/d32/d23/c5b 0 2024-08-01T06:55:58.145 INFO:tasks.workunit.client.1.smithi089.stdout:0/548: write d9/d40/d25/d46/d91/d2e/d44/d53/f9a [738834,22984] 0 2024-08-01T06:55:58.145 INFO:tasks.workunit.client.1.smithi089.stdout:5/402: mknod d5/de/d10/d16/d1b/d25/c88 0 2024-08-01T06:55:58.149 INFO:tasks.workunit.client.1.smithi089.stdout:3/299: dwrite d7/f1f [0,4194304] 0 2024-08-01T06:55:58.151 INFO:tasks.workunit.client.1.smithi089.stdout:8/423: rename d5/d65 to d5/d23/d91 0 2024-08-01T06:55:58.151 INFO:tasks.workunit.client.1.smithi089.stdout:3/300: write d7/d32/d23/d2f/f48 [788731,88057] 0 2024-08-01T06:55:58.156 INFO:tasks.workunit.client.1.smithi089.stdout:9/396: sync 2024-08-01T06:55:58.156 INFO:tasks.workunit.client.1.smithi089.stdout:4/487: sync 2024-08-01T06:55:58.157 INFO:tasks.workunit.client.1.smithi089.stdout:9/397: chown d18/d33/d3b/f69 63 1 2024-08-01T06:55:58.162 INFO:tasks.workunit.client.1.smithi089.stdout:5/403: link d5/de/d10/d16/d1b/d25/f64 d5/de/d10/d16/d1b/d25/f89 0 2024-08-01T06:55:58.163 INFO:tasks.workunit.client.1.smithi089.stdout:9/398: dwrite d18/f1d [0,4194304] 0 2024-08-01T06:55:58.165 INFO:tasks.workunit.client.1.smithi089.stdout:9/399: dread d18/d22/f57 [0,4194304] 0 2024-08-01T06:55:58.170 INFO:tasks.workunit.client.1.smithi089.stdout:3/301: fdatasync d7/f1f 0 2024-08-01T06:55:58.170 INFO:tasks.workunit.client.1.smithi089.stdout:5/404: rename d5 to d5/de/d10/d8a 22 2024-08-01T06:55:58.170 INFO:tasks.workunit.client.1.smithi089.stdout:5/405: chown d5/d13/c3f 47012 1 2024-08-01T06:55:58.171 INFO:tasks.workunit.client.1.smithi089.stdout:3/302: truncate d7/d32/d12/d1b/f51 200051 0 2024-08-01T06:55:58.171 INFO:tasks.workunit.client.1.smithi089.stdout:5/406: readlink d5/de/d10/d16/d1b/l5c 0 2024-08-01T06:55:58.172 INFO:tasks.workunit.client.1.smithi089.stdout:8/424: rmdir d5/d15/d58/d84 39 2024-08-01T06:55:58.173 INFO:tasks.workunit.client.1.smithi089.stdout:9/400: creat d18/d22/d39/f7c x:0 0 0 2024-08-01T06:55:58.174 INFO:tasks.workunit.client.1.smithi089.stdout:9/401: fsync d18/d33/f37 0 2024-08-01T06:55:58.174 INFO:tasks.workunit.client.1.smithi089.stdout:0/549: getdents d9/d40/d25/d46/d91/d2e 0 2024-08-01T06:55:58.175 INFO:tasks.workunit.client.1.smithi089.stdout:0/550: chown d9/d40/d95/d99 3 1 2024-08-01T06:55:58.175 INFO:tasks.workunit.client.1.smithi089.stdout:0/551: chown d9/d40/d45/d47/f5c 799889953 1 2024-08-01T06:55:58.184 INFO:tasks.workunit.client.1.smithi089.stdout:3/303: mknod d7/d32/d12/d1b/c5c 0 2024-08-01T06:55:58.185 INFO:tasks.workunit.client.1.smithi089.stdout:3/304: fdatasync d7/dd/f1a 0 2024-08-01T06:55:58.185 INFO:tasks.workunit.client.1.smithi089.stdout:3/305: read d7/dd/f2e [1756297,70270] 0 2024-08-01T06:55:58.187 INFO:tasks.workunit.client.1.smithi089.stdout:3/306: rename d7/d32/d23 to d7/d32/d23/d46/d5d 22 2024-08-01T06:55:58.187 INFO:tasks.workunit.client.1.smithi089.stdout:5/407: mkdir d5/de/d10/d16/d1b/d52/d5d/d6c/d8b 0 2024-08-01T06:55:58.188 INFO:tasks.workunit.client.1.smithi089.stdout:8/425: truncate d5/d15/d58/f85 393041 0 2024-08-01T06:55:58.188 INFO:tasks.workunit.client.1.smithi089.stdout:0/552: dread f7 [0,4194304] 0 2024-08-01T06:55:58.189 INFO:tasks.workunit.client.1.smithi089.stdout:3/307: read d7/d32/d12/f33 [3486089,114604] 0 2024-08-01T06:55:58.194 INFO:tasks.workunit.client.1.smithi089.stdout:4/488: truncate d3/d17/d3a/f5d 8127244 0 2024-08-01T06:55:58.196 INFO:tasks.workunit.client.1.smithi089.stdout:5/408: write d5/d13/d38/d42/f67 [426041,96885] 0 2024-08-01T06:55:58.198 INFO:tasks.workunit.client.1.smithi089.stdout:8/426: mkdir d5/dc/d12/d92 0 2024-08-01T06:55:58.199 INFO:tasks.workunit.client.1.smithi089.stdout:3/308: symlink d7/d32/d23/d31/l5e 0 2024-08-01T06:55:58.205 INFO:tasks.workunit.client.1.smithi089.stdout:9/402: write d18/d22/f38 [1817394,64353] 0 2024-08-01T06:55:58.206 INFO:tasks.workunit.client.1.smithi089.stdout:4/489: symlink d3/d1f/d62/d31/l97 0 2024-08-01T06:55:58.207 INFO:tasks.workunit.client.1.smithi089.stdout:5/409: write d5/de/d10/f2c [1603175,68815] 0 2024-08-01T06:55:58.208 INFO:tasks.workunit.client.1.smithi089.stdout:5/410: chown d5/d13/d38 851798 1 2024-08-01T06:55:58.208 INFO:tasks.workunit.client.1.smithi089.stdout:8/427: creat d5/dc/d1e/d53/f93 x:0 0 0 2024-08-01T06:55:58.210 INFO:tasks.workunit.client.1.smithi089.stdout:3/309: fdatasync d7/d32/d12/f33 0 2024-08-01T06:55:58.214 INFO:tasks.workunit.client.1.smithi089.stdout:9/403: symlink d18/d33/d53/l7d 0 2024-08-01T06:55:58.214 INFO:tasks.workunit.client.1.smithi089.stdout:9/404: readlink d18/d22/d39/l70 0 2024-08-01T06:55:58.216 INFO:tasks.workunit.client.1.smithi089.stdout:9/405: chown d18/d33/d3b/f46 2047660 1 2024-08-01T06:55:58.216 INFO:tasks.workunit.client.1.smithi089.stdout:9/406: write d18/d33/f62 [12871,477] 0 2024-08-01T06:55:58.216 INFO:tasks.workunit.client.1.smithi089.stdout:4/490: unlink d3/db/de/l30 0 2024-08-01T06:55:58.219 INFO:tasks.workunit.client.1.smithi089.stdout:5/411: symlink d5/de/d10/d16/l8c 0 2024-08-01T06:55:58.220 INFO:tasks.workunit.client.1.smithi089.stdout:5/412: write d5/d13/f65 [837272,114508] 0 2024-08-01T06:55:58.221 INFO:tasks.workunit.client.1.smithi089.stdout:5/413: stat d5/de/d10/d16/d1b/d25/c88 0 2024-08-01T06:55:58.221 INFO:tasks.workunit.client.1.smithi089.stdout:3/310: mkdir d7/d32/d4c/d53/d5f 0 2024-08-01T06:55:58.223 INFO:tasks.workunit.client.1.smithi089.stdout:0/553: link d9/d40/d25/d46/d91/d2e/d3a/c78 d9/d40/d25/d46/cb2 0 2024-08-01T06:55:58.226 INFO:tasks.workunit.client.1.smithi089.stdout:4/491: readlink d3/d1f/d62/d3b/l79 0 2024-08-01T06:55:58.226 INFO:tasks.workunit.client.1.smithi089.stdout:4/492: chown d3/db/de/d5b/f91 1 1 2024-08-01T06:55:58.227 INFO:tasks.workunit.client.1.smithi089.stdout:5/414: chown d5/de/d10/f19 0 1 2024-08-01T06:55:58.231 INFO:tasks.workunit.client.1.smithi089.stdout:0/554: unlink d9/d40/d45/d47/fa3 0 2024-08-01T06:55:58.234 INFO:tasks.workunit.client.1.smithi089.stdout:4/493: mknod d3/c98 0 2024-08-01T06:55:58.240 INFO:tasks.workunit.client.1.smithi089.stdout:9/407: creat d18/f7e x:0 0 0 2024-08-01T06:55:58.241 INFO:tasks.workunit.client.1.smithi089.stdout:9/408: fsync f13 0 2024-08-01T06:55:58.242 INFO:tasks.workunit.client.1.smithi089.stdout:5/415: getdents d5/d13/d83 0 2024-08-01T06:55:58.243 INFO:tasks.workunit.client.1.smithi089.stdout:3/311: rename d7/d32/d12/d1b/c5c to d7/d32/c60 0 2024-08-01T06:55:58.245 INFO:tasks.workunit.client.1.smithi089.stdout:0/555: fdatasync d9/fa 0 2024-08-01T06:55:58.248 INFO:tasks.workunit.client.1.smithi089.stdout:5/416: rmdir d5/de/d10/d16/d1b 39 2024-08-01T06:55:58.253 INFO:tasks.workunit.client.1.smithi089.stdout:9/409: mkdir d18/d33/d49/d7b/d7f 0 2024-08-01T06:55:58.255 INFO:tasks.workunit.client.1.smithi089.stdout:0/556: creat d9/d40/d45/d47/da8/fb3 x:0 0 0 2024-08-01T06:55:58.259 INFO:tasks.workunit.client.1.smithi089.stdout:3/312: mkdir d7/d32/d12/d29/d39/d61 0 2024-08-01T06:55:58.260 INFO:tasks.workunit.client.1.smithi089.stdout:0/557: dwrite d9/d40/d25/d46/d91/d2e/d44/d53/f9a [0,4194304] 0 2024-08-01T06:55:58.264 INFO:tasks.workunit.client.1.smithi089.stdout:5/417: symlink d5/d13/d83/l8d 0 2024-08-01T06:55:58.266 INFO:tasks.workunit.client.1.smithi089.stdout:0/558: fsync d9/d40/f27 0 2024-08-01T06:55:58.267 INFO:tasks.workunit.client.1.smithi089.stdout:4/494: getdents d3/d1f/d62 0 2024-08-01T06:55:58.271 INFO:tasks.workunit.client.1.smithi089.stdout:5/418: dread d5/de/d10/d16/d1b/d25/f89 [0,4194304] 0 2024-08-01T06:55:58.272 INFO:tasks.workunit.client.1.smithi089.stdout:0/559: creat d9/d40/d25/d46/d91/d2e/d44/d53/fb4 x:0 0 0 2024-08-01T06:55:58.273 INFO:tasks.workunit.client.1.smithi089.stdout:4/495: rmdir d3/d1f/d62 39 2024-08-01T06:55:58.274 INFO:tasks.workunit.client.1.smithi089.stdout:0/560: truncate d9/d40/d25/d46/d91/d2e/d3a/d76/d96/faa 1731731 0 2024-08-01T06:55:58.275 INFO:tasks.workunit.client.1.smithi089.stdout:3/313: link d7/d32/d23/f58 d7/dd/f62 0 2024-08-01T06:55:58.279 INFO:tasks.workunit.client.1.smithi089.stdout:5/419: readlink d5/de/df/l69 0 2024-08-01T06:55:58.281 INFO:tasks.workunit.client.1.smithi089.stdout:4/496: unlink d3/d1e/d21/c81 0 2024-08-01T06:55:58.282 INFO:tasks.workunit.client.1.smithi089.stdout:5/420: mkdir d5/de/d57/d8e 0 2024-08-01T06:55:58.285 INFO:tasks.workunit.client.1.smithi089.stdout:3/314: dwrite d7/dd/f56 [0,4194304] 0 2024-08-01T06:55:58.285 INFO:tasks.workunit.client.1.smithi089.stdout:0/561: dwrite d9/d40/d95/d99/d2b/d55/d7a/f89 [0,4194304] 0 2024-08-01T06:55:58.286 INFO:tasks.workunit.client.1.smithi089.stdout:7/390: sync 2024-08-01T06:55:58.286 INFO:tasks.workunit.client.1.smithi089.stdout:2/377: sync 2024-08-01T06:55:58.287 INFO:tasks.workunit.client.1.smithi089.stdout:5/421: truncate d5/d13/d38/d42/f67 1078584 0 2024-08-01T06:55:58.288 INFO:tasks.workunit.client.1.smithi089.stdout:7/391: write d7/d1f/f7a [354209,27533] 0 2024-08-01T06:55:58.289 INFO:tasks.workunit.client.1.smithi089.stdout:4/497: rmdir d3/db/de/d5b 39 2024-08-01T06:55:58.289 INFO:tasks.workunit.client.1.smithi089.stdout:0/562: write d9/d40/d95/d99/d2b/d55/f83 [757665,31359] 0 2024-08-01T06:55:58.292 INFO:tasks.workunit.client.1.smithi089.stdout:7/392: chown d7/fb 6246 1 2024-08-01T06:55:58.292 INFO:tasks.workunit.client.1.smithi089.stdout:3/315: fdatasync d7/d32/d23/f58 0 2024-08-01T06:55:58.294 INFO:tasks.workunit.client.1.smithi089.stdout:0/563: read d9/d40/d25/d46/d91/d64/d8c/fab [1762307,90646] 0 2024-08-01T06:55:58.295 INFO:tasks.workunit.client.1.smithi089.stdout:3/316: truncate d7/d32/d12/f41 759767 0 2024-08-01T06:55:58.296 INFO:tasks.workunit.client.1.smithi089.stdout:3/317: fdatasync d7/d32/d12/f33 0 2024-08-01T06:55:58.296 INFO:tasks.workunit.client.1.smithi089.stdout:7/393: creat d7/df/f7f x:0 0 0 2024-08-01T06:55:58.297 INFO:tasks.workunit.client.1.smithi089.stdout:4/498: creat d3/d68/d7e/f99 x:0 0 0 2024-08-01T06:55:58.297 INFO:tasks.workunit.client.1.smithi089.stdout:3/318: write d7/d32/d12/d1b/f51 [360610,66936] 0 2024-08-01T06:55:58.298 INFO:tasks.workunit.client.1.smithi089.stdout:0/564: creat d9/d40/d95/d99/d2b/d55/d7a/fb5 x:0 0 0 2024-08-01T06:55:58.298 INFO:tasks.workunit.client.1.smithi089.stdout:5/422: read d5/f3c [1473977,49805] 0 2024-08-01T06:55:58.299 INFO:tasks.workunit.client.1.smithi089.stdout:0/565: write d9/f33 [3344713,39111] 0 2024-08-01T06:55:58.300 INFO:tasks.workunit.client.1.smithi089.stdout:5/423: read - d5/de/f80 zero size 2024-08-01T06:55:58.304 INFO:tasks.workunit.client.1.smithi089.stdout:3/319: mkdir d7/d32/d12/d29/d39/d61/d63 0 2024-08-01T06:55:58.306 INFO:tasks.workunit.client.1.smithi089.stdout:0/566: readlink d9/d40/d25/d46/d91/d2e/d3a/d76/l7e 0 2024-08-01T06:55:58.308 INFO:tasks.workunit.client.1.smithi089.stdout:4/499: unlink d3/db/de/d5b/c5f 0 2024-08-01T06:55:58.309 INFO:tasks.workunit.client.1.smithi089.stdout:0/567: write d9/d40/d25/d46/d91/d2e/d44/d53/fa2 [685862,82970] 0 2024-08-01T06:55:58.310 INFO:tasks.workunit.client.1.smithi089.stdout:5/424: mknod d5/de/d10/d33/d5e/d7e/c8f 0 2024-08-01T06:55:58.313 INFO:tasks.workunit.client.1.smithi089.stdout:5/425: dread d5/d13/d38/d42/f67 [0,4194304] 0 2024-08-01T06:55:58.313 INFO:tasks.workunit.client.1.smithi089.stdout:5/426: readlink d5/d13/d38/l21 0 2024-08-01T06:55:58.316 INFO:tasks.workunit.client.1.smithi089.stdout:3/320: creat d7/d32/f64 x:0 0 0 2024-08-01T06:55:58.318 INFO:tasks.workunit.client.1.smithi089.stdout:0/568: creat d9/d40/d25/d46/d91/d2e/d44/d53/daf/fb6 x:0 0 0 2024-08-01T06:55:58.318 INFO:tasks.workunit.client.1.smithi089.stdout:3/321: dread - d7/d32/f64 zero size 2024-08-01T06:55:58.321 INFO:tasks.workunit.client.1.smithi089.stdout:5/427: dwrite d5/d13/d43/f4e [0,4194304] 0 2024-08-01T06:55:58.322 INFO:tasks.workunit.client.1.smithi089.stdout:4/500: dwrite d3/d17/d3a/f54 [0,4194304] 0 2024-08-01T06:55:58.332 INFO:tasks.workunit.client.1.smithi089.stdout:0/569: getdents d9/d40/d25/d46/d91/d64/d8c 0 2024-08-01T06:55:58.339 INFO:tasks.workunit.client.1.smithi089.stdout:0/570: dread d9/d40/d95/d99/f5d [0,4194304] 0 2024-08-01T06:55:58.341 INFO:tasks.workunit.client.1.smithi089.stdout:0/571: write d9/d40/d95/d99/d2b/f82 [129910,80271] 0 2024-08-01T06:55:58.342 INFO:tasks.workunit.client.1.smithi089.stdout:4/501: dread d3/db/d33/f6f [0,4194304] 0 2024-08-01T06:55:58.343 INFO:tasks.workunit.client.1.smithi089.stdout:4/502: dread - d3/db/de/d5b/f91 zero size 2024-08-01T06:55:58.343 INFO:tasks.workunit.client.1.smithi089.stdout:3/322: rename d7/d32/d12/d29/d39/d61 to d7/d32/d4c/d53/d65 0 2024-08-01T06:55:58.347 INFO:tasks.workunit.client.1.smithi089.stdout:3/323: symlink d7/l66 0 2024-08-01T06:55:58.347 INFO:tasks.workunit.client.1.smithi089.stdout:3/324: fsync d7/dd/f1a 0 2024-08-01T06:55:58.352 INFO:tasks.workunit.client.1.smithi089.stdout:3/325: mkdir d7/d32/d4c/d67 0 2024-08-01T06:55:58.353 INFO:tasks.workunit.client.1.smithi089.stdout:5/428: write d5/d13/d38/d42/f55 [2145109,29809] 0 2024-08-01T06:55:58.355 INFO:tasks.workunit.client.1.smithi089.stdout:4/503: creat d3/d17/f9a x:0 0 0 2024-08-01T06:55:58.355 INFO:tasks.workunit.client.1.smithi089.stdout:0/572: write d9/f77 [2464393,66638] 0 2024-08-01T06:55:58.359 INFO:tasks.workunit.client.1.smithi089.stdout:3/326: rename d7/d32/d23/d31 to d7/d68 0 2024-08-01T06:55:58.360 INFO:tasks.workunit.client.1.smithi089.stdout:0/573: mkdir d9/d40/d45/db7 0 2024-08-01T06:55:58.365 INFO:tasks.workunit.client.1.smithi089.stdout:0/574: rename d9/d40/d25/d46/d91/d2e/f30 to d9/d40/d95/d99/d2b/fb8 0 2024-08-01T06:55:58.383 INFO:tasks.workunit.client.1.smithi089.stdout:1/479: sync 2024-08-01T06:55:58.383 INFO:tasks.workunit.client.1.smithi089.stdout:8/428: sync 2024-08-01T06:55:58.383 INFO:tasks.workunit.client.1.smithi089.stdout:6/516: sync 2024-08-01T06:55:58.391 INFO:tasks.workunit.client.1.smithi089.stdout:0/575: chown d9/d40/d25/d46/d91 52 1 2024-08-01T06:55:58.392 INFO:tasks.workunit.client.1.smithi089.stdout:3/327: truncate d7/d32/f2d 3312225 0 2024-08-01T06:55:58.392 INFO:tasks.workunit.client.1.smithi089.stdout:1/480: fsync d0/d9/d15/d76/f88 0 2024-08-01T06:55:58.396 INFO:tasks.workunit.client.1.smithi089.stdout:0/576: read d9/d40/d25/d46/f3d [2125822,16443] 0 2024-08-01T06:55:58.397 INFO:tasks.workunit.client.1.smithi089.stdout:8/429: rename d5/d15/d58 to d5/dc/d94 0 2024-08-01T06:55:58.400 INFO:tasks.workunit.client.1.smithi089.stdout:8/430: dread d5/dc/f62 [0,4194304] 0 2024-08-01T06:55:58.401 INFO:tasks.workunit.client.1.smithi089.stdout:1/481: creat d0/d9/d15/d3b/d95/fa1 x:0 0 0 2024-08-01T06:55:58.402 INFO:tasks.workunit.client.1.smithi089.stdout:3/328: dwrite d7/dd/f20 [4194304,4194304] 0 2024-08-01T06:55:58.403 INFO:tasks.workunit.client.1.smithi089.stdout:4/504: dread d3/d1e/d21/d26/f38 [0,4194304] 0 2024-08-01T06:55:58.404 INFO:tasks.workunit.client.1.smithi089.stdout:0/577: getdents d9 0 2024-08-01T06:55:58.406 INFO:tasks.workunit.client.1.smithi089.stdout:8/431: truncate d5/dc/d12/f64 766309 0 2024-08-01T06:55:58.406 INFO:tasks.workunit.client.1.smithi089.stdout:4/505: write d3/db/de/d5b/f74 [1226036,55271] 0 2024-08-01T06:55:58.407 INFO:tasks.workunit.client.1.smithi089.stdout:1/482: fsync d0/d9/f87 0 2024-08-01T06:55:58.407 INFO:tasks.workunit.client.1.smithi089.stdout:3/329: rename d7/dd to d7/d32/d4c/d69 0 2024-08-01T06:55:58.411 INFO:tasks.workunit.client.1.smithi089.stdout:8/432: fsync d5/d15/d5a/d73/f90 0 2024-08-01T06:55:58.414 INFO:tasks.workunit.client.1.smithi089.stdout:6/517: dread d2/d11/d1a/f6a [0,4194304] 0 2024-08-01T06:55:58.414 INFO:tasks.workunit.client.1.smithi089.stdout:3/330: write d7/d32/d12/f41 [1454609,88597] 0 2024-08-01T06:55:58.418 INFO:tasks.workunit.client.1.smithi089.stdout:0/578: dwrite d9/d40/d95/d99/d2b/d55/d7a/f84 [0,4194304] 0 2024-08-01T06:55:58.419 INFO:tasks.workunit.client.1.smithi089.stdout:0/579: read d9/ff [3942293,51571] 0 2024-08-01T06:55:58.419 INFO:tasks.workunit.client.1.smithi089.stdout:6/518: write d2/d11/d1a/f6a [1873873,124574] 0 2024-08-01T06:55:58.420 INFO:tasks.workunit.client.1.smithi089.stdout:4/506: link d3/d1e/c32 d3/db/de/c9b 0 2024-08-01T06:55:58.423 INFO:tasks.workunit.client.1.smithi089.stdout:0/580: rmdir d9/d40 39 2024-08-01T06:55:58.425 INFO:tasks.workunit.client.1.smithi089.stdout:8/433: rename d5/dc/d1e/f7f to d5/dc/d1e/f95 0 2024-08-01T06:55:58.425 INFO:tasks.workunit.client.1.smithi089.stdout:6/519: dread d2/d11/d1f/d46/f72 [0,4194304] 0 2024-08-01T06:55:58.425 INFO:tasks.workunit.client.1.smithi089.stdout:3/331: dread d7/d32/d4c/d69/f2e [0,4194304] 0 2024-08-01T06:55:58.429 INFO:tasks.workunit.client.1.smithi089.stdout:1/483: dread d0/d9/d15/d2d/f3a [0,4194304] 0 2024-08-01T06:55:58.430 INFO:tasks.workunit.client.1.smithi089.stdout:6/520: chown d2/d11/d1f/l22 0 1 2024-08-01T06:55:58.432 INFO:tasks.workunit.client.1.smithi089.stdout:3/332: symlink d7/d32/d4c/d53/l6a 0 2024-08-01T06:55:58.432 INFO:tasks.workunit.client.1.smithi089.stdout:1/484: truncate d0/d9/d15/d3b/d95/d49/d82/f93 474771 0 2024-08-01T06:55:58.435 INFO:tasks.workunit.client.1.smithi089.stdout:6/521: unlink d2/d11/d1a/d1c/l2c 0 2024-08-01T06:55:58.440 INFO:tasks.workunit.client.1.smithi089.stdout:8/434: getdents d5/dc/d12 0 2024-08-01T06:55:58.443 INFO:tasks.workunit.client.1.smithi089.stdout:1/485: link d0/ce d0/d9/d15/ca2 0 2024-08-01T06:55:58.444 INFO:tasks.workunit.client.1.smithi089.stdout:4/507: dwrite d3/d1f/d62/d3b/f8d [0,4194304] 0 2024-08-01T06:55:58.445 INFO:tasks.workunit.client.1.smithi089.stdout:6/522: dwrite d2/d11/d1a/d1c/f52 [0,4194304] 0 2024-08-01T06:55:58.445 INFO:tasks.workunit.client.1.smithi089.stdout:3/333: link d7/d32/d12/d29/l4f d7/d32/l6b 0 2024-08-01T06:55:58.446 INFO:tasks.workunit.client.1.smithi089.stdout:4/508: chown d3/d17/f9a 580 1 2024-08-01T06:55:58.450 INFO:tasks.workunit.client.1.smithi089.stdout:0/581: truncate d9/d40/d95/d99/f3e 58939 0 2024-08-01T06:55:58.451 INFO:tasks.workunit.client.1.smithi089.stdout:6/523: symlink d2/d2e/d2f/d31/lb3 0 2024-08-01T06:55:58.453 INFO:tasks.workunit.client.1.smithi089.stdout:3/334: creat d7/d32/d12/d29/d39/f6c x:0 0 0 2024-08-01T06:55:58.454 INFO:tasks.workunit.client.1.smithi089.stdout:1/486: symlink d0/d9/d15/d2b/d7d/la3 0 2024-08-01T06:55:58.455 INFO:tasks.workunit.client.1.smithi089.stdout:0/582: write d9/d40/d95/d99/d2b/f80 [1446938,10459] 0 2024-08-01T06:55:58.458 INFO:tasks.workunit.client.1.smithi089.stdout:3/335: fdatasync d7/d32/d23/f58 0 2024-08-01T06:55:58.459 INFO:tasks.workunit.client.1.smithi089.stdout:4/509: dread d3/d1f/f7c [0,4194304] 0 2024-08-01T06:55:58.464 INFO:tasks.workunit.client.1.smithi089.stdout:0/583: rmdir d9/d40/d25/d46/d91/d2e/d44 39 2024-08-01T06:55:58.464 INFO:tasks.workunit.client.1.smithi089.stdout:4/510: chown d3/d1e/d21/d26 19534567 1 2024-08-01T06:55:58.466 INFO:tasks.workunit.client.1.smithi089.stdout:8/435: dwrite d5/dc/d1e/d53/f5c [0,4194304] 0 2024-08-01T06:55:58.471 INFO:tasks.workunit.client.1.smithi089.stdout:4/511: write d3/d17/d3a/f54 [2882325,126767] 0 2024-08-01T06:55:58.471 INFO:tasks.workunit.client.1.smithi089.stdout:3/336: dread d7/d32/d12/d1b/f51 [0,4194304] 0 2024-08-01T06:55:58.471 INFO:tasks.workunit.client.1.smithi089.stdout:6/524: dwrite d2/d11/d1a/f33 [0,4194304] 0 2024-08-01T06:55:58.474 INFO:tasks.workunit.client.1.smithi089.stdout:8/436: mknod d5/dc/d94/c96 0 2024-08-01T06:55:58.474 INFO:tasks.workunit.client.1.smithi089.stdout:4/512: fdatasync d3/d1e/f95 0 2024-08-01T06:55:58.475 INFO:tasks.workunit.client.1.smithi089.stdout:1/487: dwrite d0/d9/d43/f5c [0,4194304] 0 2024-08-01T06:55:58.477 INFO:tasks.workunit.client.1.smithi089.stdout:3/337: read d7/d32/d4c/d69/f62 [614680,96186] 0 2024-08-01T06:55:58.479 INFO:tasks.workunit.client.1.smithi089.stdout:4/513: stat d3/l11 0 2024-08-01T06:55:58.481 INFO:tasks.workunit.client.1.smithi089.stdout:3/338: dread - d7/d32/f64 zero size 2024-08-01T06:55:58.481 INFO:tasks.workunit.client.1.smithi089.stdout:1/488: readlink d0/d9/d15/d2b/l7c 0 2024-08-01T06:55:58.483 INFO:tasks.workunit.client.1.smithi089.stdout:4/514: write d3/db/f39 [1500097,72636] 0 2024-08-01T06:55:58.487 INFO:tasks.workunit.client.1.smithi089.stdout:0/584: dwrite d9/d40/d95/d99/d2b/d55/d7a/f89 [0,4194304] 0 2024-08-01T06:55:58.488 INFO:tasks.workunit.client.1.smithi089.stdout:2/378: sync 2024-08-01T06:55:58.488 INFO:tasks.workunit.client.1.smithi089.stdout:9/410: sync 2024-08-01T06:55:58.488 INFO:tasks.workunit.client.1.smithi089.stdout:1/489: write d0/d9/d15/f34 [536096,78292] 0 2024-08-01T06:55:58.490 INFO:tasks.workunit.client.1.smithi089.stdout:4/515: mknod d3/d17/d71/d92/c9c 0 2024-08-01T06:55:58.493 INFO:tasks.workunit.client.1.smithi089.stdout:6/525: dwrite d2/d30/d3c/d3d/f94 [4194304,4194304] 0 2024-08-01T06:55:58.493 INFO:tasks.workunit.client.1.smithi089.stdout:2/379: chown d7/c2f 20 1 2024-08-01T06:55:58.494 INFO:tasks.workunit.client.1.smithi089.stdout:8/437: write d5/dc/f62 [422745,14114] 0 2024-08-01T06:55:58.498 INFO:tasks.workunit.client.1.smithi089.stdout:0/585: unlink d9/d40/d95/d99/d2b/d55/f68 0 2024-08-01T06:55:58.499 INFO:tasks.workunit.client.1.smithi089.stdout:3/339: dwrite d7/d32/d4c/d69/f62 [0,4194304] 0 2024-08-01T06:55:58.500 INFO:tasks.workunit.client.1.smithi089.stdout:9/411: rename d18/l2b to d18/d22/d39/d50/d75/l80 0 2024-08-01T06:55:58.501 INFO:tasks.workunit.client.1.smithi089.stdout:2/380: write d7/d1f/d52/d6e/f75 [743393,24995] 0 2024-08-01T06:55:58.503 INFO:tasks.workunit.client.1.smithi089.stdout:3/340: write d7/d32/f64 [327987,72582] 0 2024-08-01T06:55:58.503 INFO:tasks.workunit.client.1.smithi089.stdout:0/586: fdatasync d9/d40/d25/d46/d91/d64/f6a 0 2024-08-01T06:55:58.503 INFO:tasks.workunit.client.1.smithi089.stdout:4/516: unlink d3/db/d16/f9 0 2024-08-01T06:55:58.507 INFO:tasks.workunit.client.1.smithi089.stdout:1/490: symlink d0/d9/d15/d3b/d3d/d77/la4 0 2024-08-01T06:55:58.507 INFO:tasks.workunit.client.1.smithi089.stdout:3/341: chown d7/d32/d23/f58 1 1 2024-08-01T06:55:58.507 INFO:tasks.workunit.client.1.smithi089.stdout:6/526: mkdir d2/d11/db4 0 2024-08-01T06:55:58.508 INFO:tasks.workunit.client.1.smithi089.stdout:8/438: chown d5/c1d 0 1 2024-08-01T06:55:58.510 INFO:tasks.workunit.client.1.smithi089.stdout:8/439: chown d5/d15/d5e 23748869 1 2024-08-01T06:55:58.510 INFO:tasks.workunit.client.1.smithi089.stdout:6/527: chown d2/d2e/d2f/c6c 342496483 1 2024-08-01T06:55:58.511 INFO:tasks.workunit.client.1.smithi089.stdout:9/412: mkdir d18/d33/d49/d7b/d81 0 2024-08-01T06:55:58.511 INFO:tasks.workunit.client.1.smithi089.stdout:2/381: mknod d7/d19/d68/d6f/c78 0 2024-08-01T06:55:58.512 INFO:tasks.workunit.client.1.smithi089.stdout:3/342: mkdir d7/d32/d4c/d69/d6d 0 2024-08-01T06:55:58.512 INFO:tasks.workunit.client.1.smithi089.stdout:0/587: mkdir d9/d40/d25/d46/d91/d2e/d44/d53/db9 0 2024-08-01T06:55:58.519 INFO:tasks.workunit.client.1.smithi089.stdout:0/588: mkdir d9/d40/d95/d99/dba 0 2024-08-01T06:55:58.520 INFO:tasks.workunit.client.1.smithi089.stdout:4/517: dwrite d3/d17/d3a/f70 [0,4194304] 0 2024-08-01T06:55:58.520 INFO:tasks.workunit.client.1.smithi089.stdout:2/382: truncate d7/f23 2255293 0 2024-08-01T06:55:58.520 INFO:tasks.workunit.client.1.smithi089.stdout:3/343: write d7/d32/d23/d2f/f48 [1343835,92306] 0 2024-08-01T06:55:58.523 INFO:tasks.workunit.client.1.smithi089.stdout:7/394: sync 2024-08-01T06:55:58.523 INFO:tasks.workunit.client.1.smithi089.stdout:5/429: sync 2024-08-01T06:55:58.524 INFO:tasks.workunit.client.1.smithi089.stdout:4/518: write d3/d1e/d21/d57/f5e [184296,86145] 0 2024-08-01T06:55:58.526 INFO:tasks.workunit.client.1.smithi089.stdout:2/383: fdatasync d7/d19/d1e/f30 0 2024-08-01T06:55:58.527 INFO:tasks.workunit.client.1.smithi089.stdout:8/440: dwrite d5/dc/d1e/d53/f93 [0,4194304] 0 2024-08-01T06:55:58.528 INFO:tasks.workunit.client.1.smithi089.stdout:4/519: fdatasync d3/d1e/f25 0 2024-08-01T06:55:58.532 INFO:tasks.workunit.client.1.smithi089.stdout:0/589: rename d9/l15 to d9/d40/d25/d46/d91/d2e/d44/d72/lbb 0 2024-08-01T06:55:58.541 INFO:tasks.workunit.client.1.smithi089.stdout:1/491: truncate d0/d9/d15/d2d/f53 449489 0 2024-08-01T06:55:58.542 INFO:tasks.workunit.client.1.smithi089.stdout:5/430: creat d5/de/d10/d16/d1b/f90 x:0 0 0 2024-08-01T06:55:58.542 INFO:tasks.workunit.client.1.smithi089.stdout:3/344: dwrite d7/d32/d12/d1b/f4a [0,4194304] 0 2024-08-01T06:55:58.543 INFO:tasks.workunit.client.1.smithi089.stdout:2/384: unlink d7/c8 0 2024-08-01T06:55:58.543 INFO:tasks.workunit.client.1.smithi089.stdout:9/413: truncate d18/d33/f60 1236300 0 2024-08-01T06:55:58.547 INFO:tasks.workunit.client.1.smithi089.stdout:2/385: readlink d7/d1f/d29/d48/l5a 0 2024-08-01T06:55:58.547 INFO:tasks.workunit.client.1.smithi089.stdout:5/431: truncate d5/de/f80 346651 0 2024-08-01T06:55:58.549 INFO:tasks.workunit.client.1.smithi089.stdout:7/395: symlink d7/d1f/l80 0 2024-08-01T06:55:58.549 INFO:tasks.workunit.client.1.smithi089.stdout:6/528: dread d2/d2e/d2f/f4d [0,4194304] 0 2024-08-01T06:55:58.550 INFO:tasks.workunit.client.1.smithi089.stdout:0/590: mkdir d9/d40/d95/dbc 0 2024-08-01T06:55:58.553 INFO:tasks.workunit.client.1.smithi089.stdout:6/529: readlink d2/d2e/d7c/laa 0 2024-08-01T06:55:58.554 INFO:tasks.workunit.client.1.smithi089.stdout:4/520: dwrite d3/d68/f7f [0,4194304] 0 2024-08-01T06:55:58.556 INFO:tasks.workunit.client.1.smithi089.stdout:1/492: dread d0/d9/f87 [0,4194304] 0 2024-08-01T06:55:58.556 INFO:tasks.workunit.client.1.smithi089.stdout:5/432: read - d5/de/d10/d16/d1b/d52/d5d/d6c/f81 zero size 2024-08-01T06:55:58.556 INFO:tasks.workunit.client.0.smithi016.stderr:++ readlink -f fsstress 2024-08-01T06:55:58.558 INFO:tasks.workunit.client.0.smithi016.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-08-01T06:55:58.559 INFO:tasks.workunit.client.0.smithi016.stderr:+ popd 2024-08-01T06:55:58.560 INFO:tasks.workunit.client.1.smithi089.stdout:8/441: creat d5/dc/f97 x:0 0 0 2024-08-01T06:55:58.560 INFO:tasks.workunit.client.0.smithi016.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-08-01T06:55:58.560 INFO:tasks.workunit.client.0.smithi016.stderr:+ popd 2024-08-01T06:55:58.561 INFO:tasks.workunit.client.0.smithi016.stdout:~/cephtest/mnt.0/client.0/tmp 2024-08-01T06:55:58.562 INFO:tasks.workunit.client.1.smithi089.stdout:7/396: dread - d7/d15/f3c zero size 2024-08-01T06:55:58.562 INFO:tasks.workunit.client.0.smithi016.stderr:++ mktemp -d -p . 2024-08-01T06:55:58.562 INFO:tasks.workunit.client.1.smithi089.stdout:5/433: dread - d5/d13/f7d zero size 2024-08-01T06:55:58.564 INFO:tasks.workunit.client.1.smithi089.stdout:1/493: symlink d0/d9/d43/d89/la5 0 2024-08-01T06:55:58.565 INFO:tasks.workunit.client.1.smithi089.stdout:9/414: mknod d18/d33/d49/d7b/c82 0 2024-08-01T06:55:58.566 INFO:tasks.workunit.client.0.smithi016.stderr:+ T=./tmp.HGsD6EgeC9 2024-08-01T06:55:58.566 INFO:tasks.workunit.client.0.smithi016.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.HGsD6EgeC9 -l 1 -n 1000 -p 10 -v 2024-08-01T06:55:58.568 INFO:tasks.workunit.client.1.smithi089.stdout:1/494: write d0/d9/d15/d2d/f36 [3924822,101692] 0 2024-08-01T06:55:58.569 INFO:tasks.workunit.client.1.smithi089.stdout:0/591: dread d9/d40/d25/d46/d91/d2e/d44/d53/f54 [0,4194304] 0 2024-08-01T06:55:58.569 INFO:tasks.workunit.client.1.smithi089.stdout:7/397: unlink d7/df/d10/f51 0 2024-08-01T06:55:58.570 INFO:tasks.workunit.client.1.smithi089.stdout:1/495: chown d0/d9/d15/d2d/f33 13 1 2024-08-01T06:55:58.570 INFO:tasks.workunit.client.1.smithi089.stdout:8/442: truncate d5/dc/d1e/d53/f60 302239 0 2024-08-01T06:55:58.572 INFO:tasks.workunit.client.1.smithi089.stdout:8/443: chown d5/dc/d1e/d53 3 1 2024-08-01T06:55:58.573 INFO:tasks.workunit.client.1.smithi089.stdout:1/496: read d0/d9/d15/d2d/d4a/d4d/f50 [1723735,41558] 0 2024-08-01T06:55:58.574 INFO:tasks.workunit.client.1.smithi089.stdout:5/434: creat d5/de/d10/d16/d1b/d25/f91 x:0 0 0 2024-08-01T06:55:58.575 INFO:tasks.workunit.client.1.smithi089.stdout:1/497: chown d0/d9/d15/d2d/d4a/d4d 1 1 2024-08-01T06:55:58.575 INFO:tasks.workunit.client.0.smithi016.stdout:seed = 1722021468 2024-08-01T06:55:58.575 INFO:tasks.workunit.client.1.smithi089.stdout:4/521: dread d3/db/d16/f1a [0,4194304] 0 2024-08-01T06:55:58.576 INFO:tasks.workunit.client.1.smithi089.stdout:1/498: stat d0/d9/d15/d3b/d3d/d77/la4 0 2024-08-01T06:55:58.578 INFO:tasks.workunit.client.1.smithi089.stdout:3/345: getdents d7/d32/d12 0 2024-08-01T06:55:58.579 INFO:tasks.workunit.client.1.smithi089.stdout:3/346: fsync d7/d32/d12/d29/d39/f6c 0 2024-08-01T06:55:58.580 INFO:tasks.workunit.client.1.smithi089.stdout:3/347: dread - d7/d32/d12/d29/d39/f6c zero size 2024-08-01T06:55:58.581 INFO:tasks.workunit.client.0.smithi016.stdout:0/0: write - no filename 2024-08-01T06:55:58.581 INFO:tasks.workunit.client.0.smithi016.stdout:0/1: dwrite - no filename 2024-08-01T06:55:58.582 INFO:tasks.workunit.client.1.smithi089.stdout:6/530: creat d2/d11/d1a/d1c/fb5 x:0 0 0 2024-08-01T06:55:58.583 INFO:tasks.workunit.client.1.smithi089.stdout:6/531: chown d2/f2b 5826 1 2024-08-01T06:55:58.584 INFO:tasks.workunit.client.0.smithi016.stdout:1/0: write - no filename 2024-08-01T06:55:58.584 INFO:tasks.workunit.client.1.smithi089.stdout:7/398: dread d7/d1f/d3a/f41 [0,4194304] 0 2024-08-01T06:55:58.586 INFO:tasks.workunit.client.1.smithi089.stdout:8/444: creat d5/d15/d5a/f98 x:0 0 0 2024-08-01T06:55:58.587 INFO:tasks.workunit.client.1.smithi089.stdout:6/532: dread d2/d11/d3e/f60 [0,4194304] 0 2024-08-01T06:55:58.587 INFO:tasks.workunit.client.0.smithi016.stdout:2/0: dwrite - no filename 2024-08-01T06:55:58.587 INFO:tasks.workunit.client.0.smithi016.stdout:2/1: dwrite - no filename 2024-08-01T06:55:58.587 INFO:tasks.workunit.client.0.smithi016.stdout:2/2: write - no filename 2024-08-01T06:55:58.588 INFO:tasks.workunit.client.1.smithi089.stdout:6/533: truncate d2/d11/d1f/f2d 4246626 0 2024-08-01T06:55:58.588 INFO:tasks.workunit.client.1.smithi089.stdout:5/435: mkdir d5/de/d10/d16/d1b/d92 0 2024-08-01T06:55:58.589 INFO:tasks.workunit.client.1.smithi089.stdout:5/436: write d5/de/d10/d33/f6e [206033,25812] 0 2024-08-01T06:55:58.590 INFO:tasks.workunit.client.1.smithi089.stdout:5/437: dread - d5/de/d10/d16/d1b/f90 zero size 2024-08-01T06:55:58.590 INFO:tasks.workunit.client.0.smithi016.stdout:0/2: mknod c0 0 2024-08-01T06:55:58.592 INFO:tasks.workunit.client.1.smithi089.stdout:1/499: mkdir d0/d9/d15/d3b/d95/d49/d82/da6 0 2024-08-01T06:55:58.593 INFO:tasks.workunit.client.0.smithi016.stdout:3/0: fdatasync - no filename 2024-08-01T06:55:58.593 INFO:tasks.workunit.client.0.smithi016.stdout:3/1: dwrite - no filename 2024-08-01T06:55:58.594 INFO:tasks.workunit.client.1.smithi089.stdout:9/415: link d18/d22/d39/f3a d18/d33/d49/f83 0 2024-08-01T06:55:58.594 INFO:tasks.workunit.client.0.smithi016.stdout:1/1: creat f0 x:0 0 0 2024-08-01T06:55:58.595 INFO:tasks.workunit.client.1.smithi089.stdout:9/416: dread - d18/d33/d3b/f69 zero size 2024-08-01T06:55:58.595 INFO:tasks.workunit.client.1.smithi089.stdout:5/438: dwrite d5/de/d10/d16/d1b/f39 [0,4194304] 0 2024-08-01T06:55:58.595 INFO:tasks.workunit.client.0.smithi016.stdout:0/3: mknod c1 0 2024-08-01T06:55:58.595 INFO:tasks.workunit.client.0.smithi016.stdout:0/4: truncate - no filename 2024-08-01T06:55:58.596 INFO:tasks.workunit.client.0.smithi016.stdout:0/5: rmdir - no directory 2024-08-01T06:55:58.597 INFO:tasks.workunit.client.1.smithi089.stdout:5/439: dread - d5/de/d10/d16/d1b/d25/f91 zero size 2024-08-01T06:55:58.597 INFO:tasks.workunit.client.0.smithi016.stdout:4/0: link - no file 2024-08-01T06:55:58.597 INFO:tasks.workunit.client.0.smithi016.stdout:4/1: dread - no filename 2024-08-01T06:55:58.597 INFO:tasks.workunit.client.0.smithi016.stdout:4/2: fdatasync - no filename 2024-08-01T06:55:58.597 INFO:tasks.workunit.client.0.smithi016.stdout:4/3: read - no filename 2024-08-01T06:55:58.597 INFO:tasks.workunit.client.0.smithi016.stdout:4/4: fdatasync - no filename 2024-08-01T06:55:58.597 INFO:tasks.workunit.client.0.smithi016.stdout:2/3: mkdir d0 0 2024-08-01T06:55:58.597 INFO:tasks.workunit.client.0.smithi016.stdout:2/4: truncate - no filename 2024-08-01T06:55:58.599 INFO:tasks.workunit.client.0.smithi016.stdout:1/2: mknod c1 0 2024-08-01T06:55:58.601 INFO:tasks.workunit.client.1.smithi089.stdout:7/399: stat d7/d1f/d30/d4c/l50 0 2024-08-01T06:55:58.603 INFO:tasks.workunit.client.1.smithi089.stdout:8/445: creat d5/d23/d91/f99 x:0 0 0 2024-08-01T06:55:58.604 INFO:tasks.workunit.client.1.smithi089.stdout:4/522: readlink d3/db/d33/l88 0 2024-08-01T06:55:58.605 INFO:tasks.workunit.client.0.smithi016.stdout:3/2: creat f0 x:0 0 0 2024-08-01T06:55:58.606 INFO:tasks.workunit.client.0.smithi016.stdout:1/3: mkdir d2 0 2024-08-01T06:55:58.608 INFO:tasks.workunit.client.1.smithi089.stdout:1/500: creat d0/d9/d15/d2d/fa7 x:0 0 0 2024-08-01T06:55:58.609 INFO:tasks.workunit.client.1.smithi089.stdout:3/348: creat d7/d32/d4c/d69/d6d/f6e x:0 0 0 2024-08-01T06:55:58.611 INFO:tasks.workunit.client.1.smithi089.stdout:9/417: creat d18/d22/d45/f84 x:0 0 0 2024-08-01T06:55:58.611 INFO:tasks.workunit.client.1.smithi089.stdout:1/501: write d0/d9/d15/d3b/d95/d49/f65 [2830318,113019] 0 2024-08-01T06:55:58.611 INFO:tasks.workunit.client.1.smithi089.stdout:4/523: dwrite d3/d1f/d62/d3b/f8d [0,4194304] 0 2024-08-01T06:55:58.611 INFO:tasks.workunit.client.0.smithi016.stdout:4/5: mkdir d0 0 2024-08-01T06:55:58.612 INFO:tasks.workunit.client.1.smithi089.stdout:0/592: creat d9/d40/d25/d46/d91/d2e/fbd x:0 0 0 2024-08-01T06:55:58.612 INFO:tasks.workunit.client.1.smithi089.stdout:9/418: chown d18/d22/d45/f59 16203 1 2024-08-01T06:55:58.614 INFO:tasks.workunit.client.0.smithi016.stdout:2/5: symlink d0/l1 0 2024-08-01T06:55:58.614 INFO:tasks.workunit.client.1.smithi089.stdout:1/502: read - d0/d9/d15/d2d/d4a/d61/f9e zero size 2024-08-01T06:55:58.615 INFO:tasks.workunit.client.0.smithi016.stdout:2/6: readlink d0/l1 0 2024-08-01T06:55:58.615 INFO:tasks.workunit.client.0.smithi016.stdout:2/7: fsync - no filename 2024-08-01T06:55:58.615 INFO:tasks.workunit.client.0.smithi016.stdout:2/8: dread - no filename 2024-08-01T06:55:58.615 INFO:tasks.workunit.client.0.smithi016.stdout:2/9: dwrite - no filename 2024-08-01T06:55:58.615 INFO:tasks.workunit.client.0.smithi016.stdout:2/10: dwrite - no filename 2024-08-01T06:55:58.615 INFO:tasks.workunit.client.0.smithi016.stdout:3/3: rename f0 to f1 0 2024-08-01T06:55:58.616 INFO:tasks.workunit.client.1.smithi089.stdout:7/400: chown d7/df/d10/c3d 4970585 1 2024-08-01T06:55:58.617 INFO:tasks.workunit.client.0.smithi016.stdout:1/4: dwrite f0 [0,4194304] 0 2024-08-01T06:55:58.617 INFO:tasks.workunit.client.0.smithi016.stdout:0/6: link c0 c2 0 2024-08-01T06:55:58.617 INFO:tasks.workunit.client.1.smithi089.stdout:3/349: dread d7/d32/d12/d1b/f26 [0,4194304] 0 2024-08-01T06:55:58.619 INFO:tasks.workunit.client.0.smithi016.stdout:3/4: chown f1 0 1 2024-08-01T06:55:58.619 INFO:tasks.workunit.client.1.smithi089.stdout:3/350: dread - d7/d32/d12/d29/d39/f6c zero size 2024-08-01T06:55:58.619 INFO:tasks.workunit.client.1.smithi089.stdout:6/534: mkdir d2/d11/d1a/d1c/db6 0 2024-08-01T06:55:58.620 INFO:tasks.workunit.client.0.smithi016.stdout:7/0: write - no filename 2024-08-01T06:55:58.624 INFO:tasks.workunit.client.1.smithi089.stdout:7/401: dwrite d7/df/d10/d36/f37 [0,4194304] 0 2024-08-01T06:55:58.624 INFO:tasks.workunit.client.1.smithi089.stdout:8/446: rename f2 to d5/d15/d5a/d73/d87/f9a 0 2024-08-01T06:55:58.626 INFO:tasks.workunit.client.0.smithi016.stdout:5/0: creat f0 x:0 0 0 2024-08-01T06:55:58.626 INFO:tasks.workunit.client.0.smithi016.stdout:5/1: dread - f0 zero size 2024-08-01T06:55:58.627 INFO:tasks.workunit.client.0.smithi016.stdout:5/2: truncate f0 766188 0 2024-08-01T06:55:58.628 INFO:tasks.workunit.client.1.smithi089.stdout:1/503: dread d0/d9/d43/f71 [0,4194304] 0 2024-08-01T06:55:58.630 INFO:tasks.workunit.client.1.smithi089.stdout:9/419: rmdir d18/d33 39 2024-08-01T06:55:58.633 INFO:tasks.workunit.client.0.smithi016.stdout:2/11: creat d0/f2 x:0 0 0 2024-08-01T06:55:58.634 INFO:tasks.workunit.client.0.smithi016.stdout:2/12: dread - d0/f2 zero size 2024-08-01T06:55:58.636 INFO:tasks.workunit.client.1.smithi089.stdout:0/593: dread d9/d40/d25/d46/f3d [0,4194304] 0 2024-08-01T06:55:58.639 INFO:tasks.workunit.client.0.smithi016.stdout:3/5: creat f2 x:0 0 0 2024-08-01T06:55:58.642 INFO:tasks.workunit.client.0.smithi016.stdout:8/0: dread - no filename 2024-08-01T06:55:58.642 INFO:tasks.workunit.client.0.smithi016.stdout:8/1: dread - no filename 2024-08-01T06:55:58.642 INFO:tasks.workunit.client.0.smithi016.stdout:8/2: unlink - no file 2024-08-01T06:55:58.642 INFO:tasks.workunit.client.0.smithi016.stdout:8/3: chown . 105 1 2024-08-01T06:55:58.643 INFO:tasks.workunit.client.1.smithi089.stdout:0/594: dwrite d9/d40/d95/d99/d2b/f80 [0,4194304] 0 2024-08-01T06:55:58.644 INFO:tasks.workunit.client.1.smithi089.stdout:8/447: symlink d5/d23/d91/l9b 0 2024-08-01T06:55:58.644 INFO:tasks.workunit.client.1.smithi089.stdout:8/448: chown d5/dc/f52 1 1 2024-08-01T06:55:58.645 INFO:tasks.workunit.client.0.smithi016.stdout:6/0: creat f0 x:0 0 0 2024-08-01T06:55:58.646 INFO:tasks.workunit.client.1.smithi089.stdout:7/402: mknod d7/df/d10/d42/c81 0 2024-08-01T06:55:58.647 INFO:tasks.workunit.client.0.smithi016.stdout:5/3: mkdir d1 0 2024-08-01T06:55:58.651 INFO:tasks.workunit.client.0.smithi016.stdout:4/6: creat d0/f1 x:0 0 0 2024-08-01T06:55:58.654 INFO:tasks.workunit.client.1.smithi089.stdout:8/449: dwrite d5/dc/f70 [0,4194304] 0 2024-08-01T06:55:58.655 INFO:tasks.workunit.client.0.smithi016.stdout:2/13: creat d0/f3 x:0 0 0 2024-08-01T06:55:58.655 INFO:tasks.workunit.client.0.smithi016.stdout:2/14: chown d0/f3 1262901 1 2024-08-01T06:55:58.655 INFO:tasks.workunit.client.0.smithi016.stdout:1/5: mkdir d2/d3 0 2024-08-01T06:55:58.655 INFO:tasks.workunit.client.0.smithi016.stdout:1/6: stat f0 0 2024-08-01T06:55:58.661 INFO:tasks.workunit.client.1.smithi089.stdout:5/440: dwrite d5/de/d10/d33/f56 [0,4194304] 0 2024-08-01T06:55:58.665 INFO:tasks.workunit.client.0.smithi016.stdout:7/1: getdents . 0 2024-08-01T06:55:58.666 INFO:tasks.workunit.client.0.smithi016.stdout:6/1: mkdir d1 0 2024-08-01T06:55:58.667 INFO:tasks.workunit.client.1.smithi089.stdout:4/524: creat d3/db/de/f9d x:0 0 0 2024-08-01T06:55:58.670 INFO:tasks.workunit.client.0.smithi016.stdout:4/7: mkdir d0/d2 0 2024-08-01T06:55:58.673 INFO:tasks.workunit.client.0.smithi016.stdout:2/15: mknod d0/c4 0 2024-08-01T06:55:58.675 INFO:tasks.workunit.client.0.smithi016.stdout:1/7: mknod d2/c4 0 2024-08-01T06:55:58.677 INFO:tasks.workunit.client.1.smithi089.stdout:1/504: write d0/f11 [2201155,74339] 0 2024-08-01T06:55:58.678 INFO:tasks.workunit.client.0.smithi016.stdout:3/6: rename f1 to f3 0 2024-08-01T06:55:58.679 INFO:tasks.workunit.client.1.smithi089.stdout:5/441: fsync d5/de/d10/d16/d1b/d25/f64 0 2024-08-01T06:55:58.680 INFO:tasks.workunit.client.0.smithi016.stdout:4/8: dwrite d0/f1 [0,4194304] 0 2024-08-01T06:55:58.680 INFO:tasks.workunit.client.0.smithi016.stdout:2/16: fsync d0/f3 0 2024-08-01T06:55:58.680 INFO:tasks.workunit.client.0.smithi016.stdout:4/9: stat d0 0 2024-08-01T06:55:58.682 INFO:tasks.workunit.client.0.smithi016.stdout:8/4: getdents . 0 2024-08-01T06:55:58.682 INFO:tasks.workunit.client.0.smithi016.stdout:8/5: dread - no filename 2024-08-01T06:55:58.682 INFO:tasks.workunit.client.0.smithi016.stdout:8/6: truncate - no filename 2024-08-01T06:55:58.685 INFO:tasks.workunit.client.1.smithi089.stdout:6/535: rename d2/d30/d3c/c82 to d2/d11/d1a/d1c/cb7 0 2024-08-01T06:55:58.686 INFO:tasks.workunit.client.0.smithi016.stdout:5/4: mkdir d1/d2 0 2024-08-01T06:55:58.687 INFO:tasks.workunit.client.1.smithi089.stdout:0/595: creat d9/d40/d95/d99/d2b/d55/fbe x:0 0 0 2024-08-01T06:55:58.691 INFO:tasks.workunit.client.1.smithi089.stdout:4/525: write d3/db/d16/f4f [4969133,110557] 0 2024-08-01T06:55:58.691 INFO:tasks.workunit.client.0.smithi016.stdout:0/7: getdents . 0 2024-08-01T06:55:58.691 INFO:tasks.workunit.client.0.smithi016.stdout:0/8: read - no filename 2024-08-01T06:55:58.691 INFO:tasks.workunit.client.0.smithi016.stdout:0/9: dread - no filename 2024-08-01T06:55:58.693 INFO:tasks.workunit.client.0.smithi016.stdout:3/7: unlink f2 0 2024-08-01T06:55:58.694 INFO:tasks.workunit.client.0.smithi016.stdout:5/5: dwrite f0 [0,4194304] 0 2024-08-01T06:55:58.694 INFO:tasks.workunit.client.0.smithi016.stdout:9/0: symlink l0 0 2024-08-01T06:55:58.695 INFO:tasks.workunit.client.0.smithi016.stdout:3/8: dread - f3 zero size 2024-08-01T06:55:58.695 INFO:tasks.workunit.client.0.smithi016.stdout:9/1: dread - no filename 2024-08-01T06:55:58.695 INFO:tasks.workunit.client.0.smithi016.stdout:2/17: rmdir d0 39 2024-08-01T06:55:58.696 INFO:tasks.workunit.client.0.smithi016.stdout:4/10: rmdir d0 39 2024-08-01T06:55:58.697 INFO:tasks.workunit.client.0.smithi016.stdout:7/2: mknod c0 0 2024-08-01T06:55:58.698 INFO:tasks.workunit.client.0.smithi016.stdout:7/3: write - no filename 2024-08-01T06:55:58.698 INFO:tasks.workunit.client.0.smithi016.stdout:7/4: read - no filename 2024-08-01T06:55:58.698 INFO:tasks.workunit.client.0.smithi016.stdout:7/5: read - no filename 2024-08-01T06:55:58.698 INFO:tasks.workunit.client.0.smithi016.stdout:6/2: creat d1/f2 x:0 0 0 2024-08-01T06:55:58.698 INFO:tasks.workunit.client.0.smithi016.stdout:6/3: rename d1 to d1/d3 22 2024-08-01T06:55:58.700 INFO:tasks.workunit.client.0.smithi016.stdout:1/8: creat d2/d3/f5 x:0 0 0 2024-08-01T06:55:58.701 INFO:tasks.workunit.client.0.smithi016.stdout:0/10: creat f3 x:0 0 0 2024-08-01T06:55:58.702 INFO:tasks.workunit.client.0.smithi016.stdout:0/11: truncate f3 4240 0 2024-08-01T06:55:58.704 INFO:tasks.workunit.client.0.smithi016.stdout:3/9: symlink l4 0 2024-08-01T06:55:58.705 INFO:tasks.workunit.client.0.smithi016.stdout:9/2: rename l0 to l1 0 2024-08-01T06:55:58.705 INFO:tasks.workunit.client.0.smithi016.stdout:9/3: fsync - no filename 2024-08-01T06:55:58.705 INFO:tasks.workunit.client.0.smithi016.stdout:3/10: chown f3 306 1 2024-08-01T06:55:58.710 INFO:tasks.workunit.client.0.smithi016.stdout:8/7: symlink l0 0 2024-08-01T06:55:58.711 INFO:tasks.workunit.client.0.smithi016.stdout:7/6: symlink l1 0 2024-08-01T06:55:58.711 INFO:tasks.workunit.client.0.smithi016.stdout:8/8: chown l0 2921 1 2024-08-01T06:55:58.711 INFO:tasks.workunit.client.0.smithi016.stdout:8/9: fsync - no filename 2024-08-01T06:55:58.711 INFO:tasks.workunit.client.0.smithi016.stdout:8/10: read - no filename 2024-08-01T06:55:58.712 INFO:tasks.workunit.client.0.smithi016.stdout:8/11: rmdir - no directory 2024-08-01T06:55:58.712 INFO:tasks.workunit.client.0.smithi016.stdout:8/12: dread - no filename 2024-08-01T06:55:58.712 INFO:tasks.workunit.client.0.smithi016.stdout:8/13: readlink l0 0 2024-08-01T06:55:58.713 INFO:tasks.workunit.client.0.smithi016.stdout:6/4: creat d1/f4 x:0 0 0 2024-08-01T06:55:58.713 INFO:tasks.workunit.client.0.smithi016.stdout:0/12: dwrite f3 [0,4194304] 0 2024-08-01T06:55:58.714 INFO:tasks.workunit.client.0.smithi016.stdout:1/9: symlink d2/l6 0 2024-08-01T06:55:58.718 INFO:tasks.workunit.client.0.smithi016.stdout:2/18: creat d0/f5 x:0 0 0 2024-08-01T06:55:58.720 INFO:tasks.workunit.client.0.smithi016.stdout:5/6: write f0 [4193864,128553] 0 2024-08-01T06:55:58.721 INFO:tasks.workunit.client.0.smithi016.stdout:7/7: rename c0 to c2 0 2024-08-01T06:55:58.721 INFO:tasks.workunit.client.0.smithi016.stdout:7/8: dread - no filename 2024-08-01T06:55:58.721 INFO:tasks.workunit.client.0.smithi016.stdout:7/9: dwrite - no filename 2024-08-01T06:55:58.723 INFO:tasks.workunit.client.0.smithi016.stdout:8/14: creat f1 x:0 0 0 2024-08-01T06:55:58.725 INFO:tasks.workunit.client.0.smithi016.stdout:0/13: creat f4 x:0 0 0 2024-08-01T06:55:58.726 INFO:tasks.workunit.client.0.smithi016.stdout:1/10: dwrite f0 [4194304,4194304] 0 2024-08-01T06:55:58.726 INFO:tasks.workunit.client.0.smithi016.stdout:3/11: write f3 [260378,6956] 0 2024-08-01T06:55:58.727 INFO:tasks.workunit.client.0.smithi016.stdout:6/5: creat d1/f5 x:0 0 0 2024-08-01T06:55:58.728 INFO:tasks.workunit.client.0.smithi016.stdout:8/15: write f1 [541396,12421] 0 2024-08-01T06:55:58.731 INFO:tasks.workunit.client.0.smithi016.stdout:8/16: truncate f1 1562358 0 2024-08-01T06:55:58.732 INFO:tasks.workunit.client.0.smithi016.stdout:3/12: fdatasync f3 0 2024-08-01T06:55:58.734 INFO:tasks.workunit.client.0.smithi016.stdout:7/10: mknod c3 0 2024-08-01T06:55:58.736 INFO:tasks.workunit.client.0.smithi016.stdout:0/14: mknod c5 0 2024-08-01T06:55:58.738 INFO:tasks.workunit.client.0.smithi016.stdout:1/11: rmdir d2 39 2024-08-01T06:55:58.742 INFO:tasks.workunit.client.0.smithi016.stdout:2/19: rmdir d0 39 2024-08-01T06:55:58.744 INFO:tasks.workunit.client.0.smithi016.stdout:3/13: rename l4 to l5 0 2024-08-01T06:55:58.745 INFO:tasks.workunit.client.0.smithi016.stdout:1/12: write f0 [326691,15071] 0 2024-08-01T06:55:58.745 INFO:tasks.workunit.client.0.smithi016.stdout:5/7: dwrite f0 [4194304,4194304] 0 2024-08-01T06:55:58.746 INFO:tasks.workunit.client.0.smithi016.stdout:7/11: creat f4 x:0 0 0 2024-08-01T06:55:58.749 INFO:tasks.workunit.client.0.smithi016.stdout:5/8: stat d1/d2 0 2024-08-01T06:55:58.749 INFO:tasks.workunit.client.0.smithi016.stdout:0/15: creat f6 x:0 0 0 2024-08-01T06:55:58.750 INFO:tasks.workunit.client.0.smithi016.stdout:9/4: getdents . 0 2024-08-01T06:55:58.750 INFO:tasks.workunit.client.0.smithi016.stdout:9/5: write - no filename 2024-08-01T06:55:58.751 INFO:tasks.workunit.client.0.smithi016.stdout:7/12: truncate f4 203695 0 2024-08-01T06:55:58.751 INFO:tasks.workunit.client.0.smithi016.stdout:7/13: rmdir - no directory 2024-08-01T06:55:58.752 INFO:tasks.workunit.client.0.smithi016.stdout:9/6: readlink l1 0 2024-08-01T06:55:58.753 INFO:tasks.workunit.client.0.smithi016.stdout:6/6: dwrite d1/f2 [0,4194304] 0 2024-08-01T06:55:58.754 INFO:tasks.workunit.client.0.smithi016.stdout:4/11: getdents d0 0 2024-08-01T06:55:58.755 INFO:tasks.workunit.client.0.smithi016.stdout:7/14: truncate f4 911251 0 2024-08-01T06:55:58.756 INFO:tasks.workunit.client.0.smithi016.stdout:0/16: write f6 [264676,85540] 0 2024-08-01T06:55:58.758 INFO:tasks.workunit.client.0.smithi016.stdout:8/17: dwrite f1 [0,4194304] 0 2024-08-01T06:55:58.759 INFO:tasks.workunit.client.0.smithi016.stdout:3/14: mknod c6 0 2024-08-01T06:55:58.761 INFO:tasks.workunit.client.0.smithi016.stdout:8/18: write f1 [3090030,53244] 0 2024-08-01T06:55:58.765 INFO:tasks.workunit.client.0.smithi016.stdout:9/7: rename l1 to l2 0 2024-08-01T06:55:58.766 INFO:tasks.workunit.client.1.smithi089.stdout:8/450: creat d5/f9c x:0 0 0 2024-08-01T06:55:58.766 INFO:tasks.workunit.client.1.smithi089.stdout:5/442: symlink d5/de/d10/l93 0 2024-08-01T06:55:58.767 INFO:tasks.workunit.client.0.smithi016.stdout:1/13: mknod d2/d3/c7 0 2024-08-01T06:55:58.767 INFO:tasks.workunit.client.0.smithi016.stdout:8/19: write f1 [3951366,121850] 0 2024-08-01T06:55:58.768 INFO:tasks.workunit.client.1.smithi089.stdout:9/420: dwrite f5 [4194304,4194304] 0 2024-08-01T06:55:58.769 INFO:tasks.workunit.client.0.smithi016.stdout:7/15: creat f5 x:0 0 0 2024-08-01T06:55:58.771 INFO:tasks.workunit.client.1.smithi089.stdout:8/451: write d5/d15/d5a/f8a [811968,40003] 0 2024-08-01T06:55:58.771 INFO:tasks.workunit.client.1.smithi089.stdout:6/536: dwrite d2/d2e/d2f/f6d [0,4194304] 0 2024-08-01T06:55:58.772 INFO:tasks.workunit.client.0.smithi016.stdout:0/17: creat f7 x:0 0 0 2024-08-01T06:55:58.772 INFO:tasks.workunit.client.0.smithi016.stdout:9/8: mkdir d3 0 2024-08-01T06:55:58.777 INFO:tasks.workunit.client.0.smithi016.stdout:4/12: mknod d0/d2/c3 0 2024-08-01T06:55:58.778 INFO:tasks.workunit.client.0.smithi016.stdout:5/9: dwrite f0 [8388608,4194304] 0 2024-08-01T06:55:58.781 INFO:tasks.workunit.client.0.smithi016.stdout:0/18: mknod c8 0 2024-08-01T06:55:58.782 INFO:tasks.workunit.client.0.smithi016.stdout:7/16: dread f4 [0,4194304] 0 2024-08-01T06:55:58.784 INFO:tasks.workunit.client.0.smithi016.stdout:9/9: mkdir d3/d4 0 2024-08-01T06:55:58.785 INFO:tasks.workunit.client.0.smithi016.stdout:4/13: creat d0/d2/f4 x:0 0 0 2024-08-01T06:55:58.786 INFO:tasks.workunit.client.0.smithi016.stdout:9/10: chown d3 756904 1 2024-08-01T06:55:58.787 INFO:tasks.workunit.client.0.smithi016.stdout:0/19: rename f3 to f9 0 2024-08-01T06:55:58.787 INFO:tasks.workunit.client.0.smithi016.stdout:3/15: dwrite f3 [0,4194304] 0 2024-08-01T06:55:58.788 INFO:tasks.workunit.client.0.smithi016.stdout:7/17: truncate f4 1467577 0 2024-08-01T06:55:58.789 INFO:tasks.workunit.client.0.smithi016.stdout:6/7: dwrite d1/f5 [0,4194304] 0 2024-08-01T06:55:58.790 INFO:tasks.workunit.client.0.smithi016.stdout:4/14: chown d0/d2 1 1 2024-08-01T06:55:58.791 INFO:tasks.workunit.client.0.smithi016.stdout:5/10: mknod d1/d2/c3 0 2024-08-01T06:55:58.792 INFO:tasks.workunit.client.0.smithi016.stdout:5/11: stat d1 0 2024-08-01T06:55:58.792 INFO:tasks.workunit.client.0.smithi016.stdout:1/14: dread f0 [4194304,4194304] 0 2024-08-01T06:55:58.792 INFO:tasks.workunit.client.0.smithi016.stdout:3/16: symlink l7 0 2024-08-01T06:55:58.795 INFO:tasks.workunit.client.0.smithi016.stdout:7/18: creat f6 x:0 0 0 2024-08-01T06:55:58.797 INFO:tasks.workunit.client.0.smithi016.stdout:9/11: rename l2 to d3/l5 0 2024-08-01T06:55:58.797 INFO:tasks.workunit.client.0.smithi016.stdout:9/12: write - no filename 2024-08-01T06:55:58.797 INFO:tasks.workunit.client.0.smithi016.stdout:9/13: dwrite - no filename 2024-08-01T06:55:58.797 INFO:tasks.workunit.client.0.smithi016.stdout:9/14: write - no filename 2024-08-01T06:55:58.797 INFO:tasks.workunit.client.0.smithi016.stdout:9/15: read - no filename 2024-08-01T06:55:58.797 INFO:tasks.workunit.client.0.smithi016.stdout:9/16: dwrite - no filename 2024-08-01T06:55:58.797 INFO:tasks.workunit.client.0.smithi016.stdout:9/17: fsync - no filename 2024-08-01T06:55:58.797 INFO:tasks.workunit.client.0.smithi016.stdout:9/18: fdatasync - no filename 2024-08-01T06:55:58.798 INFO:tasks.workunit.client.0.smithi016.stdout:9/19: fsync - no filename 2024-08-01T06:55:58.798 INFO:tasks.workunit.client.0.smithi016.stdout:9/20: dwrite - no filename 2024-08-01T06:55:58.798 INFO:tasks.workunit.client.0.smithi016.stdout:9/21: fdatasync - no filename 2024-08-01T06:55:58.798 INFO:tasks.workunit.client.0.smithi016.stdout:4/15: unlink d0/d2/c3 0 2024-08-01T06:55:58.801 INFO:tasks.workunit.client.0.smithi016.stdout:3/17: readlink l5 0 2024-08-01T06:55:58.802 INFO:tasks.workunit.client.1.smithi089.stdout:2/386: sync 2024-08-01T06:55:58.804 INFO:tasks.workunit.client.0.smithi016.stdout:5/12: dwrite f0 [0,4194304] 0 2024-08-01T06:55:58.806 INFO:tasks.workunit.client.0.smithi016.stdout:1/15: write f0 [5586821,69806] 0 2024-08-01T06:55:58.807 INFO:tasks.workunit.client.0.smithi016.stdout:6/8: dwrite d1/f2 [0,4194304] 0 2024-08-01T06:55:58.808 INFO:tasks.workunit.client.0.smithi016.stdout:6/9: chown d1 417655 1 2024-08-01T06:55:58.808 INFO:tasks.workunit.client.0.smithi016.stdout:6/10: fsync f0 0 2024-08-01T06:55:58.809 INFO:tasks.workunit.client.1.smithi089.stdout:5/443: dwrite d5/d13/d38/d42/f55 [0,4194304] 0 2024-08-01T06:55:58.809 INFO:tasks.workunit.client.0.smithi016.stdout:0/20: unlink f7 0 2024-08-01T06:55:58.810 INFO:tasks.workunit.client.0.smithi016.stdout:1/16: dread - d2/d3/f5 zero size 2024-08-01T06:55:58.810 INFO:tasks.workunit.client.0.smithi016.stdout:8/20: truncate f1 2346598 0 2024-08-01T06:55:58.812 INFO:tasks.workunit.client.0.smithi016.stdout:0/21: write f4 [295576,57618] 0 2024-08-01T06:55:58.813 INFO:tasks.workunit.client.0.smithi016.stdout:1/17: truncate d2/d3/f5 730080 0 2024-08-01T06:55:58.813 INFO:tasks.workunit.client.0.smithi016.stdout:7/19: mkdir d7 0 2024-08-01T06:55:58.815 INFO:tasks.workunit.client.0.smithi016.stdout:1/18: write f0 [7123780,92095] 0 2024-08-01T06:55:58.817 INFO:tasks.workunit.client.0.smithi016.stdout:3/18: fsync f3 0 2024-08-01T06:55:58.817 INFO:tasks.workunit.client.0.smithi016.stdout:3/19: fdatasync f3 0 2024-08-01T06:55:58.820 INFO:tasks.workunit.client.0.smithi016.stdout:4/16: creat d0/f5 x:0 0 0 2024-08-01T06:55:58.826 INFO:tasks.workunit.client.0.smithi016.stdout:9/22: chown d3/l5 1656396 1 2024-08-01T06:55:58.826 INFO:tasks.workunit.client.0.smithi016.stdout:9/23: truncate - no filename 2024-08-01T06:55:58.828 INFO:tasks.workunit.client.0.smithi016.stdout:7/20: dwrite f6 [0,4194304] 0 2024-08-01T06:55:58.828 INFO:tasks.workunit.client.0.smithi016.stdout:9/24: rename d3/d4 to d3/d4/d6 22 2024-08-01T06:55:58.832 INFO:tasks.workunit.client.1.smithi089.stdout:6/537: fdatasync d2/d11/f66 0 2024-08-01T06:55:58.833 INFO:tasks.workunit.client.1.smithi089.stdout:6/538: fsync d2/d11/f9a 0 2024-08-01T06:55:58.835 INFO:tasks.workunit.client.1.smithi089.stdout:9/421: dread d18/f2a [4194304,4194304] 0 2024-08-01T06:55:58.836 INFO:tasks.workunit.client.0.smithi016.stdout:6/11: rmdir d1 39 2024-08-01T06:55:58.836 INFO:tasks.workunit.client.0.smithi016.stdout:6/12: dread - f0 zero size 2024-08-01T06:55:58.836 INFO:tasks.workunit.client.1.smithi089.stdout:9/422: truncate d18/f7e 151212 0 2024-08-01T06:55:58.836 INFO:tasks.workunit.client.0.smithi016.stdout:8/21: fdatasync f1 0 2024-08-01T06:55:58.839 INFO:tasks.workunit.client.0.smithi016.stdout:0/22: mknod ca 0 2024-08-01T06:55:58.842 INFO:tasks.workunit.client.0.smithi016.stdout:1/19: creat d2/f8 x:0 0 0 2024-08-01T06:55:58.842 INFO:tasks.workunit.client.1.smithi089.stdout:8/452: dwrite d5/d23/f38 [0,4194304] 0 2024-08-01T06:55:58.843 INFO:tasks.workunit.client.0.smithi016.stdout:3/20: rename c6 to c8 0 2024-08-01T06:55:58.846 INFO:tasks.workunit.client.0.smithi016.stdout:9/25: mknod d3/c7 0 2024-08-01T06:55:58.846 INFO:tasks.workunit.client.1.smithi089.stdout:6/539: symlink d2/d11/d1a/lb8 0 2024-08-01T06:55:58.848 INFO:tasks.workunit.client.1.smithi089.stdout:9/423: creat d18/d22/d43/f85 x:0 0 0 2024-08-01T06:55:58.848 INFO:tasks.workunit.client.1.smithi089.stdout:0/596: link d9/d40/d95/d99/d2b/d55/d7a/c6e d9/d40/d45/d47/d9d/cbf 0 2024-08-01T06:55:58.849 INFO:tasks.workunit.client.0.smithi016.stdout:5/13: unlink f0 0 2024-08-01T06:55:58.849 INFO:tasks.workunit.client.0.smithi016.stdout:5/14: write - no filename 2024-08-01T06:55:58.849 INFO:tasks.workunit.client.0.smithi016.stdout:5/15: write - no filename 2024-08-01T06:55:58.850 INFO:tasks.workunit.client.0.smithi016.stdout:6/13: fsync d1/f4 0 2024-08-01T06:55:58.851 INFO:tasks.workunit.client.0.smithi016.stdout:6/14: dread - d1/f4 zero size 2024-08-01T06:55:58.851 INFO:tasks.workunit.client.0.smithi016.stdout:8/22: unlink f1 0 2024-08-01T06:55:58.851 INFO:tasks.workunit.client.0.smithi016.stdout:8/23: write - no filename 2024-08-01T06:55:58.852 INFO:tasks.workunit.client.0.smithi016.stdout:8/24: write - no filename 2024-08-01T06:55:58.858 INFO:tasks.workunit.client.1.smithi089.stdout:0/597: rename d9/d40/d25/d46/fa5 to d9/d40/d45/d47/fc0 0 2024-08-01T06:55:58.858 INFO:tasks.workunit.client.1.smithi089.stdout:5/444: write d5/d13/f30 [763167,78611] 0 2024-08-01T06:55:58.859 INFO:tasks.workunit.client.1.smithi089.stdout:8/453: fdatasync d5/dc/d94/f8c 0 2024-08-01T06:55:58.859 INFO:tasks.workunit.client.0.smithi016.stdout:3/21: mkdir d9 0 2024-08-01T06:55:58.859 INFO:tasks.workunit.client.0.smithi016.stdout:4/17: link d0/d2/f4 d0/f6 0 2024-08-01T06:55:58.859 INFO:tasks.workunit.client.0.smithi016.stdout:7/21: mkdir d7/d8 0 2024-08-01T06:55:58.861 INFO:tasks.workunit.client.0.smithi016.stdout:5/16: creat d1/d2/f4 x:0 0 0 2024-08-01T06:55:58.862 INFO:tasks.workunit.client.0.smithi016.stdout:5/17: write d1/d2/f4 [882621,25853] 0 2024-08-01T06:55:58.862 INFO:tasks.workunit.client.1.smithi089.stdout:0/598: mkdir d9/d40/d45/dc1 0 2024-08-01T06:55:58.863 INFO:tasks.workunit.client.0.smithi016.stdout:1/20: rmdir d2 39 2024-08-01T06:55:58.863 INFO:tasks.workunit.client.1.smithi089.stdout:8/454: dwrite d5/dc/f70 [0,4194304] 0 2024-08-01T06:55:58.864 INFO:tasks.workunit.client.1.smithi089.stdout:4/526: truncate d3/db/d33/f6f 780824 0 2024-08-01T06:55:58.865 INFO:tasks.workunit.client.0.smithi016.stdout:6/15: mknod d1/c6 0 2024-08-01T06:55:58.867 INFO:tasks.workunit.client.1.smithi089.stdout:0/599: truncate d9/d40/d95/d99/d2b/f80 4870114 0 2024-08-01T06:55:58.867 INFO:tasks.workunit.client.1.smithi089.stdout:2/387: dwrite d7/d1f/d29/f15 [0,4194304] 0 2024-08-01T06:55:58.868 INFO:tasks.workunit.client.1.smithi089.stdout:5/445: mknod d5/d13/d83/c94 0 2024-08-01T06:55:58.868 INFO:tasks.workunit.client.0.smithi016.stdout:5/18: dread d1/d2/f4 [0,4194304] 0 2024-08-01T06:55:58.871 INFO:tasks.workunit.client.0.smithi016.stdout:6/16: dread d1/f5 [0,4194304] 0 2024-08-01T06:55:58.871 INFO:tasks.workunit.client.1.smithi089.stdout:0/600: dread d9/d40/d25/d46/f6f [0,4194304] 0 2024-08-01T06:55:58.872 INFO:tasks.workunit.client.0.smithi016.stdout:3/22: unlink l7 0 2024-08-01T06:55:58.872 INFO:tasks.workunit.client.0.smithi016.stdout:6/17: write d1/f5 [4923289,27200] 0 2024-08-01T06:55:58.873 INFO:tasks.workunit.client.0.smithi016.stdout:6/18: stat d1/f4 0 2024-08-01T06:55:58.881 INFO:tasks.workunit.client.1.smithi089.stdout:8/455: dread d5/dc/d94/f32 [0,4194304] 0 2024-08-01T06:55:58.881 INFO:tasks.workunit.client.0.smithi016.stdout:1/21: write d2/d3/f5 [1207620,44486] 0 2024-08-01T06:55:58.883 INFO:tasks.workunit.client.1.smithi089.stdout:8/456: dread d5/dc/d94/f8c [0,4194304] 0 2024-08-01T06:55:58.884 INFO:tasks.workunit.client.1.smithi089.stdout:9/424: write d18/d33/d53/f5e [706704,46154] 0 2024-08-01T06:55:58.885 INFO:tasks.workunit.client.1.smithi089.stdout:9/425: write f10 [1201765,43298] 0 2024-08-01T06:55:58.885 INFO:tasks.workunit.client.1.smithi089.stdout:0/601: creat d9/d40/d25/d46/d91/d2e/d44/d72/fc2 x:0 0 0 2024-08-01T06:55:58.886 INFO:tasks.workunit.client.0.smithi016.stdout:5/19: creat d1/f5 x:0 0 0 2024-08-01T06:55:58.887 INFO:tasks.workunit.client.0.smithi016.stdout:5/20: chown d1/d2 112141494 1 2024-08-01T06:55:58.889 INFO:tasks.workunit.client.0.smithi016.stdout:6/19: symlink d1/l7 0 2024-08-01T06:55:58.890 INFO:tasks.workunit.client.1.smithi089.stdout:5/446: symlink d5/de/d57/d8e/l95 0 2024-08-01T06:55:58.891 INFO:tasks.workunit.client.0.smithi016.stdout:7/22: symlink d7/d8/l9 0 2024-08-01T06:55:58.892 INFO:tasks.workunit.client.1.smithi089.stdout:8/457: mknod d5/dc/d1e/d53/c9d 0 2024-08-01T06:55:58.893 INFO:tasks.workunit.client.1.smithi089.stdout:8/458: write d5/f41 [4263373,36441] 0 2024-08-01T06:55:58.898 INFO:tasks.workunit.client.1.smithi089.stdout:0/602: creat d9/d40/d25/d46/d91/d64/fc3 x:0 0 0 2024-08-01T06:55:58.898 INFO:tasks.workunit.client.0.smithi016.stdout:1/22: rename d2/f8 to d2/d3/f9 0 2024-08-01T06:55:58.899 INFO:tasks.workunit.client.0.smithi016.stdout:1/23: write d2/d3/f5 [1511393,15712] 0 2024-08-01T06:55:58.900 INFO:tasks.workunit.client.0.smithi016.stdout:1/24: chown f0 12 1 2024-08-01T06:55:58.901 INFO:tasks.workunit.client.0.smithi016.stdout:1/25: write f0 [3086979,126786] 0 2024-08-01T06:55:58.902 INFO:tasks.workunit.client.0.smithi016.stdout:0/23: getdents . 0 2024-08-01T06:55:58.904 INFO:tasks.workunit.client.0.smithi016.stdout:5/21: read d1/d2/f4 [83314,44412] 0 2024-08-01T06:55:58.906 INFO:tasks.workunit.client.1.smithi089.stdout:5/447: rename d5/de/d10/d16/d1b/d25/f91 to d5/d13/d83/f96 0 2024-08-01T06:55:58.906 INFO:tasks.workunit.client.0.smithi016.stdout:3/23: mkdir d9/da 0 2024-08-01T06:55:58.908 INFO:tasks.workunit.client.0.smithi016.stdout:6/20: mkdir d1/d8 0 2024-08-01T06:55:58.910 INFO:tasks.workunit.client.1.smithi089.stdout:4/527: dwrite d3/d1f/d62/f2a [0,4194304] 0 2024-08-01T06:55:58.910 INFO:tasks.workunit.client.1.smithi089.stdout:9/426: mknod d18/c86 0 2024-08-01T06:55:58.912 INFO:tasks.workunit.client.1.smithi089.stdout:9/427: write d18/f7e [129624,32190] 0 2024-08-01T06:55:58.913 INFO:tasks.workunit.client.1.smithi089.stdout:2/388: getdents d7 0 2024-08-01T06:55:58.913 INFO:tasks.workunit.client.0.smithi016.stdout:8/25: getdents . 0 2024-08-01T06:55:58.914 INFO:tasks.workunit.client.0.smithi016.stdout:8/26: dwrite - no filename 2024-08-01T06:55:58.916 INFO:tasks.workunit.client.1.smithi089.stdout:5/448: mkdir d5/de/d57/d8e/d97 0 2024-08-01T06:55:58.917 INFO:tasks.workunit.client.0.smithi016.stdout:1/26: rmdir d2 39 2024-08-01T06:55:58.919 INFO:tasks.workunit.client.1.smithi089.stdout:8/459: mkdir d5/d9e 0 2024-08-01T06:55:58.920 INFO:tasks.workunit.client.0.smithi016.stdout:0/24: mknod cb 0 2024-08-01T06:55:58.921 INFO:tasks.workunit.client.0.smithi016.stdout:5/22: mkdir d1/d2/d6 0 2024-08-01T06:55:58.922 INFO:tasks.workunit.client.0.smithi016.stdout:3/24: rmdir d9 39 2024-08-01T06:55:58.922 INFO:tasks.workunit.client.0.smithi016.stdout:3/25: write f3 [266553,9419] 0 2024-08-01T06:55:58.923 INFO:tasks.workunit.client.0.smithi016.stdout:6/21: write d1/f5 [784826,39665] 0 2024-08-01T06:55:58.925 INFO:tasks.workunit.client.1.smithi089.stdout:0/603: symlink d9/d40/lc4 0 2024-08-01T06:55:58.926 INFO:tasks.workunit.client.0.smithi016.stdout:8/27: mknod c2 0 2024-08-01T06:55:58.926 INFO:tasks.workunit.client.0.smithi016.stdout:8/28: truncate - no filename 2024-08-01T06:55:58.928 INFO:tasks.workunit.client.1.smithi089.stdout:9/428: unlink d18/d33/d53/c72 0 2024-08-01T06:55:58.930 INFO:tasks.workunit.client.1.smithi089.stdout:2/389: symlink d7/l79 0 2024-08-01T06:55:58.931 INFO:tasks.workunit.client.1.smithi089.stdout:5/449: mkdir d5/de/d10/d16/d1b/d52/d5d/d6c/d98 0 2024-08-01T06:55:58.932 INFO:tasks.workunit.client.0.smithi016.stdout:5/23: symlink d1/l7 0 2024-08-01T06:55:58.934 INFO:tasks.workunit.client.1.smithi089.stdout:4/528: rename d3/d1e/d21 to d3/d86/d9e 0 2024-08-01T06:55:58.935 INFO:tasks.workunit.client.1.smithi089.stdout:8/460: dread d5/dc/f16 [0,4194304] 0 2024-08-01T06:55:58.935 INFO:tasks.workunit.client.0.smithi016.stdout:6/22: mkdir d1/d9 0 2024-08-01T06:55:58.936 INFO:tasks.workunit.client.1.smithi089.stdout:9/429: symlink d18/d33/d6e/l87 0 2024-08-01T06:55:58.937 INFO:tasks.workunit.client.0.smithi016.stdout:6/23: write d1/f5 [1531330,81259] 0 2024-08-01T06:55:58.937 INFO:tasks.workunit.client.0.smithi016.stdout:0/25: dwrite f9 [0,4194304] 0 2024-08-01T06:55:58.938 INFO:tasks.workunit.client.0.smithi016.stdout:0/26: write f9 [3773178,53817] 0 2024-08-01T06:55:58.939 INFO:tasks.workunit.client.1.smithi089.stdout:2/390: dread f2 [0,4194304] 0 2024-08-01T06:55:58.942 INFO:tasks.workunit.client.0.smithi016.stdout:5/24: rename d1/l7 to d1/d2/d6/l8 0 2024-08-01T06:55:58.946 INFO:tasks.workunit.client.0.smithi016.stdout:7/23: getdents d7/d8 0 2024-08-01T06:55:58.947 INFO:tasks.workunit.client.1.smithi089.stdout:0/604: symlink d9/d40/d25/d46/d91/d2e/d44/d53/db9/lc5 0 2024-08-01T06:55:58.951 INFO:tasks.workunit.client.1.smithi089.stdout:3/351: sync 2024-08-01T06:55:58.952 INFO:tasks.workunit.client.0.smithi016.stdout:1/27: dwrite d2/d3/f9 [0,4194304] 0 2024-08-01T06:55:58.952 INFO:tasks.workunit.client.0.smithi016.stdout:0/27: dwrite f6 [0,4194304] 0 2024-08-01T06:55:58.953 INFO:tasks.workunit.client.0.smithi016.stdout:0/28: fsync f4 0 2024-08-01T06:55:58.954 INFO:tasks.workunit.client.1.smithi089.stdout:5/450: unlink d5/de/f4f 0 2024-08-01T06:55:58.955 INFO:tasks.workunit.client.0.smithi016.stdout:3/26: creat d9/da/fb x:0 0 0 2024-08-01T06:55:58.956 INFO:tasks.workunit.client.1.smithi089.stdout:5/451: write d5/de/f80 [27618,80208] 0 2024-08-01T06:55:58.956 INFO:tasks.workunit.client.1.smithi089.stdout:4/529: mknod d3/db/de/c9f 0 2024-08-01T06:55:58.957 INFO:tasks.workunit.client.0.smithi016.stdout:5/25: mkdir d1/d2/d6/d9 0 2024-08-01T06:55:58.960 INFO:tasks.workunit.client.0.smithi016.stdout:7/24: mkdir d7/d8/da 0 2024-08-01T06:55:58.960 INFO:tasks.workunit.client.0.smithi016.stdout:8/29: link l0 l3 0 2024-08-01T06:55:58.960 INFO:tasks.workunit.client.1.smithi089.stdout:2/391: fdatasync d7/d1f/f6c 0 2024-08-01T06:55:58.961 INFO:tasks.workunit.client.0.smithi016.stdout:0/29: dwrite f9 [0,4194304] 0 2024-08-01T06:55:58.961 INFO:tasks.workunit.client.0.smithi016.stdout:7/25: truncate f5 37474 0 2024-08-01T06:55:58.963 INFO:tasks.workunit.client.0.smithi016.stdout:0/30: write f6 [1146558,29465] 0 2024-08-01T06:55:58.963 INFO:tasks.workunit.client.1.smithi089.stdout:3/352: rename d7/d32/d23 to d7/d68/d50/d6f 0 2024-08-01T06:55:58.965 INFO:tasks.workunit.client.0.smithi016.stdout:6/24: creat d1/d8/fa x:0 0 0 2024-08-01T06:55:58.967 INFO:tasks.workunit.client.1.smithi089.stdout:0/605: mknod d9/cc6 0 2024-08-01T06:55:58.970 INFO:tasks.workunit.client.0.smithi016.stdout:1/28: creat d2/d3/fa x:0 0 0 2024-08-01T06:55:58.972 INFO:tasks.workunit.client.1.smithi089.stdout:3/353: dwrite d7/d32/d12/f33 [0,4194304] 0 2024-08-01T06:55:58.973 INFO:tasks.workunit.client.1.smithi089.stdout:5/452: symlink d5/de/d10/d16/d1b/l99 0 2024-08-01T06:55:58.975 INFO:tasks.workunit.client.0.smithi016.stdout:3/27: creat d9/fc x:0 0 0 2024-08-01T06:55:58.976 INFO:tasks.workunit.client.1.smithi089.stdout:2/392: fdatasync d7/d19/f44 0 2024-08-01T06:55:58.980 INFO:tasks.workunit.client.1.smithi089.stdout:8/461: truncate d5/dc/d1e/d53/f93 941699 0 2024-08-01T06:55:58.982 INFO:tasks.workunit.client.0.smithi016.stdout:7/26: mkdir d7/db 0 2024-08-01T06:55:58.983 INFO:tasks.workunit.client.1.smithi089.stdout:5/453: mknod d5/de/d10/d16/d1b/d52/d5d/d6c/c9a 0 2024-08-01T06:55:58.984 INFO:tasks.workunit.client.0.smithi016.stdout:0/31: creat fc x:0 0 0 2024-08-01T06:55:58.984 INFO:tasks.workunit.client.0.smithi016.stdout:0/32: stat f6 0 2024-08-01T06:55:58.985 INFO:tasks.workunit.client.1.smithi089.stdout:2/393: fsync d7/f10 0 2024-08-01T06:55:58.986 INFO:tasks.workunit.client.1.smithi089.stdout:0/606: rename d9/l19 to d9/d40/d95/d99/d2b/d55/d7a/lc7 0 2024-08-01T06:55:58.987 INFO:tasks.workunit.client.0.smithi016.stdout:1/29: symlink d2/d3/lb 0 2024-08-01T06:55:58.988 INFO:tasks.workunit.client.0.smithi016.stdout:3/28: creat d9/fd x:0 0 0 2024-08-01T06:55:58.988 INFO:tasks.workunit.client.0.smithi016.stdout:5/26: symlink d1/d2/d6/d9/la 0 2024-08-01T06:55:58.989 INFO:tasks.workunit.client.1.smithi089.stdout:3/354: dwrite d7/d32/d12/d1b/f26 [0,4194304] 0 2024-08-01T06:55:58.989 INFO:tasks.workunit.client.0.smithi016.stdout:3/29: write f3 [4905530,23256] 0 2024-08-01T06:55:58.989 INFO:tasks.workunit.client.1.smithi089.stdout:8/462: read - d5/dc/d1e/f34 zero size 2024-08-01T06:55:58.990 INFO:tasks.workunit.client.0.smithi016.stdout:8/30: rename l3 to l4 0 2024-08-01T06:55:58.990 INFO:tasks.workunit.client.0.smithi016.stdout:8/31: read - no filename 2024-08-01T06:55:58.992 INFO:tasks.workunit.client.1.smithi089.stdout:5/454: unlink d5/d13/f7d 0 2024-08-01T06:55:58.996 INFO:tasks.workunit.client.0.smithi016.stdout:6/25: rmdir d1/d8 39 2024-08-01T06:55:58.996 INFO:tasks.workunit.client.0.smithi016.stdout:0/33: creat fd x:0 0 0 2024-08-01T06:55:58.996 INFO:tasks.workunit.client.1.smithi089.stdout:8/463: dwrite d5/d15/d5a/f8a [0,4194304] 0 2024-08-01T06:55:58.998 INFO:tasks.workunit.client.1.smithi089.stdout:2/394: mknod d7/d1f/d52/c7a 0 2024-08-01T06:55:58.999 INFO:tasks.workunit.client.0.smithi016.stdout:1/30: creat d2/fc x:0 0 0 2024-08-01T06:55:59.001 INFO:tasks.workunit.client.1.smithi089.stdout:0/607: creat d9/d40/d25/d46/d91/d2e/d44/d72/fc8 x:0 0 0 2024-08-01T06:55:59.005 INFO:tasks.workunit.client.0.smithi016.stdout:3/30: unlink d9/fc 0 2024-08-01T06:55:59.006 INFO:tasks.workunit.client.0.smithi016.stdout:1/31: dwrite f0 [4194304,4194304] 0 2024-08-01T06:55:59.009 INFO:tasks.workunit.client.1.smithi089.stdout:0/608: dwrite d9/d40/d25/d46/d91/d2e/d44/d53/daf/fb6 [0,4194304] 0 2024-08-01T06:55:59.010 INFO:tasks.workunit.client.0.smithi016.stdout:8/32: mkdir d5 0 2024-08-01T06:55:59.011 INFO:tasks.workunit.client.0.smithi016.stdout:8/33: chown c2 16880 1 2024-08-01T06:55:59.011 INFO:tasks.workunit.client.0.smithi016.stdout:8/34: dread - no filename 2024-08-01T06:55:59.011 INFO:tasks.workunit.client.1.smithi089.stdout:0/609: dread - d9/d40/d95/d99/d2b/d55/d7a/fb5 zero size 2024-08-01T06:55:59.012 INFO:tasks.workunit.client.1.smithi089.stdout:5/455: creat d5/de/d10/d16/d1b/d25/d4d/f9b x:0 0 0 2024-08-01T06:55:59.013 INFO:tasks.workunit.client.0.smithi016.stdout:7/27: mkdir d7/d8/da/dc 0 2024-08-01T06:55:59.013 INFO:tasks.workunit.client.1.smithi089.stdout:5/456: chown d5/de/d10/d16/f44 90198 1 2024-08-01T06:55:59.014 INFO:tasks.workunit.client.1.smithi089.stdout:5/457: dread - d5/d13/d83/f96 zero size 2024-08-01T06:55:59.015 INFO:tasks.workunit.client.0.smithi016.stdout:7/28: write f5 [865129,38635] 0 2024-08-01T06:55:59.015 INFO:tasks.workunit.client.0.smithi016.stdout:1/32: dwrite d2/d3/f9 [0,4194304] 0 2024-08-01T06:55:59.016 INFO:tasks.workunit.client.0.smithi016.stdout:1/33: chown d2/d3/fa 10023755 1 2024-08-01T06:55:59.017 INFO:tasks.workunit.client.0.smithi016.stdout:0/34: mknod ce 0 2024-08-01T06:55:59.019 INFO:tasks.workunit.client.0.smithi016.stdout:6/26: truncate d1/d8/fa 857799 0 2024-08-01T06:55:59.021 INFO:tasks.workunit.client.0.smithi016.stdout:6/27: chown d1/d8 1 1 2024-08-01T06:55:59.021 INFO:tasks.workunit.client.1.smithi089.stdout:0/610: write d9/d40/d25/d46/d91/d2e/d44/d53/d9f/fb1 [214351,63839] 0 2024-08-01T06:55:59.024 INFO:tasks.workunit.client.1.smithi089.stdout:4/530: truncate d3/f24 3772849 0 2024-08-01T06:55:59.027 INFO:tasks.workunit.client.1.smithi089.stdout:5/458: symlink d5/d13/d38/d42/l9c 0 2024-08-01T06:55:59.029 INFO:tasks.workunit.client.1.smithi089.stdout:2/395: dread d7/d19/f40 [0,4194304] 0 2024-08-01T06:55:59.029 INFO:tasks.workunit.client.0.smithi016.stdout:1/34: dwrite d2/d3/f9 [4194304,4194304] 0 2024-08-01T06:55:59.030 INFO:tasks.workunit.client.0.smithi016.stdout:8/35: chown l4 18 1 2024-08-01T06:55:59.036 INFO:tasks.workunit.client.1.smithi089.stdout:8/464: rename d5/dc/d12/f56 to d5/dc/d1e/f9f 0 2024-08-01T06:55:59.037 INFO:tasks.workunit.client.1.smithi089.stdout:0/611: dwrite d9/d40/d45/d47/fc0 [0,4194304] 0 2024-08-01T06:55:59.037 INFO:tasks.workunit.client.1.smithi089.stdout:8/465: chown d5/dc/d1e/d53/c9d 199066 1 2024-08-01T06:55:59.038 INFO:tasks.workunit.client.0.smithi016.stdout:0/35: creat ff x:0 0 0 2024-08-01T06:55:59.039 INFO:tasks.workunit.client.0.smithi016.stdout:0/36: fdatasync fc 0 2024-08-01T06:55:59.040 INFO:tasks.workunit.client.0.smithi016.stdout:1/35: dwrite d2/d3/fa [0,4194304] 0 2024-08-01T06:55:59.046 INFO:tasks.workunit.client.0.smithi016.stdout:0/37: read f4 [269518,44082] 0 2024-08-01T06:55:59.050 INFO:tasks.workunit.client.1.smithi089.stdout:8/466: dread - d5/dc/d94/f39 zero size 2024-08-01T06:55:59.051 INFO:tasks.workunit.client.1.smithi089.stdout:8/467: write d5/d15/d5e/f74 [708402,59641] 0 2024-08-01T06:55:59.051 INFO:tasks.workunit.client.0.smithi016.stdout:0/38: dread f4 [0,4194304] 0 2024-08-01T06:55:59.054 INFO:tasks.workunit.client.1.smithi089.stdout:0/612: rename d9/ff to d9/d40/d25/d46/d91/d2e/d44/d53/daf/fc9 0 2024-08-01T06:55:59.056 INFO:tasks.workunit.client.0.smithi016.stdout:1/36: creat d2/d3/fd x:0 0 0 2024-08-01T06:55:59.058 INFO:tasks.workunit.client.0.smithi016.stdout:6/28: creat d1/d9/fb x:0 0 0 2024-08-01T06:55:59.062 INFO:tasks.workunit.client.0.smithi016.stdout:0/39: dwrite f4 [0,4194304] 0 2024-08-01T06:55:59.064 INFO:tasks.workunit.client.0.smithi016.stdout:8/36: getdents d5 0 2024-08-01T06:55:59.064 INFO:tasks.workunit.client.0.smithi016.stdout:0/40: write f4 [4084443,70275] 0 2024-08-01T06:55:59.066 INFO:tasks.workunit.client.1.smithi089.stdout:4/531: dread d3/d1e/f40 [0,4194304] 0 2024-08-01T06:55:59.070 INFO:tasks.workunit.client.0.smithi016.stdout:1/37: dwrite d2/fc [0,4194304] 0 2024-08-01T06:55:59.077 INFO:tasks.workunit.client.1.smithi089.stdout:6/540: sync 2024-08-01T06:55:59.078 INFO:tasks.workunit.client.1.smithi089.stdout:7/403: sync 2024-08-01T06:55:59.078 INFO:tasks.workunit.client.1.smithi089.stdout:1/505: sync 2024-08-01T06:55:59.079 INFO:tasks.workunit.client.1.smithi089.stdout:7/404: write d7/df/f2f [4391232,83802] 0 2024-08-01T06:55:59.079 INFO:tasks.workunit.client.1.smithi089.stdout:6/541: chown d2/ca 66586035 1 2024-08-01T06:55:59.080 INFO:tasks.workunit.client.1.smithi089.stdout:0/613: dread d9/d40/d25/d46/d91/d2e/d3a/d76/d96/f9c [0,4194304] 0 2024-08-01T06:55:59.083 INFO:tasks.workunit.client.1.smithi089.stdout:0/614: chown d9/d40/d25/d46/d91/d2e/d3a/d76/f8d 7575970 1 2024-08-01T06:55:59.084 INFO:tasks.workunit.client.1.smithi089.stdout:0/615: write d9/f77 [539155,9894] 0 2024-08-01T06:55:59.089 INFO:tasks.workunit.client.1.smithi089.stdout:0/616: dread d9/d40/d95/d99/d2b/d55/f83 [0,4194304] 0 2024-08-01T06:55:59.107 INFO:tasks.workunit.client.0.smithi016.stdout:6/29: rmdir d1/d8 39 2024-08-01T06:55:59.108 INFO:tasks.workunit.client.1.smithi089.stdout:8/468: read d5/dc/d94/f82 [667560,124259] 0 2024-08-01T06:55:59.108 INFO:tasks.workunit.client.0.smithi016.stdout:3/31: getdents d9 0 2024-08-01T06:55:59.109 INFO:tasks.workunit.client.0.smithi016.stdout:3/32: fsync d9/fd 0 2024-08-01T06:55:59.109 INFO:tasks.workunit.client.1.smithi089.stdout:4/532: mknod d3/d68/d7e/ca0 0 2024-08-01T06:55:59.110 INFO:tasks.workunit.client.1.smithi089.stdout:5/459: write d5/de/d10/f3d [447847,105480] 0 2024-08-01T06:55:59.110 INFO:tasks.workunit.client.1.smithi089.stdout:4/533: dread - d3/d17/f9a zero size 2024-08-01T06:55:59.111 INFO:tasks.workunit.client.0.smithi016.stdout:0/41: mkdir d10 0 2024-08-01T06:55:59.114 INFO:tasks.workunit.client.1.smithi089.stdout:6/542: rename d2/d2e/d98/l90 to d2/d2e/d98/lb9 0 2024-08-01T06:55:59.116 INFO:tasks.workunit.client.0.smithi016.stdout:1/38: rmdir d2 39 2024-08-01T06:55:59.120 INFO:tasks.workunit.client.0.smithi016.stdout:3/33: mknod d9/ce 0 2024-08-01T06:55:59.121 INFO:tasks.workunit.client.1.smithi089.stdout:7/405: dwrite d7/df/d10/f24 [0,4194304] 0 2024-08-01T06:55:59.122 INFO:tasks.workunit.client.1.smithi089.stdout:0/617: mknod d9/d40/d45/d47/cca 0 2024-08-01T06:55:59.126 INFO:tasks.workunit.client.1.smithi089.stdout:8/469: fdatasync d5/d15/d5a/d73/d87/f9a 0 2024-08-01T06:55:59.131 INFO:tasks.workunit.client.0.smithi016.stdout:8/37: symlink d5/l6 0 2024-08-01T06:55:59.131 INFO:tasks.workunit.client.0.smithi016.stdout:6/30: symlink d1/lc 0 2024-08-01T06:55:59.132 INFO:tasks.workunit.client.0.smithi016.stdout:1/39: dread - d2/d3/fd zero size 2024-08-01T06:55:59.134 INFO:tasks.workunit.client.1.smithi089.stdout:1/506: mknod d0/d9/d43/d4b/d92/ca8 0 2024-08-01T06:55:59.134 INFO:tasks.workunit.client.1.smithi089.stdout:5/460: dwrite d5/d13/f84 [4194304,4194304] 0 2024-08-01T06:55:59.136 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:58 smithi089 ceph-mon[36617]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:55:59.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:55:58 smithi089 ceph-mon[36617]: pgmap v13: 65 pgs: 65 active+clean; 759 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 9.2 MiB/s rd, 95 MiB/s wr, 295 op/s 2024-08-01T06:55:59.138 INFO:tasks.workunit.client.1.smithi089.stdout:6/543: stat d2/d2e/d2f/d31/f44 0 2024-08-01T06:55:59.143 INFO:tasks.workunit.client.1.smithi089.stdout:1/507: dwrite d0/d9/d15/d3b/f3c [0,4194304] 0 2024-08-01T06:55:59.145 INFO:tasks.workunit.client.1.smithi089.stdout:1/508: chown d0/d9/d43/d89 2560 1 2024-08-01T06:55:59.146 INFO:tasks.workunit.client.1.smithi089.stdout:9/430: sync 2024-08-01T06:55:59.146 INFO:tasks.workunit.client.1.smithi089.stdout:3/355: sync 2024-08-01T06:55:59.146 INFO:tasks.workunit.client.1.smithi089.stdout:8/470: creat d5/dc/d1e/d53/fa0 x:0 0 0 2024-08-01T06:55:59.147 INFO:tasks.workunit.client.1.smithi089.stdout:4/534: mknod d3/db/d33/ca1 0 2024-08-01T06:55:59.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:58 smithi016 ceph-mon[29266]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:55:59.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:55:58 smithi016 ceph-mon[29266]: pgmap v13: 65 pgs: 65 active+clean; 759 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 9.2 MiB/s rd, 95 MiB/s wr, 295 op/s 2024-08-01T06:55:59.150 INFO:tasks.workunit.client.1.smithi089.stdout:4/535: write d3/d1f/d62/d31/f67 [942854,57180] 0 2024-08-01T06:55:59.151 INFO:tasks.workunit.client.1.smithi089.stdout:7/406: dread d7/df/d10/d42/f48 [0,4194304] 0 2024-08-01T06:55:59.156 INFO:tasks.workunit.client.1.smithi089.stdout:0/618: fsync d9/d40/d95/d99/f3e 0 2024-08-01T06:55:59.161 INFO:tasks.workunit.client.1.smithi089.stdout:3/356: symlink d7/d32/d4c/d53/d65/l70 0 2024-08-01T06:55:59.162 INFO:tasks.workunit.client.1.smithi089.stdout:3/357: chown d7/d68/d50 899091053 1 2024-08-01T06:55:59.163 INFO:tasks.workunit.client.1.smithi089.stdout:3/358: fsync d7/d32/d12/f41 0 2024-08-01T06:55:59.164 INFO:tasks.workunit.client.1.smithi089.stdout:3/359: chown d7/d32/d4c/d53/d65/d63 50913 1 2024-08-01T06:55:59.169 INFO:tasks.workunit.client.1.smithi089.stdout:4/536: dread d3/d1e/f6e [0,4194304] 0 2024-08-01T06:55:59.170 INFO:tasks.workunit.client.1.smithi089.stdout:4/537: chown d3/d1f/d62/d31/f67 0 1 2024-08-01T06:55:59.171 INFO:tasks.workunit.client.1.smithi089.stdout:4/538: write d3/db/d16/f4f [4218775,91066] 0 2024-08-01T06:55:59.172 INFO:tasks.workunit.client.1.smithi089.stdout:6/544: mknod d2/d11/d1f/d46/cba 0 2024-08-01T06:55:59.179 INFO:tasks.workunit.client.1.smithi089.stdout:6/545: dwrite d2/ff [4194304,4194304] 0 2024-08-01T06:55:59.179 INFO:tasks.workunit.client.1.smithi089.stdout:3/360: creat d7/f71 x:0 0 0 2024-08-01T06:55:59.180 INFO:tasks.workunit.client.1.smithi089.stdout:3/361: stat d7/d32/d12/f41 0 2024-08-01T06:55:59.181 INFO:tasks.workunit.client.1.smithi089.stdout:3/362: chown d7/d32/d4c/d53/d65/l70 593436 1 2024-08-01T06:55:59.183 INFO:tasks.workunit.client.1.smithi089.stdout:3/363: dread d7/d32/d12/d1b/f51 [0,4194304] 0 2024-08-01T06:55:59.189 INFO:tasks.workunit.client.1.smithi089.stdout:1/509: link d0/d9/d15/d2d/d4a/f5e d0/d9/d15/d2d/d4a/fa9 0 2024-08-01T06:55:59.194 INFO:tasks.workunit.client.1.smithi089.stdout:1/510: dread d0/f73 [0,4194304] 0 2024-08-01T06:55:59.196 INFO:tasks.workunit.client.1.smithi089.stdout:0/619: link d9/c4e d9/d40/d45/db7/ccb 0 2024-08-01T06:55:59.199 INFO:tasks.workunit.client.1.smithi089.stdout:9/431: getdents d18/d22 0 2024-08-01T06:55:59.200 INFO:tasks.workunit.client.1.smithi089.stdout:2/396: sync 2024-08-01T06:55:59.202 INFO:tasks.workunit.client.1.smithi089.stdout:3/364: mkdir d7/d32/d4c/d67/d72 0 2024-08-01T06:55:59.203 INFO:tasks.workunit.client.1.smithi089.stdout:1/511: dread d0/d9/d15/d2d/d4a/f47 [0,4194304] 0 2024-08-01T06:55:59.203 INFO:tasks.workunit.client.1.smithi089.stdout:3/365: chown d7/d32/d4c/d69/d55 504819970 1 2024-08-01T06:55:59.204 INFO:tasks.workunit.client.1.smithi089.stdout:0/620: rmdir d9/d40/d25/d46/d91/d64/d8c 39 2024-08-01T06:55:59.204 INFO:tasks.workunit.client.1.smithi089.stdout:3/366: write d7/f71 [908561,3939] 0 2024-08-01T06:55:59.205 INFO:tasks.workunit.client.1.smithi089.stdout:3/367: chown d7/l8 208253 1 2024-08-01T06:55:59.207 INFO:tasks.workunit.client.1.smithi089.stdout:9/432: symlink d18/d33/d49/d7b/d4b/l88 0 2024-08-01T06:55:59.208 INFO:tasks.workunit.client.1.smithi089.stdout:9/433: write d18/d33/d49/f6c [552383,20096] 0 2024-08-01T06:55:59.267 INFO:tasks.workunit.client.1.smithi089.stdout:0/621: rename d9/d40/d25/d46/f6f to d9/d40/d45/dc1/fcc 0 2024-08-01T06:55:59.268 INFO:tasks.workunit.client.1.smithi089.stdout:6/546: getdents d2 0 2024-08-01T06:55:59.268 INFO:tasks.workunit.client.1.smithi089.stdout:3/368: mknod d7/d32/d4c/d53/c73 0 2024-08-01T06:55:59.269 INFO:tasks.workunit.client.1.smithi089.stdout:7/407: creat d7/df/f82 x:0 0 0 2024-08-01T06:55:59.269 INFO:tasks.workunit.client.1.smithi089.stdout:6/547: stat d2/d30/fa1 0 2024-08-01T06:55:59.269 INFO:tasks.workunit.client.1.smithi089.stdout:4/539: unlink d3/d17/f20 0 2024-08-01T06:55:59.269 INFO:tasks.workunit.client.1.smithi089.stdout:8/471: write d5/dc/d94/f85 [58449,121362] 0 2024-08-01T06:55:59.270 INFO:tasks.workunit.client.1.smithi089.stdout:7/408: chown f6 1703136699 1 2024-08-01T06:55:59.272 INFO:tasks.workunit.client.1.smithi089.stdout:9/434: symlink d18/d33/d6e/l89 0 2024-08-01T06:55:59.274 INFO:tasks.workunit.client.1.smithi089.stdout:7/409: dread - d7/d15/f3c zero size 2024-08-01T06:55:59.274 INFO:tasks.workunit.client.1.smithi089.stdout:6/548: symlink d2/d11/d1a/lbb 0 2024-08-01T06:55:59.277 INFO:tasks.workunit.client.1.smithi089.stdout:0/622: unlink d9/d40/d25/d46/d91/d64/d8c/fab 0 2024-08-01T06:55:59.280 INFO:tasks.workunit.client.1.smithi089.stdout:6/549: write d2/d30/fa3 [303245,96725] 0 2024-08-01T06:55:59.280 INFO:tasks.workunit.client.1.smithi089.stdout:9/435: write d18/d33/d53/f5e [4896942,87062] 0 2024-08-01T06:55:59.280 INFO:tasks.workunit.client.1.smithi089.stdout:7/410: read d7/df/d10/f24 [4677025,13109] 0 2024-08-01T06:55:59.281 INFO:tasks.workunit.client.1.smithi089.stdout:5/461: dwrite d5/de/d10/d16/d1b/d25/f89 [0,4194304] 0 2024-08-01T06:55:59.285 INFO:tasks.workunit.client.1.smithi089.stdout:1/512: dwrite d0/d9/f87 [0,4194304] 0 2024-08-01T06:55:59.290 INFO:tasks.workunit.client.1.smithi089.stdout:9/436: write d18/d33/d49/f6c [87348,9494] 0 2024-08-01T06:55:59.291 INFO:tasks.workunit.client.1.smithi089.stdout:4/540: dwrite d3/d1e/f95 [0,4194304] 0 2024-08-01T06:55:59.295 INFO:tasks.workunit.client.1.smithi089.stdout:1/513: fdatasync d0/d9/d15/f52 0 2024-08-01T06:55:59.295 INFO:tasks.workunit.client.1.smithi089.stdout:4/541: readlink d3/db/de/l14 0 2024-08-01T06:55:59.297 INFO:tasks.workunit.client.1.smithi089.stdout:5/462: truncate d5/f3c 1745715 0 2024-08-01T06:55:59.298 INFO:tasks.workunit.client.1.smithi089.stdout:7/411: unlink d7/df/d3b/d64/f67 0 2024-08-01T06:55:59.302 INFO:tasks.workunit.client.1.smithi089.stdout:7/412: stat d7/d15/f25 0 2024-08-01T06:55:59.302 INFO:tasks.workunit.client.1.smithi089.stdout:1/514: symlink d0/d9/d15/d7a/laa 0 2024-08-01T06:55:59.303 INFO:tasks.workunit.client.1.smithi089.stdout:4/542: write d3/d1e/f40 [4957958,62307] 0 2024-08-01T06:55:59.305 INFO:tasks.workunit.client.1.smithi089.stdout:8/472: dread d5/f25 [0,4194304] 0 2024-08-01T06:55:59.307 INFO:tasks.workunit.client.1.smithi089.stdout:6/550: dwrite d2/d11/f15 [4194304,4194304] 0 2024-08-01T06:55:59.309 INFO:tasks.workunit.client.1.smithi089.stdout:1/515: chown d0/d9/d15/d2d/d4a/d61/f67 116 1 2024-08-01T06:55:59.310 INFO:tasks.workunit.client.1.smithi089.stdout:9/437: dwrite f13 [0,4194304] 0 2024-08-01T06:55:59.311 INFO:tasks.workunit.client.0.smithi016.stdout:0/42: mkdir d10/d11 0 2024-08-01T06:55:59.313 INFO:tasks.workunit.client.0.smithi016.stdout:6/31: rmdir d1 39 2024-08-01T06:55:59.314 INFO:tasks.workunit.client.0.smithi016.stdout:1/40: mkdir d2/de 0 2024-08-01T06:55:59.315 INFO:tasks.workunit.client.0.smithi016.stdout:1/41: read - d2/d3/fd zero size 2024-08-01T06:55:59.316 INFO:tasks.workunit.client.1.smithi089.stdout:7/413: chown d7/l9 10 1 2024-08-01T06:55:59.316 INFO:tasks.workunit.client.1.smithi089.stdout:7/414: readlink d7/l9 0 2024-08-01T06:55:59.316 INFO:tasks.workunit.client.1.smithi089.stdout:5/463: dwrite d5/de/d10/d33/f56 [0,4194304] 0 2024-08-01T06:55:59.317 INFO:tasks.workunit.client.0.smithi016.stdout:0/43: unlink f4 0 2024-08-01T06:55:59.318 INFO:tasks.workunit.client.0.smithi016.stdout:0/44: chown c1 0 1 2024-08-01T06:55:59.318 INFO:tasks.workunit.client.0.smithi016.stdout:0/45: chown ca 485 1 2024-08-01T06:55:59.319 INFO:tasks.workunit.client.1.smithi089.stdout:1/516: read d0/f20 [3420228,102358] 0 2024-08-01T06:55:59.319 INFO:tasks.workunit.client.1.smithi089.stdout:6/551: creat d2/d2e/d2f/d31/fbc x:0 0 0 2024-08-01T06:55:59.322 INFO:tasks.workunit.client.1.smithi089.stdout:4/543: rename d3/db/d33/l93 to d3/d86/d9e/d26/la2 0 2024-08-01T06:55:59.324 INFO:tasks.workunit.client.1.smithi089.stdout:6/552: dread d2/fe [0,4194304] 0 2024-08-01T06:55:59.327 INFO:tasks.workunit.client.1.smithi089.stdout:7/415: creat d7/df/d10/f83 x:0 0 0 2024-08-01T06:55:59.328 INFO:tasks.workunit.client.1.smithi089.stdout:7/416: truncate d7/d46/f68 280266 0 2024-08-01T06:55:59.329 INFO:tasks.workunit.client.0.smithi016.stdout:0/46: unlink fc 0 2024-08-01T06:55:59.330 INFO:tasks.workunit.client.1.smithi089.stdout:7/417: read d7/d1f/d30/f71 [1514185,33824] 0 2024-08-01T06:55:59.330 INFO:tasks.workunit.client.0.smithi016.stdout:0/47: dread - ff zero size 2024-08-01T06:55:59.330 INFO:tasks.workunit.client.0.smithi016.stdout:0/48: chown d10/d11 30094913 1 2024-08-01T06:55:59.332 INFO:tasks.workunit.client.0.smithi016.stdout:1/42: mknod d2/de/cf 0 2024-08-01T06:55:59.333 INFO:tasks.workunit.client.1.smithi089.stdout:8/473: creat d5/dc/fa1 x:0 0 0 2024-08-01T06:55:59.334 INFO:tasks.workunit.client.1.smithi089.stdout:8/474: chown d5/d15/d5e/f74 1061 1 2024-08-01T06:55:59.336 INFO:tasks.workunit.client.1.smithi089.stdout:1/517: creat d0/d9/d15/d2d/d4a/d61/fab x:0 0 0 2024-08-01T06:55:59.336 INFO:tasks.workunit.client.1.smithi089.stdout:1/518: stat d0/d9/d15/d3b/d3d 0 2024-08-01T06:55:59.337 INFO:tasks.workunit.client.0.smithi016.stdout:6/32: dwrite d1/d8/fa [0,4194304] 0 2024-08-01T06:55:59.339 INFO:tasks.workunit.client.0.smithi016.stdout:1/43: creat d2/de/f10 x:0 0 0 2024-08-01T06:55:59.339 INFO:tasks.workunit.client.0.smithi016.stdout:1/44: stat d2/de/f10 0 2024-08-01T06:55:59.340 INFO:tasks.workunit.client.0.smithi016.stdout:0/49: mknod d10/d11/c12 0 2024-08-01T06:55:59.343 INFO:tasks.workunit.client.1.smithi089.stdout:6/553: mkdir d2/d11/d1f/dbd 0 2024-08-01T06:55:59.344 INFO:tasks.workunit.client.1.smithi089.stdout:6/554: write d2/d11/d1a/d1c/f52 [109551,123102] 0 2024-08-01T06:55:59.345 INFO:tasks.workunit.client.0.smithi016.stdout:6/33: symlink d1/d9/ld 0 2024-08-01T06:55:59.345 INFO:tasks.workunit.client.0.smithi016.stdout:6/34: readlink d1/lc 0 2024-08-01T06:55:59.348 INFO:tasks.workunit.client.0.smithi016.stdout:1/45: creat d2/de/f11 x:0 0 0 2024-08-01T06:55:59.349 INFO:tasks.workunit.client.1.smithi089.stdout:5/464: mkdir d5/de/d10/d16/d9d 0 2024-08-01T06:55:59.350 INFO:tasks.workunit.client.1.smithi089.stdout:5/465: truncate d5/d13/f65 1299326 0 2024-08-01T06:55:59.350 INFO:tasks.workunit.client.0.smithi016.stdout:0/50: creat d10/d11/f13 x:0 0 0 2024-08-01T06:55:59.354 INFO:tasks.workunit.client.0.smithi016.stdout:1/46: unlink d2/de/f11 0 2024-08-01T06:55:59.356 INFO:tasks.workunit.client.1.smithi089.stdout:1/519: chown d0/d9/d15/d2d/c35 31170 1 2024-08-01T06:55:59.362 INFO:tasks.workunit.client.0.smithi016.stdout:1/47: creat d2/f12 x:0 0 0 2024-08-01T06:55:59.363 INFO:tasks.workunit.client.0.smithi016.stdout:1/48: truncate d2/de/f10 1026112 0 2024-08-01T06:55:59.364 INFO:tasks.workunit.client.1.smithi089.stdout:8/475: symlink d5/dc/la2 0 2024-08-01T06:55:59.366 INFO:tasks.workunit.client.1.smithi089.stdout:5/466: mkdir d5/de/d10/d33/d5e/d7e/d9e 0 2024-08-01T06:55:59.369 INFO:tasks.workunit.client.1.smithi089.stdout:6/555: mknod d2/d30/d3c/cbe 0 2024-08-01T06:55:59.370 INFO:tasks.workunit.client.0.smithi016.stdout:1/49: dwrite d2/d3/f5 [0,4194304] 0 2024-08-01T06:55:59.371 INFO:tasks.workunit.client.1.smithi089.stdout:7/418: creat d7/d1f/f84 x:0 0 0 2024-08-01T06:55:59.372 INFO:tasks.workunit.client.1.smithi089.stdout:8/476: mknod d5/dc/d1e/d53/ca3 0 2024-08-01T06:55:59.373 INFO:tasks.workunit.client.1.smithi089.stdout:5/467: dwrite d5/de/f34 [4194304,4194304] 0 2024-08-01T06:55:59.376 INFO:tasks.workunit.client.1.smithi089.stdout:7/419: dread - d7/df/d10/d42/d4e/f57 zero size 2024-08-01T06:55:59.377 INFO:tasks.workunit.client.1.smithi089.stdout:7/420: chown d7/d15/c7c 16151 1 2024-08-01T06:55:59.378 INFO:tasks.workunit.client.1.smithi089.stdout:7/421: write d7/df/f2f [1414394,88685] 0 2024-08-01T06:55:59.380 INFO:tasks.workunit.client.1.smithi089.stdout:5/468: mkdir d5/de/df/d9f 0 2024-08-01T06:55:59.382 INFO:tasks.workunit.client.1.smithi089.stdout:6/556: creat d2/d11/d1a/d1c/db6/fbf x:0 0 0 2024-08-01T06:55:59.383 INFO:tasks.workunit.client.1.smithi089.stdout:6/557: chown d2/d30/c6e 0 1 2024-08-01T06:55:59.383 INFO:tasks.workunit.client.1.smithi089.stdout:6/558: chown d2/d11/d1f/f5a 237 1 2024-08-01T06:55:59.384 INFO:tasks.workunit.client.1.smithi089.stdout:6/559: read - d2/d2e/d2f/d31/fbc zero size 2024-08-01T06:55:59.385 INFO:tasks.workunit.client.1.smithi089.stdout:8/477: mknod d5/dc/ca4 0 2024-08-01T06:55:59.390 INFO:tasks.workunit.client.1.smithi089.stdout:7/422: unlink d7/d15/f1b 0 2024-08-01T06:55:59.390 INFO:tasks.workunit.client.1.smithi089.stdout:7/423: stat d7/fa 0 2024-08-01T06:55:59.391 INFO:tasks.workunit.client.1.smithi089.stdout:6/560: creat d2/d2e/d98/d97/fc0 x:0 0 0 2024-08-01T06:55:59.391 INFO:tasks.workunit.client.1.smithi089.stdout:7/424: chown d7/df/d10/c3d 932915 1 2024-08-01T06:55:59.392 INFO:tasks.workunit.client.1.smithi089.stdout:7/425: chown d7/df/d10/l6e 41260 1 2024-08-01T06:55:59.392 INFO:tasks.workunit.client.1.smithi089.stdout:8/478: creat d5/dc/d94/d84/fa5 x:0 0 0 2024-08-01T06:55:59.393 INFO:tasks.workunit.client.1.smithi089.stdout:6/561: creat d2/d11/d1f/d46/d6b/d7d/fc1 x:0 0 0 2024-08-01T06:55:59.394 INFO:tasks.workunit.client.1.smithi089.stdout:6/562: chown d2/d2e/d98/d97 11163 1 2024-08-01T06:55:59.394 INFO:tasks.workunit.client.1.smithi089.stdout:7/426: symlink d7/d1f/d30/l85 0 2024-08-01T06:55:59.396 INFO:tasks.workunit.client.1.smithi089.stdout:9/438: getdents d18/d33/d6e 0 2024-08-01T06:55:59.398 INFO:tasks.workunit.client.1.smithi089.stdout:7/427: getdents d7 0 2024-08-01T06:55:59.402 INFO:tasks.workunit.client.1.smithi089.stdout:9/439: link d18/d22/d39/l70 d18/d33/d49/d7b/l8a 0 2024-08-01T06:55:59.402 INFO:tasks.workunit.client.1.smithi089.stdout:7/428: link d7/d1f/l80 d7/d15/l86 0 2024-08-01T06:55:59.404 INFO:tasks.workunit.client.1.smithi089.stdout:7/429: stat d7/d1f/ce 0 2024-08-01T06:55:59.406 INFO:tasks.workunit.client.1.smithi089.stdout:7/430: rename d7/df/f7f to d7/d15/f87 0 2024-08-01T06:55:59.409 INFO:tasks.workunit.client.1.smithi089.stdout:7/431: creat d7/df/d10/d31/d43/f88 x:0 0 0 2024-08-01T06:55:59.412 INFO:tasks.workunit.client.1.smithi089.stdout:7/432: rename d7/d15/f39 to d7/df/d10/d31/d4a/f89 0 2024-08-01T06:55:59.413 INFO:tasks.workunit.client.1.smithi089.stdout:7/433: chown d7/df/d10/d36/f44 10681 1 2024-08-01T06:55:59.418 INFO:tasks.workunit.client.1.smithi089.stdout:7/434: link d7/d1f/l80 d7/df/d10/d31/d43/l8a 0 2024-08-01T06:55:59.419 INFO:tasks.workunit.client.1.smithi089.stdout:7/435: read d7/df/d3b/f58 [815414,110434] 0 2024-08-01T06:55:59.419 INFO:tasks.workunit.client.1.smithi089.stdout:7/436: chown d7/df/d3b/f58 43438327 1 2024-08-01T06:55:59.421 INFO:tasks.workunit.client.1.smithi089.stdout:7/437: creat d7/df/d10/d31/f8b x:0 0 0 2024-08-01T06:55:59.421 INFO:tasks.workunit.client.1.smithi089.stdout:7/438: chown d7/df/d10/d36/f37 57 1 2024-08-01T06:55:59.427 INFO:tasks.workunit.client.1.smithi089.stdout:0/623: truncate d9/d40/d25/d46/d91/d2e/d3a/f97 2029964 0 2024-08-01T06:55:59.429 INFO:tasks.workunit.client.1.smithi089.stdout:0/624: creat d9/d40/d45/d47/da8/fcd x:0 0 0 2024-08-01T06:55:59.437 INFO:tasks.workunit.client.1.smithi089.stdout:4/544: truncate d3/d1f/d62/d31/f89 103494 0 2024-08-01T06:55:59.437 INFO:tasks.workunit.client.1.smithi089.stdout:4/545: readlink d3/db/de/d5b/l83 0 2024-08-01T06:55:59.438 INFO:tasks.workunit.client.0.smithi016.stdout:6/35: truncate d1/d8/fa 2841921 0 2024-08-01T06:55:59.442 INFO:tasks.workunit.client.0.smithi016.stdout:6/36: getdents d1 0 2024-08-01T06:55:59.443 INFO:tasks.workunit.client.0.smithi016.stdout:6/37: mknod d1/ce 0 2024-08-01T06:55:59.446 INFO:tasks.workunit.client.0.smithi016.stdout:1/50: truncate d2/d3/f5 3203907 0 2024-08-01T06:55:59.448 INFO:tasks.workunit.client.1.smithi089.stdout:4/546: dread d3/d86/d9e/d57/f5e [0,4194304] 0 2024-08-01T06:55:59.452 INFO:tasks.workunit.client.1.smithi089.stdout:5/469: dwrite d5/d13/d38/d42/f67 [0,4194304] 0 2024-08-01T06:55:59.453 INFO:tasks.workunit.client.0.smithi016.stdout:1/51: dwrite d2/d3/fd [0,4194304] 0 2024-08-01T06:55:59.455 INFO:tasks.workunit.client.1.smithi089.stdout:8/479: write d5/dc/d12/f64 [411112,16113] 0 2024-08-01T06:55:59.457 INFO:tasks.workunit.client.1.smithi089.stdout:8/480: stat d5/dc/d94/f85 0 2024-08-01T06:55:59.457 INFO:tasks.workunit.client.0.smithi016.stdout:1/52: dread f0 [4194304,4194304] 0 2024-08-01T06:55:59.458 INFO:tasks.workunit.client.1.smithi089.stdout:9/440: write d18/f23 [66624,28389] 0 2024-08-01T06:55:59.462 INFO:tasks.workunit.client.1.smithi089.stdout:5/470: dwrite d5/d13/f84 [0,4194304] 0 2024-08-01T06:55:59.471 INFO:tasks.workunit.client.1.smithi089.stdout:5/471: dwrite d5/f73 [0,4194304] 0 2024-08-01T06:55:59.471 INFO:tasks.workunit.client.1.smithi089.stdout:5/472: chown f0 102 1 2024-08-01T06:55:59.471 INFO:tasks.workunit.client.1.smithi089.stdout:5/473: fsync d5/de/d10/d16/d1b/f90 0 2024-08-01T06:55:59.471 INFO:tasks.workunit.client.1.smithi089.stdout:7/439: truncate d7/df/d10/d36/f37 3816378 0 2024-08-01T06:55:59.472 INFO:tasks.workunit.client.0.smithi016.stdout:1/53: getdents d2/de 0 2024-08-01T06:55:59.474 INFO:tasks.workunit.client.1.smithi089.stdout:7/440: read d7/df/d10/d31/f45 [337094,54946] 0 2024-08-01T06:55:59.476 INFO:tasks.workunit.client.1.smithi089.stdout:7/441: dread - d7/df/d10/d31/d43/f88 zero size 2024-08-01T06:55:59.478 INFO:tasks.workunit.client.1.smithi089.stdout:5/474: rename d5/de/d10/d16/d1b/l99 to d5/d13/d43/la0 0 2024-08-01T06:55:59.479 INFO:tasks.workunit.client.1.smithi089.stdout:0/625: dwrite d9/d40/d25/d46/d91/d2e/d3a/d76/d96/f9c [0,4194304] 0 2024-08-01T06:55:59.480 INFO:tasks.workunit.client.1.smithi089.stdout:5/475: chown d5/d13/d38/c35 123616 1 2024-08-01T06:55:59.481 INFO:tasks.workunit.client.0.smithi016.stdout:1/54: symlink d2/d3/l13 0 2024-08-01T06:55:59.482 INFO:tasks.workunit.client.1.smithi089.stdout:0/626: chown d9/d40/d25/d46/d91/d2e/d44/d53/daf 6462431 1 2024-08-01T06:55:59.482 INFO:tasks.workunit.client.0.smithi016.stdout:1/55: truncate d2/de/f10 1373884 0 2024-08-01T06:55:59.483 INFO:tasks.workunit.client.0.smithi016.stdout:1/56: dread - d2/f12 zero size 2024-08-01T06:55:59.486 INFO:tasks.workunit.client.1.smithi089.stdout:4/547: truncate d3/db/f39 6345809 0 2024-08-01T06:55:59.487 INFO:tasks.workunit.client.0.smithi016.stdout:6/38: fdatasync d1/f2 0 2024-08-01T06:55:59.491 INFO:tasks.workunit.client.1.smithi089.stdout:0/627: dwrite d9/d40/d25/d46/d91/d2e/f36 [0,4194304] 0 2024-08-01T06:55:59.492 INFO:tasks.workunit.client.1.smithi089.stdout:7/442: dwrite d7/df/d10/d31/d4a/f89 [0,4194304] 0 2024-08-01T06:55:59.495 INFO:tasks.workunit.client.0.smithi016.stdout:1/57: link d2/f12 d2/de/f14 0 2024-08-01T06:55:59.496 INFO:tasks.workunit.client.1.smithi089.stdout:9/441: write d18/d33/d49/f83 [2669450,79626] 0 2024-08-01T06:55:59.496 INFO:tasks.workunit.client.1.smithi089.stdout:0/628: rmdir d9 39 2024-08-01T06:55:59.502 INFO:tasks.workunit.client.0.smithi016.stdout:1/58: unlink d2/l6 0 2024-08-01T06:55:59.503 INFO:tasks.workunit.client.1.smithi089.stdout:8/481: dwrite d5/dc/d1e/d53/f60 [0,4194304] 0 2024-08-01T06:55:59.503 INFO:tasks.workunit.client.1.smithi089.stdout:4/548: truncate d3/db/d33/f56 617374 0 2024-08-01T06:55:59.506 INFO:tasks.workunit.client.0.smithi016.stdout:6/39: rename d1/l7 to d1/d8/lf 0 2024-08-01T06:55:59.511 INFO:tasks.workunit.client.1.smithi089.stdout:4/549: dwrite d3/db/de/f9d [0,4194304] 0 2024-08-01T06:55:59.517 INFO:tasks.workunit.client.0.smithi016.stdout:1/59: link d2/d3/lb d2/l15 0 2024-08-01T06:55:59.517 INFO:tasks.workunit.client.1.smithi089.stdout:5/476: write d5/de/d10/f1c [580420,6634] 0 2024-08-01T06:55:59.518 INFO:tasks.workunit.client.1.smithi089.stdout:8/482: fdatasync d5/dc/d12/f4e 0 2024-08-01T06:55:59.519 INFO:tasks.workunit.client.1.smithi089.stdout:0/629: dwrite d9/d40/d95/d99/f73 [0,4194304] 0 2024-08-01T06:55:59.521 INFO:tasks.workunit.client.0.smithi016.stdout:1/60: write d2/de/f14 [565388,83973] 0 2024-08-01T06:55:59.524 INFO:tasks.workunit.client.1.smithi089.stdout:9/442: dread d18/d33/f60 [0,4194304] 0 2024-08-01T06:55:59.526 INFO:tasks.workunit.client.0.smithi016.stdout:1/61: dread d2/fc [0,4194304] 0 2024-08-01T06:55:59.527 INFO:tasks.workunit.client.1.smithi089.stdout:2/397: sync 2024-08-01T06:55:59.527 INFO:tasks.workunit.client.1.smithi089.stdout:3/369: sync 2024-08-01T06:55:59.528 INFO:tasks.workunit.client.1.smithi089.stdout:0/630: rmdir d9/d40/d45 39 2024-08-01T06:55:59.530 INFO:tasks.workunit.client.1.smithi089.stdout:4/550: dwrite d3/d1f/d62/d31/f67 [0,4194304] 0 2024-08-01T06:55:59.531 INFO:tasks.workunit.client.1.smithi089.stdout:7/443: getdents d7/d15 0 2024-08-01T06:55:59.534 INFO:tasks.workunit.client.1.smithi089.stdout:5/477: creat d5/de/d10/d16/d1b/d52/d5d/d6c/fa1 x:0 0 0 2024-08-01T06:55:59.537 INFO:tasks.workunit.client.1.smithi089.stdout:8/483: mkdir d5/da6 0 2024-08-01T06:55:59.537 INFO:tasks.workunit.client.1.smithi089.stdout:9/443: write d18/f2a [3074113,128875] 0 2024-08-01T06:55:59.538 INFO:tasks.workunit.client.1.smithi089.stdout:2/398: dread d7/d19/f40 [0,4194304] 0 2024-08-01T06:55:59.541 INFO:tasks.workunit.client.0.smithi016.stdout:1/62: write d2/f12 [18343,71488] 0 2024-08-01T06:55:59.544 INFO:tasks.workunit.client.1.smithi089.stdout:7/444: symlink d7/df/d10/d31/d4a/l8c 0 2024-08-01T06:55:59.544 INFO:tasks.workunit.client.1.smithi089.stdout:5/478: unlink d5/de/d10/d33/f56 0 2024-08-01T06:55:59.550 INFO:tasks.workunit.client.1.smithi089.stdout:9/444: dread d18/f23 [0,4194304] 0 2024-08-01T06:55:59.551 INFO:tasks.workunit.client.1.smithi089.stdout:4/551: dread d3/db/d16/f4f [0,4194304] 0 2024-08-01T06:55:59.553 INFO:tasks.workunit.client.0.smithi016.stdout:6/40: write d1/d8/fa [3184533,84410] 0 2024-08-01T06:55:59.556 INFO:tasks.workunit.client.1.smithi089.stdout:8/484: symlink d5/d15/d5a/d73/d87/la7 0 2024-08-01T06:55:59.557 INFO:tasks.workunit.client.1.smithi089.stdout:9/445: dwrite d18/f23 [0,4194304] 0 2024-08-01T06:55:59.557 INFO:tasks.workunit.client.1.smithi089.stdout:7/445: symlink d7/d1f/d3a/l8d 0 2024-08-01T06:55:59.558 INFO:tasks.workunit.client.1.smithi089.stdout:9/446: truncate d18/f20 939206 0 2024-08-01T06:55:59.561 INFO:tasks.workunit.client.0.smithi016.stdout:6/41: dwrite d1/f4 [0,4194304] 0 2024-08-01T06:55:59.566 INFO:tasks.workunit.client.1.smithi089.stdout:9/447: creat d18/d33/d53/f8b x:0 0 0 2024-08-01T06:55:59.566 INFO:tasks.workunit.client.0.smithi016.stdout:6/42: mknod d1/d9/c10 0 2024-08-01T06:55:59.568 INFO:tasks.workunit.client.1.smithi089.stdout:0/631: dread d9/d40/d25/d46/d91/f3f [0,4194304] 0 2024-08-01T06:55:59.568 INFO:tasks.workunit.client.1.smithi089.stdout:7/446: dwrite d7/df/d10/d42/d4e/f77 [0,4194304] 0 2024-08-01T06:55:59.571 INFO:tasks.workunit.client.1.smithi089.stdout:3/370: truncate d7/d32/d4c/d69/f56 1422406 0 2024-08-01T06:55:59.572 INFO:tasks.workunit.client.1.smithi089.stdout:0/632: write d9/f33 [4628934,31949] 0 2024-08-01T06:55:59.572 INFO:tasks.workunit.client.1.smithi089.stdout:7/447: write d7/df/d10/f35 [3607664,17468] 0 2024-08-01T06:55:59.572 INFO:tasks.workunit.client.1.smithi089.stdout:2/399: link d7/d1f/d29/c27 d7/d1f/d52/c7b 0 2024-08-01T06:55:59.574 INFO:tasks.workunit.client.1.smithi089.stdout:3/371: write d7/f71 [1350002,17697] 0 2024-08-01T06:55:59.574 INFO:tasks.workunit.client.1.smithi089.stdout:2/400: readlink d7/d1f/d28/l5f 0 2024-08-01T06:55:59.574 INFO:tasks.workunit.client.1.smithi089.stdout:0/633: fdatasync d9/d40/d25/d46/d91/f69 0 2024-08-01T06:55:59.575 INFO:tasks.workunit.client.1.smithi089.stdout:5/479: creat d5/de/d10/d16/fa2 x:0 0 0 2024-08-01T06:55:59.576 INFO:tasks.workunit.client.1.smithi089.stdout:2/401: write d7/f10 [1427147,79421] 0 2024-08-01T06:55:59.583 INFO:tasks.workunit.client.1.smithi089.stdout:3/372: dwrite d7/d32/f64 [0,4194304] 0 2024-08-01T06:55:59.584 INFO:tasks.workunit.client.1.smithi089.stdout:4/552: truncate d3/db/de/d5b/f74 3676724 0 2024-08-01T06:55:59.587 INFO:tasks.workunit.client.1.smithi089.stdout:3/373: fdatasync d7/d68/d50/d6f/d2f/f48 0 2024-08-01T06:55:59.588 INFO:tasks.workunit.client.1.smithi089.stdout:7/448: creat d7/df/d10/d42/f8e x:0 0 0 2024-08-01T06:55:59.589 INFO:tasks.workunit.client.0.smithi016.stdout:6/43: truncate d1/f5 837912 0 2024-08-01T06:55:59.590 INFO:tasks.workunit.client.1.smithi089.stdout:5/480: dwrite d5/de/d10/d16/d1b/d25/f70 [0,4194304] 0 2024-08-01T06:55:59.591 INFO:tasks.workunit.client.1.smithi089.stdout:0/634: stat d9/d40/d45/d47/cca 0 2024-08-01T06:55:59.592 INFO:tasks.workunit.client.1.smithi089.stdout:7/449: write d7/d1f/f84 [90342,49858] 0 2024-08-01T06:55:59.592 INFO:tasks.workunit.client.0.smithi016.stdout:6/44: rename f0 to d1/d8/f11 0 2024-08-01T06:55:59.594 INFO:tasks.workunit.client.1.smithi089.stdout:2/402: rename d7/d19/d68/d6f to d7/d19/d3b/d7c 0 2024-08-01T06:55:59.594 INFO:tasks.workunit.client.1.smithi089.stdout:9/448: symlink d18/d33/d49/d7b/d81/l8c 0 2024-08-01T06:55:59.595 INFO:tasks.workunit.client.0.smithi016.stdout:6/45: mknod d1/d9/c12 0 2024-08-01T06:55:59.596 INFO:tasks.workunit.client.1.smithi089.stdout:8/485: getdents d5/dc 0 2024-08-01T06:55:59.597 INFO:tasks.workunit.client.1.smithi089.stdout:4/553: symlink d3/d86/d9e/d57/la3 0 2024-08-01T06:55:59.598 INFO:tasks.workunit.client.1.smithi089.stdout:3/374: mknod d7/d32/d4c/d67/c74 0 2024-08-01T06:55:59.599 INFO:tasks.workunit.client.1.smithi089.stdout:6/563: sync 2024-08-01T06:55:59.599 INFO:tasks.workunit.client.1.smithi089.stdout:1/520: sync 2024-08-01T06:55:59.600 INFO:tasks.workunit.client.1.smithi089.stdout:9/449: creat d18/d33/d53/f8d x:0 0 0 2024-08-01T06:55:59.600 INFO:tasks.workunit.client.1.smithi089.stdout:8/486: rmdir d5 39 2024-08-01T06:55:59.600 INFO:tasks.workunit.client.1.smithi089.stdout:2/403: symlink d7/d1f/d29/d48/l7d 0 2024-08-01T06:55:59.601 INFO:tasks.workunit.client.1.smithi089.stdout:5/481: read d5/de/d10/f11 [937694,59060] 0 2024-08-01T06:55:59.603 INFO:tasks.workunit.client.1.smithi089.stdout:3/375: dread - d7/d32/d12/d29/d39/f6c zero size 2024-08-01T06:55:59.604 INFO:tasks.workunit.client.1.smithi089.stdout:4/554: symlink d3/db/de/d5b/la4 0 2024-08-01T06:55:59.605 INFO:tasks.workunit.client.0.smithi016.stdout:6/46: dwrite d1/d8/f11 [0,4194304] 0 2024-08-01T06:55:59.606 INFO:tasks.workunit.client.1.smithi089.stdout:0/635: dwrite d9/d40/f27 [0,4194304] 0 2024-08-01T06:55:59.606 INFO:tasks.workunit.client.1.smithi089.stdout:9/450: mkdir d18/d22/d39/d50/d75/d8e 0 2024-08-01T06:55:59.608 INFO:tasks.workunit.client.1.smithi089.stdout:2/404: symlink d7/d1f/d29/d48/l7e 0 2024-08-01T06:55:59.609 INFO:tasks.workunit.client.1.smithi089.stdout:1/521: fdatasync d0/d9/d15/d2d/d4a/f5e 0 2024-08-01T06:55:59.609 INFO:tasks.workunit.client.1.smithi089.stdout:8/487: symlink d5/d15/d5e/la8 0 2024-08-01T06:55:59.612 INFO:tasks.workunit.client.0.smithi016.stdout:6/47: rename d1/lc to d1/l13 0 2024-08-01T06:55:59.613 INFO:tasks.workunit.client.1.smithi089.stdout:6/564: mkdir d2/d2e/dc2 0 2024-08-01T06:55:59.616 INFO:tasks.workunit.client.1.smithi089.stdout:8/488: chown d5/dc/d1e 52 1 2024-08-01T06:55:59.618 INFO:tasks.workunit.client.1.smithi089.stdout:8/489: fsync d5/d15/d5a/f98 0 2024-08-01T06:55:59.622 INFO:tasks.workunit.client.1.smithi089.stdout:4/555: link d3/db/d16/f4f d3/db/de/fa5 0 2024-08-01T06:55:59.623 INFO:tasks.workunit.client.1.smithi089.stdout:9/451: dread f15 [0,4194304] 0 2024-08-01T06:55:59.624 INFO:tasks.workunit.client.1.smithi089.stdout:1/522: creat d0/d9/d43/d78/fac x:0 0 0 2024-08-01T06:55:59.624 INFO:tasks.workunit.client.1.smithi089.stdout:3/376: dwrite d7/f71 [0,4194304] 0 2024-08-01T06:55:59.627 INFO:tasks.workunit.client.1.smithi089.stdout:2/405: rename l1 to d7/d1f/d29/d48/d4e/l7f 0 2024-08-01T06:55:59.629 INFO:tasks.workunit.client.1.smithi089.stdout:8/490: rmdir d5/d15/d5a 39 2024-08-01T06:55:59.630 INFO:tasks.workunit.client.1.smithi089.stdout:9/452: read d18/d33/d49/d7b/f41 [761315,38462] 0 2024-08-01T06:55:59.630 INFO:tasks.workunit.client.1.smithi089.stdout:0/636: link d9/d40/d95/d99/fa1 d9/d40/d25/d46/d91/d2e/fce 0 2024-08-01T06:55:59.634 INFO:tasks.workunit.client.1.smithi089.stdout:6/565: dwrite d2/d11/d1a/d1c/d40/f83 [0,4194304] 0 2024-08-01T06:55:59.636 INFO:tasks.workunit.client.1.smithi089.stdout:9/453: dread f15 [0,4194304] 0 2024-08-01T06:55:59.638 INFO:tasks.workunit.client.1.smithi089.stdout:6/566: chown d2/d11/d1a/d1c/d40/f83 64 1 2024-08-01T06:55:59.641 INFO:tasks.workunit.client.1.smithi089.stdout:9/454: truncate d18/d33/d53/f8b 633673 0 2024-08-01T06:55:59.641 INFO:tasks.workunit.client.1.smithi089.stdout:5/482: rename d5/d13/d43/la0 to d5/de/d10/d16/d1b/d52/d5d/d6c/d98/la3 0 2024-08-01T06:55:59.643 INFO:tasks.workunit.client.1.smithi089.stdout:0/637: creat d9/d40/d25/d46/d91/d2e/d3a/d76/fcf x:0 0 0 2024-08-01T06:55:59.644 INFO:tasks.workunit.client.1.smithi089.stdout:8/491: creat d5/d15/d5a/d73/d87/fa9 x:0 0 0 2024-08-01T06:55:59.644 INFO:tasks.workunit.client.1.smithi089.stdout:7/450: truncate d7/d15/f25 1137416 0 2024-08-01T06:55:59.646 INFO:tasks.workunit.client.1.smithi089.stdout:1/523: creat d0/d9/fad x:0 0 0 2024-08-01T06:55:59.646 INFO:tasks.workunit.client.1.smithi089.stdout:8/492: fdatasync d5/d15/d5a/d73/f79 0 2024-08-01T06:55:59.649 INFO:tasks.workunit.client.1.smithi089.stdout:9/455: dread d18/d33/d49/d7b/d55/f56 [0,4194304] 0 2024-08-01T06:55:59.650 INFO:tasks.workunit.client.1.smithi089.stdout:3/377: rename d7/d32/d12/l34 to d7/d32/d4c/d67/d72/l75 0 2024-08-01T06:55:59.651 INFO:tasks.workunit.client.1.smithi089.stdout:4/556: dread d3/d1f/d62/d3b/f8d [0,4194304] 0 2024-08-01T06:55:59.651 INFO:tasks.workunit.client.1.smithi089.stdout:9/456: stat f4 0 2024-08-01T06:55:59.651 INFO:tasks.workunit.client.1.smithi089.stdout:7/451: fdatasync d7/fb 0 2024-08-01T06:55:59.652 INFO:tasks.workunit.client.1.smithi089.stdout:3/378: fsync d7/f71 0 2024-08-01T06:55:59.652 INFO:tasks.workunit.client.1.smithi089.stdout:5/483: dwrite d5/de/d10/d33/f6e [0,4194304] 0 2024-08-01T06:55:59.652 INFO:tasks.workunit.client.0.smithi016.stdout:6/48: stat d1/ce 0 2024-08-01T06:55:59.654 INFO:tasks.workunit.client.1.smithi089.stdout:2/406: link d7/d1f/d29/d48/l5a d7/l80 0 2024-08-01T06:55:59.655 INFO:tasks.workunit.client.1.smithi089.stdout:8/493: read d5/d15/f44 [353345,32755] 0 2024-08-01T06:55:59.661 INFO:tasks.workunit.client.1.smithi089.stdout:0/638: mknod d9/d40/d25/d46/d91/d2e/d44/cd0 0 2024-08-01T06:55:59.665 INFO:tasks.workunit.client.1.smithi089.stdout:4/557: unlink d3/d86/d9e/d57/f80 0 2024-08-01T06:55:59.667 INFO:tasks.workunit.client.0.smithi016.stdout:6/49: write d1/f5 [122121,20461] 0 2024-08-01T06:55:59.674 INFO:tasks.workunit.client.1.smithi089.stdout:6/567: rename d2/d11/d1f/d46/d6b/c8b to d2/d11/d1a/d1c/d40/cc3 0 2024-08-01T06:55:59.674 INFO:tasks.workunit.client.1.smithi089.stdout:2/407: read d7/f23 [2248985,118994] 0 2024-08-01T06:55:59.675 INFO:tasks.workunit.client.1.smithi089.stdout:0/639: write d9/d40/d25/d46/d91/f3f [4157141,31461] 0 2024-08-01T06:55:59.677 INFO:tasks.workunit.client.0.smithi016.stdout:6/50: dwrite d1/d8/f11 [4194304,4194304] 0 2024-08-01T06:55:59.678 INFO:tasks.workunit.client.1.smithi089.stdout:5/484: creat d5/de/d10/d16/d9d/fa4 x:0 0 0 2024-08-01T06:55:59.678 INFO:tasks.workunit.client.1.smithi089.stdout:8/494: dread d5/d15/f44 [0,4194304] 0 2024-08-01T06:55:59.679 INFO:tasks.workunit.client.1.smithi089.stdout:1/524: write d0/d9/d15/d2b/f74 [3051,38332] 0 2024-08-01T06:55:59.680 INFO:tasks.workunit.client.0.smithi016.stdout:6/51: fdatasync d1/d9/fb 0 2024-08-01T06:55:59.680 INFO:tasks.workunit.client.1.smithi089.stdout:9/457: write d18/d22/d39/f42 [4369393,124046] 0 2024-08-01T06:55:59.681 INFO:tasks.workunit.client.0.smithi016.stdout:6/52: chown d1/d8/fa 0 1 2024-08-01T06:55:59.681 INFO:tasks.workunit.client.1.smithi089.stdout:2/408: mkdir d7/d19/d1e/d5b/d81 0 2024-08-01T06:55:59.683 INFO:tasks.workunit.client.1.smithi089.stdout:5/485: write d5/de/f34 [8962912,127487] 0 2024-08-01T06:55:59.685 INFO:tasks.workunit.client.1.smithi089.stdout:9/458: stat d18/d22/d45/c4a 0 2024-08-01T06:55:59.685 INFO:tasks.workunit.client.1.smithi089.stdout:0/640: rmdir d9/d40/d25/d46/d91/d2e/d44/d72/d8b 39 2024-08-01T06:55:59.685 INFO:tasks.workunit.client.1.smithi089.stdout:1/525: stat d0/d9/d15/d2b/d7d/l8b 0 2024-08-01T06:55:59.686 INFO:tasks.workunit.client.0.smithi016.stdout:6/53: chown d1/f4 112 1 2024-08-01T06:55:59.688 INFO:tasks.workunit.client.1.smithi089.stdout:6/568: dwrite d2/d11/d1f/d46/f4b [0,4194304] 0 2024-08-01T06:55:59.689 INFO:tasks.workunit.client.1.smithi089.stdout:9/459: write f17 [2325632,63326] 0 2024-08-01T06:55:59.690 INFO:tasks.workunit.client.1.smithi089.stdout:7/452: truncate d7/df/d10/f35 874368 0 2024-08-01T06:55:59.692 INFO:tasks.workunit.client.1.smithi089.stdout:2/409: dread - d7/d73/f74 zero size 2024-08-01T06:55:59.694 INFO:tasks.workunit.client.0.smithi016.stdout:6/54: dwrite d1/f4 [0,4194304] 0 2024-08-01T06:55:59.694 INFO:tasks.workunit.client.1.smithi089.stdout:8/495: dwrite d5/dc/f70 [0,4194304] 0 2024-08-01T06:55:59.699 INFO:tasks.workunit.client.1.smithi089.stdout:8/496: rmdir d5 39 2024-08-01T06:55:59.700 INFO:tasks.workunit.client.1.smithi089.stdout:2/410: mknod d7/d19/c82 0 2024-08-01T06:55:59.700 INFO:tasks.workunit.client.0.smithi016.stdout:6/55: rename d1/d9/c12 to d1/d8/c14 0 2024-08-01T06:55:59.700 INFO:tasks.workunit.client.0.smithi016.stdout:6/56: fdatasync d1/d9/fb 0 2024-08-01T06:55:59.704 INFO:tasks.workunit.client.1.smithi089.stdout:8/497: fdatasync d5/d15/d5a/d73/f79 0 2024-08-01T06:55:59.704 INFO:tasks.workunit.client.1.smithi089.stdout:9/460: dwrite d18/f47 [0,4194304] 0 2024-08-01T06:55:59.705 INFO:tasks.workunit.client.0.smithi016.stdout:6/57: rename d1/ce to d1/d8/c15 0 2024-08-01T06:55:59.705 INFO:tasks.workunit.client.1.smithi089.stdout:1/526: dread d0/d9/d15/d2d/f53 [0,4194304] 0 2024-08-01T06:55:59.706 INFO:tasks.workunit.client.1.smithi089.stdout:8/498: chown d5/f41 0 1 2024-08-01T06:55:59.708 INFO:tasks.workunit.client.1.smithi089.stdout:7/453: write d7/d15/f3c [1028613,52891] 0 2024-08-01T06:55:59.708 INFO:tasks.workunit.client.1.smithi089.stdout:2/411: mknod d7/d19/d1e/d5b/d81/c83 0 2024-08-01T06:55:59.709 INFO:tasks.workunit.client.1.smithi089.stdout:8/499: mkdir d5/d15/d5a/d73/daa 0 2024-08-01T06:55:59.717 INFO:tasks.workunit.client.1.smithi089.stdout:7/454: creat d7/d15/f8f x:0 0 0 2024-08-01T06:55:59.720 INFO:tasks.workunit.client.1.smithi089.stdout:7/455: symlink d7/l90 0 2024-08-01T06:55:59.721 INFO:tasks.workunit.client.1.smithi089.stdout:1/527: link d0/d9/d15/d2d/d4a/f5e d0/d9/d15/fae 0 2024-08-01T06:55:59.722 INFO:tasks.workunit.client.1.smithi089.stdout:9/461: dwrite d18/f1d [0,4194304] 0 2024-08-01T06:55:59.727 INFO:tasks.workunit.client.1.smithi089.stdout:6/569: dread d2/d11/d1f/f2d [0,4194304] 0 2024-08-01T06:55:59.729 INFO:tasks.workunit.client.1.smithi089.stdout:8/500: dwrite d5/f9c [0,4194304] 0 2024-08-01T06:55:59.729 INFO:tasks.workunit.client.1.smithi089.stdout:7/456: read d7/d46/f54 [352455,92596] 0 2024-08-01T06:55:59.730 INFO:tasks.workunit.client.1.smithi089.stdout:1/528: mknod d0/d9/d15/d7a/caf 0 2024-08-01T06:55:59.731 INFO:tasks.workunit.client.1.smithi089.stdout:6/570: readlink d2/d30/l69 0 2024-08-01T06:55:59.731 INFO:tasks.workunit.client.1.smithi089.stdout:5/486: dread d5/de/d10/f11 [0,4194304] 0 2024-08-01T06:55:59.732 INFO:tasks.workunit.client.1.smithi089.stdout:9/462: chown d18/d22/d52/f54 32 1 2024-08-01T06:55:59.733 INFO:tasks.workunit.client.1.smithi089.stdout:2/412: dwrite d7/f58 [0,4194304] 0 2024-08-01T06:55:59.734 INFO:tasks.workunit.client.1.smithi089.stdout:7/457: mkdir d7/df/d91 0 2024-08-01T06:55:59.735 INFO:tasks.workunit.client.1.smithi089.stdout:1/529: mkdir d0/d9/d43/d4b/db0 0 2024-08-01T06:55:59.736 INFO:tasks.workunit.client.1.smithi089.stdout:7/458: chown d7/d1f/d3a/l8d 50558 1 2024-08-01T06:55:59.736 INFO:tasks.workunit.client.1.smithi089.stdout:2/413: write d7/d1f/d52/d6e/f75 [1111577,103380] 0 2024-08-01T06:55:59.737 INFO:tasks.workunit.client.1.smithi089.stdout:7/459: dread - d7/d1f/d30/f6a zero size 2024-08-01T06:55:59.740 INFO:tasks.workunit.client.1.smithi089.stdout:6/571: write d2/d11/d1f/d46/f72 [428458,88926] 0 2024-08-01T06:55:59.741 INFO:tasks.workunit.client.1.smithi089.stdout:1/530: truncate d0/d9/d15/d3b/d95/fa1 508591 0 2024-08-01T06:55:59.742 INFO:tasks.workunit.client.1.smithi089.stdout:6/572: dread - d2/d11/d1a/d1c/faf zero size 2024-08-01T06:55:59.746 INFO:tasks.workunit.client.1.smithi089.stdout:2/414: unlink d7/d1f/d29/d48/f46 0 2024-08-01T06:55:59.747 INFO:tasks.workunit.client.1.smithi089.stdout:5/487: mkdir d5/de/d57/d8e/d97/da5 0 2024-08-01T06:55:59.749 INFO:tasks.workunit.client.1.smithi089.stdout:7/460: mknod d7/df/d10/d36/c92 0 2024-08-01T06:55:59.749 INFO:tasks.workunit.client.0.smithi016.stdout:6/58: dwrite d1/d9/fb [0,4194304] 0 2024-08-01T06:55:59.750 INFO:tasks.workunit.client.1.smithi089.stdout:6/573: mknod d2/d2e/d98/cc4 0 2024-08-01T06:55:59.750 INFO:tasks.workunit.client.1.smithi089.stdout:7/461: readlink d7/d1f/d3a/l8d 0 2024-08-01T06:55:59.751 INFO:tasks.workunit.client.1.smithi089.stdout:1/531: dwrite d0/d9/d15/d76/f80 [0,4194304] 0 2024-08-01T06:55:59.752 INFO:tasks.workunit.client.0.smithi016.stdout:6/59: chown d1/f2 3296375 1 2024-08-01T06:55:59.753 INFO:tasks.workunit.client.1.smithi089.stdout:1/532: write d0/d9/d15/d2d/d4a/f75 [1506335,5679] 0 2024-08-01T06:55:59.755 INFO:tasks.workunit.client.1.smithi089.stdout:7/462: creat d7/f93 x:0 0 0 2024-08-01T06:55:59.759 INFO:tasks.workunit.client.1.smithi089.stdout:5/488: link d5/de/d10/d16/f44 d5/de/df/d9f/fa6 0 2024-08-01T06:55:59.759 INFO:tasks.workunit.client.0.smithi016.stdout:6/60: symlink d1/d8/l16 0 2024-08-01T06:55:59.762 INFO:tasks.workunit.client.0.smithi016.stdout:6/61: readlink d1/d8/lf 0 2024-08-01T06:55:59.762 INFO:tasks.workunit.client.1.smithi089.stdout:7/463: creat d7/d1f/d30/f94 x:0 0 0 2024-08-01T06:55:59.763 INFO:tasks.workunit.client.1.smithi089.stdout:6/574: mkdir d2/d11/d1f/dbd/dc5 0 2024-08-01T06:55:59.765 INFO:tasks.workunit.client.1.smithi089.stdout:9/463: dwrite d18/d33/d49/d7b/d55/f56 [0,4194304] 0 2024-08-01T06:55:59.768 INFO:tasks.workunit.client.1.smithi089.stdout:2/415: truncate d7/d1f/f20 3506344 0 2024-08-01T06:55:59.771 INFO:tasks.workunit.client.0.smithi016.stdout:6/62: dwrite d1/f5 [0,4194304] 0 2024-08-01T06:55:59.773 INFO:tasks.workunit.client.0.smithi016.stdout:6/63: rename d1 to d1/d17 22 2024-08-01T06:55:59.774 INFO:tasks.workunit.client.0.smithi016.stdout:6/64: mknod d1/d8/c18 0 2024-08-01T06:55:59.775 INFO:tasks.workunit.client.1.smithi089.stdout:5/489: dread d5/de/d10/d16/d1b/f22 [0,4194304] 0 2024-08-01T06:55:59.775 INFO:tasks.workunit.client.1.smithi089.stdout:1/533: dwrite d0/d9/d54/fa0 [0,4194304] 0 2024-08-01T06:55:59.776 INFO:tasks.workunit.client.0.smithi016.stdout:6/65: write d1/d8/f11 [3433301,89945] 0 2024-08-01T06:55:59.780 INFO:tasks.workunit.client.0.smithi016.stdout:6/66: dread d1/d9/fb [0,4194304] 0 2024-08-01T06:55:59.781 INFO:tasks.workunit.client.1.smithi089.stdout:2/416: rename d7/d19/d1e/l2d to d7/d19/d1e/d3d/l84 0 2024-08-01T06:55:59.781 INFO:tasks.workunit.client.1.smithi089.stdout:1/534: write d0/d9/d15/d2b/f74 [156733,79103] 0 2024-08-01T06:55:59.784 INFO:tasks.workunit.client.1.smithi089.stdout:7/464: dread d7/fa [0,4194304] 0 2024-08-01T06:55:59.786 INFO:tasks.workunit.client.1.smithi089.stdout:5/490: write d5/de/d10/d16/d1b/d25/f68 [480380,98228] 0 2024-08-01T06:55:59.786 INFO:tasks.workunit.client.1.smithi089.stdout:9/464: dwrite f5 [0,4194304] 0 2024-08-01T06:55:59.787 INFO:tasks.workunit.client.0.smithi016.stdout:6/67: dwrite d1/d8/f11 [0,4194304] 0 2024-08-01T06:55:59.788 INFO:tasks.workunit.client.1.smithi089.stdout:2/417: symlink d7/d1f/d52/d6e/l85 0 2024-08-01T06:55:59.790 INFO:tasks.workunit.client.0.smithi016.stdout:6/68: chown d1/l13 204 1 2024-08-01T06:55:59.797 INFO:tasks.workunit.client.0.smithi016.stdout:6/69: rename d1/d9/ld to d1/d8/l19 0 2024-08-01T06:55:59.798 INFO:tasks.workunit.client.1.smithi089.stdout:7/465: dwrite f4 [0,4194304] 0 2024-08-01T06:55:59.799 INFO:tasks.workunit.client.1.smithi089.stdout:5/491: dwrite d5/de/d10/f19 [0,4194304] 0 2024-08-01T06:55:59.800 INFO:tasks.workunit.client.0.smithi016.stdout:6/70: creat d1/d8/f1a x:0 0 0 2024-08-01T06:55:59.802 INFO:tasks.workunit.client.0.smithi016.stdout:6/71: truncate d1/d8/fa 3548617 0 2024-08-01T06:55:59.802 INFO:tasks.workunit.client.0.smithi016.stdout:6/72: chown d1/d8 46 1 2024-08-01T06:55:59.803 INFO:tasks.workunit.client.1.smithi089.stdout:9/465: rename d18/d22/f57 to d18/f8f 0 2024-08-01T06:55:59.805 INFO:tasks.workunit.client.1.smithi089.stdout:6/575: truncate d2/d11/f17 1917802 0 2024-08-01T06:55:59.806 INFO:tasks.workunit.client.1.smithi089.stdout:2/418: dwrite f2 [4194304,4194304] 0 2024-08-01T06:55:59.807 INFO:tasks.workunit.client.0.smithi016.stdout:6/73: mkdir d1/d8/d1b 0 2024-08-01T06:55:59.809 INFO:tasks.workunit.client.1.smithi089.stdout:5/492: dwrite d5/d13/d38/d42/f55 [0,4194304] 0 2024-08-01T06:55:59.810 INFO:tasks.workunit.client.1.smithi089.stdout:2/419: chown d7/c1b 9645405 1 2024-08-01T06:55:59.812 INFO:tasks.workunit.client.0.smithi016.stdout:6/74: dread d1/f2 [0,4194304] 0 2024-08-01T06:55:59.812 INFO:tasks.workunit.client.1.smithi089.stdout:2/420: truncate d7/d19/d1e/f54 1179235 0 2024-08-01T06:55:59.812 INFO:tasks.workunit.client.1.smithi089.stdout:5/493: truncate d5/de/d10/d16/d1b/d25/d4d/f9b 139690 0 2024-08-01T06:55:59.813 INFO:tasks.workunit.client.0.smithi016.stdout:6/75: rename d1 to d1/d8/d1b/d1c 22 2024-08-01T06:55:59.816 INFO:tasks.workunit.client.1.smithi089.stdout:5/494: unlink d5/de/df/l69 0 2024-08-01T06:55:59.817 INFO:tasks.workunit.client.0.smithi016.stdout:6/76: chown d1/c6 2 1 2024-08-01T06:55:59.818 INFO:tasks.workunit.client.1.smithi089.stdout:2/421: rename d7/c1b to d7/d1f/d52/c86 0 2024-08-01T06:55:59.819 INFO:tasks.workunit.client.1.smithi089.stdout:2/422: truncate d7/d19/d3b/f59 993552 0 2024-08-01T06:55:59.820 INFO:tasks.workunit.client.1.smithi089.stdout:6/576: dread d2/d30/fa1 [0,4194304] 0 2024-08-01T06:55:59.823 INFO:tasks.workunit.client.1.smithi089.stdout:5/495: rmdir d5/d13/d79 0 2024-08-01T06:55:59.825 INFO:tasks.workunit.client.1.smithi089.stdout:6/577: creat d2/d30/d3c/d3d/fc6 x:0 0 0 2024-08-01T06:55:59.826 INFO:tasks.workunit.client.0.smithi016.stdout:6/77: link d1/d8/c15 d1/d8/d1b/c1d 0 2024-08-01T06:55:59.826 INFO:tasks.workunit.client.0.smithi016.stdout:6/78: truncate d1/d8/f1a 226383 0 2024-08-01T06:55:59.827 INFO:tasks.workunit.client.1.smithi089.stdout:5/496: write d5/de/d10/d16/d1b/d25/f68 [960143,27076] 0 2024-08-01T06:55:59.827 INFO:tasks.workunit.client.1.smithi089.stdout:2/423: dwrite d7/d19/f44 [0,4194304] 0 2024-08-01T06:55:59.829 INFO:tasks.workunit.client.0.smithi016.stdout:6/79: symlink d1/l1e 0 2024-08-01T06:55:59.829 INFO:tasks.workunit.client.1.smithi089.stdout:9/466: dread d18/d22/d39/f3a [0,4194304] 0 2024-08-01T06:55:59.831 INFO:tasks.workunit.client.1.smithi089.stdout:2/424: creat d7/d19/d1e/d5b/d81/f87 x:0 0 0 2024-08-01T06:55:59.831 INFO:tasks.workunit.client.0.smithi016.stdout:6/80: symlink d1/d9/l1f 0 2024-08-01T06:55:59.832 INFO:tasks.workunit.client.1.smithi089.stdout:5/497: creat d5/de/d10/d16/d1b/d25/fa7 x:0 0 0 2024-08-01T06:55:59.833 INFO:tasks.workunit.client.1.smithi089.stdout:9/467: rename d18/d22/d43/f64 to d18/d33/d49/d7b/d81/f90 0 2024-08-01T06:55:59.835 INFO:tasks.workunit.client.1.smithi089.stdout:6/578: dwrite d2/d11/f15 [0,4194304] 0 2024-08-01T06:55:59.835 INFO:tasks.workunit.client.1.smithi089.stdout:2/425: symlink d7/d1f/d52/d72/l88 0 2024-08-01T06:55:59.836 INFO:tasks.workunit.client.1.smithi089.stdout:2/426: read - d7/d73/f74 zero size 2024-08-01T06:55:59.837 INFO:tasks.workunit.client.1.smithi089.stdout:9/468: mknod d18/d33/d49/d7b/d4b/c91 0 2024-08-01T06:55:59.837 INFO:tasks.workunit.client.1.smithi089.stdout:2/427: fdatasync d7/f10 0 2024-08-01T06:55:59.837 INFO:tasks.workunit.client.0.smithi016.stdout:6/81: mknod d1/d8/d1b/c20 0 2024-08-01T06:55:59.840 INFO:tasks.workunit.client.1.smithi089.stdout:9/469: dread d18/f1d [0,4194304] 0 2024-08-01T06:55:59.840 INFO:tasks.workunit.client.0.smithi016.stdout:6/82: creat d1/d9/f21 x:0 0 0 2024-08-01T06:55:59.841 INFO:tasks.workunit.client.1.smithi089.stdout:6/579: creat d2/d2e/d2f/d9e/fc7 x:0 0 0 2024-08-01T06:55:59.841 INFO:tasks.workunit.client.1.smithi089.stdout:2/428: mknod d7/d19/d1e/d3d/d60/c89 0 2024-08-01T06:55:59.842 INFO:tasks.workunit.client.0.smithi016.stdout:6/83: mkdir d1/d8/d1b/d22 0 2024-08-01T06:55:59.844 INFO:tasks.workunit.client.1.smithi089.stdout:6/580: fsync d2/d11/d1a/d1c/d40/f48 0 2024-08-01T06:55:59.846 INFO:tasks.workunit.client.1.smithi089.stdout:2/429: creat d7/d19/d1e/f8a x:0 0 0 2024-08-01T06:55:59.846 INFO:tasks.workunit.client.1.smithi089.stdout:9/470: dwrite d18/f20 [0,4194304] 0 2024-08-01T06:55:59.847 INFO:tasks.workunit.client.1.smithi089.stdout:6/581: creat d2/d11/d1a/fc8 x:0 0 0 2024-08-01T06:55:59.848 INFO:tasks.workunit.client.0.smithi016.stdout:6/84: link d1/l13 d1/l23 0 2024-08-01T06:55:59.849 INFO:tasks.workunit.client.1.smithi089.stdout:2/430: mknod d7/d1f/c8b 0 2024-08-01T06:55:59.850 INFO:tasks.workunit.client.0.smithi016.stdout:6/85: mknod d1/d9/c24 0 2024-08-01T06:55:59.850 INFO:tasks.workunit.client.1.smithi089.stdout:6/582: mkdir d2/d11/d1f/d46/d6b/d7d/dc9 0 2024-08-01T06:55:59.851 INFO:tasks.workunit.client.1.smithi089.stdout:2/431: readlink d7/d19/l61 0 2024-08-01T06:55:59.852 INFO:tasks.workunit.client.1.smithi089.stdout:2/432: fdatasync d7/f58 0 2024-08-01T06:55:59.852 INFO:tasks.workunit.client.1.smithi089.stdout:9/471: dwrite d18/d33/d53/f8d [0,4194304] 0 2024-08-01T06:55:59.857 INFO:tasks.workunit.client.0.smithi016.stdout:6/86: dwrite d1/d9/f21 [0,4194304] 0 2024-08-01T06:55:59.857 INFO:tasks.workunit.client.1.smithi089.stdout:2/433: creat d7/d19/d1e/d3d/d60/f8c x:0 0 0 2024-08-01T06:55:59.858 INFO:tasks.workunit.client.1.smithi089.stdout:2/434: fdatasync d7/d1f/d52/f5c 0 2024-08-01T06:55:59.863 INFO:tasks.workunit.client.1.smithi089.stdout:6/583: dwrite d2/d2e/d7c/fb0 [0,4194304] 0 2024-08-01T06:55:59.869 INFO:tasks.workunit.client.1.smithi089.stdout:6/584: truncate d2/d30/fa1 781401 0 2024-08-01T06:55:59.877 INFO:tasks.workunit.client.1.smithi089.stdout:6/585: unlink d2/d2e/d7c/fb0 0 2024-08-01T06:55:59.879 INFO:tasks.workunit.client.1.smithi089.stdout:9/472: link d18/d33/d49/d7b/l8a d18/d22/d39/d50/d75/d8e/l92 0 2024-08-01T06:55:59.879 INFO:tasks.workunit.client.1.smithi089.stdout:2/435: creat d7/d19/d1e/f8d x:0 0 0 2024-08-01T06:55:59.881 INFO:tasks.workunit.client.1.smithi089.stdout:2/436: fdatasync d7/d19/d1e/f54 0 2024-08-01T06:55:59.884 INFO:tasks.workunit.client.1.smithi089.stdout:1/535: write d0/d9/d15/d2d/d4a/f5e [437592,26253] 0 2024-08-01T06:55:59.886 INFO:tasks.workunit.client.1.smithi089.stdout:9/473: creat d18/d22/d43/f93 x:0 0 0 2024-08-01T06:55:59.889 INFO:tasks.workunit.client.1.smithi089.stdout:6/586: dwrite d2/f18 [8388608,4194304] 0 2024-08-01T06:55:59.892 INFO:tasks.workunit.client.1.smithi089.stdout:1/536: creat d0/d9/d15/d2b/d7d/fb1 x:0 0 0 2024-08-01T06:55:59.893 INFO:tasks.workunit.client.1.smithi089.stdout:1/537: readlink d0/l1b 0 2024-08-01T06:55:59.894 INFO:tasks.workunit.client.1.smithi089.stdout:7/466: truncate d7/d1f/d3a/f41 4143630 0 2024-08-01T06:55:59.896 INFO:tasks.workunit.client.1.smithi089.stdout:9/474: creat d18/f94 x:0 0 0 2024-08-01T06:55:59.897 INFO:tasks.workunit.client.1.smithi089.stdout:9/475: stat d18/d33/d53/l7d 0 2024-08-01T06:55:59.897 INFO:tasks.workunit.client.1.smithi089.stdout:7/467: fdatasync d7/f19 0 2024-08-01T06:55:59.898 INFO:tasks.workunit.client.1.smithi089.stdout:7/468: stat d7/d1f/d30/f71 0 2024-08-01T06:55:59.900 INFO:tasks.workunit.client.1.smithi089.stdout:7/469: mknod d7/d1f/d3a/c95 0 2024-08-01T06:55:59.905 INFO:tasks.workunit.client.1.smithi089.stdout:5/498: dread d5/d13/f31 [0,4194304] 0 2024-08-01T06:55:59.907 INFO:tasks.workunit.client.1.smithi089.stdout:5/499: mknod d5/de/d57/ca8 0 2024-08-01T06:55:59.908 INFO:tasks.workunit.client.1.smithi089.stdout:5/500: mknod d5/de/d10/d33/d5e/d7e/ca9 0 2024-08-01T06:55:59.910 INFO:tasks.workunit.client.1.smithi089.stdout:5/501: fsync d5/de/d10/d16/d1b/d25/f89 0 2024-08-01T06:55:59.915 INFO:tasks.workunit.client.1.smithi089.stdout:5/502: link d5/d13/f31 d5/de/d10/d16/d1b/d52/d5d/d6c/d8b/faa 0 2024-08-01T06:55:59.918 INFO:tasks.workunit.client.1.smithi089.stdout:5/503: read d5/d13/d43/f4e [348305,117534] 0 2024-08-01T06:55:59.919 INFO:tasks.workunit.client.1.smithi089.stdout:5/504: mknod d5/de/df/d9f/cab 0 2024-08-01T06:55:59.920 INFO:tasks.workunit.client.1.smithi089.stdout:5/505: fsync d5/de/d10/d16/d1b/f39 0 2024-08-01T06:55:59.927 INFO:tasks.workunit.client.1.smithi089.stdout:5/506: dwrite d5/de/d10/d33/f6e [0,4194304] 0 2024-08-01T06:55:59.929 INFO:tasks.workunit.client.1.smithi089.stdout:5/507: write d5/de/d10/f2c [2474178,29840] 0 2024-08-01T06:55:59.931 INFO:tasks.workunit.client.1.smithi089.stdout:3/379: sync 2024-08-01T06:55:59.932 INFO:tasks.workunit.client.1.smithi089.stdout:3/380: write d7/d32/d4c/d69/f20 [6434127,34347] 0 2024-08-01T06:55:59.932 INFO:tasks.workunit.client.1.smithi089.stdout:5/508: mkdir d5/dac 0 2024-08-01T06:55:59.934 INFO:tasks.workunit.client.1.smithi089.stdout:2/437: dread d7/d1f/f4b [0,4194304] 0 2024-08-01T06:55:59.934 INFO:tasks.workunit.client.0.smithi016.stdout:6/87: truncate d1/f4 3928757 0 2024-08-01T06:55:59.935 INFO:tasks.workunit.client.1.smithi089.stdout:3/381: read d7/d68/d50/d6f/f58 [3782199,3419] 0 2024-08-01T06:55:59.937 INFO:tasks.workunit.client.1.smithi089.stdout:3/382: write d7/d68/d50/d6f/f49 [2683358,122417] 0 2024-08-01T06:55:59.939 INFO:tasks.workunit.client.0.smithi016.stdout:6/88: chown d1/f2 1075 1 2024-08-01T06:55:59.940 INFO:tasks.workunit.client.1.smithi089.stdout:2/438: creat d7/d19/d1e/d5b/f8e x:0 0 0 2024-08-01T06:55:59.942 INFO:tasks.workunit.client.1.smithi089.stdout:2/439: symlink d7/d73/l8f 0 2024-08-01T06:55:59.947 INFO:tasks.workunit.client.1.smithi089.stdout:2/440: rename d7/d1f/d52/d72/l88 to d7/d1f/d29/l90 0 2024-08-01T06:55:59.947 INFO:tasks.workunit.client.1.smithi089.stdout:6/587: write d2/d11/d1f/d46/fac [2576001,53826] 0 2024-08-01T06:55:59.947 INFO:tasks.workunit.client.1.smithi089.stdout:1/538: write d0/d9/d15/d3b/d3d/f85 [109375,39934] 0 2024-08-01T06:55:59.948 INFO:tasks.workunit.client.1.smithi089.stdout:9/476: truncate f10 3208573 0 2024-08-01T06:55:59.948 INFO:tasks.workunit.client.1.smithi089.stdout:2/441: write d7/d1f/f6c [557820,51730] 0 2024-08-01T06:55:59.949 INFO:tasks.workunit.client.1.smithi089.stdout:6/588: readlink d2/d11/d1f/la9 0 2024-08-01T06:55:59.950 INFO:tasks.workunit.client.1.smithi089.stdout:2/442: stat d7/d19/d1e/d5b/d81 0 2024-08-01T06:55:59.955 INFO:tasks.workunit.client.1.smithi089.stdout:1/539: dread d0/d9/d15/d2d/d4a/d61/f7e [4194304,4194304] 0 2024-08-01T06:55:59.955 INFO:tasks.workunit.client.1.smithi089.stdout:2/443: rmdir d7/d1f/d29/d48 39 2024-08-01T06:55:59.956 INFO:tasks.workunit.client.1.smithi089.stdout:9/477: truncate d18/d33/f37 368954 0 2024-08-01T06:55:59.956 INFO:tasks.workunit.client.1.smithi089.stdout:5/509: write d5/de/d10/f11 [3779926,96907] 0 2024-08-01T06:55:59.957 INFO:tasks.workunit.client.1.smithi089.stdout:7/470: dwrite d7/df/f11 [0,4194304] 0 2024-08-01T06:55:59.959 INFO:tasks.workunit.client.1.smithi089.stdout:2/444: fsync d7/d19/d1e/d5b/d81/f87 0 2024-08-01T06:55:59.959 INFO:tasks.workunit.client.1.smithi089.stdout:6/589: rename d2/d11/d1f/d46/d6b/c84 to d2/d2e/d2f/d91/cca 0 2024-08-01T06:55:59.960 INFO:tasks.workunit.client.1.smithi089.stdout:6/590: dread - d2/d11/d1a/fad zero size 2024-08-01T06:55:59.965 INFO:tasks.workunit.client.1.smithi089.stdout:7/471: creat d7/df/d10/d42/d4e/f96 x:0 0 0 2024-08-01T06:55:59.966 INFO:tasks.workunit.client.1.smithi089.stdout:2/445: rmdir d7/d19/d1e/d3d/d60 39 2024-08-01T06:55:59.969 INFO:tasks.workunit.client.1.smithi089.stdout:5/510: dwrite d5/d13/f30 [0,4194304] 0 2024-08-01T06:55:59.972 INFO:tasks.workunit.client.1.smithi089.stdout:6/591: dwrite d2/d30/fa3 [0,4194304] 0 2024-08-01T06:55:59.975 INFO:tasks.workunit.client.1.smithi089.stdout:1/540: creat d0/d9/d15/d3b/d95/fb2 x:0 0 0 2024-08-01T06:55:59.975 INFO:tasks.workunit.client.1.smithi089.stdout:2/446: dread d7/d19/d1e/f30 [0,4194304] 0 2024-08-01T06:55:59.975 INFO:tasks.workunit.client.1.smithi089.stdout:9/478: truncate f17 3574806 0 2024-08-01T06:55:59.978 INFO:tasks.workunit.client.1.smithi089.stdout:5/511: symlink d5/de/d10/d16/d1b/d52/d5d/d6c/lad 0 2024-08-01T06:55:59.979 INFO:tasks.workunit.client.1.smithi089.stdout:1/541: read d0/d9/d15/f52 [548362,15715] 0 2024-08-01T06:55:59.980 INFO:tasks.workunit.client.1.smithi089.stdout:2/447: rename d7/d1f/c31 to d7/d19/d3b/c91 0 2024-08-01T06:55:59.981 INFO:tasks.workunit.client.1.smithi089.stdout:5/512: creat d5/dac/fae x:0 0 0 2024-08-01T06:55:59.982 INFO:tasks.workunit.client.1.smithi089.stdout:2/448: stat d7/d1f/d28/l2c 0 2024-08-01T06:55:59.982 INFO:tasks.workunit.client.1.smithi089.stdout:9/479: getdents d18/d33/d49/d7b/d4b 0 2024-08-01T06:55:59.983 INFO:tasks.workunit.client.1.smithi089.stdout:5/513: write d5/de/d10/d33/f6e [2342009,89959] 0 2024-08-01T06:55:59.984 INFO:tasks.workunit.client.1.smithi089.stdout:1/542: mknod d0/d9/d15/d3b/d95/d49/d82/cb3 0 2024-08-01T06:55:59.985 INFO:tasks.workunit.client.1.smithi089.stdout:1/543: dread - d0/d9/d15/d76/f94 zero size 2024-08-01T06:55:59.985 INFO:tasks.workunit.client.1.smithi089.stdout:9/480: mkdir d18/d22/d39/d95 0 2024-08-01T06:55:59.986 INFO:tasks.workunit.client.1.smithi089.stdout:1/544: chown d0/d9/d43/d4b 387951 1 2024-08-01T06:55:59.987 INFO:tasks.workunit.client.1.smithi089.stdout:1/545: chown d0/d9/d15/d2d/d4a/f55 178 1 2024-08-01T06:55:59.990 INFO:tasks.workunit.client.1.smithi089.stdout:9/481: rename d18/d22/d45/f51 to d18/d22/d39/d50/d75/d8e/f96 0 2024-08-01T06:55:59.990 INFO:tasks.workunit.client.1.smithi089.stdout:2/449: link d7/d1f/d28/c39 d7/d19/d1e/d3d/d60/c92 0 2024-08-01T06:55:59.991 INFO:tasks.workunit.client.1.smithi089.stdout:5/514: link d5/de/f59 d5/de/faf 0 2024-08-01T06:55:59.992 INFO:tasks.workunit.client.1.smithi089.stdout:5/515: stat d5/de/d10/d16/d1b/d52/d5d/d6c 0 2024-08-01T06:55:59.993 INFO:tasks.workunit.client.1.smithi089.stdout:2/450: mknod d7/d1f/d29/d48/d4e/c93 0 2024-08-01T06:55:59.994 INFO:tasks.workunit.client.1.smithi089.stdout:5/516: mkdir d5/de/d57/db0 0 2024-08-01T06:55:59.994 INFO:tasks.workunit.client.1.smithi089.stdout:2/451: fdatasync d7/d19/d1e/d5b/f8e 0 2024-08-01T06:56:00.000 INFO:tasks.workunit.client.1.smithi089.stdout:2/452: link d7/d1f/d52/d6e/f75 d7/d19/f94 0 2024-08-01T06:56:00.000 INFO:tasks.workunit.client.1.smithi089.stdout:5/517: mkdir d5/de/d10/d33/d5e/d7e/d9e/db1 0 2024-08-01T06:56:00.002 INFO:tasks.workunit.client.1.smithi089.stdout:5/518: fdatasync d5/de/f34 0 2024-08-01T06:56:00.002 INFO:tasks.workunit.client.1.smithi089.stdout:7/472: dread d7/d1f/f1d [0,4194304] 0 2024-08-01T06:56:00.004 INFO:tasks.workunit.client.1.smithi089.stdout:5/519: dread - d5/de/d10/d16/fa2 zero size 2024-08-01T06:56:00.005 INFO:tasks.workunit.client.1.smithi089.stdout:7/473: mknod d7/df/d3b/d64/c97 0 2024-08-01T06:56:00.006 INFO:tasks.workunit.client.1.smithi089.stdout:6/592: dread d2/d2e/d7c/f95 [0,4194304] 0 2024-08-01T06:56:00.007 INFO:tasks.workunit.client.1.smithi089.stdout:1/546: dread d0/d9/d15/d2d/d4a/d4d/f50 [0,4194304] 0 2024-08-01T06:56:00.009 INFO:tasks.workunit.client.1.smithi089.stdout:6/593: write d2/d11/f63 [2401619,16165] 0 2024-08-01T06:56:00.009 INFO:tasks.workunit.client.1.smithi089.stdout:9/482: dread d18/f21 [0,4194304] 0 2024-08-01T06:56:00.009 INFO:tasks.workunit.client.1.smithi089.stdout:7/474: mkdir d7/df/d91/d98 0 2024-08-01T06:56:00.010 INFO:tasks.workunit.client.1.smithi089.stdout:5/520: creat d5/de/d57/db0/fb2 x:0 0 0 2024-08-01T06:56:00.011 INFO:tasks.workunit.client.1.smithi089.stdout:9/483: write d18/d22/f38 [911019,47204] 0 2024-08-01T06:56:00.016 INFO:tasks.workunit.client.1.smithi089.stdout:5/521: creat d5/d13/d38/fb3 x:0 0 0 2024-08-01T06:56:00.018 INFO:tasks.workunit.client.1.smithi089.stdout:1/547: getdents d0/d9/d15/d3b 0 2024-08-01T06:56:00.021 INFO:tasks.workunit.client.1.smithi089.stdout:6/594: dwrite d2/d30/fa1 [0,4194304] 0 2024-08-01T06:56:00.023 INFO:tasks.workunit.client.1.smithi089.stdout:6/595: chown d2/d11/d1a 1633209 1 2024-08-01T06:56:00.028 INFO:tasks.workunit.client.1.smithi089.stdout:1/548: getdents d0/d9/d15/d3b/d95 0 2024-08-01T06:56:00.029 INFO:tasks.workunit.client.1.smithi089.stdout:2/453: dwrite d7/d1f/f20 [0,4194304] 0 2024-08-01T06:56:00.029 INFO:tasks.workunit.client.1.smithi089.stdout:9/484: dread d18/d33/d53/f5e [0,4194304] 0 2024-08-01T06:56:00.029 INFO:tasks.workunit.client.1.smithi089.stdout:1/549: readlink d0/d9/l1c 0 2024-08-01T06:56:00.031 INFO:tasks.workunit.client.1.smithi089.stdout:6/596: creat d2/d11/d1f/d46/d6b/d7d/fcb x:0 0 0 2024-08-01T06:56:00.034 INFO:tasks.workunit.client.1.smithi089.stdout:1/550: chown d0/f24 33322 1 2024-08-01T06:56:00.034 INFO:tasks.workunit.client.1.smithi089.stdout:2/454: chown d7/d1f/f6c 710779 1 2024-08-01T06:56:00.036 INFO:tasks.workunit.client.1.smithi089.stdout:7/475: dwrite d7/d1f/f3f [0,4194304] 0 2024-08-01T06:56:00.036 INFO:tasks.workunit.client.1.smithi089.stdout:9/485: read d18/d33/f37 [173389,77509] 0 2024-08-01T06:56:00.037 INFO:tasks.workunit.client.1.smithi089.stdout:7/476: dread - d7/f93 zero size 2024-08-01T06:56:00.040 INFO:tasks.workunit.client.1.smithi089.stdout:6/597: rename d2/d30/c78 to d2/d2e/d2f/ccc 0 2024-08-01T06:56:00.042 INFO:tasks.workunit.client.1.smithi089.stdout:2/455: read d7/d19/d3b/f50 [67122,64500] 0 2024-08-01T06:56:00.043 INFO:tasks.workunit.client.1.smithi089.stdout:1/551: dread d0/d9/d15/d2d/d4a/f5e [0,4194304] 0 2024-08-01T06:56:00.044 INFO:tasks.workunit.client.1.smithi089.stdout:7/477: rename d7/d1f/l20 to d7/df/d91/d98/l99 0 2024-08-01T06:56:00.044 INFO:tasks.workunit.client.1.smithi089.stdout:9/486: dread d18/d33/d53/f6f [0,4194304] 0 2024-08-01T06:56:00.045 INFO:tasks.workunit.client.1.smithi089.stdout:6/598: unlink d2/d11/d1f/ca7 0 2024-08-01T06:56:00.045 INFO:tasks.workunit.client.1.smithi089.stdout:7/478: truncate d7/df/f11 4518236 0 2024-08-01T06:56:00.046 INFO:tasks.workunit.client.1.smithi089.stdout:2/456: creat d7/d19/d3b/f95 x:0 0 0 2024-08-01T06:56:00.046 INFO:tasks.workunit.client.1.smithi089.stdout:9/487: mknod d18/d33/d3b/c97 0 2024-08-01T06:56:00.046 INFO:tasks.workunit.client.1.smithi089.stdout:7/479: chown d7/df/d10/d42/c7d 12677751 1 2024-08-01T06:56:00.047 INFO:tasks.workunit.client.1.smithi089.stdout:9/488: chown d18/d22/d52/c65 3 1 2024-08-01T06:56:00.048 INFO:tasks.workunit.client.1.smithi089.stdout:6/599: truncate d2/d2e/d2f/f4d 566455 0 2024-08-01T06:56:00.048 INFO:tasks.workunit.client.1.smithi089.stdout:7/480: write d7/df/f11 [3336470,1485] 0 2024-08-01T06:56:00.052 INFO:tasks.workunit.client.1.smithi089.stdout:6/600: creat d2/d2e/dc2/fcd x:0 0 0 2024-08-01T06:56:00.052 INFO:tasks.workunit.client.1.smithi089.stdout:7/481: mkdir d7/d1f/d30/d9a 0 2024-08-01T06:56:00.054 INFO:tasks.workunit.client.1.smithi089.stdout:6/601: mkdir d2/d11/d1f/d46/dce 0 2024-08-01T06:56:00.055 INFO:tasks.workunit.client.1.smithi089.stdout:2/457: dwrite d7/d73/f74 [0,4194304] 0 2024-08-01T06:56:00.056 INFO:tasks.workunit.client.1.smithi089.stdout:7/482: creat d7/df/d91/d98/f9b x:0 0 0 2024-08-01T06:56:00.056 INFO:tasks.workunit.client.1.smithi089.stdout:7/483: readlink d7/df/d10/d42/l5c 0 2024-08-01T06:56:00.058 INFO:tasks.workunit.client.1.smithi089.stdout:6/602: symlink d2/d2e/d7c/lcf 0 2024-08-01T06:56:00.059 INFO:tasks.workunit.client.1.smithi089.stdout:6/603: read - d2/d11/d1a/fad zero size 2024-08-01T06:56:00.060 INFO:tasks.workunit.client.1.smithi089.stdout:2/458: mknod d7/d1f/d52/c96 0 2024-08-01T06:56:00.060 INFO:tasks.workunit.client.1.smithi089.stdout:1/552: write d0/d9/d43/f71 [2676301,37488] 0 2024-08-01T06:56:00.063 INFO:tasks.workunit.client.1.smithi089.stdout:9/489: truncate ff 1386872 0 2024-08-01T06:56:00.064 INFO:tasks.workunit.client.1.smithi089.stdout:2/459: write d7/d19/f40 [1070218,25000] 0 2024-08-01T06:56:00.065 INFO:tasks.workunit.client.1.smithi089.stdout:2/460: chown d7/d19/d3b/d7c 4205965 1 2024-08-01T06:56:00.065 INFO:tasks.workunit.client.1.smithi089.stdout:6/604: rename d2/d11/d1f/la9 to d2/d11/d1a/d1c/ld0 0 2024-08-01T06:56:00.066 INFO:tasks.workunit.client.1.smithi089.stdout:9/490: truncate d18/f4f 873840 0 2024-08-01T06:56:00.066 INFO:tasks.workunit.client.1.smithi089.stdout:6/605: readlink d2/d11/l16 0 2024-08-01T06:56:00.067 INFO:tasks.workunit.client.1.smithi089.stdout:2/461: truncate d7/d1f/d28/f71 833593 0 2024-08-01T06:56:00.067 INFO:tasks.workunit.client.1.smithi089.stdout:8/501: sync 2024-08-01T06:56:00.067 INFO:tasks.workunit.client.1.smithi089.stdout:4/558: sync 2024-08-01T06:56:00.068 INFO:tasks.workunit.client.1.smithi089.stdout:0/641: sync 2024-08-01T06:56:00.068 INFO:tasks.workunit.client.1.smithi089.stdout:1/553: rename d0/d9/c40 to d0/d9/d15/d2b/d7d/cb4 0 2024-08-01T06:56:00.069 INFO:tasks.workunit.client.1.smithi089.stdout:9/491: mkdir d18/d33/d49/d7b/d7f/d98 0 2024-08-01T06:56:00.069 INFO:tasks.workunit.client.1.smithi089.stdout:7/484: dread d7/d1f/d30/f71 [0,4194304] 0 2024-08-01T06:56:00.071 INFO:tasks.workunit.client.1.smithi089.stdout:8/502: creat d5/d15/d5e/fab x:0 0 0 2024-08-01T06:56:00.072 INFO:tasks.workunit.client.1.smithi089.stdout:6/606: fsync d2/d30/d3c/d3d/f71 0 2024-08-01T06:56:00.074 INFO:tasks.workunit.client.1.smithi089.stdout:4/559: write d3/d1f/d62/d3b/f8d [414319,115940] 0 2024-08-01T06:56:00.076 INFO:tasks.workunit.client.1.smithi089.stdout:0/642: creat d9/d40/d25/d46/d91/d2e/d44/d72/d8b/fd1 x:0 0 0 2024-08-01T06:56:00.077 INFO:tasks.workunit.client.1.smithi089.stdout:7/485: mknod d7/df/d10/d42/d75/c9c 0 2024-08-01T06:56:00.078 INFO:tasks.workunit.client.1.smithi089.stdout:8/503: symlink d5/dc/d1e/d53/lac 0 2024-08-01T06:56:00.079 INFO:tasks.workunit.client.1.smithi089.stdout:2/462: dwrite d7/d19/f44 [0,4194304] 0 2024-08-01T06:56:00.079 INFO:tasks.workunit.client.1.smithi089.stdout:6/607: creat d2/d11/d1a/fd1 x:0 0 0 2024-08-01T06:56:00.080 INFO:tasks.workunit.client.1.smithi089.stdout:4/560: truncate d3/db/d16/f4f 5397621 0 2024-08-01T06:56:00.081 INFO:tasks.workunit.client.1.smithi089.stdout:4/561: chown d3/d17/d3a/d3d 227535 1 2024-08-01T06:56:00.082 INFO:tasks.workunit.client.1.smithi089.stdout:7/486: write d7/df/d10/f24 [3361016,80165] 0 2024-08-01T06:56:00.083 INFO:tasks.workunit.client.1.smithi089.stdout:9/492: dread fa [0,4194304] 0 2024-08-01T06:56:00.085 INFO:tasks.workunit.client.1.smithi089.stdout:7/487: chown d7/df/d10/d31 42745 1 2024-08-01T06:56:00.086 INFO:tasks.workunit.client.1.smithi089.stdout:8/504: chown d5/dc/d1e/l50 31 1 2024-08-01T06:56:00.090 INFO:tasks.workunit.client.1.smithi089.stdout:8/505: fsync d5/dc/fa1 0 2024-08-01T06:56:00.091 INFO:tasks.workunit.client.1.smithi089.stdout:0/643: rename d9/d40/d25/d46/d91/f69 to d9/d40/d25/d46/d91/d2e/d44/d53/daf/fd2 0 2024-08-01T06:56:00.091 INFO:tasks.workunit.client.1.smithi089.stdout:6/608: dwrite d2/d11/d1f/d46/fac [0,4194304] 0 2024-08-01T06:56:00.093 INFO:tasks.workunit.client.1.smithi089.stdout:4/562: mknod d3/db/de/d5b/ca6 0 2024-08-01T06:56:00.097 INFO:tasks.workunit.client.1.smithi089.stdout:7/488: creat d7/d1f/d3a/f9d x:0 0 0 2024-08-01T06:56:00.099 INFO:tasks.workunit.client.1.smithi089.stdout:8/506: symlink d5/dc/d1e/d53/lad 0 2024-08-01T06:56:00.099 INFO:tasks.workunit.client.1.smithi089.stdout:1/554: dread d0/d9/d15/d2d/d4a/d4d/f5d [0,4194304] 0 2024-08-01T06:56:00.100 INFO:tasks.workunit.client.1.smithi089.stdout:6/609: fsync d2/d11/f66 0 2024-08-01T06:56:00.100 INFO:tasks.workunit.client.1.smithi089.stdout:9/493: rename d18/f21 to d18/d22/d43/f99 0 2024-08-01T06:56:00.102 INFO:tasks.workunit.client.1.smithi089.stdout:7/489: creat d7/df/d10/d42/f9e x:0 0 0 2024-08-01T06:56:00.103 INFO:tasks.workunit.client.1.smithi089.stdout:2/463: getdents d7/d19/d1e/d5b 0 2024-08-01T06:56:00.104 INFO:tasks.workunit.client.1.smithi089.stdout:4/563: mkdir d3/d1f/d62/d3b/da7 0 2024-08-01T06:56:00.105 INFO:tasks.workunit.client.1.smithi089.stdout:8/507: dread d5/dc/d94/f8c [0,4194304] 0 2024-08-01T06:56:00.106 INFO:tasks.workunit.client.1.smithi089.stdout:6/610: rename d2/d2e/d98/d97 to d2/d2e/dc2/dd2 0 2024-08-01T06:56:00.108 INFO:tasks.workunit.client.1.smithi089.stdout:1/555: rmdir d0/d9/d15/d3b/d95/d99 0 2024-08-01T06:56:00.108 INFO:tasks.workunit.client.1.smithi089.stdout:0/644: dread d9/d40/d95/d99/d2b/d55/f83 [0,4194304] 0 2024-08-01T06:56:00.111 INFO:tasks.workunit.client.1.smithi089.stdout:9/494: dread d18/f47 [0,4194304] 0 2024-08-01T06:56:00.111 INFO:tasks.workunit.client.1.smithi089.stdout:0/645: chown d9/d40/d45/d47/da8/fac 33 1 2024-08-01T06:56:00.112 INFO:tasks.workunit.client.1.smithi089.stdout:1/556: mkdir d0/d9/d15/d3b/d3d/db5 0 2024-08-01T06:56:00.112 INFO:tasks.workunit.client.1.smithi089.stdout:9/495: readlink d18/d33/d49/d7b/l8a 0 2024-08-01T06:56:00.114 INFO:tasks.workunit.client.1.smithi089.stdout:0/646: creat d9/d40/d25/d46/d91/d2e/d3a/d76/d96/fd3 x:0 0 0 2024-08-01T06:56:00.115 INFO:tasks.workunit.client.1.smithi089.stdout:1/557: write d0/d9/d15/d2d/d4a/f55 [3194258,26685] 0 2024-08-01T06:56:00.118 INFO:tasks.workunit.client.1.smithi089.stdout:1/558: creat d0/d9/d43/d89/fb6 x:0 0 0 2024-08-01T06:56:00.119 INFO:tasks.workunit.client.1.smithi089.stdout:0/647: dread d9/f13 [0,4194304] 0 2024-08-01T06:56:00.121 INFO:tasks.workunit.client.1.smithi089.stdout:0/648: write d9/d40/d45/dc1/fcc [593433,97980] 0 2024-08-01T06:56:00.122 INFO:tasks.workunit.client.1.smithi089.stdout:1/559: creat d0/d9/d15/d2d/d4a/fb7 x:0 0 0 2024-08-01T06:56:00.122 INFO:tasks.workunit.client.1.smithi089.stdout:0/649: stat d9/d40/d25/d46/d91/d2e/d3a/d76/d96/fd3 0 2024-08-01T06:56:00.125 INFO:tasks.workunit.client.1.smithi089.stdout:8/508: write d5/d15/f44 [2177510,48709] 0 2024-08-01T06:56:00.126 INFO:tasks.workunit.client.1.smithi089.stdout:1/560: rename d0/d9/d15/d2d/d4a/d4d/f50 to d0/d9/d43/fb8 0 2024-08-01T06:56:00.127 INFO:tasks.workunit.client.1.smithi089.stdout:6/611: write d2/f8 [551457,111084] 0 2024-08-01T06:56:00.129 INFO:tasks.workunit.client.1.smithi089.stdout:0/650: link d9/f33 d9/d40/d95/d99/dba/fd4 0 2024-08-01T06:56:00.130 INFO:tasks.workunit.client.1.smithi089.stdout:7/490: truncate d7/df/d10/f34 442971 0 2024-08-01T06:56:00.134 INFO:tasks.workunit.client.1.smithi089.stdout:2/464: dwrite d7/d1f/d29/f49 [4194304,4194304] 0 2024-08-01T06:56:00.150 INFO:tasks.workunit.client.1.smithi089.stdout:2/465: write d7/d19/d1e/f54 [1509291,124174] 0 2024-08-01T06:56:00.152 INFO:tasks.workunit.client.1.smithi089.stdout:3/383: sync 2024-08-01T06:56:00.153 INFO:tasks.workunit.client.1.smithi089.stdout:8/509: dwrite d5/f25 [4194304,4194304] 0 2024-08-01T06:56:00.162 INFO:tasks.workunit.client.1.smithi089.stdout:1/561: dwrite d0/d9/d15/d2d/d4a/d61/fab [0,4194304] 0 2024-08-01T06:56:00.165 INFO:tasks.workunit.client.1.smithi089.stdout:4/564: dwrite d3/f24 [0,4194304] 0 2024-08-01T06:56:00.168 INFO:tasks.workunit.client.1.smithi089.stdout:7/491: dwrite d7/d1f/f7a [0,4194304] 0 2024-08-01T06:56:00.170 INFO:tasks.workunit.client.1.smithi089.stdout:8/510: mknod d5/d15/d5a/d73/cae 0 2024-08-01T06:56:00.170 INFO:tasks.workunit.client.1.smithi089.stdout:9/496: dwrite d18/d22/f28 [0,4194304] 0 2024-08-01T06:56:00.171 INFO:tasks.workunit.client.1.smithi089.stdout:6/612: dwrite d2/d30/fa3 [0,4194304] 0 2024-08-01T06:56:00.174 INFO:tasks.workunit.client.1.smithi089.stdout:4/565: fsync d3/d1e/f4e 0 2024-08-01T06:56:00.174 INFO:tasks.workunit.client.1.smithi089.stdout:0/651: dwrite d9/d40/d25/d46/d91/f3f [0,4194304] 0 2024-08-01T06:56:00.180 INFO:tasks.workunit.client.1.smithi089.stdout:7/492: fsync d7/df/d10/d31/f45 0 2024-08-01T06:56:00.180 INFO:tasks.workunit.client.1.smithi089.stdout:4/566: chown d3/d68/d7e/c8a 33 1 2024-08-01T06:56:00.182 INFO:tasks.workunit.client.1.smithi089.stdout:7/493: fdatasync f4 0 2024-08-01T06:56:00.183 INFO:tasks.workunit.client.1.smithi089.stdout:8/511: rmdir d5/d23 39 2024-08-01T06:56:00.184 INFO:tasks.workunit.client.1.smithi089.stdout:2/466: dwrite d7/d19/d1e/d5b/f8e [0,4194304] 0 2024-08-01T06:56:00.186 INFO:tasks.workunit.client.1.smithi089.stdout:8/512: fdatasync d5/dc/f70 0 2024-08-01T06:56:00.188 INFO:tasks.workunit.client.1.smithi089.stdout:0/652: truncate d9/d40/d25/d46/d91/d2e/fbd 690260 0 2024-08-01T06:56:00.189 INFO:tasks.workunit.client.1.smithi089.stdout:9/497: dwrite d18/d22/f28 [0,4194304] 0 2024-08-01T06:56:00.191 INFO:tasks.workunit.client.1.smithi089.stdout:6/613: rmdir d2/d2e/d98 39 2024-08-01T06:56:00.197 INFO:tasks.workunit.client.1.smithi089.stdout:8/513: dread d5/d15/f1f [0,4194304] 0 2024-08-01T06:56:00.197 INFO:tasks.workunit.client.1.smithi089.stdout:7/494: rmdir d7/df/d3b/d64 39 2024-08-01T06:56:00.199 INFO:tasks.workunit.client.1.smithi089.stdout:1/562: write d0/d9/d15/d3b/d95/d49/f8d [3425384,34361] 0 2024-08-01T06:56:00.202 INFO:tasks.workunit.client.1.smithi089.stdout:2/467: mknod d7/d19/d3b/d7c/c97 0 2024-08-01T06:56:00.205 INFO:tasks.workunit.client.1.smithi089.stdout:9/498: symlink d18/d33/d53/l9a 0 2024-08-01T06:56:00.208 INFO:tasks.workunit.client.1.smithi089.stdout:2/468: dwrite d7/d1f/d28/f71 [0,4194304] 0 2024-08-01T06:56:00.209 INFO:tasks.workunit.client.1.smithi089.stdout:3/384: truncate d7/d32/d4c/d69/f1a 2775780 0 2024-08-01T06:56:00.211 INFO:tasks.workunit.client.1.smithi089.stdout:5/522: sync 2024-08-01T06:56:00.212 INFO:tasks.workunit.client.1.smithi089.stdout:8/514: dread - d5/d23/f49 zero size 2024-08-01T06:56:00.212 INFO:tasks.workunit.client.1.smithi089.stdout:7/495: mknod d7/df/d10/c9f 0 2024-08-01T06:56:00.220 INFO:tasks.workunit.client.1.smithi089.stdout:0/653: truncate d9/d40/d95/d99/dba/fd4 1094201 0 2024-08-01T06:56:00.222 INFO:tasks.workunit.client.1.smithi089.stdout:8/515: dread d5/d15/f44 [0,4194304] 0 2024-08-01T06:56:00.224 INFO:tasks.workunit.client.1.smithi089.stdout:6/614: mknod d2/d2e/cd3 0 2024-08-01T06:56:00.224 INFO:tasks.workunit.client.1.smithi089.stdout:6/615: chown d2/d2e/d7c/lcf 455626675 1 2024-08-01T06:56:00.225 INFO:tasks.workunit.client.1.smithi089.stdout:6/616: fsync d2/d11/d1f/f5a 0 2024-08-01T06:56:00.231 INFO:tasks.workunit.client.1.smithi089.stdout:7/496: unlink d7/df/d10/d42/d4e/f57 0 2024-08-01T06:56:00.231 INFO:tasks.workunit.client.1.smithi089.stdout:7/497: read - d7/d15/f72 zero size 2024-08-01T06:56:00.234 INFO:tasks.workunit.client.1.smithi089.stdout:9/499: creat d18/d22/d39/d95/f9b x:0 0 0 2024-08-01T06:56:00.236 INFO:tasks.workunit.client.1.smithi089.stdout:1/563: dread d0/d9/d15/d2d/d4a/d61/f7e [0,4194304] 0 2024-08-01T06:56:00.236 INFO:tasks.workunit.client.1.smithi089.stdout:8/516: rename d5/d23/d91/l9b to d5/dc/d12/laf 0 2024-08-01T06:56:00.237 INFO:tasks.workunit.client.1.smithi089.stdout:2/469: symlink d7/l98 0 2024-08-01T06:56:00.240 INFO:tasks.workunit.client.1.smithi089.stdout:6/617: creat d2/d11/d1f/d46/fd4 x:0 0 0 2024-08-01T06:56:00.240 INFO:tasks.workunit.client.1.smithi089.stdout:9/500: dwrite d18/f6b [0,4194304] 0 2024-08-01T06:56:00.241 INFO:tasks.workunit.client.1.smithi089.stdout:3/385: symlink d7/d32/d12/d29/l76 0 2024-08-01T06:56:00.247 INFO:tasks.workunit.client.1.smithi089.stdout:7/498: creat d7/df/d10/d36/fa0 x:0 0 0 2024-08-01T06:56:00.248 INFO:tasks.workunit.client.1.smithi089.stdout:7/499: truncate d7/d15/f3c 1198332 0 2024-08-01T06:56:00.250 INFO:tasks.workunit.client.1.smithi089.stdout:1/564: mknod d0/d9/d43/cb9 0 2024-08-01T06:56:00.255 INFO:tasks.workunit.client.1.smithi089.stdout:4/567: truncate d3/db/de/f9d 2582852 0 2024-08-01T06:56:00.255 INFO:tasks.workunit.client.1.smithi089.stdout:7/500: dwrite d7/df/d10/f83 [0,4194304] 0 2024-08-01T06:56:00.256 INFO:tasks.workunit.client.1.smithi089.stdout:6/618: mknod d2/d11/d1a/cd5 0 2024-08-01T06:56:00.257 INFO:tasks.workunit.client.1.smithi089.stdout:9/501: rmdir d18/d33/d49/d7b/d55 39 2024-08-01T06:56:00.261 INFO:tasks.workunit.client.1.smithi089.stdout:5/523: creat d5/de/fb4 x:0 0 0 2024-08-01T06:56:00.262 INFO:tasks.workunit.client.1.smithi089.stdout:8/517: dwrite d5/dc/d1e/f47 [0,4194304] 0 2024-08-01T06:56:00.264 INFO:tasks.workunit.client.1.smithi089.stdout:8/518: readlink d5/dc/l8e 0 2024-08-01T06:56:00.266 INFO:tasks.workunit.client.1.smithi089.stdout:6/619: dwrite d2/f18 [4194304,4194304] 0 2024-08-01T06:56:00.268 INFO:tasks.workunit.client.1.smithi089.stdout:1/565: rmdir d0/d9/d15/d3b/d3d/d77 39 2024-08-01T06:56:00.269 INFO:tasks.workunit.client.1.smithi089.stdout:6/620: fsync d2/d2e/d2f/d9e/fc7 0 2024-08-01T06:56:00.270 INFO:tasks.workunit.client.1.smithi089.stdout:6/621: stat d2/d30/d3c/d3d/fc6 0 2024-08-01T06:56:00.275 INFO:tasks.workunit.client.1.smithi089.stdout:8/519: dwrite d5/dc/fa1 [0,4194304] 0 2024-08-01T06:56:00.281 INFO:tasks.workunit.client.1.smithi089.stdout:0/654: write d9/d40/d25/d46/d91/d2e/fce [3223585,86631] 0 2024-08-01T06:56:00.286 INFO:tasks.workunit.client.1.smithi089.stdout:5/524: symlink d5/de/df/d9f/lb5 0 2024-08-01T06:56:00.286 INFO:tasks.workunit.client.1.smithi089.stdout:5/525: write d5/de/f34 [5512943,110360] 0 2024-08-01T06:56:00.288 INFO:tasks.workunit.client.1.smithi089.stdout:5/526: dread - d5/d13/d83/f96 zero size 2024-08-01T06:56:00.290 INFO:tasks.workunit.client.1.smithi089.stdout:6/622: creat d2/fd6 x:0 0 0 2024-08-01T06:56:00.291 INFO:tasks.workunit.client.1.smithi089.stdout:2/470: creat d7/d19/d1e/d3d/f99 x:0 0 0 2024-08-01T06:56:00.293 INFO:tasks.workunit.client.1.smithi089.stdout:1/566: truncate d0/d9/d15/d2d/f53 112875 0 2024-08-01T06:56:00.294 INFO:tasks.workunit.client.1.smithi089.stdout:4/568: chown d3/db/de/f9d 23968691 1 2024-08-01T06:56:00.294 INFO:tasks.workunit.client.1.smithi089.stdout:9/502: dread d18/d33/d49/d7b/f41 [0,4194304] 0 2024-08-01T06:56:00.295 INFO:tasks.workunit.client.1.smithi089.stdout:8/520: creat d5/d23/fb0 x:0 0 0 2024-08-01T06:56:00.296 INFO:tasks.workunit.client.1.smithi089.stdout:3/386: creat d7/d32/d12/d29/f77 x:0 0 0 2024-08-01T06:56:00.298 INFO:tasks.workunit.client.1.smithi089.stdout:5/527: creat d5/de/df/fb6 x:0 0 0 2024-08-01T06:56:00.300 INFO:tasks.workunit.client.1.smithi089.stdout:1/567: symlink d0/d9/d15/d2b/lba 0 2024-08-01T06:56:00.301 INFO:tasks.workunit.client.1.smithi089.stdout:4/569: symlink d3/d86/d9e/d57/la8 0 2024-08-01T06:56:00.302 INFO:tasks.workunit.client.1.smithi089.stdout:8/521: dwrite d5/d23/f48 [4194304,4194304] 0 2024-08-01T06:56:00.304 INFO:tasks.workunit.client.1.smithi089.stdout:9/503: mkdir d18/d33/d49/d7b/d81/d9c 0 2024-08-01T06:56:00.305 INFO:tasks.workunit.client.1.smithi089.stdout:1/568: read d0/d9/d15/d3b/d3d/f8a [3413756,89342] 0 2024-08-01T06:56:00.306 INFO:tasks.workunit.client.1.smithi089.stdout:4/570: write d3/db/de/d5b/f73 [312278,122628] 0 2024-08-01T06:56:00.308 INFO:tasks.workunit.client.1.smithi089.stdout:9/504: write d18/d22/d39/f42 [1785063,114411] 0 2024-08-01T06:56:00.310 INFO:tasks.workunit.client.1.smithi089.stdout:3/387: rename d7/d32/d4c/d53/d65/d63 to d7/d68/d50/d54/d78 0 2024-08-01T06:56:00.310 INFO:tasks.workunit.client.1.smithi089.stdout:9/505: read d18/d22/d52/f6d [1230788,86517] 0 2024-08-01T06:56:00.311 INFO:tasks.workunit.client.1.smithi089.stdout:7/501: link d7/df/d3b/d64/c74 d7/d1f/d30/ca1 0 2024-08-01T06:56:00.315 INFO:tasks.workunit.client.1.smithi089.stdout:4/571: creat d3/d68/d7e/fa9 x:0 0 0 2024-08-01T06:56:00.318 INFO:tasks.workunit.client.1.smithi089.stdout:1/569: mknod d0/cbb 0 2024-08-01T06:56:00.319 INFO:tasks.workunit.client.1.smithi089.stdout:5/528: dread d5/d13/f84 [0,4194304] 0 2024-08-01T06:56:00.319 INFO:tasks.workunit.client.1.smithi089.stdout:8/522: symlink d5/dc/d12/d92/lb1 0 2024-08-01T06:56:00.321 INFO:tasks.workunit.client.1.smithi089.stdout:9/506: creat d18/d22/f9d x:0 0 0 2024-08-01T06:56:00.322 INFO:tasks.workunit.client.1.smithi089.stdout:0/655: getdents d9/d40/d25/d46/d91/d2e/d44/d53/d9f 0 2024-08-01T06:56:00.326 INFO:tasks.workunit.client.1.smithi089.stdout:1/570: chown d0/d9/d15/l29 8045474 1 2024-08-01T06:56:00.328 INFO:tasks.workunit.client.1.smithi089.stdout:8/523: read - d5/dc/d1e/f95 zero size 2024-08-01T06:56:00.329 INFO:tasks.workunit.client.1.smithi089.stdout:9/507: creat d18/d22/d39/d50/d75/d8e/f9e x:0 0 0 2024-08-01T06:56:00.331 INFO:tasks.workunit.client.1.smithi089.stdout:4/572: dread d3/db/de/fa5 [0,4194304] 0 2024-08-01T06:56:00.333 INFO:tasks.workunit.client.1.smithi089.stdout:7/502: link d7/df/d10/d42/l5c d7/d1f/d30/la2 0 2024-08-01T06:56:00.336 INFO:tasks.workunit.client.1.smithi089.stdout:8/524: truncate d5/d15/d5e/f69 251880 0 2024-08-01T06:56:00.336 INFO:tasks.workunit.client.1.smithi089.stdout:2/471: write d7/d1f/d29/f15 [2730947,88095] 0 2024-08-01T06:56:00.340 INFO:tasks.workunit.client.1.smithi089.stdout:3/388: getdents d7/d32/d4c/d53 0 2024-08-01T06:56:00.343 INFO:tasks.workunit.client.1.smithi089.stdout:7/503: mknod d7/df/d3b/ca3 0 2024-08-01T06:56:00.344 INFO:tasks.workunit.client.1.smithi089.stdout:4/573: rename d3/d17/l85 to d3/db/d42/laa 0 2024-08-01T06:56:00.346 INFO:tasks.workunit.client.1.smithi089.stdout:0/656: getdents d9/d40/d25/d46/d91/d2e/d3a/d76/d96 0 2024-08-01T06:56:00.346 INFO:tasks.workunit.client.1.smithi089.stdout:9/508: dwrite d18/d22/d52/f6d [0,4194304] 0 2024-08-01T06:56:00.352 INFO:tasks.workunit.client.1.smithi089.stdout:8/525: dwrite d5/d15/d5a/d73/f79 [0,4194304] 0 2024-08-01T06:56:00.355 INFO:tasks.workunit.client.1.smithi089.stdout:9/509: dread d18/d33/f62 [0,4194304] 0 2024-08-01T06:56:00.357 INFO:tasks.workunit.client.1.smithi089.stdout:6/623: dwrite d2/d2e/d7c/f95 [0,4194304] 0 2024-08-01T06:56:00.358 INFO:tasks.workunit.client.1.smithi089.stdout:8/526: write d5/dc/f63 [3768977,23855] 0 2024-08-01T06:56:00.359 INFO:tasks.workunit.client.1.smithi089.stdout:7/504: dread d7/fa [0,4194304] 0 2024-08-01T06:56:00.359 INFO:tasks.workunit.client.1.smithi089.stdout:2/472: link d7/d1f/d52/d6e/l85 d7/d1f/d29/l9a 0 2024-08-01T06:56:00.363 INFO:tasks.workunit.client.1.smithi089.stdout:1/571: write d0/f19 [659341,125879] 0 2024-08-01T06:56:00.364 INFO:tasks.workunit.client.1.smithi089.stdout:5/529: dwrite d5/de/df/d9f/fa6 [0,4194304] 0 2024-08-01T06:56:00.368 INFO:tasks.workunit.client.1.smithi089.stdout:0/657: creat d9/d40/d25/d46/d91/d2e/d3a/d76/fd5 x:0 0 0 2024-08-01T06:56:00.370 INFO:tasks.workunit.client.1.smithi089.stdout:7/505: readlink d7/d15/l26 0 2024-08-01T06:56:00.373 INFO:tasks.workunit.client.1.smithi089.stdout:7/506: write d7/d15/f73 [31599,99872] 0 2024-08-01T06:56:00.378 INFO:tasks.workunit.client.1.smithi089.stdout:8/527: creat d5/dc/fb2 x:0 0 0 2024-08-01T06:56:00.379 INFO:tasks.workunit.client.1.smithi089.stdout:4/574: dread d3/db/de/d5b/f75 [0,4194304] 0 2024-08-01T06:56:00.380 INFO:tasks.workunit.client.1.smithi089.stdout:3/389: dread d7/d68/d50/d6f/f49 [0,4194304] 0 2024-08-01T06:56:00.380 INFO:tasks.workunit.client.1.smithi089.stdout:1/572: mknod d0/d9/d15/d2b/cbc 0 2024-08-01T06:56:00.386 INFO:tasks.workunit.client.1.smithi089.stdout:5/530: dwrite d5/de/d10/d16/d1b/d25/f64 [0,4194304] 0 2024-08-01T06:56:00.386 INFO:tasks.workunit.client.1.smithi089.stdout:9/510: truncate d18/f8f 114799 0 2024-08-01T06:56:00.386 INFO:tasks.workunit.client.1.smithi089.stdout:3/390: chown d7/d68/d3d 13839061 1 2024-08-01T06:56:00.386 INFO:tasks.workunit.client.1.smithi089.stdout:9/511: fdatasync d18/f94 0 2024-08-01T06:56:00.386 INFO:tasks.workunit.client.1.smithi089.stdout:7/507: dread d7/df/d10/d42/f5e [0,4194304] 0 2024-08-01T06:56:00.387 INFO:tasks.workunit.client.1.smithi089.stdout:0/658: unlink d9/d40/d25/d46/d91/d2e/d3a/d76/d96/fd3 0 2024-08-01T06:56:00.387 INFO:tasks.workunit.client.1.smithi089.stdout:5/531: write d5/de/f34 [10128611,18254] 0 2024-08-01T06:56:00.389 INFO:tasks.workunit.client.1.smithi089.stdout:2/473: rename d7/l80 to d7/d19/d3b/d7c/l9b 0 2024-08-01T06:56:00.392 INFO:tasks.workunit.client.1.smithi089.stdout:7/508: rename d7/df/d10/d36 to d7/df/d91/da4 0 2024-08-01T06:56:00.395 INFO:tasks.workunit.client.1.smithi089.stdout:0/659: truncate d9/d40/d25/d46/d91/d2e/d3a/f8e 41493 0 2024-08-01T06:56:00.396 INFO:tasks.workunit.client.1.smithi089.stdout:1/573: chown d0/d9/d15/d3b/d95/d49/c91 3977 1 2024-08-01T06:56:00.397 INFO:tasks.workunit.client.1.smithi089.stdout:6/624: creat d2/d30/d3c/fd7 x:0 0 0 2024-08-01T06:56:00.398 INFO:tasks.workunit.client.1.smithi089.stdout:4/575: rmdir d3/d1f/d62/d3b/da7 0 2024-08-01T06:56:00.399 INFO:tasks.workunit.client.1.smithi089.stdout:2/474: readlink d7/d4a/l4c 0 2024-08-01T06:56:00.400 INFO:tasks.workunit.client.1.smithi089.stdout:5/532: dwrite d5/d13/d38/d42/f7b [0,4194304] 0 2024-08-01T06:56:00.401 INFO:tasks.workunit.client.1.smithi089.stdout:9/512: rename d18/d22/d39/d50/d75 to d18/d33/d49/d7b/d7f/d98/d9f 0 2024-08-01T06:56:00.402 INFO:tasks.workunit.client.1.smithi089.stdout:7/509: mknod d7/df/d91/da4/ca5 0 2024-08-01T06:56:00.403 INFO:tasks.workunit.client.1.smithi089.stdout:0/660: readlink d9/d40/d95/d99/l70 0 2024-08-01T06:56:00.406 INFO:tasks.workunit.client.1.smithi089.stdout:1/574: unlink d0/d9/d15/d2d/d4a/d4d/c4e 0 2024-08-01T06:56:00.407 INFO:tasks.workunit.client.1.smithi089.stdout:1/575: stat d0/d9/d15/d2d/d4a/c69 0 2024-08-01T06:56:00.408 INFO:tasks.workunit.client.1.smithi089.stdout:8/528: getdents d5/d15/d5a 0 2024-08-01T06:56:00.408 INFO:tasks.workunit.client.1.smithi089.stdout:3/391: write d7/d32/d4c/d69/f2e [2552993,64884] 0 2024-08-01T06:56:00.410 INFO:tasks.workunit.client.1.smithi089.stdout:9/513: write d18/f1d [5028468,71344] 0 2024-08-01T06:56:00.411 INFO:tasks.workunit.client.1.smithi089.stdout:2/475: mkdir d7/d1f/d29/d48/d4e/d64/d9c 0 2024-08-01T06:56:00.412 INFO:tasks.workunit.client.1.smithi089.stdout:2/476: chown d7/d19/d68 72350425 1 2024-08-01T06:56:00.412 INFO:tasks.workunit.client.1.smithi089.stdout:5/533: rename d5/de/df/c71 to d5/de/d57/db0/cb7 0 2024-08-01T06:56:00.419 INFO:tasks.workunit.client.1.smithi089.stdout:5/534: dread d5/de/d10/d16/f44 [4194304,4194304] 0 2024-08-01T06:56:00.420 INFO:tasks.workunit.client.1.smithi089.stdout:7/510: mkdir d7/d1f/da6 0 2024-08-01T06:56:00.422 INFO:tasks.workunit.client.1.smithi089.stdout:6/625: creat d2/fd8 x:0 0 0 2024-08-01T06:56:00.423 INFO:tasks.workunit.client.1.smithi089.stdout:6/626: chown d2/fd8 464570 1 2024-08-01T06:56:00.423 INFO:tasks.workunit.client.1.smithi089.stdout:8/529: mkdir d5/d15/d5a/d73/daa/db3 0 2024-08-01T06:56:00.425 INFO:tasks.workunit.client.1.smithi089.stdout:2/477: truncate d7/f10 2107581 0 2024-08-01T06:56:00.426 INFO:tasks.workunit.client.1.smithi089.stdout:7/511: write d7/d1f/f1d [5570938,49466] 0 2024-08-01T06:56:00.427 INFO:tasks.workunit.client.1.smithi089.stdout:3/392: dread d7/d32/d4c/d69/f20 [0,4194304] 0 2024-08-01T06:56:00.427 INFO:tasks.workunit.client.1.smithi089.stdout:4/576: getdents d3/d86/d9e/d26 0 2024-08-01T06:56:00.428 INFO:tasks.workunit.client.1.smithi089.stdout:9/514: dread f13 [4194304,4194304] 0 2024-08-01T06:56:00.431 INFO:tasks.workunit.client.1.smithi089.stdout:1/576: getdents d0/d9/d15/d2d 0 2024-08-01T06:56:00.431 INFO:tasks.workunit.client.1.smithi089.stdout:3/393: fsync d7/f71 0 2024-08-01T06:56:00.433 INFO:tasks.workunit.client.1.smithi089.stdout:5/535: link d5/l7c d5/de/d57/db0/lb8 0 2024-08-01T06:56:00.441 INFO:tasks.workunit.client.1.smithi089.stdout:9/515: dread d18/d33/d49/f6c [0,4194304] 0 2024-08-01T06:56:00.442 INFO:tasks.workunit.client.1.smithi089.stdout:7/512: symlink d7/d1f/da6/la7 0 2024-08-01T06:56:00.442 INFO:tasks.workunit.client.1.smithi089.stdout:2/478: dwrite d7/d19/d3b/f95 [0,4194304] 0 2024-08-01T06:56:00.442 INFO:tasks.workunit.client.1.smithi089.stdout:1/577: rmdir d0/d9/d15/d2d/d4a 39 2024-08-01T06:56:00.443 INFO:tasks.workunit.client.1.smithi089.stdout:3/394: symlink d7/d32/d4c/d53/d65/l79 0 2024-08-01T06:56:00.445 INFO:tasks.workunit.client.1.smithi089.stdout:4/577: dwrite d3/d68/f7f [0,4194304] 0 2024-08-01T06:56:00.446 INFO:tasks.workunit.client.1.smithi089.stdout:6/627: creat d2/d11/d1f/d46/d6b/d7d/dc9/fd9 x:0 0 0 2024-08-01T06:56:00.447 INFO:tasks.workunit.client.1.smithi089.stdout:8/530: write d5/dc/d1e/f9f [386555,36915] 0 2024-08-01T06:56:00.447 INFO:tasks.workunit.client.1.smithi089.stdout:5/536: mknod d5/de/d10/d16/d1b/d52/d5d/d6c/d8b/cb9 0 2024-08-01T06:56:00.448 INFO:tasks.workunit.client.1.smithi089.stdout:4/578: stat d3/d1f/d62/d31/c7d 0 2024-08-01T06:56:00.450 INFO:tasks.workunit.client.1.smithi089.stdout:6/628: fdatasync d2/d11/d1f/d46/fd4 0 2024-08-01T06:56:00.454 INFO:tasks.workunit.client.1.smithi089.stdout:8/531: creat d5/d15/d5a/fb4 x:0 0 0 2024-08-01T06:56:00.454 INFO:tasks.workunit.client.1.smithi089.stdout:3/395: read d7/d32/d4c/d69/f56 [384747,67690] 0 2024-08-01T06:56:00.455 INFO:tasks.workunit.client.1.smithi089.stdout:2/479: dread d7/d1f/f6c [0,4194304] 0 2024-08-01T06:56:00.457 INFO:tasks.workunit.client.1.smithi089.stdout:5/537: mkdir d5/de/d57/d8e/d97/da5/dba 0 2024-08-01T06:56:00.460 INFO:tasks.workunit.client.1.smithi089.stdout:7/513: dwrite d7/df/d10/f24 [0,4194304] 0 2024-08-01T06:56:00.461 INFO:tasks.workunit.client.1.smithi089.stdout:8/532: getdents d5/d9e 0 2024-08-01T06:56:00.462 INFO:tasks.workunit.client.1.smithi089.stdout:2/480: truncate d7/d1f/f4b 4394405 0 2024-08-01T06:56:00.464 INFO:tasks.workunit.client.1.smithi089.stdout:1/578: dwrite d0/d9/f30 [0,4194304] 0 2024-08-01T06:56:00.464 INFO:tasks.workunit.client.1.smithi089.stdout:3/396: creat d7/d32/d4c/f7a x:0 0 0 2024-08-01T06:56:00.466 INFO:tasks.workunit.client.1.smithi089.stdout:2/481: readlink d7/d1f/d28/l2c 0 2024-08-01T06:56:00.466 INFO:tasks.workunit.client.1.smithi089.stdout:5/538: rmdir d5/de/d10/d33/d5e/d7e/d9e 39 2024-08-01T06:56:00.466 INFO:tasks.workunit.client.1.smithi089.stdout:9/516: dwrite d18/d33/d53/f5e [0,4194304] 0 2024-08-01T06:56:00.466 INFO:tasks.workunit.client.1.smithi089.stdout:7/514: chown d7/df/d10/d42/c81 4942 1 2024-08-01T06:56:00.467 INFO:tasks.workunit.client.1.smithi089.stdout:2/482: rmdir d7 39 2024-08-01T06:56:00.471 INFO:tasks.workunit.client.1.smithi089.stdout:1/579: stat d0/d9/d15/d3b/d95/fa1 0 2024-08-01T06:56:00.472 INFO:tasks.workunit.client.1.smithi089.stdout:7/515: chown d7/df/d10/f35 12347552 1 2024-08-01T06:56:00.473 INFO:tasks.workunit.client.1.smithi089.stdout:3/397: symlink d7/d32/d12/d29/d39/l7b 0 2024-08-01T06:56:00.474 INFO:tasks.workunit.client.1.smithi089.stdout:5/539: write d5/de/d10/d16/d1b/d25/f70 [20591,22283] 0 2024-08-01T06:56:00.474 INFO:tasks.workunit.client.1.smithi089.stdout:9/517: symlink d18/d33/d49/d7b/d81/d9c/la0 0 2024-08-01T06:56:00.475 INFO:tasks.workunit.client.1.smithi089.stdout:1/580: write d0/f20 [686847,105349] 0 2024-08-01T06:56:00.476 INFO:tasks.workunit.client.1.smithi089.stdout:9/518: truncate d18/f7e 901766 0 2024-08-01T06:56:00.477 INFO:tasks.workunit.client.1.smithi089.stdout:8/533: link d5/d15/d5a/d73/d87/fa9 d5/dc/d1e/fb5 0 2024-08-01T06:56:00.478 INFO:tasks.workunit.client.1.smithi089.stdout:2/483: creat d7/d1f/d52/d6e/f9d x:0 0 0 2024-08-01T06:56:00.480 INFO:tasks.workunit.client.1.smithi089.stdout:9/519: write f13 [1391931,39855] 0 2024-08-01T06:56:00.480 INFO:tasks.workunit.client.1.smithi089.stdout:7/516: rename d7/d1f/d30/l61 to d7/df/d10/d31/d43/la8 0 2024-08-01T06:56:00.483 INFO:tasks.workunit.client.1.smithi089.stdout:4/579: truncate d3/d1e/f6e 1216516 0 2024-08-01T06:56:00.483 INFO:tasks.workunit.client.1.smithi089.stdout:3/398: mknod d7/d32/d12/d29/c7c 0 2024-08-01T06:56:00.484 INFO:tasks.workunit.client.1.smithi089.stdout:8/534: truncate d5/dc/f37 5104041 0 2024-08-01T06:56:00.484 INFO:tasks.workunit.client.1.smithi089.stdout:2/484: fdatasync d7/d1f/f4b 0 2024-08-01T06:56:00.485 INFO:tasks.workunit.client.1.smithi089.stdout:1/581: creat d0/d9/d43/d4b/db0/fbd x:0 0 0 2024-08-01T06:56:00.489 INFO:tasks.workunit.client.1.smithi089.stdout:5/540: dwrite d5/de/d10/d16/d1b/d25/f68 [0,4194304] 0 2024-08-01T06:56:00.498 INFO:tasks.workunit.client.1.smithi089.stdout:2/485: write d7/d19/d3b/f50 [2359371,121622] 0 2024-08-01T06:56:00.498 INFO:tasks.workunit.client.1.smithi089.stdout:8/535: creat d5/d15/d5a/d73/d87/fb6 x:0 0 0 2024-08-01T06:56:00.499 INFO:tasks.workunit.client.1.smithi089.stdout:7/517: dwrite d7/d1f/d30/f6a [0,4194304] 0 2024-08-01T06:56:00.500 INFO:tasks.workunit.client.1.smithi089.stdout:9/520: dwrite d18/d22/f9d [0,4194304] 0 2024-08-01T06:56:00.502 INFO:tasks.workunit.client.1.smithi089.stdout:1/582: symlink d0/d9/d15/d3b/d95/lbe 0 2024-08-01T06:56:00.502 INFO:tasks.workunit.client.1.smithi089.stdout:5/541: rmdir d5/de/d10/d16/d1b/d52/d5d/d6c/d98 39 2024-08-01T06:56:00.506 INFO:tasks.workunit.client.1.smithi089.stdout:8/536: mknod d5/cb7 0 2024-08-01T06:56:00.507 INFO:tasks.workunit.client.1.smithi089.stdout:1/583: chown d0/d9/d15/d2d/l45 0 1 2024-08-01T06:56:00.508 INFO:tasks.workunit.client.1.smithi089.stdout:3/399: link d7/d68/d50/d6f/l28 d7/d32/d4c/l7d 0 2024-08-01T06:56:00.509 INFO:tasks.workunit.client.1.smithi089.stdout:5/542: write d5/de/d10/d16/d1b/d25/fa7 [867202,102074] 0 2024-08-01T06:56:00.510 INFO:tasks.workunit.client.1.smithi089.stdout:7/518: creat d7/d46/d7b/fa9 x:0 0 0 2024-08-01T06:56:00.511 INFO:tasks.workunit.client.1.smithi089.stdout:9/521: truncate f8 661340 0 2024-08-01T06:56:00.512 INFO:tasks.workunit.client.1.smithi089.stdout:4/580: dwrite d3/d1e/f58 [4194304,4194304] 0 2024-08-01T06:56:00.513 INFO:tasks.workunit.client.1.smithi089.stdout:9/522: fsync d18/d33/f61 0 2024-08-01T06:56:00.514 INFO:tasks.workunit.client.1.smithi089.stdout:9/523: dread - d18/d22/d52/f54 zero size 2024-08-01T06:56:00.515 INFO:tasks.workunit.client.1.smithi089.stdout:5/543: mknod d5/d13/cbb 0 2024-08-01T06:56:00.516 INFO:tasks.workunit.client.1.smithi089.stdout:7/519: fsync d7/d15/f87 0 2024-08-01T06:56:00.517 INFO:tasks.workunit.client.1.smithi089.stdout:5/544: readlink d5/d13/l48 0 2024-08-01T06:56:00.517 INFO:tasks.workunit.client.1.smithi089.stdout:3/400: truncate d7/d32/f2d 2660980 0 2024-08-01T06:56:00.520 INFO:tasks.workunit.client.1.smithi089.stdout:3/401: fsync d7/d32/d12/d1b/f4a 0 2024-08-01T06:56:00.521 INFO:tasks.workunit.client.1.smithi089.stdout:1/584: getdents d0/d9/d15/d2b/d7d 0 2024-08-01T06:56:00.522 INFO:tasks.workunit.client.1.smithi089.stdout:4/581: truncate d3/d1f/d62/d31/f4b 699778 0 2024-08-01T06:56:00.523 INFO:tasks.workunit.client.1.smithi089.stdout:5/545: creat d5/d13/d43/fbc x:0 0 0 2024-08-01T06:56:00.525 INFO:tasks.workunit.client.1.smithi089.stdout:5/546: chown f0 4935 1 2024-08-01T06:56:00.526 INFO:tasks.workunit.client.1.smithi089.stdout:4/582: symlink d3/d1e/lab 0 2024-08-01T06:56:00.527 INFO:tasks.workunit.client.1.smithi089.stdout:4/583: chown d3/d68 1564801443 1 2024-08-01T06:56:00.527 INFO:tasks.workunit.client.1.smithi089.stdout:9/524: dwrite d18/d33/d3b/f69 [0,4194304] 0 2024-08-01T06:56:00.528 INFO:tasks.workunit.client.1.smithi089.stdout:1/585: creat d0/d9/d15/d2b/d7d/fbf x:0 0 0 2024-08-01T06:56:00.531 INFO:tasks.workunit.client.1.smithi089.stdout:4/584: readlink d3/d17/d3a/l69 0 2024-08-01T06:56:00.533 INFO:tasks.workunit.client.1.smithi089.stdout:1/586: chown d0/d9/d15/d7a/c8c 243953611 1 2024-08-01T06:56:00.536 INFO:tasks.workunit.client.1.smithi089.stdout:5/547: fsync d5/de/d10/d16/d1b/d52/d5d/d6c/f81 0 2024-08-01T06:56:00.538 INFO:tasks.workunit.client.1.smithi089.stdout:4/585: creat d3/d17/d3a/d3d/fac x:0 0 0 2024-08-01T06:56:00.539 INFO:tasks.workunit.client.1.smithi089.stdout:3/402: dread d7/d32/d4c/d69/f56 [0,4194304] 0 2024-08-01T06:56:00.541 INFO:tasks.workunit.client.1.smithi089.stdout:4/586: chown d3/db/de/c9f 30961 1 2024-08-01T06:56:00.541 INFO:tasks.workunit.client.1.smithi089.stdout:5/548: mkdir d5/de/df/d9f/dbd 0 2024-08-01T06:56:00.548 INFO:tasks.workunit.client.1.smithi089.stdout:9/525: dwrite d18/d22/d43/f5f [4194304,4194304] 0 2024-08-01T06:56:00.548 INFO:tasks.workunit.client.1.smithi089.stdout:1/587: link d0/d9/d15/d2d/f53 d0/d9/d15/d3b/d3d/fc0 0 2024-08-01T06:56:00.548 INFO:tasks.workunit.client.1.smithi089.stdout:8/537: dread d5/dc/f70 [0,4194304] 0 2024-08-01T06:56:00.552 INFO:tasks.workunit.client.1.smithi089.stdout:4/587: symlink d3/d68/lad 0 2024-08-01T06:56:00.552 INFO:tasks.workunit.client.1.smithi089.stdout:3/403: rmdir d7/d68/d50/d6f/d46 39 2024-08-01T06:56:00.553 INFO:tasks.workunit.client.1.smithi089.stdout:8/538: chown d5/dc/d1e/fb5 81050390 1 2024-08-01T06:56:00.553 INFO:tasks.workunit.client.1.smithi089.stdout:3/404: readlink d7/d32/d12/d29/l76 0 2024-08-01T06:56:00.555 INFO:tasks.workunit.client.1.smithi089.stdout:5/549: rename d5/de/d10/d16/d1b/d52/d5f/l86 to d5/d13/d83/lbe 0 2024-08-01T06:56:00.556 INFO:tasks.workunit.client.1.smithi089.stdout:7/520: dread d7/df/d91/da4/f37 [0,4194304] 0 2024-08-01T06:56:00.556 INFO:tasks.workunit.client.1.smithi089.stdout:9/526: creat d18/d33/d49/d7b/d7f/d98/d9f/d8e/fa1 x:0 0 0 2024-08-01T06:56:00.560 INFO:tasks.workunit.client.1.smithi089.stdout:9/527: mkdir d18/d22/da2 0 2024-08-01T06:56:00.561 INFO:tasks.workunit.client.1.smithi089.stdout:4/588: dwrite d3/d1f/d62/d3b/f8d [0,4194304] 0 2024-08-01T06:56:00.563 INFO:tasks.workunit.client.1.smithi089.stdout:5/550: read d5/f3c [198076,72077] 0 2024-08-01T06:56:00.564 INFO:tasks.workunit.client.1.smithi089.stdout:5/551: stat d5/de/d57/d8e 0 2024-08-01T06:56:00.565 INFO:tasks.workunit.client.1.smithi089.stdout:1/588: link d0/d9/d15/d3b/d95/d49/f8d d0/d9/d15/d2d/fc1 0 2024-08-01T06:56:00.566 INFO:tasks.workunit.client.1.smithi089.stdout:7/521: dread d7/df/d10/f35 [0,4194304] 0 2024-08-01T06:56:00.567 INFO:tasks.workunit.client.1.smithi089.stdout:7/522: stat d7/d15 0 2024-08-01T06:56:00.571 INFO:tasks.workunit.client.1.smithi089.stdout:9/528: rename d18/d33/d49/d7b/d7f/d98/d9f/l80 to d18/d33/d49/d7b/d7f/d98/d9f/la3 0 2024-08-01T06:56:00.571 INFO:tasks.workunit.client.1.smithi089.stdout:1/589: dread d0/d9/d15/d76/f88 [0,4194304] 0 2024-08-01T06:56:00.573 INFO:tasks.workunit.client.1.smithi089.stdout:3/405: truncate d7/d32/d4c/d69/f2e 406674 0 2024-08-01T06:56:00.575 INFO:tasks.workunit.client.1.smithi089.stdout:4/589: dwrite d3/d86/d9e/f41 [4194304,4194304] 0 2024-08-01T06:56:00.575 INFO:tasks.workunit.client.1.smithi089.stdout:1/590: creat d0/fc2 x:0 0 0 2024-08-01T06:56:00.577 INFO:tasks.workunit.client.1.smithi089.stdout:9/529: mkdir d18/da4 0 2024-08-01T06:56:00.579 INFO:tasks.workunit.client.1.smithi089.stdout:3/406: chown d7/c19 7 1 2024-08-01T06:56:00.579 INFO:tasks.workunit.client.1.smithi089.stdout:5/552: dwrite d5/f73 [0,4194304] 0 2024-08-01T06:56:00.579 INFO:tasks.workunit.client.1.smithi089.stdout:7/523: link d7/df/d10/c12 d7/df/d10/d42/d75/caa 0 2024-08-01T06:56:00.586 INFO:tasks.workunit.client.1.smithi089.stdout:8/539: dwrite d5/dc/d1e/fb5 [0,4194304] 0 2024-08-01T06:56:00.588 INFO:tasks.workunit.client.1.smithi089.stdout:1/591: dread - d0/d9/d15/d3b/d3d/d77/d8f/f90 zero size 2024-08-01T06:56:00.590 INFO:tasks.workunit.client.1.smithi089.stdout:9/530: mknod d18/d33/d49/d7b/ca5 0 2024-08-01T06:56:00.591 INFO:tasks.workunit.client.1.smithi089.stdout:7/524: mkdir d7/d1f/d30/dab 0 2024-08-01T06:56:00.593 INFO:tasks.workunit.client.1.smithi089.stdout:8/540: unlink d5/d23/c26 0 2024-08-01T06:56:00.594 INFO:tasks.workunit.client.1.smithi089.stdout:3/407: dwrite d7/d32/f4e [0,4194304] 0 2024-08-01T06:56:00.634 INFO:tasks.workunit.client.1.smithi089.stdout:4/590: getdents d3/d1f/d62 0 2024-08-01T06:56:00.634 INFO:tasks.workunit.client.1.smithi089.stdout:9/531: fdatasync ff 0 2024-08-01T06:56:00.636 INFO:tasks.workunit.client.1.smithi089.stdout:3/408: symlink d7/d32/d12/d29/l7e 0 2024-08-01T06:56:00.636 INFO:tasks.workunit.client.1.smithi089.stdout:1/592: dwrite d0/d9/d15/d76/f80 [4194304,4194304] 0 2024-08-01T06:56:00.637 INFO:tasks.workunit.client.1.smithi089.stdout:4/591: creat d3/d17/d3a/d3d/fae x:0 0 0 2024-08-01T06:56:00.715 INFO:tasks.workunit.client.1.smithi089.stdout:8/541: rename d5/dc/d1e/l2a to d5/d23/d91/lb8 0 2024-08-01T06:56:00.716 INFO:tasks.workunit.client.1.smithi089.stdout:1/593: chown d0/d9/fad 32219 1 2024-08-01T06:56:00.717 INFO:tasks.workunit.client.1.smithi089.stdout:9/532: mkdir d18/d33/d49/d7b/d55/da6 0 2024-08-01T06:56:00.718 INFO:tasks.workunit.client.1.smithi089.stdout:4/592: read d3/d1f/d62/f64 [3974874,110718] 0 2024-08-01T06:56:00.719 INFO:tasks.workunit.client.1.smithi089.stdout:9/533: write d18/f6b [1887111,6648] 0 2024-08-01T06:56:00.721 INFO:tasks.workunit.client.1.smithi089.stdout:7/525: dwrite d7/df/d3b/f58 [0,4194304] 0 2024-08-01T06:56:00.722 INFO:tasks.workunit.client.1.smithi089.stdout:8/542: mkdir d5/dc/d12/db9 0 2024-08-01T06:56:00.723 INFO:tasks.workunit.client.1.smithi089.stdout:1/594: mkdir d0/d9/d15/d3b/d95/d49/d82/da6/dc3 0 2024-08-01T06:56:00.726 INFO:tasks.workunit.client.1.smithi089.stdout:7/526: getdents d7/d1f/d30/dab 0 2024-08-01T06:56:00.727 INFO:tasks.workunit.client.1.smithi089.stdout:8/543: mkdir d5/dc/d12/d92/dba 0 2024-08-01T06:56:00.731 INFO:tasks.workunit.client.1.smithi089.stdout:8/544: creat d5/d23/fbb x:0 0 0 2024-08-01T06:56:00.734 INFO:tasks.workunit.client.1.smithi089.stdout:4/593: dwrite d3/d17/d3a/f54 [0,4194304] 0 2024-08-01T06:56:00.735 INFO:tasks.workunit.client.1.smithi089.stdout:7/527: rename d7/d1f/d3a/f7e to d7/df/d91/da4/fac 0 2024-08-01T06:56:00.737 INFO:tasks.workunit.client.1.smithi089.stdout:9/534: dwrite d18/d22/d43/f5f [8388608,4194304] 0 2024-08-01T06:56:00.737 INFO:tasks.workunit.client.1.smithi089.stdout:3/409: dwrite d7/d32/d4c/d69/f62 [4194304,4194304] 0 2024-08-01T06:56:00.741 INFO:tasks.workunit.client.1.smithi089.stdout:8/545: creat d5/dc/d12/fbc x:0 0 0 2024-08-01T06:56:00.742 INFO:tasks.workunit.client.1.smithi089.stdout:7/528: mkdir d7/d1f/d3a/dad 0 2024-08-01T06:56:00.743 INFO:tasks.workunit.client.1.smithi089.stdout:9/535: rename d18/d22/f38 to d18/d33/d49/d7b/d7f/d98/d9f/d8e/fa7 0 2024-08-01T06:56:00.749 INFO:tasks.workunit.client.1.smithi089.stdout:9/536: rename d18/d33 to d18/d33/d49/d7b/d55/da8 22 2024-08-01T06:56:00.749 INFO:tasks.workunit.client.1.smithi089.stdout:4/594: dwrite d3/d1e/f40 [4194304,4194304] 0 2024-08-01T06:56:00.752 INFO:tasks.workunit.client.1.smithi089.stdout:9/537: stat d18/d33/d53/f5e 0 2024-08-01T06:56:00.757 INFO:tasks.workunit.client.1.smithi089.stdout:7/529: dwrite d7/d1f/d30/f6a [4194304,4194304] 0 2024-08-01T06:56:00.759 INFO:tasks.workunit.client.1.smithi089.stdout:8/546: dwrite d5/dc/fa1 [0,4194304] 0 2024-08-01T06:56:00.763 INFO:tasks.workunit.client.1.smithi089.stdout:7/530: rmdir d7/d1f 39 2024-08-01T06:56:00.764 INFO:tasks.workunit.client.1.smithi089.stdout:3/410: dread d7/d32/d12/f41 [0,4194304] 0 2024-08-01T06:56:00.765 INFO:tasks.workunit.client.1.smithi089.stdout:4/595: fsync d3/db/d33/f6f 0 2024-08-01T06:56:00.766 INFO:tasks.workunit.client.1.smithi089.stdout:7/531: chown d7/df/d10/c12 42 1 2024-08-01T06:56:00.768 INFO:tasks.workunit.client.1.smithi089.stdout:7/532: chown d7/df/l32 15079811 1 2024-08-01T06:56:00.768 INFO:tasks.workunit.client.1.smithi089.stdout:9/538: dwrite d18/d33/d3b/f3c [0,4194304] 0 2024-08-01T06:56:00.773 INFO:tasks.workunit.client.1.smithi089.stdout:4/596: creat d3/d1f/faf x:0 0 0 2024-08-01T06:56:00.775 INFO:tasks.workunit.client.1.smithi089.stdout:8/547: rename d5/dc/d94/f2e to d5/d15/d5a/d73/daa/fbd 0 2024-08-01T06:56:00.775 INFO:tasks.workunit.client.1.smithi089.stdout:9/539: fdatasync d18/d33/d49/d7b/d7f/d98/d9f/d8e/fa7 0 2024-08-01T06:56:00.780 INFO:tasks.workunit.client.1.smithi089.stdout:3/411: dwrite d7/d32/d12/d1b/f51 [0,4194304] 0 2024-08-01T06:56:00.782 INFO:tasks.workunit.client.1.smithi089.stdout:3/412: rename d7/d32/d4c to d7/d32/d4c/d67/d7f 22 2024-08-01T06:56:00.783 INFO:tasks.workunit.client.1.smithi089.stdout:9/540: link f13 d18/da4/fa9 0 2024-08-01T06:56:00.783 INFO:tasks.workunit.client.1.smithi089.stdout:4/597: link d3/d1f/d62/d3b/f8d d3/db/de/d5b/fb0 0 2024-08-01T06:56:00.785 INFO:tasks.workunit.client.1.smithi089.stdout:3/413: creat d7/d32/d4c/d67/f80 x:0 0 0 2024-08-01T06:56:00.787 INFO:tasks.workunit.client.1.smithi089.stdout:4/598: mkdir d3/d86/d9e/db1 0 2024-08-01T06:56:00.788 INFO:tasks.workunit.client.1.smithi089.stdout:3/414: rmdir d7/d32/d4c/d69 39 2024-08-01T06:56:00.796 INFO:tasks.workunit.client.1.smithi089.stdout:7/533: dwrite d7/df/d91/da4/f37 [0,4194304] 0 2024-08-01T06:56:00.797 INFO:tasks.workunit.client.1.smithi089.stdout:8/548: truncate d5/d23/f36 592394 0 2024-08-01T06:56:00.800 INFO:tasks.workunit.client.1.smithi089.stdout:7/534: truncate d7/df/d91/da4/f47 443048 0 2024-08-01T06:56:00.803 INFO:tasks.workunit.client.1.smithi089.stdout:7/535: mknod d7/cae 0 2024-08-01T06:56:00.804 INFO:tasks.workunit.client.1.smithi089.stdout:3/415: dread d7/d32/d12/d1b/f26 [0,4194304] 0 2024-08-01T06:56:00.804 INFO:tasks.workunit.client.1.smithi089.stdout:7/536: chown d7/df/d10/d31/c78 1303454155 1 2024-08-01T06:56:00.811 INFO:tasks.workunit.client.1.smithi089.stdout:7/537: creat d7/faf x:0 0 0 2024-08-01T06:56:00.813 INFO:tasks.workunit.client.1.smithi089.stdout:8/549: dwrite d5/d15/f83 [0,4194304] 0 2024-08-01T06:56:00.814 INFO:tasks.workunit.client.1.smithi089.stdout:8/550: chown d5/c1d 30 1 2024-08-01T06:56:00.817 INFO:tasks.workunit.client.1.smithi089.stdout:7/538: getdents d7/df/d3b 0 2024-08-01T06:56:00.819 INFO:tasks.workunit.client.1.smithi089.stdout:3/416: dwrite d7/d32/d4c/d69/f56 [0,4194304] 0 2024-08-01T06:56:00.820 INFO:tasks.workunit.client.1.smithi089.stdout:8/551: creat d5/d15/d5a/d73/daa/fbe x:0 0 0 2024-08-01T06:56:00.822 INFO:tasks.workunit.client.1.smithi089.stdout:7/539: chown d7/d1f/da6 10 1 2024-08-01T06:56:00.822 INFO:tasks.workunit.client.1.smithi089.stdout:8/552: write d5/d15/d5a/d73/daa/fbe [239984,53331] 0 2024-08-01T06:56:00.825 INFO:tasks.workunit.client.1.smithi089.stdout:3/417: mkdir d7/d68/d50/d6f/d46/d47/d81 0 2024-08-01T06:56:00.832 INFO:tasks.workunit.client.1.smithi089.stdout:3/418: dwrite d7/d32/d12/d1b/f51 [0,4194304] 0 2024-08-01T06:56:00.833 INFO:tasks.workunit.client.1.smithi089.stdout:3/419: chown d7/d32/d12 382100 1 2024-08-01T06:56:00.836 INFO:tasks.workunit.client.1.smithi089.stdout:3/420: rename d7/d32/d4c/d67/f80 to d7/d68/d3d/f82 0 2024-08-01T06:56:00.839 INFO:tasks.workunit.client.1.smithi089.stdout:7/540: write d7/df/d10/f35 [1625224,22146] 0 2024-08-01T06:56:00.839 INFO:tasks.workunit.client.1.smithi089.stdout:3/421: chown d7/d32/d4c/d67/d72/l75 194865 1 2024-08-01T06:56:00.840 INFO:tasks.workunit.client.1.smithi089.stdout:8/553: dread d5/dc/d1e/d53/f5c [0,4194304] 0 2024-08-01T06:56:00.840 INFO:tasks.workunit.client.1.smithi089.stdout:7/541: write d7/fb [2766357,20120] 0 2024-08-01T06:56:00.842 INFO:tasks.workunit.client.1.smithi089.stdout:7/542: stat d7/d1f/d3a/c95 0 2024-08-01T06:56:00.843 INFO:tasks.workunit.client.1.smithi089.stdout:7/543: chown d7/d1f/f7a 0 1 2024-08-01T06:56:00.844 INFO:tasks.workunit.client.1.smithi089.stdout:7/544: dread - d7/df/d91/da4/fa0 zero size 2024-08-01T06:56:00.846 INFO:tasks.workunit.client.1.smithi089.stdout:7/545: getdents d7/df/d91 0 2024-08-01T06:56:00.849 INFO:tasks.workunit.client.1.smithi089.stdout:8/554: truncate d5/dc/d1e/d53/f5c 2307503 0 2024-08-01T06:56:00.852 INFO:tasks.workunit.client.1.smithi089.stdout:8/555: getdents d5/d23/d91 0 2024-08-01T06:56:00.853 INFO:tasks.workunit.client.1.smithi089.stdout:3/422: dwrite d7/d32/d4c/d69/f1a [0,4194304] 0 2024-08-01T06:56:00.853 INFO:tasks.workunit.client.1.smithi089.stdout:8/556: chown d5/c6f 1700 1 2024-08-01T06:56:00.855 INFO:tasks.workunit.client.1.smithi089.stdout:3/423: truncate d7/d32/d4c/d69/f20 9243044 0 2024-08-01T06:56:00.855 INFO:tasks.workunit.client.1.smithi089.stdout:8/557: fsync d5/d15/d5a/f68 0 2024-08-01T06:56:00.859 INFO:tasks.workunit.client.1.smithi089.stdout:7/546: dread d7/d15/f2d [0,4194304] 0 2024-08-01T06:56:00.861 INFO:tasks.workunit.client.1.smithi089.stdout:7/547: write d7/df/d10/d31/d43/f88 [664464,2394] 0 2024-08-01T06:56:00.861 INFO:tasks.workunit.client.1.smithi089.stdout:8/558: mkdir d5/d15/d5a/d73/d87/dbf 0 2024-08-01T06:56:00.862 INFO:tasks.workunit.client.1.smithi089.stdout:7/548: chown d7/df/d10/f24 4109651 1 2024-08-01T06:56:00.862 INFO:tasks.workunit.client.1.smithi089.stdout:7/549: fdatasync d7/fb 0 2024-08-01T06:56:00.863 INFO:tasks.workunit.client.1.smithi089.stdout:8/559: chown d5/dc/d12/d92/lb1 1337 1 2024-08-01T06:56:00.865 INFO:tasks.workunit.client.1.smithi089.stdout:7/550: truncate d7/df/d10/d42/d4e/f96 646943 0 2024-08-01T06:56:00.865 INFO:tasks.workunit.client.1.smithi089.stdout:3/424: mkdir d7/d32/d12/d29/d39/d4b/d83 0 2024-08-01T06:56:00.868 INFO:tasks.workunit.client.1.smithi089.stdout:8/560: rename d5/dc/d12/laf to d5/dc/d1e/d53/lc0 0 2024-08-01T06:56:00.870 INFO:tasks.workunit.client.1.smithi089.stdout:7/551: link d7/d15/f3c d7/df/d10/d31/d4a/fb0 0 2024-08-01T06:56:00.871 INFO:tasks.workunit.client.1.smithi089.stdout:8/561: mknod d5/dc/cc1 0 2024-08-01T06:56:00.872 INFO:tasks.workunit.client.1.smithi089.stdout:7/552: mkdir d7/d1f/d30/db1 0 2024-08-01T06:56:00.872 INFO:tasks.workunit.client.1.smithi089.stdout:3/425: link d7/d32/l1e d7/d68/d50/d6f/d46/l84 0 2024-08-01T06:56:00.873 INFO:tasks.workunit.client.1.smithi089.stdout:7/553: chown d7/df/d10/d42/d75/c9c 43389259 1 2024-08-01T06:56:00.873 INFO:tasks.workunit.client.1.smithi089.stdout:7/554: fdatasync d7/fb 0 2024-08-01T06:56:00.874 INFO:tasks.workunit.client.1.smithi089.stdout:8/562: chown d5/dc/d94/f55 2468538 1 2024-08-01T06:56:00.875 INFO:tasks.workunit.client.1.smithi089.stdout:3/426: unlink d7/d68/d50/d6f/d2f/f48 0 2024-08-01T06:56:00.876 INFO:tasks.workunit.client.1.smithi089.stdout:3/427: rmdir d7/d32 39 2024-08-01T06:56:00.877 INFO:tasks.workunit.client.1.smithi089.stdout:7/555: creat d7/d1f/d3a/dad/fb2 x:0 0 0 2024-08-01T06:56:00.878 INFO:tasks.workunit.client.1.smithi089.stdout:8/563: link d5/f25 d5/d15/d5a/d73/d87/dbf/fc2 0 2024-08-01T06:56:00.880 INFO:tasks.workunit.client.1.smithi089.stdout:8/564: fsync d5/dc/d1e/f47 0 2024-08-01T06:56:00.883 INFO:tasks.workunit.client.1.smithi089.stdout:3/428: creat d7/d32/d4c/f85 x:0 0 0 2024-08-01T06:56:00.884 INFO:tasks.workunit.client.1.smithi089.stdout:7/556: dwrite d7/d15/f8f [0,4194304] 0 2024-08-01T06:56:00.887 INFO:tasks.workunit.client.1.smithi089.stdout:7/557: truncate d7/d1f/d3a/f9d 504674 0 2024-08-01T06:56:00.889 INFO:tasks.workunit.client.1.smithi089.stdout:8/565: dwrite d5/dc/d1e/fb5 [0,4194304] 0 2024-08-01T06:56:00.889 INFO:tasks.workunit.client.1.smithi089.stdout:3/429: link d7/d32/l1c d7/d68/d50/d54/l86 0 2024-08-01T06:56:00.893 INFO:tasks.workunit.client.1.smithi089.stdout:8/566: read - d5/dc/f52 zero size 2024-08-01T06:56:00.895 INFO:tasks.workunit.client.1.smithi089.stdout:8/567: read - d5/d15/d5a/f98 zero size 2024-08-01T06:56:00.897 INFO:tasks.workunit.client.1.smithi089.stdout:7/558: dwrite d7/df/f82 [0,4194304] 0 2024-08-01T06:56:00.900 INFO:tasks.workunit.client.1.smithi089.stdout:8/568: write d5/d15/d5a/d73/d87/f9a [1438664,127965] 0 2024-08-01T06:56:00.901 INFO:tasks.workunit.client.1.smithi089.stdout:3/430: dwrite d7/d68/d50/d6f/f58 [8388608,4194304] 0 2024-08-01T06:56:00.901 INFO:tasks.workunit.client.1.smithi089.stdout:7/559: write d7/df/f11 [3896860,52769] 0 2024-08-01T06:56:00.903 INFO:tasks.workunit.client.1.smithi089.stdout:8/569: stat d5/dc/d1e/fb5 0 2024-08-01T06:56:00.904 INFO:tasks.workunit.client.1.smithi089.stdout:8/570: chown d5 360863601 1 2024-08-01T06:56:00.904 INFO:tasks.workunit.client.1.smithi089.stdout:7/560: stat d7/df/d10/d42/d75 0 2024-08-01T06:56:00.905 INFO:tasks.workunit.client.1.smithi089.stdout:3/431: rmdir d7/d68 39 2024-08-01T06:56:00.907 INFO:tasks.workunit.client.1.smithi089.stdout:8/571: rmdir d5/d23/d91 39 2024-08-01T06:56:00.908 INFO:tasks.workunit.client.1.smithi089.stdout:7/561: mkdir d7/df/d10/db3 0 2024-08-01T06:56:00.909 INFO:tasks.workunit.client.1.smithi089.stdout:3/432: write d7/d32/d12/d1b/f3c [1030078,98062] 0 2024-08-01T06:56:00.910 INFO:tasks.workunit.client.1.smithi089.stdout:8/572: write d5/dc/f97 [865318,51506] 0 2024-08-01T06:56:00.911 INFO:tasks.workunit.client.1.smithi089.stdout:7/562: dread - d7/df/d10/d42/f9e zero size 2024-08-01T06:56:00.915 INFO:tasks.workunit.client.1.smithi089.stdout:3/433: rename d7/d68/d3d/f82 to d7/d68/d50/d54/f87 0 2024-08-01T06:56:00.916 INFO:tasks.workunit.client.1.smithi089.stdout:8/573: mkdir d5/d23/dc3 0 2024-08-01T06:56:00.920 INFO:tasks.workunit.client.1.smithi089.stdout:7/563: dwrite d7/d1f/f3f [0,4194304] 0 2024-08-01T06:56:00.920 INFO:tasks.workunit.client.1.smithi089.stdout:8/574: write d5/dc/f16 [2312388,4117] 0 2024-08-01T06:56:00.923 INFO:tasks.workunit.client.1.smithi089.stdout:7/564: creat d7/df/d10/fb4 x:0 0 0 2024-08-01T06:56:00.925 INFO:tasks.workunit.client.1.smithi089.stdout:3/434: dwrite d7/d32/f4e [0,4194304] 0 2024-08-01T06:56:00.926 INFO:tasks.workunit.client.1.smithi089.stdout:3/435: fdatasync d7/f71 0 2024-08-01T06:56:00.927 INFO:tasks.workunit.client.1.smithi089.stdout:7/565: creat d7/df/d91/fb5 x:0 0 0 2024-08-01T06:56:00.928 INFO:tasks.workunit.client.1.smithi089.stdout:3/436: write d7/d32/d12/d29/d39/f6c [938963,122366] 0 2024-08-01T06:56:00.929 INFO:tasks.workunit.client.1.smithi089.stdout:8/575: dread d5/dc/d12/f40 [0,4194304] 0 2024-08-01T06:56:00.934 INFO:tasks.workunit.client.1.smithi089.stdout:8/576: dread d5/dc/d1e/f9f [0,4194304] 0 2024-08-01T06:56:00.934 INFO:tasks.workunit.client.1.smithi089.stdout:7/566: dwrite d7/fb [0,4194304] 0 2024-08-01T06:56:00.938 INFO:tasks.workunit.client.1.smithi089.stdout:8/577: fdatasync d5/dc/f70 0 2024-08-01T06:56:00.938 INFO:tasks.workunit.client.1.smithi089.stdout:7/567: write d7/df/d91/da4/f5f [3777752,125124] 0 2024-08-01T06:56:00.939 INFO:tasks.workunit.client.1.smithi089.stdout:3/437: link d7/d68/d50/d6f/d2f/c52 d7/d32/d4c/d67/d72/c88 0 2024-08-01T06:56:00.940 INFO:tasks.workunit.client.1.smithi089.stdout:8/578: write d5/f1a [4324699,5447] 0 2024-08-01T06:56:00.943 INFO:tasks.workunit.client.1.smithi089.stdout:8/579: mknod d5/d15/d5a/d73/daa/cc4 0 2024-08-01T06:56:00.945 INFO:tasks.workunit.client.1.smithi089.stdout:3/438: truncate d7/d32/d12/d1b/f4a 105604 0 2024-08-01T06:56:00.946 INFO:tasks.workunit.client.1.smithi089.stdout:0/661: sync 2024-08-01T06:56:00.946 INFO:tasks.workunit.client.1.smithi089.stdout:6/629: sync 2024-08-01T06:56:00.946 INFO:tasks.workunit.client.1.smithi089.stdout:2/486: sync 2024-08-01T06:56:00.946 INFO:tasks.workunit.client.1.smithi089.stdout:8/580: mkdir d5/dc/d12/d92/dc5 0 2024-08-01T06:56:00.951 INFO:tasks.workunit.client.1.smithi089.stdout:0/662: mknod d9/d40/d45/d47/da8/cd6 0 2024-08-01T06:56:00.951 INFO:tasks.workunit.client.1.smithi089.stdout:0/663: chown d9/d40/d25/d46/d91/d2e/fbd 435 1 2024-08-01T06:56:00.952 INFO:tasks.workunit.client.1.smithi089.stdout:0/664: chown d9/d40/d45/d47/fc0 3 1 2024-08-01T06:56:00.953 INFO:tasks.workunit.client.1.smithi089.stdout:2/487: rename d7/d19/d1e/d5b/d81 to d7/d1f/d29/d48/d4e/d9e 0 2024-08-01T06:56:00.954 INFO:tasks.workunit.client.1.smithi089.stdout:0/665: write d9/d40/d25/d46/d91/d2e/d44/d53/f9a [3131066,11558] 0 2024-08-01T06:56:00.956 INFO:tasks.workunit.client.1.smithi089.stdout:3/439: rmdir d7/d32/d4c/d69/d55 0 2024-08-01T06:56:00.957 INFO:tasks.workunit.client.1.smithi089.stdout:3/440: write d7/d32/d4c/d69/f56 [2825326,99671] 0 2024-08-01T06:56:00.959 INFO:tasks.workunit.client.1.smithi089.stdout:3/441: chown d7/c19 1909589 1 2024-08-01T06:56:00.960 INFO:tasks.workunit.client.1.smithi089.stdout:2/488: mkdir d7/d1f/d9f 0 2024-08-01T06:56:00.961 INFO:tasks.workunit.client.1.smithi089.stdout:8/581: link d5/dc/d94/l7a d5/dc/d1e/d53/lc6 0 2024-08-01T06:56:00.962 INFO:tasks.workunit.client.1.smithi089.stdout:0/666: creat d9/d40/d45/d47/d9d/fd7 x:0 0 0 2024-08-01T06:56:00.967 INFO:tasks.workunit.client.1.smithi089.stdout:6/630: write d2/f2b [292927,17638] 0 2024-08-01T06:56:00.972 INFO:tasks.workunit.client.1.smithi089.stdout:8/582: rmdir d5/d23/dc3 0 2024-08-01T06:56:00.973 INFO:tasks.workunit.client.1.smithi089.stdout:3/442: getdents d7/d68 0 2024-08-01T06:56:00.973 INFO:tasks.workunit.client.1.smithi089.stdout:8/583: stat d5/d15/d5a/d73/c80 0 2024-08-01T06:56:00.974 INFO:tasks.workunit.client.1.smithi089.stdout:6/631: symlink d2/d11/d1f/dbd/dc5/lda 0 2024-08-01T06:56:00.974 INFO:tasks.workunit.client.1.smithi089.stdout:0/667: getdents d9/d40/d95 0 2024-08-01T06:56:00.976 INFO:tasks.workunit.client.1.smithi089.stdout:3/443: stat d7/d32/d4c/d69/c45 0 2024-08-01T06:56:00.978 INFO:tasks.workunit.client.1.smithi089.stdout:2/489: dwrite d7/fa [0,4194304] 0 2024-08-01T06:56:00.978 INFO:tasks.workunit.client.1.smithi089.stdout:8/584: rename d5/dc/d12/d92 to d5/dc/d94/dc7 0 2024-08-01T06:56:00.980 INFO:tasks.workunit.client.1.smithi089.stdout:6/632: link d2/d11/d1a/f29 d2/d11/d1f/d46/fdb 0 2024-08-01T06:56:00.982 INFO:tasks.workunit.client.1.smithi089.stdout:3/444: getdents d7/d32/d4c/d53/d5f 0 2024-08-01T06:56:00.984 INFO:tasks.workunit.client.1.smithi089.stdout:6/633: chown d2/d11/d1a/f6a 121621771 1 2024-08-01T06:56:00.985 INFO:tasks.workunit.client.1.smithi089.stdout:2/490: rename d7/d1f/d29/f49 to d7/d19/d1e/fa0 0 2024-08-01T06:56:00.985 INFO:tasks.workunit.client.1.smithi089.stdout:0/668: dwrite d9/d40/d45/d47/f5c [0,4194304] 0 2024-08-01T06:56:00.987 INFO:tasks.workunit.client.1.smithi089.stdout:6/634: write d2/d11/d1a/f33 [51772,74473] 0 2024-08-01T06:56:00.992 INFO:tasks.workunit.client.1.smithi089.stdout:6/635: fsync d2/d11/d1a/d1c/d40/f48 0 2024-08-01T06:56:00.994 INFO:tasks.workunit.client.1.smithi089.stdout:2/491: link d7/d1f/c26 d7/d1f/d29/d48/ca1 0 2024-08-01T06:56:00.994 INFO:tasks.workunit.client.1.smithi089.stdout:3/445: dwrite d7/d32/f64 [0,4194304] 0 2024-08-01T06:56:00.997 INFO:tasks.workunit.client.1.smithi089.stdout:6/636: chown d2/d2e/d2f/f4d 190198257 1 2024-08-01T06:56:00.997 INFO:tasks.workunit.client.1.smithi089.stdout:2/492: creat d7/d1f/d28/fa2 x:0 0 0 2024-08-01T06:56:00.998 INFO:tasks.workunit.client.1.smithi089.stdout:2/493: dread - d7/d4a/f6d zero size 2024-08-01T06:56:00.999 INFO:tasks.workunit.client.1.smithi089.stdout:3/446: rename d7/d32/d4c/d53/d65 to d7/d68/d50/d89 0 2024-08-01T06:56:01.001 INFO:tasks.workunit.client.1.smithi089.stdout:3/447: write d7/d32/d12/d1b/f3c [1499385,101844] 0 2024-08-01T06:56:01.003 INFO:tasks.workunit.client.1.smithi089.stdout:2/494: creat d7/d1f/d28/fa3 x:0 0 0 2024-08-01T06:56:01.003 INFO:tasks.workunit.client.1.smithi089.stdout:8/585: write d5/d15/d5a/f8a [5098567,131011] 0 2024-08-01T06:56:01.004 INFO:tasks.workunit.client.1.smithi089.stdout:6/637: symlink d2/d30/d3c/d3d/ldc 0 2024-08-01T06:56:01.005 INFO:tasks.workunit.client.1.smithi089.stdout:2/495: read d7/d19/d3b/f95 [4084172,58799] 0 2024-08-01T06:56:01.007 INFO:tasks.workunit.client.1.smithi089.stdout:8/586: write d5/dc/f16 [4974472,111184] 0 2024-08-01T06:56:01.008 INFO:tasks.workunit.client.1.smithi089.stdout:6/638: mknod d2/d11/d1f/d46/cdd 0 2024-08-01T06:56:01.009 INFO:tasks.workunit.client.1.smithi089.stdout:6/639: chown d2/d11/l16 17939645 1 2024-08-01T06:56:01.009 INFO:tasks.workunit.client.1.smithi089.stdout:3/448: link d7/d32/c14 d7/c8a 0 2024-08-01T06:56:01.010 INFO:tasks.workunit.client.1.smithi089.stdout:6/640: readlink d2/d2e/d2f/l99 0 2024-08-01T06:56:01.010 INFO:tasks.workunit.client.1.smithi089.stdout:8/587: chown d5/dc/d1e/c2d 6200 1 2024-08-01T06:56:01.011 INFO:tasks.workunit.client.1.smithi089.stdout:6/641: creat d2/d2e/dc2/fde x:0 0 0 2024-08-01T06:56:01.012 INFO:tasks.workunit.client.1.smithi089.stdout:3/449: getdents d7/d32/d4c 0 2024-08-01T06:56:01.013 INFO:tasks.workunit.client.1.smithi089.stdout:6/642: mknod d2/d2e/d2f/d91/cdf 0 2024-08-01T06:56:01.014 INFO:tasks.workunit.client.1.smithi089.stdout:8/588: link d5/d23/f51 d5/dc/d94/dc7/dc5/fc8 0 2024-08-01T06:56:01.015 INFO:tasks.workunit.client.1.smithi089.stdout:3/450: mknod d7/d68/d50/d6f/c8b 0 2024-08-01T06:56:01.016 INFO:tasks.workunit.client.1.smithi089.stdout:8/589: symlink d5/dc/d12/lc9 0 2024-08-01T06:56:01.016 INFO:tasks.workunit.client.1.smithi089.stdout:3/451: rmdir d7/d68/d3d 39 2024-08-01T06:56:01.018 INFO:tasks.workunit.client.1.smithi089.stdout:0/669: truncate d9/d40/d95/d99/fa1 606791 0 2024-08-01T06:56:01.020 INFO:tasks.workunit.client.1.smithi089.stdout:3/452: symlink d7/d32/d4c/d67/l8c 0 2024-08-01T06:56:01.023 INFO:tasks.workunit.client.1.smithi089.stdout:0/670: creat d9/d40/d25/fd8 x:0 0 0 2024-08-01T06:56:01.025 INFO:tasks.workunit.client.1.smithi089.stdout:6/643: dwrite d2/d30/d3c/d3d/fc6 [0,4194304] 0 2024-08-01T06:56:01.026 INFO:tasks.workunit.client.1.smithi089.stdout:3/453: write d7/d32/d12/d1b/f26 [867131,73068] 0 2024-08-01T06:56:01.028 INFO:tasks.workunit.client.1.smithi089.stdout:0/671: fsync d9/d40/d25/d46/d91/d2e/d44/d53/f9a 0 2024-08-01T06:56:01.030 INFO:tasks.workunit.client.1.smithi089.stdout:8/590: dwrite d5/d15/f83 [0,4194304] 0 2024-08-01T06:56:01.031 INFO:tasks.workunit.client.1.smithi089.stdout:3/454: write d7/d32/d12/f41 [1465247,65429] 0 2024-08-01T06:56:01.035 INFO:tasks.workunit.client.1.smithi089.stdout:3/455: chown d7/d32/d4c/d67 92371 1 2024-08-01T06:56:01.035 INFO:tasks.workunit.client.1.smithi089.stdout:2/496: dread f2 [0,4194304] 0 2024-08-01T06:56:01.038 INFO:tasks.workunit.client.1.smithi089.stdout:0/672: rename d9/d40/lc4 to d9/d40/d25/d46/d91/d2e/d44/d53/db9/ld9 0 2024-08-01T06:56:01.042 INFO:tasks.workunit.client.1.smithi089.stdout:3/456: mknod d7/d68/d50/d6f/d46/d47/d81/c8d 0 2024-08-01T06:56:01.043 INFO:tasks.workunit.client.1.smithi089.stdout:0/673: fdatasync d9/d40/d95/d99/d2b/fb8 0 2024-08-01T06:56:01.047 INFO:tasks.workunit.client.1.smithi089.stdout:2/497: dwrite d7/d19/f37 [0,4194304] 0 2024-08-01T06:56:01.050 INFO:tasks.workunit.client.1.smithi089.stdout:2/498: dread d7/d19/d3b/f59 [0,4194304] 0 2024-08-01T06:56:01.053 INFO:tasks.workunit.client.1.smithi089.stdout:8/591: dread d5/f9c [0,4194304] 0 2024-08-01T06:56:01.053 INFO:tasks.workunit.client.1.smithi089.stdout:2/499: mknod d7/d73/ca4 0 2024-08-01T06:56:01.054 INFO:tasks.workunit.client.1.smithi089.stdout:8/592: chown d5/d23/f36 297094 1 2024-08-01T06:56:01.057 INFO:tasks.workunit.client.1.smithi089.stdout:2/500: unlink d7/d1f/d29/f43 0 2024-08-01T06:56:01.057 INFO:tasks.workunit.client.1.smithi089.stdout:6/644: dwrite d2/d11/f66 [0,4194304] 0 2024-08-01T06:56:01.059 INFO:tasks.workunit.client.1.smithi089.stdout:0/674: truncate f7 1429830 0 2024-08-01T06:56:01.060 INFO:tasks.workunit.client.1.smithi089.stdout:2/501: dread d7/d19/d3b/f59 [0,4194304] 0 2024-08-01T06:56:01.062 INFO:tasks.workunit.client.1.smithi089.stdout:5/553: sync 2024-08-01T06:56:01.062 INFO:tasks.workunit.client.1.smithi089.stdout:1/595: sync 2024-08-01T06:56:01.064 INFO:tasks.workunit.client.1.smithi089.stdout:0/675: read d9/d40/d95/d99/d2b/f82 [186339,113780] 0 2024-08-01T06:56:01.070 INFO:tasks.workunit.client.1.smithi089.stdout:5/554: creat d5/de/df/d9f/dbd/fbf x:0 0 0 2024-08-01T06:56:01.070 INFO:tasks.workunit.client.1.smithi089.stdout:8/593: dwrite d5/dc/d94/f8c [0,4194304] 0 2024-08-01T06:56:01.072 INFO:tasks.workunit.client.1.smithi089.stdout:1/596: write d0/d9/d15/d2d/d4a/d4d/f6d [1595006,22025] 0 2024-08-01T06:56:01.072 INFO:tasks.workunit.client.1.smithi089.stdout:0/676: unlink d9/d40/d25/d46/d91/d2e/f36 0 2024-08-01T06:56:01.072 INFO:tasks.workunit.client.1.smithi089.stdout:5/555: chown d5/dac 19263197 1 2024-08-01T06:56:01.073 INFO:tasks.workunit.client.1.smithi089.stdout:6/645: fdatasync d2/d11/f66 0 2024-08-01T06:56:01.074 INFO:tasks.workunit.client.1.smithi089.stdout:2/502: dwrite d7/d1f/d28/fa3 [0,4194304] 0 2024-08-01T06:56:01.075 INFO:tasks.workunit.client.1.smithi089.stdout:1/597: truncate d0/f11 8185782 0 2024-08-01T06:56:01.079 INFO:tasks.workunit.client.1.smithi089.stdout:6/646: creat d2/d2e/d2f/fe0 x:0 0 0 2024-08-01T06:56:01.079 INFO:tasks.workunit.client.1.smithi089.stdout:8/594: rmdir d5/d9e 0 2024-08-01T06:56:01.080 INFO:tasks.workunit.client.1.smithi089.stdout:6/647: chown d2/d2e/d2f/fe0 12665836 1 2024-08-01T06:56:01.081 INFO:tasks.workunit.client.1.smithi089.stdout:5/556: write d5/de/d10/d16/d1b/d52/d5d/d6c/fa1 [436054,50283] 0 2024-08-01T06:56:01.083 INFO:tasks.workunit.client.1.smithi089.stdout:1/598: mkdir d0/d9/d15/d3b/d3d/d77/dc4 0 2024-08-01T06:56:01.085 INFO:tasks.workunit.client.1.smithi089.stdout:8/595: chown d5/dc/d1e/l22 0 1 2024-08-01T06:56:01.086 INFO:tasks.workunit.client.1.smithi089.stdout:6/648: creat d2/fe1 x:0 0 0 2024-08-01T06:56:01.086 INFO:tasks.workunit.client.1.smithi089.stdout:8/596: chown d5/d15/d5a/d73/daa/fbe 15317 1 2024-08-01T06:56:01.087 INFO:tasks.workunit.client.1.smithi089.stdout:6/649: fdatasync d2/d11/d1a/fc8 0 2024-08-01T06:56:01.087 INFO:tasks.workunit.client.1.smithi089.stdout:5/557: rename d5/d13/l48 to d5/de/d10/d16/d1b/d52/d5f/lc0 0 2024-08-01T06:56:01.088 INFO:tasks.workunit.client.1.smithi089.stdout:6/650: write d2/fd6 [1012958,8474] 0 2024-08-01T06:56:01.089 INFO:tasks.workunit.client.1.smithi089.stdout:8/597: mkdir d5/dc/dca 0 2024-08-01T06:56:01.090 INFO:tasks.workunit.client.1.smithi089.stdout:2/503: dread d7/d1f/d52/d6e/f75 [0,4194304] 0 2024-08-01T06:56:01.090 INFO:tasks.workunit.client.1.smithi089.stdout:6/651: readlink d2/d2e/d7c/la6 0 2024-08-01T06:56:01.092 INFO:tasks.workunit.client.1.smithi089.stdout:8/598: write d5/dc/d94/f39 [128027,123491] 0 2024-08-01T06:56:01.092 INFO:tasks.workunit.client.1.smithi089.stdout:2/504: stat d7/l4d 0 2024-08-01T06:56:01.094 INFO:tasks.workunit.client.1.smithi089.stdout:8/599: fsync d5/dc/d12/fbc 0 2024-08-01T06:56:01.095 INFO:tasks.workunit.client.1.smithi089.stdout:6/652: creat d2/d11/fe2 x:0 0 0 2024-08-01T06:56:01.096 INFO:tasks.workunit.client.1.smithi089.stdout:2/505: rmdir d7/d19/d1e/d3d/d60 39 2024-08-01T06:56:01.098 INFO:tasks.workunit.client.1.smithi089.stdout:5/558: dwrite d5/de/d57/db0/fb2 [0,4194304] 0 2024-08-01T06:56:01.098 INFO:tasks.workunit.client.1.smithi089.stdout:0/677: dread d9/d40/d95/d99/d2b/fb8 [0,4194304] 0 2024-08-01T06:56:01.099 INFO:tasks.workunit.client.1.smithi089.stdout:6/653: creat d2/d2e/d2f/d9e/fe3 x:0 0 0 2024-08-01T06:56:01.100 INFO:tasks.workunit.client.1.smithi089.stdout:2/506: dread - d7/d19/d1e/d3d/d60/f8c zero size 2024-08-01T06:56:01.101 INFO:tasks.workunit.client.1.smithi089.stdout:6/654: write d2/fd8 [834181,70174] 0 2024-08-01T06:56:01.103 INFO:tasks.workunit.client.1.smithi089.stdout:8/600: getdents d5/d15/d5a/d73/d87/dbf 0 2024-08-01T06:56:01.103 INFO:tasks.workunit.client.1.smithi089.stdout:2/507: rmdir d7/d19 39 2024-08-01T06:56:01.104 INFO:tasks.workunit.client.1.smithi089.stdout:8/601: fsync d5/dc/d12/fbc 0 2024-08-01T06:56:01.105 INFO:tasks.workunit.client.1.smithi089.stdout:5/559: rename d5/de/d10/d33/c5a to d5/d13/cc1 0 2024-08-01T06:56:01.107 INFO:tasks.workunit.client.1.smithi089.stdout:8/602: read d5/dc/d12/f57 [53885,87562] 0 2024-08-01T06:56:01.110 INFO:tasks.workunit.client.1.smithi089.stdout:8/603: write d5/d15/d5a/d73/d87/f9a [1813342,122318] 0 2024-08-01T06:56:01.114 INFO:tasks.workunit.client.1.smithi089.stdout:8/604: fdatasync d5/dc/fb2 0 2024-08-01T06:56:01.115 INFO:tasks.workunit.client.1.smithi089.stdout:0/678: link d9/d40/d25/d46/d91/d2e/fce d9/d40/d25/d46/d91/d2e/d44/d72/fda 0 2024-08-01T06:56:01.115 INFO:tasks.workunit.client.1.smithi089.stdout:5/560: creat d5/de/d10/d33/d5e/d7e/d9e/db1/fc2 x:0 0 0 2024-08-01T06:56:01.115 INFO:tasks.workunit.client.1.smithi089.stdout:6/655: truncate d2/fd8 890213 0 2024-08-01T06:56:01.115 INFO:tasks.workunit.client.1.smithi089.stdout:2/508: dwrite d7/d19/d1e/d5b/f8e [0,4194304] 0 2024-08-01T06:56:01.115 INFO:tasks.workunit.client.1.smithi089.stdout:0/679: fdatasync d9/d40/d95/d99/d2b/d55/d7a/fb5 0 2024-08-01T06:56:01.121 INFO:tasks.workunit.client.1.smithi089.stdout:2/509: rmdir d7/d73 39 2024-08-01T06:56:01.122 INFO:tasks.workunit.client.1.smithi089.stdout:2/510: fdatasync d7/d19/d1e/f8a 0 2024-08-01T06:56:01.122 INFO:tasks.workunit.client.1.smithi089.stdout:0/680: mknod d9/d40/d25/d46/d91/d2e/d44/d53/db9/cdb 0 2024-08-01T06:56:01.126 INFO:tasks.workunit.client.1.smithi089.stdout:8/605: link d5/dc/d1e/d53/fa0 d5/d15/fcb 0 2024-08-01T06:56:01.127 INFO:tasks.workunit.client.1.smithi089.stdout:6/656: creat d2/fe4 x:0 0 0 2024-08-01T06:56:01.128 INFO:tasks.workunit.client.1.smithi089.stdout:8/606: fsync d5/d15/d5a/d73/d87/f9a 0 2024-08-01T06:56:01.129 INFO:tasks.workunit.client.1.smithi089.stdout:6/657: stat d2/d30/c64 0 2024-08-01T06:56:01.131 INFO:tasks.workunit.client.1.smithi089.stdout:0/681: truncate d9/d40/d25/d46/d91/d64/f6a 1786350 0 2024-08-01T06:56:01.131 INFO:tasks.workunit.client.1.smithi089.stdout:2/511: dwrite d7/d19/f37 [0,4194304] 0 2024-08-01T06:56:01.134 INFO:tasks.workunit.client.1.smithi089.stdout:5/561: dread d5/d13/f30 [0,4194304] 0 2024-08-01T06:56:01.135 INFO:tasks.workunit.client.1.smithi089.stdout:2/512: creat d7/d1f/d29/d48/d4e/fa5 x:0 0 0 2024-08-01T06:56:01.136 INFO:tasks.workunit.client.1.smithi089.stdout:8/607: dread d5/d15/d5a/d73/daa/fbe [0,4194304] 0 2024-08-01T06:56:01.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:00 smithi089 ceph-mon[36617]: pgmap v14: 65 pgs: 65 active+clean; 1.2 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 38 MiB/s rd, 175 MiB/s wr, 509 op/s 2024-08-01T06:56:01.138 INFO:tasks.workunit.client.1.smithi089.stdout:6/658: dread d2/d11/f65 [0,4194304] 0 2024-08-01T06:56:01.141 INFO:tasks.workunit.client.1.smithi089.stdout:8/608: creat d5/dc/d94/dc7/fcc x:0 0 0 2024-08-01T06:56:01.145 INFO:tasks.workunit.client.1.smithi089.stdout:8/609: mknod d5/dc/d94/d84/ccd 0 2024-08-01T06:56:01.146 INFO:tasks.workunit.client.1.smithi089.stdout:6/659: dwrite d2/d2e/d2f/d9e/fe3 [0,4194304] 0 2024-08-01T06:56:01.147 INFO:tasks.workunit.client.1.smithi089.stdout:5/562: mkdir d5/de/d10/d16/d1b/d52/d5d/d6c/d98/dc3 0 2024-08-01T06:56:01.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:00 smithi016 ceph-mon[29266]: pgmap v14: 65 pgs: 65 active+clean; 1.2 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 38 MiB/s rd, 175 MiB/s wr, 509 op/s 2024-08-01T06:56:01.152 INFO:tasks.workunit.client.1.smithi089.stdout:6/660: truncate d2/d11/d1a/d1c/fa4 1464613 0 2024-08-01T06:56:01.153 INFO:tasks.workunit.client.1.smithi089.stdout:6/661: stat d2/d30/d3c/d3d/ldc 0 2024-08-01T06:56:01.155 INFO:tasks.workunit.client.1.smithi089.stdout:2/513: dread d7/d1f/d28/f51 [0,4194304] 0 2024-08-01T06:56:01.157 INFO:tasks.workunit.client.1.smithi089.stdout:8/610: rename d5/d15/d5a/d73/daa/fbd to d5/dc/d1e/fce 0 2024-08-01T06:56:01.163 INFO:tasks.workunit.client.1.smithi089.stdout:0/682: dread d9/d40/d95/d99/d2b/d55/d7a/f89 [0,4194304] 0 2024-08-01T06:56:01.164 INFO:tasks.workunit.client.1.smithi089.stdout:0/683: dread - d9/d40/d45/d47/d9d/fd7 zero size 2024-08-01T06:56:01.166 INFO:tasks.workunit.client.1.smithi089.stdout:0/684: readlink d9/d40/d25/d46/d91/d2e/d44/d72/lbb 0 2024-08-01T06:56:01.167 INFO:tasks.workunit.client.1.smithi089.stdout:2/514: dread d7/f10 [0,4194304] 0 2024-08-01T06:56:01.169 INFO:tasks.workunit.client.1.smithi089.stdout:5/563: dread d5/de/d10/d16/d1b/d52/d5d/d6c/f81 [0,4194304] 0 2024-08-01T06:56:01.169 INFO:tasks.workunit.client.1.smithi089.stdout:2/515: truncate d7/d19/d1e/d5b/f69 902170 0 2024-08-01T06:56:01.169 INFO:tasks.workunit.client.1.smithi089.stdout:2/516: read d7/d1f/d28/fa3 [964374,87032] 0 2024-08-01T06:56:01.170 INFO:tasks.workunit.client.1.smithi089.stdout:5/564: read d5/de/d10/d16/d1b/d52/d5d/d6c/d8b/faa [94363,126672] 0 2024-08-01T06:56:01.174 INFO:tasks.workunit.client.1.smithi089.stdout:5/565: creat d5/de/df/d9f/dbd/fc4 x:0 0 0 2024-08-01T06:56:01.175 INFO:tasks.workunit.client.1.smithi089.stdout:5/566: dread - d5/de/d10/d33/d5e/d7e/d9e/db1/fc2 zero size 2024-08-01T06:56:01.177 INFO:tasks.workunit.client.1.smithi089.stdout:5/567: mkdir d5/d13/d43/dc5 0 2024-08-01T06:56:01.178 INFO:tasks.workunit.client.1.smithi089.stdout:5/568: write d5/d13/d38/d42/f55 [753680,75831] 0 2024-08-01T06:56:01.184 INFO:tasks.workunit.client.1.smithi089.stdout:5/569: link d5/d13/d38/d42/f67 d5/de/d10/d33/d5e/d7e/d9e/fc6 0 2024-08-01T06:56:01.192 INFO:tasks.workunit.client.1.smithi089.stdout:5/570: getdents d5/de/d10/d16/d1b/d25 0 2024-08-01T06:56:01.193 INFO:tasks.workunit.client.1.smithi089.stdout:5/571: write d5/de/d10/d16/d1b/d25/fa7 [1312682,9688] 0 2024-08-01T06:56:01.195 INFO:tasks.workunit.client.1.smithi089.stdout:5/572: symlink d5/de/df/d9f/lc7 0 2024-08-01T06:56:01.196 INFO:tasks.workunit.client.1.smithi089.stdout:9/541: sync 2024-08-01T06:56:01.198 INFO:tasks.workunit.client.1.smithi089.stdout:9/542: mkdir d18/d22/d45/daa 0 2024-08-01T06:56:01.199 INFO:tasks.workunit.client.1.smithi089.stdout:9/543: fsync d18/d22/f48 0 2024-08-01T06:56:01.201 INFO:tasks.workunit.client.1.smithi089.stdout:5/573: dwrite d5/de/d10/d16/d1b/d25/f64 [4194304,4194304] 0 2024-08-01T06:56:01.202 INFO:tasks.workunit.client.1.smithi089.stdout:5/574: readlink d5/de/d10/d16/d1b/l51 0 2024-08-01T06:56:01.203 INFO:tasks.workunit.client.1.smithi089.stdout:5/575: write d5/de/d10/d16/d1b/d25/fa7 [1533164,30307] 0 2024-08-01T06:56:01.204 INFO:tasks.workunit.client.1.smithi089.stdout:9/544: mknod d18/da4/cab 0 2024-08-01T06:56:01.205 INFO:tasks.workunit.client.1.smithi089.stdout:9/545: dread - d18/f30 zero size 2024-08-01T06:56:01.205 INFO:tasks.workunit.client.1.smithi089.stdout:5/576: dread - d5/d13/d38/f6d zero size 2024-08-01T06:56:01.211 INFO:tasks.workunit.client.1.smithi089.stdout:9/546: creat d18/d33/d49/d7b/d81/fac x:0 0 0 2024-08-01T06:56:01.212 INFO:tasks.workunit.client.1.smithi089.stdout:9/547: chown d18/d33/d49/d7b/d4b/l73 113 1 2024-08-01T06:56:01.213 INFO:tasks.workunit.client.1.smithi089.stdout:5/577: unlink d5/l6a 0 2024-08-01T06:56:01.213 INFO:tasks.workunit.client.1.smithi089.stdout:5/578: dread - d5/de/df/fb6 zero size 2024-08-01T06:56:01.215 INFO:tasks.workunit.client.1.smithi089.stdout:5/579: chown d5/de/d10/d16/d1b/d52/d5d/d6c/fa1 213628476 1 2024-08-01T06:56:01.219 INFO:tasks.workunit.client.1.smithi089.stdout:9/548: creat d18/d33/d49/d7b/fad x:0 0 0 2024-08-01T06:56:01.225 INFO:tasks.workunit.client.1.smithi089.stdout:5/580: dread d5/de/d10/d16/d1b/d25/f74 [0,4194304] 0 2024-08-01T06:56:01.228 INFO:tasks.workunit.client.1.smithi089.stdout:5/581: rmdir d5/de/d57 39 2024-08-01T06:56:01.318 INFO:tasks.workunit.client.1.smithi089.stdout:7/568: sync 2024-08-01T06:56:01.318 INFO:tasks.workunit.client.1.smithi089.stdout:7/569: dread d7/d46/f68 [0,4194304] 0 2024-08-01T06:56:01.319 INFO:tasks.workunit.client.1.smithi089.stdout:7/570: creat d7/df/d91/da4/fb6 x:0 0 0 2024-08-01T06:56:01.320 INFO:tasks.workunit.client.1.smithi089.stdout:7/571: fsync d7/df/d91/da4/f5f 0 2024-08-01T06:56:01.322 INFO:tasks.workunit.client.1.smithi089.stdout:7/572: getdents d7/df/d10/d42/d75 0 2024-08-01T06:56:01.324 INFO:tasks.workunit.client.1.smithi089.stdout:7/573: creat d7/d1f/da6/fb7 x:0 0 0 2024-08-01T06:56:01.326 INFO:tasks.workunit.client.1.smithi089.stdout:7/574: rmdir d7/df/d10/d31 39 2024-08-01T06:56:01.331 INFO:tasks.workunit.client.1.smithi089.stdout:7/575: dwrite d7/df/f11 [0,4194304] 0 2024-08-01T06:56:01.365 INFO:tasks.workunit.client.1.smithi089.stdout:3/457: sync 2024-08-01T06:56:01.365 INFO:tasks.workunit.client.1.smithi089.stdout:4/599: sync 2024-08-01T06:56:01.368 INFO:tasks.workunit.client.1.smithi089.stdout:3/458: dwrite d7/d32/f4e [0,4194304] 0 2024-08-01T06:56:01.424 INFO:tasks.workunit.client.1.smithi089.stdout:4/600: creat d3/d68/d7e/fb2 x:0 0 0 2024-08-01T06:56:01.426 INFO:tasks.workunit.client.1.smithi089.stdout:7/576: fdatasync d7/df/f11 0 2024-08-01T06:56:01.431 INFO:tasks.workunit.client.1.smithi089.stdout:4/601: dwrite d3/db/d16/f18 [4194304,4194304] 0 2024-08-01T06:56:01.431 INFO:tasks.workunit.client.1.smithi089.stdout:7/577: rmdir d7/d1f/d30/d9a 0 2024-08-01T06:56:01.434 INFO:tasks.workunit.client.1.smithi089.stdout:4/602: mkdir d3/d1f/d62/db3 0 2024-08-01T06:56:01.436 INFO:tasks.workunit.client.1.smithi089.stdout:7/578: creat d7/d1f/d30/db1/fb8 x:0 0 0 2024-08-01T06:56:01.439 INFO:tasks.workunit.client.1.smithi089.stdout:7/579: chown d7/d1f/d30/la2 8078 1 2024-08-01T06:56:01.441 INFO:tasks.workunit.client.1.smithi089.stdout:4/603: dwrite d3/d1f/faf [0,4194304] 0 2024-08-01T06:56:01.447 INFO:tasks.workunit.client.1.smithi089.stdout:4/604: chown d3/d1f/d62/d3b/l79 3471 1 2024-08-01T06:56:01.452 INFO:tasks.workunit.client.1.smithi089.stdout:4/605: creat d3/d17/d71/d92/fb4 x:0 0 0 2024-08-01T06:56:01.456 INFO:tasks.workunit.client.1.smithi089.stdout:4/606: rename d3/d1f/d62/d3b/f48 to d3/d1f/d62/db3/fb5 0 2024-08-01T06:56:01.458 INFO:tasks.workunit.client.1.smithi089.stdout:0/685: sync 2024-08-01T06:56:01.458 INFO:tasks.workunit.client.1.smithi089.stdout:6/662: sync 2024-08-01T06:56:01.458 INFO:tasks.workunit.client.1.smithi089.stdout:9/549: sync 2024-08-01T06:56:01.458 INFO:tasks.workunit.client.1.smithi089.stdout:1/599: sync 2024-08-01T06:56:01.459 INFO:tasks.workunit.client.1.smithi089.stdout:8/611: sync 2024-08-01T06:56:01.459 INFO:tasks.workunit.client.1.smithi089.stdout:5/582: sync 2024-08-01T06:56:01.459 INFO:tasks.workunit.client.1.smithi089.stdout:2/517: sync 2024-08-01T06:56:01.462 INFO:tasks.workunit.client.1.smithi089.stdout:9/550: write d18/d22/f48 [1643747,45460] 0 2024-08-01T06:56:01.462 INFO:tasks.workunit.client.1.smithi089.stdout:6/663: chown d2/d2e/d7c/lcf 4832 1 2024-08-01T06:56:01.464 INFO:tasks.workunit.client.1.smithi089.stdout:5/583: read d5/de/f34 [3281354,77794] 0 2024-08-01T06:56:01.464 INFO:tasks.workunit.client.1.smithi089.stdout:2/518: symlink d7/d1f/d29/d48/d4e/d64/la6 0 2024-08-01T06:56:01.465 INFO:tasks.workunit.client.1.smithi089.stdout:2/519: chown d7/d1f/d29/d48/l7e 502784630 1 2024-08-01T06:56:01.466 INFO:tasks.workunit.client.1.smithi089.stdout:1/600: rename d0/d9/d15/d3b/d95/c2c to d0/d9/d15/d7a/cc5 0 2024-08-01T06:56:01.467 INFO:tasks.workunit.client.1.smithi089.stdout:1/601: write d0/d9/d15/d2d/f36 [1626857,2802] 0 2024-08-01T06:56:01.470 INFO:tasks.workunit.client.1.smithi089.stdout:8/612: rename d5/dc/d1e/f9f to d5/d15/d5a/d73/daa/db3/fcf 0 2024-08-01T06:56:01.472 INFO:tasks.workunit.client.1.smithi089.stdout:2/520: rmdir d7/d73 39 2024-08-01T06:56:01.473 INFO:tasks.workunit.client.1.smithi089.stdout:5/584: dread d5/f3c [0,4194304] 0 2024-08-01T06:56:01.473 INFO:tasks.workunit.client.1.smithi089.stdout:5/585: write d5/dac/fae [1047537,9105] 0 2024-08-01T06:56:01.475 INFO:tasks.workunit.client.1.smithi089.stdout:1/602: mkdir d0/d9/d43/d4b/dc6 0 2024-08-01T06:56:01.479 INFO:tasks.workunit.client.1.smithi089.stdout:9/551: rename d18/d22/d45/f59 to d18/d22/d39/d95/fae 0 2024-08-01T06:56:01.480 INFO:tasks.workunit.client.1.smithi089.stdout:7/580: getdents d7/d1f/d30/db1 0 2024-08-01T06:56:01.481 INFO:tasks.workunit.client.1.smithi089.stdout:8/613: dwrite d5/dc/fa1 [0,4194304] 0 2024-08-01T06:56:01.483 INFO:tasks.workunit.client.1.smithi089.stdout:1/603: unlink d0/d9/la 0 2024-08-01T06:56:01.487 INFO:tasks.workunit.client.1.smithi089.stdout:2/521: mknod d7/d1f/d29/ca7 0 2024-08-01T06:56:01.488 INFO:tasks.workunit.client.1.smithi089.stdout:7/581: creat d7/df/fb9 x:0 0 0 2024-08-01T06:56:01.489 INFO:tasks.workunit.client.1.smithi089.stdout:5/586: creat d5/de/d57/fc8 x:0 0 0 2024-08-01T06:56:01.490 INFO:tasks.workunit.client.1.smithi089.stdout:8/614: creat d5/d15/d5a/d73/daa/fd0 x:0 0 0 2024-08-01T06:56:01.494 INFO:tasks.workunit.client.1.smithi089.stdout:2/522: creat d7/d1f/d28/fa8 x:0 0 0 2024-08-01T06:56:01.497 INFO:tasks.workunit.client.1.smithi089.stdout:5/587: creat d5/de/d57/d8e/d97/da5/fc9 x:0 0 0 2024-08-01T06:56:01.498 INFO:tasks.workunit.client.1.smithi089.stdout:1/604: mknod d0/d9/d15/d3b/d95/d49/d82/da6/dc3/cc7 0 2024-08-01T06:56:01.498 INFO:tasks.workunit.client.1.smithi089.stdout:5/588: chown d5/d13/d38/c5b 55 1 2024-08-01T06:56:01.501 INFO:tasks.workunit.client.1.smithi089.stdout:2/523: dwrite d7/d1f/d28/fa2 [0,4194304] 0 2024-08-01T06:56:01.502 INFO:tasks.workunit.client.1.smithi089.stdout:9/552: creat d18/faf x:0 0 0 2024-08-01T06:56:01.505 INFO:tasks.workunit.client.1.smithi089.stdout:6/664: dwrite d2/d11/d1f/f36 [0,4194304] 0 2024-08-01T06:56:01.505 INFO:tasks.workunit.client.1.smithi089.stdout:7/582: mknod d7/d1f/cba 0 2024-08-01T06:56:01.507 INFO:tasks.workunit.client.1.smithi089.stdout:6/665: write d2/d11/f9a [1190380,66969] 0 2024-08-01T06:56:01.508 INFO:tasks.workunit.client.1.smithi089.stdout:8/615: creat d5/dc/d12/db9/fd1 x:0 0 0 2024-08-01T06:56:01.509 INFO:tasks.workunit.client.1.smithi089.stdout:6/666: dread - d2/d2e/d2f/d31/fbc zero size 2024-08-01T06:56:01.510 INFO:tasks.workunit.client.1.smithi089.stdout:0/686: rename d9/d40/d25/d46/d91/d2e/d44/d53/daf/fc9 to d9/d40/d25/d46/d91/d2e/d44/d72/fdc 0 2024-08-01T06:56:01.512 INFO:tasks.workunit.client.1.smithi089.stdout:5/589: creat d5/de/d57/db0/fca x:0 0 0 2024-08-01T06:56:01.513 INFO:tasks.workunit.client.1.smithi089.stdout:6/667: chown d2/d2e/d2f/d31/f44 402837 1 2024-08-01T06:56:01.514 INFO:tasks.workunit.client.1.smithi089.stdout:9/553: creat d18/da4/fb0 x:0 0 0 2024-08-01T06:56:01.514 INFO:tasks.workunit.client.1.smithi089.stdout:2/524: mkdir d7/d1f/d29/d48/da9 0 2024-08-01T06:56:01.515 INFO:tasks.workunit.client.1.smithi089.stdout:0/687: write d9/d40/d25/d46/d91/f3f [2889885,70584] 0 2024-08-01T06:56:01.515 INFO:tasks.workunit.client.1.smithi089.stdout:7/583: mkdir d7/d1f/da6/dbb 0 2024-08-01T06:56:01.515 INFO:tasks.workunit.client.1.smithi089.stdout:6/668: chown d2/d2e/dc2/dd2 115889 1 2024-08-01T06:56:01.515 INFO:tasks.workunit.client.1.smithi089.stdout:8/616: rmdir d5/d15/d5a/d73 39 2024-08-01T06:56:01.517 INFO:tasks.workunit.client.1.smithi089.stdout:1/605: rename d0/d9/d15/d2d/fa7 to d0/d9/d15/d3b/d95/d49/fc8 0 2024-08-01T06:56:01.522 INFO:tasks.workunit.client.1.smithi089.stdout:0/688: dread - d9/d40/d25/d46/d91/d2e/d44/d72/d8b/fd1 zero size 2024-08-01T06:56:01.522 INFO:tasks.workunit.client.1.smithi089.stdout:1/606: write d0/d9/d15/d76/f88 [564385,45621] 0 2024-08-01T06:56:01.524 INFO:tasks.workunit.client.1.smithi089.stdout:9/554: dread d18/d22/d43/f5f [8388608,4194304] 0 2024-08-01T06:56:01.525 INFO:tasks.workunit.client.1.smithi089.stdout:7/584: mkdir d7/d1f/d30/d4c/dbc 0 2024-08-01T06:56:01.526 INFO:tasks.workunit.client.1.smithi089.stdout:0/689: symlink d9/d40/d45/d47/ldd 0 2024-08-01T06:56:01.526 INFO:tasks.workunit.client.1.smithi089.stdout:9/555: stat d18/d33/f37 0 2024-08-01T06:56:01.527 INFO:tasks.workunit.client.1.smithi089.stdout:8/617: symlink d5/dc/d94/dc7/dc5/ld2 0 2024-08-01T06:56:01.527 INFO:tasks.workunit.client.1.smithi089.stdout:4/607: write d3/d1f/d62/db3/fb5 [1174555,74449] 0 2024-08-01T06:56:01.531 INFO:tasks.workunit.client.1.smithi089.stdout:8/618: stat d5/d15/d5e/c7c 0 2024-08-01T06:56:01.532 INFO:tasks.workunit.client.1.smithi089.stdout:2/525: dwrite d7/d19/d1e/fa0 [0,4194304] 0 2024-08-01T06:56:01.532 INFO:tasks.workunit.client.1.smithi089.stdout:6/669: dwrite d2/f8 [0,4194304] 0 2024-08-01T06:56:01.535 INFO:tasks.workunit.client.1.smithi089.stdout:8/619: readlink d5/d15/l5d 0 2024-08-01T06:56:01.535 INFO:tasks.workunit.client.1.smithi089.stdout:6/670: chown d2 7185746 1 2024-08-01T06:56:01.538 INFO:tasks.workunit.client.1.smithi089.stdout:8/620: chown d5/dc/d1e/l50 2 1 2024-08-01T06:56:01.539 INFO:tasks.workunit.client.1.smithi089.stdout:1/607: dwrite d0/d9/d15/d2d/d4a/d61/f9e [0,4194304] 0 2024-08-01T06:56:01.542 INFO:tasks.workunit.client.1.smithi089.stdout:9/556: link d18/d22/d43/l4c d18/d33/lb1 0 2024-08-01T06:56:01.543 INFO:tasks.workunit.client.1.smithi089.stdout:6/671: dread - d2/d11/d1f/d46/d6b/d7d/dc9/fd9 zero size 2024-08-01T06:56:01.543 INFO:tasks.workunit.client.1.smithi089.stdout:4/608: getdents d3/db/d16/d35 0 2024-08-01T06:56:01.543 INFO:tasks.workunit.client.1.smithi089.stdout:0/690: dread d9/d40/d95/d99/d2b/d55/f83 [0,4194304] 0 2024-08-01T06:56:01.545 INFO:tasks.workunit.client.1.smithi089.stdout:7/585: rename d7/df/d10/c62 to d7/df/d10/d31/d43/cbd 0 2024-08-01T06:56:01.551 INFO:tasks.workunit.client.1.smithi089.stdout:8/621: mkdir d5/d23/dd3 0 2024-08-01T06:56:01.552 INFO:tasks.workunit.client.1.smithi089.stdout:1/608: creat d0/d9/d15/d7a/fc9 x:0 0 0 2024-08-01T06:56:01.552 INFO:tasks.workunit.client.1.smithi089.stdout:0/691: rmdir d9/d40 39 2024-08-01T06:56:01.553 INFO:tasks.workunit.client.1.smithi089.stdout:7/586: dread d7/d1f/d3a/f9d [0,4194304] 0 2024-08-01T06:56:01.553 INFO:tasks.workunit.client.1.smithi089.stdout:8/622: chown d5/d15 23675814 1 2024-08-01T06:56:01.553 INFO:tasks.workunit.client.1.smithi089.stdout:2/526: rename d7/d1f/d29/ca7 to d7/d19/d3b/caa 0 2024-08-01T06:56:01.557 INFO:tasks.workunit.client.1.smithi089.stdout:6/672: dread d2/d30/d3c/d3d/fc6 [0,4194304] 0 2024-08-01T06:56:01.557 INFO:tasks.workunit.client.1.smithi089.stdout:2/527: truncate d7/d19/d1e/d5b/f69 1374620 0 2024-08-01T06:56:01.559 INFO:tasks.workunit.client.1.smithi089.stdout:1/609: fdatasync d0/f23 0 2024-08-01T06:56:01.566 INFO:tasks.workunit.client.1.smithi089.stdout:6/673: truncate d2/d11/f66 1483448 0 2024-08-01T06:56:01.567 INFO:tasks.workunit.client.1.smithi089.stdout:7/587: rename d7/d15/l86 to d7/d1f/da6/lbe 0 2024-08-01T06:56:01.568 INFO:tasks.workunit.client.1.smithi089.stdout:9/557: dwrite ff [0,4194304] 0 2024-08-01T06:56:01.569 INFO:tasks.workunit.client.1.smithi089.stdout:2/528: creat d7/d1f/d29/d48/d4e/d64/d9c/fab x:0 0 0 2024-08-01T06:56:01.572 INFO:tasks.workunit.client.1.smithi089.stdout:4/609: dread d3/d17/d3a/f70 [0,4194304] 0 2024-08-01T06:56:01.572 INFO:tasks.workunit.client.1.smithi089.stdout:9/558: write ff [2379441,17491] 0 2024-08-01T06:56:01.576 INFO:tasks.workunit.client.1.smithi089.stdout:7/588: symlink d7/df/d10/db3/lbf 0 2024-08-01T06:56:01.578 INFO:tasks.workunit.client.1.smithi089.stdout:1/610: dwrite d0/d9/d15/d3b/d95/d49/d82/f93 [0,4194304] 0 2024-08-01T06:56:01.578 INFO:tasks.workunit.client.1.smithi089.stdout:0/692: dread d9/d40/d95/d99/dba/fd4 [0,4194304] 0 2024-08-01T06:56:01.587 INFO:tasks.workunit.client.1.smithi089.stdout:0/693: fsync d9/d40/d45/d47/da8/fb3 0 2024-08-01T06:56:01.589 INFO:tasks.workunit.client.1.smithi089.stdout:2/529: dwrite d7/d1f/d28/f71 [4194304,4194304] 0 2024-08-01T06:56:01.591 INFO:tasks.workunit.client.1.smithi089.stdout:6/674: dwrite d2/f2b [0,4194304] 0 2024-08-01T06:56:01.593 INFO:tasks.workunit.client.1.smithi089.stdout:1/611: creat d0/d9/d15/d3b/d3d/d77/fca x:0 0 0 2024-08-01T06:56:01.596 INFO:tasks.workunit.client.1.smithi089.stdout:7/589: dwrite d7/df/d10/d42/f9e [0,4194304] 0 2024-08-01T06:56:01.600 INFO:tasks.workunit.client.1.smithi089.stdout:4/610: creat d3/db/d33/fb6 x:0 0 0 2024-08-01T06:56:01.600 INFO:tasks.workunit.client.1.smithi089.stdout:1/612: stat d0/d9/d15/l64 0 2024-08-01T06:56:01.603 INFO:tasks.workunit.client.1.smithi089.stdout:9/559: link d18/d22/d52/c65 d18/cb2 0 2024-08-01T06:56:01.605 INFO:tasks.workunit.client.1.smithi089.stdout:7/590: symlink d7/d46/d7b/lc0 0 2024-08-01T06:56:01.606 INFO:tasks.workunit.client.1.smithi089.stdout:8/623: dread d5/dc/d12/f14 [4194304,4194304] 0 2024-08-01T06:56:01.607 INFO:tasks.workunit.client.1.smithi089.stdout:4/611: readlink d3/l76 0 2024-08-01T06:56:01.607 INFO:tasks.workunit.client.1.smithi089.stdout:2/530: dwrite d7/d1f/f4b [0,4194304] 0 2024-08-01T06:56:01.610 INFO:tasks.workunit.client.1.smithi089.stdout:1/613: creat d0/d9/d15/d3b/d3d/d77/fcb x:0 0 0 2024-08-01T06:56:01.613 INFO:tasks.workunit.client.1.smithi089.stdout:4/612: mkdir d3/d86/db7 0 2024-08-01T06:56:01.615 INFO:tasks.workunit.client.1.smithi089.stdout:8/624: chown d5/d15/d5a/d73/daa/cc4 170874653 1 2024-08-01T06:56:01.615 INFO:tasks.workunit.client.1.smithi089.stdout:9/560: symlink d18/d33/d49/d7b/d55/da6/lb3 0 2024-08-01T06:56:01.618 INFO:tasks.workunit.client.1.smithi089.stdout:4/613: write d3/d1e/f25 [2056639,114431] 0 2024-08-01T06:56:01.618 INFO:tasks.workunit.client.1.smithi089.stdout:7/591: creat d7/fc1 x:0 0 0 2024-08-01T06:56:01.618 INFO:tasks.workunit.client.1.smithi089.stdout:2/531: dwrite d7/d1f/d29/d48/d4e/fa5 [0,4194304] 0 2024-08-01T06:56:01.619 INFO:tasks.workunit.client.1.smithi089.stdout:0/694: rename d9/d40/d95/d99/d2b/d55/d7a/c6e to d9/d40/d25/d46/d91/d64/cde 0 2024-08-01T06:56:01.620 INFO:tasks.workunit.client.1.smithi089.stdout:4/614: chown d3/d68/lad 19434 1 2024-08-01T06:56:01.621 INFO:tasks.workunit.client.1.smithi089.stdout:8/625: mkdir d5/dc/d94/dc7/dc5/dd4 0 2024-08-01T06:56:01.623 INFO:tasks.workunit.client.1.smithi089.stdout:2/532: mknod d7/d19/cac 0 2024-08-01T06:56:01.623 INFO:tasks.workunit.client.1.smithi089.stdout:1/614: link d0/lb d0/d9/d54/lcc 0 2024-08-01T06:56:01.624 INFO:tasks.workunit.client.1.smithi089.stdout:7/592: symlink d7/df/d91/d98/lc2 0 2024-08-01T06:56:01.625 INFO:tasks.workunit.client.1.smithi089.stdout:4/615: dread d3/d1e/f4e [0,4194304] 0 2024-08-01T06:56:01.625 INFO:tasks.workunit.client.1.smithi089.stdout:8/626: write d5/d15/d5e/f74 [74552,129768] 0 2024-08-01T06:56:01.626 INFO:tasks.workunit.client.1.smithi089.stdout:0/695: creat d9/d40/d95/fdf x:0 0 0 2024-08-01T06:56:01.626 INFO:tasks.workunit.client.1.smithi089.stdout:3/459: sync 2024-08-01T06:56:01.626 INFO:tasks.workunit.client.1.smithi089.stdout:5/590: sync 2024-08-01T06:56:01.627 INFO:tasks.workunit.client.1.smithi089.stdout:9/561: rename d18/d22/d39/c3e to d18/d33/cb4 0 2024-08-01T06:56:01.628 INFO:tasks.workunit.client.1.smithi089.stdout:0/696: stat d9/d40/d95/dbc 0 2024-08-01T06:56:01.628 INFO:tasks.workunit.client.1.smithi089.stdout:8/627: chown d5/dc/d1e/fce 30 1 2024-08-01T06:56:01.630 INFO:tasks.workunit.client.1.smithi089.stdout:5/591: dread - d5/de/df/d9f/dbd/fbf zero size 2024-08-01T06:56:01.630 INFO:tasks.workunit.client.1.smithi089.stdout:1/615: creat d0/d9/d15/d2d/d4a/d61/fcd x:0 0 0 2024-08-01T06:56:01.632 INFO:tasks.workunit.client.1.smithi089.stdout:0/697: chown d9/d40/d95/d99/f3e 0 1 2024-08-01T06:56:01.633 INFO:tasks.workunit.client.1.smithi089.stdout:1/616: dread - d0/d9/d15/d2b/d7d/fb1 zero size 2024-08-01T06:56:01.633 INFO:tasks.workunit.client.1.smithi089.stdout:3/460: creat d7/d68/d50/d6f/d46/d47/d81/f8e x:0 0 0 2024-08-01T06:56:01.633 INFO:tasks.workunit.client.1.smithi089.stdout:5/592: readlink d5/de/d10/d16/d1b/d52/d5d/d6c/lad 0 2024-08-01T06:56:01.634 INFO:tasks.workunit.client.1.smithi089.stdout:1/617: write d0/d9/d43/f5c [4914476,82654] 0 2024-08-01T06:56:01.635 INFO:tasks.workunit.client.1.smithi089.stdout:8/628: symlink d5/d23/d91/ld5 0 2024-08-01T06:56:01.636 INFO:tasks.workunit.client.1.smithi089.stdout:0/698: mkdir d9/d40/d25/d46/de0 0 2024-08-01T06:56:01.638 INFO:tasks.workunit.client.1.smithi089.stdout:3/461: dread d7/d32/f64 [0,4194304] 0 2024-08-01T06:56:01.640 INFO:tasks.workunit.client.1.smithi089.stdout:5/593: rmdir d5/de/d10/d16/d1b/d52/d5d/d6c/d8b 39 2024-08-01T06:56:01.641 INFO:tasks.workunit.client.1.smithi089.stdout:1/618: rmdir d0/d9/d43 39 2024-08-01T06:56:01.642 INFO:tasks.workunit.client.1.smithi089.stdout:8/629: dwrite d5/d23/f38 [0,4194304] 0 2024-08-01T06:56:01.643 INFO:tasks.workunit.client.1.smithi089.stdout:3/462: creat d7/d68/d50/d54/d78/f8f x:0 0 0 2024-08-01T06:56:01.646 INFO:tasks.workunit.client.1.smithi089.stdout:0/699: rename d9/d40/d25/d46/d91/d2e/d44/d72/fc8 to d9/d40/d45/db7/fe1 0 2024-08-01T06:56:01.646 INFO:tasks.workunit.client.1.smithi089.stdout:9/562: link d18/d33/d3b/c97 d18/d22/d45/daa/cb5 0 2024-08-01T06:56:01.648 INFO:tasks.workunit.client.1.smithi089.stdout:1/619: truncate d0/f24 2250960 0 2024-08-01T06:56:01.648 INFO:tasks.workunit.client.1.smithi089.stdout:0/700: chown c8 91 1 2024-08-01T06:56:01.649 INFO:tasks.workunit.client.1.smithi089.stdout:1/620: write d0/f20 [3679807,94869] 0 2024-08-01T06:56:01.652 INFO:tasks.workunit.client.1.smithi089.stdout:9/563: mkdir d18/d33/d49/d7b/d4b/db6 0 2024-08-01T06:56:01.653 INFO:tasks.workunit.client.1.smithi089.stdout:9/564: chown f15 144039438 1 2024-08-01T06:56:01.655 INFO:tasks.workunit.client.1.smithi089.stdout:1/621: unlink d0/d9/d15/d2d/d4a/l48 0 2024-08-01T06:56:01.655 INFO:tasks.workunit.client.1.smithi089.stdout:6/675: write d2/f75 [3432049,103617] 0 2024-08-01T06:56:01.658 INFO:tasks.workunit.client.1.smithi089.stdout:5/594: rename d5/de/d10/d16/d1b/d52/d5d/d6c/d8b/cb9 to d5/ccb 0 2024-08-01T06:56:01.658 INFO:tasks.workunit.client.1.smithi089.stdout:3/463: dwrite d7/d32/d4c/d69/f20 [4194304,4194304] 0 2024-08-01T06:56:01.659 INFO:tasks.workunit.client.1.smithi089.stdout:0/701: dwrite d9/d40/d95/fdf [0,4194304] 0 2024-08-01T06:56:01.661 INFO:tasks.workunit.client.1.smithi089.stdout:5/595: read d5/d13/f65 [1274813,70380] 0 2024-08-01T06:56:01.664 INFO:tasks.workunit.client.1.smithi089.stdout:3/464: creat d7/d32/d4c/d69/d6d/f90 x:0 0 0 2024-08-01T06:56:01.665 INFO:tasks.workunit.client.1.smithi089.stdout:0/702: fdatasync d9/d40/d95/d99/d2b/d55/d7a/f84 0 2024-08-01T06:56:01.667 INFO:tasks.workunit.client.1.smithi089.stdout:0/703: chown d9/d40/d45/d47/da8/cd6 8 1 2024-08-01T06:56:01.668 INFO:tasks.workunit.client.1.smithi089.stdout:3/465: chown d7/d32/f2d 71172647 1 2024-08-01T06:56:01.668 INFO:tasks.workunit.client.1.smithi089.stdout:1/622: dwrite d0/d9/d15/d2d/f36 [0,4194304] 0 2024-08-01T06:56:01.671 INFO:tasks.workunit.client.1.smithi089.stdout:0/704: creat d9/d40/d45/d47/da8/fe2 x:0 0 0 2024-08-01T06:56:01.674 INFO:tasks.workunit.client.1.smithi089.stdout:3/466: mkdir d7/d32/d4c/d67/d72/d91 0 2024-08-01T06:56:01.674 INFO:tasks.workunit.client.1.smithi089.stdout:0/705: read d9/d40/d95/d99/f73 [96347,126655] 0 2024-08-01T06:56:01.676 INFO:tasks.workunit.client.1.smithi089.stdout:3/467: stat d7/f1f 0 2024-08-01T06:56:01.680 INFO:tasks.workunit.client.1.smithi089.stdout:4/616: truncate d3/d17/d3a/f54 3751057 0 2024-08-01T06:56:01.682 INFO:tasks.workunit.client.1.smithi089.stdout:3/468: dread - d7/d68/d50/d54/d78/f8f zero size 2024-08-01T06:56:01.683 INFO:tasks.workunit.client.1.smithi089.stdout:0/706: chown d9/d40/d25/d46/d91/d64/fc3 0 1 2024-08-01T06:56:01.686 INFO:tasks.workunit.client.1.smithi089.stdout:2/533: dwrite d7/d19/d1e/f30 [0,4194304] 0 2024-08-01T06:56:01.687 INFO:tasks.workunit.client.1.smithi089.stdout:4/617: dread - d3/db/d33/fb6 zero size 2024-08-01T06:56:01.687 INFO:tasks.workunit.client.1.smithi089.stdout:8/630: write d5/dc/d12/f4e [2390457,18282] 0 2024-08-01T06:56:01.689 INFO:tasks.workunit.client.1.smithi089.stdout:9/565: write d18/d33/d49/d7b/f41 [2656557,73719] 0 2024-08-01T06:56:01.690 INFO:tasks.workunit.client.1.smithi089.stdout:7/593: dwrite d7/df/d10/d31/f5d [0,4194304] 0 2024-08-01T06:56:01.692 INFO:tasks.workunit.client.1.smithi089.stdout:1/623: dwrite d0/d9/d43/f71 [0,4194304] 0 2024-08-01T06:56:01.700 INFO:tasks.workunit.client.1.smithi089.stdout:4/618: dread - d3/d17/d3a/d3d/fac zero size 2024-08-01T06:56:01.700 INFO:tasks.workunit.client.1.smithi089.stdout:9/566: rmdir d18/d33/d49/d7b 39 2024-08-01T06:56:01.700 INFO:tasks.workunit.client.1.smithi089.stdout:1/624: chown d0/d9/d15/d2d/d4a/d61/f67 415 1 2024-08-01T06:56:01.700 INFO:tasks.workunit.client.1.smithi089.stdout:4/619: dread - d3/d68/d7e/fb2 zero size 2024-08-01T06:56:01.701 INFO:tasks.workunit.client.1.smithi089.stdout:0/707: link d9/d40/d95/d99/d2b/f48 d9/d40/d25/fe3 0 2024-08-01T06:56:01.702 INFO:tasks.workunit.client.1.smithi089.stdout:9/567: mkdir d18/d22/d52/db7 0 2024-08-01T06:56:01.704 INFO:tasks.workunit.client.1.smithi089.stdout:8/631: rename d5/dc/d94/f8c to d5/dc/d1e/fd6 0 2024-08-01T06:56:01.707 INFO:tasks.workunit.client.1.smithi089.stdout:4/620: creat d3/fb8 x:0 0 0 2024-08-01T06:56:01.709 INFO:tasks.workunit.client.1.smithi089.stdout:2/534: dwrite d7/d19/f40 [4194304,4194304] 0 2024-08-01T06:56:01.709 INFO:tasks.workunit.client.1.smithi089.stdout:9/568: dread - d18/d33/d49/d7b/d7f/d98/d9f/d8e/f9e zero size 2024-08-01T06:56:01.709 INFO:tasks.workunit.client.1.smithi089.stdout:8/632: rmdir d5/dc/d94/dc7 39 2024-08-01T06:56:01.711 INFO:tasks.workunit.client.1.smithi089.stdout:2/535: stat d7/d1f/l56 0 2024-08-01T06:56:01.712 INFO:tasks.workunit.client.1.smithi089.stdout:4/621: unlink d3/c98 0 2024-08-01T06:56:01.712 INFO:tasks.workunit.client.1.smithi089.stdout:9/569: write d18/d33/f61 [599592,29896] 0 2024-08-01T06:56:01.714 INFO:tasks.workunit.client.1.smithi089.stdout:1/625: dwrite d0/d9/f30 [0,4194304] 0 2024-08-01T06:56:01.715 INFO:tasks.workunit.client.1.smithi089.stdout:0/708: getdents d9/d40/d25/d46/d91/d2e/d44 0 2024-08-01T06:56:01.717 INFO:tasks.workunit.client.1.smithi089.stdout:2/536: write d7/d1f/d52/f5c [490163,79602] 0 2024-08-01T06:56:01.717 INFO:tasks.workunit.client.1.smithi089.stdout:3/469: dread d7/d32/d4c/d69/f1a [0,4194304] 0 2024-08-01T06:56:01.719 INFO:tasks.workunit.client.1.smithi089.stdout:8/633: rename d5/d23/f36 to d5/dc/d1e/d53/fd7 0 2024-08-01T06:56:01.719 INFO:tasks.workunit.client.1.smithi089.stdout:0/709: dread - d9/d40/d45/d47/da8/fcd zero size 2024-08-01T06:56:01.719 INFO:tasks.workunit.client.1.smithi089.stdout:3/470: write d7/f71 [2619693,100125] 0 2024-08-01T06:56:01.721 INFO:tasks.workunit.client.1.smithi089.stdout:8/634: chown d5/dc/d1e/d53/lad 64 1 2024-08-01T06:56:01.721 INFO:tasks.workunit.client.1.smithi089.stdout:4/622: mkdir d3/db/de/d5b/db9 0 2024-08-01T06:56:01.725 INFO:tasks.workunit.client.1.smithi089.stdout:0/710: creat d9/d40/d45/fe4 x:0 0 0 2024-08-01T06:56:01.731 INFO:tasks.workunit.client.1.smithi089.stdout:1/626: mkdir d0/d9/d15/dce 0 2024-08-01T06:56:01.731 INFO:tasks.workunit.client.1.smithi089.stdout:3/471: mknod d7/c92 0 2024-08-01T06:56:01.731 INFO:tasks.workunit.client.1.smithi089.stdout:1/627: write d0/d9/d15/d76/f88 [1256147,81786] 0 2024-08-01T06:56:01.731 INFO:tasks.workunit.client.1.smithi089.stdout:4/623: creat d3/db/de/d5b/fba x:0 0 0 2024-08-01T06:56:01.731 INFO:tasks.workunit.client.1.smithi089.stdout:8/635: unlink d5/dc/d1e/f2b 0 2024-08-01T06:56:01.731 INFO:tasks.workunit.client.1.smithi089.stdout:1/628: chown d0/d9/d15/d3b/d3d/d77/dc4 3322381 1 2024-08-01T06:56:01.732 INFO:tasks.workunit.client.1.smithi089.stdout:9/570: creat d18/d33/d49/d7b/fb8 x:0 0 0 2024-08-01T06:56:01.733 INFO:tasks.workunit.client.1.smithi089.stdout:2/537: getdents d7/d1f 0 2024-08-01T06:56:01.734 INFO:tasks.workunit.client.1.smithi089.stdout:4/624: rename d3/d1f to d3/d86/d9e/db1/dbb 0 2024-08-01T06:56:01.736 INFO:tasks.workunit.client.1.smithi089.stdout:1/629: write d0/d9/d43/f71 [2684279,22443] 0 2024-08-01T06:56:01.737 INFO:tasks.workunit.client.1.smithi089.stdout:0/711: getdents d9/d40/d95/d99 0 2024-08-01T06:56:01.738 INFO:tasks.workunit.client.1.smithi089.stdout:3/472: dwrite d7/d32/d12/d29/f77 [0,4194304] 0 2024-08-01T06:56:01.741 INFO:tasks.workunit.client.1.smithi089.stdout:9/571: symlink d18/d33/d49/d7b/d81/lb9 0 2024-08-01T06:56:01.741 INFO:tasks.workunit.client.1.smithi089.stdout:1/630: write d0/d9/d15/d76/f9a [52954,37770] 0 2024-08-01T06:56:01.745 INFO:tasks.workunit.client.1.smithi089.stdout:1/631: write d0/d9/d15/d2b/f74 [315977,110064] 0 2024-08-01T06:56:01.746 INFO:tasks.workunit.client.1.smithi089.stdout:8/636: getdents d5/d23 0 2024-08-01T06:56:01.747 INFO:tasks.workunit.client.1.smithi089.stdout:0/712: creat d9/d40/d25/d46/d91/d2e/d44/d53/fe5 x:0 0 0 2024-08-01T06:56:01.748 INFO:tasks.workunit.client.1.smithi089.stdout:0/713: fsync d9/d40/d45/d47/fc0 0 2024-08-01T06:56:01.749 INFO:tasks.workunit.client.1.smithi089.stdout:0/714: readlink d9/d40/d95/d99/d2b/l35 0 2024-08-01T06:56:01.749 INFO:tasks.workunit.client.1.smithi089.stdout:0/715: readlink d9/d40/d45/la6 0 2024-08-01T06:56:01.749 INFO:tasks.workunit.client.1.smithi089.stdout:0/716: readlink d9/d40/d45/la6 0 2024-08-01T06:56:01.750 INFO:tasks.workunit.client.1.smithi089.stdout:9/572: creat d18/d33/d49/d7b/d7f/d98/d9f/fba x:0 0 0 2024-08-01T06:56:01.752 INFO:tasks.workunit.client.1.smithi089.stdout:2/538: getdents d7/d1f/d29/d48 0 2024-08-01T06:56:01.753 INFO:tasks.workunit.client.1.smithi089.stdout:4/625: dread d3/d68/f7f [0,4194304] 0 2024-08-01T06:56:01.754 INFO:tasks.workunit.client.1.smithi089.stdout:8/637: symlink d5/d23/ld8 0 2024-08-01T06:56:01.757 INFO:tasks.workunit.client.1.smithi089.stdout:2/539: fdatasync f2 0 2024-08-01T06:56:01.759 INFO:tasks.workunit.client.1.smithi089.stdout:3/473: link d7/d68/d50/d6f/d2f/l3b d7/d68/d50/l93 0 2024-08-01T06:56:01.760 INFO:tasks.workunit.client.1.smithi089.stdout:3/474: read - d7/d68/d50/d54/f87 zero size 2024-08-01T06:56:01.761 INFO:tasks.workunit.client.1.smithi089.stdout:8/638: link d5/f10 d5/dc/d94/d84/fd9 0 2024-08-01T06:56:01.763 INFO:tasks.workunit.client.1.smithi089.stdout:2/540: write d7/d1f/d28/fa3 [4394645,130015] 0 2024-08-01T06:56:01.763 INFO:tasks.workunit.client.1.smithi089.stdout:1/632: dread d0/f20 [0,4194304] 0 2024-08-01T06:56:01.764 INFO:tasks.workunit.client.1.smithi089.stdout:9/573: getdents d18/d33/d49/d7b/d7f 0 2024-08-01T06:56:01.766 INFO:tasks.workunit.client.1.smithi089.stdout:0/717: dread d9/d40/d25/d46/d91/d2e/d3a/f97 [0,4194304] 0 2024-08-01T06:56:01.767 INFO:tasks.workunit.client.1.smithi089.stdout:1/633: symlink d0/d9/d43/d4b/lcf 0 2024-08-01T06:56:01.768 INFO:tasks.workunit.client.1.smithi089.stdout:8/639: getdents d5/dc/d12 0 2024-08-01T06:56:01.770 INFO:tasks.workunit.client.1.smithi089.stdout:1/634: write d0/d9/d15/d3b/f3c [1614211,71455] 0 2024-08-01T06:56:01.771 INFO:tasks.workunit.client.1.smithi089.stdout:2/541: creat d7/d19/d1e/d3d/fad x:0 0 0 2024-08-01T06:56:01.771 INFO:tasks.workunit.client.1.smithi089.stdout:3/475: dwrite d7/d32/d12/d29/f77 [0,4194304] 0 2024-08-01T06:56:01.772 INFO:tasks.workunit.client.1.smithi089.stdout:9/574: getdents d18/d33/d49/d7b/d81 0 2024-08-01T06:56:01.773 INFO:tasks.workunit.client.1.smithi089.stdout:8/640: symlink d5/dc/dca/lda 0 2024-08-01T06:56:01.774 INFO:tasks.workunit.client.1.smithi089.stdout:2/542: creat d7/d1f/fae x:0 0 0 2024-08-01T06:56:01.775 INFO:tasks.workunit.client.1.smithi089.stdout:1/635: creat d0/d9/d43/d4b/db0/fd0 x:0 0 0 2024-08-01T06:56:01.776 INFO:tasks.workunit.client.1.smithi089.stdout:0/718: truncate d9/d40/d25/d46/d91/d64/f6a 158513 0 2024-08-01T06:56:01.776 INFO:tasks.workunit.client.1.smithi089.stdout:3/476: creat d7/d32/d12/d29/d39/d4b/f94 x:0 0 0 2024-08-01T06:56:01.777 INFO:tasks.workunit.client.1.smithi089.stdout:8/641: mkdir d5/dc/d94/d84/ddb 0 2024-08-01T06:56:01.777 INFO:tasks.workunit.client.1.smithi089.stdout:3/477: stat d7/d32/d12/d29/d39/c4d 0 2024-08-01T06:56:01.778 INFO:tasks.workunit.client.1.smithi089.stdout:9/575: mkdir d18/d33/d49/d7b/d4b/dbb 0 2024-08-01T06:56:01.778 INFO:tasks.workunit.client.1.smithi089.stdout:1/636: fsync d0/f13 0 2024-08-01T06:56:01.781 INFO:tasks.workunit.client.1.smithi089.stdout:8/642: truncate d5/d15/d5a/fb4 75572 0 2024-08-01T06:56:01.782 INFO:tasks.workunit.client.1.smithi089.stdout:0/719: truncate d9/d40/d25/d46/d91/d2e/d44/d53/f9a 5145661 0 2024-08-01T06:56:01.785 INFO:tasks.workunit.client.1.smithi089.stdout:8/643: mknod d5/dc/d12/cdc 0 2024-08-01T06:56:01.786 INFO:tasks.workunit.client.1.smithi089.stdout:2/543: mkdir d7/d1f/d29/d48/d4e/d64/d9c/daf 0 2024-08-01T06:56:01.787 INFO:tasks.workunit.client.1.smithi089.stdout:2/544: write d7/d1f/d29/d48/d4e/d9e/f87 [898314,28312] 0 2024-08-01T06:56:01.787 INFO:tasks.workunit.client.1.smithi089.stdout:3/478: unlink d7/d68/d50/d54/l57 0 2024-08-01T06:56:01.788 INFO:tasks.workunit.client.1.smithi089.stdout:9/576: creat d18/d33/d49/d7b/d4b/dbb/fbc x:0 0 0 2024-08-01T06:56:01.788 INFO:tasks.workunit.client.1.smithi089.stdout:3/479: fdatasync d7/d32/d12/d1b/f51 0 2024-08-01T06:56:01.790 INFO:tasks.workunit.client.1.smithi089.stdout:8/644: creat d5/d15/d5e/fdd x:0 0 0 2024-08-01T06:56:01.790 INFO:tasks.workunit.client.1.smithi089.stdout:1/637: write d0/d9/d15/f6b [3121842,119560] 0 2024-08-01T06:56:01.794 INFO:tasks.workunit.client.1.smithi089.stdout:2/545: unlink d7/d1f/d52/f5c 0 2024-08-01T06:56:01.795 INFO:tasks.workunit.client.1.smithi089.stdout:1/638: fdatasync d0/d9/d15/d3b/d95/fb2 0 2024-08-01T06:56:01.798 INFO:tasks.workunit.client.1.smithi089.stdout:3/480: creat d7/d32/d12/d29/f95 x:0 0 0 2024-08-01T06:56:01.799 INFO:tasks.workunit.client.1.smithi089.stdout:1/639: unlink d0/d9/d15/f6b 0 2024-08-01T06:56:01.800 INFO:tasks.workunit.client.1.smithi089.stdout:2/546: dwrite d7/f23 [0,4194304] 0 2024-08-01T06:56:01.800 INFO:tasks.workunit.client.1.smithi089.stdout:0/720: truncate d9/d40/d95/d99/d2b/f80 578207 0 2024-08-01T06:56:01.806 INFO:tasks.workunit.client.1.smithi089.stdout:8/645: dread d5/f9c [0,4194304] 0 2024-08-01T06:56:01.807 INFO:tasks.workunit.client.1.smithi089.stdout:2/547: rename d7/d19/d1e/c36 to d7/d1f/d28/cb0 0 2024-08-01T06:56:01.808 INFO:tasks.workunit.client.1.smithi089.stdout:3/481: dread d7/d32/d12/d29/d39/f6c [0,4194304] 0 2024-08-01T06:56:01.809 INFO:tasks.workunit.client.1.smithi089.stdout:2/548: chown d7/c9 3126649 1 2024-08-01T06:56:01.815 INFO:tasks.workunit.client.1.smithi089.stdout:2/549: dread d7/d19/d1e/d5b/f8e [0,4194304] 0 2024-08-01T06:56:01.816 INFO:tasks.workunit.client.1.smithi089.stdout:8/646: dwrite d5/dc/d1e/fce [0,4194304] 0 2024-08-01T06:56:01.817 INFO:tasks.workunit.client.1.smithi089.stdout:3/482: dwrite d7/d32/d12/d29/d39/f6c [0,4194304] 0 2024-08-01T06:56:01.819 INFO:tasks.workunit.client.1.smithi089.stdout:2/550: write d7/d1f/d52/d6e/f9d [870202,39668] 0 2024-08-01T06:56:01.820 INFO:tasks.workunit.client.1.smithi089.stdout:8/647: rename d5/d15/d5a to d5/d15/d5a/d73/daa/db3/dde 22 2024-08-01T06:56:01.823 INFO:tasks.workunit.client.1.smithi089.stdout:1/640: dread d0/d9/d15/d3b/d95/d49/f65 [4194304,4194304] 0 2024-08-01T06:56:01.824 INFO:tasks.workunit.client.1.smithi089.stdout:3/483: creat d7/d32/d4c/d69/f96 x:0 0 0 2024-08-01T06:56:01.825 INFO:tasks.workunit.client.1.smithi089.stdout:3/484: stat d7/d32/d12/d29/f77 0 2024-08-01T06:56:01.826 INFO:tasks.workunit.client.1.smithi089.stdout:3/485: write d7/d32/d4c/d69/f56 [24356,9208] 0 2024-08-01T06:56:01.827 INFO:tasks.workunit.client.1.smithi089.stdout:1/641: symlink d0/ld1 0 2024-08-01T06:56:01.829 INFO:tasks.workunit.client.1.smithi089.stdout:1/642: chown d0/d9/d15/d2d/d4a/d4d/f6d 31 1 2024-08-01T06:56:01.831 INFO:tasks.workunit.client.1.smithi089.stdout:2/551: link d7/d19/d3b/caa d7/d19/d68/cb1 0 2024-08-01T06:56:01.832 INFO:tasks.workunit.client.1.smithi089.stdout:8/648: creat d5/d23/dd3/fdf x:0 0 0 2024-08-01T06:56:01.833 INFO:tasks.workunit.client.1.smithi089.stdout:2/552: write d7/d1f/fae [165071,28418] 0 2024-08-01T06:56:01.834 INFO:tasks.workunit.client.1.smithi089.stdout:2/553: fsync d7/f23 0 2024-08-01T06:56:01.835 INFO:tasks.workunit.client.1.smithi089.stdout:3/486: dwrite d7/f71 [4194304,4194304] 0 2024-08-01T06:56:01.838 INFO:tasks.workunit.client.1.smithi089.stdout:2/554: mknod d7/d1f/d29/d48/d4e/d9e/cb2 0 2024-08-01T06:56:01.840 INFO:tasks.workunit.client.1.smithi089.stdout:3/487: mknod d7/d68/d50/d89/c97 0 2024-08-01T06:56:01.841 INFO:tasks.workunit.client.1.smithi089.stdout:8/649: rename d5/d15/d5a/d73/c88 to d5/dc/d94/dc7/ce0 0 2024-08-01T06:56:01.841 INFO:tasks.workunit.client.1.smithi089.stdout:3/488: write d7/d32/d12/f33 [2947958,10821] 0 2024-08-01T06:56:01.842 INFO:tasks.workunit.client.1.smithi089.stdout:2/555: rmdir d7/d1f/d29/d48/d4e/d64/d9c 39 2024-08-01T06:56:01.847 INFO:tasks.workunit.client.1.smithi089.stdout:2/556: mknod d7/d1f/d29/d48/cb3 0 2024-08-01T06:56:01.849 INFO:tasks.workunit.client.1.smithi089.stdout:3/489: creat d7/d32/f98 x:0 0 0 2024-08-01T06:56:01.850 INFO:tasks.workunit.client.1.smithi089.stdout:2/557: creat d7/d19/fb4 x:0 0 0 2024-08-01T06:56:01.851 INFO:tasks.workunit.client.1.smithi089.stdout:8/650: creat d5/d23/fe1 x:0 0 0 2024-08-01T06:56:01.852 INFO:tasks.workunit.client.1.smithi089.stdout:3/490: creat d7/d32/d4c/d53/f99 x:0 0 0 2024-08-01T06:56:01.853 INFO:tasks.workunit.client.1.smithi089.stdout:2/558: mkdir d7/d19/db5 0 2024-08-01T06:56:01.854 INFO:tasks.workunit.client.1.smithi089.stdout:8/651: creat d5/d15/d5a/d73/fe2 x:0 0 0 2024-08-01T06:56:01.855 INFO:tasks.workunit.client.1.smithi089.stdout:3/491: write d7/d68/d50/d54/f87 [800018,74648] 0 2024-08-01T06:56:01.856 INFO:tasks.workunit.client.1.smithi089.stdout:8/652: creat d5/d15/d5e/fe3 x:0 0 0 2024-08-01T06:56:01.856 INFO:tasks.workunit.client.1.smithi089.stdout:1/643: write d0/d9/d15/f52 [1229111,52078] 0 2024-08-01T06:56:01.901 INFO:tasks.workunit.client.1.smithi089.stdout:6/676: sync 2024-08-01T06:56:01.917 INFO:tasks.workunit.client.1.smithi089.stdout:3/492: getdents d7/d32/d12/d29/d39 0 2024-08-01T06:56:01.917 INFO:tasks.workunit.client.1.smithi089.stdout:8/653: dwrite d5/dc/d1e/f34 [0,4194304] 0 2024-08-01T06:56:01.918 INFO:tasks.workunit.client.1.smithi089.stdout:6/677: mknod d2/d11/d1a/d1c/d40/ce5 0 2024-08-01T06:56:01.969 INFO:tasks.workunit.client.1.smithi089.stdout:8/654: creat d5/d15/d5e/fe4 x:0 0 0 2024-08-01T06:56:01.971 INFO:tasks.workunit.client.1.smithi089.stdout:1/644: dwrite d0/d9/d15/d3b/d3d/fc0 [0,4194304] 0 2024-08-01T06:56:01.974 INFO:tasks.workunit.client.1.smithi089.stdout:8/655: creat d5/dc/d94/dc7/fe5 x:0 0 0 2024-08-01T06:56:01.974 INFO:tasks.workunit.client.1.smithi089.stdout:3/493: getdents d7/d32/d4c/d67 0 2024-08-01T06:56:01.975 INFO:tasks.workunit.client.1.smithi089.stdout:6/678: link d2/d11/c1e d2/d2e/d2f/d91/ce6 0 2024-08-01T06:56:01.976 INFO:tasks.workunit.client.1.smithi089.stdout:8/656: creat d5/dc/dca/fe6 x:0 0 0 2024-08-01T06:56:01.978 INFO:tasks.workunit.client.1.smithi089.stdout:8/657: fdatasync d5/dc/d1e/d53/f60 0 2024-08-01T06:56:01.983 INFO:tasks.workunit.client.1.smithi089.stdout:1/645: truncate d0/d9/d15/d3b/f3c 2165944 0 2024-08-01T06:56:01.984 INFO:tasks.workunit.client.1.smithi089.stdout:8/658: dread d5/d15/d5e/f74 [0,4194304] 0 2024-08-01T06:56:01.984 INFO:tasks.workunit.client.1.smithi089.stdout:3/494: dread d7/d68/d50/d6f/f49 [0,4194304] 0 2024-08-01T06:56:01.986 INFO:tasks.workunit.client.1.smithi089.stdout:3/495: symlink d7/d32/d4c/l9a 0 2024-08-01T06:56:01.986 INFO:tasks.workunit.client.1.smithi089.stdout:8/659: truncate d5/d15/d5e/fe4 431945 0 2024-08-01T06:56:01.989 INFO:tasks.workunit.client.1.smithi089.stdout:6/679: dwrite d2/fd8 [0,4194304] 0 2024-08-01T06:56:01.990 INFO:tasks.workunit.client.1.smithi089.stdout:8/660: creat d5/dc/d94/d84/ddb/fe7 x:0 0 0 2024-08-01T06:56:01.991 INFO:tasks.workunit.client.1.smithi089.stdout:3/496: truncate d7/d32/d4c/d69/f2e 241282 0 2024-08-01T06:56:01.992 INFO:tasks.workunit.client.1.smithi089.stdout:8/661: write d5/dc/d1e/f47 [3678055,120063] 0 2024-08-01T06:56:01.995 INFO:tasks.workunit.client.1.smithi089.stdout:5/596: sync 2024-08-01T06:56:01.995 INFO:tasks.workunit.client.1.smithi089.stdout:6/680: rename d2/d11/d1a/d1c/f52 to d2/d30/fe7 0 2024-08-01T06:56:01.995 INFO:tasks.workunit.client.1.smithi089.stdout:8/662: read d5/dc/d94/d84/fd9 [115332,8807] 0 2024-08-01T06:56:01.997 INFO:tasks.workunit.client.1.smithi089.stdout:6/681: write d2/d11/d1f/d46/f72 [1221964,127030] 0 2024-08-01T06:56:01.997 INFO:tasks.workunit.client.1.smithi089.stdout:8/663: dread - d5/dc/d1e/f95 zero size 2024-08-01T06:56:01.998 INFO:tasks.workunit.client.1.smithi089.stdout:6/682: chown d2/d11/d1f/l22 1 1 2024-08-01T06:56:01.999 INFO:tasks.workunit.client.1.smithi089.stdout:3/497: rename d7/d68/d50/d6f/d46/d47/d81/f8e to d7/d32/d12/d29/d39/d4b/d83/f9b 0 2024-08-01T06:56:01.999 INFO:tasks.workunit.client.1.smithi089.stdout:1/646: truncate d0/d9/d15/d2d/d4a/fa9 214864 0 2024-08-01T06:56:02.000 INFO:tasks.workunit.client.1.smithi089.stdout:3/498: truncate d7/d32/d12/f41 1823312 0 2024-08-01T06:56:02.003 INFO:tasks.workunit.client.1.smithi089.stdout:8/664: creat d5/dc/d12/db9/fe8 x:0 0 0 2024-08-01T06:56:02.004 INFO:tasks.workunit.client.1.smithi089.stdout:6/683: mknod d2/d11/d1a/d1c/db6/ce8 0 2024-08-01T06:56:02.005 INFO:tasks.workunit.client.1.smithi089.stdout:3/499: mkdir d7/d68/d50/d6f/d2f/d9c 0 2024-08-01T06:56:02.007 INFO:tasks.workunit.client.1.smithi089.stdout:5/597: dwrite d5/de/d10/d16/d1b/d25/f74 [0,4194304] 0 2024-08-01T06:56:02.007 INFO:tasks.workunit.client.1.smithi089.stdout:1/647: symlink d0/d9/d15/dce/ld2 0 2024-08-01T06:56:02.008 INFO:tasks.workunit.client.1.smithi089.stdout:5/598: chown d5/d13/d38/c2f 61166862 1 2024-08-01T06:56:02.009 INFO:tasks.workunit.client.1.smithi089.stdout:6/684: readlink d2/d11/d1f/d46/d6b/l79 0 2024-08-01T06:56:02.010 INFO:tasks.workunit.client.1.smithi089.stdout:5/599: write d5/de/d57/d8e/d97/da5/fc9 [483389,92078] 0 2024-08-01T06:56:02.011 INFO:tasks.workunit.client.1.smithi089.stdout:8/665: truncate d5/dc/d12/f40 400338 0 2024-08-01T06:56:02.014 INFO:tasks.workunit.client.1.smithi089.stdout:8/666: readlink d5/d23/d91/lb8 0 2024-08-01T06:56:02.016 INFO:tasks.workunit.client.1.smithi089.stdout:8/667: readlink d5/l13 0 2024-08-01T06:56:02.016 INFO:tasks.workunit.client.1.smithi089.stdout:1/648: dwrite d0/d9/d15/d76/f80 [4194304,4194304] 0 2024-08-01T06:56:02.017 INFO:tasks.workunit.client.1.smithi089.stdout:3/500: dread d7/d32/f2d [0,4194304] 0 2024-08-01T06:56:02.027 INFO:tasks.workunit.client.1.smithi089.stdout:3/501: creat d7/d68/d50/d6f/d2f/d9c/f9d x:0 0 0 2024-08-01T06:56:02.028 INFO:tasks.workunit.client.1.smithi089.stdout:1/649: rmdir d0/d9/d43/d4b/dc6 0 2024-08-01T06:56:02.029 INFO:tasks.workunit.client.1.smithi089.stdout:1/650: rmdir d0/d9/d15/d3b/d95/d49/d82/da6 39 2024-08-01T06:56:02.030 INFO:tasks.workunit.client.1.smithi089.stdout:1/651: fdatasync d0/d9/d43/d89/fb6 0 2024-08-01T06:56:02.031 INFO:tasks.workunit.client.1.smithi089.stdout:3/502: write d7/d32/f2d [3021277,28503] 0 2024-08-01T06:56:02.033 INFO:tasks.workunit.client.1.smithi089.stdout:3/503: write d7/f71 [8804656,90736] 0 2024-08-01T06:56:02.079 INFO:tasks.workunit.client.1.smithi089.stdout:7/594: sync 2024-08-01T06:56:02.079 INFO:tasks.workunit.client.1.smithi089.stdout:2/559: sync 2024-08-01T06:56:02.080 INFO:tasks.workunit.client.1.smithi089.stdout:9/577: sync 2024-08-01T06:56:02.080 INFO:tasks.workunit.client.1.smithi089.stdout:4/626: sync 2024-08-01T06:56:02.080 INFO:tasks.workunit.client.1.smithi089.stdout:0/721: sync 2024-08-01T06:56:02.083 INFO:tasks.workunit.client.1.smithi089.stdout:3/504: fdatasync d7/d32/d12/d1b/f4a 0 2024-08-01T06:56:02.084 INFO:tasks.workunit.client.1.smithi089.stdout:2/560: readlink d7/d1f/d29/l2b 0 2024-08-01T06:56:02.084 INFO:tasks.workunit.client.1.smithi089.stdout:4/627: symlink d3/db/d16/lbc 0 2024-08-01T06:56:02.084 INFO:tasks.workunit.client.1.smithi089.stdout:0/722: fdatasync d9/d40/d45/d47/da8/fe2 0 2024-08-01T06:56:02.084 INFO:tasks.workunit.client.1.smithi089.stdout:1/652: dwrite d0/d9/d43/d4b/db0/fbd [0,4194304] 0 2024-08-01T06:56:02.085 INFO:tasks.workunit.client.1.smithi089.stdout:7/595: mknod d7/d1f/da6/dbb/cc3 0 2024-08-01T06:56:02.087 INFO:tasks.workunit.client.1.smithi089.stdout:9/578: getdents d18/d33/d49/d7b/d7f/d98 0 2024-08-01T06:56:02.089 INFO:tasks.workunit.client.1.smithi089.stdout:1/653: mkdir d0/d9/d15/dce/dd3 0 2024-08-01T06:56:02.089 INFO:tasks.workunit.client.1.smithi089.stdout:9/579: write d18/f1d [1375762,16390] 0 2024-08-01T06:56:02.091 INFO:tasks.workunit.client.1.smithi089.stdout:0/723: creat d9/d40/d25/d46/d91/d2e/d44/d72/d8b/fe6 x:0 0 0 2024-08-01T06:56:02.091 INFO:tasks.workunit.client.1.smithi089.stdout:7/596: write d7/df/d91/da4/f37 [2048426,83326] 0 2024-08-01T06:56:02.091 INFO:tasks.workunit.client.1.smithi089.stdout:2/561: symlink d7/d1f/d29/d48/d4e/d64/d9c/daf/lb6 0 2024-08-01T06:56:02.092 INFO:tasks.workunit.client.1.smithi089.stdout:9/580: chown d18/d33/d49/d7b/ca5 136914 1 2024-08-01T06:56:02.092 INFO:tasks.workunit.client.1.smithi089.stdout:1/654: creat d0/d9/d15/d76/fd4 x:0 0 0 2024-08-01T06:56:02.094 INFO:tasks.workunit.client.1.smithi089.stdout:9/581: rename d18/d33/d49/d7b to d18/d33/d49/d7b/d7f/d98/dbd 22 2024-08-01T06:56:02.094 INFO:tasks.workunit.client.1.smithi089.stdout:0/724: read d9/d40/d25/d46/d91/d2e/d3a/f8e [36434,19126] 0 2024-08-01T06:56:02.095 INFO:tasks.workunit.client.1.smithi089.stdout:7/597: unlink d7/df/d10/d42/f48 0 2024-08-01T06:56:02.098 INFO:tasks.workunit.client.1.smithi089.stdout:7/598: mkdir d7/df/d10/d31/dc4 0 2024-08-01T06:56:02.102 INFO:tasks.workunit.client.1.smithi089.stdout:0/725: creat d9/fe7 x:0 0 0 2024-08-01T06:56:02.102 INFO:tasks.workunit.client.1.smithi089.stdout:7/599: creat d7/d1f/d30/dab/fc5 x:0 0 0 2024-08-01T06:56:02.103 INFO:tasks.workunit.client.1.smithi089.stdout:4/628: dwrite d3/d86/d9e/d26/f61 [0,4194304] 0 2024-08-01T06:56:02.106 INFO:tasks.workunit.client.1.smithi089.stdout:0/726: rmdir d9/d40/d95/dbc 0 2024-08-01T06:56:02.107 INFO:tasks.workunit.client.1.smithi089.stdout:4/629: creat d3/d17/fbd x:0 0 0 2024-08-01T06:56:02.107 INFO:tasks.workunit.client.1.smithi089.stdout:2/562: dread d7/d19/f44 [0,4194304] 0 2024-08-01T06:56:02.109 INFO:tasks.workunit.client.1.smithi089.stdout:2/563: write d7/d19/d1e/f8a [440363,44189] 0 2024-08-01T06:56:02.112 INFO:tasks.workunit.client.1.smithi089.stdout:4/630: truncate d3/db/de/f9d 256701 0 2024-08-01T06:56:02.116 INFO:tasks.workunit.client.1.smithi089.stdout:0/727: dwrite d9/d40/d95/d99/d2b/f82 [0,4194304] 0 2024-08-01T06:56:02.117 INFO:tasks.workunit.client.1.smithi089.stdout:2/564: rename d7/d1f/d9f to d7/d1f/d29/db7 0 2024-08-01T06:56:02.121 INFO:tasks.workunit.client.1.smithi089.stdout:0/728: rename d9/d40/d45/fa0 to d9/d40/d25/d46/d91/d2e/d44/d53/fe8 0 2024-08-01T06:56:02.125 INFO:tasks.workunit.client.1.smithi089.stdout:2/565: dwrite d7/d19/d1e/fa0 [4194304,4194304] 0 2024-08-01T06:56:02.126 INFO:tasks.workunit.client.1.smithi089.stdout:2/566: readlink d7/d19/d1e/l47 0 2024-08-01T06:56:02.128 INFO:tasks.workunit.client.1.smithi089.stdout:2/567: write d7/d4a/f6d [285047,6854] 0 2024-08-01T06:56:02.137 INFO:tasks.workunit.client.1.smithi089.stdout:2/568: dwrite d7/f23 [0,4194304] 0 2024-08-01T06:56:02.142 INFO:tasks.workunit.client.1.smithi089.stdout:0/729: dread d9/d40/d95/d99/d2b/f48 [0,4194304] 0 2024-08-01T06:56:02.143 INFO:tasks.workunit.client.1.smithi089.stdout:2/569: creat d7/d1f/d29/d48/d4e/fb8 x:0 0 0 2024-08-01T06:56:02.144 INFO:tasks.workunit.client.1.smithi089.stdout:0/730: readlink d9/d40/d25/d46/d91/d2e/d44/d72/lbb 0 2024-08-01T06:56:02.145 INFO:tasks.workunit.client.1.smithi089.stdout:0/731: chown d9/d40/d45/d47/d9d/fd7 2740 1 2024-08-01T06:56:02.146 INFO:tasks.workunit.client.1.smithi089.stdout:0/732: read - d9/d40/d45/d47/da8/fb3 zero size 2024-08-01T06:56:02.148 INFO:tasks.workunit.client.1.smithi089.stdout:0/733: readlink d9/d40/d25/d46/d91/d2e/d44/d72/lbb 0 2024-08-01T06:56:02.151 INFO:tasks.workunit.client.1.smithi089.stdout:2/570: dread f2 [4194304,4194304] 0 2024-08-01T06:56:02.151 INFO:tasks.workunit.client.1.smithi089.stdout:4/631: dread d3/d86/d9e/f60 [0,4194304] 0 2024-08-01T06:56:02.164 INFO:tasks.workunit.client.1.smithi089.stdout:6/685: sync 2024-08-01T06:56:02.165 INFO:tasks.workunit.client.1.smithi089.stdout:5/600: sync 2024-08-01T06:56:02.165 INFO:tasks.workunit.client.1.smithi089.stdout:8/668: sync 2024-08-01T06:56:02.166 INFO:tasks.workunit.client.1.smithi089.stdout:0/734: dread d9/d40/d25/d46/d91/d2e/fce [0,4194304] 0 2024-08-01T06:56:02.166 INFO:tasks.workunit.client.1.smithi089.stdout:6/686: fsync d2/d11/d1a/fc8 0 2024-08-01T06:56:02.166 INFO:tasks.workunit.client.1.smithi089.stdout:5/601: fsync d5/de/d10/d16/d1b/d25/f74 0 2024-08-01T06:56:02.167 INFO:tasks.workunit.client.1.smithi089.stdout:2/571: dread d7/d1f/d52/d6e/f9d [0,4194304] 0 2024-08-01T06:56:02.168 INFO:tasks.workunit.client.1.smithi089.stdout:8/669: mkdir d5/dc/de9 0 2024-08-01T06:56:02.170 INFO:tasks.workunit.client.1.smithi089.stdout:0/735: unlink d9/l2d 0 2024-08-01T06:56:02.174 INFO:tasks.workunit.client.1.smithi089.stdout:4/632: dwrite d3/db/d33/f6f [0,4194304] 0 2024-08-01T06:56:02.179 INFO:tasks.workunit.client.1.smithi089.stdout:8/670: dwrite d5/d23/d91/f78 [0,4194304] 0 2024-08-01T06:56:02.180 INFO:tasks.workunit.client.1.smithi089.stdout:0/736: mknod d9/d40/d45/db7/ce9 0 2024-08-01T06:56:02.180 INFO:tasks.workunit.client.1.smithi089.stdout:2/572: dwrite d7/d1f/d29/d48/d4e/fa5 [4194304,4194304] 0 2024-08-01T06:56:02.186 INFO:tasks.workunit.client.1.smithi089.stdout:8/671: creat d5/dc/d1e/d53/fea x:0 0 0 2024-08-01T06:56:02.190 INFO:tasks.workunit.client.1.smithi089.stdout:2/573: creat d7/d1f/d29/d48/d4e/d64/d9c/daf/fb9 x:0 0 0 2024-08-01T06:56:02.192 INFO:tasks.workunit.client.1.smithi089.stdout:4/633: mkdir d3/db/de/dbe 0 2024-08-01T06:56:02.195 INFO:tasks.workunit.client.1.smithi089.stdout:0/737: rename d9/d40/d95/d99/d2b/c8a to d9/d40/d25/d46/cea 0 2024-08-01T06:56:02.200 INFO:tasks.workunit.client.1.smithi089.stdout:8/672: symlink d5/dc/leb 0 2024-08-01T06:56:02.201 INFO:tasks.workunit.client.1.smithi089.stdout:5/602: write d5/f3c [1886139,83417] 0 2024-08-01T06:56:02.202 INFO:tasks.workunit.client.1.smithi089.stdout:5/603: read - d5/d13/d43/fbc zero size 2024-08-01T06:56:02.203 INFO:tasks.workunit.client.1.smithi089.stdout:0/738: mkdir d9/d40/d25/d46/d91/d2e/d44/d53/deb 0 2024-08-01T06:56:02.204 INFO:tasks.workunit.client.1.smithi089.stdout:5/604: stat d5/de/df/d9f/cab 0 2024-08-01T06:56:02.207 INFO:tasks.workunit.client.1.smithi089.stdout:8/673: creat d5/d15/d5a/d73/d87/fec x:0 0 0 2024-08-01T06:56:02.208 INFO:tasks.workunit.client.1.smithi089.stdout:2/574: creat d7/d1f/fba x:0 0 0 2024-08-01T06:56:02.209 INFO:tasks.workunit.client.1.smithi089.stdout:6/687: dwrite d2/d30/d3c/d3d/f71 [0,4194304] 0 2024-08-01T06:56:02.209 INFO:tasks.workunit.client.1.smithi089.stdout:8/674: readlink d5/d15/d5e/la8 0 2024-08-01T06:56:02.210 INFO:tasks.workunit.client.1.smithi089.stdout:6/688: fdatasync d2/f8 0 2024-08-01T06:56:02.210 INFO:tasks.workunit.client.1.smithi089.stdout:2/575: write d7/d1f/fba [953259,106518] 0 2024-08-01T06:56:02.212 INFO:tasks.workunit.client.1.smithi089.stdout:6/689: dread - d2/d2e/d2f/d9e/fc7 zero size 2024-08-01T06:56:02.221 INFO:tasks.workunit.client.1.smithi089.stdout:2/576: dwrite d7/d1f/d29/d48/d4e/fb8 [0,4194304] 0 2024-08-01T06:56:02.221 INFO:tasks.workunit.client.1.smithi089.stdout:4/634: dread d3/d86/d9e/f41 [4194304,4194304] 0 2024-08-01T06:56:02.222 INFO:tasks.workunit.client.1.smithi089.stdout:6/690: creat d2/d2e/d98/fe9 x:0 0 0 2024-08-01T06:56:02.222 INFO:tasks.workunit.client.1.smithi089.stdout:4/635: fsync d3/f24 0 2024-08-01T06:56:02.224 INFO:tasks.workunit.client.1.smithi089.stdout:2/577: write d7/d1f/d29/f1a [583172,87597] 0 2024-08-01T06:56:02.225 INFO:tasks.workunit.client.1.smithi089.stdout:8/675: link d5/f1a d5/dc/d1e/fed 0 2024-08-01T06:56:02.227 INFO:tasks.workunit.client.1.smithi089.stdout:5/605: dread d5/de/d10/f3d [0,4194304] 0 2024-08-01T06:56:02.227 INFO:tasks.workunit.client.1.smithi089.stdout:8/676: readlink d5/dc/d1e/d53/lad 0 2024-08-01T06:56:02.228 INFO:tasks.workunit.client.1.smithi089.stdout:2/578: read - d7/d19/d1e/d3d/d60/f8c zero size 2024-08-01T06:56:02.229 INFO:tasks.workunit.client.1.smithi089.stdout:2/579: chown d7/d19/f37 1 1 2024-08-01T06:56:02.235 INFO:tasks.workunit.client.1.smithi089.stdout:5/606: mknod d5/de/df/d9f/dbd/ccc 0 2024-08-01T06:56:02.235 INFO:tasks.workunit.client.1.smithi089.stdout:5/607: chown d5/de/f80 34 1 2024-08-01T06:56:02.236 INFO:tasks.workunit.client.1.smithi089.stdout:6/691: mkdir d2/d11/d1a/d1c/dea 0 2024-08-01T06:56:02.237 INFO:tasks.workunit.client.1.smithi089.stdout:0/739: write d9/f33 [777252,15983] 0 2024-08-01T06:56:02.238 INFO:tasks.workunit.client.1.smithi089.stdout:4/636: symlink d3/db/de/d5b/db9/lbf 0 2024-08-01T06:56:02.238 INFO:tasks.workunit.client.1.smithi089.stdout:5/608: truncate d5/de/d10/d16/d1b/d25/d4d/f9b 1104293 0 2024-08-01T06:56:02.239 INFO:tasks.workunit.client.1.smithi089.stdout:0/740: fdatasync d9/d40/d25/d46/d91/d64/fc3 0 2024-08-01T06:56:02.239 INFO:tasks.workunit.client.1.smithi089.stdout:8/677: truncate d5/dc/d94/dc7/dc5/fc8 264863 0 2024-08-01T06:56:02.241 INFO:tasks.workunit.client.1.smithi089.stdout:6/692: rmdir d2/d11/d3e 39 2024-08-01T06:56:02.242 INFO:tasks.workunit.client.1.smithi089.stdout:0/741: truncate d9/d40/d45/d47/da8/fac 542642 0 2024-08-01T06:56:02.246 INFO:tasks.workunit.client.1.smithi089.stdout:5/609: unlink d5/de/d57/fc8 0 2024-08-01T06:56:02.246 INFO:tasks.workunit.client.1.smithi089.stdout:4/637: dread d3/d1e/f25 [0,4194304] 0 2024-08-01T06:56:02.248 INFO:tasks.workunit.client.1.smithi089.stdout:0/742: dwrite d9/d40/d95/d99/dba/fd4 [0,4194304] 0 2024-08-01T06:56:02.255 INFO:tasks.workunit.client.1.smithi089.stdout:5/610: rmdir d5/de/d10/d16/d1b/d25/d4d 39 2024-08-01T06:56:02.256 INFO:tasks.workunit.client.1.smithi089.stdout:5/611: write d5/d13/d38/f6d [604468,113917] 0 2024-08-01T06:56:02.259 INFO:tasks.workunit.client.1.smithi089.stdout:0/743: mkdir d9/d40/d95/d99/dec 0 2024-08-01T06:56:02.261 INFO:tasks.workunit.client.1.smithi089.stdout:8/678: link d5/dc/d94/d84/ddb/fe7 d5/dc/d94/fee 0 2024-08-01T06:56:02.261 INFO:tasks.workunit.client.1.smithi089.stdout:8/679: chown d5/dc/d12/cdc 0 1 2024-08-01T06:56:02.262 INFO:tasks.workunit.client.1.smithi089.stdout:8/680: write d5/dc/d94/dc7/fe5 [673959,19262] 0 2024-08-01T06:56:02.265 INFO:tasks.workunit.client.1.smithi089.stdout:0/744: mknod d9/d40/d25/d46/d91/d2e/d44/d53/ced 0 2024-08-01T06:56:02.269 INFO:tasks.workunit.client.1.smithi089.stdout:4/638: getdents d3/db/de 0 2024-08-01T06:56:02.270 INFO:tasks.workunit.client.1.smithi089.stdout:4/639: chown d3/d17/d3a/f5d 33 1 2024-08-01T06:56:02.330 INFO:tasks.workunit.client.1.smithi089.stdout:3/505: sync 2024-08-01T06:56:02.333 INFO:tasks.workunit.client.1.smithi089.stdout:0/745: dread d9/d40/d25/d46/d91/d2e/d44/d53/f54 [0,4194304] 0 2024-08-01T06:56:02.338 INFO:tasks.workunit.client.1.smithi089.stdout:4/640: dwrite d3/d17/d3a/d3d/fae [0,4194304] 0 2024-08-01T06:56:02.338 INFO:tasks.workunit.client.1.smithi089.stdout:0/746: mkdir d9/dee 0 2024-08-01T06:56:02.339 INFO:tasks.workunit.client.1.smithi089.stdout:5/612: dwrite d5/d13/f65 [0,4194304] 0 2024-08-01T06:56:02.340 INFO:tasks.workunit.client.1.smithi089.stdout:4/641: symlink d3/d17/d71/d92/lc0 0 2024-08-01T06:56:02.342 INFO:tasks.workunit.client.1.smithi089.stdout:5/613: fdatasync d5/d13/d38/d42/f7b 0 2024-08-01T06:56:02.342 INFO:tasks.workunit.client.1.smithi089.stdout:3/506: dwrite d7/d32/d12/d29/f77 [4194304,4194304] 0 2024-08-01T06:56:02.343 INFO:tasks.workunit.client.1.smithi089.stdout:4/642: chown d3/d86/d9e/d26/f38 37951931 1 2024-08-01T06:56:02.344 INFO:tasks.workunit.client.1.smithi089.stdout:3/507: chown d7/d68/d50/d6f/f58 7343 1 2024-08-01T06:56:02.346 INFO:tasks.workunit.client.1.smithi089.stdout:5/614: rename d5/de/d10/d16/d1b/d52 to d5/de/d10/d16/d1b/d52/d5d/dcd 22 2024-08-01T06:56:02.347 INFO:tasks.workunit.client.1.smithi089.stdout:0/747: read d9/d40/d25/d46/d91/d2e/d44/d53/daf/fd2 [894123,63711] 0 2024-08-01T06:56:02.348 INFO:tasks.workunit.client.1.smithi089.stdout:4/643: chown d3/db/c1d 1925 1 2024-08-01T06:56:02.351 INFO:tasks.workunit.client.1.smithi089.stdout:4/644: symlink d3/db/d42/lc1 0 2024-08-01T06:56:02.353 INFO:tasks.workunit.client.1.smithi089.stdout:4/645: write d3/f24 [287721,98951] 0 2024-08-01T06:56:02.358 INFO:tasks.workunit.client.1.smithi089.stdout:4/646: truncate d3/d17/d3a/d4a/f55 530371 0 2024-08-01T06:56:02.358 INFO:tasks.workunit.client.1.smithi089.stdout:5/615: link d5/de/d10/d16/d1b/d25/d4d/l6b d5/de/d10/d16/d1b/d52/d5d/d6c/d98/lce 0 2024-08-01T06:56:02.358 INFO:tasks.workunit.client.1.smithi089.stdout:4/647: readlink d3/d86/l8c 0 2024-08-01T06:56:02.361 INFO:tasks.workunit.client.1.smithi089.stdout:5/616: creat d5/de/d10/d16/d1b/d25/d4d/fcf x:0 0 0 2024-08-01T06:56:02.364 INFO:tasks.workunit.client.1.smithi089.stdout:5/617: rename d5/d13/d38/c5b to d5/de/d10/d16/d1b/d52/d5f/cd0 0 2024-08-01T06:56:02.366 INFO:tasks.workunit.client.1.smithi089.stdout:3/508: dread d7/d32/d12/d1b/f26 [0,4194304] 0 2024-08-01T06:56:02.366 INFO:tasks.workunit.client.1.smithi089.stdout:5/618: mkdir d5/de/dd1 0 2024-08-01T06:56:02.367 INFO:tasks.workunit.client.1.smithi089.stdout:3/509: chown d7/d32/d4c/d53/l59 519253359 1 2024-08-01T06:56:02.367 INFO:tasks.workunit.client.1.smithi089.stdout:5/619: dread - d5/de/d10/d16/d9d/fa4 zero size 2024-08-01T06:56:02.369 INFO:tasks.workunit.client.1.smithi089.stdout:5/620: stat d5/de/d10/d33/d5e/d7e/d9e/db1/fc2 0 2024-08-01T06:56:02.375 INFO:tasks.workunit.client.1.smithi089.stdout:4/648: dread d3/d86/d9e/db1/dbb/d62/db3/fb5 [0,4194304] 0 2024-08-01T06:56:02.375 INFO:tasks.workunit.client.1.smithi089.stdout:3/510: dwrite d7/d32/d4c/f7a [0,4194304] 0 2024-08-01T06:56:02.377 INFO:tasks.workunit.client.1.smithi089.stdout:5/621: dwrite d5/de/d10/d16/d1b/d25/fa7 [0,4194304] 0 2024-08-01T06:56:02.378 INFO:tasks.workunit.client.1.smithi089.stdout:3/511: read d7/d32/d4c/d69/f1a [3196897,129030] 0 2024-08-01T06:56:02.379 INFO:tasks.workunit.client.1.smithi089.stdout:3/512: fdatasync d7/d32/d4c/d69/f62 0 2024-08-01T06:56:02.381 INFO:tasks.workunit.client.1.smithi089.stdout:3/513: truncate d7/d68/d50/d6f/f49 4543337 0 2024-08-01T06:56:02.385 INFO:tasks.workunit.client.1.smithi089.stdout:3/514: mknod d7/d32/d12/d29/d39/c9e 0 2024-08-01T06:56:02.390 INFO:tasks.workunit.client.1.smithi089.stdout:5/622: link d5/d13/d83/l8d d5/de/df/d9f/dbd/ld2 0 2024-08-01T06:56:02.390 INFO:tasks.workunit.client.1.smithi089.stdout:4/649: dread d3/d86/d9e/db1/dbb/d62/d31/f67 [0,4194304] 0 2024-08-01T06:56:02.392 INFO:tasks.workunit.client.1.smithi089.stdout:4/650: chown d3/db/de/d5b/f74 3382614 1 2024-08-01T06:56:02.393 INFO:tasks.workunit.client.1.smithi089.stdout:3/515: rename d7/d68/d50/d6f/d46/d47 to d7/d32/d9f 0 2024-08-01T06:56:02.395 INFO:tasks.workunit.client.1.smithi089.stdout:4/651: unlink d3/d86/d9e/d26/f61 0 2024-08-01T06:56:02.395 INFO:tasks.workunit.client.1.smithi089.stdout:3/516: write d7/d32/d4c/d69/f62 [5743315,49142] 0 2024-08-01T06:56:02.398 INFO:tasks.workunit.client.1.smithi089.stdout:4/652: creat d3/d17/d3a/d3d/fc2 x:0 0 0 2024-08-01T06:56:02.400 INFO:tasks.workunit.client.1.smithi089.stdout:5/623: rename d5/de/d10/f3d to d5/fd3 0 2024-08-01T06:56:02.402 INFO:tasks.workunit.client.1.smithi089.stdout:3/517: creat d7/fa0 x:0 0 0 2024-08-01T06:56:02.403 INFO:tasks.workunit.client.1.smithi089.stdout:5/624: symlink d5/de/d10/d16/d1b/d25/d4d/ld4 0 2024-08-01T06:56:02.403 INFO:tasks.workunit.client.1.smithi089.stdout:3/518: write d7/fa0 [679483,25790] 0 2024-08-01T06:56:02.404 INFO:tasks.workunit.client.1.smithi089.stdout:3/519: chown d7/d32/d12/f41 874 1 2024-08-01T06:56:02.405 INFO:tasks.workunit.client.1.smithi089.stdout:5/625: creat d5/de/df/d9f/dbd/fd5 x:0 0 0 2024-08-01T06:56:02.406 INFO:tasks.workunit.client.1.smithi089.stdout:4/653: getdents d3/d86 0 2024-08-01T06:56:02.407 INFO:tasks.workunit.client.1.smithi089.stdout:5/626: creat d5/de/d57/d8e/fd6 x:0 0 0 2024-08-01T06:56:02.408 INFO:tasks.workunit.client.1.smithi089.stdout:3/520: mknod d7/d32/d4c/d53/d5f/ca1 0 2024-08-01T06:56:02.408 INFO:tasks.workunit.client.1.smithi089.stdout:5/627: readlink d5/de/d10/d16/d1b/d52/d5d/l87 0 2024-08-01T06:56:02.409 INFO:tasks.workunit.client.1.smithi089.stdout:3/521: stat d7/d68/d50/d54/l86 0 2024-08-01T06:56:02.412 INFO:tasks.workunit.client.1.smithi089.stdout:3/522: write d7/d32/d12/d29/f77 [2005159,12820] 0 2024-08-01T06:56:02.412 INFO:tasks.workunit.client.1.smithi089.stdout:5/628: getdents d5/d13 0 2024-08-01T06:56:02.415 INFO:tasks.workunit.client.1.smithi089.stdout:4/654: dwrite d3/db/de/d5b/f75 [0,4194304] 0 2024-08-01T06:56:02.417 INFO:tasks.workunit.client.1.smithi089.stdout:3/523: write d7/d68/d50/d6f/d2f/d9c/f9d [277388,44654] 0 2024-08-01T06:56:02.417 INFO:tasks.workunit.client.1.smithi089.stdout:5/629: creat d5/de/d10/d16/fd7 x:0 0 0 2024-08-01T06:56:02.419 INFO:tasks.workunit.client.1.smithi089.stdout:0/748: dwrite d9/d40/d25/d46/d91/d2e/d44/d72/fdc [0,4194304] 0 2024-08-01T06:56:02.420 INFO:tasks.workunit.client.1.smithi089.stdout:5/630: dread - d5/de/d57/db0/fca zero size 2024-08-01T06:56:02.420 INFO:tasks.workunit.client.1.smithi089.stdout:0/749: readlink d9/d40/d95/d99/l5a 0 2024-08-01T06:56:02.422 INFO:tasks.workunit.client.1.smithi089.stdout:4/655: rename d3/d17/d71/d92/fb4 to d3/db/de/d5b/db9/fc3 0 2024-08-01T06:56:02.426 INFO:tasks.workunit.client.1.smithi089.stdout:3/524: mkdir d7/d68/d50/d6f/d2f/da2 0 2024-08-01T06:56:02.429 INFO:tasks.workunit.client.1.smithi089.stdout:4/656: dwrite d3/d86/d9e/db1/dbb/f7c [0,4194304] 0 2024-08-01T06:56:02.430 INFO:tasks.workunit.client.1.smithi089.stdout:5/631: mknod d5/de/d10/d16/d1b/d52/d5d/d6c/d8b/cd8 0 2024-08-01T06:56:02.432 INFO:tasks.workunit.client.1.smithi089.stdout:5/632: write d5/de/d10/f1c [1150935,107062] 0 2024-08-01T06:56:02.434 INFO:tasks.workunit.client.1.smithi089.stdout:3/525: mknod d7/d68/d50/d6f/d46/ca3 0 2024-08-01T06:56:02.434 INFO:tasks.workunit.client.1.smithi089.stdout:0/750: truncate f7 1089472 0 2024-08-01T06:56:02.436 INFO:tasks.workunit.client.1.smithi089.stdout:4/657: write d3/d86/d9e/db1/dbb/d62/db3/fb5 [4479405,130402] 0 2024-08-01T06:56:02.440 INFO:tasks.workunit.client.1.smithi089.stdout:3/526: creat d7/d68/d50/d54/fa4 x:0 0 0 2024-08-01T06:56:02.441 INFO:tasks.workunit.client.1.smithi089.stdout:0/751: write d9/d40/d95/d99/d2b/f48 [702061,3112] 0 2024-08-01T06:56:02.444 INFO:tasks.workunit.client.1.smithi089.stdout:0/752: readlink d9/d40/d25/la7 0 2024-08-01T06:56:02.446 INFO:tasks.workunit.client.1.smithi089.stdout:5/633: dwrite d5/de/d10/d16/d1b/d25/f74 [0,4194304] 0 2024-08-01T06:56:02.447 INFO:tasks.workunit.client.1.smithi089.stdout:4/658: creat d3/d86/d9e/db1/dbb/fc4 x:0 0 0 2024-08-01T06:56:02.448 INFO:tasks.workunit.client.1.smithi089.stdout:3/527: read d7/d32/d12/f33 [2203085,52062] 0 2024-08-01T06:56:02.448 INFO:tasks.workunit.client.1.smithi089.stdout:5/634: chown d5/d13/d43/c63 6 1 2024-08-01T06:56:02.451 INFO:tasks.workunit.client.1.smithi089.stdout:4/659: rename d3/db/de/d5b/fba to d3/db/de/d5b/fc5 0 2024-08-01T06:56:02.451 INFO:tasks.workunit.client.1.smithi089.stdout:5/635: unlink d5/de/d10/c6f 0 2024-08-01T06:56:02.453 INFO:tasks.workunit.client.1.smithi089.stdout:4/660: chown d3/db/de/c9b 13817 1 2024-08-01T06:56:02.454 INFO:tasks.workunit.client.1.smithi089.stdout:4/661: chown d3/d86/d9e/f41 334 1 2024-08-01T06:56:02.454 INFO:tasks.workunit.client.1.smithi089.stdout:5/636: mkdir d5/de/d10/d16/d1b/d52/d5d/dd9 0 2024-08-01T06:56:02.454 INFO:tasks.workunit.client.1.smithi089.stdout:5/637: stat d5/d13/d38 0 2024-08-01T06:56:02.459 INFO:tasks.workunit.client.1.smithi089.stdout:5/638: dwrite d5/de/d57/db0/fb2 [0,4194304] 0 2024-08-01T06:56:02.465 INFO:tasks.workunit.client.1.smithi089.stdout:0/753: dwrite d9/d40/d25/d46/f3d [0,4194304] 0 2024-08-01T06:56:02.474 INFO:tasks.workunit.client.1.smithi089.stdout:5/639: truncate d5/de/d10/d16/d1b/d25/f74 350340 0 2024-08-01T06:56:02.478 INFO:tasks.workunit.client.1.smithi089.stdout:5/640: dread d5/de/f80 [0,4194304] 0 2024-08-01T06:56:02.478 INFO:tasks.workunit.client.1.smithi089.stdout:5/641: fsync d5/de/d10/d16/fa2 0 2024-08-01T06:56:02.481 INFO:tasks.workunit.client.1.smithi089.stdout:5/642: creat d5/de/d10/d16/d1b/d25/fda x:0 0 0 2024-08-01T06:56:02.482 INFO:tasks.workunit.client.1.smithi089.stdout:0/754: dread d9/d40/d95/d99/d2b/fb8 [0,4194304] 0 2024-08-01T06:56:02.483 INFO:tasks.workunit.client.1.smithi089.stdout:5/643: fsync d5/de/df/d9f/dbd/fd5 0 2024-08-01T06:56:02.484 INFO:tasks.workunit.client.1.smithi089.stdout:5/644: write d5/de/df/d9f/dbd/fbf [872798,38881] 0 2024-08-01T06:56:02.485 INFO:tasks.workunit.client.1.smithi089.stdout:0/755: readlink d9/d40/d25/d46/d91/d2e/d44/d53/l9b 0 2024-08-01T06:56:02.488 INFO:tasks.workunit.client.1.smithi089.stdout:0/756: getdents d9/d40/d25/d46/d91/d2e/d3a/d76 0 2024-08-01T06:56:02.489 INFO:tasks.workunit.client.1.smithi089.stdout:5/645: dwrite d5/de/d10/d33/f6e [0,4194304] 0 2024-08-01T06:56:02.492 INFO:tasks.workunit.client.1.smithi089.stdout:5/646: write d5/de/d10/d16/d1b/f76 [379409,67339] 0 2024-08-01T06:56:02.495 INFO:tasks.workunit.client.1.smithi089.stdout:0/757: dread d9/d40/d95/d99/d2b/f82 [0,4194304] 0 2024-08-01T06:56:02.496 INFO:tasks.workunit.client.1.smithi089.stdout:0/758: chown d9/d40/d25/d46/d91/d2e/d44/d72/d8b 3594 1 2024-08-01T06:56:02.497 INFO:tasks.workunit.client.1.smithi089.stdout:5/647: creat d5/de/d10/d16/d1b/d92/fdb x:0 0 0 2024-08-01T06:56:02.498 INFO:tasks.workunit.client.1.smithi089.stdout:1/655: sync 2024-08-01T06:56:02.498 INFO:tasks.workunit.client.1.smithi089.stdout:9/582: sync 2024-08-01T06:56:02.499 INFO:tasks.workunit.client.1.smithi089.stdout:0/759: fsync d9/d40/d95/d99/d2b/f82 0 2024-08-01T06:56:02.502 INFO:tasks.workunit.client.1.smithi089.stdout:1/656: creat d0/d9/d15/dce/dd3/fd5 x:0 0 0 2024-08-01T06:56:02.502 INFO:tasks.workunit.client.1.smithi089.stdout:5/648: dread d5/f3c [0,4194304] 0 2024-08-01T06:56:02.505 INFO:tasks.workunit.client.1.smithi089.stdout:0/760: dread d9/d40/d95/d99/f5d [0,4194304] 0 2024-08-01T06:56:02.505 INFO:tasks.workunit.client.1.smithi089.stdout:5/649: write d5/de/d10/d16/d1b/d25/f89 [5203606,79819] 0 2024-08-01T06:56:02.507 INFO:tasks.workunit.client.1.smithi089.stdout:0/761: read - d9/d40/d95/d99/d2b/d55/d7a/fb5 zero size 2024-08-01T06:56:02.508 INFO:tasks.workunit.client.1.smithi089.stdout:1/657: dread d0/d9/d15/d3b/d3d/f85 [0,4194304] 0 2024-08-01T06:56:02.510 INFO:tasks.workunit.client.1.smithi089.stdout:9/583: dread d18/d33/d49/d7b/d7f/d98/d9f/d8e/fa7 [0,4194304] 0 2024-08-01T06:56:02.514 INFO:tasks.workunit.client.1.smithi089.stdout:0/762: rename d9/d40/d25/d46/d91/d2e/d44/d53/fe5 to d9/d40/d25/d46/d91/d2e/d44/d72/d8b/fef 0 2024-08-01T06:56:02.514 INFO:tasks.workunit.client.1.smithi089.stdout:5/650: link d5/de/df/c41 d5/d13/d38/d42/cdc 0 2024-08-01T06:56:02.515 INFO:tasks.workunit.client.1.smithi089.stdout:1/658: mknod d0/d9/d15/d3b/d3d/db5/cd6 0 2024-08-01T06:56:02.519 INFO:tasks.workunit.client.1.smithi089.stdout:9/584: rename d18/d33/d49/d7b/d7f/d98/d9f/d8e/l92 to d18/d33/d49/d7b/d4b/db6/lbe 0 2024-08-01T06:56:02.519 INFO:tasks.workunit.client.1.smithi089.stdout:0/763: mknod d9/d40/d95/d99/cf0 0 2024-08-01T06:56:02.521 INFO:tasks.workunit.client.1.smithi089.stdout:5/651: symlink d5/de/d10/d16/d1b/d25/d4d/ldd 0 2024-08-01T06:56:02.521 INFO:tasks.workunit.client.1.smithi089.stdout:5/652: dread - d5/de/d10/d16/fa2 zero size 2024-08-01T06:56:02.525 INFO:tasks.workunit.client.1.smithi089.stdout:0/764: rename d9/d40/d95/d99/d2b/d55/d7a to d9/d40/d95/df1 0 2024-08-01T06:56:02.528 INFO:tasks.workunit.client.1.smithi089.stdout:5/653: mkdir d5/de/d57/d8e/d97/da5/dde 0 2024-08-01T06:56:02.531 INFO:tasks.workunit.client.1.smithi089.stdout:0/765: rename d9/d40/d45/d47/da8/fe2 to d9/d40/d25/d46/d91/d2e/d44/d53/daf/ff2 0 2024-08-01T06:56:02.531 INFO:tasks.workunit.client.1.smithi089.stdout:5/654: rmdir d5/de/d10/d16/d1b/d52/d5d/d6c 39 2024-08-01T06:56:02.532 INFO:tasks.workunit.client.1.smithi089.stdout:5/655: dread - d5/d13/d83/f96 zero size 2024-08-01T06:56:02.533 INFO:tasks.workunit.client.1.smithi089.stdout:9/585: getdents d18/d22/d43 0 2024-08-01T06:56:02.535 INFO:tasks.workunit.client.1.smithi089.stdout:5/656: unlink d5/de/d10/d33/d5e/d7e/d9e/fc6 0 2024-08-01T06:56:02.537 INFO:tasks.workunit.client.1.smithi089.stdout:5/657: fdatasync d5/de/d10/d16/d1b/d92/fdb 0 2024-08-01T06:56:02.543 INFO:tasks.workunit.client.1.smithi089.stdout:1/659: dwrite d0/d9/d15/fae [0,4194304] 0 2024-08-01T06:56:02.543 INFO:tasks.workunit.client.1.smithi089.stdout:5/658: write d5/de/df/d9f/dbd/fbf [1500049,13437] 0 2024-08-01T06:56:02.543 INFO:tasks.workunit.client.1.smithi089.stdout:9/586: dwrite d18/d33/d49/d7b/d7f/d98/d9f/d8e/fa1 [0,4194304] 0 2024-08-01T06:56:02.544 INFO:tasks.workunit.client.1.smithi089.stdout:5/659: mkdir d5/de/d57/ddf 0 2024-08-01T06:56:02.550 INFO:tasks.workunit.client.1.smithi089.stdout:1/660: link d0/d9/d15/d3b/d95/c16 d0/d9/d15/d3b/d95/cd7 0 2024-08-01T06:56:02.556 INFO:tasks.workunit.client.1.smithi089.stdout:5/660: getdents d5/de/d57/d8e/d97/da5 0 2024-08-01T06:56:02.556 INFO:tasks.workunit.client.1.smithi089.stdout:1/661: truncate d0/f13 2535131 0 2024-08-01T06:56:02.557 INFO:tasks.workunit.client.1.smithi089.stdout:1/662: fdatasync d0/d9/d15/d2d/d4a/d61/f7e 0 2024-08-01T06:56:02.561 INFO:tasks.workunit.client.1.smithi089.stdout:5/661: dwrite d5/de/d10/f11 [0,4194304] 0 2024-08-01T06:56:02.565 INFO:tasks.workunit.client.1.smithi089.stdout:5/662: write d5/d13/f84 [6022521,87526] 0 2024-08-01T06:56:02.565 INFO:tasks.workunit.client.1.smithi089.stdout:9/587: truncate ff 1722205 0 2024-08-01T06:56:02.566 INFO:tasks.workunit.client.1.smithi089.stdout:1/663: dwrite d0/d9/d15/d2d/d4a/fb7 [0,4194304] 0 2024-08-01T06:56:02.570 INFO:tasks.workunit.client.1.smithi089.stdout:5/663: write d5/f3c [776749,1733] 0 2024-08-01T06:56:02.571 INFO:tasks.workunit.client.1.smithi089.stdout:1/664: fsync d0/d9/d43/d89/f98 0 2024-08-01T06:56:02.571 INFO:tasks.workunit.client.1.smithi089.stdout:5/664: dread - d5/de/df/d9f/dbd/fd5 zero size 2024-08-01T06:56:02.572 INFO:tasks.workunit.client.1.smithi089.stdout:9/588: truncate d18/d33/d3b/f46 431844 0 2024-08-01T06:56:02.573 INFO:tasks.workunit.client.1.smithi089.stdout:5/665: write d5/de/d10/f1c [1061654,26539] 0 2024-08-01T06:56:02.583 INFO:tasks.workunit.client.1.smithi089.stdout:5/666: dwrite d5/de/d10/d16/d1b/f22 [0,4194304] 0 2024-08-01T06:56:02.583 INFO:tasks.workunit.client.1.smithi089.stdout:2/580: sync 2024-08-01T06:56:02.586 INFO:tasks.workunit.client.1.smithi089.stdout:6/693: sync 2024-08-01T06:56:02.586 INFO:tasks.workunit.client.1.smithi089.stdout:7/600: sync 2024-08-01T06:56:02.588 INFO:tasks.workunit.client.1.smithi089.stdout:5/667: rmdir d5/de/d10/d16/d1b/d52/d5d/d6c/d8b 39 2024-08-01T06:56:02.589 INFO:tasks.workunit.client.1.smithi089.stdout:2/581: getdents d7/d19/d3b/d7c 0 2024-08-01T06:56:02.590 INFO:tasks.workunit.client.1.smithi089.stdout:6/694: creat d2/d2e/d2f/d9e/feb x:0 0 0 2024-08-01T06:56:02.592 INFO:tasks.workunit.client.1.smithi089.stdout:9/589: dread f17 [0,4194304] 0 2024-08-01T06:56:02.593 INFO:tasks.workunit.client.1.smithi089.stdout:6/695: chown d2/d11/d1a/d1c/d40 179 1 2024-08-01T06:56:02.593 INFO:tasks.workunit.client.1.smithi089.stdout:7/601: symlink d7/df/d10/d31/dc4/lc6 0 2024-08-01T06:56:02.595 INFO:tasks.workunit.client.1.smithi089.stdout:1/665: dread d0/d9/d15/d2d/f3a [0,4194304] 0 2024-08-01T06:56:02.598 INFO:tasks.workunit.client.1.smithi089.stdout:6/696: unlink d2/d30/d3c/d3d/f94 0 2024-08-01T06:56:02.599 INFO:tasks.workunit.client.1.smithi089.stdout:6/697: fdatasync d2/d11/d1a/fd1 0 2024-08-01T06:56:02.602 INFO:tasks.workunit.client.1.smithi089.stdout:7/602: creat d7/fc7 x:0 0 0 2024-08-01T06:56:02.603 INFO:tasks.workunit.client.1.smithi089.stdout:6/698: creat d2/d2e/d2f/d91/fec x:0 0 0 2024-08-01T06:56:02.603 INFO:tasks.workunit.client.1.smithi089.stdout:6/699: chown d2/d30 60564 1 2024-08-01T06:56:02.603 INFO:tasks.workunit.client.1.smithi089.stdout:9/590: getdents d18/da4 0 2024-08-01T06:56:02.604 INFO:tasks.workunit.client.1.smithi089.stdout:1/666: creat d0/d9/d15/d3b/d95/fd8 x:0 0 0 2024-08-01T06:56:02.607 INFO:tasks.workunit.client.1.smithi089.stdout:5/668: truncate d5/d13/f65 509427 0 2024-08-01T06:56:02.608 INFO:tasks.workunit.client.1.smithi089.stdout:1/667: mkdir d0/dd9 0 2024-08-01T06:56:02.611 INFO:tasks.workunit.client.1.smithi089.stdout:1/668: fdatasync d0/d9/d15/d76/f9a 0 2024-08-01T06:56:02.611 INFO:tasks.workunit.client.1.smithi089.stdout:9/591: mknod d18/d33/d49/d7b/cbf 0 2024-08-01T06:56:02.611 INFO:tasks.workunit.client.1.smithi089.stdout:2/582: dwrite d7/d19/d1e/f2e [0,4194304] 0 2024-08-01T06:56:02.613 INFO:tasks.workunit.client.1.smithi089.stdout:7/603: link d7/df/d10/d31/f45 d7/df/d91/fc8 0 2024-08-01T06:56:02.614 INFO:tasks.workunit.client.1.smithi089.stdout:2/583: chown d7/d1f/d29/c21 839753 1 2024-08-01T06:56:02.615 INFO:tasks.workunit.client.1.smithi089.stdout:5/669: dread d5/de/d10/d16/d1b/d25/f89 [0,4194304] 0 2024-08-01T06:56:02.615 INFO:tasks.workunit.client.1.smithi089.stdout:6/700: write d2/d11/d1a/f29 [565435,113568] 0 2024-08-01T06:56:02.618 INFO:tasks.workunit.client.1.smithi089.stdout:1/669: rename d0/d9/d15/d3b/d3d/c46 to d0/d9/d43/d4b/d92/cda 0 2024-08-01T06:56:02.619 INFO:tasks.workunit.client.1.smithi089.stdout:6/701: dread d2/d11/d1f/f5a [0,4194304] 0 2024-08-01T06:56:02.622 INFO:tasks.workunit.client.1.smithi089.stdout:7/604: symlink d7/df/d91/d98/lc9 0 2024-08-01T06:56:02.625 INFO:tasks.workunit.client.1.smithi089.stdout:5/670: fdatasync d5/de/f80 0 2024-08-01T06:56:02.627 INFO:tasks.workunit.client.1.smithi089.stdout:6/702: creat d2/d11/d1f/fed x:0 0 0 2024-08-01T06:56:02.628 INFO:tasks.workunit.client.1.smithi089.stdout:1/670: rmdir d0/d9/d15/d3b/d95/d49/d82/da6 39 2024-08-01T06:56:02.629 INFO:tasks.workunit.client.1.smithi089.stdout:6/703: write d2/d11/d1a/d1c/d40/f83 [3715572,60824] 0 2024-08-01T06:56:02.629 INFO:tasks.workunit.client.1.smithi089.stdout:7/605: dwrite d7/df/d91/da4/f5f [0,4194304] 0 2024-08-01T06:56:02.631 INFO:tasks.workunit.client.1.smithi089.stdout:7/606: truncate d7/d1f/f28 570405 0 2024-08-01T06:56:02.632 INFO:tasks.workunit.client.1.smithi089.stdout:9/592: link d18/d33/d49/d7b/d7f/d98/d9f/l76 d18/d22/d52/db7/lc0 0 2024-08-01T06:56:02.632 INFO:tasks.workunit.client.1.smithi089.stdout:2/584: link d7/d1f/d28/fa2 d7/d1f/d52/d6e/fbb 0 2024-08-01T06:56:02.636 INFO:tasks.workunit.client.1.smithi089.stdout:5/671: write d5/de/d10/d16/d1b/d52/d5d/d6c/f81 [2986484,127552] 0 2024-08-01T06:56:02.639 INFO:tasks.workunit.client.1.smithi089.stdout:2/585: dwrite d7/d19/d1e/f70 [0,4194304] 0 2024-08-01T06:56:02.639 INFO:tasks.workunit.client.1.smithi089.stdout:2/586: stat d7 0 2024-08-01T06:56:02.644 INFO:tasks.workunit.client.1.smithi089.stdout:5/672: creat d5/d13/fe0 x:0 0 0 2024-08-01T06:56:02.644 INFO:tasks.workunit.client.1.smithi089.stdout:1/671: creat d0/d9/d15/d2d/fdb x:0 0 0 2024-08-01T06:56:02.649 INFO:tasks.workunit.client.1.smithi089.stdout:2/587: unlink d7/d1f/d28/cb0 0 2024-08-01T06:56:02.650 INFO:tasks.workunit.client.1.smithi089.stdout:7/607: getdents d7/d1f/d3a/dad 0 2024-08-01T06:56:02.650 INFO:tasks.workunit.client.1.smithi089.stdout:6/704: write d2/f2a [2554747,74620] 0 2024-08-01T06:56:02.650 INFO:tasks.workunit.client.1.smithi089.stdout:6/705: fdatasync d2/d30/fa1 0 2024-08-01T06:56:02.652 INFO:tasks.workunit.client.1.smithi089.stdout:9/593: getdents d18/d22 0 2024-08-01T06:56:02.652 INFO:tasks.workunit.client.1.smithi089.stdout:1/672: creat d0/d9/d43/d4b/fdc x:0 0 0 2024-08-01T06:56:02.653 INFO:tasks.workunit.client.1.smithi089.stdout:7/608: mkdir d7/df/d91/da4/dca 0 2024-08-01T06:56:02.654 INFO:tasks.workunit.client.1.smithi089.stdout:6/706: mknod d2/d2e/dc2/cee 0 2024-08-01T06:56:02.656 INFO:tasks.workunit.client.1.smithi089.stdout:6/707: dread - d2/d2e/dc2/fde zero size 2024-08-01T06:56:02.657 INFO:tasks.workunit.client.1.smithi089.stdout:7/609: mknod d7/df/d10/d31/ccb 0 2024-08-01T06:56:02.658 INFO:tasks.workunit.client.1.smithi089.stdout:5/673: getdents d5/de 0 2024-08-01T06:56:02.660 INFO:tasks.workunit.client.1.smithi089.stdout:9/594: dwrite d18/da4/fb0 [0,4194304] 0 2024-08-01T06:56:02.660 INFO:tasks.workunit.client.1.smithi089.stdout:2/588: truncate d7/fa 3132619 0 2024-08-01T06:56:02.661 INFO:tasks.workunit.client.1.smithi089.stdout:1/673: dread d0/d9/d15/d2d/d4a/f5e [0,4194304] 0 2024-08-01T06:56:02.661 INFO:tasks.workunit.client.1.smithi089.stdout:7/610: mknod d7/df/d10/d42/d4e/ccc 0 2024-08-01T06:56:02.664 INFO:tasks.workunit.client.1.smithi089.stdout:2/589: mknod d7/d4a/cbc 0 2024-08-01T06:56:02.664 INFO:tasks.workunit.client.1.smithi089.stdout:8/681: sync 2024-08-01T06:56:02.667 INFO:tasks.workunit.client.1.smithi089.stdout:1/674: mkdir d0/d9/d15/dce/dd3/ddd 0 2024-08-01T06:56:02.668 INFO:tasks.workunit.client.1.smithi089.stdout:9/595: truncate d18/da4/fa9 3098710 0 2024-08-01T06:56:02.669 INFO:tasks.workunit.client.1.smithi089.stdout:8/682: creat d5/d23/d91/fef x:0 0 0 2024-08-01T06:56:02.669 INFO:tasks.workunit.client.1.smithi089.stdout:6/708: dwrite d2/ff [4194304,4194304] 0 2024-08-01T06:56:02.670 INFO:tasks.workunit.client.1.smithi089.stdout:9/596: chown d18/d22/d45/daa 2366 1 2024-08-01T06:56:02.670 INFO:tasks.workunit.client.1.smithi089.stdout:7/611: mkdir d7/d1f/d30/d4c/dbc/dcd 0 2024-08-01T06:56:02.670 INFO:tasks.workunit.client.1.smithi089.stdout:1/675: chown d0/f13 4829 1 2024-08-01T06:56:02.672 INFO:tasks.workunit.client.1.smithi089.stdout:6/709: fsync d2/d11/d1f/d46/fac 0 2024-08-01T06:56:02.672 INFO:tasks.workunit.client.1.smithi089.stdout:9/597: write d18/f7e [1121418,5063] 0 2024-08-01T06:56:02.673 INFO:tasks.workunit.client.1.smithi089.stdout:8/683: mkdir d5/dc/d94/d84/df0 0 2024-08-01T06:56:02.679 INFO:tasks.workunit.client.1.smithi089.stdout:6/710: truncate d2/d2e/dc2/fde 74268 0 2024-08-01T06:56:02.680 INFO:tasks.workunit.client.1.smithi089.stdout:2/590: dread d7/d19/d1e/f54 [0,4194304] 0 2024-08-01T06:56:02.684 INFO:tasks.workunit.client.1.smithi089.stdout:5/674: truncate d5/de/d10/d16/d1b/f76 3545404 0 2024-08-01T06:56:02.684 INFO:tasks.workunit.client.1.smithi089.stdout:9/598: chown d18/d33/d49/d7b/d7f/d98/d9f/la3 659 1 2024-08-01T06:56:02.684 INFO:tasks.workunit.client.1.smithi089.stdout:6/711: mkdir d2/d11/d1a/d1c/db6/def 0 2024-08-01T06:56:02.687 INFO:tasks.workunit.client.1.smithi089.stdout:7/612: dwrite d7/df/d10/f83 [0,4194304] 0 2024-08-01T06:56:02.691 INFO:tasks.workunit.client.1.smithi089.stdout:1/676: dwrite d0/d9/d15/d2d/d4a/d61/f72 [0,4194304] 0 2024-08-01T06:56:02.695 INFO:tasks.workunit.client.1.smithi089.stdout:5/675: mknod d5/de/d10/d16/d1b/d25/ce1 0 2024-08-01T06:56:02.695 INFO:tasks.workunit.client.1.smithi089.stdout:8/684: dwrite d5/f9c [0,4194304] 0 2024-08-01T06:56:02.698 INFO:tasks.workunit.client.1.smithi089.stdout:7/613: symlink d7/df/d10/d42/lce 0 2024-08-01T06:56:02.698 INFO:tasks.workunit.client.1.smithi089.stdout:1/677: chown d0/d9/d15/dce/ld2 1141043840 1 2024-08-01T06:56:02.698 INFO:tasks.workunit.client.1.smithi089.stdout:2/591: dwrite d7/d1f/d28/f51 [0,4194304] 0 2024-08-01T06:56:02.698 INFO:tasks.workunit.client.1.smithi089.stdout:9/599: rename d18/d33/d49/d7b/d7f/d98/d9f/fba to d18/fc1 0 2024-08-01T06:56:02.698 INFO:tasks.workunit.client.1.smithi089.stdout:2/592: readlink d7/l79 0 2024-08-01T06:56:02.699 INFO:tasks.workunit.client.1.smithi089.stdout:1/678: readlink d0/d9/d15/d2b/l60 0 2024-08-01T06:56:02.700 INFO:tasks.workunit.client.1.smithi089.stdout:5/676: mknod d5/de/ce2 0 2024-08-01T06:56:02.700 INFO:tasks.workunit.client.1.smithi089.stdout:9/600: chown d18/d33/d53/f8b 31592 1 2024-08-01T06:56:02.701 INFO:tasks.workunit.client.1.smithi089.stdout:2/593: write d7/d19/f37 [8616698,109648] 0 2024-08-01T06:56:02.704 INFO:tasks.workunit.client.1.smithi089.stdout:6/712: rename d2/d11/d1f/d46/fac to d2/d2e/d98/ff0 0 2024-08-01T06:56:02.706 INFO:tasks.workunit.client.1.smithi089.stdout:8/685: truncate d5/d15/d5a/f68 143872 0 2024-08-01T06:56:02.708 INFO:tasks.workunit.client.1.smithi089.stdout:1/679: creat d0/d9/d15/d2b/d7d/fde x:0 0 0 2024-08-01T06:56:02.717 INFO:tasks.workunit.client.1.smithi089.stdout:0/766: sync 2024-08-01T06:56:02.717 INFO:tasks.workunit.client.1.smithi089.stdout:4/662: sync 2024-08-01T06:56:02.717 INFO:tasks.workunit.client.1.smithi089.stdout:3/528: sync 2024-08-01T06:56:02.749 INFO:tasks.workunit.client.1.smithi089.stdout:2/594: creat d7/d19/d3b/fbd x:0 0 0 2024-08-01T06:56:02.749 INFO:tasks.workunit.client.1.smithi089.stdout:1/680: fsync d0/d9/d15/d3b/d3d/fc0 0 2024-08-01T06:56:02.749 INFO:tasks.workunit.client.1.smithi089.stdout:9/601: creat d18/d33/d49/d7b/d81/fc2 x:0 0 0 2024-08-01T06:56:02.753 INFO:tasks.workunit.client.1.smithi089.stdout:2/595: rmdir d7/d1f 39 2024-08-01T06:56:02.753 INFO:tasks.workunit.client.1.smithi089.stdout:3/529: mkdir d7/d68/d50/d54/da5 0 2024-08-01T06:56:02.755 INFO:tasks.workunit.client.1.smithi089.stdout:2/596: write d7/f23 [2380465,18491] 0 2024-08-01T06:56:02.756 INFO:tasks.workunit.client.1.smithi089.stdout:6/713: dwrite d2/d11/d1f/f2d [0,4194304] 0 2024-08-01T06:56:02.758 INFO:tasks.workunit.client.1.smithi089.stdout:9/602: symlink d18/d22/d52/db7/lc3 0 2024-08-01T06:56:02.758 INFO:tasks.workunit.client.1.smithi089.stdout:6/714: fdatasync d2/d11/d1f/d46/f4b 0 2024-08-01T06:56:02.760 INFO:tasks.workunit.client.1.smithi089.stdout:3/530: creat d7/d32/d4c/d69/d6d/fa6 x:0 0 0 2024-08-01T06:56:02.761 INFO:tasks.workunit.client.1.smithi089.stdout:8/686: getdents d5/dc 0 2024-08-01T06:56:02.762 INFO:tasks.workunit.client.1.smithi089.stdout:5/677: dread d5/de/d57/d8e/d97/da5/fc9 [0,4194304] 0 2024-08-01T06:56:02.763 INFO:tasks.workunit.client.1.smithi089.stdout:4/663: write d3/d17/d3a/f5d [5187736,53860] 0 2024-08-01T06:56:02.764 INFO:tasks.workunit.client.1.smithi089.stdout:1/681: creat d0/d9/d15/d3b/d95/d49/d82/fdf x:0 0 0 2024-08-01T06:56:02.764 INFO:tasks.workunit.client.1.smithi089.stdout:4/664: fdatasync d3/db/d33/fb6 0 2024-08-01T06:56:02.766 INFO:tasks.workunit.client.1.smithi089.stdout:6/715: write d2/f18 [9969929,39191] 0 2024-08-01T06:56:02.766 INFO:tasks.workunit.client.1.smithi089.stdout:9/603: mknod d18/d33/d49/d7b/d7f/d98/d9f/cc4 0 2024-08-01T06:56:02.767 INFO:tasks.workunit.client.1.smithi089.stdout:3/531: symlink d7/d32/d12/d29/d39/la7 0 2024-08-01T06:56:02.770 INFO:tasks.workunit.client.1.smithi089.stdout:0/767: getdents d9/d40/d25/d46/d91/d2e/d44/d53/daf 0 2024-08-01T06:56:02.770 INFO:tasks.workunit.client.1.smithi089.stdout:1/682: rmdir d0/d9/d15/d2d/d4a/d61 39 2024-08-01T06:56:02.773 INFO:tasks.workunit.client.1.smithi089.stdout:2/597: creat d7/d19/d1e/fbe x:0 0 0 2024-08-01T06:56:02.775 INFO:tasks.workunit.client.1.smithi089.stdout:8/687: mknod d5/dc/d94/dc7/dba/cf1 0 2024-08-01T06:56:02.777 INFO:tasks.workunit.client.1.smithi089.stdout:1/683: write d0/d9/d15/d3b/d3d/d77/d8f/f90 [279897,110943] 0 2024-08-01T06:56:02.779 INFO:tasks.workunit.client.1.smithi089.stdout:3/532: dread d7/d32/d12/d29/f77 [4194304,4194304] 0 2024-08-01T06:56:02.779 INFO:tasks.workunit.client.1.smithi089.stdout:9/604: dwrite d18/d33/d49/d7b/f41 [0,4194304] 0 2024-08-01T06:56:02.784 INFO:tasks.workunit.client.1.smithi089.stdout:8/688: mkdir d5/dc/d1e/df2 0 2024-08-01T06:56:02.784 INFO:tasks.workunit.client.1.smithi089.stdout:3/533: dread - d7/d68/d50/d54/fa4 zero size 2024-08-01T06:56:02.784 INFO:tasks.workunit.client.1.smithi089.stdout:5/678: dwrite d5/de/d10/d16/d1b/d52/d5d/d6c/f81 [4194304,4194304] 0 2024-08-01T06:56:02.784 INFO:tasks.workunit.client.1.smithi089.stdout:1/684: creat d0/d9/d54/fe0 x:0 0 0 2024-08-01T06:56:02.788 INFO:tasks.workunit.client.1.smithi089.stdout:8/689: symlink d5/d23/dd3/lf3 0 2024-08-01T06:56:02.792 INFO:tasks.workunit.client.1.smithi089.stdout:3/534: write d7/d32/d4c/d69/d6d/f90 [421158,111164] 0 2024-08-01T06:56:02.795 INFO:tasks.workunit.client.1.smithi089.stdout:3/535: chown d7/fa0 38896221 1 2024-08-01T06:56:02.796 INFO:tasks.workunit.client.1.smithi089.stdout:2/598: dread d7/d1f/d29/d48/d4e/fb8 [0,4194304] 0 2024-08-01T06:56:02.796 INFO:tasks.workunit.client.1.smithi089.stdout:4/665: dread d3/d17/d3a/f5d [0,4194304] 0 2024-08-01T06:56:02.797 INFO:tasks.workunit.client.1.smithi089.stdout:9/605: dwrite d18/f7e [0,4194304] 0 2024-08-01T06:56:02.798 INFO:tasks.workunit.client.1.smithi089.stdout:5/679: truncate d5/de/d10/d16/fa2 904049 0 2024-08-01T06:56:02.799 INFO:tasks.workunit.client.1.smithi089.stdout:6/716: dread d2/d2e/d2f/d9e/fe3 [0,4194304] 0 2024-08-01T06:56:02.800 INFO:tasks.workunit.client.1.smithi089.stdout:2/599: stat d7/l98 0 2024-08-01T06:56:02.801 INFO:tasks.workunit.client.1.smithi089.stdout:4/666: read d3/d17/d3a/d3d/fae [3348761,13370] 0 2024-08-01T06:56:02.802 INFO:tasks.workunit.client.1.smithi089.stdout:1/685: dread d0/d9/d15/d2b/f74 [0,4194304] 0 2024-08-01T06:56:02.804 INFO:tasks.workunit.client.1.smithi089.stdout:9/606: mknod d18/d33/d49/d7b/d4b/dbb/cc5 0 2024-08-01T06:56:02.805 INFO:tasks.workunit.client.1.smithi089.stdout:1/686: dread - d0/d9/d15/d2d/fdb zero size 2024-08-01T06:56:02.808 INFO:tasks.workunit.client.1.smithi089.stdout:9/607: fdatasync d18/d33/d49/d7b/fb8 0 2024-08-01T06:56:02.809 INFO:tasks.workunit.client.1.smithi089.stdout:5/680: creat d5/de/d10/d16/d1b/d52/d5d/fe3 x:0 0 0 2024-08-01T06:56:02.810 INFO:tasks.workunit.client.1.smithi089.stdout:4/667: truncate d3/d17/d3a/f63 2244540 0 2024-08-01T06:56:02.812 INFO:tasks.workunit.client.1.smithi089.stdout:8/690: write d5/dc/f11 [99687,129685] 0 2024-08-01T06:56:02.813 INFO:tasks.workunit.client.1.smithi089.stdout:3/536: dwrite d7/d32/d4c/f7a [0,4194304] 0 2024-08-01T06:56:02.814 INFO:tasks.workunit.client.1.smithi089.stdout:1/687: mkdir d0/d9/de1 0 2024-08-01T06:56:02.816 INFO:tasks.workunit.client.1.smithi089.stdout:5/681: write d5/d13/d38/d42/f7b [926963,98779] 0 2024-08-01T06:56:02.817 INFO:tasks.workunit.client.1.smithi089.stdout:2/600: dread f2 [0,4194304] 0 2024-08-01T06:56:02.817 INFO:tasks.workunit.client.1.smithi089.stdout:4/668: rmdir d3/d86/d9e/db1 39 2024-08-01T06:56:02.819 INFO:tasks.workunit.client.1.smithi089.stdout:9/608: rename d18/da4/fb0 to d18/d33/d3b/fc6 0 2024-08-01T06:56:02.820 INFO:tasks.workunit.client.1.smithi089.stdout:1/688: readlink d0/d9/d15/l64 0 2024-08-01T06:56:02.821 INFO:tasks.workunit.client.1.smithi089.stdout:5/682: fsync d5/de/df/fb6 0 2024-08-01T06:56:02.823 INFO:tasks.workunit.client.1.smithi089.stdout:6/717: dwrite d2/d2e/d2f/d31/f44 [0,4194304] 0 2024-08-01T06:56:02.824 INFO:tasks.workunit.client.1.smithi089.stdout:1/689: read - d0/d9/d15/d7a/fc9 zero size 2024-08-01T06:56:02.824 INFO:tasks.workunit.client.1.smithi089.stdout:8/691: creat d5/d15/ff4 x:0 0 0 2024-08-01T06:56:02.825 INFO:tasks.workunit.client.1.smithi089.stdout:4/669: write d3/d86/d9e/f41 [6376030,80614] 0 2024-08-01T06:56:02.826 INFO:tasks.workunit.client.1.smithi089.stdout:3/537: rename d7/d32/d9f/d81 to d7/d68/d50/d6f/d2f/da2/da8 0 2024-08-01T06:56:02.829 INFO:tasks.workunit.client.1.smithi089.stdout:2/601: mknod d7/cbf 0 2024-08-01T06:56:02.831 INFO:tasks.workunit.client.1.smithi089.stdout:1/690: symlink d0/d9/d15/dce/le2 0 2024-08-01T06:56:02.833 INFO:tasks.workunit.client.1.smithi089.stdout:4/670: truncate d3/db/d33/fb6 846992 0 2024-08-01T06:56:02.833 INFO:tasks.workunit.client.1.smithi089.stdout:2/602: write d7/d19/f40 [136045,71725] 0 2024-08-01T06:56:02.833 INFO:tasks.workunit.client.1.smithi089.stdout:9/609: dwrite d18/f30 [0,4194304] 0 2024-08-01T06:56:02.834 INFO:tasks.workunit.client.1.smithi089.stdout:1/691: readlink d0/d9/d15/d3b/l57 0 2024-08-01T06:56:02.834 INFO:tasks.workunit.client.1.smithi089.stdout:6/718: unlink d2/d11/d1f/d46/d6b/l79 0 2024-08-01T06:56:02.835 INFO:tasks.workunit.client.1.smithi089.stdout:8/692: unlink d5/d23/d91/c67 0 2024-08-01T06:56:02.838 INFO:tasks.workunit.client.1.smithi089.stdout:3/538: unlink d7/d68/d3d/l40 0 2024-08-01T06:56:02.840 INFO:tasks.workunit.client.1.smithi089.stdout:2/603: readlink d7/d1f/d29/l9a 0 2024-08-01T06:56:02.842 INFO:tasks.workunit.client.1.smithi089.stdout:9/610: unlink d18/l32 0 2024-08-01T06:56:02.844 INFO:tasks.workunit.client.1.smithi089.stdout:4/671: creat d3/db/d16/d35/fc6 x:0 0 0 2024-08-01T06:56:02.846 INFO:tasks.workunit.client.1.smithi089.stdout:1/692: rmdir d0/d9/d43/d4b/db0 39 2024-08-01T06:56:02.849 INFO:tasks.workunit.client.1.smithi089.stdout:5/683: rename d5/d13/d38/d42/l82 to d5/de/d10/d16/d1b/d52/le4 0 2024-08-01T06:56:02.850 INFO:tasks.workunit.client.1.smithi089.stdout:8/693: mkdir d5/dc/d94/dc7/dba/df5 0 2024-08-01T06:56:02.851 INFO:tasks.workunit.client.1.smithi089.stdout:3/539: mkdir d7/d68/d50/d54/da9 0 2024-08-01T06:56:02.856 INFO:tasks.workunit.client.1.smithi089.stdout:3/540: dwrite d7/d32/d4c/d69/f56 [0,4194304] 0 2024-08-01T06:56:02.857 INFO:tasks.workunit.client.1.smithi089.stdout:3/541: dread - d7/d32/d4c/d69/d6d/fa6 zero size 2024-08-01T06:56:02.857 INFO:tasks.workunit.client.1.smithi089.stdout:6/719: mkdir d2/d11/d3e/df1 0 2024-08-01T06:56:02.858 INFO:tasks.workunit.client.1.smithi089.stdout:4/672: symlink d3/d17/d71/d92/lc7 0 2024-08-01T06:56:02.859 INFO:tasks.workunit.client.1.smithi089.stdout:4/673: fdatasync d3/d86/d9e/f41 0 2024-08-01T06:56:02.861 INFO:tasks.workunit.client.1.smithi089.stdout:5/684: symlink d5/de/d10/d16/d1b/d25/d4d/le5 0 2024-08-01T06:56:02.865 INFO:tasks.workunit.client.1.smithi089.stdout:6/720: dwrite d2/d11/d1f/f5a [0,4194304] 0 2024-08-01T06:56:02.869 INFO:tasks.workunit.client.1.smithi089.stdout:3/542: mknod d7/d68/d50/caa 0 2024-08-01T06:56:02.870 INFO:tasks.workunit.client.1.smithi089.stdout:4/674: mknod d3/d68/cc8 0 2024-08-01T06:56:02.872 INFO:tasks.workunit.client.1.smithi089.stdout:8/694: fsync d5/dc/d94/dc7/dc5/fc8 0 2024-08-01T06:56:02.874 INFO:tasks.workunit.client.1.smithi089.stdout:3/543: dread d7/d32/d12/d29/f77 [4194304,4194304] 0 2024-08-01T06:56:02.874 INFO:tasks.workunit.client.1.smithi089.stdout:6/721: creat d2/d2e/d2f/d9e/ff2 x:0 0 0 2024-08-01T06:56:02.875 INFO:tasks.workunit.client.1.smithi089.stdout:8/695: mknod d5/d15/d5a/d73/d87/dbf/cf6 0 2024-08-01T06:56:02.876 INFO:tasks.workunit.client.1.smithi089.stdout:4/675: mknod d3/d86/db7/cc9 0 2024-08-01T06:56:02.876 INFO:tasks.workunit.client.1.smithi089.stdout:3/544: creat d7/d32/d9f/fab x:0 0 0 2024-08-01T06:56:02.877 INFO:tasks.workunit.client.1.smithi089.stdout:4/676: mknod d3/d17/d3a/d3d/cca 0 2024-08-01T06:56:02.878 INFO:tasks.workunit.client.1.smithi089.stdout:4/677: chown d3/d86/d9e/f60 44203602 1 2024-08-01T06:56:02.878 INFO:tasks.workunit.client.1.smithi089.stdout:8/696: read d5/f10 [1175484,28501] 0 2024-08-01T06:56:02.884 INFO:tasks.workunit.client.1.smithi089.stdout:8/697: dwrite d5/d23/d91/f99 [0,4194304] 0 2024-08-01T06:56:02.885 INFO:tasks.workunit.client.1.smithi089.stdout:2/604: truncate d7/d19/d3b/f50 1393606 0 2024-08-01T06:56:02.888 INFO:tasks.workunit.client.1.smithi089.stdout:2/605: chown d7/d73 27891319 1 2024-08-01T06:56:02.893 INFO:tasks.workunit.client.1.smithi089.stdout:2/606: fsync d7/d19/d1e/f70 0 2024-08-01T06:56:02.894 INFO:tasks.workunit.client.1.smithi089.stdout:8/698: rename d5/d23/l2f to d5/dc/d12/db9/lf7 0 2024-08-01T06:56:02.898 INFO:tasks.workunit.client.1.smithi089.stdout:9/611: dwrite d18/d33/d49/d7b/d7f/d98/d9f/d8e/f96 [0,4194304] 0 2024-08-01T06:56:02.899 INFO:tasks.workunit.client.1.smithi089.stdout:8/699: fdatasync d5/d15/d5a/fb4 0 2024-08-01T06:56:02.901 INFO:tasks.workunit.client.1.smithi089.stdout:2/607: mkdir d7/d1f/d52/d72/dc0 0 2024-08-01T06:56:02.902 INFO:tasks.workunit.client.1.smithi089.stdout:1/693: dwrite d0/d9/d15/d2d/d4a/d61/f7e [0,4194304] 0 2024-08-01T06:56:02.904 INFO:tasks.workunit.client.1.smithi089.stdout:2/608: fsync d7/d1f/d28/fa8 0 2024-08-01T06:56:02.904 INFO:tasks.workunit.client.1.smithi089.stdout:5/685: dwrite d5/de/d10/d16/f44 [0,4194304] 0 2024-08-01T06:56:02.906 INFO:tasks.workunit.client.1.smithi089.stdout:9/612: read d18/d33/d49/d7b/d7f/d98/d9f/d8e/fa7 [1763245,107215] 0 2024-08-01T06:56:02.909 INFO:tasks.workunit.client.1.smithi089.stdout:8/700: fsync d5/d15/f1f 0 2024-08-01T06:56:02.909 INFO:tasks.workunit.client.1.smithi089.stdout:1/694: mkdir d0/de3 0 2024-08-01T06:56:02.909 INFO:tasks.workunit.client.1.smithi089.stdout:3/545: dread d7/f1f [0,4194304] 0 2024-08-01T06:56:02.910 INFO:tasks.workunit.client.1.smithi089.stdout:9/613: chown d18/d33/d49/d7b/d7f/d98/d9f/d8e/f9e 98790 1 2024-08-01T06:56:02.911 INFO:tasks.workunit.client.1.smithi089.stdout:1/695: dread - d0/d9/d43/d4b/fdc zero size 2024-08-01T06:56:02.911 INFO:tasks.workunit.client.1.smithi089.stdout:8/701: rmdir d5/d15/d5e 39 2024-08-01T06:56:02.913 INFO:tasks.workunit.client.1.smithi089.stdout:4/678: dread d3/d17/d3a/f54 [0,4194304] 0 2024-08-01T06:56:02.914 INFO:tasks.workunit.client.1.smithi089.stdout:8/702: rmdir d5/dc/dca 39 2024-08-01T06:56:02.914 INFO:tasks.workunit.client.1.smithi089.stdout:3/546: write d7/d32/d12/f33 [1499006,118857] 0 2024-08-01T06:56:02.917 INFO:tasks.workunit.client.1.smithi089.stdout:1/696: creat d0/d9/d15/dce/fe4 x:0 0 0 2024-08-01T06:56:02.919 INFO:tasks.workunit.client.1.smithi089.stdout:9/614: rename d18/d22/d52/c65 to d18/d33/d49/d7b/d4b/db6/cc7 0 2024-08-01T06:56:02.920 INFO:tasks.workunit.client.1.smithi089.stdout:9/615: dread - d18/d22/d52/f54 zero size 2024-08-01T06:56:02.921 INFO:tasks.workunit.client.1.smithi089.stdout:3/547: write d7/d32/d12/d29/f77 [9408328,118043] 0 2024-08-01T06:56:02.923 INFO:tasks.workunit.client.1.smithi089.stdout:9/616: fdatasync d18/d33/d49/f6c 0 2024-08-01T06:56:02.924 INFO:tasks.workunit.client.1.smithi089.stdout:3/548: rmdir d7/d68/d50/d6f/d2f 39 2024-08-01T06:56:02.925 INFO:tasks.workunit.client.1.smithi089.stdout:3/549: chown d7/d32/d4c/d53/l59 266 1 2024-08-01T06:56:02.926 INFO:tasks.workunit.client.1.smithi089.stdout:3/550: chown d7/d32/d4c/d69/d6d/fa6 118528 1 2024-08-01T06:56:02.927 INFO:tasks.workunit.client.1.smithi089.stdout:9/617: chown d18/d22/d52/db7/lc0 2 1 2024-08-01T06:56:02.927 INFO:tasks.workunit.client.1.smithi089.stdout:4/679: link d3/d86/d9e/db1/dbb/c34 d3/d86/d9e/db1/dbb/d62/ccb 0 2024-08-01T06:56:02.929 INFO:tasks.workunit.client.1.smithi089.stdout:9/618: read d18/d33/d53/f8d [1140700,82414] 0 2024-08-01T06:56:02.929 INFO:tasks.workunit.client.1.smithi089.stdout:3/551: creat d7/d32/d4c/d67/fac x:0 0 0 2024-08-01T06:56:02.931 INFO:tasks.workunit.client.1.smithi089.stdout:9/619: rmdir d18/d33/d6e 39 2024-08-01T06:56:02.932 INFO:tasks.workunit.client.1.smithi089.stdout:9/620: fdatasync d18/d22/d39/d95/f9b 0 2024-08-01T06:56:02.932 INFO:tasks.workunit.client.1.smithi089.stdout:3/552: dread d7/d32/d4c/d69/d6d/f90 [0,4194304] 0 2024-08-01T06:56:02.935 INFO:tasks.workunit.client.1.smithi089.stdout:9/621: stat d18/d33/d49/d7b/d7f/d98/d9f/l76 0 2024-08-01T06:56:02.938 INFO:tasks.workunit.client.1.smithi089.stdout:2/609: read d7/d19/d3b/f50 [833282,44591] 0 2024-08-01T06:56:02.940 INFO:tasks.workunit.client.1.smithi089.stdout:2/610: chown f2 851 1 2024-08-01T06:56:02.941 INFO:tasks.workunit.client.1.smithi089.stdout:4/680: write d3/d17/d3a/f63 [2494486,79249] 0 2024-08-01T06:56:02.941 INFO:tasks.workunit.client.1.smithi089.stdout:3/553: link d7/d32/d12/d29/l7e d7/d32/d12/d29/d39/d4b/lad 0 2024-08-01T06:56:02.942 INFO:tasks.workunit.client.1.smithi089.stdout:5/686: dwrite d5/d13/f31 [0,4194304] 0 2024-08-01T06:56:02.942 INFO:tasks.workunit.client.1.smithi089.stdout:2/611: readlink d7/d4a/l4c 0 2024-08-01T06:56:02.944 INFO:tasks.workunit.client.1.smithi089.stdout:8/703: dread d5/f1a [0,4194304] 0 2024-08-01T06:56:02.945 INFO:tasks.workunit.client.1.smithi089.stdout:9/622: dwrite d18/f23 [0,4194304] 0 2024-08-01T06:56:02.947 INFO:tasks.workunit.client.1.smithi089.stdout:2/612: creat d7/d1f/d29/db7/fc1 x:0 0 0 2024-08-01T06:56:02.950 INFO:tasks.workunit.client.1.smithi089.stdout:3/554: mknod d7/d68/d50/d6f/d2f/da2/cae 0 2024-08-01T06:56:02.950 INFO:tasks.workunit.client.1.smithi089.stdout:9/623: mkdir d18/d33/d3b/dc8 0 2024-08-01T06:56:02.953 INFO:tasks.workunit.client.1.smithi089.stdout:2/613: truncate d7/f10 2637306 0 2024-08-01T06:56:02.954 INFO:tasks.workunit.client.1.smithi089.stdout:9/624: creat d18/d33/d49/d7b/d7f/d98/fc9 x:0 0 0 2024-08-01T06:56:02.957 INFO:tasks.workunit.client.1.smithi089.stdout:5/687: getdents d5/de/d10/d16/d1b/d52/d5d/d6c/d98 0 2024-08-01T06:56:02.965 INFO:tasks.workunit.client.1.smithi089.stdout:5/688: stat d5/de/d10/d16/d1b/d25/c36 0 2024-08-01T06:56:02.967 INFO:tasks.workunit.client.1.smithi089.stdout:8/704: dwrite d5/f10 [0,4194304] 0 2024-08-01T06:56:02.970 INFO:tasks.workunit.client.1.smithi089.stdout:9/625: dwrite d18/f6b [4194304,4194304] 0 2024-08-01T06:56:02.971 INFO:tasks.workunit.client.1.smithi089.stdout:4/681: dwrite d3/d86/d9e/db1/dbb/d62/d31/f89 [0,4194304] 0 2024-08-01T06:56:02.973 INFO:tasks.workunit.client.1.smithi089.stdout:2/614: dwrite d7/d19/d1e/d3d/d60/f8c [0,4194304] 0 2024-08-01T06:56:02.977 INFO:tasks.workunit.client.1.smithi089.stdout:5/689: readlink d5/de/d10/d16/d1b/d52/d5f/lc0 0 2024-08-01T06:56:02.977 INFO:tasks.workunit.client.1.smithi089.stdout:2/615: mknod d7/d1f/d29/d48/d4e/cc2 0 2024-08-01T06:56:02.983 INFO:tasks.workunit.client.1.smithi089.stdout:4/682: dwrite d3/d17/d3a/d3d/fc2 [0,4194304] 0 2024-08-01T06:56:02.983 INFO:tasks.workunit.client.1.smithi089.stdout:9/626: dread d18/d33/f37 [0,4194304] 0 2024-08-01T06:56:02.983 INFO:tasks.workunit.client.1.smithi089.stdout:5/690: mkdir d5/de/df/de6 0 2024-08-01T06:56:02.984 INFO:tasks.workunit.client.1.smithi089.stdout:2/616: symlink d7/lc3 0 2024-08-01T06:56:02.985 INFO:tasks.workunit.client.1.smithi089.stdout:4/683: write d3/d1e/f4e [1285729,110249] 0 2024-08-01T06:56:02.986 INFO:tasks.workunit.client.1.smithi089.stdout:8/705: rmdir d5/dc/d1e/df2 0 2024-08-01T06:56:02.989 INFO:tasks.workunit.client.1.smithi089.stdout:9/627: unlink d18/d22/d52/db7/lc0 0 2024-08-01T06:56:02.990 INFO:tasks.workunit.client.1.smithi089.stdout:2/617: write d7/d19/d1e/f54 [2453775,105306] 0 2024-08-01T06:56:02.993 INFO:tasks.workunit.client.1.smithi089.stdout:8/706: rmdir d5/dc/d12 39 2024-08-01T06:56:02.994 INFO:tasks.workunit.client.1.smithi089.stdout:2/618: symlink d7/d1f/d28/lc4 0 2024-08-01T06:56:02.995 INFO:tasks.workunit.client.1.smithi089.stdout:5/691: rmdir d5/de/df/de6 0 2024-08-01T06:56:02.996 INFO:tasks.workunit.client.1.smithi089.stdout:9/628: fdatasync f13 0 2024-08-01T06:56:02.997 INFO:tasks.workunit.client.1.smithi089.stdout:2/619: fdatasync d7/d1f/d29/db7/fc1 0 2024-08-01T06:56:03.000 INFO:tasks.workunit.client.1.smithi089.stdout:9/629: creat d18/d22/fca x:0 0 0 2024-08-01T06:56:03.000 INFO:tasks.workunit.client.1.smithi089.stdout:4/684: dwrite d3/d86/d9e/d57/f5e [0,4194304] 0 2024-08-01T06:56:03.004 INFO:tasks.workunit.client.1.smithi089.stdout:4/685: rmdir d3/db/d16 39 2024-08-01T06:56:03.004 INFO:tasks.workunit.client.1.smithi089.stdout:8/707: dread d5/f1a [0,4194304] 0 2024-08-01T06:56:03.006 INFO:tasks.workunit.client.1.smithi089.stdout:9/630: creat d18/d33/d3b/dc8/fcb x:0 0 0 2024-08-01T06:56:03.009 INFO:tasks.workunit.client.1.smithi089.stdout:8/708: fdatasync d5/dc/d1e/f34 0 2024-08-01T06:56:03.011 INFO:tasks.workunit.client.1.smithi089.stdout:5/692: dwrite d5/de/d57/db0/fca [0,4194304] 0 2024-08-01T06:56:03.011 INFO:tasks.workunit.client.1.smithi089.stdout:9/631: symlink d18/d22/d52/lcc 0 2024-08-01T06:56:03.013 INFO:tasks.workunit.client.1.smithi089.stdout:2/620: dwrite d7/d1f/d29/d48/d4e/fa5 [4194304,4194304] 0 2024-08-01T06:56:03.015 INFO:tasks.workunit.client.1.smithi089.stdout:2/621: fdatasync d7/d1f/d28/fa8 0 2024-08-01T06:56:03.015 INFO:tasks.workunit.client.1.smithi089.stdout:5/693: read d5/de/d10/d16/d1b/f22 [4906155,91821] 0 2024-08-01T06:56:03.017 INFO:tasks.workunit.client.1.smithi089.stdout:9/632: mkdir d18/d33/d49/d7b/d7f/d98/dcd 0 2024-08-01T06:56:03.019 INFO:tasks.workunit.client.1.smithi089.stdout:4/686: rename d3/d86/d9e/db1/dbb/d62/d31/l96 to d3/d17/lcc 0 2024-08-01T06:56:03.020 INFO:tasks.workunit.client.1.smithi089.stdout:9/633: creat d18/d22/fce x:0 0 0 2024-08-01T06:56:03.022 INFO:tasks.workunit.client.1.smithi089.stdout:4/687: stat d3/db/d16/f18 0 2024-08-01T06:56:03.023 INFO:tasks.workunit.client.1.smithi089.stdout:4/688: stat d3/db/f13 0 2024-08-01T06:56:03.024 INFO:tasks.workunit.client.1.smithi089.stdout:4/689: fsync d3/d1e/f58 0 2024-08-01T06:56:03.025 INFO:tasks.workunit.client.1.smithi089.stdout:8/709: rename d5/dc/d1e/d53/lac to d5/d15/lf8 0 2024-08-01T06:56:03.025 INFO:tasks.workunit.client.1.smithi089.stdout:5/694: dwrite d5/de/d10/d16/d1b/d25/f70 [0,4194304] 0 2024-08-01T06:56:03.027 INFO:tasks.workunit.client.1.smithi089.stdout:9/634: creat d18/d22/d45/daa/fcf x:0 0 0 2024-08-01T06:56:03.028 INFO:tasks.workunit.client.1.smithi089.stdout:4/690: write d3/d68/d7e/fb2 [250065,41514] 0 2024-08-01T06:56:03.028 INFO:tasks.workunit.client.1.smithi089.stdout:5/695: creat d5/d13/d38/fe7 x:0 0 0 2024-08-01T06:56:03.030 INFO:tasks.workunit.client.1.smithi089.stdout:5/696: stat d5/de/d57/ca8 0 2024-08-01T06:56:03.030 INFO:tasks.workunit.client.1.smithi089.stdout:8/710: truncate d5/dc/dca/fe6 256502 0 2024-08-01T06:56:03.030 INFO:tasks.workunit.client.1.smithi089.stdout:4/691: chown d3/d17/d3a/d3d/cca 2287 1 2024-08-01T06:56:03.032 INFO:tasks.workunit.client.1.smithi089.stdout:8/711: chown d5/d23/dd3/lf3 30 1 2024-08-01T06:56:03.032 INFO:tasks.workunit.client.1.smithi089.stdout:4/692: dread - d3/d17/f9a zero size 2024-08-01T06:56:03.033 INFO:tasks.workunit.client.1.smithi089.stdout:9/635: link d18/d22/d45/c67 d18/d33/d49/d7b/d55/cd0 0 2024-08-01T06:56:03.036 INFO:tasks.workunit.client.1.smithi089.stdout:5/697: dread d5/de/d10/d16/d1b/d25/f64 [4194304,4194304] 0 2024-08-01T06:56:03.038 INFO:tasks.workunit.client.1.smithi089.stdout:8/712: dread d5/f9c [0,4194304] 0 2024-08-01T06:56:03.038 INFO:tasks.workunit.client.1.smithi089.stdout:5/698: write d5/f73 [8313767,20849] 0 2024-08-01T06:56:03.041 INFO:tasks.workunit.client.1.smithi089.stdout:5/699: dread - d5/de/df/d9f/dbd/fd5 zero size 2024-08-01T06:56:03.041 INFO:tasks.workunit.client.1.smithi089.stdout:7/614: sync 2024-08-01T06:56:03.042 INFO:tasks.workunit.client.1.smithi089.stdout:8/713: mkdir d5/d15/d5e/df9 0 2024-08-01T06:56:03.043 INFO:tasks.workunit.client.1.smithi089.stdout:9/636: dwrite d18/d33/d49/d7b/fb8 [0,4194304] 0 2024-08-01T06:56:03.045 INFO:tasks.workunit.client.1.smithi089.stdout:5/700: write d5/de/d57/db0/fb2 [2493024,37033] 0 2024-08-01T06:56:03.046 INFO:tasks.workunit.client.1.smithi089.stdout:8/714: rmdir d5 39 2024-08-01T06:56:03.047 INFO:tasks.workunit.client.1.smithi089.stdout:5/701: fdatasync d5/de/d10/d16/d1b/d25/f62 0 2024-08-01T06:56:03.049 INFO:tasks.workunit.client.1.smithi089.stdout:5/702: chown d5/de/d57/d8e/d97/da5 105581699 1 2024-08-01T06:56:03.049 INFO:tasks.workunit.client.1.smithi089.stdout:4/693: dread d3/d17/d3a/f70 [0,4194304] 0 2024-08-01T06:56:03.050 INFO:tasks.workunit.client.1.smithi089.stdout:5/703: truncate d5/d13/d38/fe7 1037012 0 2024-08-01T06:56:03.052 INFO:tasks.workunit.client.1.smithi089.stdout:9/637: mkdir d18/d33/d6e/dd1 0 2024-08-01T06:56:03.052 INFO:tasks.workunit.client.1.smithi089.stdout:9/638: fdatasync f5 0 2024-08-01T06:56:03.053 INFO:tasks.workunit.client.1.smithi089.stdout:9/639: truncate d18/fc1 1044362 0 2024-08-01T06:56:03.055 INFO:tasks.workunit.client.1.smithi089.stdout:9/640: write d18/f23 [580584,92144] 0 2024-08-01T06:56:03.055 INFO:tasks.workunit.client.1.smithi089.stdout:8/715: read - d5/dc/d94/d84/ddb/fe7 zero size 2024-08-01T06:56:03.056 INFO:tasks.workunit.client.1.smithi089.stdout:4/694: mknod d3/d86/d9e/db1/dbb/ccd 0 2024-08-01T06:56:03.058 INFO:tasks.workunit.client.1.smithi089.stdout:8/716: chown d5/dc/d1e/f95 695 1 2024-08-01T06:56:03.060 INFO:tasks.workunit.client.1.smithi089.stdout:5/704: creat d5/de/d10/fe8 x:0 0 0 2024-08-01T06:56:03.060 INFO:tasks.workunit.client.1.smithi089.stdout:4/695: write d3/d86/d9e/db1/dbb/d62/db3/fb5 [572294,119494] 0 2024-08-01T06:56:03.061 INFO:tasks.workunit.client.1.smithi089.stdout:8/717: mkdir d5/d15/d5a/dfa 0 2024-08-01T06:56:03.063 INFO:tasks.workunit.client.1.smithi089.stdout:7/615: dwrite f3 [0,4194304] 0 2024-08-01T06:56:03.063 INFO:tasks.workunit.client.1.smithi089.stdout:4/696: readlink d3/d17/d71/d92/lc0 0 2024-08-01T06:56:03.063 INFO:tasks.workunit.client.1.smithi089.stdout:5/705: unlink d5/d13/f2b 0 2024-08-01T06:56:03.065 INFO:tasks.workunit.client.1.smithi089.stdout:8/718: mknod d5/dc/d1e/d53/cfb 0 2024-08-01T06:56:03.066 INFO:tasks.workunit.client.1.smithi089.stdout:4/697: chown d3/d68/d7e/f99 19 1 2024-08-01T06:56:03.067 INFO:tasks.workunit.client.1.smithi089.stdout:7/616: truncate d7/d1f/da6/fb7 102546 0 2024-08-01T06:56:03.068 INFO:tasks.workunit.client.1.smithi089.stdout:8/719: creat d5/dc/d94/dc7/dba/ffc x:0 0 0 2024-08-01T06:56:03.068 INFO:tasks.workunit.client.1.smithi089.stdout:7/617: dread - d7/df/fb9 zero size 2024-08-01T06:56:03.069 INFO:tasks.workunit.client.1.smithi089.stdout:4/698: mknod d3/d68/cce 0 2024-08-01T06:56:03.069 INFO:tasks.workunit.client.1.smithi089.stdout:7/618: chown d7/df 18520315 1 2024-08-01T06:56:03.070 INFO:tasks.workunit.client.1.smithi089.stdout:4/699: readlink d3/db/d16/lc 0 2024-08-01T06:56:03.071 INFO:tasks.workunit.client.1.smithi089.stdout:5/706: rename d5/de/d57/db0 to d5/de/d57/d8e/d97/da5/dde/de9 0 2024-08-01T06:56:03.072 INFO:tasks.workunit.client.1.smithi089.stdout:9/641: dread d18/d33/d3b/f69 [0,4194304] 0 2024-08-01T06:56:03.073 INFO:tasks.workunit.client.1.smithi089.stdout:8/720: creat d5/dc/d1e/d53/ffd x:0 0 0 2024-08-01T06:56:03.075 INFO:tasks.workunit.client.1.smithi089.stdout:7/619: creat d7/df/d3b/fcf x:0 0 0 2024-08-01T06:56:03.077 INFO:tasks.workunit.client.1.smithi089.stdout:9/642: creat d18/d33/d49/d7b/d55/fd2 x:0 0 0 2024-08-01T06:56:03.078 INFO:tasks.workunit.client.1.smithi089.stdout:5/707: dwrite d5/f3c [0,4194304] 0 2024-08-01T06:56:03.079 INFO:tasks.workunit.client.1.smithi089.stdout:7/620: creat d7/df/d10/d31/d4a/fd0 x:0 0 0 2024-08-01T06:56:03.080 INFO:tasks.workunit.client.1.smithi089.stdout:8/721: symlink d5/d15/d5a/lfe 0 2024-08-01T06:56:03.084 INFO:tasks.workunit.client.1.smithi089.stdout:5/708: symlink d5/de/d10/d16/d9d/lea 0 2024-08-01T06:56:03.088 INFO:tasks.workunit.client.1.smithi089.stdout:4/700: getdents d3/d86/d9e/db1/dbb 0 2024-08-01T06:56:03.089 INFO:tasks.workunit.client.1.smithi089.stdout:8/722: symlink d5/dc/dca/lff 0 2024-08-01T06:56:03.090 INFO:tasks.workunit.client.1.smithi089.stdout:5/709: dwrite d5/de/d57/d8e/d97/da5/dde/de9/fca [0,4194304] 0 2024-08-01T06:56:03.090 INFO:tasks.workunit.client.1.smithi089.stdout:9/643: mkdir d18/d33/d49/dd3 0 2024-08-01T06:56:03.093 INFO:tasks.workunit.client.1.smithi089.stdout:4/701: mknod d3/d86/d9e/db1/ccf 0 2024-08-01T06:56:03.093 INFO:tasks.workunit.client.1.smithi089.stdout:7/621: rmdir d7 39 2024-08-01T06:56:03.095 INFO:tasks.workunit.client.1.smithi089.stdout:4/702: fsync d3/d1e/f4e 0 2024-08-01T06:56:03.095 INFO:tasks.workunit.client.1.smithi089.stdout:8/723: mkdir d5/dc/d94/dc7/dba/d100 0 2024-08-01T06:56:03.099 INFO:tasks.workunit.client.1.smithi089.stdout:5/710: mkdir d5/de/d10/deb 0 2024-08-01T06:56:03.099 INFO:tasks.workunit.client.1.smithi089.stdout:9/644: dwrite d18/d22/d39/d95/f9b [0,4194304] 0 2024-08-01T06:56:03.100 INFO:tasks.workunit.client.1.smithi089.stdout:8/724: readlink d5/dc/d94/l7a 0 2024-08-01T06:56:03.102 INFO:tasks.workunit.client.1.smithi089.stdout:5/711: write d5/d13/f31 [2723530,103799] 0 2024-08-01T06:56:03.105 INFO:tasks.workunit.client.1.smithi089.stdout:9/645: creat d18/d22/d52/db7/fd4 x:0 0 0 2024-08-01T06:56:03.105 INFO:tasks.workunit.client.1.smithi089.stdout:5/712: write d5/de/d10/d16/d1b/d52/d5d/d6c/fa1 [1356518,44292] 0 2024-08-01T06:56:03.106 INFO:tasks.workunit.client.1.smithi089.stdout:7/622: link d7/d1f/c2c d7/d1f/d30/cd1 0 2024-08-01T06:56:03.107 INFO:tasks.workunit.client.1.smithi089.stdout:7/623: stat d7/df/d10/d31/c70 0 2024-08-01T06:56:03.108 INFO:tasks.workunit.client.1.smithi089.stdout:4/703: truncate d3/db/d33/f6f 3845025 0 2024-08-01T06:56:03.109 INFO:tasks.workunit.client.1.smithi089.stdout:9/646: creat d18/d33/d49/d7b/d4b/fd5 x:0 0 0 2024-08-01T06:56:03.110 INFO:tasks.workunit.client.1.smithi089.stdout:5/713: mkdir d5/de/d10/d16/d1b/d52/dec 0 2024-08-01T06:56:03.112 INFO:tasks.workunit.client.1.smithi089.stdout:8/725: dwrite d5/dc/fa1 [0,4194304] 0 2024-08-01T06:56:03.112 INFO:tasks.workunit.client.1.smithi089.stdout:9/647: rmdir d18/d22/d39/d95 39 2024-08-01T06:56:03.115 INFO:tasks.workunit.client.1.smithi089.stdout:7/624: chown d7/df/d3b/d64/c74 577640328 1 2024-08-01T06:56:03.117 INFO:tasks.workunit.client.1.smithi089.stdout:5/714: getdents d5/de/d10/d16/d1b/d25 0 2024-08-01T06:56:03.118 INFO:tasks.workunit.client.1.smithi089.stdout:7/625: creat d7/d1f/d30/db1/fd2 x:0 0 0 2024-08-01T06:56:03.120 INFO:tasks.workunit.client.1.smithi089.stdout:5/715: write d5/de/d10/d16/d1b/d25/f68 [1016031,78073] 0 2024-08-01T06:56:03.121 INFO:tasks.workunit.client.1.smithi089.stdout:5/716: dread - d5/de/df/d9f/dbd/fc4 zero size 2024-08-01T06:56:03.124 INFO:tasks.workunit.client.1.smithi089.stdout:5/717: chown d5/d13/d83/l8d 432262 1 2024-08-01T06:56:03.125 INFO:tasks.workunit.client.1.smithi089.stdout:7/626: dwrite d7/fd [0,4194304] 0 2024-08-01T06:56:03.131 INFO:tasks.workunit.client.1.smithi089.stdout:5/718: dwrite d5/fd3 [0,4194304] 0 2024-08-01T06:56:03.131 INFO:tasks.workunit.client.1.smithi089.stdout:7/627: dread d7/df/d10/d31/d43/f88 [0,4194304] 0 2024-08-01T06:56:03.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:02 smithi089 ceph-mon[36617]: pgmap v15: 65 pgs: 65 active+clean; 1.2 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 37 MiB/s rd, 165 MiB/s wr, 391 op/s 2024-08-01T06:56:03.138 INFO:tasks.workunit.client.1.smithi089.stdout:7/628: creat d7/df/d91/da4/dca/fd3 x:0 0 0 2024-08-01T06:56:03.139 INFO:tasks.workunit.client.1.smithi089.stdout:7/629: chown d7/df/d10/d42/d75 1710 1 2024-08-01T06:56:03.140 INFO:tasks.workunit.client.1.smithi089.stdout:5/719: rmdir d5/de/d10/d16/d1b/d52/dec 0 2024-08-01T06:56:03.140 INFO:tasks.workunit.client.1.smithi089.stdout:0/768: sync 2024-08-01T06:56:03.142 INFO:tasks.workunit.client.1.smithi089.stdout:0/769: fsync d9/d40/d25/d46/d91/d2e/d3a/d76/fcf 0 2024-08-01T06:56:03.143 INFO:tasks.workunit.client.1.smithi089.stdout:7/630: symlink d7/d1f/d30/ld4 0 2024-08-01T06:56:03.147 INFO:tasks.workunit.client.1.smithi089.stdout:5/720: creat d5/de/d10/d33/d5e/fed x:0 0 0 2024-08-01T06:56:03.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:02 smithi016 ceph-mon[29266]: pgmap v15: 65 pgs: 65 active+clean; 1.2 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 37 MiB/s rd, 165 MiB/s wr, 391 op/s 2024-08-01T06:56:03.151 INFO:tasks.workunit.client.1.smithi089.stdout:0/770: getdents d9/d40/d25/d46 0 2024-08-01T06:56:03.152 INFO:tasks.workunit.client.1.smithi089.stdout:4/704: dwrite d3/d1e/f6e [0,4194304] 0 2024-08-01T06:56:03.154 INFO:tasks.workunit.client.1.smithi089.stdout:8/726: dread d5/d23/f38 [0,4194304] 0 2024-08-01T06:56:03.154 INFO:tasks.workunit.client.1.smithi089.stdout:7/631: rename d7/df/d10/c3d to d7/df/d10/cd5 0 2024-08-01T06:56:03.158 INFO:tasks.workunit.client.1.smithi089.stdout:5/721: link d5/de/d10/d16/fa2 d5/de/d57/d8e/d97/da5/fee 0 2024-08-01T06:56:03.158 INFO:tasks.workunit.client.1.smithi089.stdout:7/632: write d7/df/d91/d98/f9b [666540,9189] 0 2024-08-01T06:56:03.158 INFO:tasks.workunit.client.1.smithi089.stdout:8/727: write d5/d15/f1c [3557706,124741] 0 2024-08-01T06:56:03.158 INFO:tasks.workunit.client.1.smithi089.stdout:7/633: write d7/df/d10/d31/f8b [555368,24690] 0 2024-08-01T06:56:03.159 INFO:tasks.workunit.client.1.smithi089.stdout:0/771: unlink d9/d40/d25/d46/d91/d2e/d44/d72/d8b/f9e 0 2024-08-01T06:56:03.162 INFO:tasks.workunit.client.1.smithi089.stdout:4/705: mknod d3/d86/d9e/db1/dbb/d62/cd0 0 2024-08-01T06:56:03.169 INFO:tasks.workunit.client.1.smithi089.stdout:0/772: creat d9/d40/d25/d46/ff3 x:0 0 0 2024-08-01T06:56:03.170 INFO:tasks.workunit.client.1.smithi089.stdout:0/773: chown d9/d40/d95/d99/dec 58 1 2024-08-01T06:56:03.170 INFO:tasks.workunit.client.1.smithi089.stdout:8/728: mknod d5/d15/c101 0 2024-08-01T06:56:03.171 INFO:tasks.workunit.client.1.smithi089.stdout:0/774: write d9/d40/d45/d47/da8/fb3 [142525,10914] 0 2024-08-01T06:56:03.172 INFO:tasks.workunit.client.1.smithi089.stdout:7/634: mkdir d7/df/d10/dd6 0 2024-08-01T06:56:03.175 INFO:tasks.workunit.client.1.smithi089.stdout:8/729: unlink d5/d15/d5e/f69 0 2024-08-01T06:56:03.177 INFO:tasks.workunit.client.1.smithi089.stdout:0/775: rmdir d9/d40/d25/d46/d91/d2e/d3a/d76/d96 39 2024-08-01T06:56:03.178 INFO:tasks.workunit.client.1.smithi089.stdout:4/706: dread d3/d68/f7f [0,4194304] 0 2024-08-01T06:56:03.178 INFO:tasks.workunit.client.1.smithi089.stdout:5/722: link d5/d13/d38/d42/cdc d5/de/d10/d16/d1b/cef 0 2024-08-01T06:56:03.179 INFO:tasks.workunit.client.1.smithi089.stdout:4/707: read d3/d86/d9e/f60 [861939,42649] 0 2024-08-01T06:56:03.180 INFO:tasks.workunit.client.1.smithi089.stdout:8/730: creat d5/dc/dca/f102 x:0 0 0 2024-08-01T06:56:03.181 INFO:tasks.workunit.client.1.smithi089.stdout:7/635: mkdir d7/d1f/d30/d4c/dbc/dcd/dd7 0 2024-08-01T06:56:03.186 INFO:tasks.workunit.client.1.smithi089.stdout:5/723: dwrite d5/de/d57/d8e/fd6 [0,4194304] 0 2024-08-01T06:56:03.189 INFO:tasks.workunit.client.1.smithi089.stdout:4/708: dwrite d3/db/d33/fb6 [0,4194304] 0 2024-08-01T06:56:03.189 INFO:tasks.workunit.client.1.smithi089.stdout:7/636: creat d7/df/fd8 x:0 0 0 2024-08-01T06:56:03.190 INFO:tasks.workunit.client.1.smithi089.stdout:4/709: stat d3/d17/d3a/l53 0 2024-08-01T06:56:03.191 INFO:tasks.workunit.client.1.smithi089.stdout:8/731: dwrite d5/d15/d5a/d73/d87/fec [0,4194304] 0 2024-08-01T06:56:03.194 INFO:tasks.workunit.client.1.smithi089.stdout:8/732: chown d5/dc/d1e/d53/f60 1 1 2024-08-01T06:56:03.194 INFO:tasks.workunit.client.1.smithi089.stdout:4/710: read d3/db/de/d5b/f75 [3128204,27949] 0 2024-08-01T06:56:03.195 INFO:tasks.workunit.client.1.smithi089.stdout:5/724: chown d5/ccb 298692 1 2024-08-01T06:56:03.196 INFO:tasks.workunit.client.1.smithi089.stdout:4/711: chown d3/db/d16/f4f 62 1 2024-08-01T06:56:03.196 INFO:tasks.workunit.client.1.smithi089.stdout:5/725: chown d5/de/df/d9f/cab 164072 1 2024-08-01T06:56:03.198 INFO:tasks.workunit.client.1.smithi089.stdout:4/712: chown d3/d86/d9e/db1/dbb/ccd 1255714 1 2024-08-01T06:56:03.209 INFO:tasks.workunit.client.1.smithi089.stdout:0/776: write d9/f13 [1222303,29698] 0 2024-08-01T06:56:03.211 INFO:tasks.workunit.client.1.smithi089.stdout:4/713: mkdir d3/d86/db7/dd1 0 2024-08-01T06:56:03.217 INFO:tasks.workunit.client.1.smithi089.stdout:3/555: sync 2024-08-01T06:56:03.217 INFO:tasks.workunit.client.1.smithi089.stdout:1/697: sync 2024-08-01T06:56:03.219 INFO:tasks.workunit.client.1.smithi089.stdout:5/726: dwrite d5/de/d57/d8e/d97/da5/fc9 [0,4194304] 0 2024-08-01T06:56:03.220 INFO:tasks.workunit.client.1.smithi089.stdout:8/733: rename d5/dc/f63 to d5/dc/d12/f103 0 2024-08-01T06:56:03.222 INFO:tasks.workunit.client.1.smithi089.stdout:7/637: dread d7/df/d10/d42/d4e/f77 [0,4194304] 0 2024-08-01T06:56:03.222 INFO:tasks.workunit.client.1.smithi089.stdout:6/722: sync 2024-08-01T06:56:03.222 INFO:tasks.workunit.client.1.smithi089.stdout:2/622: sync 2024-08-01T06:56:03.224 INFO:tasks.workunit.client.1.smithi089.stdout:4/714: dwrite d3/db/d16/f18 [8388608,4194304] 0 2024-08-01T06:56:03.224 INFO:tasks.workunit.client.1.smithi089.stdout:3/556: rmdir d7/d68/d50/d54/d78 39 2024-08-01T06:56:03.226 INFO:tasks.workunit.client.1.smithi089.stdout:5/727: write d5/de/d57/d8e/fd6 [3630411,23795] 0 2024-08-01T06:56:03.228 INFO:tasks.workunit.client.1.smithi089.stdout:6/723: write d2/d11/d1f/d46/f72 [232192,54179] 0 2024-08-01T06:56:03.231 INFO:tasks.workunit.client.1.smithi089.stdout:2/623: mkdir d7/d19/dc5 0 2024-08-01T06:56:03.235 INFO:tasks.workunit.client.1.smithi089.stdout:7/638: creat d7/df/d91/d98/fd9 x:0 0 0 2024-08-01T06:56:03.237 INFO:tasks.workunit.client.1.smithi089.stdout:0/777: dread d9/d40/d25/fe3 [0,4194304] 0 2024-08-01T06:56:03.239 INFO:tasks.workunit.client.1.smithi089.stdout:3/557: unlink d7/d32/d12/d29/d39/la7 0 2024-08-01T06:56:03.241 INFO:tasks.workunit.client.1.smithi089.stdout:5/728: dwrite d5/de/d10/d16/d1b/d25/d4d/f9b [0,4194304] 0 2024-08-01T06:56:03.241 INFO:tasks.workunit.client.1.smithi089.stdout:8/734: dread d5/d15/f44 [0,4194304] 0 2024-08-01T06:56:03.242 INFO:tasks.workunit.client.1.smithi089.stdout:3/558: dread - d7/d32/d4c/d67/fac zero size 2024-08-01T06:56:03.243 INFO:tasks.workunit.client.1.smithi089.stdout:4/715: rename d3/d86/d9e/d26 to d3/d86/db7/dd2 0 2024-08-01T06:56:03.243 INFO:tasks.workunit.client.1.smithi089.stdout:6/724: rmdir d2/d11/d1a 39 2024-08-01T06:56:03.246 INFO:tasks.workunit.client.1.smithi089.stdout:1/698: dread d0/d9/d15/d2d/d4a/f47 [0,4194304] 0 2024-08-01T06:56:03.246 INFO:tasks.workunit.client.1.smithi089.stdout:6/725: read d2/d30/fe7 [427241,17818] 0 2024-08-01T06:56:03.249 INFO:tasks.workunit.client.1.smithi089.stdout:2/624: creat d7/d1f/d29/d48/d4e/d9e/fc6 x:0 0 0 2024-08-01T06:56:03.251 INFO:tasks.workunit.client.1.smithi089.stdout:9/648: sync 2024-08-01T06:56:03.251 INFO:tasks.workunit.client.1.smithi089.stdout:3/559: dwrite d7/d68/d50/d54/fa4 [0,4194304] 0 2024-08-01T06:56:03.252 INFO:tasks.workunit.client.1.smithi089.stdout:3/560: truncate d7/f1f 4683371 0 2024-08-01T06:56:03.253 INFO:tasks.workunit.client.1.smithi089.stdout:7/639: creat d7/df/d91/da4/dca/fda x:0 0 0 2024-08-01T06:56:03.255 INFO:tasks.workunit.client.1.smithi089.stdout:0/778: symlink d9/d40/d25/lf4 0 2024-08-01T06:56:03.259 INFO:tasks.workunit.client.1.smithi089.stdout:4/716: rename d3/d86/db7/dd2/la2 to d3/d17/d71/d92/ld3 0 2024-08-01T06:56:03.262 INFO:tasks.workunit.client.1.smithi089.stdout:1/699: creat d0/d9/d15/dce/dd3/fe5 x:0 0 0 2024-08-01T06:56:03.262 INFO:tasks.workunit.client.1.smithi089.stdout:0/779: dwrite d9/d40/d45/d47/fc0 [0,4194304] 0 2024-08-01T06:56:03.265 INFO:tasks.workunit.client.1.smithi089.stdout:0/780: write d9/d40/d25/d46/d91/d2e/d44/d53/daf/fb6 [4410052,65603] 0 2024-08-01T06:56:03.271 INFO:tasks.workunit.client.1.smithi089.stdout:2/625: dread d7/d1f/d29/d48/d4e/fb8 [0,4194304] 0 2024-08-01T06:56:03.271 INFO:tasks.workunit.client.1.smithi089.stdout:2/626: stat d7/d19/c82 0 2024-08-01T06:56:03.273 INFO:tasks.workunit.client.1.smithi089.stdout:8/735: unlink d5/d23/fbb 0 2024-08-01T06:56:03.277 INFO:tasks.workunit.client.1.smithi089.stdout:2/627: dwrite d7/f23 [0,4194304] 0 2024-08-01T06:56:03.278 INFO:tasks.workunit.client.1.smithi089.stdout:1/700: write d0/d9/d43/d4b/db0/fd0 [718802,130831] 0 2024-08-01T06:56:03.278 INFO:tasks.workunit.client.1.smithi089.stdout:1/701: fdatasync d0/fc2 0 2024-08-01T06:56:03.281 INFO:tasks.workunit.client.1.smithi089.stdout:9/649: symlink d18/ld6 0 2024-08-01T06:56:03.284 INFO:tasks.workunit.client.1.smithi089.stdout:3/561: symlink d7/d32/laf 0 2024-08-01T06:56:03.286 INFO:tasks.workunit.client.1.smithi089.stdout:3/562: fdatasync d7/d32/d12/d1b/f3c 0 2024-08-01T06:56:03.294 INFO:tasks.workunit.client.1.smithi089.stdout:6/726: symlink d2/d11/d1a/d1c/lf3 0 2024-08-01T06:56:03.295 INFO:tasks.workunit.client.1.smithi089.stdout:2/628: dread d7/d1f/d52/d6e/fbb [0,4194304] 0 2024-08-01T06:56:03.298 INFO:tasks.workunit.client.1.smithi089.stdout:9/650: stat cd 0 2024-08-01T06:56:03.301 INFO:tasks.workunit.client.1.smithi089.stdout:0/781: link d9/d40/d25/d46/d91/d2e/d44/d72/fdc d9/d40/d45/db7/ff5 0 2024-08-01T06:56:03.302 INFO:tasks.workunit.client.1.smithi089.stdout:7/640: truncate d7/fb 1914464 0 2024-08-01T06:56:03.304 INFO:tasks.workunit.client.1.smithi089.stdout:9/651: dwrite d18/d33/d53/f8b [0,4194304] 0 2024-08-01T06:56:03.305 INFO:tasks.workunit.client.1.smithi089.stdout:9/652: write d18/d22/d39/f42 [2814257,92919] 0 2024-08-01T06:56:03.306 INFO:tasks.workunit.client.1.smithi089.stdout:0/782: read d9/d40/d95/d99/d2b/d55/f83 [120038,102206] 0 2024-08-01T06:56:03.306 INFO:tasks.workunit.client.1.smithi089.stdout:4/717: write d3/db/d33/f6f [3372918,112488] 0 2024-08-01T06:56:03.309 INFO:tasks.workunit.client.1.smithi089.stdout:8/736: link d5/d23/d91/fef d5/dc/d94/dc7/dba/d100/f104 0 2024-08-01T06:56:03.309 INFO:tasks.workunit.client.1.smithi089.stdout:9/653: write d18/d33/d49/d7b/d81/fac [968124,75688] 0 2024-08-01T06:56:03.311 INFO:tasks.workunit.client.1.smithi089.stdout:9/654: chown d18/d33/d3b/fc6 453 1 2024-08-01T06:56:03.312 INFO:tasks.workunit.client.1.smithi089.stdout:2/629: chown d7/d19/d3b/c91 714524 1 2024-08-01T06:56:03.316 INFO:tasks.workunit.client.1.smithi089.stdout:7/641: unlink d7/df/d91/da4/fac 0 2024-08-01T06:56:03.324 INFO:tasks.workunit.client.1.smithi089.stdout:0/783: symlink d9/d40/d25/d46/d91/d2e/d44/d53/lf6 0 2024-08-01T06:56:03.324 INFO:tasks.workunit.client.1.smithi089.stdout:0/784: fsync d9/f77 0 2024-08-01T06:56:03.328 INFO:tasks.workunit.client.1.smithi089.stdout:2/630: mknod d7/d1f/d28/cc7 0 2024-08-01T06:56:03.331 INFO:tasks.workunit.client.1.smithi089.stdout:3/563: creat d7/fb0 x:0 0 0 2024-08-01T06:56:03.331 INFO:tasks.workunit.client.1.smithi089.stdout:3/564: fdatasync d7/d32/d4c/d67/fac 0 2024-08-01T06:56:03.332 INFO:tasks.workunit.client.1.smithi089.stdout:3/565: chown d7/d68/d50/d6f/f49 26 1 2024-08-01T06:56:03.332 INFO:tasks.workunit.client.1.smithi089.stdout:6/727: symlink d2/d2e/d2f/d91/lf4 0 2024-08-01T06:56:03.333 INFO:tasks.workunit.client.1.smithi089.stdout:6/728: readlink d2/d2e/d7c/laa 0 2024-08-01T06:56:03.333 INFO:tasks.workunit.client.1.smithi089.stdout:3/566: dread - d7/d32/d12/d29/d39/d4b/d83/f9b zero size 2024-08-01T06:56:03.333 INFO:tasks.workunit.client.1.smithi089.stdout:4/718: creat d3/db/de/dbe/fd4 x:0 0 0 2024-08-01T06:56:03.337 INFO:tasks.workunit.client.1.smithi089.stdout:8/737: symlink d5/dc/d94/dc7/dc5/dd4/l105 0 2024-08-01T06:56:03.339 INFO:tasks.workunit.client.1.smithi089.stdout:3/567: dread d7/d68/d50/d54/fa4 [0,4194304] 0 2024-08-01T06:56:03.339 INFO:tasks.workunit.client.1.smithi089.stdout:6/729: dwrite d2/d11/d1a/d1c/d40/f83 [0,4194304] 0 2024-08-01T06:56:03.340 INFO:tasks.workunit.client.1.smithi089.stdout:6/730: stat d2/d2e/dc2/fde 0 2024-08-01T06:56:03.341 INFO:tasks.workunit.client.1.smithi089.stdout:2/631: rename d7/d19/d68/l6a to d7/d1f/d52/d72/dc0/lc8 0 2024-08-01T06:56:03.341 INFO:tasks.workunit.client.1.smithi089.stdout:3/568: write d7/d32/d9f/fab [313471,56330] 0 2024-08-01T06:56:03.344 INFO:tasks.workunit.client.1.smithi089.stdout:2/632: dread - d7/d1f/d29/d48/d4e/d9e/fc6 zero size 2024-08-01T06:56:03.344 INFO:tasks.workunit.client.1.smithi089.stdout:3/569: write d7/d32/d4c/f85 [833772,95019] 0 2024-08-01T06:56:03.346 INFO:tasks.workunit.client.1.smithi089.stdout:0/785: creat d9/dee/ff7 x:0 0 0 2024-08-01T06:56:03.348 INFO:tasks.workunit.client.1.smithi089.stdout:8/738: dwrite d5/f10 [0,4194304] 0 2024-08-01T06:56:03.349 INFO:tasks.workunit.client.1.smithi089.stdout:9/655: link d18/d33/d49/d7b/f41 d18/d22/d39/d95/fd7 0 2024-08-01T06:56:03.350 INFO:tasks.workunit.client.1.smithi089.stdout:8/739: write d5/d15/d5a/d73/f79 [3738338,47512] 0 2024-08-01T06:56:03.358 INFO:tasks.workunit.client.1.smithi089.stdout:6/731: rmdir d2/d30/d3c 39 2024-08-01T06:56:03.362 INFO:tasks.workunit.client.1.smithi089.stdout:7/642: link d7/c21 d7/df/d91/cdb 0 2024-08-01T06:56:03.364 INFO:tasks.workunit.client.1.smithi089.stdout:2/633: mknod d7/d73/cc9 0 2024-08-01T06:56:03.369 INFO:tasks.workunit.client.1.smithi089.stdout:3/570: dread d7/d32/d4c/d69/f62 [0,4194304] 0 2024-08-01T06:56:03.374 INFO:tasks.workunit.client.1.smithi089.stdout:7/643: creat d7/d15/fdc x:0 0 0 2024-08-01T06:56:03.375 INFO:tasks.workunit.client.1.smithi089.stdout:7/644: truncate d7/d1f/d30/f71 5065583 0 2024-08-01T06:56:03.375 INFO:tasks.workunit.client.1.smithi089.stdout:4/719: creat d3/db/d33/fd5 x:0 0 0 2024-08-01T06:56:03.380 INFO:tasks.workunit.client.1.smithi089.stdout:9/656: unlink d18/d33/lb1 0 2024-08-01T06:56:03.382 INFO:tasks.workunit.client.1.smithi089.stdout:8/740: mkdir d5/d23/d106 0 2024-08-01T06:56:03.385 INFO:tasks.workunit.client.1.smithi089.stdout:9/657: dwrite d18/d33/d49/d7b/d55/fd2 [0,4194304] 0 2024-08-01T06:56:03.387 INFO:tasks.workunit.client.1.smithi089.stdout:7/645: mknod d7/df/d10/d31/cdd 0 2024-08-01T06:56:03.388 INFO:tasks.workunit.client.1.smithi089.stdout:4/720: mkdir d3/d17/d3a/d3d/dd6 0 2024-08-01T06:56:03.391 INFO:tasks.workunit.client.1.smithi089.stdout:3/571: symlink d7/d68/d50/d6f/lb1 0 2024-08-01T06:56:03.394 INFO:tasks.workunit.client.1.smithi089.stdout:9/658: dwrite d18/f7e [0,4194304] 0 2024-08-01T06:56:03.394 INFO:tasks.workunit.client.1.smithi089.stdout:8/741: write d5/dc/d12/f14 [9064299,88465] 0 2024-08-01T06:56:03.406 INFO:tasks.workunit.client.1.smithi089.stdout:1/702: sync 2024-08-01T06:56:03.406 INFO:tasks.workunit.client.1.smithi089.stdout:5/729: sync 2024-08-01T06:56:03.406 INFO:tasks.workunit.client.1.smithi089.stdout:2/634: truncate d7/d19/d1e/d5b/f8e 3796960 0 2024-08-01T06:56:03.410 INFO:tasks.workunit.client.1.smithi089.stdout:9/659: fdatasync f17 0 2024-08-01T06:56:03.412 INFO:tasks.workunit.client.1.smithi089.stdout:9/660: fsync d18/d33/d53/f5e 0 2024-08-01T06:56:03.414 INFO:tasks.workunit.client.1.smithi089.stdout:3/572: dread d7/d32/d4c/f7a [0,4194304] 0 2024-08-01T06:56:03.414 INFO:tasks.workunit.client.1.smithi089.stdout:8/742: creat d5/d23/dd3/f107 x:0 0 0 2024-08-01T06:56:03.415 INFO:tasks.workunit.client.1.smithi089.stdout:6/732: getdents d2/d11/d1f/d46/d6b/d7d/dc9 0 2024-08-01T06:56:03.416 INFO:tasks.workunit.client.1.smithi089.stdout:0/786: link d9/c4e d9/d40/d25/d46/d91/d2e/d3a/d76/cf8 0 2024-08-01T06:56:03.418 INFO:tasks.workunit.client.1.smithi089.stdout:1/703: readlink d0/d9/d54/lcc 0 2024-08-01T06:56:03.423 INFO:tasks.workunit.client.1.smithi089.stdout:7/646: dread d7/df/d3b/f58 [0,4194304] 0 2024-08-01T06:56:03.430 INFO:tasks.workunit.client.1.smithi089.stdout:5/730: dread d5/de/d10/d16/d1b/f22 [0,4194304] 0 2024-08-01T06:56:03.430 INFO:tasks.workunit.client.1.smithi089.stdout:4/721: rmdir d3/d17/d3a/d3d/dd6 0 2024-08-01T06:56:03.431 INFO:tasks.workunit.client.1.smithi089.stdout:4/722: stat d3/db/de/d5b/f74 0 2024-08-01T06:56:03.432 INFO:tasks.workunit.client.1.smithi089.stdout:4/723: read - d3/d17/d3a/d3d/fac zero size 2024-08-01T06:56:03.433 INFO:tasks.workunit.client.1.smithi089.stdout:4/724: chown d3/d86/db7/dd2/f38 0 1 2024-08-01T06:56:03.435 INFO:tasks.workunit.client.1.smithi089.stdout:9/661: rename d18/d33/d3b/f46 to d18/d22/da2/fd8 0 2024-08-01T06:56:03.436 INFO:tasks.workunit.client.1.smithi089.stdout:9/662: readlink d18/d22/l79 0 2024-08-01T06:56:03.436 INFO:tasks.workunit.client.1.smithi089.stdout:9/663: stat d18/d22/da2 0 2024-08-01T06:56:03.440 INFO:tasks.workunit.client.1.smithi089.stdout:2/635: dread d7/d1f/f4b [0,4194304] 0 2024-08-01T06:56:03.442 INFO:tasks.workunit.client.1.smithi089.stdout:0/787: write d9/d40/d25/d46/d91/d2e/d3a/d76/d96/faa [2693899,111218] 0 2024-08-01T06:56:03.446 INFO:tasks.workunit.client.1.smithi089.stdout:4/725: stat d3/d86/d9e/db1/dbb/c34 0 2024-08-01T06:56:03.446 INFO:tasks.workunit.client.1.smithi089.stdout:7/647: dread d7/df/d91/da4/f37 [0,4194304] 0 2024-08-01T06:56:03.450 INFO:tasks.workunit.client.1.smithi089.stdout:5/731: rename d5/de/d10/d16/d1b/d52 to d5/de/df/d9f/dbd/df0 0 2024-08-01T06:56:03.451 INFO:tasks.workunit.client.1.smithi089.stdout:8/743: dwrite d5/dc/d1e/d53/fa0 [0,4194304] 0 2024-08-01T06:56:03.456 INFO:tasks.workunit.client.1.smithi089.stdout:0/788: write d9/d40/d95/df1/f89 [3550244,84932] 0 2024-08-01T06:56:03.458 INFO:tasks.workunit.client.1.smithi089.stdout:0/789: stat d9/d40/d95/d99/d2b/d55/f83 0 2024-08-01T06:56:03.458 INFO:tasks.workunit.client.1.smithi089.stdout:4/726: creat d3/d86/d9e/db1/dbb/d62/fd7 x:0 0 0 2024-08-01T06:56:03.463 INFO:tasks.workunit.client.1.smithi089.stdout:9/664: rename d18/d22/l40 to d18/d22/da2/ld9 0 2024-08-01T06:56:03.465 INFO:tasks.workunit.client.1.smithi089.stdout:5/732: chown d5/de/d10/c3e 7 1 2024-08-01T06:56:03.467 INFO:tasks.workunit.client.1.smithi089.stdout:6/733: getdents d2/d2e/d2f 0 2024-08-01T06:56:03.467 INFO:tasks.workunit.client.1.smithi089.stdout:5/733: truncate d5/de/d10/d16/d1b/d92/fdb 778636 0 2024-08-01T06:56:03.468 INFO:tasks.workunit.client.1.smithi089.stdout:5/734: write d5/d13/f31 [4072183,115789] 0 2024-08-01T06:56:03.469 INFO:tasks.workunit.client.1.smithi089.stdout:1/704: truncate d0/d9/d15/d2d/d4a/fa9 79142 0 2024-08-01T06:56:03.470 INFO:tasks.workunit.client.1.smithi089.stdout:1/705: write d0/f73 [1073430,32408] 0 2024-08-01T06:56:03.471 INFO:tasks.workunit.client.1.smithi089.stdout:1/706: write d0/d9/d43/d89/fb6 [819032,91634] 0 2024-08-01T06:56:03.472 INFO:tasks.workunit.client.1.smithi089.stdout:0/790: unlink d9/d40/f27 0 2024-08-01T06:56:03.473 INFO:tasks.workunit.client.1.smithi089.stdout:0/791: stat d9/d40/d25/d46/d91/c94 0 2024-08-01T06:56:03.573 INFO:tasks.workunit.client.1.smithi089.stdout:6/734: symlink d2/d11/d1f/d46/d6b/d7d/dc9/lf5 0 2024-08-01T06:56:03.573 INFO:tasks.workunit.client.1.smithi089.stdout:2/636: write d7/d19/f94 [1478815,102997] 0 2024-08-01T06:56:03.574 INFO:tasks.workunit.client.1.smithi089.stdout:5/735: creat d5/de/d57/d8e/d97/da5/dde/de9/ff1 x:0 0 0 2024-08-01T06:56:03.574 INFO:tasks.workunit.client.1.smithi089.stdout:4/727: symlink d3/db/d33/ld8 0 2024-08-01T06:56:03.575 INFO:tasks.workunit.client.1.smithi089.stdout:7/648: truncate d7/df/d10/d31/d43/f88 617295 0 2024-08-01T06:56:03.576 INFO:tasks.workunit.client.1.smithi089.stdout:5/736: write d5/f73 [5782909,116715] 0 2024-08-01T06:56:03.578 INFO:tasks.workunit.client.1.smithi089.stdout:0/792: dread - d9/d40/d25/d46/d91/d2e/d3a/d76/f8d zero size 2024-08-01T06:56:03.579 INFO:tasks.workunit.client.1.smithi089.stdout:7/649: dread - d7/df/d91/da4/dca/fd3 zero size 2024-08-01T06:56:03.579 INFO:tasks.workunit.client.1.smithi089.stdout:4/728: creat d3/d17/d3a/fd9 x:0 0 0 2024-08-01T06:56:03.580 INFO:tasks.workunit.client.1.smithi089.stdout:7/650: stat d7/d1f/cba 0 2024-08-01T06:56:03.582 INFO:tasks.workunit.client.1.smithi089.stdout:9/665: dwrite d18/d22/d39/d95/fae [0,4194304] 0 2024-08-01T06:56:03.583 INFO:tasks.workunit.client.1.smithi089.stdout:9/666: readlink d18/d33/d6e/l87 0 2024-08-01T06:56:03.584 INFO:tasks.workunit.client.1.smithi089.stdout:1/707: rename d0/d9/d15/d3b/d95/d49/l70 to d0/d9/d15/d2d/le6 0 2024-08-01T06:56:03.585 INFO:tasks.workunit.client.1.smithi089.stdout:6/735: getdents d2/d11/d1a/d1c/dea 0 2024-08-01T06:56:03.586 INFO:tasks.workunit.client.1.smithi089.stdout:6/736: write d2/d11/fe2 [233164,26367] 0 2024-08-01T06:56:03.586 INFO:tasks.workunit.client.1.smithi089.stdout:0/793: unlink d9/l1d 0 2024-08-01T06:56:03.586 INFO:tasks.workunit.client.1.smithi089.stdout:6/737: fdatasync d2/fd6 0 2024-08-01T06:56:03.587 INFO:tasks.workunit.client.1.smithi089.stdout:4/729: mknod d3/d86/d9e/db1/cda 0 2024-08-01T06:56:03.590 INFO:tasks.workunit.client.1.smithi089.stdout:5/737: truncate d5/d13/f65 184632 0 2024-08-01T06:56:03.593 INFO:tasks.workunit.client.1.smithi089.stdout:0/794: unlink d9/d40/d45/dc1/fcc 0 2024-08-01T06:56:03.594 INFO:tasks.workunit.client.1.smithi089.stdout:6/738: mkdir d2/d11/d1f/d46/d6b/d7d/dc9/df6 0 2024-08-01T06:56:03.596 INFO:tasks.workunit.client.1.smithi089.stdout:9/667: link f4 d18/d22/d45/fda 0 2024-08-01T06:56:03.598 INFO:tasks.workunit.client.1.smithi089.stdout:4/730: dread d3/d17/d3a/f5d [0,4194304] 0 2024-08-01T06:56:03.598 INFO:tasks.workunit.client.1.smithi089.stdout:6/739: write d2/d2e/d2f/d31/fbc [569077,124685] 0 2024-08-01T06:56:03.603 INFO:tasks.workunit.client.1.smithi089.stdout:2/637: write d7/fa [7507,11346] 0 2024-08-01T06:56:03.603 INFO:tasks.workunit.client.1.smithi089.stdout:5/738: dwrite d5/de/d10/d33/d5e/fed [0,4194304] 0 2024-08-01T06:56:03.605 INFO:tasks.workunit.client.1.smithi089.stdout:7/651: dread d7/d1f/f1a [0,4194304] 0 2024-08-01T06:56:03.605 INFO:tasks.workunit.client.1.smithi089.stdout:6/740: write d2/d2e/d2f/d9e/fc7 [619900,127388] 0 2024-08-01T06:56:03.608 INFO:tasks.workunit.client.1.smithi089.stdout:9/668: creat d18/d33/d49/d7b/d4b/db6/fdb x:0 0 0 2024-08-01T06:56:03.611 INFO:tasks.workunit.client.1.smithi089.stdout:6/741: mknod d2/d11/d1a/d1c/db6/cf7 0 2024-08-01T06:56:03.615 INFO:tasks.workunit.client.1.smithi089.stdout:0/795: truncate d9/d40/d25/d46/f3d 2140204 0 2024-08-01T06:56:03.615 INFO:tasks.workunit.client.1.smithi089.stdout:7/652: symlink d7/df/d10/dd6/lde 0 2024-08-01T06:56:03.616 INFO:tasks.workunit.client.1.smithi089.stdout:1/708: write d0/d9/d15/d2d/d4a/fa9 [322811,2389] 0 2024-08-01T06:56:03.616 INFO:tasks.workunit.client.1.smithi089.stdout:1/709: fsync d0/f11 0 2024-08-01T06:56:03.617 INFO:tasks.workunit.client.1.smithi089.stdout:5/739: symlink d5/de/d57/d8e/d97/da5/dba/lf2 0 2024-08-01T06:56:03.617 INFO:tasks.workunit.client.1.smithi089.stdout:7/653: truncate d7/df/d91/fb5 630920 0 2024-08-01T06:56:03.620 INFO:tasks.workunit.client.1.smithi089.stdout:6/742: creat d2/d11/d1a/d1c/dea/ff8 x:0 0 0 2024-08-01T06:56:03.621 INFO:tasks.workunit.client.1.smithi089.stdout:6/743: chown d2/d2e/d7c 442327 1 2024-08-01T06:56:03.621 INFO:tasks.workunit.client.1.smithi089.stdout:9/669: link d18/d33/d49/d7b/c82 d18/d22/d52/db7/cdc 0 2024-08-01T06:56:03.623 INFO:tasks.workunit.client.1.smithi089.stdout:9/670: chown d18/d33/d49/d7b/d4b/db6 0 1 2024-08-01T06:56:03.624 INFO:tasks.workunit.client.1.smithi089.stdout:0/796: chown d9/d40/d25/d46/d91/d2e/d44/d53/l9b 1 1 2024-08-01T06:56:03.626 INFO:tasks.workunit.client.1.smithi089.stdout:9/671: chown d18/d22/d39/l63 216530 1 2024-08-01T06:56:03.628 INFO:tasks.workunit.client.1.smithi089.stdout:6/744: dwrite d2/d11/d1f/d46/d6b/d7d/fc1 [0,4194304] 0 2024-08-01T06:56:03.630 INFO:tasks.workunit.client.1.smithi089.stdout:2/638: truncate d7/fa 1473490 0 2024-08-01T06:56:03.630 INFO:tasks.workunit.client.1.smithi089.stdout:9/672: dread - d18/d33/d49/d7b/d4b/fd5 zero size 2024-08-01T06:56:03.631 INFO:tasks.workunit.client.1.smithi089.stdout:4/731: dwrite d3/db/f39 [0,4194304] 0 2024-08-01T06:56:03.632 INFO:tasks.workunit.client.1.smithi089.stdout:2/639: chown d7/d1f/d28/cc7 48 1 2024-08-01T06:56:03.633 INFO:tasks.workunit.client.1.smithi089.stdout:6/745: symlink d2/d11/d1a/d1c/d40/lf9 0 2024-08-01T06:56:03.634 INFO:tasks.workunit.client.1.smithi089.stdout:1/710: write d0/d9/d15/d3b/d3d/f7f [893027,121652] 0 2024-08-01T06:56:03.634 INFO:tasks.workunit.client.1.smithi089.stdout:9/673: truncate d18/f94 462501 0 2024-08-01T06:56:03.635 INFO:tasks.workunit.client.1.smithi089.stdout:5/740: truncate d5/de/d57/d8e/d97/da5/dde/de9/fb2 3141907 0 2024-08-01T06:56:03.636 INFO:tasks.workunit.client.1.smithi089.stdout:4/732: symlink d3/d86/d9e/db1/ldb 0 2024-08-01T06:56:03.638 INFO:tasks.workunit.client.1.smithi089.stdout:2/640: write d7/d1f/d52/d6e/fbb [3013128,2840] 0 2024-08-01T06:56:03.640 INFO:tasks.workunit.client.1.smithi089.stdout:4/733: dread - d3/d17/d3a/fd9 zero size 2024-08-01T06:56:03.641 INFO:tasks.workunit.client.1.smithi089.stdout:5/741: rmdir d5/de/d10/d16/d1b/d92 39 2024-08-01T06:56:03.642 INFO:tasks.workunit.client.1.smithi089.stdout:1/711: mknod d0/d9/d15/d3b/d95/ce7 0 2024-08-01T06:56:03.643 INFO:tasks.workunit.client.1.smithi089.stdout:2/641: fdatasync d7/d1f/f4b 0 2024-08-01T06:56:03.645 INFO:tasks.workunit.client.1.smithi089.stdout:1/712: readlink d0/d9/l1c 0 2024-08-01T06:56:03.649 INFO:tasks.workunit.client.1.smithi089.stdout:6/746: dwrite d2/d11/d1f/d46/fd4 [0,4194304] 0 2024-08-01T06:56:03.650 INFO:tasks.workunit.client.1.smithi089.stdout:2/642: write d7/d1f/fba [89361,68712] 0 2024-08-01T06:56:03.651 INFO:tasks.workunit.client.1.smithi089.stdout:0/797: dwrite d9/d40/d95/d99/dba/fd4 [4194304,4194304] 0 2024-08-01T06:56:03.652 INFO:tasks.workunit.client.1.smithi089.stdout:5/742: rename d5/d13/d38/c78 to d5/de/d57/d8e/d97/cf3 0 2024-08-01T06:56:03.652 INFO:tasks.workunit.client.1.smithi089.stdout:6/747: write d2/d2e/d7c/f95 [2064181,97818] 0 2024-08-01T06:56:03.654 INFO:tasks.workunit.client.1.smithi089.stdout:5/743: chown d5/d13/d43/c63 18409471 1 2024-08-01T06:56:03.657 INFO:tasks.workunit.client.1.smithi089.stdout:2/643: mknod d7/d19/cca 0 2024-08-01T06:56:03.657 INFO:tasks.workunit.client.1.smithi089.stdout:2/644: dread - d7/d1f/d28/fa8 zero size 2024-08-01T06:56:03.660 INFO:tasks.workunit.client.1.smithi089.stdout:1/713: rename d0/d9/d15/d2d/d4a/d61/f7e to d0/d9/d15/dce/dd3/fe8 0 2024-08-01T06:56:03.660 INFO:tasks.workunit.client.1.smithi089.stdout:9/674: dread d18/d33/f34 [0,4194304] 0 2024-08-01T06:56:03.693 INFO:tasks.workunit.client.1.smithi089.stdout:6/748: symlink d2/d11/d3e/lfa 0 2024-08-01T06:56:03.693 INFO:tasks.workunit.client.1.smithi089.stdout:4/734: truncate d3/d1e/f25 1808732 0 2024-08-01T06:56:03.693 INFO:tasks.workunit.client.1.smithi089.stdout:2/645: creat d7/d19/d1e/d5b/fcb x:0 0 0 2024-08-01T06:56:03.694 INFO:tasks.workunit.client.1.smithi089.stdout:9/675: symlink d18/d33/d3b/dc8/ldd 0 2024-08-01T06:56:03.694 INFO:tasks.workunit.client.1.smithi089.stdout:1/714: creat d0/d9/d15/d3b/d3d/db5/fe9 x:0 0 0 2024-08-01T06:56:03.695 INFO:tasks.workunit.client.1.smithi089.stdout:9/676: fdatasync d18/d33/d49/d7b/d55/f56 0 2024-08-01T06:56:03.695 INFO:tasks.workunit.client.1.smithi089.stdout:6/749: chown d2/d2e/d2f/d91/fec 11753 1 2024-08-01T06:56:03.697 INFO:tasks.workunit.client.1.smithi089.stdout:1/715: creat d0/d9/d15/d7a/fea x:0 0 0 2024-08-01T06:56:03.699 INFO:tasks.workunit.client.1.smithi089.stdout:6/750: unlink d2/d11/f15 0 2024-08-01T06:56:03.702 INFO:tasks.workunit.client.1.smithi089.stdout:1/716: chown d0/d9/d43/d4b/d92/cda 548131 1 2024-08-01T06:56:03.704 INFO:tasks.workunit.client.1.smithi089.stdout:4/735: dwrite d3/d17/d3a/f70 [0,4194304] 0 2024-08-01T06:56:03.704 INFO:tasks.workunit.client.1.smithi089.stdout:2/646: dwrite d7/d19/f44 [4194304,4194304] 0 2024-08-01T06:56:03.705 INFO:tasks.workunit.client.1.smithi089.stdout:1/717: chown d0/d9/d15/d2d/d4a/fa9 18 1 2024-08-01T06:56:03.708 INFO:tasks.workunit.client.1.smithi089.stdout:6/751: rename d2/d11/l47 to d2/d2e/dc2/dd2/lfb 0 2024-08-01T06:56:03.712 INFO:tasks.workunit.client.1.smithi089.stdout:2/647: rename d7/d1f/d29/d48/d4e to d7/d19/dc5/dcc 0 2024-08-01T06:56:03.712 INFO:tasks.workunit.client.1.smithi089.stdout:6/752: creat d2/d2e/dc2/ffc x:0 0 0 2024-08-01T06:56:03.717 INFO:tasks.workunit.client.1.smithi089.stdout:6/753: mknod d2/d2e/dc2/dd2/cfd 0 2024-08-01T06:56:03.718 INFO:tasks.workunit.client.1.smithi089.stdout:4/736: dwrite d3/d1e/f4e [0,4194304] 0 2024-08-01T06:56:03.719 INFO:tasks.workunit.client.1.smithi089.stdout:1/718: dwrite d0/d9/d15/d3b/d3d/f85 [0,4194304] 0 2024-08-01T06:56:03.728 INFO:tasks.workunit.client.1.smithi089.stdout:6/754: dread d2/d11/d1f/d46/f62 [0,4194304] 0 2024-08-01T06:56:03.730 INFO:tasks.workunit.client.1.smithi089.stdout:4/737: creat d3/d86/db7/dd1/fdc x:0 0 0 2024-08-01T06:56:03.734 INFO:tasks.workunit.client.1.smithi089.stdout:4/738: fdatasync d3/db/de/d5b/f75 0 2024-08-01T06:56:03.736 INFO:tasks.workunit.client.1.smithi089.stdout:1/719: dwrite d0/d9/d15/d3b/d95/d49/f8d [4194304,4194304] 0 2024-08-01T06:56:03.746 INFO:tasks.workunit.client.1.smithi089.stdout:1/720: truncate d0/d9/d15/d2d/d4a/d61/f9e 4298690 0 2024-08-01T06:56:03.746 INFO:tasks.workunit.client.1.smithi089.stdout:1/721: stat d0/f23 0 2024-08-01T06:56:03.748 INFO:tasks.workunit.client.1.smithi089.stdout:6/755: truncate d2/d11/d1a/d1c/d40/f83 3389650 0 2024-08-01T06:56:03.752 INFO:tasks.workunit.client.1.smithi089.stdout:6/756: truncate d2/d11/d1f/d46/fdb 2924171 0 2024-08-01T06:56:03.755 INFO:tasks.workunit.client.1.smithi089.stdout:4/739: dwrite d3/d17/d3a/f54 [0,4194304] 0 2024-08-01T06:56:03.756 INFO:tasks.workunit.client.1.smithi089.stdout:1/722: dwrite d0/d9/d43/fb8 [0,4194304] 0 2024-08-01T06:56:03.756 INFO:tasks.workunit.client.1.smithi089.stdout:6/757: fdatasync d2/d11/f66 0 2024-08-01T06:56:03.758 INFO:tasks.workunit.client.1.smithi089.stdout:4/740: chown d3/db/d16/l47 2911519 1 2024-08-01T06:56:03.761 INFO:tasks.workunit.client.1.smithi089.stdout:6/758: creat d2/d11/d1f/dbd/ffe x:0 0 0 2024-08-01T06:56:03.764 INFO:tasks.workunit.client.1.smithi089.stdout:4/741: unlink d3/d86/d9e/db1/dbb/d62/ccb 0 2024-08-01T06:56:03.766 INFO:tasks.workunit.client.1.smithi089.stdout:6/759: mkdir d2/d11/d1f/d46/d6b/d7d/dff 0 2024-08-01T06:56:03.770 INFO:tasks.workunit.client.1.smithi089.stdout:1/723: dwrite d0/d9/d15/d76/f94 [0,4194304] 0 2024-08-01T06:56:03.771 INFO:tasks.workunit.client.1.smithi089.stdout:1/724: fdatasync d0/d9/d15/d2d/d4a/f5e 0 2024-08-01T06:56:03.774 INFO:tasks.workunit.client.1.smithi089.stdout:4/742: rename d3/d86/d9e/db1/dbb/fc4 to d3/d17/fdd 0 2024-08-01T06:56:03.775 INFO:tasks.workunit.client.1.smithi089.stdout:6/760: dwrite d2/d11/d1a/d1c/fb5 [0,4194304] 0 2024-08-01T06:56:03.779 INFO:tasks.workunit.client.1.smithi089.stdout:6/761: unlink d2/d2e/dc2/ffc 0 2024-08-01T06:56:03.780 INFO:tasks.workunit.client.1.smithi089.stdout:6/762: fdatasync d2/d11/d1a/d1c/fa4 0 2024-08-01T06:56:03.783 INFO:tasks.workunit.client.1.smithi089.stdout:4/743: rename d3/c82 to d3/d86/d9e/db1/dbb/d62/cde 0 2024-08-01T06:56:03.784 INFO:tasks.workunit.client.1.smithi089.stdout:4/744: chown d3/d68/d7e/c8a 2 1 2024-08-01T06:56:03.785 INFO:tasks.workunit.client.1.smithi089.stdout:4/745: dread - d3/db/d33/fd5 zero size 2024-08-01T06:56:03.785 INFO:tasks.workunit.client.1.smithi089.stdout:6/763: mknod d2/d30/d3c/c100 0 2024-08-01T06:56:03.788 INFO:tasks.workunit.client.1.smithi089.stdout:6/764: symlink d2/d2e/d2f/d9e/l101 0 2024-08-01T06:56:03.796 INFO:tasks.workunit.client.1.smithi089.stdout:1/725: dwrite d0/f24 [0,4194304] 0 2024-08-01T06:56:03.802 INFO:tasks.workunit.client.1.smithi089.stdout:4/746: dwrite d3/db/de/d5b/f91 [0,4194304] 0 2024-08-01T06:56:03.803 INFO:tasks.workunit.client.1.smithi089.stdout:1/726: creat d0/d9/d15/d3b/d95/d49/d82/da6/dc3/feb x:0 0 0 2024-08-01T06:56:03.809 INFO:tasks.workunit.client.1.smithi089.stdout:8/744: sync 2024-08-01T06:56:03.809 INFO:tasks.workunit.client.1.smithi089.stdout:3/573: sync 2024-08-01T06:56:03.813 INFO:tasks.workunit.client.1.smithi089.stdout:6/765: dread d2/f2b [0,4194304] 0 2024-08-01T06:56:03.813 INFO:tasks.workunit.client.1.smithi089.stdout:4/747: dwrite d3/db/d16/f4f [0,4194304] 0 2024-08-01T06:56:03.814 INFO:tasks.workunit.client.1.smithi089.stdout:8/745: unlink d5/dc/d12/f4e 0 2024-08-01T06:56:03.814 INFO:tasks.workunit.client.1.smithi089.stdout:1/727: dwrite d0/d9/d43/d89/fb6 [0,4194304] 0 2024-08-01T06:56:03.817 INFO:tasks.workunit.client.1.smithi089.stdout:8/746: dread - d5/dc/d94/d84/fa5 zero size 2024-08-01T06:56:03.819 INFO:tasks.workunit.client.1.smithi089.stdout:3/574: creat d7/d32/d4c/d69/fb2 x:0 0 0 2024-08-01T06:56:03.820 INFO:tasks.workunit.client.1.smithi089.stdout:6/766: symlink d2/d11/d1a/d1c/db6/def/l102 0 2024-08-01T06:56:03.822 INFO:tasks.workunit.client.1.smithi089.stdout:6/767: read d2/d2e/d2f/d9e/fc7 [691814,28572] 0 2024-08-01T06:56:03.825 INFO:tasks.workunit.client.1.smithi089.stdout:1/728: dwrite d0/d9/d15/d3b/d3d/db5/fe9 [0,4194304] 0 2024-08-01T06:56:03.825 INFO:tasks.workunit.client.1.smithi089.stdout:3/575: symlink d7/d32/d12/lb3 0 2024-08-01T06:56:03.825 INFO:tasks.workunit.client.1.smithi089.stdout:6/768: write d2/d2e/d2f/d9e/fc7 [703604,23601] 0 2024-08-01T06:56:03.830 INFO:tasks.workunit.client.1.smithi089.stdout:3/576: rmdir d7/d68/d50/d6f/d2f 39 2024-08-01T06:56:03.833 INFO:tasks.workunit.client.1.smithi089.stdout:1/729: dwrite d0/d9/d43/d89/fb6 [0,4194304] 0 2024-08-01T06:56:03.834 INFO:tasks.workunit.client.1.smithi089.stdout:3/577: mkdir d7/d32/d4c/d67/db4 0 2024-08-01T06:56:03.834 INFO:tasks.workunit.client.1.smithi089.stdout:8/747: link d5/d15/d5a/d73/l7e d5/dc/dca/l108 0 2024-08-01T06:56:03.835 INFO:tasks.workunit.client.1.smithi089.stdout:4/748: dwrite d3/d86/db7/dd2/f38 [0,4194304] 0 2024-08-01T06:56:03.839 INFO:tasks.workunit.client.1.smithi089.stdout:1/730: creat d0/d9/d43/fec x:0 0 0 2024-08-01T06:56:03.841 INFO:tasks.workunit.client.1.smithi089.stdout:6/769: write d2/d11/d1a/d1c/d40/f48 [846874,100683] 0 2024-08-01T06:56:03.843 INFO:tasks.workunit.client.1.smithi089.stdout:8/748: symlink d5/d23/d106/l109 0 2024-08-01T06:56:03.843 INFO:tasks.workunit.client.1.smithi089.stdout:6/770: truncate d2/d11/d1f/fed 753081 0 2024-08-01T06:56:03.844 INFO:tasks.workunit.client.1.smithi089.stdout:3/578: symlink d7/d32/d4c/d69/lb5 0 2024-08-01T06:56:03.846 INFO:tasks.workunit.client.1.smithi089.stdout:8/749: rmdir d5/dc/d1e 39 2024-08-01T06:56:03.848 INFO:tasks.workunit.client.1.smithi089.stdout:1/731: mkdir d0/d9/d15/d2d/d4a/ded 0 2024-08-01T06:56:03.850 INFO:tasks.workunit.client.1.smithi089.stdout:1/732: chown d0/d9/d15/d3b/d3d/d77/fca 8 1 2024-08-01T06:56:03.850 INFO:tasks.workunit.client.1.smithi089.stdout:3/579: symlink d7/d32/d12/d29/d39/lb6 0 2024-08-01T06:56:03.852 INFO:tasks.workunit.client.1.smithi089.stdout:1/733: read d0/d9/d43/d4b/db0/fbd [1833357,72459] 0 2024-08-01T06:56:03.854 INFO:tasks.workunit.client.1.smithi089.stdout:4/749: getdents d3/db/d42 0 2024-08-01T06:56:03.858 INFO:tasks.workunit.client.1.smithi089.stdout:4/750: creat d3/d68/fdf x:0 0 0 2024-08-01T06:56:03.859 INFO:tasks.workunit.client.1.smithi089.stdout:3/580: link d7/d32/d4c/d69/fb2 d7/d32/d4c/d69/d6d/fb7 0 2024-08-01T06:56:03.860 INFO:tasks.workunit.client.1.smithi089.stdout:8/750: getdents d5/dc/d94/dc7/dc5 0 2024-08-01T06:56:03.861 INFO:tasks.workunit.client.1.smithi089.stdout:8/751: stat d5/d15/d5a/f8a 0 2024-08-01T06:56:03.861 INFO:tasks.workunit.client.1.smithi089.stdout:3/581: read d7/d32/d4c/f85 [740552,53803] 0 2024-08-01T06:56:03.864 INFO:tasks.workunit.client.1.smithi089.stdout:3/582: chown d7/d68/d50/d6f/d2f/da2/da8/c8d 1267892 1 2024-08-01T06:56:03.865 INFO:tasks.workunit.client.1.smithi089.stdout:6/771: dread d2/d30/fa3 [0,4194304] 0 2024-08-01T06:56:03.865 INFO:tasks.workunit.client.1.smithi089.stdout:4/751: dread d3/db/d33/f56 [0,4194304] 0 2024-08-01T06:56:03.867 INFO:tasks.workunit.client.1.smithi089.stdout:1/734: dread d0/d9/d15/d2d/d4a/d4d/f5d [0,4194304] 0 2024-08-01T06:56:03.869 INFO:tasks.workunit.client.1.smithi089.stdout:6/772: creat d2/d11/d1a/d1c/f103 x:0 0 0 2024-08-01T06:56:03.871 INFO:tasks.workunit.client.1.smithi089.stdout:6/773: stat d2/d2e/d2f/d9e/ff2 0 2024-08-01T06:56:03.871 INFO:tasks.workunit.client.1.smithi089.stdout:1/735: dread d0/d9/d15/d3b/d95/fa1 [0,4194304] 0 2024-08-01T06:56:03.871 INFO:tasks.workunit.client.1.smithi089.stdout:3/583: write d7/d32/d4c/d69/f2e [126638,117924] 0 2024-08-01T06:56:03.873 INFO:tasks.workunit.client.1.smithi089.stdout:4/752: dwrite d3/db/d33/fb6 [0,4194304] 0 2024-08-01T06:56:03.876 INFO:tasks.workunit.client.1.smithi089.stdout:1/736: link d0/d9/d15/d7a/l9d d0/d9/d43/d78/lee 0 2024-08-01T06:56:03.880 INFO:tasks.workunit.client.1.smithi089.stdout:6/774: dwrite d2/d30/d3c/fd7 [0,4194304] 0 2024-08-01T06:56:03.880 INFO:tasks.workunit.client.1.smithi089.stdout:1/737: mkdir d0/dd9/def 0 2024-08-01T06:56:03.885 INFO:tasks.workunit.client.1.smithi089.stdout:6/775: symlink d2/d30/l104 0 2024-08-01T06:56:03.885 INFO:tasks.workunit.client.1.smithi089.stdout:6/776: fsync d2/fd6 0 2024-08-01T06:56:03.887 INFO:tasks.workunit.client.1.smithi089.stdout:6/777: truncate d2/d30/fe7 4711744 0 2024-08-01T06:56:03.889 INFO:tasks.workunit.client.1.smithi089.stdout:6/778: write d2/d2e/d2f/d9e/feb [279077,24012] 0 2024-08-01T06:56:03.894 INFO:tasks.workunit.client.1.smithi089.stdout:6/779: dwrite d2/d2e/d2f/f6d [4194304,4194304] 0 2024-08-01T06:56:03.895 INFO:tasks.workunit.client.1.smithi089.stdout:4/753: dread d3/d86/d9e/db1/dbb/d62/f64 [0,4194304] 0 2024-08-01T06:56:03.897 INFO:tasks.workunit.client.1.smithi089.stdout:6/780: creat d2/d11/d1f/d46/f105 x:0 0 0 2024-08-01T06:56:03.898 INFO:tasks.workunit.client.1.smithi089.stdout:4/754: readlink d3/db/d33/l65 0 2024-08-01T06:56:03.900 INFO:tasks.workunit.client.1.smithi089.stdout:6/781: creat d2/d11/d1f/d46/d6b/d7d/f106 x:0 0 0 2024-08-01T06:56:03.901 INFO:tasks.workunit.client.1.smithi089.stdout:1/738: truncate d0/d9/d15/d2d/d4a/f47 2539065 0 2024-08-01T06:56:03.903 INFO:tasks.workunit.client.1.smithi089.stdout:1/739: stat d0/d9/d15/d3b/d3d/f8a 0 2024-08-01T06:56:03.904 INFO:tasks.workunit.client.1.smithi089.stdout:1/740: creat d0/d9/d43/d78/ff0 x:0 0 0 2024-08-01T06:56:03.905 INFO:tasks.workunit.client.1.smithi089.stdout:1/741: stat d0/d9/d15/l29 0 2024-08-01T06:56:03.914 INFO:tasks.workunit.client.1.smithi089.stdout:1/742: dwrite d0/d9/d15/d2b/d7d/fde [0,4194304] 0 2024-08-01T06:56:03.916 INFO:tasks.workunit.client.1.smithi089.stdout:4/755: dwrite d3/d86/d9e/db1/dbb/d62/d3b/f8d [0,4194304] 0 2024-08-01T06:56:03.925 INFO:tasks.workunit.client.1.smithi089.stdout:6/782: dread d2/f75 [0,4194304] 0 2024-08-01T06:56:03.925 INFO:tasks.workunit.client.1.smithi089.stdout:1/743: dwrite d0/d9/d15/d2d/d4a/fb7 [4194304,4194304] 0 2024-08-01T06:56:03.927 INFO:tasks.workunit.client.1.smithi089.stdout:6/783: fsync d2/d2e/d2f/d31/f44 0 2024-08-01T06:56:03.931 INFO:tasks.workunit.client.1.smithi089.stdout:4/756: dwrite d3/d86/d9e/db1/dbb/d62/db3/fb5 [0,4194304] 0 2024-08-01T06:56:03.932 INFO:tasks.workunit.client.1.smithi089.stdout:6/784: read d2/d11/d1f/fed [506702,93118] 0 2024-08-01T06:56:03.932 INFO:tasks.workunit.client.1.smithi089.stdout:1/744: mknod d0/d9/d15/d3b/d95/d49/d82/da6/cf1 0 2024-08-01T06:56:03.934 INFO:tasks.workunit.client.1.smithi089.stdout:1/745: fsync d0/d9/d15/d3b/d3d/d77/fcb 0 2024-08-01T06:56:03.936 INFO:tasks.workunit.client.1.smithi089.stdout:1/746: read d0/f23 [3256954,108788] 0 2024-08-01T06:56:03.937 INFO:tasks.workunit.client.1.smithi089.stdout:4/757: mknod d3/d86/d9e/db1/dbb/d62/d31/ce0 0 2024-08-01T06:56:03.940 INFO:tasks.workunit.client.1.smithi089.stdout:6/785: dwrite d2/ff [0,4194304] 0 2024-08-01T06:56:03.942 INFO:tasks.workunit.client.1.smithi089.stdout:6/786: write d2/d11/d1a/d1c/fb5 [434437,19238] 0 2024-08-01T06:56:03.944 INFO:tasks.workunit.client.1.smithi089.stdout:4/758: dread d3/d68/d7e/fb2 [0,4194304] 0 2024-08-01T06:56:03.945 INFO:tasks.workunit.client.1.smithi089.stdout:1/747: getdents d0/d9 0 2024-08-01T06:56:03.948 INFO:tasks.workunit.client.1.smithi089.stdout:4/759: mkdir d3/d17/d3a/d4a/de1 0 2024-08-01T06:56:03.949 INFO:tasks.workunit.client.1.smithi089.stdout:6/787: rename d2/d11/d1a/d1c/d40/ce5 to d2/d30/c107 0 2024-08-01T06:56:03.951 INFO:tasks.workunit.client.1.smithi089.stdout:4/760: creat d3/db/de/d5b/fe2 x:0 0 0 2024-08-01T06:56:03.951 INFO:tasks.workunit.client.1.smithi089.stdout:1/748: mknod d0/d9/d15/dce/dd3/ddd/cf2 0 2024-08-01T06:56:03.953 INFO:tasks.workunit.client.1.smithi089.stdout:1/749: stat d0/d9/d15/d76/f88 0 2024-08-01T06:56:03.954 INFO:tasks.workunit.client.1.smithi089.stdout:1/750: chown d0/l8e 11219466 1 2024-08-01T06:56:03.954 INFO:tasks.workunit.client.1.smithi089.stdout:4/761: write d3/d17/d3a/f66 [1064895,65967] 0 2024-08-01T06:56:03.955 INFO:tasks.workunit.client.1.smithi089.stdout:6/788: dread d2/ff [0,4194304] 0 2024-08-01T06:56:03.956 INFO:tasks.workunit.client.1.smithi089.stdout:1/751: mknod d0/d9/d15/d7a/cf3 0 2024-08-01T06:56:03.959 INFO:tasks.workunit.client.1.smithi089.stdout:6/789: unlink d2/d11/d1f/d46/d6b/d7d/dc9/lf5 0 2024-08-01T06:56:03.960 INFO:tasks.workunit.client.1.smithi089.stdout:1/752: mknod d0/d9/d15/d3b/d95/d49/d82/da6/cf4 0 2024-08-01T06:56:03.961 INFO:tasks.workunit.client.1.smithi089.stdout:6/790: creat d2/d2e/dc2/f108 x:0 0 0 2024-08-01T06:56:03.962 INFO:tasks.workunit.client.1.smithi089.stdout:6/791: dread - d2/d2e/dc2/fcd zero size 2024-08-01T06:56:03.962 INFO:tasks.workunit.client.1.smithi089.stdout:1/753: unlink d0/d9/f30 0 2024-08-01T06:56:03.963 INFO:tasks.workunit.client.1.smithi089.stdout:6/792: fdatasync d2/d11/d1f/dbd/ffe 0 2024-08-01T06:56:03.964 INFO:tasks.workunit.client.1.smithi089.stdout:6/793: write d2/d2e/d2f/d9e/feb [193659,103477] 0 2024-08-01T06:56:03.968 INFO:tasks.workunit.client.1.smithi089.stdout:4/762: truncate d3/f24 1433854 0 2024-08-01T06:56:03.970 INFO:tasks.workunit.client.1.smithi089.stdout:6/794: dwrite d2/d11/d3e/fae [0,4194304] 0 2024-08-01T06:56:03.971 INFO:tasks.workunit.client.1.smithi089.stdout:6/795: dread - d2/d11/d1f/d46/d6b/d7d/f106 zero size 2024-08-01T06:56:03.971 INFO:tasks.workunit.client.1.smithi089.stdout:4/763: creat d3/d86/d9e/db1/fe3 x:0 0 0 2024-08-01T06:56:03.972 INFO:tasks.workunit.client.1.smithi089.stdout:1/754: truncate d0/f73 329435 0 2024-08-01T06:56:03.972 INFO:tasks.workunit.client.1.smithi089.stdout:6/796: write d2/f18 [11804705,565] 0 2024-08-01T06:56:03.975 INFO:tasks.workunit.client.1.smithi089.stdout:4/764: creat d3/d86/d9e/db1/fe4 x:0 0 0 2024-08-01T06:56:03.976 INFO:tasks.workunit.client.1.smithi089.stdout:6/797: write d2/d2e/d2f/d31/fbc [1489217,27464] 0 2024-08-01T06:56:03.980 INFO:tasks.workunit.client.1.smithi089.stdout:4/765: creat d3/d86/d9e/db1/fe5 x:0 0 0 2024-08-01T06:56:03.981 INFO:tasks.workunit.client.1.smithi089.stdout:6/798: unlink d2/d2e/d2f/d91/fec 0 2024-08-01T06:56:03.983 INFO:tasks.workunit.client.1.smithi089.stdout:1/755: read d0/d9/d15/d3b/f3c [1203211,3812] 0 2024-08-01T06:56:03.984 INFO:tasks.workunit.client.1.smithi089.stdout:4/766: creat d3/db/d33/fe6 x:0 0 0 2024-08-01T06:56:03.985 INFO:tasks.workunit.client.1.smithi089.stdout:6/799: getdents d2/d30/d3c 0 2024-08-01T06:56:03.987 INFO:tasks.workunit.client.1.smithi089.stdout:4/767: unlink d3/db/d33/l65 0 2024-08-01T06:56:03.988 INFO:tasks.workunit.client.1.smithi089.stdout:1/756: creat d0/d9/d43/d4b/d92/ff5 x:0 0 0 2024-08-01T06:56:03.990 INFO:tasks.workunit.client.1.smithi089.stdout:1/757: mkdir d0/d9/d15/d3b/d3d/db5/df6 0 2024-08-01T06:56:03.991 INFO:tasks.workunit.client.1.smithi089.stdout:6/800: link d2/d11/d1f/f77 d2/d11/d1a/d1c/d40/f109 0 2024-08-01T06:56:03.991 INFO:tasks.workunit.client.1.smithi089.stdout:1/758: readlink d0/d9/d15/d2d/d4a/l9c 0 2024-08-01T06:56:03.994 INFO:tasks.workunit.client.1.smithi089.stdout:1/759: write d0/d9/d54/fe0 [135085,758] 0 2024-08-01T06:56:03.995 INFO:tasks.workunit.client.1.smithi089.stdout:4/768: dwrite d3/db/de/d5b/db9/fc3 [0,4194304] 0 2024-08-01T06:56:03.997 INFO:tasks.workunit.client.1.smithi089.stdout:6/801: truncate d2/d11/d1a/d1c/d40/f83 3974653 0 2024-08-01T06:56:03.999 INFO:tasks.workunit.client.1.smithi089.stdout:4/769: dread d3/db/de/f9d [0,4194304] 0 2024-08-01T06:56:04.003 INFO:tasks.workunit.client.1.smithi089.stdout:1/760: dwrite d0/d9/d15/fae [0,4194304] 0 2024-08-01T06:56:04.004 INFO:tasks.workunit.client.1.smithi089.stdout:1/761: chown d0/d9/d15/d3b/d3d/d77/dc4 966 1 2024-08-01T06:56:04.005 INFO:tasks.workunit.client.1.smithi089.stdout:4/770: getdents d3/d86 0 2024-08-01T06:56:04.006 INFO:tasks.workunit.client.1.smithi089.stdout:6/802: getdents d2/d11/d1a/d1c/d40 0 2024-08-01T06:56:04.007 INFO:tasks.workunit.client.1.smithi089.stdout:6/803: write d2/d11/d1f/f5a [254368,18902] 0 2024-08-01T06:56:04.008 INFO:tasks.workunit.client.1.smithi089.stdout:1/762: mknod d0/d9/d15/d3b/cf7 0 2024-08-01T06:56:04.012 INFO:tasks.workunit.client.1.smithi089.stdout:6/804: creat d2/d11/db4/f10a x:0 0 0 2024-08-01T06:56:04.012 INFO:tasks.workunit.client.1.smithi089.stdout:4/771: dwrite d3/d86/d9e/db1/dbb/d62/f2a [0,4194304] 0 2024-08-01T06:56:04.015 INFO:tasks.workunit.client.1.smithi089.stdout:1/763: unlink d0/d9/d15/d3b/d3d/c5f 0 2024-08-01T06:56:04.016 INFO:tasks.workunit.client.1.smithi089.stdout:1/764: chown d0/d9/d15/d3b/l57 17959575 1 2024-08-01T06:56:04.017 INFO:tasks.workunit.client.1.smithi089.stdout:6/805: fsync d2/d11/f66 0 2024-08-01T06:56:04.025 INFO:tasks.workunit.client.1.smithi089.stdout:6/806: mknod d2/d2e/c10b 0 2024-08-01T06:56:04.025 INFO:tasks.workunit.client.1.smithi089.stdout:4/772: truncate d3/d86/d9e/db1/dbb/d62/d31/f67 136838 0 2024-08-01T06:56:04.032 INFO:tasks.workunit.client.1.smithi089.stdout:6/807: dwrite d2/d11/d3e/fae [0,4194304] 0 2024-08-01T06:56:04.034 INFO:tasks.workunit.client.1.smithi089.stdout:6/808: readlink d2/d2e/d2f/d31/lb3 0 2024-08-01T06:56:04.036 INFO:tasks.workunit.client.1.smithi089.stdout:6/809: symlink d2/d30/d3c/l10c 0 2024-08-01T06:56:04.037 INFO:tasks.workunit.client.1.smithi089.stdout:1/765: dread d0/d9/d15/d2d/d4a/d61/fab [0,4194304] 0 2024-08-01T06:56:04.041 INFO:tasks.workunit.client.1.smithi089.stdout:6/810: mkdir d2/d11/d1a/d1c/db6/d10d 0 2024-08-01T06:56:04.041 INFO:tasks.workunit.client.1.smithi089.stdout:4/773: dread d3/d86/d9e/db1/dbb/d62/d31/f89 [0,4194304] 0 2024-08-01T06:56:04.042 INFO:tasks.workunit.client.1.smithi089.stdout:4/774: write d3/d86/db7/dd2/f38 [29975,76507] 0 2024-08-01T06:56:04.043 INFO:tasks.workunit.client.1.smithi089.stdout:1/766: unlink d0/d9/d15/d2b/d7d/fde 0 2024-08-01T06:56:04.046 INFO:tasks.workunit.client.1.smithi089.stdout:6/811: unlink d2/d2e/d2f/d31/fbc 0 2024-08-01T06:56:04.047 INFO:tasks.workunit.client.1.smithi089.stdout:6/812: read d2/d11/d1f/d46/f62 [694478,110890] 0 2024-08-01T06:56:04.050 INFO:tasks.workunit.client.1.smithi089.stdout:1/767: mknod d0/d9/d15/d3b/d3d/d77/cf8 0 2024-08-01T06:56:04.051 INFO:tasks.workunit.client.1.smithi089.stdout:1/768: write d0/d9/d15/d76/f94 [980283,62384] 0 2024-08-01T06:56:04.053 INFO:tasks.workunit.client.1.smithi089.stdout:6/813: mknod d2/d2e/c10e 0 2024-08-01T06:56:04.056 INFO:tasks.workunit.client.1.smithi089.stdout:6/814: chown d2/d11/f17 442702 1 2024-08-01T06:56:04.057 INFO:tasks.workunit.client.1.smithi089.stdout:1/769: mknod d0/d9/d15/d2d/d4a/cf9 0 2024-08-01T06:56:04.058 INFO:tasks.workunit.client.1.smithi089.stdout:4/775: dread d3/d1e/f40 [0,4194304] 0 2024-08-01T06:56:04.059 INFO:tasks.workunit.client.1.smithi089.stdout:6/815: truncate d2/d11/d3e/f60 1199499 0 2024-08-01T06:56:04.059 INFO:tasks.workunit.client.1.smithi089.stdout:1/770: creat d0/d9/d15/d3b/ffa x:0 0 0 2024-08-01T06:56:04.060 INFO:tasks.workunit.client.1.smithi089.stdout:4/776: symlink d3/d86/d9e/db1/dbb/d62/le7 0 2024-08-01T06:56:04.060 INFO:tasks.workunit.client.1.smithi089.stdout:1/771: readlink d0/d9/d43/d4b/lcf 0 2024-08-01T06:56:04.062 INFO:tasks.workunit.client.1.smithi089.stdout:6/816: getdents d2/d30/d3c/d9c 0 2024-08-01T06:56:04.067 INFO:tasks.workunit.client.1.smithi089.stdout:1/772: dwrite d0/d9/d15/d3b/d95/d49/d82/fdf [0,4194304] 0 2024-08-01T06:56:04.067 INFO:tasks.workunit.client.1.smithi089.stdout:4/777: dread d3/d1e/f40 [4194304,4194304] 0 2024-08-01T06:56:04.077 INFO:tasks.workunit.client.1.smithi089.stdout:7/654: sync 2024-08-01T06:56:04.077 INFO:tasks.workunit.client.1.smithi089.stdout:0/798: sync 2024-08-01T06:56:04.125 INFO:tasks.workunit.client.1.smithi089.stdout:5/744: sync 2024-08-01T06:56:04.125 INFO:tasks.workunit.client.1.smithi089.stdout:9/677: sync 2024-08-01T06:56:04.126 INFO:tasks.workunit.client.1.smithi089.stdout:5/745: fdatasync d5/de/d10/d16/d1b/f39 0 2024-08-01T06:56:04.132 INFO:tasks.workunit.client.1.smithi089.stdout:4/778: mknod d3/d86/d9e/db1/dbb/d62/db3/ce8 0 2024-08-01T06:56:04.133 INFO:tasks.workunit.client.1.smithi089.stdout:5/746: dread d5/de/d10/d16/d1b/f22 [0,4194304] 0 2024-08-01T06:56:04.134 INFO:tasks.workunit.client.1.smithi089.stdout:7/655: creat d7/df/d10/db3/fdf x:0 0 0 2024-08-01T06:56:04.134 INFO:tasks.workunit.client.1.smithi089.stdout:6/817: write d2/d11/d1f/fed [660036,30474] 0 2024-08-01T06:56:04.136 INFO:tasks.workunit.client.1.smithi089.stdout:6/818: write d2/d11/d1a/fc8 [567099,40816] 0 2024-08-01T06:56:04.139 INFO:tasks.workunit.client.1.smithi089.stdout:9/678: mkdir d18/d33/d49/d7b/d7f/d98/d9f/d8e/dde 0 2024-08-01T06:56:04.141 INFO:tasks.workunit.client.1.smithi089.stdout:1/773: symlink d0/d9/d15/d3b/d3d/d77/dc4/lfb 0 2024-08-01T06:56:04.141 INFO:tasks.workunit.client.1.smithi089.stdout:1/774: chown d0/d9/d43/fb8 255309035 1 2024-08-01T06:56:04.142 INFO:tasks.workunit.client.1.smithi089.stdout:4/779: truncate d3/db/d33/f56 759266 0 2024-08-01T06:56:04.144 INFO:tasks.workunit.client.1.smithi089.stdout:1/775: dread d0/d9/d15/dce/dd3/fe8 [4194304,4194304] 0 2024-08-01T06:56:04.146 INFO:tasks.workunit.client.1.smithi089.stdout:1/776: chown d0/d9/d15/d2d/fc1 792871 1 2024-08-01T06:56:04.148 INFO:tasks.workunit.client.1.smithi089.stdout:4/780: dwrite d3/d86/d9e/db1/dbb/d62/f2a [0,4194304] 0 2024-08-01T06:56:04.151 INFO:tasks.workunit.client.1.smithi089.stdout:4/781: truncate d3/d86/d9e/db1/dbb/d62/d31/f89 4987411 0 2024-08-01T06:56:04.151 INFO:tasks.workunit.client.1.smithi089.stdout:9/679: symlink d18/d33/d49/d7b/d7f/d98/d9f/ldf 0 2024-08-01T06:56:04.151 INFO:tasks.workunit.client.1.smithi089.stdout:4/782: chown d3/d17/d71/d92/c9c 13 1 2024-08-01T06:56:04.152 INFO:tasks.workunit.client.1.smithi089.stdout:4/783: readlink d3/db/de/d5b/la4 0 2024-08-01T06:56:04.154 INFO:tasks.workunit.client.1.smithi089.stdout:4/784: truncate d3/db/de/d5b/fe2 650941 0 2024-08-01T06:56:04.154 INFO:tasks.workunit.client.1.smithi089.stdout:7/656: fdatasync d7/df/d10/d31/f45 0 2024-08-01T06:56:04.154 INFO:tasks.workunit.client.1.smithi089.stdout:5/747: symlink d5/de/df/d9f/dbd/df0/d5d/dd9/lf4 0 2024-08-01T06:56:04.158 INFO:tasks.workunit.client.1.smithi089.stdout:6/819: mkdir d2/d11/d1f/d46/dce/d10f 0 2024-08-01T06:56:04.159 INFO:tasks.workunit.client.1.smithi089.stdout:6/820: dread - d2/d2e/dc2/fcd zero size 2024-08-01T06:56:04.160 INFO:tasks.workunit.client.1.smithi089.stdout:2/648: sync 2024-08-01T06:56:04.160 INFO:tasks.workunit.client.1.smithi089.stdout:8/752: sync 2024-08-01T06:56:04.160 INFO:tasks.workunit.client.1.smithi089.stdout:3/584: sync 2024-08-01T06:56:04.160 INFO:tasks.workunit.client.1.smithi089.stdout:9/680: mkdir d18/d33/d49/d7b/d7f/d98/d9f/d8e/de0 0 2024-08-01T06:56:04.164 INFO:tasks.workunit.client.1.smithi089.stdout:5/748: chown d5/de/df/d9f/dbd/df0/d5d/d6c/d8b/faa 24033084 1 2024-08-01T06:56:04.167 INFO:tasks.workunit.client.1.smithi089.stdout:6/821: creat d2/d2e/d7c/f110 x:0 0 0 2024-08-01T06:56:04.168 INFO:tasks.workunit.client.1.smithi089.stdout:6/822: write d2/d11/d1a/fd1 [860453,73371] 0 2024-08-01T06:56:04.169 INFO:tasks.workunit.client.1.smithi089.stdout:2/649: write d7/d1f/d52/d6e/f9d [1253183,41717] 0 2024-08-01T06:56:04.172 INFO:tasks.workunit.client.1.smithi089.stdout:9/681: mkdir d18/d33/d49/d7b/d7f/d98/de1 0 2024-08-01T06:56:04.173 INFO:tasks.workunit.client.1.smithi089.stdout:9/682: write d18/f20 [600324,89576] 0 2024-08-01T06:56:04.179 INFO:tasks.workunit.client.1.smithi089.stdout:3/585: dwrite d7/d32/d4c/d69/f62 [4194304,4194304] 0 2024-08-01T06:56:04.179 INFO:tasks.workunit.client.1.smithi089.stdout:5/749: mkdir d5/de/d57/d8e/d97/df5 0 2024-08-01T06:56:04.180 INFO:tasks.workunit.client.1.smithi089.stdout:2/650: creat d7/d19/d1e/d3d/d60/fcd x:0 0 0 2024-08-01T06:56:04.187 INFO:tasks.workunit.client.1.smithi089.stdout:1/777: getdents d0/d9/d15/d2d 0 2024-08-01T06:56:04.189 INFO:tasks.workunit.client.1.smithi089.stdout:9/683: truncate f17 421222 0 2024-08-01T06:56:04.195 INFO:tasks.workunit.client.1.smithi089.stdout:4/785: getdents d3/db/de/d5b/db9 0 2024-08-01T06:56:04.196 INFO:tasks.workunit.client.1.smithi089.stdout:9/684: mknod d18/d22/d43/ce2 0 2024-08-01T06:56:04.209 INFO:tasks.workunit.client.1.smithi089.stdout:4/786: dread d3/d1e/f25 [0,4194304] 0 2024-08-01T06:56:04.212 INFO:tasks.workunit.client.1.smithi089.stdout:0/799: rename d9/d40/d25/d46/d91/d2e/d3a/d76/d96/f9c to d9/d40/d25/d46/d91/d2e/d44/d72/ff9 0 2024-08-01T06:56:04.214 INFO:tasks.workunit.client.1.smithi089.stdout:4/787: creat d3/d17/fe9 x:0 0 0 2024-08-01T06:56:04.215 INFO:tasks.workunit.client.1.smithi089.stdout:0/800: creat d9/d40/d25/d46/d91/d2e/d44/d53/daf/ffa x:0 0 0 2024-08-01T06:56:04.217 INFO:tasks.workunit.client.1.smithi089.stdout:7/657: rename d7/df/d91/cdb to d7/d1f/da6/ce0 0 2024-08-01T06:56:04.219 INFO:tasks.workunit.client.1.smithi089.stdout:7/658: write d7/d15/f87 [365353,109126] 0 2024-08-01T06:56:04.220 INFO:tasks.workunit.client.1.smithi089.stdout:8/753: rename d5/c8b to d5/d23/dd3/c10a 0 2024-08-01T06:56:04.220 INFO:tasks.workunit.client.1.smithi089.stdout:7/659: chown d7/df/d10/db3 92737 1 2024-08-01T06:56:04.221 INFO:tasks.workunit.client.1.smithi089.stdout:7/660: write d7/fd [945547,7033] 0 2024-08-01T06:56:04.223 INFO:tasks.workunit.client.1.smithi089.stdout:7/661: chown d7/d1f/da6/la7 0 1 2024-08-01T06:56:04.225 INFO:tasks.workunit.client.1.smithi089.stdout:0/801: getdents d9/d40/d25/d46 0 2024-08-01T06:56:04.227 INFO:tasks.workunit.client.1.smithi089.stdout:4/788: dread d3/db/de/d5b/f75 [0,4194304] 0 2024-08-01T06:56:04.228 INFO:tasks.workunit.client.1.smithi089.stdout:7/662: unlink d7/faf 0 2024-08-01T06:56:04.231 INFO:tasks.workunit.client.1.smithi089.stdout:0/802: unlink d9/d40/d25/lf4 0 2024-08-01T06:56:04.234 INFO:tasks.workunit.client.1.smithi089.stdout:7/663: truncate d7/d1f/d3a/f6f 338167 0 2024-08-01T06:56:04.234 INFO:tasks.workunit.client.1.smithi089.stdout:4/789: dread d3/db/d16/f1a [4194304,4194304] 0 2024-08-01T06:56:04.235 INFO:tasks.workunit.client.1.smithi089.stdout:4/790: readlink d3/db/de/d5b/l83 0 2024-08-01T06:56:04.236 INFO:tasks.workunit.client.1.smithi089.stdout:4/791: write d3/db/de/d5b/db9/fc3 [4265344,23149] 0 2024-08-01T06:56:04.237 INFO:tasks.workunit.client.1.smithi089.stdout:0/803: creat d9/d40/d95/d99/dba/ffb x:0 0 0 2024-08-01T06:56:04.238 INFO:tasks.workunit.client.1.smithi089.stdout:7/664: creat d7/d1f/da6/dbb/fe1 x:0 0 0 2024-08-01T06:56:04.240 INFO:tasks.workunit.client.1.smithi089.stdout:4/792: symlink d3/db/de/d5b/lea 0 2024-08-01T06:56:04.248 INFO:tasks.workunit.client.1.smithi089.stdout:4/793: dwrite d3/db/de/d5b/fe2 [0,4194304] 0 2024-08-01T06:56:04.255 INFO:tasks.workunit.client.1.smithi089.stdout:3/586: link d7/d32/d9f/fab d7/d68/fb8 0 2024-08-01T06:56:04.256 INFO:tasks.workunit.client.1.smithi089.stdout:4/794: dwrite d3/db/d33/fb6 [0,4194304] 0 2024-08-01T06:56:04.259 INFO:tasks.workunit.client.1.smithi089.stdout:3/587: creat d7/d32/d4c/d69/fb9 x:0 0 0 2024-08-01T06:56:04.260 INFO:tasks.workunit.client.1.smithi089.stdout:4/795: creat d3/d17/d3a/d4a/de1/feb x:0 0 0 2024-08-01T06:56:04.261 INFO:tasks.workunit.client.1.smithi089.stdout:4/796: mknod d3/d68/cec 0 2024-08-01T06:56:04.268 INFO:tasks.workunit.client.1.smithi089.stdout:4/797: dwrite d3/fb8 [0,4194304] 0 2024-08-01T06:56:04.270 INFO:tasks.workunit.client.1.smithi089.stdout:2/651: truncate d7/d1f/d28/fa3 702367 0 2024-08-01T06:56:04.272 INFO:tasks.workunit.client.1.smithi089.stdout:3/588: symlink d7/d32/d12/d29/lba 0 2024-08-01T06:56:04.273 INFO:tasks.workunit.client.1.smithi089.stdout:2/652: write d7/d19/d1e/f54 [3319582,26541] 0 2024-08-01T06:56:04.273 INFO:tasks.workunit.client.1.smithi089.stdout:3/589: stat d7/d68/d50 0 2024-08-01T06:56:04.274 INFO:tasks.workunit.client.1.smithi089.stdout:4/798: dread d3/db/d33/fb6 [0,4194304] 0 2024-08-01T06:56:04.275 INFO:tasks.workunit.client.1.smithi089.stdout:2/653: readlink d7/d1f/d28/l5f 0 2024-08-01T06:56:04.281 INFO:tasks.workunit.client.1.smithi089.stdout:2/654: link d7/d19/d1e/f2e d7/d19/dc5/dcc/d64/fce 0 2024-08-01T06:56:04.283 INFO:tasks.workunit.client.1.smithi089.stdout:8/754: write d5/d23/f6d [595643,90162] 0 2024-08-01T06:56:04.285 INFO:tasks.workunit.client.1.smithi089.stdout:8/755: write d5/d15/d5a/d73/d87/fa9 [2592961,2253] 0 2024-08-01T06:56:04.287 INFO:tasks.workunit.client.1.smithi089.stdout:2/655: link d7/l98 d7/d1f/lcf 0 2024-08-01T06:56:04.288 INFO:tasks.workunit.client.1.smithi089.stdout:8/756: chown d5/dc/f52 6695 1 2024-08-01T06:56:04.289 INFO:tasks.workunit.client.1.smithi089.stdout:2/656: unlink d7/l79 0 2024-08-01T06:56:04.289 INFO:tasks.workunit.client.1.smithi089.stdout:8/757: stat d5/d23/f51 0 2024-08-01T06:56:04.289 INFO:tasks.workunit.client.1.smithi089.stdout:3/590: dread d7/d32/d4c/d69/f1a [0,4194304] 0 2024-08-01T06:56:04.290 INFO:tasks.workunit.client.1.smithi089.stdout:2/657: truncate d7/d4a/f6d 1009733 0 2024-08-01T06:56:04.292 INFO:tasks.workunit.client.1.smithi089.stdout:2/658: write d7/d19/fb4 [884843,124426] 0 2024-08-01T06:56:04.292 INFO:tasks.workunit.client.1.smithi089.stdout:3/591: symlink d7/d68/d50/d6f/d2f/lbb 0 2024-08-01T06:56:04.293 INFO:tasks.workunit.client.1.smithi089.stdout:6/823: rename d2/f2a to d2/d11/d1f/f111 0 2024-08-01T06:56:04.294 INFO:tasks.workunit.client.1.smithi089.stdout:8/758: creat d5/dc/d94/dc7/dc5/dd4/f10b x:0 0 0 2024-08-01T06:56:04.295 INFO:tasks.workunit.client.1.smithi089.stdout:4/799: creat d3/d86/d9e/db1/dbb/fed x:0 0 0 2024-08-01T06:56:04.296 INFO:tasks.workunit.client.1.smithi089.stdout:3/592: write d7/d32/d12/d1b/f3c [227990,127097] 0 2024-08-01T06:56:04.297 INFO:tasks.workunit.client.1.smithi089.stdout:2/659: chown d7/d1f/d29/l90 217190 1 2024-08-01T06:56:04.297 INFO:tasks.workunit.client.1.smithi089.stdout:5/750: rename d5/de/df/d9f/dbd/df0/d5d/c75 to d5/de/df/cf6 0 2024-08-01T06:56:04.298 INFO:tasks.workunit.client.1.smithi089.stdout:7/665: dwrite d7/d1f/f1a [0,4194304] 0 2024-08-01T06:56:04.299 INFO:tasks.workunit.client.1.smithi089.stdout:6/824: unlink d2/d2e/d2f/f4d 0 2024-08-01T06:56:04.301 INFO:tasks.workunit.client.1.smithi089.stdout:4/800: read d3/db/d16/f18 [5602766,18882] 0 2024-08-01T06:56:04.302 INFO:tasks.workunit.client.1.smithi089.stdout:7/666: truncate d7/df/fd8 152474 0 2024-08-01T06:56:04.302 INFO:tasks.workunit.client.1.smithi089.stdout:9/685: rename d18/d22/d52/c66 to d18/d22/d45/ce3 0 2024-08-01T06:56:04.304 INFO:tasks.workunit.client.1.smithi089.stdout:2/660: unlink d7/d19/d1e/l3a 0 2024-08-01T06:56:04.304 INFO:tasks.workunit.client.1.smithi089.stdout:5/751: chown d5/de/d57/d8e/d97/da5/dba/lf2 1 1 2024-08-01T06:56:04.307 INFO:tasks.workunit.client.1.smithi089.stdout:3/593: mkdir d7/d68/d50/d54/dbc 0 2024-08-01T06:56:04.307 INFO:tasks.workunit.client.1.smithi089.stdout:4/801: write d3/d86/d9e/f6d [260987,71331] 0 2024-08-01T06:56:04.308 INFO:tasks.workunit.client.1.smithi089.stdout:7/667: unlink d7/f19 0 2024-08-01T06:56:04.308 INFO:tasks.workunit.client.1.smithi089.stdout:5/752: write d5/d13/d43/fbc [986349,116186] 0 2024-08-01T06:56:04.310 INFO:tasks.workunit.client.1.smithi089.stdout:6/825: fdatasync d2/d11/d3e/f60 0 2024-08-01T06:56:04.312 INFO:tasks.workunit.client.1.smithi089.stdout:3/594: write d7/d32/d12/d1b/f51 [3674740,15418] 0 2024-08-01T06:56:04.314 INFO:tasks.workunit.client.1.smithi089.stdout:8/759: dwrite d5/d15/d5a/d73/fe2 [0,4194304] 0 2024-08-01T06:56:04.315 INFO:tasks.workunit.client.1.smithi089.stdout:2/661: truncate d7/d19/d1e/d3d/d60/fcd 839565 0 2024-08-01T06:56:04.316 INFO:tasks.workunit.client.1.smithi089.stdout:8/760: readlink d5/d15/l33 0 2024-08-01T06:56:04.316 INFO:tasks.workunit.client.1.smithi089.stdout:9/686: mknod d18/d33/d6e/dd1/ce4 0 2024-08-01T06:56:04.320 INFO:tasks.workunit.client.1.smithi089.stdout:7/668: creat d7/df/d10/d42/fe2 x:0 0 0 2024-08-01T06:56:04.323 INFO:tasks.workunit.client.1.smithi089.stdout:6/826: creat d2/d2e/d2f/f112 x:0 0 0 2024-08-01T06:56:04.323 INFO:tasks.workunit.client.1.smithi089.stdout:5/753: dwrite d5/d13/d43/f4e [0,4194304] 0 2024-08-01T06:56:04.326 INFO:tasks.workunit.client.1.smithi089.stdout:2/662: creat d7/d19/d1e/d3d/d60/fd0 x:0 0 0 2024-08-01T06:56:04.328 INFO:tasks.workunit.client.1.smithi089.stdout:8/761: chown d5/dc/d12/f40 589 1 2024-08-01T06:56:04.328 INFO:tasks.workunit.client.1.smithi089.stdout:9/687: creat d18/d33/d49/d7b/d81/fe5 x:0 0 0 2024-08-01T06:56:04.330 INFO:tasks.workunit.client.1.smithi089.stdout:5/754: creat d5/de/df/d9f/ff7 x:0 0 0 2024-08-01T06:56:04.330 INFO:tasks.workunit.client.1.smithi089.stdout:3/595: mknod d7/d68/d50/d54/da5/cbd 0 2024-08-01T06:56:04.331 INFO:tasks.workunit.client.1.smithi089.stdout:2/663: rmdir d7/d19/dc5/dcc/d64/d9c 39 2024-08-01T06:56:04.332 INFO:tasks.workunit.client.1.smithi089.stdout:9/688: write f15 [571844,15453] 0 2024-08-01T06:56:04.333 INFO:tasks.workunit.client.1.smithi089.stdout:8/762: creat d5/dc/d94/d84/f10c x:0 0 0 2024-08-01T06:56:04.334 INFO:tasks.workunit.client.1.smithi089.stdout:8/763: read - d5/dc/fb2 zero size 2024-08-01T06:56:04.338 INFO:tasks.workunit.client.1.smithi089.stdout:5/755: write d5/de/d10/d16/d1b/d25/f89 [5938473,118406] 0 2024-08-01T06:56:04.338 INFO:tasks.workunit.client.1.smithi089.stdout:2/664: rename d7/d19/fb4 to d7/d19/d3b/fd1 0 2024-08-01T06:56:04.341 INFO:tasks.workunit.client.1.smithi089.stdout:5/756: write d5/f73 [1794948,64350] 0 2024-08-01T06:56:04.342 INFO:tasks.workunit.client.1.smithi089.stdout:9/689: dwrite d18/d33/d3b/f3c [0,4194304] 0 2024-08-01T06:56:04.345 INFO:tasks.workunit.client.1.smithi089.stdout:8/764: dwrite d5/d15/d5a/d73/d87/f9a [0,4194304] 0 2024-08-01T06:56:04.345 INFO:tasks.workunit.client.1.smithi089.stdout:7/669: link f6 d7/df/d3b/fe3 0 2024-08-01T06:56:04.353 INFO:tasks.workunit.client.1.smithi089.stdout:8/765: fsync d5/dc/d12/f40 0 2024-08-01T06:56:04.353 INFO:tasks.workunit.client.1.smithi089.stdout:5/757: truncate d5/de/f59 1819025 0 2024-08-01T06:56:04.354 INFO:tasks.workunit.client.1.smithi089.stdout:7/670: creat d7/df/d10/d31/d43/fe4 x:0 0 0 2024-08-01T06:56:04.354 INFO:tasks.workunit.client.1.smithi089.stdout:4/802: dwrite d3/db/de/f9d [0,4194304] 0 2024-08-01T06:56:04.357 INFO:tasks.workunit.client.1.smithi089.stdout:4/803: fsync d3/d1e/f58 0 2024-08-01T06:56:04.358 INFO:tasks.workunit.client.1.smithi089.stdout:8/766: write d5/d15/d5e/fe3 [988843,81885] 0 2024-08-01T06:56:04.359 INFO:tasks.workunit.client.1.smithi089.stdout:9/690: getdents d18/d22/d45 0 2024-08-01T06:56:04.361 INFO:tasks.workunit.client.1.smithi089.stdout:3/596: dwrite d7/d68/fb8 [0,4194304] 0 2024-08-01T06:56:04.362 INFO:tasks.workunit.client.1.smithi089.stdout:2/665: truncate d7/d19/d1e/f8a 299294 0 2024-08-01T06:56:04.364 INFO:tasks.workunit.client.1.smithi089.stdout:5/758: rmdir d5/de/d57/d8e/d97 39 2024-08-01T06:56:04.365 INFO:tasks.workunit.client.1.smithi089.stdout:3/597: write d7/d32/f2d [150645,117840] 0 2024-08-01T06:56:04.370 INFO:tasks.workunit.client.1.smithi089.stdout:9/691: symlink d18/d22/d39/d50/le6 0 2024-08-01T06:56:04.371 INFO:tasks.workunit.client.1.smithi089.stdout:8/767: rename d5/d15/l5d to d5/dc/d94/dc7/dba/df5/l10d 0 2024-08-01T06:56:04.371 INFO:tasks.workunit.client.1.smithi089.stdout:9/692: chown d18/d33/f60 1936301 1 2024-08-01T06:56:04.372 INFO:tasks.workunit.client.1.smithi089.stdout:7/671: dread d7/df/d10/f34 [0,4194304] 0 2024-08-01T06:56:04.373 INFO:tasks.workunit.client.1.smithi089.stdout:3/598: rmdir d7/d32/d12/d1b 39 2024-08-01T06:56:04.375 INFO:tasks.workunit.client.1.smithi089.stdout:7/672: chown d7/d15/f2d 227697 1 2024-08-01T06:56:04.376 INFO:tasks.workunit.client.1.smithi089.stdout:8/768: creat d5/dc/f10e x:0 0 0 2024-08-01T06:56:04.379 INFO:tasks.workunit.client.1.smithi089.stdout:9/693: getdents d18/d22 0 2024-08-01T06:56:04.382 INFO:tasks.workunit.client.1.smithi089.stdout:3/599: mknod d7/d68/d50/d6f/d2f/d9c/cbe 0 2024-08-01T06:56:04.383 INFO:tasks.workunit.client.1.smithi089.stdout:5/759: dwrite d5/d13/d38/fe7 [0,4194304] 0 2024-08-01T06:56:04.383 INFO:tasks.workunit.client.1.smithi089.stdout:7/673: fdatasync d7/df/d10/d31/f45 0 2024-08-01T06:56:04.383 INFO:tasks.workunit.client.1.smithi089.stdout:3/600: readlink d7/d32/l22 0 2024-08-01T06:56:04.384 INFO:tasks.workunit.client.1.smithi089.stdout:9/694: creat d18/d33/d3b/fe7 x:0 0 0 2024-08-01T06:56:04.388 INFO:tasks.workunit.client.1.smithi089.stdout:2/666: dwrite d7/d19/dc5/dcc/d64/d9c/daf/fb9 [0,4194304] 0 2024-08-01T06:56:04.388 INFO:tasks.workunit.client.1.smithi089.stdout:8/769: link d5/dc/d94/dc7/dba/ffc d5/dc/d94/dc7/dc5/f10f 0 2024-08-01T06:56:04.389 INFO:tasks.workunit.client.1.smithi089.stdout:4/804: truncate d3/db/de/d5b/fe2 2245589 0 2024-08-01T06:56:04.391 INFO:tasks.workunit.client.1.smithi089.stdout:9/695: creat d18/da4/fe8 x:0 0 0 2024-08-01T06:56:04.392 INFO:tasks.workunit.client.1.smithi089.stdout:4/805: write d3/d1e/f58 [9272656,80610] 0 2024-08-01T06:56:04.394 INFO:tasks.workunit.client.1.smithi089.stdout:7/674: creat d7/fe5 x:0 0 0 2024-08-01T06:56:04.395 INFO:tasks.workunit.client.1.smithi089.stdout:9/696: mknod d18/d22/d52/ce9 0 2024-08-01T06:56:04.395 INFO:tasks.workunit.client.1.smithi089.stdout:4/806: read - d3/d68/d7e/fa9 zero size 2024-08-01T06:56:04.397 INFO:tasks.workunit.client.1.smithi089.stdout:8/770: truncate d5/dc/d94/dc7/dc5/dd4/f10b 130003 0 2024-08-01T06:56:04.398 INFO:tasks.workunit.client.1.smithi089.stdout:3/601: getdents d7/d32/d12/d29/d39/d4b 0 2024-08-01T06:56:04.398 INFO:tasks.workunit.client.1.smithi089.stdout:5/760: dwrite d5/de/d10/d16/d1b/d25/f64 [0,4194304] 0 2024-08-01T06:56:04.399 INFO:tasks.workunit.client.1.smithi089.stdout:7/675: mknod d7/d46/ce6 0 2024-08-01T06:56:04.400 INFO:tasks.workunit.client.1.smithi089.stdout:8/771: dread - d5/d23/fe1 zero size 2024-08-01T06:56:04.401 INFO:tasks.workunit.client.1.smithi089.stdout:4/807: mkdir d3/d17/d3a/d4a/dee 0 2024-08-01T06:56:04.403 INFO:tasks.workunit.client.1.smithi089.stdout:5/761: chown d5/de/d57/d8e/l95 63400579 1 2024-08-01T06:56:04.404 INFO:tasks.workunit.client.1.smithi089.stdout:3/602: mknod d7/d68/d50/d89/cbf 0 2024-08-01T06:56:04.406 INFO:tasks.workunit.client.1.smithi089.stdout:7/676: mkdir d7/d1f/da6/dbb/de7 0 2024-08-01T06:56:04.407 INFO:tasks.workunit.client.1.smithi089.stdout:5/762: write d5/de/d10/fe8 [373491,109146] 0 2024-08-01T06:56:04.410 INFO:tasks.workunit.client.1.smithi089.stdout:9/697: dwrite d18/f1d [4194304,4194304] 0 2024-08-01T06:56:04.411 INFO:tasks.workunit.client.1.smithi089.stdout:5/763: chown d5/l4a 57673149 1 2024-08-01T06:56:04.413 INFO:tasks.workunit.client.1.smithi089.stdout:7/677: read d7/df/d10/d31/d4a/fb0 [473736,37221] 0 2024-08-01T06:56:04.414 INFO:tasks.workunit.client.1.smithi089.stdout:3/603: creat d7/d68/fc0 x:0 0 0 2024-08-01T06:56:04.415 INFO:tasks.workunit.client.1.smithi089.stdout:9/698: dread - d18/d33/d49/d7b/d4b/dbb/fbc zero size 2024-08-01T06:56:04.418 INFO:tasks.workunit.client.1.smithi089.stdout:4/808: dwrite d3/d17/d3a/d4a/de1/feb [0,4194304] 0 2024-08-01T06:56:04.419 INFO:tasks.workunit.client.1.smithi089.stdout:2/667: truncate d7/d19/d1e/d3d/d60/fcd 634925 0 2024-08-01T06:56:04.419 INFO:tasks.workunit.client.1.smithi089.stdout:9/699: stat d18/d33/d49/d7b/d55/da6 0 2024-08-01T06:56:04.421 INFO:tasks.workunit.client.1.smithi089.stdout:7/678: read d7/df/d10/d31/d43/f88 [495639,28482] 0 2024-08-01T06:56:04.422 INFO:tasks.workunit.client.1.smithi089.stdout:7/679: chown d7/d1f/d30/db1 2 1 2024-08-01T06:56:04.425 INFO:tasks.workunit.client.1.smithi089.stdout:5/764: getdents d5/de/d10 0 2024-08-01T06:56:04.427 INFO:tasks.workunit.client.1.smithi089.stdout:5/765: write d5/de/df/fb6 [414454,12389] 0 2024-08-01T06:56:04.429 INFO:tasks.workunit.client.1.smithi089.stdout:8/772: dread d5/dc/d1e/fb5 [0,4194304] 0 2024-08-01T06:56:04.429 INFO:tasks.workunit.client.1.smithi089.stdout:5/766: write d5/de/d10/d33/d5e/fed [4345507,62474] 0 2024-08-01T06:56:04.430 INFO:tasks.workunit.client.1.smithi089.stdout:8/773: write d5/dc/fb2 [621465,50485] 0 2024-08-01T06:56:04.431 INFO:tasks.workunit.client.1.smithi089.stdout:3/604: rename d7/d68/l5e to d7/d68/d50/d54/lc1 0 2024-08-01T06:56:04.433 INFO:tasks.workunit.client.1.smithi089.stdout:3/605: write d7/d68/d50/d6f/d2f/d9c/f9d [703563,57540] 0 2024-08-01T06:56:04.435 INFO:tasks.workunit.client.1.smithi089.stdout:4/809: link d3/d17/f9a d3/d86/d9e/fef 0 2024-08-01T06:56:04.437 INFO:tasks.workunit.client.1.smithi089.stdout:7/680: rename d7/df/d10/l6e to d7/df/d10/d31/d4a/le8 0 2024-08-01T06:56:04.438 INFO:tasks.workunit.client.1.smithi089.stdout:7/681: write f3 [240990,27940] 0 2024-08-01T06:56:04.439 INFO:tasks.workunit.client.1.smithi089.stdout:9/700: truncate d18/d22/d39/f3a 933834 0 2024-08-01T06:56:04.440 INFO:tasks.workunit.client.1.smithi089.stdout:3/606: dread d7/d32/d12/f41 [0,4194304] 0 2024-08-01T06:56:04.444 INFO:tasks.workunit.client.1.smithi089.stdout:2/668: getdents d7/d73 0 2024-08-01T06:56:04.447 INFO:tasks.workunit.client.1.smithi089.stdout:5/767: rename d5/de/d10/d16/d1b/d25/f70 to d5/dac/ff8 0 2024-08-01T06:56:04.447 INFO:tasks.workunit.client.1.smithi089.stdout:7/682: mkdir d7/df/d10/db3/de9 0 2024-08-01T06:56:04.449 INFO:tasks.workunit.client.1.smithi089.stdout:9/701: creat d18/d22/d52/fea x:0 0 0 2024-08-01T06:56:04.450 INFO:tasks.workunit.client.1.smithi089.stdout:3/607: symlink d7/d68/d50/d6f/d2f/da2/lc2 0 2024-08-01T06:56:04.451 INFO:tasks.workunit.client.1.smithi089.stdout:5/768: symlink d5/de/d10/d16/d9d/lf9 0 2024-08-01T06:56:04.453 INFO:tasks.workunit.client.1.smithi089.stdout:4/810: getdents d3/d86/d9e/db1/dbb 0 2024-08-01T06:56:04.454 INFO:tasks.workunit.client.1.smithi089.stdout:2/669: dwrite d7/d19/d3b/fbd [0,4194304] 0 2024-08-01T06:56:04.455 INFO:tasks.workunit.client.1.smithi089.stdout:8/774: dread d5/dc/d1e/d53/fa0 [0,4194304] 0 2024-08-01T06:56:04.455 INFO:tasks.workunit.client.1.smithi089.stdout:4/811: dread - d3/d86/db7/dd1/fdc zero size 2024-08-01T06:56:04.455 INFO:tasks.workunit.client.1.smithi089.stdout:2/670: readlink d7/d4a/l4c 0 2024-08-01T06:56:04.456 INFO:tasks.workunit.client.1.smithi089.stdout:7/683: creat d7/d1f/d30/d4c/dbc/dcd/dd7/fea x:0 0 0 2024-08-01T06:56:04.456 INFO:tasks.workunit.client.1.smithi089.stdout:3/608: mknod d7/d68/d50/d6f/d2f/da2/cc3 0 2024-08-01T06:56:04.458 INFO:tasks.workunit.client.1.smithi089.stdout:8/775: truncate d5/d23/dd3/f107 792684 0 2024-08-01T06:56:04.459 INFO:tasks.workunit.client.1.smithi089.stdout:7/684: chown d7/d1f/d30/c65 122688 1 2024-08-01T06:56:04.459 INFO:tasks.workunit.client.1.smithi089.stdout:2/671: symlink d7/d1f/d29/d48/ld2 0 2024-08-01T06:56:04.460 INFO:tasks.workunit.client.1.smithi089.stdout:8/776: fsync d5/dc/d1e/d53/ffd 0 2024-08-01T06:56:04.461 INFO:tasks.workunit.client.1.smithi089.stdout:7/685: chown d7/df/d10/d42/d4e/f77 13 1 2024-08-01T06:56:04.461 INFO:tasks.workunit.client.1.smithi089.stdout:4/812: rename d3/d86/d9e/db1/dbb/d62/d3b/f8d to d3/d86/ff0 0 2024-08-01T06:56:04.468 INFO:tasks.workunit.client.1.smithi089.stdout:8/777: mkdir d5/d15/d5a/d73/d87/dbf/d110 0 2024-08-01T06:56:04.470 INFO:tasks.workunit.client.1.smithi089.stdout:4/813: write d3/d68/d7e/fb2 [1313425,5952] 0 2024-08-01T06:56:04.470 INFO:tasks.workunit.client.1.smithi089.stdout:2/672: write d7/d1f/f6c [1308654,113094] 0 2024-08-01T06:56:04.470 INFO:tasks.workunit.client.1.smithi089.stdout:9/702: truncate d18/f7e 4007683 0 2024-08-01T06:56:04.470 INFO:tasks.workunit.client.1.smithi089.stdout:8/778: chown d5/dc/d1e/d53/fa0 14822 1 2024-08-01T06:56:04.473 INFO:tasks.workunit.client.1.smithi089.stdout:2/673: mkdir d7/d1f/d29/db7/dd3 0 2024-08-01T06:56:04.473 INFO:tasks.workunit.client.1.smithi089.stdout:7/686: mkdir d7/d1f/da6/dbb/de7/deb 0 2024-08-01T06:56:04.475 INFO:tasks.workunit.client.1.smithi089.stdout:3/609: write d7/d32/d12/d1b/f4a [80710,48694] 0 2024-08-01T06:56:04.475 INFO:tasks.workunit.client.1.smithi089.stdout:9/703: rename d18/d33/d49/l74 to d18/d33/d53/leb 0 2024-08-01T06:56:04.477 INFO:tasks.workunit.client.1.smithi089.stdout:7/687: creat d7/df/d10/d31/d43/fec x:0 0 0 2024-08-01T06:56:04.478 INFO:tasks.workunit.client.1.smithi089.stdout:2/674: getdents d7/d1f/d29/d48/da9 0 2024-08-01T06:56:04.479 INFO:tasks.workunit.client.1.smithi089.stdout:7/688: fsync d7/d1f/d3a/dad/fb2 0 2024-08-01T06:56:04.481 INFO:tasks.workunit.client.1.smithi089.stdout:8/779: write d5/d15/f44 [5056421,84441] 0 2024-08-01T06:56:04.481 INFO:tasks.workunit.client.1.smithi089.stdout:4/814: getdents d3/d86/db7/dd2 0 2024-08-01T06:56:04.484 INFO:tasks.workunit.client.1.smithi089.stdout:7/689: creat d7/d1f/d30/d4c/dbc/dcd/fed x:0 0 0 2024-08-01T06:56:04.485 INFO:tasks.workunit.client.1.smithi089.stdout:7/690: chown d7/df/d10/d31/d43/fec 10 1 2024-08-01T06:56:04.485 INFO:tasks.workunit.client.1.smithi089.stdout:7/691: fsync d7/df/d91/da4/fa0 0 2024-08-01T06:56:04.486 INFO:tasks.workunit.client.1.smithi089.stdout:4/815: rmdir d3/d17/d3a 39 2024-08-01T06:56:04.487 INFO:tasks.workunit.client.1.smithi089.stdout:4/816: chown d3/d17/d71/d92/lc7 1 1 2024-08-01T06:56:04.493 INFO:tasks.workunit.client.1.smithi089.stdout:4/817: rmdir d3/d86 39 2024-08-01T06:56:04.494 INFO:tasks.workunit.client.1.smithi089.stdout:7/692: dwrite d7/df/d10/f83 [4194304,4194304] 0 2024-08-01T06:56:04.494 INFO:tasks.workunit.client.1.smithi089.stdout:8/780: link d5/cb7 d5/dc/d94/dc7/dc5/dd4/c111 0 2024-08-01T06:56:04.495 INFO:tasks.workunit.client.1.smithi089.stdout:9/704: dwrite d18/d22/d43/f99 [4194304,4194304] 0 2024-08-01T06:56:04.496 INFO:tasks.workunit.client.1.smithi089.stdout:7/693: chown d7/df/d91/da4 58335 1 2024-08-01T06:56:04.498 INFO:tasks.workunit.client.1.smithi089.stdout:8/781: mkdir d5/dc/d12/d112 0 2024-08-01T06:56:04.499 INFO:tasks.workunit.client.1.smithi089.stdout:2/675: truncate d7/d1f/f20 2831031 0 2024-08-01T06:56:04.500 INFO:tasks.workunit.client.1.smithi089.stdout:4/818: creat d3/d86/db7/ff1 x:0 0 0 2024-08-01T06:56:04.500 INFO:tasks.workunit.client.1.smithi089.stdout:2/676: chown d7/d19/dc5/dcc/d64 164529010 1 2024-08-01T06:56:04.502 INFO:tasks.workunit.client.1.smithi089.stdout:7/694: mkdir d7/df/d10/dd6/dee 0 2024-08-01T06:56:04.502 INFO:tasks.workunit.client.1.smithi089.stdout:8/782: chown d5/dc/d94/d84/ddb/fe7 987053 1 2024-08-01T06:56:04.503 INFO:tasks.workunit.client.1.smithi089.stdout:7/695: stat d7/f93 0 2024-08-01T06:56:04.503 INFO:tasks.workunit.client.1.smithi089.stdout:4/819: readlink d3/d86/d9e/db1/dbb/d62/d31/l97 0 2024-08-01T06:56:04.504 INFO:tasks.workunit.client.1.smithi089.stdout:4/820: fsync d3/db/f39 0 2024-08-01T06:56:04.505 INFO:tasks.workunit.client.1.smithi089.stdout:4/821: chown d3/d86/d9e/d57 63715969 1 2024-08-01T06:56:04.506 INFO:tasks.workunit.client.1.smithi089.stdout:9/705: rename d18/d22/d52/db7 to d18/dec 0 2024-08-01T06:56:04.507 INFO:tasks.workunit.client.1.smithi089.stdout:2/677: symlink d7/d19/d3b/ld4 0 2024-08-01T06:56:04.509 INFO:tasks.workunit.client.1.smithi089.stdout:4/822: mknod d3/d86/d9e/db1/dbb/d62/d31/cf2 0 2024-08-01T06:56:04.509 INFO:tasks.workunit.client.1.smithi089.stdout:7/696: creat d7/d1f/d30/d4c/fef x:0 0 0 2024-08-01T06:56:04.511 INFO:tasks.workunit.client.1.smithi089.stdout:7/697: chown d7/d1f/da6/fb7 38925936 1 2024-08-01T06:56:04.512 INFO:tasks.workunit.client.1.smithi089.stdout:7/698: stat d7/df/d10/d31/d4a/fb0 0 2024-08-01T06:56:04.515 INFO:tasks.workunit.client.1.smithi089.stdout:7/699: mknod d7/df/d10/d31/d4a/cf0 0 2024-08-01T06:56:04.517 INFO:tasks.workunit.client.1.smithi089.stdout:7/700: mknod d7/df/cf1 0 2024-08-01T06:56:04.517 INFO:tasks.workunit.client.1.smithi089.stdout:4/823: dwrite d3/fb8 [0,4194304] 0 2024-08-01T06:56:04.519 INFO:tasks.workunit.client.1.smithi089.stdout:7/701: write d7/df/d91/da4/fb6 [275692,61616] 0 2024-08-01T06:56:04.520 INFO:tasks.workunit.client.1.smithi089.stdout:7/702: readlink d7/d1f/d30/la2 0 2024-08-01T06:56:04.523 INFO:tasks.workunit.client.1.smithi089.stdout:4/824: write d3/d17/d3a/f63 [1849371,3869] 0 2024-08-01T06:56:04.523 INFO:tasks.workunit.client.1.smithi089.stdout:7/703: chown d7/d1f/da6/ce0 6081 1 2024-08-01T06:56:04.528 INFO:tasks.workunit.client.1.smithi089.stdout:2/678: write d7/d19/d3b/f50 [1162421,785] 0 2024-08-01T06:56:04.528 INFO:tasks.workunit.client.1.smithi089.stdout:7/704: link d7/d1f/ce d7/df/d10/d31/d4a/cf2 0 2024-08-01T06:56:04.530 INFO:tasks.workunit.client.1.smithi089.stdout:2/679: fdatasync d7/d19/d1e/fbe 0 2024-08-01T06:56:04.531 INFO:tasks.workunit.client.1.smithi089.stdout:2/680: chown d7/d1f/d52/d6e/l85 68 1 2024-08-01T06:56:04.532 INFO:tasks.workunit.client.1.smithi089.stdout:4/825: link d3/d86/d9e/db1/dbb/d62/d31/c7d d3/db/d33/cf3 0 2024-08-01T06:56:04.532 INFO:tasks.workunit.client.1.smithi089.stdout:7/705: mkdir d7/d1f/da6/dbb/de7/deb/df3 0 2024-08-01T06:56:04.534 INFO:tasks.workunit.client.1.smithi089.stdout:2/681: symlink d7/d1f/d29/d48/da9/ld5 0 2024-08-01T06:56:04.534 INFO:tasks.workunit.client.1.smithi089.stdout:4/826: mkdir d3/d86/db7/dd2/df4 0 2024-08-01T06:56:04.534 INFO:tasks.workunit.client.1.smithi089.stdout:7/706: write d7/d1f/f1d [6342210,83981] 0 2024-08-01T06:56:04.537 INFO:tasks.workunit.client.1.smithi089.stdout:4/827: creat d3/d17/d3a/d4a/de1/ff5 x:0 0 0 2024-08-01T06:56:04.541 INFO:tasks.workunit.client.1.smithi089.stdout:8/783: dread d5/dc/f11 [0,4194304] 0 2024-08-01T06:56:04.542 INFO:tasks.workunit.client.1.smithi089.stdout:7/707: dwrite d7/d1f/f28 [0,4194304] 0 2024-08-01T06:56:04.544 INFO:tasks.workunit.client.1.smithi089.stdout:8/784: write d5/dc/f97 [774887,91267] 0 2024-08-01T06:56:04.544 INFO:tasks.workunit.client.1.smithi089.stdout:2/682: dwrite d7/d1f/d28/f51 [0,4194304] 0 2024-08-01T06:56:04.547 INFO:tasks.workunit.client.1.smithi089.stdout:7/708: symlink d7/df/d10/d31/lf4 0 2024-08-01T06:56:04.550 INFO:tasks.workunit.client.1.smithi089.stdout:2/683: rename d7/d1f/fae to d7/d19/fd6 0 2024-08-01T06:56:04.554 INFO:tasks.workunit.client.1.smithi089.stdout:7/709: dwrite d7/d15/f2d [0,4194304] 0 2024-08-01T06:56:04.557 INFO:tasks.workunit.client.1.smithi089.stdout:8/785: link d5/d15/d5a/d73/l7e d5/dc/d94/dc7/dba/l113 0 2024-08-01T06:56:04.560 INFO:tasks.workunit.client.1.smithi089.stdout:8/786: dread - d5/dc/d12/db9/fd1 zero size 2024-08-01T06:56:04.560 INFO:tasks.workunit.client.1.smithi089.stdout:7/710: rename d7/d1f/f3f to d7/d1f/d30/d4c/dbc/dcd/ff5 0 2024-08-01T06:56:04.563 INFO:tasks.workunit.client.1.smithi089.stdout:7/711: creat d7/df/d91/da4/dca/ff6 x:0 0 0 2024-08-01T06:56:04.566 INFO:tasks.workunit.client.1.smithi089.stdout:7/712: mknod d7/d1f/d3a/cf7 0 2024-08-01T06:56:04.566 INFO:tasks.workunit.client.1.smithi089.stdout:8/787: dwrite d5/dc/d1e/fce [0,4194304] 0 2024-08-01T06:56:04.567 INFO:tasks.workunit.client.1.smithi089.stdout:2/684: dread d7/d19/d1e/f54 [0,4194304] 0 2024-08-01T06:56:04.571 INFO:tasks.workunit.client.1.smithi089.stdout:8/788: creat d5/dc/d94/d84/f114 x:0 0 0 2024-08-01T06:56:04.572 INFO:tasks.workunit.client.1.smithi089.stdout:2/685: truncate d7/d1f/d28/fa8 476995 0 2024-08-01T06:56:04.583 INFO:tasks.workunit.client.1.smithi089.stdout:7/713: dwrite d7/df/d10/d42/d4e/f96 [0,4194304] 0 2024-08-01T06:56:04.588 INFO:tasks.workunit.client.1.smithi089.stdout:8/789: truncate d5/dc/d12/f4c 830051 0 2024-08-01T06:56:04.590 INFO:tasks.workunit.client.1.smithi089.stdout:8/790: write d5/d15/d5a/d73/d87/fec [3756296,69352] 0 2024-08-01T06:56:04.597 INFO:tasks.workunit.client.1.smithi089.stdout:2/686: dread d7/d73/f74 [0,4194304] 0 2024-08-01T06:56:04.597 INFO:tasks.workunit.client.1.smithi089.stdout:8/791: dwrite d5/dc/d1e/f34 [0,4194304] 0 2024-08-01T06:56:04.602 INFO:tasks.workunit.client.1.smithi089.stdout:7/714: dread f3 [0,4194304] 0 2024-08-01T06:56:04.604 INFO:tasks.workunit.client.1.smithi089.stdout:2/687: truncate d7/d19/d1e/d5b/f8e 3614027 0 2024-08-01T06:56:04.604 INFO:tasks.workunit.client.1.smithi089.stdout:8/792: truncate d5/d15/d5a/d73/d87/fec 2880809 0 2024-08-01T06:56:04.607 INFO:tasks.workunit.client.1.smithi089.stdout:7/715: rename d7/df/d91/da4/c59 to d7/df/d10/d42/cf8 0 2024-08-01T06:56:04.607 INFO:tasks.workunit.client.1.smithi089.stdout:7/716: chown d7/df/d10/d31/d43/f88 33975547 1 2024-08-01T06:56:04.608 INFO:tasks.workunit.client.1.smithi089.stdout:7/717: chown d7/c4b 75989 1 2024-08-01T06:56:04.608 INFO:tasks.workunit.client.1.smithi089.stdout:2/688: unlink d7/d19/d3b/d7c/c78 0 2024-08-01T06:56:04.608 INFO:tasks.workunit.client.1.smithi089.stdout:8/793: symlink d5/d15/d5e/l115 0 2024-08-01T06:56:04.609 INFO:tasks.workunit.client.1.smithi089.stdout:8/794: rmdir d5 39 2024-08-01T06:56:04.610 INFO:tasks.workunit.client.1.smithi089.stdout:2/689: mkdir d7/dd7 0 2024-08-01T06:56:04.611 INFO:tasks.workunit.client.1.smithi089.stdout:7/718: creat d7/ff9 x:0 0 0 2024-08-01T06:56:04.612 INFO:tasks.workunit.client.1.smithi089.stdout:2/690: write d7/d1f/d52/d6e/fbb [1991888,75444] 0 2024-08-01T06:56:04.613 INFO:tasks.workunit.client.1.smithi089.stdout:7/719: chown d7/df/d10/d31/d4a/cf0 29259487 1 2024-08-01T06:56:04.613 INFO:tasks.workunit.client.1.smithi089.stdout:8/795: symlink d5/dc/d1e/l116 0 2024-08-01T06:56:04.616 INFO:tasks.workunit.client.1.smithi089.stdout:2/691: rename d7/d19/dc5/dcc/d64/d9c/daf/fb9 to d7/d19/d1e/d5b/fd8 0 2024-08-01T06:56:04.617 INFO:tasks.workunit.client.1.smithi089.stdout:2/692: write d7/d1f/d29/db7/fc1 [57216,5997] 0 2024-08-01T06:56:04.617 INFO:tasks.workunit.client.1.smithi089.stdout:8/796: creat d5/dc/d1e/f117 x:0 0 0 2024-08-01T06:56:04.618 INFO:tasks.workunit.client.1.smithi089.stdout:8/797: chown d5/d23/d91/fef 4063 1 2024-08-01T06:56:04.618 INFO:tasks.workunit.client.1.smithi089.stdout:7/720: rename d7/df/d91/fc8 to d7/df/d91/da4/dca/ffa 0 2024-08-01T06:56:04.621 INFO:tasks.workunit.client.1.smithi089.stdout:7/721: mkdir d7/df/d10/d31/dfb 0 2024-08-01T06:56:04.623 INFO:tasks.workunit.client.1.smithi089.stdout:1/778: sync 2024-08-01T06:56:04.625 INFO:tasks.workunit.client.1.smithi089.stdout:1/779: write d0/d9/d15/d3b/d95/d49/d82/f93 [1169812,20927] 0 2024-08-01T06:56:04.627 INFO:tasks.workunit.client.1.smithi089.stdout:8/798: mknod d5/dc/d94/dc7/dba/d100/c118 0 2024-08-01T06:56:04.628 INFO:tasks.workunit.client.1.smithi089.stdout:2/693: creat d7/d1f/d28/fd9 x:0 0 0 2024-08-01T06:56:04.628 INFO:tasks.workunit.client.1.smithi089.stdout:8/799: stat d5/d15/d5a/f98 0 2024-08-01T06:56:04.630 INFO:tasks.workunit.client.1.smithi089.stdout:2/694: mknod d7/d19/d3b/d7c/cda 0 2024-08-01T06:56:04.632 INFO:tasks.workunit.client.1.smithi089.stdout:1/780: rename d0/d9/d15/d2d/fdb to d0/d9/d15/d2d/ffc 0 2024-08-01T06:56:04.636 INFO:tasks.workunit.client.1.smithi089.stdout:1/781: mknod d0/d9/d15/d3b/d95/d49/d82/da6/cfd 0 2024-08-01T06:56:04.637 INFO:tasks.workunit.client.1.smithi089.stdout:8/800: dwrite d5/dc/dca/fe6 [0,4194304] 0 2024-08-01T06:56:04.638 INFO:tasks.workunit.client.1.smithi089.stdout:1/782: truncate d0/d9/d15/f34 4486900 0 2024-08-01T06:56:04.640 INFO:tasks.workunit.client.1.smithi089.stdout:8/801: unlink d5/dc/fb2 0 2024-08-01T06:56:04.641 INFO:tasks.workunit.client.1.smithi089.stdout:7/722: write d7/d46/f68 [284306,113863] 0 2024-08-01T06:56:04.643 INFO:tasks.workunit.client.1.smithi089.stdout:7/723: write d7/d1f/d30/d4c/fef [732454,4975] 0 2024-08-01T06:56:04.645 INFO:tasks.workunit.client.1.smithi089.stdout:1/783: creat d0/d9/d15/d3b/d3d/d77/ffe x:0 0 0 2024-08-01T06:56:04.646 INFO:tasks.workunit.client.1.smithi089.stdout:2/695: truncate d7/d1f/f6c 846999 0 2024-08-01T06:56:04.647 INFO:tasks.workunit.client.1.smithi089.stdout:7/724: unlink d7/d15/l79 0 2024-08-01T06:56:04.647 INFO:tasks.workunit.client.1.smithi089.stdout:8/802: dread d5/d15/d5a/d73/fe2 [0,4194304] 0 2024-08-01T06:56:04.649 INFO:tasks.workunit.client.1.smithi089.stdout:7/725: chown d7/d1f/ce 30589214 1 2024-08-01T06:56:04.650 INFO:tasks.workunit.client.1.smithi089.stdout:1/784: unlink d0/d9/d15/d2d/d4a/d4d/l63 0 2024-08-01T06:56:04.652 INFO:tasks.workunit.client.1.smithi089.stdout:2/696: unlink d7/d19/d3b/caa 0 2024-08-01T06:56:04.652 INFO:tasks.workunit.client.1.smithi089.stdout:8/803: dread - d5/d15/d5a/d73/f90 zero size 2024-08-01T06:56:04.654 INFO:tasks.workunit.client.1.smithi089.stdout:2/697: creat d7/d19/fdb x:0 0 0 2024-08-01T06:56:04.656 INFO:tasks.workunit.client.1.smithi089.stdout:8/804: fsync d5/dc/d1e/fd6 0 2024-08-01T06:56:04.660 INFO:tasks.workunit.client.1.smithi089.stdout:7/726: write d7/df/d91/da4/dca/ffa [1198543,9109] 0 2024-08-01T06:56:04.667 INFO:tasks.workunit.client.1.smithi089.stdout:1/785: dread d0/d9/d15/d3b/d3d/fc0 [0,4194304] 0 2024-08-01T06:56:04.668 INFO:tasks.workunit.client.1.smithi089.stdout:7/727: dwrite d7/df/d10/d31/d4a/fd0 [0,4194304] 0 2024-08-01T06:56:04.669 INFO:tasks.workunit.client.1.smithi089.stdout:1/786: rename d0/d9 to d0/d9/d43/d89/dff 22 2024-08-01T06:56:04.670 INFO:tasks.workunit.client.1.smithi089.stdout:7/728: write d7/df/d10/d42/f9e [2292918,15473] 0 2024-08-01T06:56:04.674 INFO:tasks.workunit.client.1.smithi089.stdout:7/729: read d7/d1f/f84 [17622,79577] 0 2024-08-01T06:56:04.677 INFO:tasks.workunit.client.1.smithi089.stdout:8/805: dread d5/f25 [0,4194304] 0 2024-08-01T06:56:04.678 INFO:tasks.workunit.client.1.smithi089.stdout:1/787: dwrite d0/d9/d15/dce/dd3/fd5 [0,4194304] 0 2024-08-01T06:56:04.678 INFO:tasks.workunit.client.1.smithi089.stdout:8/806: readlink d5/dc/d12/lc9 0 2024-08-01T06:56:04.680 INFO:tasks.workunit.client.1.smithi089.stdout:1/788: write d0/d9/d15/d3b/d3d/f85 [4203611,75047] 0 2024-08-01T06:56:04.682 INFO:tasks.workunit.client.1.smithi089.stdout:8/807: truncate d5/d15/d5e/fdd 874623 0 2024-08-01T06:56:04.685 INFO:tasks.workunit.client.1.smithi089.stdout:1/789: creat d0/d9/d15/d2d/d4a/ded/f100 x:0 0 0 2024-08-01T06:56:04.688 INFO:tasks.workunit.client.1.smithi089.stdout:1/790: mknod d0/d9/d43/d89/c101 0 2024-08-01T06:56:04.691 INFO:tasks.workunit.client.1.smithi089.stdout:1/791: rename d0/d9/d15/d3b/d95/d49/f8d to d0/d9/d15/d3b/d3d/f102 0 2024-08-01T06:56:04.693 INFO:tasks.workunit.client.1.smithi089.stdout:1/792: mkdir d0/d9/d43/d4b/d92/d103 0 2024-08-01T06:56:04.695 INFO:tasks.workunit.client.1.smithi089.stdout:1/793: read d0/d9/d43/f71 [221645,75429] 0 2024-08-01T06:56:04.699 INFO:tasks.workunit.client.1.smithi089.stdout:8/808: truncate d5/d15/d5a/d73/d87/f9a 1615853 0 2024-08-01T06:56:04.701 INFO:tasks.workunit.client.1.smithi089.stdout:8/809: mkdir d5/dc/d12/d119 0 2024-08-01T06:56:04.702 INFO:tasks.workunit.client.1.smithi089.stdout:1/794: truncate d0/d9/d43/d89/fb6 3452370 0 2024-08-01T06:56:04.704 INFO:tasks.workunit.client.1.smithi089.stdout:8/810: dread d5/dc/d1e/fb5 [0,4194304] 0 2024-08-01T06:56:04.705 INFO:tasks.workunit.client.1.smithi089.stdout:1/795: getdents d0/d9/d15/d2d/d4a 0 2024-08-01T06:56:04.706 INFO:tasks.workunit.client.1.smithi089.stdout:1/796: truncate d0/fc2 90487 0 2024-08-01T06:56:04.708 INFO:tasks.workunit.client.1.smithi089.stdout:8/811: readlink d5/l13 0 2024-08-01T06:56:04.709 INFO:tasks.workunit.client.1.smithi089.stdout:8/812: mkdir d5/d15/d5a/d73/daa/d11a 0 2024-08-01T06:56:04.713 INFO:tasks.workunit.client.1.smithi089.stdout:8/813: mkdir d5/d15/d5a/d73/d87/dbf/d110/d11b 0 2024-08-01T06:56:04.713 INFO:tasks.workunit.client.1.smithi089.stdout:1/797: dwrite d0/f23 [0,4194304] 0 2024-08-01T06:56:04.716 INFO:tasks.workunit.client.1.smithi089.stdout:8/814: mknod d5/da6/c11c 0 2024-08-01T06:56:04.716 INFO:tasks.workunit.client.1.smithi089.stdout:1/798: write d0/d9/d15/dce/dd3/fe8 [3911983,78634] 0 2024-08-01T06:56:04.717 INFO:tasks.workunit.client.1.smithi089.stdout:1/799: chown d0/d9/d15/d7a/cf3 649403521 1 2024-08-01T06:56:04.719 INFO:tasks.workunit.client.1.smithi089.stdout:1/800: chown d0/d9/d15/d76/fd4 14364613 1 2024-08-01T06:56:04.721 INFO:tasks.workunit.client.1.smithi089.stdout:1/801: mkdir d0/d9/d15/d2d/d4a/d104 0 2024-08-01T06:56:04.722 INFO:tasks.workunit.client.1.smithi089.stdout:8/815: link d5/dc/d12/db9/lf7 d5/d15/d5a/d73/daa/d11a/l11d 0 2024-08-01T06:56:04.725 INFO:tasks.workunit.client.1.smithi089.stdout:1/802: link d0/d9/d43/d4b/db0/fbd d0/d9/d15/d3b/d95/d49/d82/da6/f105 0 2024-08-01T06:56:04.728 INFO:tasks.workunit.client.1.smithi089.stdout:8/816: dread d5/dc/f16 [4194304,4194304] 0 2024-08-01T06:56:04.729 INFO:tasks.workunit.client.1.smithi089.stdout:8/817: chown d5/dc/cc1 6407489 1 2024-08-01T06:56:04.730 INFO:tasks.workunit.client.1.smithi089.stdout:8/818: chown d5/d15/d5a/d73/d87/fb6 7404427 1 2024-08-01T06:56:04.731 INFO:tasks.workunit.client.1.smithi089.stdout:1/803: chown d0/d9/d15/d2d/d4a/l9c 115 1 2024-08-01T06:56:04.732 INFO:tasks.workunit.client.1.smithi089.stdout:8/819: mkdir d5/dc/d94/dc7/dba/df5/d11e 0 2024-08-01T06:56:04.733 INFO:tasks.workunit.client.1.smithi089.stdout:8/820: chown d5/dc/d12/d112 7962 1 2024-08-01T06:56:04.734 INFO:tasks.workunit.client.1.smithi089.stdout:1/804: rename d0/d9/d43/d78 to d0/d9/d15/d7a/d106 0 2024-08-01T06:56:04.734 INFO:tasks.workunit.client.1.smithi089.stdout:8/821: mknod d5/d15/d5e/c11f 0 2024-08-01T06:56:04.735 INFO:tasks.workunit.client.1.smithi089.stdout:8/822: chown d5/dc/d12/f64 15 1 2024-08-01T06:56:04.737 INFO:tasks.workunit.client.1.smithi089.stdout:8/823: write d5/d15/d5e/fe4 [644111,59450] 0 2024-08-01T06:56:04.739 INFO:tasks.workunit.client.1.smithi089.stdout:1/805: link d0/d9/d54/fa0 d0/d9/d15/d3b/d3d/db5/df6/f107 0 2024-08-01T06:56:04.740 INFO:tasks.workunit.client.1.smithi089.stdout:8/824: mkdir d5/dc/d94/dc7/d120 0 2024-08-01T06:56:04.740 INFO:tasks.workunit.client.1.smithi089.stdout:1/806: dread - d0/d9/fad zero size 2024-08-01T06:56:04.741 INFO:tasks.workunit.client.1.smithi089.stdout:1/807: chown d0/d9/d15/d2b/l7c 3294730 1 2024-08-01T06:56:04.742 INFO:tasks.workunit.client.1.smithi089.stdout:1/808: dread - d0/d9/d15/d76/fd4 zero size 2024-08-01T06:56:04.746 INFO:tasks.workunit.client.1.smithi089.stdout:8/825: dwrite d5/dc/d12/db9/fd1 [0,4194304] 0 2024-08-01T06:56:04.749 INFO:tasks.workunit.client.1.smithi089.stdout:1/809: rmdir d0/d9/d15/d3b/d3d/db5 39 2024-08-01T06:56:04.754 INFO:tasks.workunit.client.1.smithi089.stdout:8/826: truncate d5/dc/f16 2936271 0 2024-08-01T06:56:04.756 INFO:tasks.workunit.client.1.smithi089.stdout:8/827: creat d5/dc/d12/d119/f121 x:0 0 0 2024-08-01T06:56:04.757 INFO:tasks.workunit.client.1.smithi089.stdout:8/828: fdatasync d5/d23/d91/f99 0 2024-08-01T06:56:04.758 INFO:tasks.workunit.client.1.smithi089.stdout:8/829: readlink d5/d15/d5a/d73/d87/la7 0 2024-08-01T06:56:04.766 INFO:tasks.workunit.client.1.smithi089.stdout:1/810: dread d0/d9/d15/d2d/d4a/f55 [0,4194304] 0 2024-08-01T06:56:04.767 INFO:tasks.workunit.client.1.smithi089.stdout:1/811: symlink d0/d9/d15/d2d/l108 0 2024-08-01T06:56:04.768 INFO:tasks.workunit.client.1.smithi089.stdout:1/812: dread - d0/d9/d15/d3b/d95/d49/fc8 zero size 2024-08-01T06:56:04.770 INFO:tasks.workunit.client.1.smithi089.stdout:1/813: creat d0/d9/d15/d7a/d106/f109 x:0 0 0 2024-08-01T06:56:04.773 INFO:tasks.workunit.client.1.smithi089.stdout:1/814: rename d0/d9/d15/d3b/d3d/l66 to d0/d9/d15/d3b/d95/d49/l10a 0 2024-08-01T06:56:04.776 INFO:tasks.workunit.client.1.smithi089.stdout:8/830: dread d5/dc/d94/f55 [0,4194304] 0 2024-08-01T06:56:04.779 INFO:tasks.workunit.client.1.smithi089.stdout:1/815: dwrite d0/d9/d15/d3b/d3d/f85 [0,4194304] 0 2024-08-01T06:56:04.784 INFO:tasks.workunit.client.1.smithi089.stdout:8/831: dwrite d5/d15/d5a/f98 [0,4194304] 0 2024-08-01T06:56:04.790 INFO:tasks.workunit.client.1.smithi089.stdout:8/832: mknod d5/dc/d1e/d53/c122 0 2024-08-01T06:56:04.791 INFO:tasks.workunit.client.1.smithi089.stdout:8/833: creat d5/dc/d94/dc7/dba/df5/d11e/f123 x:0 0 0 2024-08-01T06:56:04.795 INFO:tasks.workunit.client.1.smithi089.stdout:1/816: dwrite d0/d9/d15/d3b/f3c [0,4194304] 0 2024-08-01T06:56:04.799 INFO:tasks.workunit.client.1.smithi089.stdout:8/834: dwrite d5/d15/f44 [4194304,4194304] 0 2024-08-01T06:56:04.804 INFO:tasks.workunit.client.1.smithi089.stdout:8/835: mkdir d5/dc/d94/d84/d124 0 2024-08-01T06:56:04.807 INFO:tasks.workunit.client.1.smithi089.stdout:1/817: dread d0/d9/d43/f71 [0,4194304] 0 2024-08-01T06:56:04.808 INFO:tasks.workunit.client.1.smithi089.stdout:8/836: link d5/dc/d94/d84/f10c d5/d15/d5a/d73/f125 0 2024-08-01T06:56:04.809 INFO:tasks.workunit.client.1.smithi089.stdout:8/837: chown d5/d15/d5e/fdd 1 1 2024-08-01T06:56:04.811 INFO:tasks.workunit.client.1.smithi089.stdout:8/838: write d5/dc/d1e/f47 [3033510,97625] 0 2024-08-01T06:56:04.813 INFO:tasks.workunit.client.1.smithi089.stdout:8/839: readlink d5/dc/leb 0 2024-08-01T06:56:04.814 INFO:tasks.workunit.client.1.smithi089.stdout:1/818: dwrite d0/d9/d15/d2d/f53 [0,4194304] 0 2024-08-01T06:56:04.815 INFO:tasks.workunit.client.1.smithi089.stdout:8/840: mkdir d5/dc/d12/d119/d126 0 2024-08-01T06:56:04.818 INFO:tasks.workunit.client.1.smithi089.stdout:8/841: stat d5/dc/d94/c54 0 2024-08-01T06:56:04.819 INFO:tasks.workunit.client.1.smithi089.stdout:1/819: dread d0/d9/d15/dce/dd3/fd5 [0,4194304] 0 2024-08-01T06:56:04.822 INFO:tasks.workunit.client.1.smithi089.stdout:8/842: rename d5/c7d to d5/dc/de9/c127 0 2024-08-01T06:56:04.827 INFO:tasks.workunit.client.1.smithi089.stdout:8/843: getdents d5/d15/d5a/dfa 0 2024-08-01T06:56:04.828 INFO:tasks.workunit.client.1.smithi089.stdout:8/844: fdatasync d5/d15/d5a/fb4 0 2024-08-01T06:56:04.829 INFO:tasks.workunit.client.1.smithi089.stdout:8/845: write d5/dc/d12/db9/fd1 [2633131,102783] 0 2024-08-01T06:56:04.835 INFO:tasks.workunit.client.1.smithi089.stdout:8/846: dwrite d5/d23/d91/f78 [0,4194304] 0 2024-08-01T06:56:04.839 INFO:tasks.workunit.client.1.smithi089.stdout:8/847: mknod d5/dc/d1e/c128 0 2024-08-01T06:56:04.843 INFO:tasks.workunit.client.1.smithi089.stdout:1/820: dwrite d0/d9/d15/d2d/d4a/f47 [0,4194304] 0 2024-08-01T06:56:04.845 INFO:tasks.workunit.client.1.smithi089.stdout:8/848: dread d5/dc/dca/fe6 [0,4194304] 0 2024-08-01T06:56:04.849 INFO:tasks.workunit.client.1.smithi089.stdout:8/849: unlink d5/dc/d94/c54 0 2024-08-01T06:56:04.850 INFO:tasks.workunit.client.1.smithi089.stdout:1/821: creat d0/d9/d15/d2d/d4a/d104/f10b x:0 0 0 2024-08-01T06:56:04.852 INFO:tasks.workunit.client.1.smithi089.stdout:8/850: creat d5/d15/d5a/d73/d87/dbf/f129 x:0 0 0 2024-08-01T06:56:04.853 INFO:tasks.workunit.client.1.smithi089.stdout:1/822: creat d0/d9/d15/d76/f10c x:0 0 0 2024-08-01T06:56:04.857 INFO:tasks.workunit.client.1.smithi089.stdout:1/823: creat d0/d9/d15/f10d x:0 0 0 2024-08-01T06:56:04.861 INFO:tasks.workunit.client.1.smithi089.stdout:1/824: getdents d0/d9/d43/d4b/d92 0 2024-08-01T06:56:04.863 INFO:tasks.workunit.client.1.smithi089.stdout:1/825: creat d0/d9/d15/dce/f10e x:0 0 0 2024-08-01T06:56:04.869 INFO:tasks.workunit.client.1.smithi089.stdout:8/851: write d5/dc/d94/dc7/dba/ffc [505877,42018] 0 2024-08-01T06:56:04.870 INFO:tasks.workunit.client.1.smithi089.stdout:1/826: dwrite d0/d9/d15/d2d/d4a/f5e [4194304,4194304] 0 2024-08-01T06:56:04.872 INFO:tasks.workunit.client.1.smithi089.stdout:8/852: unlink d5/dc/d1e/fd6 0 2024-08-01T06:56:04.873 INFO:tasks.workunit.client.1.smithi089.stdout:8/853: creat d5/da6/f12a x:0 0 0 2024-08-01T06:56:04.874 INFO:tasks.workunit.client.1.smithi089.stdout:1/827: creat d0/dd9/def/f10f x:0 0 0 2024-08-01T06:56:04.876 INFO:tasks.workunit.client.1.smithi089.stdout:8/854: write d5/dc/d12/db9/fd1 [4852592,14426] 0 2024-08-01T06:56:04.879 INFO:tasks.workunit.client.1.smithi089.stdout:1/828: link d0/dd9/def/f10f d0/dd9/f110 0 2024-08-01T06:56:04.880 INFO:tasks.workunit.client.1.smithi089.stdout:1/829: fdatasync d0/d9/d15/d3b/d3d/fc0 0 2024-08-01T06:56:04.882 INFO:tasks.workunit.client.1.smithi089.stdout:0/804: sync 2024-08-01T06:56:04.882 INFO:tasks.workunit.client.1.smithi089.stdout:5/769: sync 2024-08-01T06:56:04.882 INFO:tasks.workunit.client.1.smithi089.stdout:6/827: sync 2024-08-01T06:56:04.883 INFO:tasks.workunit.client.1.smithi089.stdout:1/830: mkdir d0/d9/d15/d2b/d7d/d111 0 2024-08-01T06:56:04.884 INFO:tasks.workunit.client.1.smithi089.stdout:8/855: dwrite d5/d15/d5a/d73/d87/dbf/f129 [0,4194304] 0 2024-08-01T06:56:04.884 INFO:tasks.workunit.client.1.smithi089.stdout:5/770: chown d5/ccb 128 1 2024-08-01T06:56:04.885 INFO:tasks.workunit.client.1.smithi089.stdout:6/828: read - d2/d11/d1f/d46/f105 zero size 2024-08-01T06:56:04.887 INFO:tasks.workunit.client.1.smithi089.stdout:0/805: chown d9/d40/d25/d46/d91/d2e/d44/d53/d9f/c93 14 1 2024-08-01T06:56:04.888 INFO:tasks.workunit.client.1.smithi089.stdout:5/771: creat d5/d13/d43/dc5/ffa x:0 0 0 2024-08-01T06:56:04.888 INFO:tasks.workunit.client.1.smithi089.stdout:6/829: mknod d2/d11/c113 0 2024-08-01T06:56:04.891 INFO:tasks.workunit.client.1.smithi089.stdout:0/806: mkdir d9/d40/d25/d46/d91/d2e/dfc 0 2024-08-01T06:56:04.892 INFO:tasks.workunit.client.1.smithi089.stdout:8/856: dread d5/d15/d5a/d73/fe2 [0,4194304] 0 2024-08-01T06:56:04.893 INFO:tasks.workunit.client.1.smithi089.stdout:6/830: creat d2/d11/d1a/d1c/dea/f114 x:0 0 0 2024-08-01T06:56:04.896 INFO:tasks.workunit.client.1.smithi089.stdout:1/831: dwrite d0/d9/d15/d3b/d95/d49/f65 [4194304,4194304] 0 2024-08-01T06:56:04.897 INFO:tasks.workunit.client.1.smithi089.stdout:8/857: chown d5/dc/d94/d84/l86 55713 1 2024-08-01T06:56:04.898 INFO:tasks.workunit.client.1.smithi089.stdout:6/831: symlink d2/d11/d1f/dbd/dc5/l115 0 2024-08-01T06:56:04.900 INFO:tasks.workunit.client.1.smithi089.stdout:5/772: dwrite d5/d13/f84 [0,4194304] 0 2024-08-01T06:56:04.901 INFO:tasks.workunit.client.1.smithi089.stdout:0/807: rename d9/d40/d25/d46/d91/d2e/d3a/f8e to d9/d40/d25/d46/ffd 0 2024-08-01T06:56:04.902 INFO:tasks.workunit.client.1.smithi089.stdout:1/832: creat d0/d9/d15/d2d/d4a/d104/f112 x:0 0 0 2024-08-01T06:56:04.905 INFO:tasks.workunit.client.1.smithi089.stdout:1/833: write d0/d9/d15/d2b/d7d/fb1 [57009,18116] 0 2024-08-01T06:56:04.906 INFO:tasks.workunit.client.1.smithi089.stdout:8/858: rename d5/d15/d5e/f74 to d5/d15/d5a/d73/daa/f12b 0 2024-08-01T06:56:04.906 INFO:tasks.workunit.client.1.smithi089.stdout:5/773: rmdir d5/de/d10/d16/d1b 39 2024-08-01T06:56:04.909 INFO:tasks.workunit.client.1.smithi089.stdout:8/859: read - d5/dc/d1e/d53/fea zero size 2024-08-01T06:56:04.910 INFO:tasks.workunit.client.1.smithi089.stdout:3/610: sync 2024-08-01T06:56:04.911 INFO:tasks.workunit.client.1.smithi089.stdout:6/832: dwrite d2/ff [4194304,4194304] 0 2024-08-01T06:56:04.911 INFO:tasks.workunit.client.1.smithi089.stdout:0/808: truncate d9/d40/d25/d46/d91/d2e/d44/d72/d8b/fe6 825485 0 2024-08-01T06:56:04.913 INFO:tasks.workunit.client.1.smithi089.stdout:8/860: read d5/d23/dd3/f107 [553946,68797] 0 2024-08-01T06:56:04.918 INFO:tasks.workunit.client.1.smithi089.stdout:0/809: rename d9/d40/d25/d46/d91/d2e/d3a/d76/f8d to d9/d40/d45/d47/ffe 0 2024-08-01T06:56:04.920 INFO:tasks.workunit.client.1.smithi089.stdout:8/861: creat d5/d15/d5a/dfa/f12c x:0 0 0 2024-08-01T06:56:04.920 INFO:tasks.workunit.client.1.smithi089.stdout:5/774: truncate d5/de/d57/d8e/d97/da5/dde/de9/fb2 1137355 0 2024-08-01T06:56:04.921 INFO:tasks.workunit.client.1.smithi089.stdout:1/834: dwrite d0/d9/d15/d2d/d4a/f55 [0,4194304] 0 2024-08-01T06:56:04.924 INFO:tasks.workunit.client.1.smithi089.stdout:1/835: chown d0/d9/d15/d3b/d95/d49/d82/f93 401727104 1 2024-08-01T06:56:04.924 INFO:tasks.workunit.client.1.smithi089.stdout:5/775: dread - d5/de/fb4 zero size 2024-08-01T06:56:04.925 INFO:tasks.workunit.client.1.smithi089.stdout:8/862: mknod d5/dc/d12/d119/c12d 0 2024-08-01T06:56:04.928 INFO:tasks.workunit.client.1.smithi089.stdout:8/863: write d5/dc/f97 [1061951,109322] 0 2024-08-01T06:56:04.934 INFO:tasks.workunit.client.1.smithi089.stdout:5/776: dread d5/de/f80 [0,4194304] 0 2024-08-01T06:56:04.937 INFO:tasks.workunit.client.1.smithi089.stdout:6/833: dread d2/d11/d1a/fa2 [0,4194304] 0 2024-08-01T06:56:04.938 INFO:tasks.workunit.client.1.smithi089.stdout:5/777: creat d5/de/d10/d33/d5e/d7e/d9e/db1/ffb x:0 0 0 2024-08-01T06:56:04.942 INFO:tasks.workunit.client.1.smithi089.stdout:6/834: chown d2/d2e/c89 11 1 2024-08-01T06:56:04.944 INFO:tasks.workunit.client.1.smithi089.stdout:1/836: write d0/d9/d15/d3b/d95/fa1 [256830,99089] 0 2024-08-01T06:56:04.946 INFO:tasks.workunit.client.1.smithi089.stdout:6/835: unlink d2/d11/d1f/d46/d6b/d7d/fc1 0 2024-08-01T06:56:04.948 INFO:tasks.workunit.client.1.smithi089.stdout:5/778: dwrite f0 [0,4194304] 0 2024-08-01T06:56:04.950 INFO:tasks.workunit.client.1.smithi089.stdout:1/837: unlink d0/d9/d15/d2b/l7c 0 2024-08-01T06:56:04.954 INFO:tasks.workunit.client.1.smithi089.stdout:8/864: dwrite d5/f3d [0,4194304] 0 2024-08-01T06:56:04.957 INFO:tasks.workunit.client.1.smithi089.stdout:8/865: read - d5/d15/d5a/dfa/f12c zero size 2024-08-01T06:56:04.959 INFO:tasks.workunit.client.1.smithi089.stdout:1/838: mkdir d0/d9/d15/d76/d113 0 2024-08-01T06:56:04.962 INFO:tasks.workunit.client.1.smithi089.stdout:0/810: dread d9/d40/d25/d46/d91/d2e/d44/d53/d9f/fb1 [4194304,4194304] 0 2024-08-01T06:56:04.962 INFO:tasks.workunit.client.1.smithi089.stdout:6/836: dwrite d2/d2e/dc2/f108 [0,4194304] 0 2024-08-01T06:56:04.963 INFO:tasks.workunit.client.1.smithi089.stdout:8/866: rmdir d5/dc 39 2024-08-01T06:56:04.965 INFO:tasks.workunit.client.1.smithi089.stdout:1/839: chown d0/d9/d15/ca2 242027 1 2024-08-01T06:56:04.966 INFO:tasks.workunit.client.1.smithi089.stdout:5/779: creat d5/de/d10/d16/d1b/d25/ffc x:0 0 0 2024-08-01T06:56:04.970 INFO:tasks.workunit.client.1.smithi089.stdout:1/840: truncate d0/d9/d15/dce/dd3/fe5 354109 0 2024-08-01T06:56:04.970 INFO:tasks.workunit.client.1.smithi089.stdout:6/837: write d2/d2e/d2f/d9e/fc7 [1416272,95066] 0 2024-08-01T06:56:04.970 INFO:tasks.workunit.client.1.smithi089.stdout:5/780: symlink d5/de/d10/d33/d5e/d7e/d9e/lfd 0 2024-08-01T06:56:04.971 INFO:tasks.workunit.client.1.smithi089.stdout:5/781: fsync d5/de/d10/d16/fd7 0 2024-08-01T06:56:04.972 INFO:tasks.workunit.client.1.smithi089.stdout:6/838: mknod d2/d11/c116 0 2024-08-01T06:56:04.974 INFO:tasks.workunit.client.1.smithi089.stdout:6/839: mkdir d2/d11/d1f/dbd/dc5/d117 0 2024-08-01T06:56:04.975 INFO:tasks.workunit.client.1.smithi089.stdout:6/840: dread - d2/d2e/dc2/fcd zero size 2024-08-01T06:56:04.977 INFO:tasks.workunit.client.1.smithi089.stdout:5/782: dwrite d5/de/d57/d8e/d97/da5/fc9 [0,4194304] 0 2024-08-01T06:56:04.979 INFO:tasks.workunit.client.1.smithi089.stdout:5/783: truncate d5/d13/f30 4301086 0 2024-08-01T06:56:04.981 INFO:tasks.workunit.client.1.smithi089.stdout:5/784: readlink d5/de/df/d9f/dbd/df0/d5d/d6c/d98/lce 0 2024-08-01T06:56:04.989 INFO:tasks.workunit.client.1.smithi089.stdout:8/867: write d5/dc/d12/f40 [754361,9572] 0 2024-08-01T06:56:04.989 INFO:tasks.workunit.client.1.smithi089.stdout:0/811: write d9/d40/d25/d46/d91/d2e/d44/d72/ff9 [2821978,25259] 0 2024-08-01T06:56:04.989 INFO:tasks.workunit.client.1.smithi089.stdout:5/785: fsync d5/de/d10/d16/d1b/d25/fda 0 2024-08-01T06:56:04.994 INFO:tasks.workunit.client.1.smithi089.stdout:0/812: fsync d9/dee/ff7 0 2024-08-01T06:56:04.994 INFO:tasks.workunit.client.1.smithi089.stdout:6/841: write d2/d11/d1f/d46/f62 [1969801,52884] 0 2024-08-01T06:56:04.995 INFO:tasks.workunit.client.1.smithi089.stdout:8/868: rmdir d5/dc/d94/d84 39 2024-08-01T06:56:04.995 INFO:tasks.workunit.client.1.smithi089.stdout:6/842: mknod d2/d11/d3e/c118 0 2024-08-01T06:56:04.995 INFO:tasks.workunit.client.1.smithi089.stdout:6/843: write d2/fe1 [800763,129081] 0 2024-08-01T06:56:04.997 INFO:tasks.workunit.client.1.smithi089.stdout:0/813: getdents d9/d40/d25/d46/d91/d2e/d3a 0 2024-08-01T06:56:05.001 INFO:tasks.workunit.client.1.smithi089.stdout:6/844: creat d2/d11/d1f/d46/dce/f119 x:0 0 0 2024-08-01T06:56:05.002 INFO:tasks.workunit.client.1.smithi089.stdout:5/786: dwrite d5/de/df/fb6 [0,4194304] 0 2024-08-01T06:56:05.002 INFO:tasks.workunit.client.1.smithi089.stdout:0/814: creat d9/d40/d45/db7/fff x:0 0 0 2024-08-01T06:56:05.006 INFO:tasks.workunit.client.1.smithi089.stdout:8/869: dwrite d5/d23/f51 [0,4194304] 0 2024-08-01T06:56:05.006 INFO:tasks.workunit.client.1.smithi089.stdout:5/787: chown d5/de/d10/d33/d5e/fed 12984 1 2024-08-01T06:56:05.008 INFO:tasks.workunit.client.1.smithi089.stdout:6/845: fdatasync d2/d2e/d2f/d31/f41 0 2024-08-01T06:56:05.009 INFO:tasks.workunit.client.1.smithi089.stdout:0/815: unlink d9/d40/d25/d46/d91/d2e/d44/cd0 0 2024-08-01T06:56:05.012 INFO:tasks.workunit.client.1.smithi089.stdout:6/846: write d2/d11/d1a/d1c/dea/f114 [762612,73654] 0 2024-08-01T06:56:05.014 INFO:tasks.workunit.client.1.smithi089.stdout:6/847: write d2/d2e/d2f/f112 [500130,46267] 0 2024-08-01T06:56:05.018 INFO:tasks.workunit.client.1.smithi089.stdout:5/788: dwrite d5/de/d10/d16/d1b/d25/ffc [0,4194304] 0 2024-08-01T06:56:05.026 INFO:tasks.workunit.client.1.smithi089.stdout:6/848: truncate d2/d11/d1a/d1c/fb5 2946417 0 2024-08-01T06:56:05.028 INFO:tasks.workunit.client.1.smithi089.stdout:0/816: truncate d9/d40/d25/d46/d91/d2e/d44/d53/d9f/fb1 6786435 0 2024-08-01T06:56:05.028 INFO:tasks.workunit.client.1.smithi089.stdout:5/789: truncate d5/f3c 3465194 0 2024-08-01T06:56:05.029 INFO:tasks.workunit.client.1.smithi089.stdout:8/870: dwrite d5/dc/d94/d84/ddb/fe7 [0,4194304] 0 2024-08-01T06:56:05.031 INFO:tasks.workunit.client.1.smithi089.stdout:8/871: chown d5/dc/d94/dc7/dc5/dd4/f10b 113771852 1 2024-08-01T06:56:05.031 INFO:tasks.workunit.client.1.smithi089.stdout:5/790: fdatasync d5/de/df/d9f/dbd/df0/d5d/d6c/f81 0 2024-08-01T06:56:05.036 INFO:tasks.workunit.client.1.smithi089.stdout:8/872: mkdir d5/d15/d5a/d12e 0 2024-08-01T06:56:05.037 INFO:tasks.workunit.client.1.smithi089.stdout:5/791: symlink d5/de/df/d9f/dbd/df0/d5d/d6c/d8b/lfe 0 2024-08-01T06:56:05.041 INFO:tasks.workunit.client.1.smithi089.stdout:5/792: read d5/d13/f84 [3197574,5414] 0 2024-08-01T06:56:05.041 INFO:tasks.workunit.client.1.smithi089.stdout:8/873: chown d5/dc/d1e/fed 1270 1 2024-08-01T06:56:05.042 INFO:tasks.workunit.client.1.smithi089.stdout:4/828: sync 2024-08-01T06:56:05.042 INFO:tasks.workunit.client.1.smithi089.stdout:9/706: sync 2024-08-01T06:56:05.043 INFO:tasks.workunit.client.1.smithi089.stdout:7/730: sync 2024-08-01T06:56:05.043 INFO:tasks.workunit.client.1.smithi089.stdout:2/698: sync 2024-08-01T06:56:05.044 INFO:tasks.workunit.client.1.smithi089.stdout:6/849: dwrite d2/d30/d3c/d3d/fc6 [0,4194304] 0 2024-08-01T06:56:05.045 INFO:tasks.workunit.client.1.smithi089.stdout:8/874: fdatasync d5/d23/f48 0 2024-08-01T06:56:05.047 INFO:tasks.workunit.client.1.smithi089.stdout:5/793: unlink d5/d13/f31 0 2024-08-01T06:56:05.048 INFO:tasks.workunit.client.1.smithi089.stdout:9/707: fsync d18/d33/f60 0 2024-08-01T06:56:05.048 INFO:tasks.workunit.client.1.smithi089.stdout:8/875: read d5/f25 [1609579,79635] 0 2024-08-01T06:56:05.051 INFO:tasks.workunit.client.1.smithi089.stdout:2/699: unlink d7/d19/d1e/c5d 0 2024-08-01T06:56:05.056 INFO:tasks.workunit.client.1.smithi089.stdout:6/850: read d2/d11/f1d [3627123,99278] 0 2024-08-01T06:56:05.057 INFO:tasks.workunit.client.1.smithi089.stdout:0/817: dwrite d9/d40/d25/d46/d91/d2e/d44/d53/fa2 [0,4194304] 0 2024-08-01T06:56:05.061 INFO:tasks.workunit.client.1.smithi089.stdout:9/708: chown d18/d22/d39/f7c 6623871 1 2024-08-01T06:56:05.061 INFO:tasks.workunit.client.1.smithi089.stdout:6/851: readlink d2/d2e/d2f/d9e/l101 0 2024-08-01T06:56:05.064 INFO:tasks.workunit.client.1.smithi089.stdout:8/876: creat d5/dc/d94/dc7/dba/f12f x:0 0 0 2024-08-01T06:56:05.068 INFO:tasks.workunit.client.1.smithi089.stdout:7/731: dwrite d7/d1f/d30/dab/fc5 [0,4194304] 0 2024-08-01T06:56:05.070 INFO:tasks.workunit.client.1.smithi089.stdout:9/709: rename d18/d33/d49/d7b to d18/d33/d49/d7b/d7f/d98/de1/ded 22 2024-08-01T06:56:05.071 INFO:tasks.workunit.client.1.smithi089.stdout:0/818: symlink d9/l100 0 2024-08-01T06:56:05.074 INFO:tasks.workunit.client.1.smithi089.stdout:8/877: creat d5/dc/d94/dc7/dba/df5/f130 x:0 0 0 2024-08-01T06:56:05.074 INFO:tasks.workunit.client.1.smithi089.stdout:6/852: getdents d2/d11/d1a/d1c/d40 0 2024-08-01T06:56:05.078 INFO:tasks.workunit.client.1.smithi089.stdout:6/853: fdatasync d2/d11/d1f/d46/fdb 0 2024-08-01T06:56:05.085 INFO:tasks.workunit.client.1.smithi089.stdout:6/854: write d2/d30/fa3 [706346,91369] 0 2024-08-01T06:56:05.086 INFO:tasks.workunit.client.1.smithi089.stdout:2/700: dwrite d7/d1f/f6c [0,4194304] 0 2024-08-01T06:56:05.089 INFO:tasks.workunit.client.1.smithi089.stdout:4/829: dread d3/d17/d3a/d3d/fae [0,4194304] 0 2024-08-01T06:56:05.090 INFO:tasks.workunit.client.1.smithi089.stdout:9/710: truncate d18/f23 3191819 0 2024-08-01T06:56:05.091 INFO:tasks.workunit.client.1.smithi089.stdout:8/878: rename d5/d15/d5a/d73/d87/dbf/f129 to d5/dc/d94/dc7/d120/f131 0 2024-08-01T06:56:05.091 INFO:tasks.workunit.client.1.smithi089.stdout:5/794: dread d5/de/d10/d33/d5e/fed [0,4194304] 0 2024-08-01T06:56:05.093 INFO:tasks.workunit.client.1.smithi089.stdout:2/701: rmdir d7/d19/d1e/d3d/d60 39 2024-08-01T06:56:05.093 INFO:tasks.workunit.client.1.smithi089.stdout:5/795: truncate d5/d13/d43/f4e 5066768 0 2024-08-01T06:56:05.095 INFO:tasks.workunit.client.1.smithi089.stdout:7/732: truncate d7/d1f/f1d 1016623 0 2024-08-01T06:56:05.100 INFO:tasks.workunit.client.1.smithi089.stdout:5/796: unlink d5/de/d10/f2c 0 2024-08-01T06:56:05.103 INFO:tasks.workunit.client.1.smithi089.stdout:4/830: dwrite d3/db/d33/fe6 [0,4194304] 0 2024-08-01T06:56:05.104 INFO:tasks.workunit.client.1.smithi089.stdout:2/702: symlink d7/d1f/d52/d6e/ldc 0 2024-08-01T06:56:05.107 INFO:tasks.workunit.client.1.smithi089.stdout:4/831: chown d3/db/d16/f18 464 1 2024-08-01T06:56:05.108 INFO:tasks.workunit.client.1.smithi089.stdout:7/733: symlink d7/d1f/d30/d4c/dbc/dcd/dd7/lfc 0 2024-08-01T06:56:05.109 INFO:tasks.workunit.client.1.smithi089.stdout:6/855: getdents d2/d2e/d2f 0 2024-08-01T06:56:05.110 INFO:tasks.workunit.client.1.smithi089.stdout:8/879: creat d5/dc/f132 x:0 0 0 2024-08-01T06:56:05.111 INFO:tasks.workunit.client.1.smithi089.stdout:7/734: write d7/df/d91/da4/dca/fda [365314,20449] 0 2024-08-01T06:56:05.112 INFO:tasks.workunit.client.1.smithi089.stdout:4/832: rmdir d3/d86/d9e/db1/dbb/d62/db3 39 2024-08-01T06:56:05.112 INFO:tasks.workunit.client.1.smithi089.stdout:9/711: getdents d18/da4 0 2024-08-01T06:56:05.113 INFO:tasks.workunit.client.1.smithi089.stdout:3/611: sync 2024-08-01T06:56:05.114 INFO:tasks.workunit.client.1.smithi089.stdout:5/797: rmdir d5/de/df/d9f/dbd/df0/d5d/d6c/d8b 39 2024-08-01T06:56:05.117 INFO:tasks.workunit.client.1.smithi089.stdout:0/819: dread d9/d40/d25/d46/d91/d2e/d44/d53/daf/fb6 [0,4194304] 0 2024-08-01T06:56:05.117 INFO:tasks.workunit.client.1.smithi089.stdout:9/712: chown d18/c1e 18 1 2024-08-01T06:56:05.118 INFO:tasks.workunit.client.1.smithi089.stdout:2/703: link d7/d1f/d28/fd9 d7/d19/d1e/fdd 0 2024-08-01T06:56:05.119 INFO:tasks.workunit.client.1.smithi089.stdout:8/880: creat d5/da6/f133 x:0 0 0 2024-08-01T06:56:05.120 INFO:tasks.workunit.client.1.smithi089.stdout:5/798: write d5/d13/d38/fb3 [1008592,85213] 0 2024-08-01T06:56:05.120 INFO:tasks.workunit.client.1.smithi089.stdout:9/713: readlink d18/d22/d39/l63 0 2024-08-01T06:56:05.120 INFO:tasks.workunit.client.1.smithi089.stdout:7/735: mknod d7/df/d91/da4/dca/cfd 0 2024-08-01T06:56:05.121 INFO:tasks.workunit.client.1.smithi089.stdout:4/833: mknod d3/d17/d3a/d4a/dee/cf6 0 2024-08-01T06:56:05.124 INFO:tasks.workunit.client.1.smithi089.stdout:7/736: dread - d7/f93 zero size 2024-08-01T06:56:05.125 INFO:tasks.workunit.client.1.smithi089.stdout:0/820: mknod d9/d40/d45/d47/c101 0 2024-08-01T06:56:05.125 INFO:tasks.workunit.client.1.smithi089.stdout:5/799: creat d5/d13/d83/fff x:0 0 0 2024-08-01T06:56:05.126 INFO:tasks.workunit.client.1.smithi089.stdout:7/737: stat d7/df/d3b/f58 0 2024-08-01T06:56:05.127 INFO:tasks.workunit.client.1.smithi089.stdout:3/612: creat d7/d32/d12/d29/d39/d4b/d83/fc4 x:0 0 0 2024-08-01T06:56:05.129 INFO:tasks.workunit.client.1.smithi089.stdout:9/714: rename d18/d22/d45/f84 to d18/d22/d39/d95/fee 0 2024-08-01T06:56:05.129 INFO:tasks.workunit.client.1.smithi089.stdout:4/834: creat d3/d68/d7e/ff7 x:0 0 0 2024-08-01T06:56:05.129 INFO:tasks.workunit.client.1.smithi089.stdout:2/704: dread d7/d4a/f6d [0,4194304] 0 2024-08-01T06:56:05.129 INFO:tasks.workunit.client.1.smithi089.stdout:0/821: write d9/d40/d25/fd8 [634132,46188] 0 2024-08-01T06:56:05.130 INFO:tasks.workunit.client.1.smithi089.stdout:5/800: mkdir d5/d13/d43/dc5/d100 0 2024-08-01T06:56:05.130 INFO:tasks.workunit.client.1.smithi089.stdout:8/881: creat d5/d15/d5a/d73/daa/d11a/f134 x:0 0 0 2024-08-01T06:56:05.131 INFO:tasks.workunit.client.1.smithi089.stdout:7/738: creat d7/d46/ffe x:0 0 0 2024-08-01T06:56:05.131 INFO:tasks.workunit.client.1.smithi089.stdout:9/715: chown d18/faf 9 1 2024-08-01T06:56:05.134 INFO:tasks.workunit.client.1.smithi089.stdout:5/801: stat d5/de/df/d9f/dbd/ld2 0 2024-08-01T06:56:05.135 INFO:tasks.workunit.client.1.smithi089.stdout:8/882: mknod d5/dc/d12/db9/c135 0 2024-08-01T06:56:05.135 INFO:tasks.workunit.client.1.smithi089.stdout:4/835: write d3/db/de/d5b/db9/fc3 [4922660,58058] 0 2024-08-01T06:56:05.136 INFO:tasks.workunit.client.1.smithi089.stdout:9/716: symlink d18/d22/d45/daa/lef 0 2024-08-01T06:56:05.136 INFO:tasks.workunit.client.1.smithi089.stdout:6/856: dread d2/d2e/d2f/f6d [4194304,4194304] 0 2024-08-01T06:56:05.136 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:04 smithi089 ceph-mon[36617]: pgmap v16: 65 pgs: 65 active+clean; 1.2 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 37 MiB/s rd, 165 MiB/s wr, 391 op/s 2024-08-01T06:56:05.139 INFO:tasks.workunit.client.1.smithi089.stdout:7/739: mkdir d7/d1f/da6/dbb/de7/deb/df3/dff 0 2024-08-01T06:56:05.144 INFO:tasks.workunit.client.1.smithi089.stdout:8/883: fdatasync d5/dc/dca/fe6 0 2024-08-01T06:56:05.144 INFO:tasks.workunit.client.1.smithi089.stdout:1/841: sync 2024-08-01T06:56:05.145 INFO:tasks.workunit.client.1.smithi089.stdout:0/822: truncate d9/d40/d25/d46/d91/d2e/d3a/f97 1186709 0 2024-08-01T06:56:05.145 INFO:tasks.workunit.client.1.smithi089.stdout:9/717: dread d18/d33/f61 [0,4194304] 0 2024-08-01T06:56:05.147 INFO:tasks.workunit.client.1.smithi089.stdout:7/740: mknod d7/d1f/c100 0 2024-08-01T06:56:05.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:04 smithi016 ceph-mon[29266]: pgmap v16: 65 pgs: 65 active+clean; 1.2 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 37 MiB/s rd, 165 MiB/s wr, 391 op/s 2024-08-01T06:56:05.149 INFO:tasks.workunit.client.1.smithi089.stdout:3/613: dread d7/d32/f2d [0,4194304] 0 2024-08-01T06:56:05.150 INFO:tasks.workunit.client.1.smithi089.stdout:5/802: dread d5/d13/d38/f6d [0,4194304] 0 2024-08-01T06:56:05.152 INFO:tasks.workunit.client.1.smithi089.stdout:2/705: dwrite d7/d1f/d52/d6e/fbb [0,4194304] 0 2024-08-01T06:56:05.154 INFO:tasks.workunit.client.1.smithi089.stdout:1/842: chown d0/d9/d15/d2d/f36 51 1 2024-08-01T06:56:05.155 INFO:tasks.workunit.client.1.smithi089.stdout:6/857: link d2/cb2 d2/d11/d1f/d46/d6b/d7d/dc9/df6/c11a 0 2024-08-01T06:56:05.155 INFO:tasks.workunit.client.1.smithi089.stdout:0/823: write d9/d40/d95/d99/dba/ffb [852895,9576] 0 2024-08-01T06:56:05.156 INFO:tasks.workunit.client.1.smithi089.stdout:7/741: symlink d7/d1f/d30/d4c/dbc/l101 0 2024-08-01T06:56:05.157 INFO:tasks.workunit.client.1.smithi089.stdout:3/614: chown d7/d68/d50/d6f/d2f/d9c 66 1 2024-08-01T06:56:05.160 INFO:tasks.workunit.client.1.smithi089.stdout:1/843: stat d0/d9/d15/d2d/f53 0 2024-08-01T06:56:05.164 INFO:tasks.workunit.client.1.smithi089.stdout:0/824: symlink d9/d40/d45/dc1/l102 0 2024-08-01T06:56:05.165 INFO:tasks.workunit.client.1.smithi089.stdout:2/706: chown d7/d19/dc5/dcc/d9e/f87 392 1 2024-08-01T06:56:05.168 INFO:tasks.workunit.client.1.smithi089.stdout:5/803: unlink d5/de/d10/f1c 0 2024-08-01T06:56:05.170 INFO:tasks.workunit.client.1.smithi089.stdout:4/836: dwrite d3/d86/d9e/db1/dbb/d62/db3/fb5 [0,4194304] 0 2024-08-01T06:56:05.170 INFO:tasks.workunit.client.1.smithi089.stdout:1/844: creat d0/de3/f114 x:0 0 0 2024-08-01T06:56:05.171 INFO:tasks.workunit.client.1.smithi089.stdout:9/718: dwrite d18/d22/f48 [0,4194304] 0 2024-08-01T06:56:05.171 INFO:tasks.workunit.client.1.smithi089.stdout:6/858: truncate d2/d11/f65 1292156 0 2024-08-01T06:56:05.176 INFO:tasks.workunit.client.1.smithi089.stdout:8/884: dread d5/dc/fa1 [0,4194304] 0 2024-08-01T06:56:05.180 INFO:tasks.workunit.client.1.smithi089.stdout:6/859: dread d2/d11/d1a/d1c/d40/f48 [0,4194304] 0 2024-08-01T06:56:05.181 INFO:tasks.workunit.client.1.smithi089.stdout:7/742: creat d7/df/d10/db3/de9/f102 x:0 0 0 2024-08-01T06:56:05.183 INFO:tasks.workunit.client.1.smithi089.stdout:7/743: write d7/d1f/d3a/dad/fb2 [742573,62339] 0 2024-08-01T06:56:05.189 INFO:tasks.workunit.client.1.smithi089.stdout:2/707: symlink d7/d1f/d28/lde 0 2024-08-01T06:56:05.191 INFO:tasks.workunit.client.1.smithi089.stdout:2/708: fdatasync d7/d19/f40 0 2024-08-01T06:56:05.192 INFO:tasks.workunit.client.1.smithi089.stdout:5/804: dread d5/d13/d43/f4e [0,4194304] 0 2024-08-01T06:56:05.193 INFO:tasks.workunit.client.1.smithi089.stdout:1/845: mkdir d0/d9/d15/d2b/d7d/d115 0 2024-08-01T06:56:05.194 INFO:tasks.workunit.client.1.smithi089.stdout:2/709: write d7/d19/fdb [46726,109537] 0 2024-08-01T06:56:05.199 INFO:tasks.workunit.client.1.smithi089.stdout:8/885: symlink d5/d15/d5a/d73/d87/dbf/d110/l136 0 2024-08-01T06:56:05.199 INFO:tasks.workunit.client.1.smithi089.stdout:6/860: mkdir d2/d11/d1f/dbd/dc5/d11b 0 2024-08-01T06:56:05.199 INFO:tasks.workunit.client.1.smithi089.stdout:8/886: stat d5/f10 0 2024-08-01T06:56:05.199 INFO:tasks.workunit.client.1.smithi089.stdout:9/719: symlink d18/d22/d39/lf0 0 2024-08-01T06:56:05.200 INFO:tasks.workunit.client.1.smithi089.stdout:7/744: mknod d7/d1f/da6/c103 0 2024-08-01T06:56:05.200 INFO:tasks.workunit.client.1.smithi089.stdout:3/615: dwrite d7/d32/d4c/d69/d6d/f90 [0,4194304] 0 2024-08-01T06:56:05.203 INFO:tasks.workunit.client.1.smithi089.stdout:8/887: dread - d5/dc/d94/d84/f114 zero size 2024-08-01T06:56:05.203 INFO:tasks.workunit.client.1.smithi089.stdout:4/837: creat d3/ff8 x:0 0 0 2024-08-01T06:56:05.207 INFO:tasks.workunit.client.1.smithi089.stdout:2/710: mknod d7/d1f/d52/d72/cdf 0 2024-08-01T06:56:05.209 INFO:tasks.workunit.client.1.smithi089.stdout:0/825: dwrite d9/d40/d25/d46/d91/d2e/d44/d72/d8b/fef [0,4194304] 0 2024-08-01T06:56:05.209 INFO:tasks.workunit.client.1.smithi089.stdout:3/616: write d7/d32/d4c/d69/d6d/f90 [372288,6170] 0 2024-08-01T06:56:05.213 INFO:tasks.workunit.client.1.smithi089.stdout:7/745: rename d7/df/d91/d98 to d7/d1f/d30/d4c/dbc/dcd/d104 0 2024-08-01T06:56:05.217 INFO:tasks.workunit.client.1.smithi089.stdout:9/720: dread d18/d33/f37 [0,4194304] 0 2024-08-01T06:56:05.218 INFO:tasks.workunit.client.1.smithi089.stdout:8/888: dread - d5/dc/d94/dc7/dba/df5/f130 zero size 2024-08-01T06:56:05.219 INFO:tasks.workunit.client.1.smithi089.stdout:2/711: truncate d7/d1f/d28/f51 4954011 0 2024-08-01T06:56:05.221 INFO:tasks.workunit.client.1.smithi089.stdout:4/838: rename d3/d17/d71/l8e to d3/d86/db7/dd1/lf9 0 2024-08-01T06:56:05.223 INFO:tasks.workunit.client.1.smithi089.stdout:3/617: symlink d7/d32/d4c/d53/d5f/lc5 0 2024-08-01T06:56:05.223 INFO:tasks.workunit.client.1.smithi089.stdout:7/746: dread - d7/df/d10/d42/fe2 zero size 2024-08-01T06:56:05.223 INFO:tasks.workunit.client.1.smithi089.stdout:8/889: fsync d5/d23/dd3/fdf 0 2024-08-01T06:56:05.224 INFO:tasks.workunit.client.1.smithi089.stdout:6/861: dwrite d2/d2e/d7c/f95 [0,4194304] 0 2024-08-01T06:56:05.225 INFO:tasks.workunit.client.1.smithi089.stdout:0/826: dread d9/d40/d45/d47/da8/fb3 [0,4194304] 0 2024-08-01T06:56:05.227 INFO:tasks.workunit.client.1.smithi089.stdout:3/618: write d7/f1f [428737,107194] 0 2024-08-01T06:56:05.231 INFO:tasks.workunit.client.1.smithi089.stdout:8/890: chown d5/dc/d1e/l75 20242 1 2024-08-01T06:56:05.233 INFO:tasks.workunit.client.1.smithi089.stdout:2/712: dread d7/d1f/d52/d6e/f9d [0,4194304] 0 2024-08-01T06:56:05.234 INFO:tasks.workunit.client.1.smithi089.stdout:0/827: read d9/d40/d25/d46/d91/d2e/d44/d72/fda [353173,85559] 0 2024-08-01T06:56:05.235 INFO:tasks.workunit.client.1.smithi089.stdout:6/862: fsync d2/d30/d3c/fd7 0 2024-08-01T06:56:05.235 INFO:tasks.workunit.client.1.smithi089.stdout:3/619: creat d7/d68/d50/d54/da5/fc6 x:0 0 0 2024-08-01T06:56:05.305 INFO:tasks.workunit.client.1.smithi089.stdout:7/747: creat d7/df/d10/d31/dfb/f105 x:0 0 0 2024-08-01T06:56:05.305 INFO:tasks.workunit.client.1.smithi089.stdout:0/828: readlink d9/d40/d25/la7 0 2024-08-01T06:56:05.308 INFO:tasks.workunit.client.1.smithi089.stdout:6/863: stat d2/d11/d1f/dbd/dc5/lda 0 2024-08-01T06:56:05.309 INFO:tasks.workunit.client.1.smithi089.stdout:7/748: write d7/f93 [138262,19769] 0 2024-08-01T06:56:05.310 INFO:tasks.workunit.client.1.smithi089.stdout:8/891: getdents d5/dc/d94/dc7 0 2024-08-01T06:56:05.311 INFO:tasks.workunit.client.1.smithi089.stdout:3/620: write d7/d32/d4c/d69/f1a [2106268,59992] 0 2024-08-01T06:56:05.311 INFO:tasks.workunit.client.1.smithi089.stdout:2/713: write d7/d19/d1e/f54 [2893416,130120] 0 2024-08-01T06:56:05.311 INFO:tasks.workunit.client.1.smithi089.stdout:5/805: dread d5/de/d10/d16/d1b/d25/f68 [0,4194304] 0 2024-08-01T06:56:05.315 INFO:tasks.workunit.client.1.smithi089.stdout:6/864: stat d2/d2e/d2f/d31 0 2024-08-01T06:56:05.317 INFO:tasks.workunit.client.1.smithi089.stdout:3/621: chown d7/d68/d50/d54/lc1 307378 1 2024-08-01T06:56:05.317 INFO:tasks.workunit.client.1.smithi089.stdout:4/839: dwrite d3/d1e/f25 [0,4194304] 0 2024-08-01T06:56:05.317 INFO:tasks.workunit.client.1.smithi089.stdout:8/892: write d5/d15/ff4 [208904,108458] 0 2024-08-01T06:56:05.318 INFO:tasks.workunit.client.1.smithi089.stdout:2/714: fsync d7/d1f/d52/d6e/fbb 0 2024-08-01T06:56:05.320 INFO:tasks.workunit.client.1.smithi089.stdout:4/840: chown d3/d17/d3a/d4a/dee/cf6 95663373 1 2024-08-01T06:56:05.320 INFO:tasks.workunit.client.1.smithi089.stdout:2/715: chown d7/d1f/d52/d6e/fbb 20117637 1 2024-08-01T06:56:05.322 INFO:tasks.workunit.client.1.smithi089.stdout:5/806: getdents d5/de/d57/ddf 0 2024-08-01T06:56:05.322 INFO:tasks.workunit.client.1.smithi089.stdout:8/893: fsync d5/dc/d1e/f95 0 2024-08-01T06:56:05.324 INFO:tasks.workunit.client.1.smithi089.stdout:8/894: chown d5/d15/d5e 0 1 2024-08-01T06:56:05.325 INFO:tasks.workunit.client.1.smithi089.stdout:6/865: symlink d2/d2e/d2f/d91/l11c 0 2024-08-01T06:56:05.325 INFO:tasks.workunit.client.1.smithi089.stdout:2/716: unlink d7/d1f/d28/c39 0 2024-08-01T06:56:05.327 INFO:tasks.workunit.client.1.smithi089.stdout:5/807: truncate d5/de/d10/d16/d1b/f39 8675166 0 2024-08-01T06:56:05.327 INFO:tasks.workunit.client.1.smithi089.stdout:6/866: creat d2/d2e/d7c/f11d x:0 0 0 2024-08-01T06:56:05.328 INFO:tasks.workunit.client.1.smithi089.stdout:7/749: getdents d7/d1f/d30/db1 0 2024-08-01T06:56:05.328 INFO:tasks.workunit.client.1.smithi089.stdout:8/895: creat d5/da6/f137 x:0 0 0 2024-08-01T06:56:05.329 INFO:tasks.workunit.client.1.smithi089.stdout:0/829: dread d9/d40/d25/d46/d91/d2e/f81 [0,4194304] 0 2024-08-01T06:56:05.331 INFO:tasks.workunit.client.1.smithi089.stdout:5/808: rmdir d5 39 2024-08-01T06:56:05.331 INFO:tasks.workunit.client.1.smithi089.stdout:0/830: read - d9/d40/d25/d46/d91/d2e/d3a/d76/fcf zero size 2024-08-01T06:56:05.332 INFO:tasks.workunit.client.1.smithi089.stdout:2/717: dread d7/d19/d1e/d5b/f69 [0,4194304] 0 2024-08-01T06:56:05.334 INFO:tasks.workunit.client.1.smithi089.stdout:0/831: dread - d9/d40/d25/d46/d91/d2e/d44/d53/daf/ff2 zero size 2024-08-01T06:56:05.334 INFO:tasks.workunit.client.1.smithi089.stdout:7/750: creat d7/d1f/d30/db1/f106 x:0 0 0 2024-08-01T06:56:05.335 INFO:tasks.workunit.client.1.smithi089.stdout:6/867: mknod d2/d2e/dc2/c11e 0 2024-08-01T06:56:05.336 INFO:tasks.workunit.client.1.smithi089.stdout:7/751: write d7/df/d91/da4/dca/ffa [2034944,96003] 0 2024-08-01T06:56:05.336 INFO:tasks.workunit.client.1.smithi089.stdout:0/832: dread - d9/d40/d25/d46/d91/d2e/d44/d72/d8b/fd1 zero size 2024-08-01T06:56:05.337 INFO:tasks.workunit.client.1.smithi089.stdout:0/833: readlink d9/d40/l6d 0 2024-08-01T06:56:05.337 INFO:tasks.workunit.client.1.smithi089.stdout:8/896: creat d5/dc/d12/d119/f138 x:0 0 0 2024-08-01T06:56:05.338 INFO:tasks.workunit.client.1.smithi089.stdout:6/868: chown d2/d30/d3c/fd7 1074 1 2024-08-01T06:56:05.339 INFO:tasks.workunit.client.1.smithi089.stdout:2/718: symlink d7/d4a/le0 0 2024-08-01T06:56:05.343 INFO:tasks.workunit.client.1.smithi089.stdout:0/834: mknod d9/d40/d25/d46/d91/d2e/d44/d53/c103 0 2024-08-01T06:56:05.344 INFO:tasks.workunit.client.1.smithi089.stdout:7/752: truncate d7/df/d91/da4/f47 694251 0 2024-08-01T06:56:05.345 INFO:tasks.workunit.client.1.smithi089.stdout:7/753: chown d7 57 1 2024-08-01T06:56:05.345 INFO:tasks.workunit.client.1.smithi089.stdout:2/719: mknod d7/d19/d1e/d3d/ce1 0 2024-08-01T06:56:05.346 INFO:tasks.workunit.client.1.smithi089.stdout:0/835: rmdir d9/d40/d95/d99/d2b/d55 39 2024-08-01T06:56:05.347 INFO:tasks.workunit.client.1.smithi089.stdout:6/869: write d2/d11/d3e/f60 [1484087,29662] 0 2024-08-01T06:56:05.348 INFO:tasks.workunit.client.1.smithi089.stdout:7/754: fdatasync d7/df/d91/da4/f5f 0 2024-08-01T06:56:05.350 INFO:tasks.workunit.client.1.smithi089.stdout:2/720: mkdir d7/d1f/d29/d48/da9/de2 0 2024-08-01T06:56:05.351 INFO:tasks.workunit.client.1.smithi089.stdout:6/870: fsync d2/d11/d1f/fed 0 2024-08-01T06:56:05.352 INFO:tasks.workunit.client.1.smithi089.stdout:5/809: dwrite d5/de/d10/d16/d1b/d25/f62 [0,4194304] 0 2024-08-01T06:56:05.355 INFO:tasks.workunit.client.1.smithi089.stdout:6/871: write d2/d30/d3c/d3d/fc6 [4262793,54709] 0 2024-08-01T06:56:05.356 INFO:tasks.workunit.client.1.smithi089.stdout:0/836: mkdir d9/d40/d25/d46/d91/d2e/d44/d72/d104 0 2024-08-01T06:56:05.356 INFO:tasks.workunit.client.1.smithi089.stdout:6/872: fsync d2/d30/fa1 0 2024-08-01T06:56:05.356 INFO:tasks.workunit.client.1.smithi089.stdout:6/873: chown d2/d30/d3c 0 1 2024-08-01T06:56:05.358 INFO:tasks.workunit.client.1.smithi089.stdout:5/810: read d5/f3c [519062,30067] 0 2024-08-01T06:56:05.359 INFO:tasks.workunit.client.1.smithi089.stdout:2/721: unlink d7/d1f/d52/d72/dc0/lc8 0 2024-08-01T06:56:05.361 INFO:tasks.workunit.client.1.smithi089.stdout:0/837: mknod d9/d40/d25/d46/d91/d2e/d44/d53/d9f/c105 0 2024-08-01T06:56:05.364 INFO:tasks.workunit.client.1.smithi089.stdout:5/811: stat d5/de/d10/d33/d5e/fed 0 2024-08-01T06:56:05.367 INFO:tasks.workunit.client.1.smithi089.stdout:7/755: dread d7/d15/f25 [0,4194304] 0 2024-08-01T06:56:05.369 INFO:tasks.workunit.client.1.smithi089.stdout:5/812: write d5/de/d57/d8e/d97/da5/fc9 [2064288,130313] 0 2024-08-01T06:56:05.369 INFO:tasks.workunit.client.1.smithi089.stdout:6/874: dwrite d2/d11/d1f/d46/f62 [0,4194304] 0 2024-08-01T06:56:05.371 INFO:tasks.workunit.client.1.smithi089.stdout:7/756: read f4 [809318,80336] 0 2024-08-01T06:56:05.371 INFO:tasks.workunit.client.1.smithi089.stdout:2/722: dwrite f2 [4194304,4194304] 0 2024-08-01T06:56:05.379 INFO:tasks.workunit.client.1.smithi089.stdout:7/757: symlink d7/df/d10/d31/l107 0 2024-08-01T06:56:05.379 INFO:tasks.workunit.client.1.smithi089.stdout:5/813: mknod d5/d13/d43/c101 0 2024-08-01T06:56:05.381 INFO:tasks.workunit.client.1.smithi089.stdout:5/814: write d5/de/d57/d8e/d97/da5/dde/de9/ff1 [219534,67222] 0 2024-08-01T06:56:05.381 INFO:tasks.workunit.client.1.smithi089.stdout:6/875: rmdir d2/d11/d1f/dbd/dc5/d11b 0 2024-08-01T06:56:05.382 INFO:tasks.workunit.client.1.smithi089.stdout:5/815: readlink d5/de/d10/d16/l8c 0 2024-08-01T06:56:05.383 INFO:tasks.workunit.client.1.smithi089.stdout:7/758: getdents d7/df/d10 0 2024-08-01T06:56:05.386 INFO:tasks.workunit.client.1.smithi089.stdout:7/759: mknod d7/d1f/d30/d4c/dbc/dcd/c108 0 2024-08-01T06:56:05.389 INFO:tasks.workunit.client.1.smithi089.stdout:7/760: fdatasync d7/d1f/d30/db1/fb8 0 2024-08-01T06:56:05.390 INFO:tasks.workunit.client.1.smithi089.stdout:5/816: truncate d5/de/d10/d16/d1b/d25/d4d/fcf 678971 0 2024-08-01T06:56:05.391 INFO:tasks.workunit.client.1.smithi089.stdout:6/876: dwrite d2/d11/d3e/f60 [0,4194304] 0 2024-08-01T06:56:05.391 INFO:tasks.workunit.client.1.smithi089.stdout:2/723: write f5 [1214847,22844] 0 2024-08-01T06:56:05.392 INFO:tasks.workunit.client.1.smithi089.stdout:5/817: readlink d5/de/d57/d8e/l95 0 2024-08-01T06:56:05.394 INFO:tasks.workunit.client.1.smithi089.stdout:5/818: chown d5/de/d57/d8e/d97 890 1 2024-08-01T06:56:05.396 INFO:tasks.workunit.client.1.smithi089.stdout:7/761: symlink d7/df/d91/da4/l109 0 2024-08-01T06:56:05.397 INFO:tasks.workunit.client.1.smithi089.stdout:6/877: mkdir d2/d11/d1a/d1c/dea/d11f 0 2024-08-01T06:56:05.397 INFO:tasks.workunit.client.1.smithi089.stdout:5/819: write d5/de/d10/d33/f6e [2087472,38486] 0 2024-08-01T06:56:05.398 INFO:tasks.workunit.client.1.smithi089.stdout:7/762: readlink d7/df/d10/d31/lf4 0 2024-08-01T06:56:05.403 INFO:tasks.workunit.client.1.smithi089.stdout:5/820: fdatasync d5/de/d10/d16/f44 0 2024-08-01T06:56:05.403 INFO:tasks.workunit.client.1.smithi089.stdout:2/724: dwrite d7/d1f/d52/d6e/f75 [0,4194304] 0 2024-08-01T06:56:05.404 INFO:tasks.workunit.client.1.smithi089.stdout:7/763: fsync d7/d1f/d3a/f6f 0 2024-08-01T06:56:05.406 INFO:tasks.workunit.client.1.smithi089.stdout:2/725: rmdir d7/d1f/d52 39 2024-08-01T06:56:05.407 INFO:tasks.workunit.client.1.smithi089.stdout:7/764: symlink d7/d1f/d30/d4c/dbc/dcd/dd7/l10a 0 2024-08-01T06:56:05.407 INFO:tasks.workunit.client.1.smithi089.stdout:2/726: read d7/d1f/f4b [56087,16505] 0 2024-08-01T06:56:05.409 INFO:tasks.workunit.client.1.smithi089.stdout:2/727: readlink d7/d19/d3b/ld4 0 2024-08-01T06:56:05.411 INFO:tasks.workunit.client.1.smithi089.stdout:7/765: unlink d7/d1f/d30/d4c/dbc/l101 0 2024-08-01T06:56:05.412 INFO:tasks.workunit.client.1.smithi089.stdout:7/766: truncate d7/fb 4424297 0 2024-08-01T06:56:05.413 INFO:tasks.workunit.client.1.smithi089.stdout:5/821: link d5/de/df/d9f/dbd/ccc d5/de/d10/d16/d1b/d25/c102 0 2024-08-01T06:56:05.415 INFO:tasks.workunit.client.1.smithi089.stdout:2/728: creat d7/dd7/fe3 x:0 0 0 2024-08-01T06:56:05.415 INFO:tasks.workunit.client.1.smithi089.stdout:7/767: creat d7/d46/f10b x:0 0 0 2024-08-01T06:56:05.416 INFO:tasks.workunit.client.1.smithi089.stdout:5/822: mkdir d5/de/df/d9f/d103 0 2024-08-01T06:56:05.417 INFO:tasks.workunit.client.1.smithi089.stdout:7/768: stat d7/d1f/d30/d4c/dbc/dcd/d104 0 2024-08-01T06:56:05.419 INFO:tasks.workunit.client.1.smithi089.stdout:5/823: creat d5/de/d10/d16/d1b/d92/f104 x:0 0 0 2024-08-01T06:56:05.422 INFO:tasks.workunit.client.1.smithi089.stdout:7/769: rename d7/df/d10/cd5 to d7/df/d10/dd6/c10c 0 2024-08-01T06:56:05.423 INFO:tasks.workunit.client.1.smithi089.stdout:5/824: write d5/d13/f30 [5166876,78138] 0 2024-08-01T06:56:05.428 INFO:tasks.workunit.client.1.smithi089.stdout:5/825: rename d5/de/df/d9f to d5/dac/d105 0 2024-08-01T06:56:05.433 INFO:tasks.workunit.client.1.smithi089.stdout:5/826: mkdir d5/d13/d83/d106 0 2024-08-01T06:56:05.435 INFO:tasks.workunit.client.1.smithi089.stdout:2/729: dwrite d7/d1f/d28/fd9 [0,4194304] 0 2024-08-01T06:56:05.436 INFO:tasks.workunit.client.1.smithi089.stdout:7/770: dwrite d7/d1f/d30/d4c/dbc/dcd/fed [0,4194304] 0 2024-08-01T06:56:05.439 INFO:tasks.workunit.client.1.smithi089.stdout:7/771: rmdir d7/d1f/d30/dab 39 2024-08-01T06:56:05.440 INFO:tasks.workunit.client.1.smithi089.stdout:2/730: creat d7/d19/dc5/dcc/fe4 x:0 0 0 2024-08-01T06:56:05.441 INFO:tasks.workunit.client.1.smithi089.stdout:2/731: chown d7/d4a/le0 523472324 1 2024-08-01T06:56:05.444 INFO:tasks.workunit.client.1.smithi089.stdout:5/827: mknod d5/de/d57/d8e/d97/df5/c107 0 2024-08-01T06:56:05.445 INFO:tasks.workunit.client.1.smithi089.stdout:7/772: creat d7/d1f/da6/f10d x:0 0 0 2024-08-01T06:56:05.446 INFO:tasks.workunit.client.1.smithi089.stdout:7/773: chown d7/df/c29 1442575 1 2024-08-01T06:56:05.448 INFO:tasks.workunit.client.1.smithi089.stdout:7/774: truncate d7/df/d10/d31/d4a/fd0 4238284 0 2024-08-01T06:56:05.449 INFO:tasks.workunit.client.1.smithi089.stdout:2/732: write d7/d19/d1e/d3d/d60/f8c [1563127,18897] 0 2024-08-01T06:56:05.451 INFO:tasks.workunit.client.1.smithi089.stdout:5/828: truncate d5/de/d10/d16/d1b/f76 2862619 0 2024-08-01T06:56:05.452 INFO:tasks.workunit.client.1.smithi089.stdout:7/775: symlink d7/df/d91/da4/l10e 0 2024-08-01T06:56:05.455 INFO:tasks.workunit.client.1.smithi089.stdout:2/733: mkdir d7/d1f/d52/d72/de5 0 2024-08-01T06:56:05.459 INFO:tasks.workunit.client.1.smithi089.stdout:5/829: link d5/d13/d38/l50 d5/de/d57/d8e/d97/df5/l108 0 2024-08-01T06:56:05.460 INFO:tasks.workunit.client.1.smithi089.stdout:7/776: dwrite d7/ff9 [0,4194304] 0 2024-08-01T06:56:05.460 INFO:tasks.workunit.client.1.smithi089.stdout:2/734: rename d7/d19/d3b/c67 to d7/d73/ce6 0 2024-08-01T06:56:05.461 INFO:tasks.workunit.client.1.smithi089.stdout:7/777: chown d7/df/d91/da4/dca 0 1 2024-08-01T06:56:05.462 INFO:tasks.workunit.client.1.smithi089.stdout:5/830: creat d5/dac/f109 x:0 0 0 2024-08-01T06:56:05.464 INFO:tasks.workunit.client.1.smithi089.stdout:7/778: readlink d7/d1f/d3a/l8d 0 2024-08-01T06:56:05.465 INFO:tasks.workunit.client.1.smithi089.stdout:5/831: rmdir d5/de 39 2024-08-01T06:56:05.466 INFO:tasks.workunit.client.1.smithi089.stdout:2/735: symlink d7/d1f/d29/d48/da9/de2/le7 0 2024-08-01T06:56:05.467 INFO:tasks.workunit.client.1.smithi089.stdout:7/779: rmdir d7/df/d10/d31 39 2024-08-01T06:56:05.467 INFO:tasks.workunit.client.1.smithi089.stdout:2/736: readlink d7/d1f/d29/d48/da9/ld5 0 2024-08-01T06:56:05.468 INFO:tasks.workunit.client.1.smithi089.stdout:5/832: read d5/dac/d105/dbd/df0/d5d/d6c/f81 [3965997,115939] 0 2024-08-01T06:56:05.471 INFO:tasks.workunit.client.1.smithi089.stdout:5/833: mkdir d5/d13/d43/dc5/d10a 0 2024-08-01T06:56:05.472 INFO:tasks.workunit.client.1.smithi089.stdout:2/737: rename d7/d19/d1e/c35 to d7/d1f/d52/d72/dc0/ce8 0 2024-08-01T06:56:05.476 INFO:tasks.workunit.client.1.smithi089.stdout:2/738: symlink d7/d19/d1e/le9 0 2024-08-01T06:56:05.478 INFO:tasks.workunit.client.1.smithi089.stdout:2/739: creat d7/d19/db5/fea x:0 0 0 2024-08-01T06:56:05.478 INFO:tasks.workunit.client.1.smithi089.stdout:5/834: link d5/de/d10/d16/d1b/d25/c40 d5/dac/d105/dbd/c10b 0 2024-08-01T06:56:05.479 INFO:tasks.workunit.client.1.smithi089.stdout:2/740: stat d7/c33 0 2024-08-01T06:56:05.480 INFO:tasks.workunit.client.1.smithi089.stdout:5/835: mkdir d5/dac/d105/d10c 0 2024-08-01T06:56:05.481 INFO:tasks.workunit.client.1.smithi089.stdout:2/741: creat d7/d19/feb x:0 0 0 2024-08-01T06:56:05.482 INFO:tasks.workunit.client.1.smithi089.stdout:5/836: unlink d5/d13/d38/d42/cdc 0 2024-08-01T06:56:05.483 INFO:tasks.workunit.client.1.smithi089.stdout:2/742: rmdir d7/d19/dc5/dcc/d64 39 2024-08-01T06:56:05.484 INFO:tasks.workunit.client.1.smithi089.stdout:5/837: dread - d5/dac/d105/dbd/fd5 zero size 2024-08-01T06:56:05.484 INFO:tasks.workunit.client.1.smithi089.stdout:2/743: stat d7/d1f/d29/c27 0 2024-08-01T06:56:05.485 INFO:tasks.workunit.client.1.smithi089.stdout:5/838: chown d5/d13/d43/dc5/d10a 155 1 2024-08-01T06:56:05.486 INFO:tasks.workunit.client.1.smithi089.stdout:2/744: creat d7/d1f/d52/d72/fec x:0 0 0 2024-08-01T06:56:05.487 INFO:tasks.workunit.client.1.smithi089.stdout:5/839: mkdir d5/d13/d43/dc5/d100/d10d 0 2024-08-01T06:56:05.487 INFO:tasks.workunit.client.1.smithi089.stdout:2/745: dread - d7/d19/d1e/f8d zero size 2024-08-01T06:56:05.488 INFO:tasks.workunit.client.1.smithi089.stdout:2/746: fsync d7/d1f/d52/d6e/f75 0 2024-08-01T06:56:05.489 INFO:tasks.workunit.client.1.smithi089.stdout:2/747: chown d7/d19/dc5/dcc 678320 1 2024-08-01T06:56:05.494 INFO:tasks.workunit.client.1.smithi089.stdout:2/748: mknod d7/d19/d68/ced 0 2024-08-01T06:56:05.496 INFO:tasks.workunit.client.1.smithi089.stdout:5/840: link d5/de/d10/d16/d1b/d25/f62 d5/de/d10/d16/d1b/d25/f10e 0 2024-08-01T06:56:05.497 INFO:tasks.workunit.client.1.smithi089.stdout:2/749: stat d7/c12 0 2024-08-01T06:56:05.501 INFO:tasks.workunit.client.1.smithi089.stdout:2/750: symlink d7/d1f/d52/d72/de5/lee 0 2024-08-01T06:56:05.506 INFO:tasks.workunit.client.1.smithi089.stdout:5/841: dwrite d5/de/d10/d16/d1b/d25/f10e [0,4194304] 0 2024-08-01T06:56:05.510 INFO:tasks.workunit.client.1.smithi089.stdout:5/842: unlink d5/d13/d83/l8d 0 2024-08-01T06:56:05.513 INFO:tasks.workunit.client.1.smithi089.stdout:2/751: link d7/d1f/d28/l5f d7/d19/d1e/lef 0 2024-08-01T06:56:05.518 INFO:tasks.workunit.client.1.smithi089.stdout:2/752: dread d7/d1f/d28/fa2 [0,4194304] 0 2024-08-01T06:56:05.522 INFO:tasks.workunit.client.1.smithi089.stdout:5/843: dwrite d5/d13/f84 [4194304,4194304] 0 2024-08-01T06:56:05.525 INFO:tasks.workunit.client.1.smithi089.stdout:2/753: dread d7/d1f/d52/d6e/fbb [0,4194304] 0 2024-08-01T06:56:05.527 INFO:tasks.workunit.client.1.smithi089.stdout:2/754: rmdir d7/d19/dc5/dcc 39 2024-08-01T06:56:05.530 INFO:tasks.workunit.client.1.smithi089.stdout:5/844: dwrite d5/de/d10/d33/f6e [0,4194304] 0 2024-08-01T06:56:05.534 INFO:tasks.workunit.client.1.smithi089.stdout:5/845: truncate d5/de/d10/d33/d5e/d7e/d9e/db1/ffb 313064 0 2024-08-01T06:56:05.535 INFO:tasks.workunit.client.1.smithi089.stdout:2/755: rename d7/d19/d68/ced to d7/dd7/cf0 0 2024-08-01T06:56:05.535 INFO:tasks.workunit.client.1.smithi089.stdout:2/756: chown d7/d1f/d29/cd 256 1 2024-08-01T06:56:05.536 INFO:tasks.workunit.client.1.smithi089.stdout:5/846: mkdir d5/dac/d10f 0 2024-08-01T06:56:05.540 INFO:tasks.workunit.client.1.smithi089.stdout:2/757: symlink d7/d19/dc5/dcc/d9e/lf1 0 2024-08-01T06:56:05.545 INFO:tasks.workunit.client.1.smithi089.stdout:2/758: rename d7/d19/d1e/f8a to d7/d19/d1e/d3d/d60/ff2 0 2024-08-01T06:56:05.546 INFO:tasks.workunit.client.1.smithi089.stdout:2/759: creat d7/d1f/d52/d72/ff3 x:0 0 0 2024-08-01T06:56:05.548 INFO:tasks.workunit.client.1.smithi089.stdout:2/760: write d7/d19/dc5/dcc/d9e/f87 [121309,108289] 0 2024-08-01T06:56:05.551 INFO:tasks.workunit.client.1.smithi089.stdout:2/761: rmdir d7/d1f/d52 39 2024-08-01T06:56:05.551 INFO:tasks.workunit.client.1.smithi089.stdout:5/847: dwrite d5/f3c [0,4194304] 0 2024-08-01T06:56:05.556 INFO:tasks.workunit.client.1.smithi089.stdout:5/848: creat d5/de/f110 x:0 0 0 2024-08-01T06:56:05.556 INFO:tasks.workunit.client.1.smithi089.stdout:2/762: truncate d7/d1f/f20 3497168 0 2024-08-01T06:56:05.558 INFO:tasks.workunit.client.1.smithi089.stdout:2/763: fdatasync d7/dd7/fe3 0 2024-08-01T06:56:05.560 INFO:tasks.workunit.client.1.smithi089.stdout:5/849: readlink d5/dac/d105/dbd/df0/d5d/dd9/lf4 0 2024-08-01T06:56:05.560 INFO:tasks.workunit.client.1.smithi089.stdout:2/764: mknod d7/d19/dc5/cf4 0 2024-08-01T06:56:05.561 INFO:tasks.workunit.client.1.smithi089.stdout:5/850: fdatasync d5/dac/d105/dbd/fc4 0 2024-08-01T06:56:05.563 INFO:tasks.workunit.client.1.smithi089.stdout:2/765: symlink d7/d1f/d29/lf5 0 2024-08-01T06:56:05.564 INFO:tasks.workunit.client.1.smithi089.stdout:5/851: symlink d5/d13/d43/dc5/d100/d10d/l111 0 2024-08-01T06:56:05.572 INFO:tasks.workunit.client.1.smithi089.stdout:2/766: rmdir d7/d1f/d52/d72 39 2024-08-01T06:56:05.574 INFO:tasks.workunit.client.1.smithi089.stdout:2/767: read - d7/d19/dc5/dcc/d64/d9c/fab zero size 2024-08-01T06:56:05.577 INFO:tasks.workunit.client.1.smithi089.stdout:5/852: write d5/de/d10/d16/d1b/d25/fa7 [889898,121811] 0 2024-08-01T06:56:05.578 INFO:tasks.workunit.client.1.smithi089.stdout:2/768: creat d7/d1f/d52/d72/dc0/ff6 x:0 0 0 2024-08-01T06:56:05.586 INFO:tasks.workunit.client.1.smithi089.stdout:5/853: rename d5/d13/d83/fff to d5/de/d10/d16/d9d/f112 0 2024-08-01T06:56:05.587 INFO:tasks.workunit.client.1.smithi089.stdout:2/769: write d7/d19/dc5/dcc/d64/fce [1351200,14617] 0 2024-08-01T06:56:05.588 INFO:tasks.workunit.client.1.smithi089.stdout:2/770: readlink d7/d19/d3b/ld4 0 2024-08-01T06:56:05.591 INFO:tasks.workunit.client.1.smithi089.stdout:1/846: sync 2024-08-01T06:56:05.591 INFO:tasks.workunit.client.1.smithi089.stdout:9/721: sync 2024-08-01T06:56:05.593 INFO:tasks.workunit.client.1.smithi089.stdout:1/847: write d0/d9/d15/d3b/d95/fb2 [1044313,62132] 0 2024-08-01T06:56:05.600 INFO:tasks.workunit.client.1.smithi089.stdout:2/771: mknod d7/d19/cf7 0 2024-08-01T06:56:05.602 INFO:tasks.workunit.client.1.smithi089.stdout:2/772: dread d7/d1f/d28/f51 [4194304,4194304] 0 2024-08-01T06:56:05.606 INFO:tasks.workunit.client.1.smithi089.stdout:9/722: mkdir d18/d33/d49/d7b/d7f/d98/d9f/df1 0 2024-08-01T06:56:05.607 INFO:tasks.workunit.client.1.smithi089.stdout:9/723: write f15 [1837025,79236] 0 2024-08-01T06:56:05.607 INFO:tasks.workunit.client.1.smithi089.stdout:2/773: fdatasync d7/d19/d3b/fd1 0 2024-08-01T06:56:05.608 INFO:tasks.workunit.client.1.smithi089.stdout:5/854: link d5/d13/d38/c2f d5/de/d10/d33/d5e/d7e/d9e/c113 0 2024-08-01T06:56:05.609 INFO:tasks.workunit.client.1.smithi089.stdout:2/774: mknod d7/d19/d3b/d7c/cf8 0 2024-08-01T06:56:05.610 INFO:tasks.workunit.client.1.smithi089.stdout:2/775: chown d7/d19/dc5/dcc/d64/fce 737037 1 2024-08-01T06:56:05.613 INFO:tasks.workunit.client.1.smithi089.stdout:2/776: fdatasync d7/d19/dc5/dcc/d64/d9c/fab 0 2024-08-01T06:56:05.613 INFO:tasks.workunit.client.1.smithi089.stdout:1/848: rename d0/d9/d15/d2d/d4a/d4d/c84 to d0/d9/d15/d2d/d4a/c116 0 2024-08-01T06:56:05.615 INFO:tasks.workunit.client.1.smithi089.stdout:1/849: symlink d0/d9/d15/dce/dd3/ddd/l117 0 2024-08-01T06:56:05.616 INFO:tasks.workunit.client.1.smithi089.stdout:9/724: truncate d18/d22/f28 1488066 0 2024-08-01T06:56:05.617 INFO:tasks.workunit.client.1.smithi089.stdout:9/725: chown d18/da4/fe8 6949265 1 2024-08-01T06:56:05.620 INFO:tasks.workunit.client.1.smithi089.stdout:2/777: dwrite d7/d19/dc5/dcc/fa5 [4194304,4194304] 0 2024-08-01T06:56:05.626 INFO:tasks.workunit.client.1.smithi089.stdout:2/778: fdatasync d7/d73/f74 0 2024-08-01T06:56:05.629 INFO:tasks.workunit.client.1.smithi089.stdout:1/850: dwrite d0/d9/d43/d4b/db0/fd0 [0,4194304] 0 2024-08-01T06:56:05.632 INFO:tasks.workunit.client.1.smithi089.stdout:5/855: dwrite d5/de/d10/d16/fa2 [0,4194304] 0 2024-08-01T06:56:05.634 INFO:tasks.workunit.client.1.smithi089.stdout:2/779: mkdir d7/d1f/d52/df9 0 2024-08-01T06:56:05.635 INFO:tasks.workunit.client.1.smithi089.stdout:5/856: mknod d5/d13/d43/c114 0 2024-08-01T06:56:05.640 INFO:tasks.workunit.client.1.smithi089.stdout:2/780: mkdir d7/d19/dc5/dcc/d64/d9c/dfa 0 2024-08-01T06:56:05.643 INFO:tasks.workunit.client.1.smithi089.stdout:1/851: creat d0/d9/d15/d3b/d3d/f118 x:0 0 0 2024-08-01T06:56:05.643 INFO:tasks.workunit.client.1.smithi089.stdout:4/841: sync 2024-08-01T06:56:05.643 INFO:tasks.workunit.client.1.smithi089.stdout:3/622: sync 2024-08-01T06:56:05.646 INFO:tasks.workunit.client.1.smithi089.stdout:3/623: write d7/d32/f98 [126536,107475] 0 2024-08-01T06:56:05.648 INFO:tasks.workunit.client.1.smithi089.stdout:5/857: dwrite d5/de/d10/d16/d1b/d25/fa7 [0,4194304] 0 2024-08-01T06:56:05.652 INFO:tasks.workunit.client.1.smithi089.stdout:4/842: unlink d3/d86/d9e/db1/dbb/ccd 0 2024-08-01T06:56:05.653 INFO:tasks.workunit.client.1.smithi089.stdout:3/624: mkdir d7/d32/d4c/d69/d6d/dc7 0 2024-08-01T06:56:05.653 INFO:tasks.workunit.client.1.smithi089.stdout:9/726: dread d18/d33/d53/f8b [0,4194304] 0 2024-08-01T06:56:05.659 INFO:tasks.workunit.client.1.smithi089.stdout:5/858: truncate d5/de/faf 2162689 0 2024-08-01T06:56:05.660 INFO:tasks.workunit.client.1.smithi089.stdout:2/781: dwrite d7/d19/d1e/fbe [0,4194304] 0 2024-08-01T06:56:05.661 INFO:tasks.workunit.client.1.smithi089.stdout:3/625: creat d7/d68/d50/d6f/d2f/d9c/fc8 x:0 0 0 2024-08-01T06:56:05.666 INFO:tasks.workunit.client.1.smithi089.stdout:3/626: chown d7/d32/d4c/d69/f96 0 1 2024-08-01T06:56:05.667 INFO:tasks.workunit.client.1.smithi089.stdout:4/843: dread d3/db/de/d5b/f73 [0,4194304] 0 2024-08-01T06:56:05.669 INFO:tasks.workunit.client.1.smithi089.stdout:9/727: dwrite d18/d22/d45/daa/fcf [0,4194304] 0 2024-08-01T06:56:05.672 INFO:tasks.workunit.client.1.smithi089.stdout:4/844: write d3/d86/d9e/db1/fe5 [1013276,67442] 0 2024-08-01T06:56:05.673 INFO:tasks.workunit.client.1.smithi089.stdout:3/627: mknod d7/d32/d4c/d67/d72/d91/cc9 0 2024-08-01T06:56:05.675 INFO:tasks.workunit.client.1.smithi089.stdout:1/852: dread d0/d9/d43/f71 [0,4194304] 0 2024-08-01T06:56:05.677 INFO:tasks.workunit.client.1.smithi089.stdout:2/782: dwrite d7/d19/d3b/f50 [0,4194304] 0 2024-08-01T06:56:05.680 INFO:tasks.workunit.client.1.smithi089.stdout:2/783: write f5 [4377224,34773] 0 2024-08-01T06:56:05.680 INFO:tasks.workunit.client.1.smithi089.stdout:9/728: dread d18/d22/da2/fd8 [0,4194304] 0 2024-08-01T06:56:05.680 INFO:tasks.workunit.client.1.smithi089.stdout:3/628: read - d7/d32/d12/d29/d39/d4b/d83/fc4 zero size 2024-08-01T06:56:05.682 INFO:tasks.workunit.client.1.smithi089.stdout:4/845: link d3/d86/d9e/d57/la3 d3/d86/d9e/db1/lfa 0 2024-08-01T06:56:05.682 INFO:tasks.workunit.client.1.smithi089.stdout:9/729: chown d18/d33/d6e/dd1 25515 1 2024-08-01T06:56:05.683 INFO:tasks.workunit.client.1.smithi089.stdout:9/730: chown d18/d22/d39/d50 170553 1 2024-08-01T06:56:05.684 INFO:tasks.workunit.client.1.smithi089.stdout:1/853: creat d0/d9/d15/d2b/d7d/d115/f119 x:0 0 0 2024-08-01T06:56:05.686 INFO:tasks.workunit.client.1.smithi089.stdout:3/629: write d7/d32/d12/d29/d39/d4b/d83/f9b [882407,99830] 0 2024-08-01T06:56:05.686 INFO:tasks.workunit.client.1.smithi089.stdout:9/731: dread - d18/d22/d39/f3f zero size 2024-08-01T06:56:05.688 INFO:tasks.workunit.client.1.smithi089.stdout:1/854: symlink d0/d9/d15/d3b/d3d/d77/l11a 0 2024-08-01T06:56:05.688 INFO:tasks.workunit.client.1.smithi089.stdout:4/846: mknod d3/d86/d9e/db1/dbb/d62/d3b/cfb 0 2024-08-01T06:56:05.689 INFO:tasks.workunit.client.1.smithi089.stdout:4/847: fdatasync d3/fb8 0 2024-08-01T06:56:05.690 INFO:tasks.workunit.client.1.smithi089.stdout:9/732: creat d18/d33/d49/d7b/d4b/ff2 x:0 0 0 2024-08-01T06:56:05.690 INFO:tasks.workunit.client.1.smithi089.stdout:3/630: rename d7/d32/d4c/d69/f56 to d7/d32/d4c/fca 0 2024-08-01T06:56:05.691 INFO:tasks.workunit.client.1.smithi089.stdout:4/848: truncate d3/d68/fdf 262528 0 2024-08-01T06:56:05.694 INFO:tasks.workunit.client.1.smithi089.stdout:2/784: write d7/d19/d1e/d3d/f99 [124964,29800] 0 2024-08-01T06:56:05.695 INFO:tasks.workunit.client.1.smithi089.stdout:3/631: rename d7/d68/d50/d54 to d7/d32/d4c/d67/d72/d91/dcb 0 2024-08-01T06:56:05.697 INFO:tasks.workunit.client.1.smithi089.stdout:4/849: mkdir d3/d17/d3a/d4a/de1/dfc 0 2024-08-01T06:56:05.697 INFO:tasks.workunit.client.1.smithi089.stdout:1/855: symlink d0/d9/d15/d2d/d4a/l11b 0 2024-08-01T06:56:05.697 INFO:tasks.workunit.client.1.smithi089.stdout:9/733: dwrite d18/d33/d53/f5e [0,4194304] 0 2024-08-01T06:56:05.698 INFO:tasks.workunit.client.1.smithi089.stdout:2/785: creat d7/d19/d3b/d7c/ffb x:0 0 0 2024-08-01T06:56:05.698 INFO:tasks.workunit.client.1.smithi089.stdout:3/632: dread - d7/d32/d4c/d67/fac zero size 2024-08-01T06:56:05.703 INFO:tasks.workunit.client.1.smithi089.stdout:9/734: truncate f4 3842291 0 2024-08-01T06:56:05.703 INFO:tasks.workunit.client.1.smithi089.stdout:1/856: rename d0/d9/d43/d4b to d0/d9/d43/d4b/d11c 22 2024-08-01T06:56:05.705 INFO:tasks.workunit.client.1.smithi089.stdout:4/850: symlink d3/d86/d9e/db1/dbb/d62/d3b/lfd 0 2024-08-01T06:56:05.705 INFO:tasks.workunit.client.1.smithi089.stdout:9/735: read - d18/d22/d39/f3f zero size 2024-08-01T06:56:05.705 INFO:tasks.workunit.client.1.smithi089.stdout:1/857: fdatasync d0/d9/d15/d7a/fc9 0 2024-08-01T06:56:05.706 INFO:tasks.workunit.client.1.smithi089.stdout:3/633: symlink d7/d68/d50/d6f/d2f/da2/da8/lcc 0 2024-08-01T06:56:05.709 INFO:tasks.workunit.client.1.smithi089.stdout:4/851: creat d3/d68/ffe x:0 0 0 2024-08-01T06:56:05.709 INFO:tasks.workunit.client.1.smithi089.stdout:1/858: unlink d0/d9/d15/d2b/d7d/l8b 0 2024-08-01T06:56:05.712 INFO:tasks.workunit.client.1.smithi089.stdout:9/736: creat d18/d33/d49/d7b/d7f/d98/d9f/d8e/ff3 x:0 0 0 2024-08-01T06:56:05.712 INFO:tasks.workunit.client.1.smithi089.stdout:4/852: rmdir d3/d17/d3a/d4a/dee 39 2024-08-01T06:56:05.721 INFO:tasks.workunit.client.1.smithi089.stdout:9/737: creat d18/d33/d49/d7b/d7f/d98/d9f/d8e/de0/ff4 x:0 0 0 2024-08-01T06:56:05.721 INFO:tasks.workunit.client.1.smithi089.stdout:4/853: rename d3/d86/d9e/db1/dbb/d62/f37 to d3/db/de/d5b/db9/fff 0 2024-08-01T06:56:05.722 INFO:tasks.workunit.client.1.smithi089.stdout:2/786: dwrite d7/f10 [0,4194304] 0 2024-08-01T06:56:05.726 INFO:tasks.workunit.client.1.smithi089.stdout:1/859: dwrite d0/d9/d15/d3b/d95/d49/fc8 [0,4194304] 0 2024-08-01T06:56:05.728 INFO:tasks.workunit.client.1.smithi089.stdout:3/634: dwrite d7/d32/d4c/d69/fb2 [0,4194304] 0 2024-08-01T06:56:05.729 INFO:tasks.workunit.client.1.smithi089.stdout:4/854: symlink d3/d17/d71/d92/l100 0 2024-08-01T06:56:05.731 INFO:tasks.workunit.client.1.smithi089.stdout:2/787: truncate d7/d19/d1e/d3d/fad 4514 0 2024-08-01T06:56:05.733 INFO:tasks.workunit.client.1.smithi089.stdout:4/855: symlink d3/d86/db7/dd1/l101 0 2024-08-01T06:56:05.733 INFO:tasks.workunit.client.1.smithi089.stdout:1/860: dread - d0/d9/d15/d2b/d7d/fbf zero size 2024-08-01T06:56:05.737 INFO:tasks.workunit.client.1.smithi089.stdout:3/635: creat d7/d32/d12/d29/fcd x:0 0 0 2024-08-01T06:56:05.738 INFO:tasks.workunit.client.1.smithi089.stdout:4/856: symlink d3/db/de/dbe/l102 0 2024-08-01T06:56:05.739 INFO:tasks.workunit.client.1.smithi089.stdout:1/861: mknod d0/d9/d15/d3b/d95/d49/c11d 0 2024-08-01T06:56:05.739 INFO:tasks.workunit.client.1.smithi089.stdout:2/788: dwrite d7/d19/d1e/f2e [0,4194304] 0 2024-08-01T06:56:05.741 INFO:tasks.workunit.client.1.smithi089.stdout:9/738: getdents d18/d22 0 2024-08-01T06:56:05.742 INFO:tasks.workunit.client.1.smithi089.stdout:1/862: readlink d0/d9/d15/dce/dd3/ddd/l117 0 2024-08-01T06:56:05.743 INFO:tasks.workunit.client.1.smithi089.stdout:2/789: read d7/d1f/d29/f15 [2582156,106883] 0 2024-08-01T06:56:05.744 INFO:tasks.workunit.client.1.smithi089.stdout:4/857: rename d3/d68/d7e to d3/d17/d3a/d4a/de1/d103 0 2024-08-01T06:56:05.745 INFO:tasks.workunit.client.1.smithi089.stdout:3/636: mkdir d7/dce 0 2024-08-01T06:56:05.746 INFO:tasks.workunit.client.1.smithi089.stdout:3/637: readlink d7/d32/l37 0 2024-08-01T06:56:05.748 INFO:tasks.workunit.client.1.smithi089.stdout:9/739: creat d18/d22/d39/d95/ff5 x:0 0 0 2024-08-01T06:56:05.750 INFO:tasks.workunit.client.1.smithi089.stdout:2/790: creat d7/d19/d3b/d7c/ffc x:0 0 0 2024-08-01T06:56:05.752 INFO:tasks.workunit.client.1.smithi089.stdout:4/858: write d3/db/d16/f18 [4455980,38188] 0 2024-08-01T06:56:05.755 INFO:tasks.workunit.client.1.smithi089.stdout:1/863: rename d0/d9/d15/d2d/d4a/fa9 to d0/dd9/f11e 0 2024-08-01T06:56:05.757 INFO:tasks.workunit.client.1.smithi089.stdout:9/740: rename d18/d33/d49/d7b/d7f/d98/d9f/ldf to d18/d22/lf6 0 2024-08-01T06:56:05.758 INFO:tasks.workunit.client.1.smithi089.stdout:4/859: creat d3/d86/d9e/f104 x:0 0 0 2024-08-01T06:56:05.760 INFO:tasks.workunit.client.1.smithi089.stdout:2/791: rename d7/d1f/c8b to d7/d1f/d29/d48/cfd 0 2024-08-01T06:56:05.762 INFO:tasks.workunit.client.1.smithi089.stdout:4/860: dread d3/d86/d9e/db1/fe5 [0,4194304] 0 2024-08-01T06:56:05.762 INFO:tasks.workunit.client.1.smithi089.stdout:1/864: rename d0/d9/d15/d3b/d95/d49/c11d to d0/c11f 0 2024-08-01T06:56:05.763 INFO:tasks.workunit.client.1.smithi089.stdout:2/792: mknod d7/d4a/cfe 0 2024-08-01T06:56:05.764 INFO:tasks.workunit.client.1.smithi089.stdout:2/793: dread - d7/d19/d1e/f8d zero size 2024-08-01T06:56:05.767 INFO:tasks.workunit.client.1.smithi089.stdout:9/741: rename d18/d33/d49/d7b/d55 to d18/d33/df7 0 2024-08-01T06:56:05.767 INFO:tasks.workunit.client.1.smithi089.stdout:2/794: unlink d7/d1f/d29/d48/l7e 0 2024-08-01T06:56:05.769 INFO:tasks.workunit.client.1.smithi089.stdout:9/742: stat d18/d22/d39/l70 0 2024-08-01T06:56:05.772 INFO:tasks.workunit.client.1.smithi089.stdout:3/638: dread d7/d32/d12/d29/f77 [4194304,4194304] 0 2024-08-01T06:56:05.773 INFO:tasks.workunit.client.1.smithi089.stdout:2/795: link d7/d1f/d28/fd9 d7/d19/d1e/d5b/fff 0 2024-08-01T06:56:05.773 INFO:tasks.workunit.client.1.smithi089.stdout:9/743: mkdir d18/d33/d49/d7b/d4b/db6/df8 0 2024-08-01T06:56:05.774 INFO:tasks.workunit.client.1.smithi089.stdout:9/744: chown d18 51 1 2024-08-01T06:56:05.775 INFO:tasks.workunit.client.1.smithi089.stdout:1/865: dwrite d0/d9/d15/d2d/d4a/d61/fab [0,4194304] 0 2024-08-01T06:56:05.777 INFO:tasks.workunit.client.1.smithi089.stdout:1/866: stat d0/d9/d15/d2b/d7d/d115/f119 0 2024-08-01T06:56:05.777 INFO:tasks.workunit.client.1.smithi089.stdout:6/878: sync 2024-08-01T06:56:05.778 INFO:tasks.workunit.client.1.smithi089.stdout:8/897: sync 2024-08-01T06:56:05.778 INFO:tasks.workunit.client.1.smithi089.stdout:7/780: sync 2024-08-01T06:56:05.778 INFO:tasks.workunit.client.1.smithi089.stdout:0/838: sync 2024-08-01T06:56:05.780 INFO:tasks.workunit.client.1.smithi089.stdout:1/867: chown d0/d9/d15/f10d 3065 1 2024-08-01T06:56:05.781 INFO:tasks.workunit.client.1.smithi089.stdout:3/639: dwrite d7/f71 [0,4194304] 0 2024-08-01T06:56:05.782 INFO:tasks.workunit.client.1.smithi089.stdout:8/898: fdatasync d5/dc/d94/dc7/dc5/f10f 0 2024-08-01T06:56:05.784 INFO:tasks.workunit.client.1.smithi089.stdout:6/879: write d2/d11/d1f/f2d [2735704,42221] 0 2024-08-01T06:56:05.786 INFO:tasks.workunit.client.1.smithi089.stdout:2/796: truncate d7/d19/dc5/dcc/fb8 686255 0 2024-08-01T06:56:05.786 INFO:tasks.workunit.client.1.smithi089.stdout:1/868: stat d0/d9/d43/d4b/lcf 0 2024-08-01T06:56:05.789 INFO:tasks.workunit.client.1.smithi089.stdout:3/640: write d7/d32/d4c/d69/d6d/fb7 [1228301,96119] 0 2024-08-01T06:56:05.791 INFO:tasks.workunit.client.1.smithi089.stdout:9/745: dwrite d18/fc1 [0,4194304] 0 2024-08-01T06:56:05.792 INFO:tasks.workunit.client.1.smithi089.stdout:2/797: read d7/d73/f74 [2055382,117525] 0 2024-08-01T06:56:05.794 INFO:tasks.workunit.client.1.smithi089.stdout:0/839: creat d9/d40/d25/d46/d91/d2e/dfc/f106 x:0 0 0 2024-08-01T06:56:05.795 INFO:tasks.workunit.client.1.smithi089.stdout:8/899: truncate d5/dc/f16 3310833 0 2024-08-01T06:56:05.797 INFO:tasks.workunit.client.1.smithi089.stdout:9/746: creat d18/d22/d45/daa/ff9 x:0 0 0 2024-08-01T06:56:05.798 INFO:tasks.workunit.client.1.smithi089.stdout:0/840: chown d9/d40/d25/d46/d91/d2e/d44/d53/f54 1014089 1 2024-08-01T06:56:05.799 INFO:tasks.workunit.client.1.smithi089.stdout:3/641: creat d7/d68/d50/d89/fcf x:0 0 0 2024-08-01T06:56:05.801 INFO:tasks.workunit.client.1.smithi089.stdout:9/747: rmdir d18/d22/d45 39 2024-08-01T06:56:05.804 INFO:tasks.workunit.client.1.smithi089.stdout:1/869: dread d0/d9/d43/d4b/db0/fd0 [0,4194304] 0 2024-08-01T06:56:05.804 INFO:tasks.workunit.client.1.smithi089.stdout:8/900: creat d5/d15/d5a/d73/daa/d11a/f139 x:0 0 0 2024-08-01T06:56:05.806 INFO:tasks.workunit.client.1.smithi089.stdout:9/748: read - d18/d33/d49/d7b/d7f/d98/d9f/d8e/de0/ff4 zero size 2024-08-01T06:56:05.806 INFO:tasks.workunit.client.1.smithi089.stdout:0/841: mknod d9/d40/d25/d46/d91/d2e/d44/d53/c107 0 2024-08-01T06:56:05.811 INFO:tasks.workunit.client.1.smithi089.stdout:1/870: symlink d0/d9/d15/d2b/d7d/d115/l120 0 2024-08-01T06:56:05.811 INFO:tasks.workunit.client.1.smithi089.stdout:9/749: chown d18/d22/d52/fea 215969 1 2024-08-01T06:56:05.811 INFO:tasks.workunit.client.1.smithi089.stdout:0/842: write d9/d40/d95/d99/d2b/f82 [3352329,23087] 0 2024-08-01T06:56:05.812 INFO:tasks.workunit.client.1.smithi089.stdout:7/781: dread f6 [0,4194304] 0 2024-08-01T06:56:05.814 INFO:tasks.workunit.client.1.smithi089.stdout:9/750: mknod d18/d33/d49/d7b/d7f/cfa 0 2024-08-01T06:56:05.817 INFO:tasks.workunit.client.1.smithi089.stdout:0/843: mkdir d9/d40/d25/d46/d91/d2e/d44/d53/daf/d108 0 2024-08-01T06:56:05.817 INFO:tasks.workunit.client.1.smithi089.stdout:8/901: dread d5/d15/d5a/d73/daa/fbe [0,4194304] 0 2024-08-01T06:56:05.817 INFO:tasks.workunit.client.1.smithi089.stdout:3/642: dread d7/d32/d12/d1b/f3c [0,4194304] 0 2024-08-01T06:56:05.818 INFO:tasks.workunit.client.1.smithi089.stdout:7/782: dread - d7/df/d10/d31/d43/fec zero size 2024-08-01T06:56:05.822 INFO:tasks.workunit.client.1.smithi089.stdout:1/871: dwrite d0/d9/d15/f34 [0,4194304] 0 2024-08-01T06:56:05.822 INFO:tasks.workunit.client.1.smithi089.stdout:0/844: read d9/d40/d45/db7/ff5 [1645400,9625] 0 2024-08-01T06:56:05.823 INFO:tasks.workunit.client.1.smithi089.stdout:8/902: creat d5/dc/d12/d112/f13a x:0 0 0 2024-08-01T06:56:05.828 INFO:tasks.workunit.client.1.smithi089.stdout:2/798: dread f5 [0,4194304] 0 2024-08-01T06:56:05.829 INFO:tasks.workunit.client.1.smithi089.stdout:0/845: creat d9/d40/d25/d46/f109 x:0 0 0 2024-08-01T06:56:05.831 INFO:tasks.workunit.client.1.smithi089.stdout:9/751: dwrite d18/d33/d49/d7b/d4b/dbb/fbc [0,4194304] 0 2024-08-01T06:56:05.835 INFO:tasks.workunit.client.1.smithi089.stdout:3/643: rename d7/d32/d12/d29/d39/d4b/d83/fc4 to d7/d68/d50/d6f/d2f/d9c/fd0 0 2024-08-01T06:56:05.835 INFO:tasks.workunit.client.1.smithi089.stdout:7/783: link d7/df/d10/d31/lf4 d7/d1f/d30/db1/l10f 0 2024-08-01T06:56:05.836 INFO:tasks.workunit.client.1.smithi089.stdout:0/846: readlink d9/d40/d25/d46/d91/d2e/l58 0 2024-08-01T06:56:05.838 INFO:tasks.workunit.client.1.smithi089.stdout:9/752: symlink d18/d22/d39/lfb 0 2024-08-01T06:56:05.838 INFO:tasks.workunit.client.1.smithi089.stdout:3/644: mkdir d7/d68/d50/d6f/d46/dd1 0 2024-08-01T06:56:05.842 INFO:tasks.workunit.client.1.smithi089.stdout:2/799: rename d7/d1f/c5e to d7/d1f/c100 0 2024-08-01T06:56:05.842 INFO:tasks.workunit.client.1.smithi089.stdout:1/872: dwrite d0/d9/d15/dce/dd3/fe5 [0,4194304] 0 2024-08-01T06:56:05.845 INFO:tasks.workunit.client.1.smithi089.stdout:9/753: write d18/d33/f61 [481057,1274] 0 2024-08-01T06:56:05.847 INFO:tasks.workunit.client.1.smithi089.stdout:0/847: mknod d9/d40/d25/d46/d91/d2e/d3a/d76/d96/c10a 0 2024-08-01T06:56:05.851 INFO:tasks.workunit.client.1.smithi089.stdout:2/800: mknod d7/d1f/d29/d48/c101 0 2024-08-01T06:56:05.852 INFO:tasks.workunit.client.1.smithi089.stdout:7/784: dwrite d7/df/d10/f35 [0,4194304] 0 2024-08-01T06:56:05.853 INFO:tasks.workunit.client.1.smithi089.stdout:9/754: chown d18/d33/d49/d7b/ca5 4 1 2024-08-01T06:56:05.855 INFO:tasks.workunit.client.1.smithi089.stdout:1/873: fsync d0/d9/d15/d2b/d7d/fbf 0 2024-08-01T06:56:05.855 INFO:tasks.workunit.client.1.smithi089.stdout:8/903: dread d5/dc/d12/db9/fd1 [0,4194304] 0 2024-08-01T06:56:05.856 INFO:tasks.workunit.client.1.smithi089.stdout:1/874: readlink d0/d9/d43/l7b 0 2024-08-01T06:56:05.856 INFO:tasks.workunit.client.1.smithi089.stdout:8/904: chown d5/d15/d5e/df9 199 1 2024-08-01T06:56:05.858 INFO:tasks.workunit.client.1.smithi089.stdout:1/875: fsync d0/d9/d15/d2d/d4a/d104/f112 0 2024-08-01T06:56:05.858 INFO:tasks.workunit.client.1.smithi089.stdout:7/785: rmdir d7 39 2024-08-01T06:56:05.863 INFO:tasks.workunit.client.1.smithi089.stdout:1/876: write d0/d9/d43/fec [604176,95579] 0 2024-08-01T06:56:05.864 INFO:tasks.workunit.client.1.smithi089.stdout:2/801: link d7/d19/fdb d7/d1f/d52/d6e/f102 0 2024-08-01T06:56:05.866 INFO:tasks.workunit.client.1.smithi089.stdout:3/645: truncate d7/d32/f2d 2674033 0 2024-08-01T06:56:05.867 INFO:tasks.workunit.client.1.smithi089.stdout:9/755: dwrite d18/d33/d49/d7b/d4b/ff2 [0,4194304] 0 2024-08-01T06:56:05.871 INFO:tasks.workunit.client.1.smithi089.stdout:2/802: chown d7/d19/dc5/dcc/l7f 19004 1 2024-08-01T06:56:05.872 INFO:tasks.workunit.client.1.smithi089.stdout:0/848: truncate d9/d40/d25/d46/d91/f3f 1496440 0 2024-08-01T06:56:05.872 INFO:tasks.workunit.client.1.smithi089.stdout:9/756: symlink d18/da4/lfc 0 2024-08-01T06:56:05.873 INFO:tasks.workunit.client.1.smithi089.stdout:8/905: dwrite d5/dc/dca/fe6 [0,4194304] 0 2024-08-01T06:56:05.873 INFO:tasks.workunit.client.1.smithi089.stdout:3/646: mkdir d7/d32/d12/d29/d39/d4b/dd2 0 2024-08-01T06:56:05.874 INFO:tasks.workunit.client.1.smithi089.stdout:2/803: rmdir d7/d1f/d52 39 2024-08-01T06:56:05.875 INFO:tasks.workunit.client.1.smithi089.stdout:1/877: write d0/d9/d15/d3b/d3d/db5/fe9 [1388754,23519] 0 2024-08-01T06:56:05.878 INFO:tasks.workunit.client.1.smithi089.stdout:2/804: truncate d7/dd7/fe3 280214 0 2024-08-01T06:56:05.878 INFO:tasks.workunit.client.1.smithi089.stdout:8/906: rmdir d5/dc/d94/dc7/dc5 39 2024-08-01T06:56:05.881 INFO:tasks.workunit.client.1.smithi089.stdout:1/878: write d0/d9/d15/d2d/d4a/d61/f9e [2634083,60199] 0 2024-08-01T06:56:05.881 INFO:tasks.workunit.client.1.smithi089.stdout:2/805: truncate d7/d19/fd6 359694 0 2024-08-01T06:56:05.882 INFO:tasks.workunit.client.1.smithi089.stdout:8/907: stat d5/dc/d94/dc7/d120 0 2024-08-01T06:56:05.882 INFO:tasks.workunit.client.1.smithi089.stdout:2/806: readlink d7/d4a/le0 0 2024-08-01T06:56:05.887 INFO:tasks.workunit.client.1.smithi089.stdout:1/879: creat d0/d9/d15/d2d/f121 x:0 0 0 2024-08-01T06:56:05.889 INFO:tasks.workunit.client.1.smithi089.stdout:1/880: write d0/d9/d15/d7a/fea [1028362,98230] 0 2024-08-01T06:56:05.892 INFO:tasks.workunit.client.1.smithi089.stdout:8/908: dwrite d5/d15/d5e/fe4 [0,4194304] 0 2024-08-01T06:56:05.894 INFO:tasks.workunit.client.1.smithi089.stdout:3/647: dread d7/d32/d12/d29/d39/f6c [0,4194304] 0 2024-08-01T06:56:05.896 INFO:tasks.workunit.client.1.smithi089.stdout:8/909: chown d5/l46 302231724 1 2024-08-01T06:56:05.897 INFO:tasks.workunit.client.1.smithi089.stdout:3/648: truncate d7/d32/d4c/d69/fb9 932573 0 2024-08-01T06:56:05.898 INFO:tasks.workunit.client.1.smithi089.stdout:3/649: fsync d7/d32/f4e 0 2024-08-01T06:56:05.900 INFO:tasks.workunit.client.1.smithi089.stdout:8/910: symlink d5/l13b 0 2024-08-01T06:56:05.904 INFO:tasks.workunit.client.1.smithi089.stdout:7/786: dread d7/d1f/d30/d4c/dbc/dcd/ff5 [0,4194304] 0 2024-08-01T06:56:05.905 INFO:tasks.workunit.client.1.smithi089.stdout:3/650: rename d7/d32/d12/d29/fcd to d7/d32/d12/d1b/fd3 0 2024-08-01T06:56:05.907 INFO:tasks.workunit.client.1.smithi089.stdout:8/911: getdents d5/d15 0 2024-08-01T06:56:05.908 INFO:tasks.workunit.client.1.smithi089.stdout:7/787: unlink d7/d1f/d30/d4c/l50 0 2024-08-01T06:56:05.909 INFO:tasks.workunit.client.1.smithi089.stdout:3/651: getdents d7/d32/d4c/d69/d6d/dc7 0 2024-08-01T06:56:05.910 INFO:tasks.workunit.client.1.smithi089.stdout:7/788: creat d7/df/d10/d31/f110 x:0 0 0 2024-08-01T06:56:05.911 INFO:tasks.workunit.client.1.smithi089.stdout:8/912: getdents d5/d15/d5a/d73/daa/db3 0 2024-08-01T06:56:05.912 INFO:tasks.workunit.client.1.smithi089.stdout:5/859: sync 2024-08-01T06:56:05.913 INFO:tasks.workunit.client.1.smithi089.stdout:3/652: mknod d7/d68/d50/d6f/cd4 0 2024-08-01T06:56:05.915 INFO:tasks.workunit.client.1.smithi089.stdout:5/860: mkdir d5/dac/d105/d103/d115 0 2024-08-01T06:56:05.919 INFO:tasks.workunit.client.1.smithi089.stdout:3/653: mkdir d7/d32/d12/d29/d39/d4b/dd2/dd5 0 2024-08-01T06:56:05.921 INFO:tasks.workunit.client.1.smithi089.stdout:5/861: chown d5/de/d10/d16/d1b/d92/fdb 198893 1 2024-08-01T06:56:05.922 INFO:tasks.workunit.client.1.smithi089.stdout:8/913: dwrite d5/d23/d91/f78 [0,4194304] 0 2024-08-01T06:56:05.922 INFO:tasks.workunit.client.1.smithi089.stdout:1/881: dread d0/f24 [0,4194304] 0 2024-08-01T06:56:05.923 INFO:tasks.workunit.client.1.smithi089.stdout:7/789: dwrite d7/df/d10/d31/d43/fe4 [0,4194304] 0 2024-08-01T06:56:05.924 INFO:tasks.workunit.client.1.smithi089.stdout:3/654: write d7/d32/d12/f33 [699436,114157] 0 2024-08-01T06:56:05.926 INFO:tasks.workunit.client.1.smithi089.stdout:3/655: truncate d7/fb0 341594 0 2024-08-01T06:56:05.926 INFO:tasks.workunit.client.1.smithi089.stdout:1/882: write d0/d9/d15/d3b/d95/fa1 [1309830,11156] 0 2024-08-01T06:56:05.927 INFO:tasks.workunit.client.1.smithi089.stdout:7/790: mknod d7/df/c111 0 2024-08-01T06:56:05.930 INFO:tasks.workunit.client.1.smithi089.stdout:3/656: write d7/fb0 [169328,40467] 0 2024-08-01T06:56:05.930 INFO:tasks.workunit.client.1.smithi089.stdout:3/657: chown d7/c1d 82216 1 2024-08-01T06:56:05.934 INFO:tasks.workunit.client.1.smithi089.stdout:5/862: dread d5/d13/d38/f6d [0,4194304] 0 2024-08-01T06:56:05.935 INFO:tasks.workunit.client.1.smithi089.stdout:7/791: symlink d7/d1f/d30/db1/l112 0 2024-08-01T06:56:05.938 INFO:tasks.workunit.client.1.smithi089.stdout:1/883: symlink d0/d9/d15/d2d/d4a/d4d/l122 0 2024-08-01T06:56:05.939 INFO:tasks.workunit.client.1.smithi089.stdout:8/914: write d5/dc/d94/dc7/dba/d100/f104 [833356,68582] 0 2024-08-01T06:56:05.941 INFO:tasks.workunit.client.1.smithi089.stdout:7/792: chown d7/df/d10/d42/d75/l76 656264 1 2024-08-01T06:56:05.941 INFO:tasks.workunit.client.1.smithi089.stdout:3/658: dwrite d7/d32/d4c/d69/f20 [0,4194304] 0 2024-08-01T06:56:05.945 INFO:tasks.workunit.client.1.smithi089.stdout:1/884: creat d0/d9/d15/d3b/d95/d49/d82/da6/f123 x:0 0 0 2024-08-01T06:56:05.945 INFO:tasks.workunit.client.1.smithi089.stdout:5/863: dwrite d5/d13/f30 [0,4194304] 0 2024-08-01T06:56:05.946 INFO:tasks.workunit.client.1.smithi089.stdout:1/885: chown d0/ce 535965867 1 2024-08-01T06:56:05.946 INFO:tasks.workunit.client.1.smithi089.stdout:8/915: fdatasync d5/dc/d94/f85 0 2024-08-01T06:56:05.947 INFO:tasks.workunit.client.1.smithi089.stdout:7/793: mknod d7/d1f/d30/db1/c113 0 2024-08-01T06:56:05.948 INFO:tasks.workunit.client.1.smithi089.stdout:5/864: stat d5/d13/f84 0 2024-08-01T06:56:05.950 INFO:tasks.workunit.client.1.smithi089.stdout:8/916: write d5/d23/fe1 [166112,126310] 0 2024-08-01T06:56:05.955 INFO:tasks.workunit.client.1.smithi089.stdout:8/917: mknod d5/d15/d5a/d73/d87/c13c 0 2024-08-01T06:56:05.956 INFO:tasks.workunit.client.1.smithi089.stdout:7/794: creat d7/df/d10/d31/f114 x:0 0 0 2024-08-01T06:56:05.956 INFO:tasks.workunit.client.1.smithi089.stdout:8/918: chown d5/d15/d5a/d73/cae 22 1 2024-08-01T06:56:05.957 INFO:tasks.workunit.client.1.smithi089.stdout:7/795: chown d7/df/d91/da4/f37 0 1 2024-08-01T06:56:05.958 INFO:tasks.workunit.client.1.smithi089.stdout:7/796: dread - d7/fe5 zero size 2024-08-01T06:56:05.959 INFO:tasks.workunit.client.1.smithi089.stdout:8/919: rmdir d5/dc 39 2024-08-01T06:56:05.962 INFO:tasks.workunit.client.1.smithi089.stdout:8/920: dread - d5/dc/dca/f102 zero size 2024-08-01T06:56:05.967 INFO:tasks.workunit.client.1.smithi089.stdout:1/886: write d0/f19 [307023,6038] 0 2024-08-01T06:56:05.968 INFO:tasks.workunit.client.1.smithi089.stdout:7/797: dwrite d7/df/d10/d31/d4a/fd0 [0,4194304] 0 2024-08-01T06:56:05.968 INFO:tasks.workunit.client.1.smithi089.stdout:8/921: creat d5/dc/d94/dc7/dc5/f13d x:0 0 0 2024-08-01T06:56:05.970 INFO:tasks.workunit.client.1.smithi089.stdout:3/659: dwrite d7/d32/f2d [0,4194304] 0 2024-08-01T06:56:05.972 INFO:tasks.workunit.client.1.smithi089.stdout:7/798: mknod d7/d46/c115 0 2024-08-01T06:56:05.974 INFO:tasks.workunit.client.1.smithi089.stdout:1/887: rmdir d0/d9/d15/d2b 39 2024-08-01T06:56:05.978 INFO:tasks.workunit.client.1.smithi089.stdout:3/660: write d7/d68/d50/d6f/d2f/d9c/fd0 [662030,107225] 0 2024-08-01T06:56:05.979 INFO:tasks.workunit.client.1.smithi089.stdout:1/888: chown d0/d9/d43/d89/la5 224 1 2024-08-01T06:56:05.980 INFO:tasks.workunit.client.1.smithi089.stdout:8/922: dwrite d5/d23/fe1 [0,4194304] 0 2024-08-01T06:56:05.982 INFO:tasks.workunit.client.1.smithi089.stdout:7/799: link d7/d1f/d30/db1/l112 d7/df/d3b/d64/l116 0 2024-08-01T06:56:05.983 INFO:tasks.workunit.client.1.smithi089.stdout:1/889: write d0/d9/d43/f71 [3227403,116957] 0 2024-08-01T06:56:05.988 INFO:tasks.workunit.client.1.smithi089.stdout:3/661: symlink d7/d32/d4c/d67/d72/d91/dcb/dbc/ld6 0 2024-08-01T06:56:05.990 INFO:tasks.workunit.client.1.smithi089.stdout:1/890: unlink d0/d9/d43/f71 0 2024-08-01T06:56:05.992 INFO:tasks.workunit.client.1.smithi089.stdout:7/800: dwrite d7/d1f/d30/f6a [0,4194304] 0 2024-08-01T06:56:05.992 INFO:tasks.workunit.client.1.smithi089.stdout:5/865: dread d5/de/d57/d8e/d97/da5/dde/de9/fca [0,4194304] 0 2024-08-01T06:56:05.995 INFO:tasks.workunit.client.1.smithi089.stdout:7/801: dread - d7/df/d10/d31/f110 zero size 2024-08-01T06:56:05.999 INFO:tasks.workunit.client.1.smithi089.stdout:7/802: fdatasync d7/df/d91/da4/dca/ff6 0 2024-08-01T06:56:05.999 INFO:tasks.workunit.client.1.smithi089.stdout:5/866: write d5/de/f34 [926295,50373] 0 2024-08-01T06:56:06.001 INFO:tasks.workunit.client.1.smithi089.stdout:3/662: dwrite d7/fb0 [0,4194304] 0 2024-08-01T06:56:06.003 INFO:tasks.workunit.client.1.smithi089.stdout:7/803: chown d7/df/d10/c12 26939482 1 2024-08-01T06:56:06.005 INFO:tasks.workunit.client.1.smithi089.stdout:7/804: fsync d7/d1f/d30/d4c/dbc/dcd/d104/fd9 0 2024-08-01T06:56:06.009 INFO:tasks.workunit.client.1.smithi089.stdout:1/891: truncate d0/d9/d15/d76/f88 460464 0 2024-08-01T06:56:06.015 INFO:tasks.workunit.client.1.smithi089.stdout:8/923: dread d5/f9c [0,4194304] 0 2024-08-01T06:56:06.017 INFO:tasks.workunit.client.1.smithi089.stdout:7/805: dwrite d7/d1f/d30/dab/fc5 [0,4194304] 0 2024-08-01T06:56:06.018 INFO:tasks.workunit.client.1.smithi089.stdout:5/867: dwrite d5/dac/d105/dbd/fbf [0,4194304] 0 2024-08-01T06:56:06.020 INFO:tasks.workunit.client.1.smithi089.stdout:1/892: dread d0/d9/d15/d2d/d4a/d61/fab [0,4194304] 0 2024-08-01T06:56:06.023 INFO:tasks.workunit.client.1.smithi089.stdout:8/924: rename d5/d23/dd3/lf3 to d5/d15/d5a/d73/daa/l13e 0 2024-08-01T06:56:06.026 INFO:tasks.workunit.client.1.smithi089.stdout:1/893: write d0/f24 [4773932,28328] 0 2024-08-01T06:56:06.027 INFO:tasks.workunit.client.1.smithi089.stdout:5/868: creat d5/d13/d83/d106/f116 x:0 0 0 2024-08-01T06:56:06.031 INFO:tasks.workunit.client.1.smithi089.stdout:7/806: dwrite d7/df/d10/db3/fdf [0,4194304] 0 2024-08-01T06:56:06.032 INFO:tasks.workunit.client.1.smithi089.stdout:3/663: dwrite d7/d32/d4c/d69/d6d/f6e [0,4194304] 0 2024-08-01T06:56:06.032 INFO:tasks.workunit.client.1.smithi089.stdout:5/869: dread - d5/dac/d105/dbd/df0/d5d/fe3 zero size 2024-08-01T06:56:06.034 INFO:tasks.workunit.client.1.smithi089.stdout:8/925: dread d5/dc/d12/f40 [0,4194304] 0 2024-08-01T06:56:06.039 INFO:tasks.workunit.client.1.smithi089.stdout:3/664: creat d7/d68/d50/d6f/d2f/d9c/fd7 x:0 0 0 2024-08-01T06:56:06.039 INFO:tasks.workunit.client.1.smithi089.stdout:5/870: write d5/de/d10/d33/d5e/d7e/d9e/db1/ffb [80017,98854] 0 2024-08-01T06:56:06.039 INFO:tasks.workunit.client.1.smithi089.stdout:7/807: mknod d7/d1f/d30/c117 0 2024-08-01T06:56:06.041 INFO:tasks.workunit.client.1.smithi089.stdout:8/926: write d5/d23/f48 [8633795,92878] 0 2024-08-01T06:56:06.043 INFO:tasks.workunit.client.1.smithi089.stdout:3/665: stat d7/d68/d50/d6f/d2f/d9c/fd0 0 2024-08-01T06:56:06.043 INFO:tasks.workunit.client.1.smithi089.stdout:7/808: write d7/fb [3619972,27113] 0 2024-08-01T06:56:06.045 INFO:tasks.workunit.client.1.smithi089.stdout:8/927: dread - d5/da6/f12a zero size 2024-08-01T06:56:06.045 INFO:tasks.workunit.client.1.smithi089.stdout:3/666: chown d7/d32/d12/d29/d39 1 1 2024-08-01T06:56:06.047 INFO:tasks.workunit.client.1.smithi089.stdout:7/809: write d7/df/d91/da4/dca/ffa [1764406,107750] 0 2024-08-01T06:56:06.048 INFO:tasks.workunit.client.1.smithi089.stdout:7/810: dread - d7/fc7 zero size 2024-08-01T06:56:06.050 INFO:tasks.workunit.client.1.smithi089.stdout:5/871: creat d5/de/d10/d33/d5e/d7e/d9e/f117 x:0 0 0 2024-08-01T06:56:06.053 INFO:tasks.workunit.client.1.smithi089.stdout:3/667: unlink d7/d32/d12/d29/c7c 0 2024-08-01T06:56:06.054 INFO:tasks.workunit.client.1.smithi089.stdout:8/928: link d5/dc/d94/l6a d5/dc/d94/dc7/dc5/l13f 0 2024-08-01T06:56:06.055 INFO:tasks.workunit.client.1.smithi089.stdout:1/894: truncate d0/d9/d15/d2d/d4a/f5e 709545 0 2024-08-01T06:56:06.056 INFO:tasks.workunit.client.1.smithi089.stdout:3/668: dread - d7/d32/d4c/d67/fac zero size 2024-08-01T06:56:06.059 INFO:tasks.workunit.client.1.smithi089.stdout:7/811: dwrite d7/d1f/d30/f6a [4194304,4194304] 0 2024-08-01T06:56:06.059 INFO:tasks.workunit.client.1.smithi089.stdout:5/872: mkdir d5/dac/d105/dbd/df0/d5d/d6c/d8b/d118 0 2024-08-01T06:56:06.062 INFO:tasks.workunit.client.1.smithi089.stdout:7/812: rmdir d7/df/d10 39 2024-08-01T06:56:06.068 INFO:tasks.workunit.client.1.smithi089.stdout:1/895: dwrite d0/f23 [0,4194304] 0 2024-08-01T06:56:06.068 INFO:tasks.workunit.client.1.smithi089.stdout:8/929: dwrite d5/d15/fcb [0,4194304] 0 2024-08-01T06:56:06.070 INFO:tasks.workunit.client.1.smithi089.stdout:7/813: mknod d7/df/d10/d31/d4a/c118 0 2024-08-01T06:56:06.075 INFO:tasks.workunit.client.1.smithi089.stdout:3/669: truncate d7/d32/d12/d1b/f51 3667870 0 2024-08-01T06:56:06.077 INFO:tasks.workunit.client.1.smithi089.stdout:7/814: mkdir d7/d46/d7b/d119 0 2024-08-01T06:56:06.080 INFO:tasks.workunit.client.1.smithi089.stdout:1/896: dwrite d0/d9/d15/d7a/d106/f109 [0,4194304] 0 2024-08-01T06:56:06.083 INFO:tasks.workunit.client.1.smithi089.stdout:7/815: symlink d7/df/d10/d31/l11a 0 2024-08-01T06:56:06.085 INFO:tasks.workunit.client.1.smithi089.stdout:3/670: mkdir d7/d68/d50/d6f/d46/dd1/dd8 0 2024-08-01T06:56:06.086 INFO:tasks.workunit.client.1.smithi089.stdout:5/873: dread f0 [0,4194304] 0 2024-08-01T06:56:06.087 INFO:tasks.workunit.client.1.smithi089.stdout:7/816: creat d7/df/d10/db3/f11b x:0 0 0 2024-08-01T06:56:06.091 INFO:tasks.workunit.client.1.smithi089.stdout:3/671: creat d7/d32/d12/d29/d39/d4b/fd9 x:0 0 0 2024-08-01T06:56:06.091 INFO:tasks.workunit.client.1.smithi089.stdout:5/874: creat d5/de/d57/d8e/d97/df5/f119 x:0 0 0 2024-08-01T06:56:06.093 INFO:tasks.workunit.client.1.smithi089.stdout:5/875: chown d5/dac/d105/dbd/df0/d5d 255503954 1 2024-08-01T06:56:06.094 INFO:tasks.workunit.client.1.smithi089.stdout:1/897: rename d0/d9/d15/d7a to d0/d9/d15/d3b/d95/d49/d82/d124 0 2024-08-01T06:56:06.095 INFO:tasks.workunit.client.1.smithi089.stdout:3/672: write d7/d32/d12/d29/d39/d4b/fd9 [865642,58933] 0 2024-08-01T06:56:06.098 INFO:tasks.workunit.client.1.smithi089.stdout:7/817: mknod d7/df/d10/d42/d4e/c11c 0 2024-08-01T06:56:06.100 INFO:tasks.workunit.client.1.smithi089.stdout:3/673: read d7/f1f [170148,14113] 0 2024-08-01T06:56:06.100 INFO:tasks.workunit.client.1.smithi089.stdout:8/930: dwrite d5/dc/d94/f55 [0,4194304] 0 2024-08-01T06:56:06.101 INFO:tasks.workunit.client.1.smithi089.stdout:5/876: symlink d5/dac/d105/dbd/l11a 0 2024-08-01T06:56:06.103 INFO:tasks.workunit.client.1.smithi089.stdout:3/674: creat d7/d68/d3d/fda x:0 0 0 2024-08-01T06:56:06.103 INFO:tasks.workunit.client.1.smithi089.stdout:8/931: read d5/d15/fcb [98868,99838] 0 2024-08-01T06:56:06.107 INFO:tasks.workunit.client.1.smithi089.stdout:4/861: sync 2024-08-01T06:56:06.113 INFO:tasks.workunit.client.1.smithi089.stdout:7/818: dwrite d7/d1f/da6/f10d [0,4194304] 0 2024-08-01T06:56:06.114 INFO:tasks.workunit.client.1.smithi089.stdout:4/862: mkdir d3/d17/d3a/d4a/d105 0 2024-08-01T06:56:06.120 INFO:tasks.workunit.client.1.smithi089.stdout:4/863: mknod d3/db/de/dbe/c106 0 2024-08-01T06:56:06.120 INFO:tasks.workunit.client.1.smithi089.stdout:5/877: dwrite d5/de/d10/fe8 [0,4194304] 0 2024-08-01T06:56:06.121 INFO:tasks.workunit.client.1.smithi089.stdout:3/675: dwrite d7/d32/d4c/d53/f99 [0,4194304] 0 2024-08-01T06:56:06.122 INFO:tasks.workunit.client.1.smithi089.stdout:8/932: write d5/d23/dd3/f107 [65910,66152] 0 2024-08-01T06:56:06.126 INFO:tasks.workunit.client.1.smithi089.stdout:1/898: dread d0/d9/d15/d3b/f3c [0,4194304] 0 2024-08-01T06:56:06.128 INFO:tasks.workunit.client.1.smithi089.stdout:8/933: readlink d5/dc/d94/dc7/lb1 0 2024-08-01T06:56:06.129 INFO:tasks.workunit.client.1.smithi089.stdout:7/819: dwrite d7/df/fb9 [0,4194304] 0 2024-08-01T06:56:06.129 INFO:tasks.workunit.client.1.smithi089.stdout:5/878: read d5/d13/d38/d42/f55 [2879007,122271] 0 2024-08-01T06:56:06.132 INFO:tasks.workunit.client.1.smithi089.stdout:1/899: write d0/d9/d15/dce/dd3/fe5 [3178143,126712] 0 2024-08-01T06:56:06.134 INFO:tasks.workunit.client.1.smithi089.stdout:3/676: write d7/d32/d4c/f85 [618582,27508] 0 2024-08-01T06:56:06.135 INFO:tasks.workunit.client.1.smithi089.stdout:4/864: creat d3/d17/d3a/d4a/de1/dfc/f107 x:0 0 0 2024-08-01T06:56:06.136 INFO:tasks.workunit.client.1.smithi089.stdout:5/879: mkdir d5/d13/d43/dc5/d100/d10d/d11b 0 2024-08-01T06:56:06.136 INFO:tasks.workunit.client.1.smithi089.stdout:8/934: mknod d5/dc/d94/d84/d124/c140 0 2024-08-01T06:56:06.137 INFO:tasks.workunit.client.1.smithi089.stdout:7/820: mkdir d7/df/d10/d42/d4e/d11d 0 2024-08-01T06:56:06.138 INFO:tasks.workunit.client.1.smithi089.stdout:1/900: creat d0/d9/d15/d3b/f125 x:0 0 0 2024-08-01T06:56:06.139 INFO:tasks.workunit.client.1.smithi089.stdout:3/677: unlink d7/d32/d4c/d69/d6d/fb7 0 2024-08-01T06:56:06.140 INFO:tasks.workunit.client.1.smithi089.stdout:8/935: truncate d5/dc/d94/dc7/dba/f12f 1045551 0 2024-08-01T06:56:06.141 INFO:tasks.workunit.client.1.smithi089.stdout:7/821: mknod d7/d1f/da6/c11e 0 2024-08-01T06:56:06.142 INFO:tasks.workunit.client.1.smithi089.stdout:4/865: fsync d3/db/de/d5b/db9/fff 0 2024-08-01T06:56:06.143 INFO:tasks.workunit.client.1.smithi089.stdout:5/880: creat d5/de/f11c x:0 0 0 2024-08-01T06:56:06.143 INFO:tasks.workunit.client.1.smithi089.stdout:3/678: symlink d7/dce/ldb 0 2024-08-01T06:56:06.145 INFO:tasks.workunit.client.1.smithi089.stdout:3/679: chown d7/d32/l22 248 1 2024-08-01T06:56:06.145 INFO:tasks.workunit.client.1.smithi089.stdout:4/866: truncate d3/d86/d9e/fef 592400 0 2024-08-01T06:56:06.145 INFO:tasks.workunit.client.1.smithi089.stdout:1/901: truncate d0/d9/d15/d2d/d4a/d61/f67 1493561 0 2024-08-01T06:56:06.146 INFO:tasks.workunit.client.1.smithi089.stdout:3/680: write d7/d68/d3d/fda [242286,104018] 0 2024-08-01T06:56:06.147 INFO:tasks.workunit.client.1.smithi089.stdout:4/867: creat d3/db/de/dbe/f108 x:0 0 0 2024-08-01T06:56:06.148 INFO:tasks.workunit.client.1.smithi089.stdout:7/822: rename d7/d1f/d3a/f41 to d7/d1f/f11f 0 2024-08-01T06:56:06.149 INFO:tasks.workunit.client.1.smithi089.stdout:1/902: symlink d0/d9/d15/d3b/d3d/d77/d8f/l126 0 2024-08-01T06:56:06.150 INFO:tasks.workunit.client.1.smithi089.stdout:7/823: write d7/df/d91/da4/f5f [3794890,121519] 0 2024-08-01T06:56:06.150 INFO:tasks.workunit.client.1.smithi089.stdout:3/681: mkdir d7/d32/d4c/d67/db4/ddc 0 2024-08-01T06:56:06.150 INFO:tasks.workunit.client.1.smithi089.stdout:4/868: write d3/d86/d9e/db1/fe5 [15107,77316] 0 2024-08-01T06:56:06.152 INFO:tasks.workunit.client.1.smithi089.stdout:7/824: chown d7/df/d10/d42/lce 15555 1 2024-08-01T06:56:06.152 INFO:tasks.workunit.client.1.smithi089.stdout:4/869: chown d3/db/d16/d35/fc6 2736942 1 2024-08-01T06:56:06.153 INFO:tasks.workunit.client.1.smithi089.stdout:1/903: mkdir d0/d9/d15/d76/d113/d127 0 2024-08-01T06:56:06.158 INFO:tasks.workunit.client.1.smithi089.stdout:7/825: link d7/df/d91/da4/dca/fd3 d7/d1f/d3a/f120 0 2024-08-01T06:56:06.159 INFO:tasks.workunit.client.1.smithi089.stdout:1/904: fsync d0/d9/d43/d4b/db0/fbd 0 2024-08-01T06:56:06.160 INFO:tasks.workunit.client.1.smithi089.stdout:3/682: dwrite d7/d32/d4c/d69/d6d/fa6 [0,4194304] 0 2024-08-01T06:56:06.161 INFO:tasks.workunit.client.1.smithi089.stdout:7/826: chown d7/df/d10/d31/d4a/fb0 1261684 1 2024-08-01T06:56:06.162 INFO:tasks.workunit.client.1.smithi089.stdout:3/683: fsync d7/d32/d4c/d67/d72/d91/dcb/f87 0 2024-08-01T06:56:06.166 INFO:tasks.workunit.client.1.smithi089.stdout:4/870: truncate d3/d86/d9e/db1/dbb/d62/d31/f4b 589557 0 2024-08-01T06:56:06.167 INFO:tasks.workunit.client.1.smithi089.stdout:7/827: rmdir d7/d1f/d30/d4c/dbc/dcd/dd7 39 2024-08-01T06:56:06.169 INFO:tasks.workunit.client.1.smithi089.stdout:1/905: mknod d0/d9/d15/d3b/d3d/c128 0 2024-08-01T06:56:06.170 INFO:tasks.workunit.client.1.smithi089.stdout:7/828: readlink d7/d1f/d30/la2 0 2024-08-01T06:56:06.171 INFO:tasks.workunit.client.1.smithi089.stdout:1/906: stat d0/d9/d15/d2d/ffc 0 2024-08-01T06:56:06.173 INFO:tasks.workunit.client.1.smithi089.stdout:7/829: chown d7/d1f/f84 4 1 2024-08-01T06:56:06.174 INFO:tasks.workunit.client.1.smithi089.stdout:3/684: dwrite d7/d32/d4c/d69/fb9 [0,4194304] 0 2024-08-01T06:56:06.177 INFO:tasks.workunit.client.1.smithi089.stdout:1/907: fdatasync d0/d9/d15/dce/dd3/fe5 0 2024-08-01T06:56:06.177 INFO:tasks.workunit.client.1.smithi089.stdout:4/871: dwrite d3/db/de/d5b/f91 [0,4194304] 0 2024-08-01T06:56:06.181 INFO:tasks.workunit.client.1.smithi089.stdout:4/872: read d3/d17/d3a/f5d [3810938,59273] 0 2024-08-01T06:56:06.181 INFO:tasks.workunit.client.1.smithi089.stdout:1/908: stat d0/d9/d15/d2b/d7d/d111 0 2024-08-01T06:56:06.184 INFO:tasks.workunit.client.1.smithi089.stdout:3/685: getdents d7/d68/d50/d6f/d46/dd1 0 2024-08-01T06:56:06.185 INFO:tasks.workunit.client.1.smithi089.stdout:4/873: mkdir d3/d109 0 2024-08-01T06:56:06.186 INFO:tasks.workunit.client.1.smithi089.stdout:3/686: chown d7/c92 13834206 1 2024-08-01T06:56:06.187 INFO:tasks.workunit.client.1.smithi089.stdout:3/687: readlink d7/d32/d4c/d53/l6a 0 2024-08-01T06:56:06.190 INFO:tasks.workunit.client.1.smithi089.stdout:1/909: dwrite d0/d9/d15/d3b/d3d/f118 [0,4194304] 0 2024-08-01T06:56:06.192 INFO:tasks.workunit.client.1.smithi089.stdout:4/874: rename d3/d86/d9e/db1/dbb/fed to d3/d17/d3a/d4a/de1/d103/f10a 0 2024-08-01T06:56:06.192 INFO:tasks.workunit.client.1.smithi089.stdout:3/688: mknod d7/d32/d4c/d67/d72/cdd 0 2024-08-01T06:56:06.194 INFO:tasks.workunit.client.1.smithi089.stdout:1/910: mknod d0/dd9/c129 0 2024-08-01T06:56:06.195 INFO:tasks.workunit.client.1.smithi089.stdout:4/875: write d3/d68/f7f [3130606,111891] 0 2024-08-01T06:56:06.197 INFO:tasks.workunit.client.1.smithi089.stdout:1/911: chown d0/d9/d15/d3b/d95/d49/fc8 23479 1 2024-08-01T06:56:06.197 INFO:tasks.workunit.client.1.smithi089.stdout:3/689: dread d7/d32/d12/d1b/f3c [0,4194304] 0 2024-08-01T06:56:06.198 INFO:tasks.workunit.client.1.smithi089.stdout:1/912: dread - d0/d9/d15/d3b/d95/d49/d82/da6/f123 zero size 2024-08-01T06:56:06.200 INFO:tasks.workunit.client.1.smithi089.stdout:4/876: creat d3/db/d33/f10b x:0 0 0 2024-08-01T06:56:06.201 INFO:tasks.workunit.client.1.smithi089.stdout:3/690: creat d7/d32/d4c/d67/d72/d91/dcb/da9/fde x:0 0 0 2024-08-01T06:56:06.201 INFO:tasks.workunit.client.1.smithi089.stdout:7/830: dread d7/d1f/f11f [0,4194304] 0 2024-08-01T06:56:06.202 INFO:tasks.workunit.client.1.smithi089.stdout:1/913: mkdir d0/d9/d15/d2d/d4a/d104/d12a 0 2024-08-01T06:56:06.203 INFO:tasks.workunit.client.1.smithi089.stdout:3/691: chown d7/d32/d4c/d69/d6d/f6e 486 1 2024-08-01T06:56:06.203 INFO:tasks.workunit.client.1.smithi089.stdout:4/877: symlink d3/d1e/l10c 0 2024-08-01T06:56:06.206 INFO:tasks.workunit.client.1.smithi089.stdout:4/878: stat d3/d86/d9e/db1/dbb/d62/d3b/c72 0 2024-08-01T06:56:06.208 INFO:tasks.workunit.client.1.smithi089.stdout:3/692: rename d7/d32/l1c to d7/d32/d12/d29/d39/d4b/dd2/ldf 0 2024-08-01T06:56:06.211 INFO:tasks.workunit.client.1.smithi089.stdout:1/914: dread d0/d9/d15/d2d/d4a/d61/f67 [0,4194304] 0 2024-08-01T06:56:06.211 INFO:tasks.workunit.client.1.smithi089.stdout:4/879: getdents d3/d17/d3a/d3d 0 2024-08-01T06:56:06.218 INFO:tasks.workunit.client.1.smithi089.stdout:1/915: creat d0/d9/d15/d2d/d4a/d104/d12a/f12b x:0 0 0 2024-08-01T06:56:06.219 INFO:tasks.workunit.client.1.smithi089.stdout:7/831: write d7/df/d91/da4/f44 [2213401,75629] 0 2024-08-01T06:56:06.219 INFO:tasks.workunit.client.1.smithi089.stdout:4/880: dread d3/f24 [0,4194304] 0 2024-08-01T06:56:06.219 INFO:tasks.workunit.client.1.smithi089.stdout:1/916: rename d0/d9/d15/f52 to d0/d9/d15/d76/d113/f12c 0 2024-08-01T06:56:06.220 INFO:tasks.workunit.client.1.smithi089.stdout:7/832: creat d7/d46/d7b/d119/f121 x:0 0 0 2024-08-01T06:56:06.221 INFO:tasks.workunit.client.1.smithi089.stdout:4/881: creat d3/d17/d3a/d4a/de1/f10d x:0 0 0 2024-08-01T06:56:06.221 INFO:tasks.workunit.client.1.smithi089.stdout:1/917: fdatasync d0/d9/d15/d2d/d4a/ded/f100 0 2024-08-01T06:56:06.222 INFO:tasks.workunit.client.1.smithi089.stdout:7/833: write d7/d1f/d30/dab/fc5 [2796394,110494] 0 2024-08-01T06:56:06.223 INFO:tasks.workunit.client.1.smithi089.stdout:1/918: write d0/d9/d43/f5c [1902785,97445] 0 2024-08-01T06:56:06.223 INFO:tasks.workunit.client.1.smithi089.stdout:7/834: chown d7/df/d91/da4/dca/ff6 10 1 2024-08-01T06:56:06.225 INFO:tasks.workunit.client.1.smithi089.stdout:1/919: symlink d0/d9/d15/d76/l12d 0 2024-08-01T06:56:06.226 INFO:tasks.workunit.client.1.smithi089.stdout:7/835: fsync d7/df/d10/d31/d43/f88 0 2024-08-01T06:56:06.227 INFO:tasks.workunit.client.1.smithi089.stdout:1/920: read d0/d9/d15/d76/f9a [82529,101699] 0 2024-08-01T06:56:06.227 INFO:tasks.workunit.client.1.smithi089.stdout:4/882: getdents d3/d17/d3a/d4a/de1/d103 0 2024-08-01T06:56:06.230 INFO:tasks.workunit.client.1.smithi089.stdout:4/883: mknod d3/db/d16/d35/c10e 0 2024-08-01T06:56:06.231 INFO:tasks.workunit.client.1.smithi089.stdout:7/836: rename d7/df/d10/d31/cdd to d7/df/d91/c122 0 2024-08-01T06:56:06.233 INFO:tasks.workunit.client.1.smithi089.stdout:1/921: creat d0/d9/de1/f12e x:0 0 0 2024-08-01T06:56:06.234 INFO:tasks.workunit.client.1.smithi089.stdout:7/837: creat d7/df/d10/dd6/f123 x:0 0 0 2024-08-01T06:56:06.234 INFO:tasks.workunit.client.1.smithi089.stdout:4/884: symlink d3/d86/db7/dd2/df4/l10f 0 2024-08-01T06:56:06.236 INFO:tasks.workunit.client.1.smithi089.stdout:7/838: symlink d7/d46/d7b/l124 0 2024-08-01T06:56:06.236 INFO:tasks.workunit.client.1.smithi089.stdout:4/885: fsync d3/d17/d3a/d4a/de1/d103/fb2 0 2024-08-01T06:56:06.236 INFO:tasks.workunit.client.1.smithi089.stdout:1/922: rename d0/d9/d15/d3b/d3d/f85 to d0/d9/d15/d3b/f12f 0 2024-08-01T06:56:06.237 INFO:tasks.workunit.client.1.smithi089.stdout:7/839: chown d7/d1f/d30/d4c/dbc/dcd/d104/lc9 2 1 2024-08-01T06:56:06.237 INFO:tasks.workunit.client.1.smithi089.stdout:4/886: read d3/d17/d3a/d4a/de1/d103/fb2 [692892,55652] 0 2024-08-01T06:56:06.237 INFO:tasks.workunit.client.1.smithi089.stdout:1/923: fsync d0/d9/d15/d76/f10c 0 2024-08-01T06:56:06.239 INFO:tasks.workunit.client.1.smithi089.stdout:1/924: fsync d0/d9/d43/fec 0 2024-08-01T06:56:06.241 INFO:tasks.workunit.client.1.smithi089.stdout:7/840: creat d7/d1f/d30/d4c/dbc/dcd/f125 x:0 0 0 2024-08-01T06:56:06.241 INFO:tasks.workunit.client.1.smithi089.stdout:1/925: mkdir d0/d9/d15/d3b/d3d/d77/d8f/d130 0 2024-08-01T06:56:06.242 INFO:tasks.workunit.client.1.smithi089.stdout:7/841: fsync d7/df/d91/da4/f44 0 2024-08-01T06:56:06.242 INFO:tasks.workunit.client.1.smithi089.stdout:7/842: write d7/df/f82 [3068956,18212] 0 2024-08-01T06:56:06.245 INFO:tasks.workunit.client.1.smithi089.stdout:7/843: symlink d7/d1f/d30/db1/l126 0 2024-08-01T06:56:06.246 INFO:tasks.workunit.client.1.smithi089.stdout:4/887: write d3/d86/d9e/fef [808055,19475] 0 2024-08-01T06:56:06.246 INFO:tasks.workunit.client.1.smithi089.stdout:7/844: truncate d7/d46/ffe 206824 0 2024-08-01T06:56:06.248 INFO:tasks.workunit.client.1.smithi089.stdout:7/845: chown d7/l5b 337521927 1 2024-08-01T06:56:06.249 INFO:tasks.workunit.client.1.smithi089.stdout:4/888: creat d3/d17/f110 x:0 0 0 2024-08-01T06:56:06.250 INFO:tasks.workunit.client.1.smithi089.stdout:4/889: mkdir d3/d86/db7/dd2/d111 0 2024-08-01T06:56:06.251 INFO:tasks.workunit.client.1.smithi089.stdout:7/846: getdents d7/df/d10/db3/de9 0 2024-08-01T06:56:06.252 INFO:tasks.workunit.client.1.smithi089.stdout:4/890: symlink d3/d86/d9e/db1/dbb/l112 0 2024-08-01T06:56:06.257 INFO:tasks.workunit.client.1.smithi089.stdout:4/891: link d3/d86/d9e/db1/dbb/d62/d31/f67 d3/d86/d9e/db1/dbb/d62/f113 0 2024-08-01T06:56:06.258 INFO:tasks.workunit.client.1.smithi089.stdout:4/892: readlink d3/d86/d9e/d57/la3 0 2024-08-01T06:56:06.259 INFO:tasks.workunit.client.1.smithi089.stdout:4/893: chown d3/d17/d3a/d4a/de1/feb 762536945 1 2024-08-01T06:56:06.260 INFO:tasks.workunit.client.1.smithi089.stdout:4/894: chown d3/d17/d3a/d4a/f55 2006657 1 2024-08-01T06:56:06.261 INFO:tasks.workunit.client.1.smithi089.stdout:4/895: stat d3/fb8 0 2024-08-01T06:56:06.263 INFO:tasks.workunit.client.1.smithi089.stdout:7/847: dread d7/df/d91/da4/f38 [0,4194304] 0 2024-08-01T06:56:06.263 INFO:tasks.workunit.client.1.smithi089.stdout:4/896: mknod d3/db/de/d5b/c114 0 2024-08-01T06:56:06.265 INFO:tasks.workunit.client.1.smithi089.stdout:4/897: symlink d3/d86/d9e/db1/dbb/d62/l115 0 2024-08-01T06:56:06.267 INFO:tasks.workunit.client.1.smithi089.stdout:7/848: dread d7/d1f/d3a/dad/fb2 [0,4194304] 0 2024-08-01T06:56:06.268 INFO:tasks.workunit.client.1.smithi089.stdout:2/807: sync 2024-08-01T06:56:06.268 INFO:tasks.workunit.client.1.smithi089.stdout:9/757: sync 2024-08-01T06:56:06.268 INFO:tasks.workunit.client.1.smithi089.stdout:6/880: sync 2024-08-01T06:56:06.268 INFO:tasks.workunit.client.1.smithi089.stdout:0/849: sync 2024-08-01T06:56:06.268 INFO:tasks.workunit.client.1.smithi089.stdout:4/898: symlink d3/d86/d9e/db1/dbb/d62/l116 0 2024-08-01T06:56:06.269 INFO:tasks.workunit.client.1.smithi089.stdout:6/881: stat d2/d30/l7e 0 2024-08-01T06:56:06.270 INFO:tasks.workunit.client.1.smithi089.stdout:2/808: write d7/d1f/d28/fa2 [3677823,5122] 0 2024-08-01T06:56:06.271 INFO:tasks.workunit.client.1.smithi089.stdout:9/758: symlink d18/d33/d49/d7b/d4b/lfd 0 2024-08-01T06:56:06.271 INFO:tasks.workunit.client.1.smithi089.stdout:4/899: truncate d3/d17/f9a 887861 0 2024-08-01T06:56:06.271 INFO:tasks.workunit.client.1.smithi089.stdout:7/849: getdents d7/df/d10/d42/d75 0 2024-08-01T06:56:06.272 INFO:tasks.workunit.client.1.smithi089.stdout:2/809: dread - d7/d19/d3b/d7c/ffb zero size 2024-08-01T06:56:06.273 INFO:tasks.workunit.client.1.smithi089.stdout:6/882: dread d2/fe [0,4194304] 0 2024-08-01T06:56:06.274 INFO:tasks.workunit.client.1.smithi089.stdout:0/850: link d9/d40/d45/d47/da8/fb3 d9/d40/d95/d99/dec/f10b 0 2024-08-01T06:56:06.274 INFO:tasks.workunit.client.1.smithi089.stdout:9/759: symlink d18/d33/df7/da6/lfe 0 2024-08-01T06:56:06.274 INFO:tasks.workunit.client.1.smithi089.stdout:2/810: write d7/d19/d1e/f2e [3490410,8407] 0 2024-08-01T06:56:06.275 INFO:tasks.workunit.client.1.smithi089.stdout:7/850: creat d7/df/d10/d31/dc4/f127 x:0 0 0 2024-08-01T06:56:06.276 INFO:tasks.workunit.client.1.smithi089.stdout:2/811: stat d7/d1f/d29/d48 0 2024-08-01T06:56:06.277 INFO:tasks.workunit.client.1.smithi089.stdout:6/883: symlink d2/d11/d1f/l120 0 2024-08-01T06:56:06.278 INFO:tasks.workunit.client.1.smithi089.stdout:6/884: fdatasync d2/d2e/d2f/d31/f41 0 2024-08-01T06:56:06.280 INFO:tasks.workunit.client.1.smithi089.stdout:7/851: creat d7/d1f/d30/d4c/dbc/dcd/d104/f128 x:0 0 0 2024-08-01T06:56:06.281 INFO:tasks.workunit.client.1.smithi089.stdout:6/885: stat d2/d11/d3e/df1 0 2024-08-01T06:56:06.282 INFO:tasks.workunit.client.1.smithi089.stdout:9/760: rename d18/da4/fa9 to d18/d22/d39/fff 0 2024-08-01T06:56:06.284 INFO:tasks.workunit.client.1.smithi089.stdout:0/851: dwrite d9/d40/d25/d46/d91/d2e/d44/d72/d8b/fe6 [0,4194304] 0 2024-08-01T06:56:06.286 INFO:tasks.workunit.client.1.smithi089.stdout:6/886: symlink d2/d11/d1f/d46/l121 0 2024-08-01T06:56:06.376 INFO:tasks.workunit.client.1.smithi089.stdout:4/900: getdents d3/d86/d9e/db1/dbb/d62 0 2024-08-01T06:56:06.376 INFO:tasks.workunit.client.1.smithi089.stdout:7/852: creat d7/d1f/da6/dbb/de7/deb/df3/f129 x:0 0 0 2024-08-01T06:56:06.376 INFO:tasks.workunit.client.1.smithi089.stdout:4/901: stat d3/d1e/l10c 0 2024-08-01T06:56:06.378 INFO:tasks.workunit.client.1.smithi089.stdout:7/853: dread - d7/df/d10/d31/d43/fec zero size 2024-08-01T06:56:06.380 INFO:tasks.workunit.client.1.smithi089.stdout:4/902: read d3/db/de/d5b/fb0 [3127198,50916] 0 2024-08-01T06:56:06.382 INFO:tasks.workunit.client.1.smithi089.stdout:9/761: getdents d18/d22/da2 0 2024-08-01T06:56:06.383 INFO:tasks.workunit.client.1.smithi089.stdout:0/852: write d9/d40/d95/d99/d2b/d55/fbe [398045,50231] 0 2024-08-01T06:56:06.386 INFO:tasks.workunit.client.1.smithi089.stdout:2/812: dwrite d7/d1f/d52/d6e/f102 [0,4194304] 0 2024-08-01T06:56:06.386 INFO:tasks.workunit.client.1.smithi089.stdout:4/903: mknod d3/d86/d9e/db1/dbb/d62/db3/c117 0 2024-08-01T06:56:06.387 INFO:tasks.workunit.client.1.smithi089.stdout:9/762: write d18/d33/d49/d7b/fad [378015,47287] 0 2024-08-01T06:56:06.393 INFO:tasks.workunit.client.1.smithi089.stdout:6/887: link d2/d30/d3c/c100 d2/d11/d1a/c122 0 2024-08-01T06:56:06.393 INFO:tasks.workunit.client.1.smithi089.stdout:0/853: mkdir d9/d40/d45/d47/da8/d10c 0 2024-08-01T06:56:06.393 INFO:tasks.workunit.client.1.smithi089.stdout:6/888: write d2/fe4 [111428,34837] 0 2024-08-01T06:56:06.393 INFO:tasks.workunit.client.1.smithi089.stdout:4/904: dread - d3/db/de/d5b/fc5 zero size 2024-08-01T06:56:06.393 INFO:tasks.workunit.client.1.smithi089.stdout:6/889: write d2/d11/d1f/d46/f105 [401691,97931] 0 2024-08-01T06:56:06.397 INFO:tasks.workunit.client.1.smithi089.stdout:6/890: readlink d2/d30/l7e 0 2024-08-01T06:56:06.397 INFO:tasks.workunit.client.1.smithi089.stdout:4/905: write d3/d86/d9e/fef [976176,45951] 0 2024-08-01T06:56:06.398 INFO:tasks.workunit.client.1.smithi089.stdout:4/906: readlink d3/d1e/lab 0 2024-08-01T06:56:06.401 INFO:tasks.workunit.client.1.smithi089.stdout:4/907: creat d3/d86/db7/f118 x:0 0 0 2024-08-01T06:56:06.404 INFO:tasks.workunit.client.1.smithi089.stdout:7/854: dread d7/d1f/d30/d4c/dbc/dcd/fed [0,4194304] 0 2024-08-01T06:56:06.405 INFO:tasks.workunit.client.1.smithi089.stdout:0/854: write d9/d40/d95/d99/f73 [4033176,19456] 0 2024-08-01T06:56:06.406 INFO:tasks.workunit.client.1.smithi089.stdout:2/813: dread d7/d19/d1e/f54 [0,4194304] 0 2024-08-01T06:56:06.407 INFO:tasks.workunit.client.1.smithi089.stdout:6/891: dwrite d2/d2e/d2f/f6d [4194304,4194304] 0 2024-08-01T06:56:06.413 INFO:tasks.workunit.client.1.smithi089.stdout:6/892: write d2/d2e/d2f/d9e/fc7 [1119846,126746] 0 2024-08-01T06:56:06.414 INFO:tasks.workunit.client.1.smithi089.stdout:7/855: rename d7/d1f/l80 to d7/df/d91/da4/l12a 0 2024-08-01T06:56:06.414 INFO:tasks.workunit.client.1.smithi089.stdout:9/763: dwrite d18/d22/d39/d95/fee [0,4194304] 0 2024-08-01T06:56:06.414 INFO:tasks.workunit.client.1.smithi089.stdout:0/855: write d9/d40/d25/d46/d91/d2e/d44/d53/daf/fd2 [1447734,50676] 0 2024-08-01T06:56:06.417 INFO:tasks.workunit.client.1.smithi089.stdout:8/936: sync 2024-08-01T06:56:06.419 INFO:tasks.workunit.client.1.smithi089.stdout:2/814: creat d7/d19/d1e/d3d/f103 x:0 0 0 2024-08-01T06:56:06.420 INFO:tasks.workunit.client.1.smithi089.stdout:7/856: symlink d7/df/d10/db3/de9/l12b 0 2024-08-01T06:56:06.423 INFO:tasks.workunit.client.1.smithi089.stdout:7/857: write d7/d1f/d30/f71 [3576641,14669] 0 2024-08-01T06:56:06.425 INFO:tasks.workunit.client.1.smithi089.stdout:2/815: fsync d7/d1f/d28/fd9 0 2024-08-01T06:56:06.430 INFO:tasks.workunit.client.1.smithi089.stdout:6/893: dwrite d2/d2e/d98/fe9 [0,4194304] 0 2024-08-01T06:56:06.431 INFO:tasks.workunit.client.1.smithi089.stdout:0/856: dwrite d9/d40/d45/d47/da8/fac [0,4194304] 0 2024-08-01T06:56:06.444 INFO:tasks.workunit.client.1.smithi089.stdout:9/764: dread d18/f1d [4194304,4194304] 0 2024-08-01T06:56:06.450 INFO:tasks.workunit.client.1.smithi089.stdout:9/765: dwrite d18/d33/d49/d7b/d7f/d98/d9f/d8e/fa1 [0,4194304] 0 2024-08-01T06:56:06.482 INFO:tasks.workunit.client.1.smithi089.stdout:7/858: rename d7/d1f/da6 to d7/d46/d7b/d12c 0 2024-08-01T06:56:06.486 INFO:tasks.workunit.client.1.smithi089.stdout:6/894: creat d2/d11/d1a/d1c/d40/f123 x:0 0 0 2024-08-01T06:56:06.488 INFO:tasks.workunit.client.1.smithi089.stdout:7/859: dwrite d7/df/d10/d42/d4e/f96 [0,4194304] 0 2024-08-01T06:56:06.491 INFO:tasks.workunit.client.1.smithi089.stdout:9/766: chown d18/d33/d3b/c97 47 1 2024-08-01T06:56:06.494 INFO:tasks.workunit.client.1.smithi089.stdout:7/860: unlink d7/df/d10/d42/f8e 0 2024-08-01T06:56:06.495 INFO:tasks.workunit.client.1.smithi089.stdout:2/816: link d7/d19/d3b/d7c/cda d7/d1f/d52/d72/c104 0 2024-08-01T06:56:06.495 INFO:tasks.workunit.client.1.smithi089.stdout:6/895: symlink d2/d11/d1f/d46/d6b/d7d/dff/l124 0 2024-08-01T06:56:06.498 INFO:tasks.workunit.client.1.smithi089.stdout:2/817: fsync d7/d1f/d52/d6e/fbb 0 2024-08-01T06:56:06.498 INFO:tasks.workunit.client.1.smithi089.stdout:8/937: dwrite d5/d15/d5a/d73/f125 [0,4194304] 0 2024-08-01T06:56:06.499 INFO:tasks.workunit.client.1.smithi089.stdout:9/767: rename d18/d33/d49/d7b/d4b/fd5 to d18/d22/d52/f100 0 2024-08-01T06:56:06.501 INFO:tasks.workunit.client.1.smithi089.stdout:7/861: symlink d7/df/d10/d42/l12d 0 2024-08-01T06:56:06.503 INFO:tasks.workunit.client.1.smithi089.stdout:7/862: write d7/fd [4547761,108147] 0 2024-08-01T06:56:06.505 INFO:tasks.workunit.client.1.smithi089.stdout:7/863: chown d7/df/c66 2 1 2024-08-01T06:56:06.505 INFO:tasks.workunit.client.1.smithi089.stdout:6/896: creat d2/d11/d1f/d46/d6b/d7d/f125 x:0 0 0 2024-08-01T06:56:06.510 INFO:tasks.workunit.client.1.smithi089.stdout:8/938: rename d5/dc/d1e/fce to d5/d15/d5a/d73/daa/f141 0 2024-08-01T06:56:06.512 INFO:tasks.workunit.client.1.smithi089.stdout:7/864: creat d7/df/d10/dd6/dee/f12e x:0 0 0 2024-08-01T06:56:06.513 INFO:tasks.workunit.client.1.smithi089.stdout:6/897: dread - d2/d11/d1a/d1c/dea/ff8 zero size 2024-08-01T06:56:06.514 INFO:tasks.workunit.client.1.smithi089.stdout:0/857: dwrite d9/d40/d95/d99/d2b/f80 [0,4194304] 0 2024-08-01T06:56:06.515 INFO:tasks.workunit.client.1.smithi089.stdout:2/818: dwrite d7/d19/d1e/fbe [0,4194304] 0 2024-08-01T06:56:06.518 INFO:tasks.workunit.client.1.smithi089.stdout:5/881: sync 2024-08-01T06:56:06.521 INFO:tasks.workunit.client.1.smithi089.stdout:2/819: write d7/d19/d1e/f8d [1047600,38440] 0 2024-08-01T06:56:06.521 INFO:tasks.workunit.client.1.smithi089.stdout:8/939: mkdir d5/dc/d94/dc7/dba/d100/d142 0 2024-08-01T06:56:06.523 INFO:tasks.workunit.client.1.smithi089.stdout:9/768: write d18/d22/da2/fd8 [677627,48790] 0 2024-08-01T06:56:06.526 INFO:tasks.workunit.client.1.smithi089.stdout:0/858: mkdir d9/d40/d25/d46/d91/d2e/d44/d72/d104/d10d 0 2024-08-01T06:56:06.528 INFO:tasks.workunit.client.1.smithi089.stdout:7/865: dwrite d7/df/d10/f83 [8388608,4194304] 0 2024-08-01T06:56:06.530 INFO:tasks.workunit.client.1.smithi089.stdout:7/866: chown d7/d1f/cba 1654687 1 2024-08-01T06:56:06.531 INFO:tasks.workunit.client.1.smithi089.stdout:8/940: write d5/dc/d1e/fb5 [4993999,28308] 0 2024-08-01T06:56:06.535 INFO:tasks.workunit.client.1.smithi089.stdout:7/867: fdatasync d7/df/d91/da4/dca/ffa 0 2024-08-01T06:56:06.536 INFO:tasks.workunit.client.1.smithi089.stdout:7/868: dread - d7/df/d10/db3/f11b zero size 2024-08-01T06:56:06.537 INFO:tasks.workunit.client.1.smithi089.stdout:9/769: link fa d18/d22/d39/d95/f101 0 2024-08-01T06:56:06.538 INFO:tasks.workunit.client.1.smithi089.stdout:0/859: mkdir d9/d40/d25/d46/d91/d2e/d44/d72/d104/d10d/d10e 0 2024-08-01T06:56:06.540 INFO:tasks.workunit.client.1.smithi089.stdout:2/820: write d7/d1f/f20 [1688,69549] 0 2024-08-01T06:56:06.543 INFO:tasks.workunit.client.1.smithi089.stdout:7/869: write d7/df/fd8 [970232,104451] 0 2024-08-01T06:56:06.544 INFO:tasks.workunit.client.1.smithi089.stdout:2/821: rmdir d7/d4a 39 2024-08-01T06:56:06.546 INFO:tasks.workunit.client.1.smithi089.stdout:8/941: dwrite d5/dc/fa1 [0,4194304] 0 2024-08-01T06:56:06.546 INFO:tasks.workunit.client.1.smithi089.stdout:0/860: creat d9/d40/d95/d99/dec/f10f x:0 0 0 2024-08-01T06:56:06.548 INFO:tasks.workunit.client.1.smithi089.stdout:8/942: stat d5/d15/d5e/fe4 0 2024-08-01T06:56:06.554 INFO:tasks.workunit.client.1.smithi089.stdout:7/870: getdents d7/df/d3b/d64 0 2024-08-01T06:56:06.555 INFO:tasks.workunit.client.1.smithi089.stdout:8/943: symlink d5/dc/d94/d84/ddb/l143 0 2024-08-01T06:56:06.555 INFO:tasks.workunit.client.1.smithi089.stdout:9/770: dwrite d18/d22/d52/f54 [0,4194304] 0 2024-08-01T06:56:06.555 INFO:tasks.workunit.client.1.smithi089.stdout:2/822: truncate d7/d19/d1e/d5b/f8e 3038473 0 2024-08-01T06:56:06.556 INFO:tasks.workunit.client.1.smithi089.stdout:5/882: dread d5/de/d10/d16/d1b/f39 [0,4194304] 0 2024-08-01T06:56:06.557 INFO:tasks.workunit.client.1.smithi089.stdout:7/871: fsync d7/d1f/d30/db1/f106 0 2024-08-01T06:56:06.560 INFO:tasks.workunit.client.1.smithi089.stdout:0/861: creat d9/d40/d25/d46/d91/d2e/d44/f110 x:0 0 0 2024-08-01T06:56:06.563 INFO:tasks.workunit.client.1.smithi089.stdout:9/771: read d18/d33/d49/d7b/d7f/d98/d9f/d8e/f96 [2321169,52464] 0 2024-08-01T06:56:06.564 INFO:tasks.workunit.client.1.smithi089.stdout:5/883: creat d5/dac/d105/dbd/df0/f11d x:0 0 0 2024-08-01T06:56:06.565 INFO:tasks.workunit.client.1.smithi089.stdout:7/872: rename d7/d1f/d30/ca1 to d7/d46/d7b/d12c/c12f 0 2024-08-01T06:56:06.566 INFO:tasks.workunit.client.1.smithi089.stdout:9/772: write d18/d33/df7/f56 [4509192,24799] 0 2024-08-01T06:56:06.568 INFO:tasks.workunit.client.1.smithi089.stdout:5/884: readlink d5/d13/d38/l50 0 2024-08-01T06:56:06.572 INFO:tasks.workunit.client.1.smithi089.stdout:8/944: dwrite d5/dc/d1e/d53/fa0 [0,4194304] 0 2024-08-01T06:56:06.572 INFO:tasks.workunit.client.1.smithi089.stdout:9/773: fsync d18/d33/d49/d7b/d4b/db6/fdb 0 2024-08-01T06:56:06.572 INFO:tasks.workunit.client.1.smithi089.stdout:2/823: rmdir d7/d19 39 2024-08-01T06:56:06.579 INFO:tasks.workunit.client.1.smithi089.stdout:7/873: getdents d7/df/d10/dd6 0 2024-08-01T06:56:06.579 INFO:tasks.workunit.client.1.smithi089.stdout:8/945: dread - d5/dc/d94/dc7/dba/df5/f130 zero size 2024-08-01T06:56:06.579 INFO:tasks.workunit.client.1.smithi089.stdout:9/774: chown d18/d22/d43/l4c 11287158 1 2024-08-01T06:56:06.580 INFO:tasks.workunit.client.1.smithi089.stdout:2/824: unlink d7/d1f/d29/f15 0 2024-08-01T06:56:06.580 INFO:tasks.workunit.client.1.smithi089.stdout:0/862: dwrite d9/d40/d25/d46/d91/d2e/d44/d53/fe8 [0,4194304] 0 2024-08-01T06:56:06.586 INFO:tasks.workunit.client.1.smithi089.stdout:5/885: fdatasync d5/de/d57/d8e/d97/da5/dde/de9/fb2 0 2024-08-01T06:56:06.586 INFO:tasks.workunit.client.1.smithi089.stdout:8/946: chown d5/dc/dca/fe6 1663669718 1 2024-08-01T06:56:06.592 INFO:tasks.workunit.client.1.smithi089.stdout:9/775: read d18/d22/da2/fd8 [335594,127107] 0 2024-08-01T06:56:06.593 INFO:tasks.workunit.client.1.smithi089.stdout:7/874: write d7/df/d10/db3/de9/f102 [940140,96477] 0 2024-08-01T06:56:06.598 INFO:tasks.workunit.client.1.smithi089.stdout:5/886: dread - d5/dac/d105/dbd/df0/f11d zero size 2024-08-01T06:56:06.599 INFO:tasks.workunit.client.1.smithi089.stdout:4/908: sync 2024-08-01T06:56:06.599 INFO:tasks.workunit.client.1.smithi089.stdout:3/693: sync 2024-08-01T06:56:06.599 INFO:tasks.workunit.client.1.smithi089.stdout:1/926: sync 2024-08-01T06:56:06.599 INFO:tasks.workunit.client.1.smithi089.stdout:7/875: write d7/df/d10/d31/dc4/f127 [304605,29463] 0 2024-08-01T06:56:06.599 INFO:tasks.workunit.client.1.smithi089.stdout:0/863: dwrite d9/f77 [0,4194304] 0 2024-08-01T06:56:06.603 INFO:tasks.workunit.client.1.smithi089.stdout:1/927: readlink d0/d9/d15/d3b/d95/d49/d82/d124/laa 0 2024-08-01T06:56:06.608 INFO:tasks.workunit.client.1.smithi089.stdout:0/864: unlink d9/d40/d95/d99/f5d 0 2024-08-01T06:56:06.609 INFO:tasks.workunit.client.1.smithi089.stdout:4/909: unlink d3/d86/d9e/db1/dbb/faf 0 2024-08-01T06:56:06.609 INFO:tasks.workunit.client.1.smithi089.stdout:9/776: mkdir d18/d33/d102 0 2024-08-01T06:56:06.609 INFO:tasks.workunit.client.1.smithi089.stdout:3/694: chown d7/d32/c14 3523 1 2024-08-01T06:56:06.610 INFO:tasks.workunit.client.1.smithi089.stdout:8/947: mknod d5/d15/d5a/c144 0 2024-08-01T06:56:06.613 INFO:tasks.workunit.client.1.smithi089.stdout:1/928: write d0/d9/d15/d2d/d4a/ded/f100 [48609,29574] 0 2024-08-01T06:56:06.615 INFO:tasks.workunit.client.1.smithi089.stdout:5/887: dwrite d5/de/d10/d16/d1b/d25/f62 [4194304,4194304] 0 2024-08-01T06:56:06.616 INFO:tasks.workunit.client.1.smithi089.stdout:0/865: readlink d9/d40/d95/df1/lae 0 2024-08-01T06:56:06.618 INFO:tasks.workunit.client.1.smithi089.stdout:7/876: dwrite d7/df/d10/d31/f8b [0,4194304] 0 2024-08-01T06:56:06.620 INFO:tasks.workunit.client.1.smithi089.stdout:7/877: dread - d7/d15/fdc zero size 2024-08-01T06:56:06.621 INFO:tasks.workunit.client.1.smithi089.stdout:2/825: dread d7/d19/d1e/fdd [0,4194304] 0 2024-08-01T06:56:06.621 INFO:tasks.workunit.client.1.smithi089.stdout:5/888: readlink d5/de/d10/d16/d1b/l58 0 2024-08-01T06:56:06.625 INFO:tasks.workunit.client.1.smithi089.stdout:9/777: link d18/d33/d49/f6c d18/d33/d49/d7b/d81/f103 0 2024-08-01T06:56:06.627 INFO:tasks.workunit.client.1.smithi089.stdout:3/695: getdents d7/d32/d4c/d53/d5f 0 2024-08-01T06:56:06.627 INFO:tasks.workunit.client.1.smithi089.stdout:4/910: link d3/db/de/c9f d3/d17/d3a/d3d/c119 0 2024-08-01T06:56:06.632 INFO:tasks.workunit.client.1.smithi089.stdout:9/778: symlink d18/d33/d3b/dc8/l104 0 2024-08-01T06:56:06.633 INFO:tasks.workunit.client.1.smithi089.stdout:8/948: write d5/dc/d1e/d53/f5c [831850,2003] 0 2024-08-01T06:56:06.633 INFO:tasks.workunit.client.1.smithi089.stdout:5/889: chown d5/de/d10/d16/d1b/d25/f68 1548312016 1 2024-08-01T06:56:06.634 INFO:tasks.workunit.client.1.smithi089.stdout:6/898: sync 2024-08-01T06:56:06.636 INFO:tasks.workunit.client.1.smithi089.stdout:3/696: dread d7/d68/d50/d6f/d2f/d9c/f9d [0,4194304] 0 2024-08-01T06:56:06.636 INFO:tasks.workunit.client.1.smithi089.stdout:7/878: write d7/df/f11 [542453,80797] 0 2024-08-01T06:56:06.637 INFO:tasks.workunit.client.1.smithi089.stdout:9/779: write d18/d22/d52/fea [38817,44003] 0 2024-08-01T06:56:06.637 INFO:tasks.workunit.client.1.smithi089.stdout:0/866: creat d9/d40/d25/d46/d91/d64/f111 x:0 0 0 2024-08-01T06:56:06.639 INFO:tasks.workunit.client.1.smithi089.stdout:1/929: dwrite d0/d9/d15/d2d/fc1 [0,4194304] 0 2024-08-01T06:56:06.639 INFO:tasks.workunit.client.1.smithi089.stdout:4/911: creat d3/d86/db7/dd2/d111/f11a x:0 0 0 2024-08-01T06:56:06.640 INFO:tasks.workunit.client.1.smithi089.stdout:2/826: link d7/d19/f40 d7/d19/dc5/dcc/d64/d9c/daf/f105 0 2024-08-01T06:56:06.642 INFO:tasks.workunit.client.1.smithi089.stdout:8/949: mkdir d5/dc/d145 0 2024-08-01T06:56:06.643 INFO:tasks.workunit.client.1.smithi089.stdout:3/697: write d7/d32/d4c/d69/fb9 [2993208,82088] 0 2024-08-01T06:56:06.646 INFO:tasks.workunit.client.1.smithi089.stdout:9/780: mknod d18/dec/c105 0 2024-08-01T06:56:06.647 INFO:tasks.workunit.client.1.smithi089.stdout:5/890: mknod d5/dac/d105/dbd/df0/d5d/d6c/c11e 0 2024-08-01T06:56:06.648 INFO:tasks.workunit.client.1.smithi089.stdout:7/879: write d7/d1f/d30/db1/fd2 [604286,11881] 0 2024-08-01T06:56:06.648 INFO:tasks.workunit.client.1.smithi089.stdout:6/899: symlink d2/d11/d1a/d1c/db6/def/l126 0 2024-08-01T06:56:06.649 INFO:tasks.workunit.client.1.smithi089.stdout:0/867: fdatasync d9/d40/d25/d46/d91/d2e/d3a/f97 0 2024-08-01T06:56:06.653 INFO:tasks.workunit.client.1.smithi089.stdout:9/781: rmdir d18/d33/d49/d7b/d7f/d98/d9f/d8e/de0 39 2024-08-01T06:56:06.655 INFO:tasks.workunit.client.1.smithi089.stdout:2/827: getdents d7/d1f/d52/d72/dc0 0 2024-08-01T06:56:06.656 INFO:tasks.workunit.client.1.smithi089.stdout:6/900: creat d2/d11/d1f/dbd/dc5/f127 x:0 0 0 2024-08-01T06:56:06.657 INFO:tasks.workunit.client.1.smithi089.stdout:0/868: symlink d9/d40/d25/d46/d91/d2e/l112 0 2024-08-01T06:56:06.657 INFO:tasks.workunit.client.1.smithi089.stdout:7/880: creat d7/df/d10/d42/d4e/d11d/f130 x:0 0 0 2024-08-01T06:56:06.658 INFO:tasks.workunit.client.1.smithi089.stdout:1/930: truncate d0/d9/d15/d3b/d3d/db5/df6/f107 992670 0 2024-08-01T06:56:06.659 INFO:tasks.workunit.client.1.smithi089.stdout:8/950: dwrite d5/dc/d1e/fed [0,4194304] 0 2024-08-01T06:56:06.659 INFO:tasks.workunit.client.1.smithi089.stdout:6/901: chown d2/d11/d1a/f33 675993 1 2024-08-01T06:56:06.662 INFO:tasks.workunit.client.1.smithi089.stdout:2/828: mkdir d7/d19/dc5/dcc/d106 0 2024-08-01T06:56:06.663 INFO:tasks.workunit.client.1.smithi089.stdout:0/869: creat d9/f113 x:0 0 0 2024-08-01T06:56:06.664 INFO:tasks.workunit.client.1.smithi089.stdout:7/881: creat d7/df/d10/d42/f131 x:0 0 0 2024-08-01T06:56:06.667 INFO:tasks.workunit.client.1.smithi089.stdout:9/782: rename d18/d22/d45/daa/cb5 to d18/d22/d39/d95/c106 0 2024-08-01T06:56:06.668 INFO:tasks.workunit.client.1.smithi089.stdout:7/882: dread d7/df/d91/fb5 [0,4194304] 0 2024-08-01T06:56:06.668 INFO:tasks.workunit.client.1.smithi089.stdout:1/931: symlink d0/d9/d15/d2b/l131 0 2024-08-01T06:56:06.669 INFO:tasks.workunit.client.1.smithi089.stdout:1/932: write d0/f11 [960924,14614] 0 2024-08-01T06:56:06.670 INFO:tasks.workunit.client.1.smithi089.stdout:4/912: write d3/d1e/f95 [431301,51816] 0 2024-08-01T06:56:06.670 INFO:tasks.workunit.client.1.smithi089.stdout:7/883: truncate d7/df/d10/d42/f131 177155 0 2024-08-01T06:56:06.672 INFO:tasks.workunit.client.1.smithi089.stdout:4/913: chown d3/d86/d9e/db1/ccf 164357 1 2024-08-01T06:56:06.672 INFO:tasks.workunit.client.1.smithi089.stdout:7/884: chown d7/df/d91/da4/dca/ff6 384 1 2024-08-01T06:56:06.673 INFO:tasks.workunit.client.1.smithi089.stdout:8/951: mknod d5/d23/c146 0 2024-08-01T06:56:06.674 INFO:tasks.workunit.client.1.smithi089.stdout:4/914: write d3/db/d16/d35/fc6 [1001275,61045] 0 2024-08-01T06:56:06.675 INFO:tasks.workunit.client.1.smithi089.stdout:3/698: write d7/d32/d4c/d69/fb2 [1733021,38566] 0 2024-08-01T06:56:06.677 INFO:tasks.workunit.client.1.smithi089.stdout:7/885: write d7/df/d10/d42/f9e [4123655,14587] 0 2024-08-01T06:56:06.678 INFO:tasks.workunit.client.1.smithi089.stdout:5/891: write d5/de/faf [161571,105952] 0 2024-08-01T06:56:06.680 INFO:tasks.workunit.client.1.smithi089.stdout:4/915: write d3/db/de/d5b/db9/fc3 [343938,60704] 0 2024-08-01T06:56:06.680 INFO:tasks.workunit.client.1.smithi089.stdout:2/829: dread d7/d1f/d29/f1a [0,4194304] 0 2024-08-01T06:56:06.681 INFO:tasks.workunit.client.1.smithi089.stdout:3/699: fsync d7/d32/d4c/fca 0 2024-08-01T06:56:06.681 INFO:tasks.workunit.client.1.smithi089.stdout:8/952: rmdir d5/dc/d94/dc7/dba/d100 39 2024-08-01T06:56:06.682 INFO:tasks.workunit.client.1.smithi089.stdout:1/933: creat d0/d9/d15/d76/d113/d127/f132 x:0 0 0 2024-08-01T06:56:06.684 INFO:tasks.workunit.client.1.smithi089.stdout:4/916: chown d3/d86/d9e/db1/dbb/d62/d31/ce0 32678658 1 2024-08-01T06:56:06.685 INFO:tasks.workunit.client.1.smithi089.stdout:1/934: readlink d0/d9/d43/l7b 0 2024-08-01T06:56:06.685 INFO:tasks.workunit.client.1.smithi089.stdout:5/892: unlink d5/dac/d105/dbd/df0/d5f/lc0 0 2024-08-01T06:56:06.685 INFO:tasks.workunit.client.1.smithi089.stdout:0/870: link d9/d40/d25/d46/d91/d2e/f81 d9/d40/d45/d47/da8/d10c/f114 0 2024-08-01T06:56:06.686 INFO:tasks.workunit.client.1.smithi089.stdout:1/935: stat d0/d9/d15/dce/dd3/fe5 0 2024-08-01T06:56:06.687 INFO:tasks.workunit.client.1.smithi089.stdout:7/886: creat d7/d46/d7b/d12c/dbb/f132 x:0 0 0 2024-08-01T06:56:06.688 INFO:tasks.workunit.client.1.smithi089.stdout:3/700: creat d7/d32/d12/d29/d39/fe0 x:0 0 0 2024-08-01T06:56:06.689 INFO:tasks.workunit.client.1.smithi089.stdout:8/953: symlink d5/dc/d94/dc7/dba/df5/l147 0 2024-08-01T06:56:06.690 INFO:tasks.workunit.client.1.smithi089.stdout:7/887: write d7/df/d10/d31/d4a/fd0 [325425,14293] 0 2024-08-01T06:56:06.690 INFO:tasks.workunit.client.1.smithi089.stdout:3/701: read d7/d32/d4c/d69/d6d/f6e [2726791,67958] 0 2024-08-01T06:56:06.691 INFO:tasks.workunit.client.1.smithi089.stdout:7/888: stat d7/c22 0 2024-08-01T06:56:06.692 INFO:tasks.workunit.client.1.smithi089.stdout:1/936: mkdir d0/d9/d15/d2b/d7d/d133 0 2024-08-01T06:56:06.694 INFO:tasks.workunit.client.1.smithi089.stdout:7/889: write d7/ff9 [1914134,40343] 0 2024-08-01T06:56:06.697 INFO:tasks.workunit.client.1.smithi089.stdout:0/871: getdents d9/d40/d25/d46/d91/d2e/d44/d53/deb 0 2024-08-01T06:56:06.697 INFO:tasks.workunit.client.1.smithi089.stdout:7/890: chown d7/df/d3b 64955 1 2024-08-01T06:56:06.697 INFO:tasks.workunit.client.1.smithi089.stdout:5/893: rename d5/d13/d38/l21 to d5/dac/d105/dbd/df0/d5d/l11f 0 2024-08-01T06:56:06.698 INFO:tasks.workunit.client.1.smithi089.stdout:4/917: truncate d3/d86/d9e/db1/dbb/d62/d31/f67 150168 0 2024-08-01T06:56:06.701 INFO:tasks.workunit.client.1.smithi089.stdout:6/902: dwrite d2/d11/d1a/d1c/d40/f83 [0,4194304] 0 2024-08-01T06:56:06.703 INFO:tasks.workunit.client.1.smithi089.stdout:1/937: truncate d0/d9/d15/d2b/d7d/d115/f119 891092 0 2024-08-01T06:56:06.703 INFO:tasks.workunit.client.1.smithi089.stdout:7/891: truncate d7/df/d91/da4/fa0 414656 0 2024-08-01T06:56:06.705 INFO:tasks.workunit.client.1.smithi089.stdout:2/830: dread d7/d19/d3b/f95 [0,4194304] 0 2024-08-01T06:56:06.705 INFO:tasks.workunit.client.1.smithi089.stdout:5/894: symlink d5/dac/d105/dbd/df0/d5d/dd9/l120 0 2024-08-01T06:56:06.706 INFO:tasks.workunit.client.1.smithi089.stdout:0/872: unlink d9/d40/d25/d46/d91/d2e/d44/d53/daf/ff2 0 2024-08-01T06:56:06.708 INFO:tasks.workunit.client.1.smithi089.stdout:7/892: chown d7/df/d91/da4/f5f 320 1 2024-08-01T06:56:06.708 INFO:tasks.workunit.client.1.smithi089.stdout:5/895: readlink d5/de/d10/d16/d1b/l51 0 2024-08-01T06:56:06.709 INFO:tasks.workunit.client.1.smithi089.stdout:6/903: symlink d2/d11/d1a/d1c/dea/d11f/l128 0 2024-08-01T06:56:06.710 INFO:tasks.workunit.client.1.smithi089.stdout:4/918: rename d3/d86/db7/dd1/l101 to d3/d17/d3a/d4a/de1/d103/l11b 0 2024-08-01T06:56:06.712 INFO:tasks.workunit.client.1.smithi089.stdout:7/893: readlink d7/df/d91/da4/l10e 0 2024-08-01T06:56:06.712 INFO:tasks.workunit.client.1.smithi089.stdout:5/896: mkdir d5/dac/d105/d10c/d121 0 2024-08-01T06:56:06.714 INFO:tasks.workunit.client.1.smithi089.stdout:3/702: dwrite d7/d32/d4c/d67/d72/d91/dcb/fa4 [0,4194304] 0 2024-08-01T06:56:06.718 INFO:tasks.workunit.client.1.smithi089.stdout:7/894: chown d7/df/d10/d31/d4a/cf0 2 1 2024-08-01T06:56:06.720 INFO:tasks.workunit.client.1.smithi089.stdout:4/919: truncate d3/db/f39 4029585 0 2024-08-01T06:56:06.721 INFO:tasks.workunit.client.1.smithi089.stdout:0/873: truncate d9/d40/d95/d99/d2b/d55/f83 368238 0 2024-08-01T06:56:06.722 INFO:tasks.workunit.client.1.smithi089.stdout:5/897: mkdir d5/d13/d43/dc5/d100/d10d/d122 0 2024-08-01T06:56:06.724 INFO:tasks.workunit.client.1.smithi089.stdout:7/895: symlink d7/d1f/d30/d4c/dbc/dcd/l133 0 2024-08-01T06:56:06.725 INFO:tasks.workunit.client.1.smithi089.stdout:2/831: dwrite d7/d1f/d52/d72/dc0/ff6 [0,4194304] 0 2024-08-01T06:56:06.726 INFO:tasks.workunit.client.1.smithi089.stdout:5/898: chown d5/d13/d43/c63 15154409 1 2024-08-01T06:56:06.726 INFO:tasks.workunit.client.1.smithi089.stdout:6/904: dwrite d2/d30/d3c/d3d/fc6 [0,4194304] 0 2024-08-01T06:56:06.729 INFO:tasks.workunit.client.1.smithi089.stdout:5/899: chown d5/d13/d43/c101 3 1 2024-08-01T06:56:06.734 INFO:tasks.workunit.client.1.smithi089.stdout:7/896: truncate d7/df/d10/d31/d43/fec 787440 0 2024-08-01T06:56:06.736 INFO:tasks.workunit.client.1.smithi089.stdout:4/920: rmdir d3/d86/d9e/db1/dbb/d62/d3b 39 2024-08-01T06:56:06.736 INFO:tasks.workunit.client.1.smithi089.stdout:6/905: creat d2/d11/d1f/d46/dce/f129 x:0 0 0 2024-08-01T06:56:06.739 INFO:tasks.workunit.client.1.smithi089.stdout:2/832: fdatasync d7/d4a/f6d 0 2024-08-01T06:56:06.740 INFO:tasks.workunit.client.1.smithi089.stdout:7/897: symlink d7/d1f/d30/dab/l134 0 2024-08-01T06:56:06.741 INFO:tasks.workunit.client.1.smithi089.stdout:3/703: getdents d7/d32/d4c/d67/d72/d91/dcb/d78 0 2024-08-01T06:56:06.742 INFO:tasks.workunit.client.1.smithi089.stdout:0/874: dwrite d9/d40/d45/d47/da8/fcd [0,4194304] 0 2024-08-01T06:56:06.742 INFO:tasks.workunit.client.1.smithi089.stdout:4/921: mkdir d3/d86/db7/dd2/d111/d11c 0 2024-08-01T06:56:06.742 INFO:tasks.workunit.client.1.smithi089.stdout:6/906: mkdir d2/d11/d1f/d46/d6b/d12a 0 2024-08-01T06:56:06.744 INFO:tasks.workunit.client.1.smithi089.stdout:2/833: mkdir d7/d19/dc5/d107 0 2024-08-01T06:56:06.746 INFO:tasks.workunit.client.1.smithi089.stdout:3/704: symlink d7/d68/d50/d6f/d46/dd1/le1 0 2024-08-01T06:56:06.748 INFO:tasks.workunit.client.1.smithi089.stdout:5/900: truncate d5/de/d10/d16/d1b/d25/d4d/f9b 4267206 0 2024-08-01T06:56:06.749 INFO:tasks.workunit.client.1.smithi089.stdout:6/907: chown d2/d2e/d2f/d31/c96 992926919 1 2024-08-01T06:56:06.750 INFO:tasks.workunit.client.1.smithi089.stdout:2/834: symlink d7/d1f/d52/d6e/l108 0 2024-08-01T06:56:06.752 INFO:tasks.workunit.client.1.smithi089.stdout:6/908: write d2/d11/d3e/f60 [4144744,45932] 0 2024-08-01T06:56:06.753 INFO:tasks.workunit.client.1.smithi089.stdout:3/705: read - d7/d32/d12/d29/d39/d4b/f94 zero size 2024-08-01T06:56:06.755 INFO:tasks.workunit.client.1.smithi089.stdout:6/909: creat d2/d11/d1f/d46/d6b/d7d/dc9/f12b x:0 0 0 2024-08-01T06:56:06.756 INFO:tasks.workunit.client.1.smithi089.stdout:3/706: creat d7/d32/d4c/d69/d6d/dc7/fe2 x:0 0 0 2024-08-01T06:56:06.758 INFO:tasks.workunit.client.1.smithi089.stdout:6/910: creat d2/d11/d1a/d1c/dea/d11f/f12c x:0 0 0 2024-08-01T06:56:06.761 INFO:tasks.workunit.client.1.smithi089.stdout:6/911: rename d2/d11/d1a/d1c/d40/l81 to d2/d11/d1f/d46/dce/l12d 0 2024-08-01T06:56:06.763 INFO:tasks.workunit.client.1.smithi089.stdout:7/898: truncate d7/df/d10/d31/f8b 2530650 0 2024-08-01T06:56:06.769 INFO:tasks.workunit.client.1.smithi089.stdout:7/899: rename d7/d15/f3c to d7/d1f/d3a/f135 0 2024-08-01T06:56:06.771 INFO:tasks.workunit.client.1.smithi089.stdout:0/875: dwrite d9/d40/d45/d47/d9d/fd7 [0,4194304] 0 2024-08-01T06:56:06.774 INFO:tasks.workunit.client.1.smithi089.stdout:6/912: dwrite d2/d2e/d2f/d9e/feb [0,4194304] 0 2024-08-01T06:56:06.776 INFO:tasks.workunit.client.1.smithi089.stdout:4/922: dread d3/d17/d3a/f54 [0,4194304] 0 2024-08-01T06:56:06.778 INFO:tasks.workunit.client.1.smithi089.stdout:7/900: dread d7/d1f/d3a/dad/fb2 [0,4194304] 0 2024-08-01T06:56:06.778 INFO:tasks.workunit.client.1.smithi089.stdout:5/901: dread d5/d13/d38/d42/f67 [0,4194304] 0 2024-08-01T06:56:06.780 INFO:tasks.workunit.client.1.smithi089.stdout:5/902: stat d5/de/d10/d16/d1b/d25 0 2024-08-01T06:56:06.783 INFO:tasks.workunit.client.1.smithi089.stdout:5/903: write d5/de/d57/d8e/d97/da5/fee [1559499,28886] 0 2024-08-01T06:56:06.788 INFO:tasks.workunit.client.1.smithi089.stdout:0/876: dwrite d9/d40/d25/d46/d91/d2e/d44/d72/ff9 [0,4194304] 0 2024-08-01T06:56:06.791 INFO:tasks.workunit.client.1.smithi089.stdout:7/901: dread d7/df/d91/da4/f47 [0,4194304] 0 2024-08-01T06:56:06.791 INFO:tasks.workunit.client.1.smithi089.stdout:0/877: symlink d9/d40/d95/l115 0 2024-08-01T06:56:06.795 INFO:tasks.workunit.client.1.smithi089.stdout:5/904: dwrite d5/de/d10/d16/d1b/d25/fa7 [0,4194304] 0 2024-08-01T06:56:06.800 INFO:tasks.workunit.client.1.smithi089.stdout:4/923: dwrite d3/f24 [0,4194304] 0 2024-08-01T06:56:06.803 INFO:tasks.workunit.client.1.smithi089.stdout:0/878: truncate d9/d40/d25/d46/d91/d2e/fce 1590924 0 2024-08-01T06:56:06.803 INFO:tasks.workunit.client.1.smithi089.stdout:7/902: link d7/df/d91/da4/dca/cfd d7/d1f/d30/d4c/dbc/dcd/d104/c136 0 2024-08-01T06:56:06.803 INFO:tasks.workunit.client.1.smithi089.stdout:0/879: readlink d9/d40/d45/d47/ldd 0 2024-08-01T06:56:06.805 INFO:tasks.workunit.client.1.smithi089.stdout:4/924: mkdir d3/d17/d3a/d4a/de1/d11d 0 2024-08-01T06:56:06.806 INFO:tasks.workunit.client.1.smithi089.stdout:0/880: truncate d9/dee/ff7 383221 0 2024-08-01T06:56:06.810 INFO:tasks.workunit.client.1.smithi089.stdout:4/925: truncate d3/db/f13 3824502 0 2024-08-01T06:56:06.811 INFO:tasks.workunit.client.1.smithi089.stdout:0/881: dread - d9/d40/d95/d99/d2b/d55/fa9 zero size 2024-08-01T06:56:06.811 INFO:tasks.workunit.client.1.smithi089.stdout:7/903: dwrite d7/fe5 [0,4194304] 0 2024-08-01T06:56:06.813 INFO:tasks.workunit.client.1.smithi089.stdout:7/904: write d7/df/d10/d31/d4a/fd0 [2847022,74626] 0 2024-08-01T06:56:06.813 INFO:tasks.workunit.client.1.smithi089.stdout:0/882: mknod d9/d40/d95/c116 0 2024-08-01T06:56:06.819 INFO:tasks.workunit.client.1.smithi089.stdout:4/926: rename d3/d86/d9e to d3/d17/d3a/d4a/d11e 0 2024-08-01T06:56:06.821 INFO:tasks.workunit.client.1.smithi089.stdout:4/927: write d3/d17/d3a/d4a/d11e/d57/f5e [1950567,106263] 0 2024-08-01T06:56:06.822 INFO:tasks.workunit.client.1.smithi089.stdout:7/905: dread d7/d15/f73 [0,4194304] 0 2024-08-01T06:56:06.822 INFO:tasks.workunit.client.1.smithi089.stdout:0/883: rename d9/d40/d95/c116 to d9/d40/d25/d46/d91/d2e/d44/d53/db9/c117 0 2024-08-01T06:56:06.824 INFO:tasks.workunit.client.1.smithi089.stdout:4/928: mkdir d3/db/de/d5b/d11f 0 2024-08-01T06:56:06.826 INFO:tasks.workunit.client.1.smithi089.stdout:7/906: unlink d7/d46/d7b/d12c/dbb/fe1 0 2024-08-01T06:56:06.827 INFO:tasks.workunit.client.1.smithi089.stdout:7/907: chown d7/d1f/cba 34855035 1 2024-08-01T06:56:06.829 INFO:tasks.workunit.client.1.smithi089.stdout:7/908: truncate d7/df/d10/d31/d4a/fd0 4315862 0 2024-08-01T06:56:06.835 INFO:tasks.workunit.client.1.smithi089.stdout:7/909: truncate d7/df/d10/d42/d4e/d11d/f130 799873 0 2024-08-01T06:56:06.835 INFO:tasks.workunit.client.1.smithi089.stdout:4/929: link d3/d86/db7/cc9 d3/d17/d71/c120 0 2024-08-01T06:56:06.835 INFO:tasks.workunit.client.1.smithi089.stdout:4/930: write d3/d1e/f25 [4645021,123455] 0 2024-08-01T06:56:06.835 INFO:tasks.workunit.client.1.smithi089.stdout:0/884: getdents d9/d40/d25/d46/d91/d64/d8c 0 2024-08-01T06:56:06.836 INFO:tasks.workunit.client.1.smithi089.stdout:4/931: mknod d3/db/d16/d35/c121 0 2024-08-01T06:56:06.837 INFO:tasks.workunit.client.1.smithi089.stdout:0/885: symlink d9/d40/d45/db7/l118 0 2024-08-01T06:56:06.838 INFO:tasks.workunit.client.1.smithi089.stdout:4/932: symlink d3/db/de/l122 0 2024-08-01T06:56:06.839 INFO:tasks.workunit.client.1.smithi089.stdout:0/886: readlink d9/d40/d25/d46/d91/d2e/d44/d53/l9b 0 2024-08-01T06:56:06.839 INFO:tasks.workunit.client.1.smithi089.stdout:4/933: chown d3/db/de/d5b 14037 1 2024-08-01T06:56:06.841 INFO:tasks.workunit.client.1.smithi089.stdout:4/934: fdatasync d3/d17/d3a/f54 0 2024-08-01T06:56:06.841 INFO:tasks.workunit.client.1.smithi089.stdout:0/887: dread d9/d40/d95/d99/f3e [0,4194304] 0 2024-08-01T06:56:06.844 INFO:tasks.workunit.client.1.smithi089.stdout:4/935: rmdir d3/d17/d3a/d4a/d11e/db1/dbb/d62/d31 39 2024-08-01T06:56:06.848 INFO:tasks.workunit.client.1.smithi089.stdout:7/910: dread d7/d15/f8f [0,4194304] 0 2024-08-01T06:56:06.850 INFO:tasks.workunit.client.1.smithi089.stdout:7/911: fdatasync d7/d15/f2d 0 2024-08-01T06:56:06.850 INFO:tasks.workunit.client.1.smithi089.stdout:4/936: dwrite d3/d68/fdf [0,4194304] 0 2024-08-01T06:56:06.852 INFO:tasks.workunit.client.1.smithi089.stdout:4/937: write d3/db/de/dbe/f108 [429485,93406] 0 2024-08-01T06:56:06.857 INFO:tasks.workunit.client.1.smithi089.stdout:4/938: truncate d3/d17/d3a/d4a/de1/d103/fb2 360791 0 2024-08-01T06:56:06.858 INFO:tasks.workunit.client.1.smithi089.stdout:4/939: chown d3/db/d42/lc1 1515558 1 2024-08-01T06:56:06.953 INFO:tasks.workunit.client.1.smithi089.stdout:4/940: write d3/db/de/d5b/f73 [1348281,96427] 0 2024-08-01T06:56:06.955 INFO:tasks.workunit.client.1.smithi089.stdout:4/941: mknod d3/d86/db7/c123 0 2024-08-01T06:56:06.957 INFO:tasks.workunit.client.1.smithi089.stdout:7/912: dwrite d7/df/d10/f34 [0,4194304] 0 2024-08-01T06:56:06.975 INFO:tasks.workunit.client.1.smithi089.stdout:4/942: chown d3/d17/d3a/d4a/d11e/db1/dbb/d62/d3b/lfd 894 1 2024-08-01T06:56:06.975 INFO:tasks.workunit.client.1.smithi089.stdout:7/913: write d7/df/d3b/fcf [597996,62252] 0 2024-08-01T06:56:06.976 INFO:tasks.workunit.client.1.smithi089.stdout:7/914: chown d7/d46/d7b/d12c/dbb/cc3 60431036 1 2024-08-01T06:56:06.977 INFO:tasks.workunit.client.1.smithi089.stdout:4/943: mkdir d3/d17/d3a/d4a/d11e/db1/dbb/d62/d124 0 2024-08-01T06:56:06.979 INFO:tasks.workunit.client.1.smithi089.stdout:4/944: write d3/db/de/f9d [1773293,103981] 0 2024-08-01T06:56:06.981 INFO:tasks.workunit.client.1.smithi089.stdout:7/915: rename d7/f93 to d7/d1f/d30/d4c/dbc/dcd/dd7/f137 0 2024-08-01T06:56:06.985 INFO:tasks.workunit.client.1.smithi089.stdout:4/945: mknod d3/d17/d3a/d4a/d11e/db1/dbb/d62/db3/c125 0 2024-08-01T06:56:06.988 INFO:tasks.workunit.client.1.smithi089.stdout:4/946: creat d3/db/d33/f126 x:0 0 0 2024-08-01T06:56:06.992 INFO:tasks.workunit.client.1.smithi089.stdout:4/947: dread d3/db/d16/d35/fc6 [0,4194304] 0 2024-08-01T06:56:06.992 INFO:tasks.workunit.client.1.smithi089.stdout:4/948: chown d3/d17/d71/d92 122 1 2024-08-01T06:56:06.997 INFO:tasks.workunit.client.1.smithi089.stdout:4/949: dwrite d3/d1e/f40 [0,4194304] 0 2024-08-01T06:56:06.999 INFO:tasks.workunit.client.1.smithi089.stdout:4/950: write d3/d17/d3a/d4a/d11e/f104 [1027727,38671] 0 2024-08-01T06:56:07.001 INFO:tasks.workunit.client.1.smithi089.stdout:4/951: stat d3/d17/d3a/d3d/c119 0 2024-08-01T06:56:07.008 INFO:tasks.workunit.client.1.smithi089.stdout:4/952: dwrite d3/db/d33/fe6 [4194304,4194304] 0 2024-08-01T06:56:07.012 INFO:tasks.workunit.client.1.smithi089.stdout:9/783: sync 2024-08-01T06:56:07.012 INFO:tasks.workunit.client.1.smithi089.stdout:4/953: creat d3/d17/d3a/d4a/de1/f127 x:0 0 0 2024-08-01T06:56:07.040 INFO:tasks.workunit.client.1.smithi089.stdout:9/784: dread d18/d33/d3b/f3c [0,4194304] 0 2024-08-01T06:56:07.041 INFO:tasks.workunit.client.1.smithi089.stdout:9/785: dwrite d18/d33/d3b/f3c [0,4194304] 0 2024-08-01T06:56:07.045 INFO:tasks.workunit.client.1.smithi089.stdout:9/786: dread - d18/d33/d49/d7b/d7f/d98/d9f/d8e/de0/ff4 zero size 2024-08-01T06:56:07.047 INFO:tasks.workunit.client.1.smithi089.stdout:9/787: mkdir d18/d33/d49/d7b/d4b/dbb/d107 0 2024-08-01T06:56:07.056 INFO:tasks.workunit.client.1.smithi089.stdout:9/788: write d18/d22/d43/f5f [9164632,85912] 0 2024-08-01T06:56:07.056 INFO:tasks.workunit.client.1.smithi089.stdout:9/789: fsync d18/d33/d3b/f3c 0 2024-08-01T06:56:07.057 INFO:tasks.workunit.client.1.smithi089.stdout:9/790: stat d18/d33/d3b/fc6 0 2024-08-01T06:56:07.063 INFO:tasks.workunit.client.1.smithi089.stdout:9/791: dwrite d18/d22/d52/f6d [0,4194304] 0 2024-08-01T06:56:07.066 INFO:tasks.workunit.client.1.smithi089.stdout:9/792: creat d18/d33/d102/f108 x:0 0 0 2024-08-01T06:56:07.067 INFO:tasks.workunit.client.1.smithi089.stdout:9/793: write d18/d33/d49/d7b/fb8 [2969959,97060] 0 2024-08-01T06:56:07.069 INFO:tasks.workunit.client.1.smithi089.stdout:9/794: chown d18/d22/d39/d95/f101 1503 1 2024-08-01T06:56:07.072 INFO:tasks.workunit.client.1.smithi089.stdout:9/795: fdatasync d18/d22/d39/d50/f77 0 2024-08-01T06:56:07.072 INFO:tasks.workunit.client.1.smithi089.stdout:9/796: stat d18/d33/d3b/c4d 0 2024-08-01T06:56:07.074 INFO:tasks.workunit.client.1.smithi089.stdout:9/797: fdatasync d18/d33/d53/f8b 0 2024-08-01T06:56:07.080 INFO:tasks.workunit.client.1.smithi089.stdout:9/798: dwrite d18/d22/f9d [0,4194304] 0 2024-08-01T06:56:07.084 INFO:tasks.workunit.client.1.smithi089.stdout:9/799: creat d18/d33/f109 x:0 0 0 2024-08-01T06:56:07.086 INFO:tasks.workunit.client.1.smithi089.stdout:9/800: symlink d18/d33/d6e/l10a 0 2024-08-01T06:56:07.091 INFO:tasks.workunit.client.1.smithi089.stdout:1/938: sync 2024-08-01T06:56:07.091 INFO:tasks.workunit.client.1.smithi089.stdout:2/835: sync 2024-08-01T06:56:07.091 INFO:tasks.workunit.client.1.smithi089.stdout:3/707: sync 2024-08-01T06:56:07.091 INFO:tasks.workunit.client.1.smithi089.stdout:8/954: sync 2024-08-01T06:56:07.092 INFO:tasks.workunit.client.1.smithi089.stdout:9/801: write d18/d22/d43/f93 [661277,121626] 0 2024-08-01T06:56:07.097 INFO:tasks.workunit.client.1.smithi089.stdout:1/939: creat d0/d9/d15/d2b/d7d/f134 x:0 0 0 2024-08-01T06:56:07.098 INFO:tasks.workunit.client.1.smithi089.stdout:2/836: symlink d7/d19/dc5/d107/l109 0 2024-08-01T06:56:07.099 INFO:tasks.workunit.client.1.smithi089.stdout:8/955: mknod d5/dc/d94/dc7/dba/d100/d142/c148 0 2024-08-01T06:56:07.100 INFO:tasks.workunit.client.1.smithi089.stdout:9/802: dwrite d18/d33/d49/d7b/d4b/ff2 [4194304,4194304] 0 2024-08-01T06:56:07.101 INFO:tasks.workunit.client.1.smithi089.stdout:2/837: dread - d7/d19/feb zero size 2024-08-01T06:56:07.103 INFO:tasks.workunit.client.1.smithi089.stdout:1/940: creat d0/d9/d15/d2d/d4a/d61/f135 x:0 0 0 2024-08-01T06:56:07.105 INFO:tasks.workunit.client.1.smithi089.stdout:8/956: creat d5/d15/d5a/d73/daa/f149 x:0 0 0 2024-08-01T06:56:07.105 INFO:tasks.workunit.client.1.smithi089.stdout:1/941: dread - d0/d9/d15/d3b/d3d/d77/fcb zero size 2024-08-01T06:56:07.107 INFO:tasks.workunit.client.1.smithi089.stdout:2/838: write d7/d1f/d52/d6e/f9d [217620,66807] 0 2024-08-01T06:56:07.109 INFO:tasks.workunit.client.1.smithi089.stdout:8/957: fsync d5/d15/d5a/d73/fe2 0 2024-08-01T06:56:07.111 INFO:tasks.workunit.client.1.smithi089.stdout:1/942: creat d0/d9/d15/d3b/d3d/db5/f136 x:0 0 0 2024-08-01T06:56:07.111 INFO:tasks.workunit.client.1.smithi089.stdout:9/803: dwrite f13 [0,4194304] 0 2024-08-01T06:56:07.112 INFO:tasks.workunit.client.1.smithi089.stdout:8/958: read d5/dc/d1e/d53/f5c [2217748,54681] 0 2024-08-01T06:56:07.113 INFO:tasks.workunit.client.1.smithi089.stdout:2/839: creat d7/d1f/d52/d6e/f10a x:0 0 0 2024-08-01T06:56:07.114 INFO:tasks.workunit.client.1.smithi089.stdout:1/943: fsync d0/d9/d15/d2d/d4a/fb7 0 2024-08-01T06:56:07.117 INFO:tasks.workunit.client.1.smithi089.stdout:9/804: rmdir d18/d33/d49/d7b/d7f/d98/de1 0 2024-08-01T06:56:07.119 INFO:tasks.workunit.client.1.smithi089.stdout:2/840: mkdir d7/d19/dc5/d10b 0 2024-08-01T06:56:07.120 INFO:tasks.workunit.client.1.smithi089.stdout:2/841: write d7/d19/d1e/d5b/fcb [104300,8723] 0 2024-08-01T06:56:07.122 INFO:tasks.workunit.client.1.smithi089.stdout:8/959: dwrite d5/d15/d5a/d73/daa/f141 [0,4194304] 0 2024-08-01T06:56:07.123 INFO:tasks.workunit.client.1.smithi089.stdout:9/805: unlink d18/d22/d39/d95/c106 0 2024-08-01T06:56:07.125 INFO:tasks.workunit.client.1.smithi089.stdout:8/960: readlink d5/dc/l19 0 2024-08-01T06:56:07.125 INFO:tasks.workunit.client.1.smithi089.stdout:2/842: read d7/d19/fdb [1076338,119941] 0 2024-08-01T06:56:07.126 INFO:tasks.workunit.client.1.smithi089.stdout:9/806: getdents d18/d33/d49/d7b/d7f/d98/dcd 0 2024-08-01T06:56:07.128 INFO:tasks.workunit.client.1.smithi089.stdout:2/843: symlink d7/l10c 0 2024-08-01T06:56:07.133 INFO:tasks.workunit.client.1.smithi089.stdout:8/961: getdents d5/dc/d1e 0 2024-08-01T06:56:07.134 INFO:tasks.workunit.client.1.smithi089.stdout:1/944: truncate d0/d9/d15/f34 87425 0 2024-08-01T06:56:07.135 INFO:tasks.workunit.client.1.smithi089.stdout:2/844: dwrite d7/d1f/d52/d6e/f75 [0,4194304] 0 2024-08-01T06:56:07.135 INFO:tasks.workunit.client.1.smithi089.stdout:8/962: write d5/dc/d12/db9/fe8 [335673,104775] 0 2024-08-01T06:56:07.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:06 smithi089 ceph-mon[36617]: pgmap v17: 65 pgs: 65 active+clean; 1.7 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 74 MiB/s rd, 257 MiB/s wr, 546 op/s 2024-08-01T06:56:07.140 INFO:tasks.workunit.client.1.smithi089.stdout:8/963: fsync d5/dc/d1e/d53/fea 0 2024-08-01T06:56:07.144 INFO:tasks.workunit.client.1.smithi089.stdout:9/807: dwrite d18/d22/d39/d50/f77 [0,4194304] 0 2024-08-01T06:56:07.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:06 smithi016 ceph-mon[29266]: pgmap v17: 65 pgs: 65 active+clean; 1.7 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 74 MiB/s rd, 257 MiB/s wr, 546 op/s 2024-08-01T06:56:07.153 INFO:tasks.workunit.client.1.smithi089.stdout:2/845: dwrite d7/d19/d1e/d3d/fad [0,4194304] 0 2024-08-01T06:56:07.153 INFO:tasks.workunit.client.1.smithi089.stdout:9/808: mkdir d18/d33/d49/d7b/d81/d10b 0 2024-08-01T06:56:07.153 INFO:tasks.workunit.client.1.smithi089.stdout:1/945: dwrite d0/d9/d15/d3b/d3d/d77/fca [0,4194304] 0 2024-08-01T06:56:07.161 INFO:tasks.workunit.client.1.smithi089.stdout:8/964: dwrite d5/dc/d1e/fb5 [0,4194304] 0 2024-08-01T06:56:07.161 INFO:tasks.workunit.client.1.smithi089.stdout:2/846: dread d7/d19/fd6 [0,4194304] 0 2024-08-01T06:56:07.163 INFO:tasks.workunit.client.1.smithi089.stdout:1/946: mknod d0/d9/d15/d2b/d7d/d133/c137 0 2024-08-01T06:56:07.170 INFO:tasks.workunit.client.1.smithi089.stdout:8/965: dwrite d5/da6/f133 [0,4194304] 0 2024-08-01T06:56:07.172 INFO:tasks.workunit.client.1.smithi089.stdout:1/947: dwrite d0/d9/d43/d4b/db0/fd0 [0,4194304] 0 2024-08-01T06:56:07.174 INFO:tasks.workunit.client.1.smithi089.stdout:5/905: sync 2024-08-01T06:56:07.174 INFO:tasks.workunit.client.1.smithi089.stdout:6/913: sync 2024-08-01T06:56:07.174 INFO:tasks.workunit.client.1.smithi089.stdout:7/916: sync 2024-08-01T06:56:07.174 INFO:tasks.workunit.client.1.smithi089.stdout:4/954: sync 2024-08-01T06:56:07.174 INFO:tasks.workunit.client.1.smithi089.stdout:0/888: sync 2024-08-01T06:56:07.176 INFO:tasks.workunit.client.1.smithi089.stdout:1/948: stat d0/de3 0 2024-08-01T06:56:07.176 INFO:tasks.workunit.client.1.smithi089.stdout:8/966: creat d5/dc/d94/d84/ddb/f14a x:0 0 0 2024-08-01T06:56:07.178 INFO:tasks.workunit.client.1.smithi089.stdout:4/955: readlink d3/d1e/lab 0 2024-08-01T06:56:07.181 INFO:tasks.workunit.client.1.smithi089.stdout:7/917: stat d7/df/d10/d31/l6c 0 2024-08-01T06:56:07.182 INFO:tasks.workunit.client.1.smithi089.stdout:0/889: write d9/d40/d25/d46/d91/d64/f111 [477786,49226] 0 2024-08-01T06:56:07.183 INFO:tasks.workunit.client.1.smithi089.stdout:8/967: dread - d5/dc/dca/f102 zero size 2024-08-01T06:56:07.183 INFO:tasks.workunit.client.1.smithi089.stdout:4/956: read - d3/d17/d3a/d4a/d11e/db1/fe3 zero size 2024-08-01T06:56:07.184 INFO:tasks.workunit.client.1.smithi089.stdout:1/949: chown d0/d9/d15/d2b/d7d/fb1 3035938 1 2024-08-01T06:56:07.185 INFO:tasks.workunit.client.1.smithi089.stdout:4/957: chown d3/db/de/fa5 27056306 1 2024-08-01T06:56:07.188 INFO:tasks.workunit.client.1.smithi089.stdout:4/958: write d3/d17/d3a/d4a/d11e/db1/dbb/d62/db3/fb5 [4886067,102618] 0 2024-08-01T06:56:07.188 INFO:tasks.workunit.client.1.smithi089.stdout:5/906: rename d5/de/d57/c72 to d5/de/d10/c123 0 2024-08-01T06:56:07.191 INFO:tasks.workunit.client.1.smithi089.stdout:5/907: truncate d5/de/d10/d16/d1b/d92/f104 353962 0 2024-08-01T06:56:07.191 INFO:tasks.workunit.client.1.smithi089.stdout:7/918: rename d7/d1f/d3a/c95 to d7/d46/d7b/d12c/dbb/de7/c138 0 2024-08-01T06:56:07.192 INFO:tasks.workunit.client.1.smithi089.stdout:8/968: fdatasync d5/d15/d5a/d73/daa/db3/fcf 0 2024-08-01T06:56:07.192 INFO:tasks.workunit.client.1.smithi089.stdout:5/908: chown d5/de/d10/d33/d5e/d7e 1 1 2024-08-01T06:56:07.193 INFO:tasks.workunit.client.1.smithi089.stdout:7/919: write d7/df/d10/d31/f110 [548731,67681] 0 2024-08-01T06:56:07.194 INFO:tasks.workunit.client.1.smithi089.stdout:0/890: getdents d9/d40/d95/d99/dec 0 2024-08-01T06:56:07.196 INFO:tasks.workunit.client.1.smithi089.stdout:8/969: mkdir d5/d15/d14b 0 2024-08-01T06:56:07.197 INFO:tasks.workunit.client.1.smithi089.stdout:8/970: fdatasync d5/dc/d1e/d53/f60 0 2024-08-01T06:56:07.199 INFO:tasks.workunit.client.1.smithi089.stdout:4/959: getdents d3/d17/d3a/d3d 0 2024-08-01T06:56:07.200 INFO:tasks.workunit.client.1.smithi089.stdout:8/971: creat d5/dc/d1e/f14c x:0 0 0 2024-08-01T06:56:07.201 INFO:tasks.workunit.client.1.smithi089.stdout:0/891: mkdir d9/d40/d119 0 2024-08-01T06:56:07.202 INFO:tasks.workunit.client.1.smithi089.stdout:4/960: mknod d3/db/d42/c128 0 2024-08-01T06:56:07.205 INFO:tasks.workunit.client.1.smithi089.stdout:8/972: unlink d5/dc/d12/d119/c12d 0 2024-08-01T06:56:07.211 INFO:tasks.workunit.client.1.smithi089.stdout:0/892: rmdir d9/d40/d25/d46/d91/d2e/d44/d72/d8b 39 2024-08-01T06:56:07.211 INFO:tasks.workunit.client.1.smithi089.stdout:5/909: dwrite d5/de/d10/d16/d1b/f39 [0,4194304] 0 2024-08-01T06:56:07.211 INFO:tasks.workunit.client.1.smithi089.stdout:4/961: mkdir d3/d17/d3a/d4a/d11e/d129 0 2024-08-01T06:56:07.212 INFO:tasks.workunit.client.1.smithi089.stdout:1/950: dread d0/d9/d15/d76/f94 [0,4194304] 0 2024-08-01T06:56:07.216 INFO:tasks.workunit.client.1.smithi089.stdout:9/809: dwrite d18/d33/d49/f6c [0,4194304] 0 2024-08-01T06:56:07.217 INFO:tasks.workunit.client.1.smithi089.stdout:0/893: chown d9/f18 26 1 2024-08-01T06:56:07.218 INFO:tasks.workunit.client.1.smithi089.stdout:7/920: dread f4 [0,4194304] 0 2024-08-01T06:56:07.218 INFO:tasks.workunit.client.1.smithi089.stdout:2/847: dwrite d7/f23 [0,4194304] 0 2024-08-01T06:56:07.221 INFO:tasks.workunit.client.1.smithi089.stdout:1/951: read d0/d9/d43/fec [458424,101685] 0 2024-08-01T06:56:07.225 INFO:tasks.workunit.client.1.smithi089.stdout:4/962: unlink d3/ca 0 2024-08-01T06:56:07.225 INFO:tasks.workunit.client.1.smithi089.stdout:5/910: fdatasync d5/de/d57/d8e/d97/da5/fc9 0 2024-08-01T06:56:07.227 INFO:tasks.workunit.client.1.smithi089.stdout:6/914: dwrite d2/d11/f66 [0,4194304] 0 2024-08-01T06:56:07.227 INFO:tasks.workunit.client.1.smithi089.stdout:9/810: mkdir d18/d33/d49/d7b/d4b/db6/d10c 0 2024-08-01T06:56:07.229 INFO:tasks.workunit.client.1.smithi089.stdout:7/921: rmdir d7/df/d91 39 2024-08-01T06:56:07.230 INFO:tasks.workunit.client.1.smithi089.stdout:2/848: symlink d7/d19/l10d 0 2024-08-01T06:56:07.234 INFO:tasks.workunit.client.1.smithi089.stdout:8/973: dwrite d5/dc/dca/f102 [0,4194304] 0 2024-08-01T06:56:07.234 INFO:tasks.workunit.client.1.smithi089.stdout:5/911: rmdir d5/de/d10/d16 39 2024-08-01T06:56:07.234 INFO:tasks.workunit.client.1.smithi089.stdout:0/894: unlink d9/d40/d25/d46/d91/d2e/d44/d53/db9/ld9 0 2024-08-01T06:56:07.235 INFO:tasks.workunit.client.1.smithi089.stdout:9/811: read f10 [1503552,12649] 0 2024-08-01T06:56:07.235 INFO:tasks.workunit.client.1.smithi089.stdout:7/922: chown d7/df/d10/d42/d75/caa 403257443 1 2024-08-01T06:56:07.238 INFO:tasks.workunit.client.1.smithi089.stdout:4/963: creat d3/d17/d3a/d4a/d11e/d129/f12a x:0 0 0 2024-08-01T06:56:07.239 INFO:tasks.workunit.client.1.smithi089.stdout:9/812: read d18/d22/f48 [4011308,86754] 0 2024-08-01T06:56:07.242 INFO:tasks.workunit.client.1.smithi089.stdout:7/923: mknod d7/d1f/d30/db1/c139 0 2024-08-01T06:56:07.246 INFO:tasks.workunit.client.1.smithi089.stdout:1/952: dwrite d0/d9/d15/d3b/f12f [0,4194304] 0 2024-08-01T06:56:07.249 INFO:tasks.workunit.client.1.smithi089.stdout:3/708: sync 2024-08-01T06:56:07.250 INFO:tasks.workunit.client.1.smithi089.stdout:5/912: creat d5/dac/d105/dbd/df0/d5d/d6c/d98/dc3/f124 x:0 0 0 2024-08-01T06:56:07.251 INFO:tasks.workunit.client.1.smithi089.stdout:6/915: getdents d2/d11/d1f/d46/d6b/d7d/dc9/df6 0 2024-08-01T06:56:07.252 INFO:tasks.workunit.client.1.smithi089.stdout:8/974: mkdir d5/d15/d5a/dfa/d14d 0 2024-08-01T06:56:07.253 INFO:tasks.workunit.client.1.smithi089.stdout:3/709: chown d7/dce 63845740 1 2024-08-01T06:56:07.255 INFO:tasks.workunit.client.1.smithi089.stdout:1/953: write d0/d9/d15/d2d/d4a/d61/f9e [2552694,28143] 0 2024-08-01T06:56:07.255 INFO:tasks.workunit.client.1.smithi089.stdout:2/849: dwrite d7/d19/d1e/d3d/d60/fd0 [0,4194304] 0 2024-08-01T06:56:07.256 INFO:tasks.workunit.client.1.smithi089.stdout:9/813: creat d18/d22/d39/f10d x:0 0 0 2024-08-01T06:56:07.257 INFO:tasks.workunit.client.1.smithi089.stdout:7/924: truncate d7/df/d10/f24 4310738 0 2024-08-01T06:56:07.261 INFO:tasks.workunit.client.1.smithi089.stdout:8/975: read d5/dc/d12/f64 [102541,69830] 0 2024-08-01T06:56:07.263 INFO:tasks.workunit.client.1.smithi089.stdout:9/814: symlink d18/d22/d39/d95/l10e 0 2024-08-01T06:56:07.265 INFO:tasks.workunit.client.1.smithi089.stdout:3/710: rename d7/d32/d9f/fab to d7/d32/d4c/d67/db4/ddc/fe3 0 2024-08-01T06:56:07.266 INFO:tasks.workunit.client.1.smithi089.stdout:5/913: mknod d5/dac/d105/d103/d115/c125 0 2024-08-01T06:56:07.268 INFO:tasks.workunit.client.1.smithi089.stdout:6/916: creat d2/d2e/f12e x:0 0 0 2024-08-01T06:56:07.268 INFO:tasks.workunit.client.1.smithi089.stdout:0/895: truncate d9/d40/d95/d99/dba/fd4 7441486 0 2024-08-01T06:56:07.269 INFO:tasks.workunit.client.1.smithi089.stdout:2/850: dread d7/d19/d1e/f8d [0,4194304] 0 2024-08-01T06:56:07.271 INFO:tasks.workunit.client.1.smithi089.stdout:1/954: dwrite d0/d9/d15/d3b/d95/d49/d82/da6/f123 [0,4194304] 0 2024-08-01T06:56:07.275 INFO:tasks.workunit.client.1.smithi089.stdout:2/851: rmdir d7/d19/dc5 39 2024-08-01T06:56:07.276 INFO:tasks.workunit.client.1.smithi089.stdout:4/964: dwrite d3/d17/d3a/d3d/fae [4194304,4194304] 0 2024-08-01T06:56:07.276 INFO:tasks.workunit.client.1.smithi089.stdout:3/711: symlink d7/d68/le4 0 2024-08-01T06:56:07.278 INFO:tasks.workunit.client.1.smithi089.stdout:6/917: dread - d2/d11/d1a/d1c/db6/fbf zero size 2024-08-01T06:56:07.278 INFO:tasks.workunit.client.1.smithi089.stdout:0/896: chown d9/d40/d25/d46/d91/d64/d8c/c98 1483650724 1 2024-08-01T06:56:07.278 INFO:tasks.workunit.client.1.smithi089.stdout:5/914: creat d5/dac/d105/dbd/df0/d5f/f126 x:0 0 0 2024-08-01T06:56:07.279 INFO:tasks.workunit.client.1.smithi089.stdout:3/712: stat d7/d32/d4c/d69/d6d/f6e 0 2024-08-01T06:56:07.282 INFO:tasks.workunit.client.1.smithi089.stdout:6/918: fsync d2/f75 0 2024-08-01T06:56:07.283 INFO:tasks.workunit.client.1.smithi089.stdout:2/852: write d7/d19/dc5/dcc/fe4 [460876,3657] 0 2024-08-01T06:56:07.287 INFO:tasks.workunit.client.1.smithi089.stdout:3/713: mknod d7/d32/d12/d29/d39/ce5 0 2024-08-01T06:56:07.289 INFO:tasks.workunit.client.1.smithi089.stdout:5/915: mkdir d5/d13/d38/d42/d127 0 2024-08-01T06:56:07.291 INFO:tasks.workunit.client.1.smithi089.stdout:4/965: dwrite d3/d68/fdf [4194304,4194304] 0 2024-08-01T06:56:07.291 INFO:tasks.workunit.client.1.smithi089.stdout:1/955: rename d0/d9/d15/d2d/d4a/d61/fab to d0/d9/d15/f138 0 2024-08-01T06:56:07.293 INFO:tasks.workunit.client.1.smithi089.stdout:5/916: write d5/f3c [613078,45712] 0 2024-08-01T06:56:07.293 INFO:tasks.workunit.client.1.smithi089.stdout:2/853: write d7/dd7/fe3 [470350,106561] 0 2024-08-01T06:56:07.297 INFO:tasks.workunit.client.1.smithi089.stdout:3/714: creat d7/d32/d9f/fe6 x:0 0 0 2024-08-01T06:56:07.298 INFO:tasks.workunit.client.1.smithi089.stdout:9/815: write d18/d22/d39/f3f [612826,23235] 0 2024-08-01T06:56:07.301 INFO:tasks.workunit.client.1.smithi089.stdout:1/956: write d0/d9/d15/dce/f10e [1041942,18748] 0 2024-08-01T06:56:07.302 INFO:tasks.workunit.client.1.smithi089.stdout:7/925: dwrite f6 [4194304,4194304] 0 2024-08-01T06:56:07.305 INFO:tasks.workunit.client.1.smithi089.stdout:0/897: write d9/d40/d25/d46/d91/d2e/d44/d72/fc2 [636685,84641] 0 2024-08-01T06:56:07.305 INFO:tasks.workunit.client.1.smithi089.stdout:3/715: dread - d7/d32/d12/d29/d39/fe0 zero size 2024-08-01T06:56:07.308 INFO:tasks.workunit.client.1.smithi089.stdout:5/917: chown d5/de/d10/d16/d1b/d25/c36 251 1 2024-08-01T06:56:07.309 INFO:tasks.workunit.client.1.smithi089.stdout:4/966: mknod d3/d17/d3a/d4a/d11e/db1/dbb/d62/db3/c12b 0 2024-08-01T06:56:07.309 INFO:tasks.workunit.client.1.smithi089.stdout:1/957: symlink d0/de3/l139 0 2024-08-01T06:56:07.310 INFO:tasks.workunit.client.1.smithi089.stdout:8/976: dwrite d5/d23/f49 [0,4194304] 0 2024-08-01T06:56:07.313 INFO:tasks.workunit.client.1.smithi089.stdout:5/918: write d5/dac/d105/ff7 [429556,9518] 0 2024-08-01T06:56:07.313 INFO:tasks.workunit.client.1.smithi089.stdout:3/716: chown d7/d68/d50/d6f/d2f/d9c/fd0 3256 1 2024-08-01T06:56:07.317 INFO:tasks.workunit.client.1.smithi089.stdout:2/854: creat d7/d19/d1e/d3d/f10e x:0 0 0 2024-08-01T06:56:07.319 INFO:tasks.workunit.client.1.smithi089.stdout:7/926: dwrite d7/fb [0,4194304] 0 2024-08-01T06:56:07.319 INFO:tasks.workunit.client.1.smithi089.stdout:4/967: creat d3/db/de/d5b/db9/f12c x:0 0 0 2024-08-01T06:56:07.321 INFO:tasks.workunit.client.1.smithi089.stdout:9/816: creat d18/d33/d49/d7b/f10f x:0 0 0 2024-08-01T06:56:07.324 INFO:tasks.workunit.client.1.smithi089.stdout:1/958: creat d0/d9/d15/d3b/d95/d49/d82/d124/d106/f13a x:0 0 0 2024-08-01T06:56:07.324 INFO:tasks.workunit.client.1.smithi089.stdout:0/898: dread f7 [0,4194304] 0 2024-08-01T06:56:07.324 INFO:tasks.workunit.client.1.smithi089.stdout:7/927: write d7/df/f82 [3451174,7786] 0 2024-08-01T06:56:07.324 INFO:tasks.workunit.client.1.smithi089.stdout:5/919: write d5/de/d10/d16/d1b/d25/d4d/f9b [4160274,33575] 0 2024-08-01T06:56:07.326 INFO:tasks.workunit.client.1.smithi089.stdout:4/968: creat d3/d17/d3a/d4a/de1/d103/f12d x:0 0 0 2024-08-01T06:56:07.328 INFO:tasks.workunit.client.1.smithi089.stdout:4/969: fdatasync d3/d17/d3a/d4a/d11e/f41 0 2024-08-01T06:56:07.329 INFO:tasks.workunit.client.1.smithi089.stdout:8/977: rename c3 to d5/dc/d1e/c14e 0 2024-08-01T06:56:07.330 INFO:tasks.workunit.client.1.smithi089.stdout:9/817: fsync d18/d22/da2/fd8 0 2024-08-01T06:56:07.331 INFO:tasks.workunit.client.1.smithi089.stdout:0/899: creat d9/d40/d45/dc1/f11a x:0 0 0 2024-08-01T06:56:07.332 INFO:tasks.workunit.client.1.smithi089.stdout:4/970: write d3/d17/d3a/d4a/d11e/db1/dbb/d62/db3/fb5 [1806784,59179] 0 2024-08-01T06:56:07.332 INFO:tasks.workunit.client.1.smithi089.stdout:9/818: write d18/d22/d52/f54 [275833,99592] 0 2024-08-01T06:56:07.333 INFO:tasks.workunit.client.1.smithi089.stdout:7/928: mknod d7/df/d10/d42/d4e/c13a 0 2024-08-01T06:56:07.335 INFO:tasks.workunit.client.1.smithi089.stdout:7/929: write d7/d1f/d30/db1/fb8 [754504,83507] 0 2024-08-01T06:56:07.335 INFO:tasks.workunit.client.1.smithi089.stdout:1/959: rename d0/d9/d15/d3b/d95/d49/f65 to d0/de3/f13b 0 2024-08-01T06:56:07.336 INFO:tasks.workunit.client.1.smithi089.stdout:1/960: chown d0/fc2 2834276 1 2024-08-01T06:56:07.336 INFO:tasks.workunit.client.1.smithi089.stdout:8/978: mkdir d5/d15/d5a/d73/d87/d14f 0 2024-08-01T06:56:07.337 INFO:tasks.workunit.client.1.smithi089.stdout:1/961: chown d0/d9/d43/d4b/db0 233352 1 2024-08-01T06:56:07.340 INFO:tasks.workunit.client.1.smithi089.stdout:9/819: creat d18/d33/d49/d7b/d4b/db6/df8/f110 x:0 0 0 2024-08-01T06:56:07.340 INFO:tasks.workunit.client.1.smithi089.stdout:1/962: fdatasync d0/d9/d15/d3b/d3d/db5/f136 0 2024-08-01T06:56:07.341 INFO:tasks.workunit.client.1.smithi089.stdout:1/963: fsync d0/d9/d15/dce/dd3/fe8 0 2024-08-01T06:56:07.343 INFO:tasks.workunit.client.1.smithi089.stdout:8/979: mkdir d5/dc/d94/dc7/dba/d100/d142/d150 0 2024-08-01T06:56:07.343 INFO:tasks.workunit.client.1.smithi089.stdout:4/971: read d3/db/de/d5b/fe2 [517327,118404] 0 2024-08-01T06:56:07.343 INFO:tasks.workunit.client.1.smithi089.stdout:9/820: rmdir d18/d33/d49/d7b/d7f 39 2024-08-01T06:56:07.346 INFO:tasks.workunit.client.1.smithi089.stdout:9/821: mknod d18/d33/d49/d7b/d81/c111 0 2024-08-01T06:56:07.347 INFO:tasks.workunit.client.1.smithi089.stdout:3/717: truncate d7/d32/d12/d1b/f3c 1021365 0 2024-08-01T06:56:07.349 INFO:tasks.workunit.client.1.smithi089.stdout:5/920: write d5/d13/d43/f4e [5955933,107425] 0 2024-08-01T06:56:07.349 INFO:tasks.workunit.client.1.smithi089.stdout:9/822: write d18/f20 [4186363,43359] 0 2024-08-01T06:56:07.352 INFO:tasks.workunit.client.1.smithi089.stdout:0/900: write d9/d40/d95/d99/d2b/fb8 [547595,119719] 0 2024-08-01T06:56:07.352 INFO:tasks.workunit.client.1.smithi089.stdout:7/930: truncate d7/d46/d7b/d12c/f10d 2084033 0 2024-08-01T06:56:07.355 INFO:tasks.workunit.client.1.smithi089.stdout:8/980: dwrite d5/dc/dca/f102 [4194304,4194304] 0 2024-08-01T06:56:07.356 INFO:tasks.workunit.client.1.smithi089.stdout:4/972: dwrite d3/db/de/d5b/db9/fc3 [0,4194304] 0 2024-08-01T06:56:07.357 INFO:tasks.workunit.client.1.smithi089.stdout:5/921: write d5/dac/f109 [478782,46054] 0 2024-08-01T06:56:07.359 INFO:tasks.workunit.client.1.smithi089.stdout:9/823: truncate d18/d22/fca 203970 0 2024-08-01T06:56:07.360 INFO:tasks.workunit.client.1.smithi089.stdout:3/718: truncate d7/d32/d4c/d69/d6d/f6e 3704507 0 2024-08-01T06:56:07.363 INFO:tasks.workunit.client.1.smithi089.stdout:9/824: creat d18/da4/f112 x:0 0 0 2024-08-01T06:56:07.364 INFO:tasks.workunit.client.1.smithi089.stdout:5/922: readlink d5/d13/d38/d42/l9c 0 2024-08-01T06:56:07.366 INFO:tasks.workunit.client.1.smithi089.stdout:8/981: symlink d5/d15/d5a/d73/d87/dbf/l151 0 2024-08-01T06:56:07.366 INFO:tasks.workunit.client.1.smithi089.stdout:9/825: dread - d18/d33/d102/f108 zero size 2024-08-01T06:56:07.366 INFO:tasks.workunit.client.1.smithi089.stdout:0/901: mkdir d9/d40/d45/d47/da8/d10c/d11b 0 2024-08-01T06:56:07.367 INFO:tasks.workunit.client.1.smithi089.stdout:3/719: fsync d7/d68/d50/d6f/d2f/d9c/fd0 0 2024-08-01T06:56:07.367 INFO:tasks.workunit.client.1.smithi089.stdout:1/964: dread d0/d9/d15/d3b/d3d/f102 [4194304,4194304] 0 2024-08-01T06:56:07.369 INFO:tasks.workunit.client.1.smithi089.stdout:1/965: dread - d0/d9/d15/dce/fe4 zero size 2024-08-01T06:56:07.371 INFO:tasks.workunit.client.1.smithi089.stdout:1/966: stat d0/d9/d15/dce/le2 0 2024-08-01T06:56:07.375 INFO:tasks.workunit.client.1.smithi089.stdout:9/826: unlink d18/d33/d53/f8d 0 2024-08-01T06:56:07.376 INFO:tasks.workunit.client.1.smithi089.stdout:0/902: dwrite d9/d40/d45/d47/fc0 [0,4194304] 0 2024-08-01T06:56:07.378 INFO:tasks.workunit.client.1.smithi089.stdout:3/720: rename d7/d32/d12/f41 to d7/d68/d50/d6f/d2f/da2/da8/fe7 0 2024-08-01T06:56:07.378 INFO:tasks.workunit.client.1.smithi089.stdout:8/982: symlink d5/d15/d5e/l152 0 2024-08-01T06:56:07.380 INFO:tasks.workunit.client.1.smithi089.stdout:9/827: dread d18/d33/d49/d7b/fad [0,4194304] 0 2024-08-01T06:56:07.382 INFO:tasks.workunit.client.1.smithi089.stdout:9/828: fdatasync d18/d33/d49/d7b/d4b/db6/df8/f110 0 2024-08-01T06:56:07.382 INFO:tasks.workunit.client.1.smithi089.stdout:1/967: rmdir d0/d9/d15/d2d/d4a/d104 39 2024-08-01T06:56:07.386 INFO:tasks.workunit.client.1.smithi089.stdout:7/931: link d7/d1f/d30/d4c/dbc/dcd/d104/f9b d7/d1f/d30/f13b 0 2024-08-01T06:56:07.388 INFO:tasks.workunit.client.1.smithi089.stdout:4/973: write d3/d17/d3a/d4a/de1/d103/fb2 [1310580,44608] 0 2024-08-01T06:56:07.389 INFO:tasks.workunit.client.1.smithi089.stdout:8/983: chown d5/d15/f1f 28401 1 2024-08-01T06:56:07.389 INFO:tasks.workunit.client.1.smithi089.stdout:5/923: dread d5/de/d10/d16/d1b/d25/d4d/f9b [0,4194304] 0 2024-08-01T06:56:07.391 INFO:tasks.workunit.client.1.smithi089.stdout:9/829: write d18/d33/d3b/fc6 [2116049,102209] 0 2024-08-01T06:56:07.391 INFO:tasks.workunit.client.1.smithi089.stdout:4/974: readlink d3/db/de/d5b/db9/lbf 0 2024-08-01T06:56:07.393 INFO:tasks.workunit.client.1.smithi089.stdout:4/975: write d3/db/de/dbe/f108 [1160307,22001] 0 2024-08-01T06:56:07.395 INFO:tasks.workunit.client.1.smithi089.stdout:8/984: symlink d5/d15/d5a/d73/d87/dbf/l153 0 2024-08-01T06:56:07.396 INFO:tasks.workunit.client.1.smithi089.stdout:1/968: rename d0/d9/d15/d2d/d4a/d104/f112 to d0/d9/d15/d2d/d4a/d61/f13c 0 2024-08-01T06:56:07.397 INFO:tasks.workunit.client.1.smithi089.stdout:8/985: read d5/dc/d94/d84/fd9 [3311604,80560] 0 2024-08-01T06:56:07.397 INFO:tasks.workunit.client.1.smithi089.stdout:5/924: mknod d5/d13/d38/d42/d127/c128 0 2024-08-01T06:56:07.399 INFO:tasks.workunit.client.1.smithi089.stdout:0/903: getdents d9/d40/d25/d46/d91/d2e/d3a/d76/d96 0 2024-08-01T06:56:07.400 INFO:tasks.workunit.client.1.smithi089.stdout:8/986: dread d5/dc/d94/dc7/dc5/dd4/f10b [0,4194304] 0 2024-08-01T06:56:07.402 INFO:tasks.workunit.client.1.smithi089.stdout:5/925: creat d5/d13/d43/dc5/d100/f129 x:0 0 0 2024-08-01T06:56:07.404 INFO:tasks.workunit.client.1.smithi089.stdout:3/721: dwrite d7/d32/d12/d1b/f51 [0,4194304] 0 2024-08-01T06:56:07.406 INFO:tasks.workunit.client.1.smithi089.stdout:3/722: write d7/d32/d12/d29/d39/fe0 [52236,93810] 0 2024-08-01T06:56:07.410 INFO:tasks.workunit.client.1.smithi089.stdout:4/976: link d3/l76 d3/db/de/d5b/l12e 0 2024-08-01T06:56:07.411 INFO:tasks.workunit.client.1.smithi089.stdout:9/830: dwrite d18/f7e [0,4194304] 0 2024-08-01T06:56:07.412 INFO:tasks.workunit.client.1.smithi089.stdout:1/969: getdents d0/d9/d43/d4b 0 2024-08-01T06:56:07.413 INFO:tasks.workunit.client.1.smithi089.stdout:3/723: write d7/d32/d4c/d67/d72/d91/dcb/f87 [1061712,111521] 0 2024-08-01T06:56:07.414 INFO:tasks.workunit.client.1.smithi089.stdout:8/987: rmdir d5/d15/d5a/d73/d87/dbf/d110/d11b 0 2024-08-01T06:56:07.415 INFO:tasks.workunit.client.1.smithi089.stdout:4/977: dread - d3/d17/d3a/d4a/de1/d103/f99 zero size 2024-08-01T06:56:07.416 INFO:tasks.workunit.client.1.smithi089.stdout:0/904: truncate d9/d40/d25/d46/d91/d2e/fce 1871132 0 2024-08-01T06:56:07.416 INFO:tasks.workunit.client.1.smithi089.stdout:4/978: chown d3/d1e 103 1 2024-08-01T06:56:07.416 INFO:tasks.workunit.client.1.smithi089.stdout:3/724: stat d7/d68/d50/l93 0 2024-08-01T06:56:07.417 INFO:tasks.workunit.client.1.smithi089.stdout:1/970: chown d0/d9/d15/d2d/d4a/f5e 10805536 1 2024-08-01T06:56:07.419 INFO:tasks.workunit.client.1.smithi089.stdout:8/988: mkdir d5/d15/d5a/d73/d154 0 2024-08-01T06:56:07.423 INFO:tasks.workunit.client.1.smithi089.stdout:3/725: readlink d7/d32/d12/d29/d39/d4b/lad 0 2024-08-01T06:56:07.423 INFO:tasks.workunit.client.1.smithi089.stdout:4/979: chown d3/db/d33/f56 1 1 2024-08-01T06:56:07.424 INFO:tasks.workunit.client.1.smithi089.stdout:1/971: write d0/d9/d15/dce/f10e [1145668,84693] 0 2024-08-01T06:56:07.425 INFO:tasks.workunit.client.1.smithi089.stdout:0/905: link d9/d40/d45/db7/fff d9/d40/d45/db7/f11c 0 2024-08-01T06:56:07.425 INFO:tasks.workunit.client.1.smithi089.stdout:5/926: dwrite d5/de/d57/d8e/d97/da5/dde/de9/fb2 [0,4194304] 0 2024-08-01T06:56:07.431 INFO:tasks.workunit.client.1.smithi089.stdout:1/972: creat d0/d9/de1/f13d x:0 0 0 2024-08-01T06:56:07.431 INFO:tasks.workunit.client.1.smithi089.stdout:9/831: write d18/d22/d39/f3a [923075,115658] 0 2024-08-01T06:56:07.432 INFO:tasks.workunit.client.1.smithi089.stdout:3/726: mknod d7/d32/d12/d29/d39/d4b/d83/ce8 0 2024-08-01T06:56:07.432 INFO:tasks.workunit.client.1.smithi089.stdout:5/927: unlink d5/de/f59 0 2024-08-01T06:56:07.434 INFO:tasks.workunit.client.1.smithi089.stdout:1/973: unlink d0/d9/d43/c68 0 2024-08-01T06:56:07.436 INFO:tasks.workunit.client.1.smithi089.stdout:3/727: write d7/d32/d12/d1b/f4a [240594,64052] 0 2024-08-01T06:56:07.438 INFO:tasks.workunit.client.1.smithi089.stdout:5/928: creat d5/dac/d105/d10c/d121/f12a x:0 0 0 2024-08-01T06:56:07.439 INFO:tasks.workunit.client.1.smithi089.stdout:8/989: dwrite d5/dc/d12/db9/fd1 [0,4194304] 0 2024-08-01T06:56:07.443 INFO:tasks.workunit.client.1.smithi089.stdout:8/990: symlink d5/d15/d5a/d73/d87/dbf/l155 0 2024-08-01T06:56:07.446 INFO:tasks.workunit.client.1.smithi089.stdout:1/974: dread d0/d9/d15/d3b/d3d/f7f [0,4194304] 0 2024-08-01T06:56:07.447 INFO:tasks.workunit.client.1.smithi089.stdout:5/929: mknod d5/de/d10/d16/d1b/d25/c12b 0 2024-08-01T06:56:07.447 INFO:tasks.workunit.client.1.smithi089.stdout:0/906: dread d9/d40/d95/d99/f73 [0,4194304] 0 2024-08-01T06:56:07.449 INFO:tasks.workunit.client.1.smithi089.stdout:5/930: read d5/d13/d43/f4e [3504689,126304] 0 2024-08-01T06:56:07.451 INFO:tasks.workunit.client.1.smithi089.stdout:5/931: chown d5/d13/d43/c85 256588701 1 2024-08-01T06:56:07.454 INFO:tasks.workunit.client.1.smithi089.stdout:5/932: write d5/dac/d105/dbd/df0/d5f/f126 [424712,30481] 0 2024-08-01T06:56:07.454 INFO:tasks.workunit.client.1.smithi089.stdout:8/991: dwrite d5/dc/d94/dc7/dba/f12f [0,4194304] 0 2024-08-01T06:56:07.456 INFO:tasks.workunit.client.1.smithi089.stdout:1/975: rename d0/d9/d15/d3b/d95/d49/d82/da6/dc3 to d0/d9/d15/d3b/d3d/d77/d8f/d130/d13e 0 2024-08-01T06:56:07.458 INFO:tasks.workunit.client.1.smithi089.stdout:8/992: stat d5/dc/d94/dc7/dba/d100 0 2024-08-01T06:56:07.459 INFO:tasks.workunit.client.1.smithi089.stdout:5/933: dread - d5/dac/d105/d10c/d121/f12a zero size 2024-08-01T06:56:07.462 INFO:tasks.workunit.client.1.smithi089.stdout:8/993: write d5/dc/d12/d112/f13a [1009449,110558] 0 2024-08-01T06:56:07.464 INFO:tasks.workunit.client.1.smithi089.stdout:9/832: dwrite d18/d33/d49/d7b/f41 [0,4194304] 0 2024-08-01T06:56:07.468 INFO:tasks.workunit.client.1.smithi089.stdout:3/728: dwrite d7/d68/d50/d6f/d2f/da2/da8/fe7 [0,4194304] 0 2024-08-01T06:56:07.469 INFO:tasks.workunit.client.1.smithi089.stdout:3/729: dread - d7/d68/d50/d6f/d2f/d9c/fc8 zero size 2024-08-01T06:56:07.471 INFO:tasks.workunit.client.1.smithi089.stdout:8/994: symlink d5/dc/d94/dc7/dc5/dd4/l156 0 2024-08-01T06:56:07.473 INFO:tasks.workunit.client.1.smithi089.stdout:5/934: readlink d5/de/d10/d16/d1b/l51 0 2024-08-01T06:56:07.473 INFO:tasks.workunit.client.1.smithi089.stdout:8/995: chown d5/d15/d5a/d73/d87/fa9 173892670 1 2024-08-01T06:56:07.474 INFO:tasks.workunit.client.1.smithi089.stdout:8/996: write d5/d23/f6d [391145,84986] 0 2024-08-01T06:56:07.479 INFO:tasks.workunit.client.1.smithi089.stdout:8/997: rmdir d5/dc/d145 0 2024-08-01T06:56:07.482 INFO:tasks.workunit.client.1.smithi089.stdout:8/998: creat d5/d23/f157 x:0 0 0 2024-08-01T06:56:07.485 INFO:tasks.workunit.client.1.smithi089.stdout:8/999: creat d5/d15/d5a/d73/d87/d14f/f158 x:0 0 0 2024-08-01T06:56:07.489 INFO:tasks.workunit.client.1.smithi089.stdout:3/730: dread d7/d32/d12/d29/f77 [0,4194304] 0 2024-08-01T06:56:07.493 INFO:tasks.workunit.client.1.smithi089.stdout:3/731: mknod d7/d68/d50/d89/ce9 0 2024-08-01T06:56:07.493 INFO:tasks.workunit.client.1.smithi089.stdout:1/976: dread d0/d9/d15/d2d/f53 [0,4194304] 0 2024-08-01T06:56:07.494 INFO:tasks.workunit.client.1.smithi089.stdout:3/732: chown d7/d68/d50/d6f/d46 5936 1 2024-08-01T06:56:07.497 INFO:tasks.workunit.client.1.smithi089.stdout:3/733: mkdir d7/d32/d4c/d53/dea 0 2024-08-01T06:56:07.498 INFO:tasks.workunit.client.1.smithi089.stdout:1/977: rename d0/c3 to d0/d9/d43/d4b/c13f 0 2024-08-01T06:56:07.499 INFO:tasks.workunit.client.1.smithi089.stdout:9/833: dread d18/d33/d53/f8b [0,4194304] 0 2024-08-01T06:56:07.500 INFO:tasks.workunit.client.1.smithi089.stdout:3/734: mkdir d7/d32/d12/d29/d39/d4b/deb 0 2024-08-01T06:56:07.500 INFO:tasks.workunit.client.1.smithi089.stdout:1/978: creat d0/d9/d15/d76/f140 x:0 0 0 2024-08-01T06:56:07.501 INFO:tasks.workunit.client.1.smithi089.stdout:9/834: symlink d18/d22/da2/l113 0 2024-08-01T06:56:07.501 INFO:tasks.workunit.client.1.smithi089.stdout:3/735: mknod d7/d32/d4c/d53/d5f/cec 0 2024-08-01T06:56:07.503 INFO:tasks.workunit.client.1.smithi089.stdout:1/979: mknod d0/d9/d15/d3b/d3d/c141 0 2024-08-01T06:56:07.504 INFO:tasks.workunit.client.1.smithi089.stdout:3/736: unlink d7/d32/d4c/d67/d72/d91/dcb/lc1 0 2024-08-01T06:56:07.504 INFO:tasks.workunit.client.1.smithi089.stdout:9/835: creat d18/d33/d49/d7b/d7f/d98/d9f/f114 x:0 0 0 2024-08-01T06:56:07.505 INFO:tasks.workunit.client.1.smithi089.stdout:3/737: rmdir d7/d32/d4c/d53/d5f 39 2024-08-01T06:56:07.506 INFO:tasks.workunit.client.1.smithi089.stdout:1/980: symlink d0/d9/d15/d3b/d3d/db5/df6/l142 0 2024-08-01T06:56:07.508 INFO:tasks.workunit.client.1.smithi089.stdout:3/738: rename d7/d32/d4c/d67/d72/d91/dcb/da5/fc6 to d7/d32/d4c/d69/d6d/dc7/fed 0 2024-08-01T06:56:07.512 INFO:tasks.workunit.client.1.smithi089.stdout:1/981: dwrite d0/d9/d15/d3b/d3d/db5/f136 [0,4194304] 0 2024-08-01T06:56:07.513 INFO:tasks.workunit.client.1.smithi089.stdout:3/739: rename d7/d68/d50/d6f/d46/l84 to d7/d32/d4c/d67/d72/lee 0 2024-08-01T06:56:07.516 INFO:tasks.workunit.client.1.smithi089.stdout:3/740: creat d7/d68/d50/d6f/d2f/fef x:0 0 0 2024-08-01T06:56:07.522 INFO:tasks.workunit.client.1.smithi089.stdout:3/741: dwrite d7/d32/d4c/d53/f99 [0,4194304] 0 2024-08-01T06:56:07.524 INFO:tasks.workunit.client.1.smithi089.stdout:3/742: unlink d7/d32/d4c/f7a 0 2024-08-01T06:56:07.526 INFO:tasks.workunit.client.1.smithi089.stdout:3/743: creat d7/d32/d4c/d67/ff0 x:0 0 0 2024-08-01T06:56:07.531 INFO:tasks.workunit.client.1.smithi089.stdout:3/744: creat d7/d32/d12/d29/d39/d4b/dd2/dd5/ff1 x:0 0 0 2024-08-01T06:56:07.532 INFO:tasks.workunit.client.1.smithi089.stdout:3/745: creat d7/d32/d12/d29/d39/d4b/dd2/dd5/ff2 x:0 0 0 2024-08-01T06:56:07.534 INFO:tasks.workunit.client.1.smithi089.stdout:3/746: mkdir d7/d32/d12/df3 0 2024-08-01T06:56:07.538 INFO:tasks.workunit.client.1.smithi089.stdout:3/747: link d7/d32/d12/d1b/f3c d7/d32/d9f/ff4 0 2024-08-01T06:56:07.539 INFO:tasks.workunit.client.1.smithi089.stdout:3/748: write d7/d32/d4c/d67/ff0 [711381,33785] 0 2024-08-01T06:56:07.541 INFO:tasks.workunit.client.1.smithi089.stdout:3/749: mkdir d7/d32/d12/d29/d39/d4b/df5 0 2024-08-01T06:56:07.541 INFO:tasks.workunit.client.1.smithi089.stdout:3/750: stat d7/d32/d12/d29/d39/d4b/dd2/dd5 0 2024-08-01T06:56:07.543 INFO:tasks.workunit.client.1.smithi089.stdout:3/751: symlink d7/d68/d3d/lf6 0 2024-08-01T06:56:07.544 INFO:tasks.workunit.client.1.smithi089.stdout:3/752: mknod d7/d68/d50/d89/cf7 0 2024-08-01T06:56:07.545 INFO:tasks.workunit.client.1.smithi089.stdout:3/753: write d7/d32/d4c/d69/d6d/dc7/fe2 [430776,60542] 0 2024-08-01T06:56:07.547 INFO:tasks.workunit.client.1.smithi089.stdout:3/754: write d7/d68/d50/d6f/d2f/d9c/f9d [1711260,113703] 0 2024-08-01T06:56:07.547 INFO:tasks.workunit.client.1.smithi089.stdout:3/755: chown d7/d32/d12/d29 25155 1 2024-08-01T06:56:07.548 INFO:tasks.workunit.client.1.smithi089.stdout:3/756: dread - d7/d32/d4c/d69/f96 zero size 2024-08-01T06:56:07.552 INFO:tasks.workunit.client.1.smithi089.stdout:3/757: dread d7/d32/d12/d1b/f3c [0,4194304] 0 2024-08-01T06:56:07.556 INFO:tasks.workunit.client.1.smithi089.stdout:3/758: link d7/d32/d4c/d69/d6d/f6e d7/d32/d12/d29/d39/d4b/ff8 0 2024-08-01T06:56:07.557 INFO:tasks.workunit.client.1.smithi089.stdout:3/759: write d7/d68/d50/d6f/d2f/d9c/f9d [857207,10856] 0 2024-08-01T06:56:07.566 INFO:tasks.workunit.client.1.smithi089.stdout:3/760: dwrite d7/d32/f64 [0,4194304] 0 2024-08-01T06:56:07.569 INFO:tasks.workunit.client.1.smithi089.stdout:3/761: creat d7/d32/d4c/d67/ff9 x:0 0 0 2024-08-01T06:56:07.570 INFO:tasks.workunit.client.1.smithi089.stdout:3/762: mkdir d7/d32/d9f/dfa 0 2024-08-01T06:56:07.578 INFO:tasks.workunit.client.1.smithi089.stdout:3/763: dwrite d7/d32/d12/d29/d39/d4b/dd2/dd5/ff2 [0,4194304] 0 2024-08-01T06:56:07.586 INFO:tasks.workunit.client.1.smithi089.stdout:3/764: dread d7/d32/d12/d29/d39/d4b/d83/f9b [0,4194304] 0 2024-08-01T06:56:07.589 INFO:tasks.workunit.client.1.smithi089.stdout:3/765: link d7/d32/d4c/d67/fac d7/d32/d4c/d69/d6d/ffb 0 2024-08-01T06:56:07.591 INFO:tasks.workunit.client.1.smithi089.stdout:3/766: symlink d7/d32/d12/d29/d39/d4b/lfc 0 2024-08-01T06:56:07.592 INFO:tasks.workunit.client.1.smithi089.stdout:3/767: chown d7/d68/d50/d6f/d2f/da2/cae 1453 1 2024-08-01T06:56:07.608 INFO:tasks.workunit.client.1.smithi089.stdout:3/768: dread d7/d32/d4c/d69/f20 [4194304,4194304] 0 2024-08-01T06:56:07.609 INFO:tasks.workunit.client.1.smithi089.stdout:3/769: chown d7/d68/d50/d6f/d2f/c44 11129 1 2024-08-01T06:56:07.612 INFO:tasks.workunit.client.1.smithi089.stdout:3/770: mkdir d7/d32/d4c/d67/d72/d91/dcb/dfd 0 2024-08-01T06:56:07.615 INFO:tasks.workunit.client.1.smithi089.stdout:3/771: rename d7/d32/d4c/l7d to d7/d32/d4c/d67/d72/d91/dcb/d78/lfe 0 2024-08-01T06:56:07.616 INFO:tasks.workunit.client.1.smithi089.stdout:3/772: fsync d7/d32/d4c/d67/d72/d91/dcb/fa4 0 2024-08-01T06:56:07.617 INFO:tasks.workunit.client.1.smithi089.stdout:3/773: fdatasync d7/d32/d12/d1b/fd3 0 2024-08-01T06:56:07.619 INFO:tasks.workunit.client.1.smithi089.stdout:3/774: symlink d7/d32/d12/d29/d39/d4b/deb/lff 0 2024-08-01T06:56:07.620 INFO:tasks.workunit.client.1.smithi089.stdout:3/775: write d7/d32/d12/d29/d39/d4b/dd2/dd5/ff1 [1041148,12968] 0 2024-08-01T06:56:07.622 INFO:tasks.workunit.client.1.smithi089.stdout:3/776: creat d7/d32/d4c/d53/dea/f100 x:0 0 0 2024-08-01T06:56:07.623 INFO:tasks.workunit.client.1.smithi089.stdout:3/777: write d7/d68/d50/d6f/d2f/d9c/fc8 [17503,52246] 0 2024-08-01T06:56:07.624 INFO:tasks.workunit.client.1.smithi089.stdout:3/778: fdatasync d7/d32/d12/d29/d39/d4b/dd2/dd5/ff2 0 2024-08-01T06:56:07.630 INFO:tasks.workunit.client.1.smithi089.stdout:3/779: dwrite d7/d32/d4c/d67/ff9 [0,4194304] 0 2024-08-01T06:56:07.631 INFO:tasks.workunit.client.1.smithi089.stdout:3/780: chown d7/d68/d50/d6f/d46/dd1 14 1 2024-08-01T06:56:07.635 INFO:tasks.workunit.client.1.smithi089.stdout:3/781: creat d7/d68/d50/d6f/f101 x:0 0 0 2024-08-01T06:56:07.636 INFO:tasks.workunit.client.1.smithi089.stdout:3/782: fdatasync d7/d32/d4c/d67/ff0 0 2024-08-01T06:56:07.638 INFO:tasks.workunit.client.1.smithi089.stdout:3/783: mknod d7/d32/d4c/d69/d6d/dc7/c102 0 2024-08-01T06:56:07.656 INFO:tasks.workunit.client.1.smithi089.stdout:3/784: dread d7/fb0 [0,4194304] 0 2024-08-01T06:56:07.660 INFO:tasks.workunit.client.1.smithi089.stdout:3/785: getdents d7/d32/d12/d29/d39 0 2024-08-01T06:56:07.662 INFO:tasks.workunit.client.1.smithi089.stdout:3/786: creat d7/d32/d4c/d69/f103 x:0 0 0 2024-08-01T06:56:07.663 INFO:tasks.workunit.client.1.smithi089.stdout:3/787: read d7/d32/d4c/d69/f1a [498602,61463] 0 2024-08-01T06:56:07.665 INFO:tasks.workunit.client.1.smithi089.stdout:3/788: truncate d7/d32/d12/d1b/f3c 722221 0 2024-08-01T06:56:07.666 INFO:tasks.workunit.client.1.smithi089.stdout:3/789: fsync d7/d32/d4c/d69/f1a 0 2024-08-01T06:56:07.667 INFO:tasks.workunit.client.1.smithi089.stdout:3/790: chown d7/d32/d4c/d67/d72/d91/dcb/dbc 330665585 1 2024-08-01T06:56:07.670 INFO:tasks.workunit.client.1.smithi089.stdout:3/791: rename d7/d32/d4c/d53/d5f/lc5 to d7/d32/d4c/d67/db4/ddc/l104 0 2024-08-01T06:56:07.672 INFO:tasks.workunit.client.1.smithi089.stdout:3/792: symlink d7/d32/d4c/d69/l105 0 2024-08-01T06:56:07.675 INFO:tasks.workunit.client.1.smithi089.stdout:3/793: rename d7/d32/d4c/d69/d6d/f90 to d7/d68/d50/f106 0 2024-08-01T06:56:07.677 INFO:tasks.workunit.client.1.smithi089.stdout:3/794: creat d7/d32/d4c/d69/d6d/dc7/f107 x:0 0 0 2024-08-01T06:56:07.679 INFO:tasks.workunit.client.1.smithi089.stdout:3/795: symlink d7/d32/d4c/d67/d72/d91/dcb/dfd/l108 0 2024-08-01T06:56:07.680 INFO:tasks.workunit.client.1.smithi089.stdout:3/796: truncate d7/d32/d4c/d69/d6d/ffb 569470 0 2024-08-01T06:56:07.690 INFO:tasks.workunit.client.1.smithi089.stdout:3/797: dwrite d7/d32/d12/d29/f95 [0,4194304] 0 2024-08-01T06:56:07.692 INFO:tasks.workunit.client.1.smithi089.stdout:3/798: creat d7/d32/d12/df3/f109 x:0 0 0 2024-08-01T06:56:07.693 INFO:tasks.workunit.client.1.smithi089.stdout:3/799: fsync d7/d32/d12/d1b/f51 0 2024-08-01T06:56:07.695 INFO:tasks.workunit.client.1.smithi089.stdout:3/800: dread - d7/d32/d4c/d53/dea/f100 zero size 2024-08-01T06:56:07.697 INFO:tasks.workunit.client.1.smithi089.stdout:3/801: rmdir d7/d32/d4c/d67 39 2024-08-01T06:56:07.700 INFO:tasks.workunit.client.1.smithi089.stdout:6/919: sync 2024-08-01T06:56:07.700 INFO:tasks.workunit.client.1.smithi089.stdout:2/855: sync 2024-08-01T06:56:07.700 INFO:tasks.workunit.client.1.smithi089.stdout:2/856: chown d7/d1f/d52/d72/fec 1031095 1 2024-08-01T06:56:07.701 INFO:tasks.workunit.client.1.smithi089.stdout:3/802: dread d7/d32/d4c/d69/f20 [4194304,4194304] 0 2024-08-01T06:56:07.701 INFO:tasks.workunit.client.1.smithi089.stdout:6/920: write d2/d11/d1f/d46/fdb [3354867,45735] 0 2024-08-01T06:56:07.703 INFO:tasks.workunit.client.1.smithi089.stdout:2/857: unlink d7/d19/d3b/f95 0 2024-08-01T06:56:07.704 INFO:tasks.workunit.client.1.smithi089.stdout:6/921: truncate d2/d11/f1d 4170058 0 2024-08-01T06:56:07.705 INFO:tasks.workunit.client.1.smithi089.stdout:2/858: truncate d7/d19/d1e/d3d/f10e 669721 0 2024-08-01T06:56:07.705 INFO:tasks.workunit.client.1.smithi089.stdout:3/803: truncate d7/d32/d12/d1b/f3c 660589 0 2024-08-01T06:56:07.705 INFO:tasks.workunit.client.1.smithi089.stdout:6/922: write d2/d2e/d7c/f110 [138740,123926] 0 2024-08-01T06:56:07.708 INFO:tasks.workunit.client.1.smithi089.stdout:6/923: mknod d2/d11/d1f/d46/d6b/d7d/dc9/df6/c12f 0 2024-08-01T06:56:07.710 INFO:tasks.workunit.client.1.smithi089.stdout:2/859: read d7/fa [775038,92071] 0 2024-08-01T06:56:07.712 INFO:tasks.workunit.client.1.smithi089.stdout:6/924: getdents d2/d2e/d2f/d91 0 2024-08-01T06:56:07.712 INFO:tasks.workunit.client.1.smithi089.stdout:6/925: chown d2 17 1 2024-08-01T06:56:07.715 INFO:tasks.workunit.client.1.smithi089.stdout:6/926: unlink d2/d2e/d7c/f11d 0 2024-08-01T06:56:07.715 INFO:tasks.workunit.client.1.smithi089.stdout:6/927: fdatasync d2/d11/d1f/fed 0 2024-08-01T06:56:07.718 INFO:tasks.workunit.client.1.smithi089.stdout:6/928: stat d2/d11/d1a/d1c/fb5 0 2024-08-01T06:56:07.718 INFO:tasks.workunit.client.1.smithi089.stdout:6/929: chown d2/d11/d1a/d1c/db6 108 1 2024-08-01T06:56:07.719 INFO:tasks.workunit.client.1.smithi089.stdout:3/804: dread d7/d68/d50/d6f/f58 [4194304,4194304] 0 2024-08-01T06:56:07.720 INFO:tasks.workunit.client.1.smithi089.stdout:6/930: readlink d2/d2e/d2f/d91/la8 0 2024-08-01T06:56:07.720 INFO:tasks.workunit.client.1.smithi089.stdout:3/805: fdatasync d7/d32/d12/f33 0 2024-08-01T06:56:07.721 INFO:tasks.workunit.client.1.smithi089.stdout:3/806: truncate d7/f1f 5028229 0 2024-08-01T06:56:07.723 INFO:tasks.workunit.client.1.smithi089.stdout:3/807: symlink d7/d32/d12/d29/d39/d4b/d83/l10a 0 2024-08-01T06:56:07.724 INFO:tasks.workunit.client.1.smithi089.stdout:3/808: readlink d7/d68/le4 0 2024-08-01T06:56:07.726 INFO:tasks.workunit.client.1.smithi089.stdout:3/809: truncate d7/d32/d4c/d53/dea/f100 785468 0 2024-08-01T06:56:07.727 INFO:tasks.workunit.client.1.smithi089.stdout:3/810: write d7/d32/d4c/d69/fb9 [2483099,95299] 0 2024-08-01T06:56:07.728 INFO:tasks.workunit.client.1.smithi089.stdout:6/931: write d2/d11/f1d [872528,130343] 0 2024-08-01T06:56:07.730 INFO:tasks.workunit.client.1.smithi089.stdout:3/811: creat d7/d68/d50/d6f/d46/dd1/f10b x:0 0 0 2024-08-01T06:56:07.731 INFO:tasks.workunit.client.1.smithi089.stdout:3/812: rmdir d7/d68/d50/d6f/d2f 39 2024-08-01T06:56:07.733 INFO:tasks.workunit.client.1.smithi089.stdout:6/932: link d2/d11/d1f/d46/l121 d2/d11/d1f/d46/d6b/l130 0 2024-08-01T06:56:07.734 INFO:tasks.workunit.client.1.smithi089.stdout:6/933: dread - d2/d11/d1a/d1c/dea/d11f/f12c zero size 2024-08-01T06:56:07.736 INFO:tasks.workunit.client.1.smithi089.stdout:3/813: rename d7/d32/d12/d29/f95 to d7/d32/d12/d1b/f10c 0 2024-08-01T06:56:07.737 INFO:tasks.workunit.client.1.smithi089.stdout:6/934: symlink d2/d2e/d2f/d91/l131 0 2024-08-01T06:56:07.744 INFO:tasks.workunit.client.1.smithi089.stdout:3/814: dwrite d7/d32/d4c/d67/d72/d91/dcb/da9/fde [0,4194304] 0 2024-08-01T06:56:07.746 INFO:tasks.workunit.client.1.smithi089.stdout:3/815: read d7/d32/d4c/d67/ff0 [548594,93714] 0 2024-08-01T06:56:07.752 INFO:tasks.workunit.client.1.smithi089.stdout:3/816: truncate d7/f1f 3840786 0 2024-08-01T06:56:07.753 INFO:tasks.workunit.client.1.smithi089.stdout:6/935: dread d2/d2e/d7c/f95 [0,4194304] 0 2024-08-01T06:56:07.754 INFO:tasks.workunit.client.1.smithi089.stdout:3/817: mkdir d7/d32/d4c/d53/d10d 0 2024-08-01T06:56:07.755 INFO:tasks.workunit.client.1.smithi089.stdout:6/936: mknod d2/d11/d1f/d46/d6b/d7d/dff/c132 0 2024-08-01T06:56:07.756 INFO:tasks.workunit.client.1.smithi089.stdout:3/818: symlink d7/d32/d4c/d69/l10e 0 2024-08-01T06:56:07.758 INFO:tasks.workunit.client.1.smithi089.stdout:6/937: truncate d2/d11/d1f/fed 224077 0 2024-08-01T06:56:07.758 INFO:tasks.workunit.client.1.smithi089.stdout:3/819: symlink d7/d32/d4c/d67/d72/d91/dcb/da5/l10f 0 2024-08-01T06:56:07.760 INFO:tasks.workunit.client.1.smithi089.stdout:6/938: symlink d2/d2e/dc2/dd2/l133 0 2024-08-01T06:56:07.761 INFO:tasks.workunit.client.1.smithi089.stdout:3/820: chown d7/d32/d12/l2b 95 1 2024-08-01T06:56:07.767 INFO:tasks.workunit.client.1.smithi089.stdout:3/821: write d7/d32/d4c/d69/d6d/f6e [122583,28054] 0 2024-08-01T06:56:07.770 INFO:tasks.workunit.client.1.smithi089.stdout:6/939: dread d2/d11/d1a/d1c/fb5 [0,4194304] 0 2024-08-01T06:56:07.770 INFO:tasks.workunit.client.1.smithi089.stdout:3/822: getdents d7/d32/d4c/d53/d5f 0 2024-08-01T06:56:07.770 INFO:tasks.workunit.client.1.smithi089.stdout:6/940: chown d2/d2e/d98/l8f 894776 1 2024-08-01T06:56:07.771 INFO:tasks.workunit.client.1.smithi089.stdout:3/823: chown d7/d68/d50/d6f/d2f 1276129321 1 2024-08-01T06:56:07.772 INFO:tasks.workunit.client.1.smithi089.stdout:6/941: read d2/d11/d1f/d46/f62 [3640129,103230] 0 2024-08-01T06:56:07.773 INFO:tasks.workunit.client.1.smithi089.stdout:3/824: creat d7/d32/d4c/d67/db4/f110 x:0 0 0 2024-08-01T06:56:07.777 INFO:tasks.workunit.client.1.smithi089.stdout:3/825: link d7/d32/d4c/d69/l105 d7/d68/d50/d6f/d2f/d9c/l111 0 2024-08-01T06:56:07.778 INFO:tasks.workunit.client.1.smithi089.stdout:3/826: chown d7/d32/d12/lb3 2 1 2024-08-01T06:56:07.781 INFO:tasks.workunit.client.1.smithi089.stdout:7/932: sync 2024-08-01T06:56:07.782 INFO:tasks.workunit.client.1.smithi089.stdout:9/836: sync 2024-08-01T06:56:07.782 INFO:tasks.workunit.client.1.smithi089.stdout:1/982: sync 2024-08-01T06:56:07.782 INFO:tasks.workunit.client.1.smithi089.stdout:5/935: sync 2024-08-01T06:56:07.782 INFO:tasks.workunit.client.1.smithi089.stdout:4/980: sync 2024-08-01T06:56:07.782 INFO:tasks.workunit.client.1.smithi089.stdout:0/907: sync 2024-08-01T06:56:07.784 INFO:tasks.workunit.client.1.smithi089.stdout:9/837: fdatasync d18/f30 0 2024-08-01T06:56:07.785 INFO:tasks.workunit.client.1.smithi089.stdout:7/933: mknod d7/df/c13c 0 2024-08-01T06:56:07.787 INFO:tasks.workunit.client.1.smithi089.stdout:5/936: unlink d5/de/f11c 0 2024-08-01T06:56:07.788 INFO:tasks.workunit.client.1.smithi089.stdout:6/942: dread d2/d2e/d2f/d9e/feb [0,4194304] 0 2024-08-01T06:56:07.788 INFO:tasks.workunit.client.1.smithi089.stdout:3/827: dwrite d7/d32/d4c/d67/d72/d91/dcb/f87 [0,4194304] 0 2024-08-01T06:56:07.788 INFO:tasks.workunit.client.1.smithi089.stdout:0/908: write d9/d40/d45/d47/da8/fac [1541450,55297] 0 2024-08-01T06:56:07.789 INFO:tasks.workunit.client.1.smithi089.stdout:4/981: write d3/db/de/d5b/db9/f12c [754416,111445] 0 2024-08-01T06:56:07.791 INFO:tasks.workunit.client.1.smithi089.stdout:1/983: fdatasync d0/d9/d15/d2d/d4a/d61/f86 0 2024-08-01T06:56:07.792 INFO:tasks.workunit.client.1.smithi089.stdout:7/934: rmdir d7/d46/d7b/d12c/dbb 39 2024-08-01T06:56:07.793 INFO:tasks.workunit.client.1.smithi089.stdout:3/828: write d7/d32/d4c/d69/d6d/f6e [2099624,58063] 0 2024-08-01T06:56:07.795 INFO:tasks.workunit.client.1.smithi089.stdout:5/937: mkdir d5/dac/d105/dbd/df0/d5d/d6c/d98/d12c 0 2024-08-01T06:56:07.805 INFO:tasks.workunit.client.1.smithi089.stdout:6/943: link d2/d11/d1a/cd5 d2/d11/d1f/d46/d6b/d7d/dff/c134 0 2024-08-01T06:56:07.806 INFO:tasks.workunit.client.1.smithi089.stdout:4/982: dwrite d3/d17/d3a/d4a/d11e/d129/f12a [0,4194304] 0 2024-08-01T06:56:07.807 INFO:tasks.workunit.client.1.smithi089.stdout:5/938: dread d5/dac/d105/dbd/df0/d5d/d6c/fa1 [0,4194304] 0 2024-08-01T06:56:07.808 INFO:tasks.workunit.client.1.smithi089.stdout:3/829: link d7/dce/ldb d7/d32/d4c/d69/d6d/dc7/l112 0 2024-08-01T06:56:07.808 INFO:tasks.workunit.client.1.smithi089.stdout:1/984: dread d0/d9/d15/d3b/d95/fa1 [0,4194304] 0 2024-08-01T06:56:07.809 INFO:tasks.workunit.client.1.smithi089.stdout:0/909: dwrite d9/d40/d25/d46/d91/d2e/d44/d72/d8b/fe6 [0,4194304] 0 2024-08-01T06:56:07.810 INFO:tasks.workunit.client.1.smithi089.stdout:6/944: chown d2/d11/d1f/c7f 26 1 2024-08-01T06:56:07.811 INFO:tasks.workunit.client.1.smithi089.stdout:4/983: dread - d3/db/d33/f126 zero size 2024-08-01T06:56:07.815 INFO:tasks.workunit.client.1.smithi089.stdout:0/910: mkdir d9/d40/d45/dc1/d11d 0 2024-08-01T06:56:07.819 INFO:tasks.workunit.client.1.smithi089.stdout:7/935: dwrite d7/df/d10/f24 [0,4194304] 0 2024-08-01T06:56:07.820 INFO:tasks.workunit.client.1.smithi089.stdout:1/985: dread d0/d9/d15/d2d/d4a/d4d/f6e [0,4194304] 0 2024-08-01T06:56:07.821 INFO:tasks.workunit.client.1.smithi089.stdout:5/939: rename d5/de/df/cf6 to d5/dac/d105/d103/d115/c12d 0 2024-08-01T06:56:07.824 INFO:tasks.workunit.client.1.smithi089.stdout:1/986: chown d0/f24 248 1 2024-08-01T06:56:07.824 INFO:tasks.workunit.client.1.smithi089.stdout:6/945: dwrite d2/d2e/d2f/f6d [8388608,4194304] 0 2024-08-01T06:56:07.825 INFO:tasks.workunit.client.1.smithi089.stdout:4/984: mkdir d3/d17/d3a/d4a/d11e/db1/dbb/d62/d31/d12f 0 2024-08-01T06:56:07.826 INFO:tasks.workunit.client.1.smithi089.stdout:6/946: stat d2/d11/db4/f10a 0 2024-08-01T06:56:07.830 INFO:tasks.workunit.client.1.smithi089.stdout:7/936: dread - d7/fc1 zero size 2024-08-01T06:56:07.830 INFO:tasks.workunit.client.1.smithi089.stdout:1/987: symlink d0/d9/d15/d3b/d95/d49/l143 0 2024-08-01T06:56:07.831 INFO:tasks.workunit.client.1.smithi089.stdout:4/985: write d3/d17/d3a/d4a/de1/f10d [573339,24489] 0 2024-08-01T06:56:07.831 INFO:tasks.workunit.client.1.smithi089.stdout:6/947: rmdir d2/d11/d1f/d46/d6b 39 2024-08-01T06:56:07.832 INFO:tasks.workunit.client.1.smithi089.stdout:5/940: creat d5/dac/d105/dbd/df0/d5d/d6c/d98/d12c/f12e x:0 0 0 2024-08-01T06:56:07.837 INFO:tasks.workunit.client.1.smithi089.stdout:3/830: truncate d7/d32/d12/d29/f77 5105903 0 2024-08-01T06:56:07.840 INFO:tasks.workunit.client.1.smithi089.stdout:5/941: write d5/dac/d105/dbd/df0/d5d/d6c/fa1 [1408259,62548] 0 2024-08-01T06:56:07.842 INFO:tasks.workunit.client.1.smithi089.stdout:7/937: dread d7/df/d91/da4/f38 [0,4194304] 0 2024-08-01T06:56:07.842 INFO:tasks.workunit.client.1.smithi089.stdout:3/831: symlink d7/d32/l113 0 2024-08-01T06:56:07.845 INFO:tasks.workunit.client.1.smithi089.stdout:1/988: dwrite d0/d9/d15/d3b/d95/d49/d82/da6/f123 [4194304,4194304] 0 2024-08-01T06:56:07.848 INFO:tasks.workunit.client.1.smithi089.stdout:4/986: dwrite d3/d17/d3a/d4a/d11e/db1/dbb/d62/d31/f89 [0,4194304] 0 2024-08-01T06:56:07.850 INFO:tasks.workunit.client.1.smithi089.stdout:1/989: creat d0/d9/d15/dce/dd3/ddd/f144 x:0 0 0 2024-08-01T06:56:07.852 INFO:tasks.workunit.client.1.smithi089.stdout:3/832: creat d7/d32/d4c/d69/f114 x:0 0 0 2024-08-01T06:56:07.852 INFO:tasks.workunit.client.1.smithi089.stdout:4/987: truncate d3/db/de/d5b/db9/f12c 1364035 0 2024-08-01T06:56:07.854 INFO:tasks.workunit.client.1.smithi089.stdout:5/942: getdents d5/de/d57/d8e/d97/da5 0 2024-08-01T06:56:07.855 INFO:tasks.workunit.client.1.smithi089.stdout:1/990: fsync d0/d9/d15/d2b/d7d/f134 0 2024-08-01T06:56:07.860 INFO:tasks.workunit.client.1.smithi089.stdout:0/911: dread d9/d40/d45/d47/da8/fcd [0,4194304] 0 2024-08-01T06:56:07.861 INFO:tasks.workunit.client.1.smithi089.stdout:3/833: mkdir d7/d32/d9f/dfa/d115 0 2024-08-01T06:56:07.861 INFO:tasks.workunit.client.1.smithi089.stdout:2/860: sync 2024-08-01T06:56:07.863 INFO:tasks.workunit.client.1.smithi089.stdout:4/988: symlink d3/d86/db7/dd2/d111/d11c/l130 0 2024-08-01T06:56:07.865 INFO:tasks.workunit.client.1.smithi089.stdout:6/948: dwrite d2/d11/f17 [0,4194304] 0 2024-08-01T06:56:07.867 INFO:tasks.workunit.client.1.smithi089.stdout:3/834: symlink d7/d32/d4c/d67/l116 0 2024-08-01T06:56:07.870 INFO:tasks.workunit.client.1.smithi089.stdout:7/938: dread d7/df/d10/f34 [0,4194304] 0 2024-08-01T06:56:07.872 INFO:tasks.workunit.client.1.smithi089.stdout:6/949: chown d2/d2e/d7c/l92 3 1 2024-08-01T06:56:07.872 INFO:tasks.workunit.client.1.smithi089.stdout:1/991: dwrite d0/d9/d15/dce/f10e [0,4194304] 0 2024-08-01T06:56:07.874 INFO:tasks.workunit.client.1.smithi089.stdout:7/939: chown d7/df/d10/l2e 38 1 2024-08-01T06:56:07.874 INFO:tasks.workunit.client.1.smithi089.stdout:3/835: mkdir d7/d32/d4c/d67/d72/d91/d117 0 2024-08-01T06:56:07.875 INFO:tasks.workunit.client.1.smithi089.stdout:4/989: rmdir d3/d17/d3a/d4a/d11e/db1/dbb/d62/d31 39 2024-08-01T06:56:07.876 INFO:tasks.workunit.client.1.smithi089.stdout:3/836: fsync d7/d32/f98 0 2024-08-01T06:56:07.880 INFO:tasks.workunit.client.1.smithi089.stdout:7/940: dread d7/d46/f68 [0,4194304] 0 2024-08-01T06:56:07.880 INFO:tasks.workunit.client.1.smithi089.stdout:0/912: link d9/d40/d25/d46/d91/d2e/f42 d9/d40/d45/d47/da8/d10c/f11e 0 2024-08-01T06:56:07.884 INFO:tasks.workunit.client.1.smithi089.stdout:2/861: write d7/d1f/d28/fa3 [979233,61879] 0 2024-08-01T06:56:07.885 INFO:tasks.workunit.client.1.smithi089.stdout:1/992: truncate d0/d9/d15/d2d/f53 1835575 0 2024-08-01T06:56:07.887 INFO:tasks.workunit.client.1.smithi089.stdout:7/941: chown d7/df/d10/d31/d4a 0 1 2024-08-01T06:56:07.887 INFO:tasks.workunit.client.1.smithi089.stdout:3/837: creat d7/d68/d50/d6f/d2f/f118 x:0 0 0 2024-08-01T06:56:07.888 INFO:tasks.workunit.client.1.smithi089.stdout:6/950: dwrite d2/d11/d1f/d46/dce/f119 [0,4194304] 0 2024-08-01T06:56:07.890 INFO:tasks.workunit.client.1.smithi089.stdout:5/943: dread d5/de/d10/d16/d1b/f22 [0,4194304] 0 2024-08-01T06:56:07.890 INFO:tasks.workunit.client.1.smithi089.stdout:4/990: rename d3/d17/d3a/d4a/d11e/db1/dbb/c34 to d3/d86/db7/c131 0 2024-08-01T06:56:07.892 INFO:tasks.workunit.client.1.smithi089.stdout:6/951: write d2/ff [6901792,104688] 0 2024-08-01T06:56:07.893 INFO:tasks.workunit.client.1.smithi089.stdout:7/942: write d7/df/d3b/fcf [608034,14921] 0 2024-08-01T06:56:07.895 INFO:tasks.workunit.client.1.smithi089.stdout:5/944: chown d5/d13/d83/c94 58626122 1 2024-08-01T06:56:07.898 INFO:tasks.workunit.client.1.smithi089.stdout:1/993: rename d0/d9/d15/d3b/d95/d49/d82/cb3 to d0/d9/d15/d3b/d3d/d77/c145 0 2024-08-01T06:56:07.899 INFO:tasks.workunit.client.1.smithi089.stdout:5/945: readlink d5/de/d57/d8e/d97/df5/l108 0 2024-08-01T06:56:07.919 INFO:tasks.workunit.client.1.smithi089.stdout:2/862: dwrite d7/d19/d1e/fbe [4194304,4194304] 0 2024-08-01T06:56:07.921 INFO:tasks.workunit.client.1.smithi089.stdout:4/991: rmdir d3/d17/d3a/d4a/de1/d11d 0 2024-08-01T06:56:07.925 INFO:tasks.workunit.client.1.smithi089.stdout:3/838: dwrite d7/d68/d50/d6f/f58 [0,4194304] 0 2024-08-01T06:56:07.926 INFO:tasks.workunit.client.1.smithi089.stdout:1/994: creat d0/d9/d15/d3b/d95/f146 x:0 0 0 2024-08-01T06:56:07.927 INFO:tasks.workunit.client.1.smithi089.stdout:7/943: getdents d7/d46/d7b/d12c/dbb 0 2024-08-01T06:56:07.928 INFO:tasks.workunit.client.1.smithi089.stdout:5/946: truncate d5/dac/d105/dbd/df0/f11d 373390 0 2024-08-01T06:56:07.930 INFO:tasks.workunit.client.1.smithi089.stdout:0/913: dread d9/d40/d95/df1/f84 [0,4194304] 0 2024-08-01T06:56:07.934 INFO:tasks.workunit.client.1.smithi089.stdout:1/995: dread - d0/d9/d15/d3b/d95/d49/d82/d124/fc9 zero size 2024-08-01T06:56:07.935 INFO:tasks.workunit.client.1.smithi089.stdout:0/914: dread d9/d40/d95/d99/dec/f10b [0,4194304] 0 2024-08-01T06:56:07.937 INFO:tasks.workunit.client.1.smithi089.stdout:1/996: creat d0/d9/d15/d3b/d3d/db5/df6/f147 x:0 0 0 2024-08-01T06:56:07.937 INFO:tasks.workunit.client.1.smithi089.stdout:3/839: dread d7/d68/d50/d6f/d2f/d9c/fd0 [0,4194304] 0 2024-08-01T06:56:07.938 INFO:tasks.workunit.client.1.smithi089.stdout:0/915: creat d9/d40/d45/d47/da8/d10c/f11f x:0 0 0 2024-08-01T06:56:07.939 INFO:tasks.workunit.client.1.smithi089.stdout:3/840: stat d7/d68/d50/d6f/d2f/d9c/fd7 0 2024-08-01T06:56:07.942 INFO:tasks.workunit.client.1.smithi089.stdout:2/863: dread d7/d19/f94 [0,4194304] 0 2024-08-01T06:56:07.942 INFO:tasks.workunit.client.1.smithi089.stdout:3/841: unlink d7/d68/d50/d6f/d2f/l3b 0 2024-08-01T06:56:07.943 INFO:tasks.workunit.client.1.smithi089.stdout:2/864: write d7/d19/d1e/d3d/f99 [1148473,125345] 0 2024-08-01T06:56:07.946 INFO:tasks.workunit.client.1.smithi089.stdout:3/842: mkdir d7/d68/d50/d119 0 2024-08-01T06:56:07.950 INFO:tasks.workunit.client.1.smithi089.stdout:5/947: dread d5/de/d10/f19 [0,4194304] 0 2024-08-01T06:56:07.950 INFO:tasks.workunit.client.1.smithi089.stdout:3/843: creat d7/d32/d4c/d67/db4/ddc/f11a x:0 0 0 2024-08-01T06:56:07.951 INFO:tasks.workunit.client.1.smithi089.stdout:4/992: write d3/d17/d3a/d4a/d11e/db1/dbb/d62/f113 [370551,47648] 0 2024-08-01T06:56:07.951 INFO:tasks.workunit.client.1.smithi089.stdout:2/865: dwrite f2 [4194304,4194304] 0 2024-08-01T06:56:07.951 INFO:tasks.workunit.client.1.smithi089.stdout:7/944: write d7/df/d91/da4/f47 [1270332,44765] 0 2024-08-01T06:56:07.954 INFO:tasks.workunit.client.1.smithi089.stdout:4/993: chown d3/db/de/l122 133 1 2024-08-01T06:56:07.955 INFO:tasks.workunit.client.1.smithi089.stdout:0/916: truncate d9/d40/d95/d99/d2b/fb8 530091 0 2024-08-01T06:56:07.957 INFO:tasks.workunit.client.1.smithi089.stdout:5/948: rmdir d5/dac/d105/dbd/df0/d5d/d6c/d98 39 2024-08-01T06:56:07.957 INFO:tasks.workunit.client.1.smithi089.stdout:7/945: creat d7/df/d10/d31/d43/f13d x:0 0 0 2024-08-01T06:56:07.960 INFO:tasks.workunit.client.1.smithi089.stdout:3/844: link d7/d32/d12/df3/f109 d7/d32/f11b 0 2024-08-01T06:56:07.960 INFO:tasks.workunit.client.1.smithi089.stdout:4/994: write d3/d17/d3a/f66 [3910726,80588] 0 2024-08-01T06:56:07.961 INFO:tasks.workunit.client.1.smithi089.stdout:0/917: dread - d9/d40/d25/d46/d91/d2e/d44/d53/daf/ffa zero size 2024-08-01T06:56:07.962 INFO:tasks.workunit.client.1.smithi089.stdout:1/997: dwrite d0/f13 [0,4194304] 0 2024-08-01T06:56:07.965 INFO:tasks.workunit.client.1.smithi089.stdout:2/866: write d7/d19/d1e/f30 [3857972,113261] 0 2024-08-01T06:56:07.965 INFO:tasks.workunit.client.1.smithi089.stdout:3/845: chown d7/d32/d12/d1b/f4a 4410 1 2024-08-01T06:56:07.970 INFO:tasks.workunit.client.1.smithi089.stdout:4/995: symlink d3/d17/d3a/d4a/dee/l132 0 2024-08-01T06:56:07.970 INFO:tasks.workunit.client.0.smithi016.stdout:2/20: sync 2024-08-01T06:56:07.971 INFO:tasks.workunit.client.1.smithi089.stdout:5/949: getdents d5/dac/d105/dbd/df0/d5d/d6c/d8b/d118 0 2024-08-01T06:56:07.972 INFO:tasks.workunit.client.1.smithi089.stdout:2/867: unlink d7/d19/dc5/dcc/d64/fce 0 2024-08-01T06:56:07.973 INFO:tasks.workunit.client.1.smithi089.stdout:1/998: creat d0/d9/d15/d3b/d95/d49/d82/d124/d106/f148 x:0 0 0 2024-08-01T06:56:07.974 INFO:tasks.workunit.client.1.smithi089.stdout:7/946: dwrite d7/d46/d7b/d12c/dbb/de7/deb/df3/f129 [0,4194304] 0 2024-08-01T06:56:07.976 INFO:tasks.workunit.client.1.smithi089.stdout:0/918: write d9/d40/d25/d46/d91/d2e/d3a/f97 [175038,112205] 0 2024-08-01T06:56:07.978 INFO:tasks.workunit.client.0.smithi016.stdout:2/21: rmdir d0 39 2024-08-01T06:56:07.982 INFO:tasks.workunit.client.1.smithi089.stdout:2/868: chown d7/d1f/d52/d72/dc0/ce8 6983 1 2024-08-01T06:56:07.982 INFO:tasks.workunit.client.1.smithi089.stdout:4/996: dwrite d3/d17/d3a/d4a/d11e/db1/dbb/d62/f113 [0,4194304] 0 2024-08-01T06:56:07.983 INFO:tasks.workunit.client.0.smithi016.stdout:2/22: mknod d0/c6 0 2024-08-01T06:56:07.986 INFO:tasks.workunit.client.0.smithi016.stdout:2/23: dread - d0/f3 zero size 2024-08-01T06:56:07.990 INFO:tasks.workunit.client.1.smithi089.stdout:0/919: rename d9/d40/d25/d46/d91/c94 to d9/d40/d25/d46/d91/d2e/d44/d53/daf/d108/c120 0 2024-08-01T06:56:07.990 INFO:tasks.workunit.client.0.smithi016.stdout:2/24: mknod d0/c7 0 2024-08-01T06:56:07.992 INFO:tasks.workunit.client.0.smithi016.stdout:4/18: sync 2024-08-01T06:56:07.992 INFO:tasks.workunit.client.0.smithi016.stdout:9/26: sync 2024-08-01T06:56:07.992 INFO:tasks.workunit.client.0.smithi016.stdout:9/27: dread - no filename 2024-08-01T06:56:07.993 INFO:tasks.workunit.client.1.smithi089.stdout:0/920: chown d9/f77 7188860 1 2024-08-01T06:56:07.993 INFO:tasks.workunit.client.0.smithi016.stdout:9/28: readlink d3/l5 0 2024-08-01T06:56:07.993 INFO:tasks.workunit.client.0.smithi016.stdout:9/29: chown d3 22729490 1 2024-08-01T06:56:07.993 INFO:tasks.workunit.client.0.smithi016.stdout:9/30: chown d3 5319702 1 2024-08-01T06:56:07.993 INFO:tasks.workunit.client.0.smithi016.stdout:9/31: write - no filename 2024-08-01T06:56:07.994 INFO:tasks.workunit.client.1.smithi089.stdout:4/997: write d3/d17/d3a/d4a/d11e/db1/dbb/d62/d31/f89 [4200652,32434] 0 2024-08-01T06:56:07.994 INFO:tasks.workunit.client.1.smithi089.stdout:5/950: dread d5/fd3 [0,4194304] 0 2024-08-01T06:56:07.995 INFO:tasks.workunit.client.0.smithi016.stdout:4/19: symlink d0/d2/l7 0 2024-08-01T06:56:07.995 INFO:tasks.workunit.client.1.smithi089.stdout:3/846: dwrite d7/d32/d4c/d67/d72/d91/dcb/f87 [4194304,4194304] 0 2024-08-01T06:56:07.997 INFO:tasks.workunit.client.1.smithi089.stdout:7/947: write d7/fa [2608163,34803] 0 2024-08-01T06:56:07.997 INFO:tasks.workunit.client.0.smithi016.stdout:4/20: creat d0/f8 x:0 0 0 2024-08-01T06:56:08.000 INFO:tasks.workunit.client.0.smithi016.stdout:4/21: creat d0/f9 x:0 0 0 2024-08-01T06:56:08.000 INFO:tasks.workunit.client.1.smithi089.stdout:9/838: sync 2024-08-01T06:56:08.000 INFO:tasks.workunit.client.0.smithi016.stdout:9/32: link d3/l5 d3/l8 0 2024-08-01T06:56:08.001 INFO:tasks.workunit.client.0.smithi016.stdout:4/22: truncate d0/f9 607632 0 2024-08-01T06:56:08.002 INFO:tasks.workunit.client.1.smithi089.stdout:0/921: mknod d9/d40/d95/d99/dec/c121 0 2024-08-01T06:56:08.002 INFO:tasks.workunit.client.0.smithi016.stdout:9/33: mkdir d3/d9 0 2024-08-01T06:56:08.003 INFO:tasks.workunit.client.0.smithi016.stdout:4/23: dread d0/f9 [0,4194304] 0 2024-08-01T06:56:08.006 INFO:tasks.workunit.client.1.smithi089.stdout:7/948: readlink d7/d1f/d30/d4c/dbc/dcd/dd7/lfc 0 2024-08-01T06:56:08.006 INFO:tasks.workunit.client.0.smithi016.stdout:4/24: dread d0/f9 [0,4194304] 0 2024-08-01T06:56:08.006 INFO:tasks.workunit.client.0.smithi016.stdout:9/34: creat d3/d4/fa x:0 0 0 2024-08-01T06:56:08.008 INFO:tasks.workunit.client.1.smithi089.stdout:3/847: mkdir d7/d32/d4c/d67/d72/d91/dcb/d78/d11c 0 2024-08-01T06:56:08.008 INFO:tasks.workunit.client.1.smithi089.stdout:4/998: chown d3/d17/d3a/d4a/d11e/db1/dbb/d62/d3b/lfd 461875 1 2024-08-01T06:56:08.008 INFO:tasks.workunit.client.1.smithi089.stdout:2/869: dwrite f5 [0,4194304] 0 2024-08-01T06:56:08.009 INFO:tasks.workunit.client.0.smithi016.stdout:2/25: write d0/f3 [41467,124081] 0 2024-08-01T06:56:08.009 INFO:tasks.workunit.client.1.smithi089.stdout:1/999: dwrite d0/d9/d43/d4b/fdc [0,4194304] 0 2024-08-01T06:56:08.011 INFO:tasks.workunit.client.0.smithi016.stdout:9/35: getdents d3/d9 0 2024-08-01T06:56:08.011 INFO:tasks.workunit.client.1.smithi089.stdout:2/870: chown d7/d19/d1e/d5b 2 1 2024-08-01T06:56:08.011 INFO:tasks.workunit.client.0.smithi016.stdout:9/36: dread - d3/d4/fa zero size 2024-08-01T06:56:08.012 INFO:tasks.workunit.client.0.smithi016.stdout:9/37: dread - d3/d4/fa zero size 2024-08-01T06:56:08.013 INFO:tasks.workunit.client.1.smithi089.stdout:2/871: fdatasync d7/d19/d3b/d7c/ffb 0 2024-08-01T06:56:08.014 INFO:tasks.workunit.client.0.smithi016.stdout:9/38: fdatasync d3/d4/fa 0 2024-08-01T06:56:08.014 INFO:tasks.workunit.client.0.smithi016.stdout:4/25: link d0/f1 d0/d2/fa 0 2024-08-01T06:56:08.015 INFO:tasks.workunit.client.0.smithi016.stdout:9/39: truncate d3/d4/fa 948036 0 2024-08-01T06:56:08.015 INFO:tasks.workunit.client.0.smithi016.stdout:9/40: stat d3 0 2024-08-01T06:56:08.016 INFO:tasks.workunit.client.1.smithi089.stdout:9/839: mkdir d18/d33/d49/d7b/d115 0 2024-08-01T06:56:08.016 INFO:tasks.workunit.client.1.smithi089.stdout:0/922: dread d9/d40/d45/d47/da8/fcd [0,4194304] 0 2024-08-01T06:56:08.020 INFO:tasks.workunit.client.1.smithi089.stdout:7/949: creat d7/df/d91/f13e x:0 0 0 2024-08-01T06:56:08.020 INFO:tasks.workunit.client.1.smithi089.stdout:0/923: chown d9/d40/d25/fe3 0 1 2024-08-01T06:56:08.021 INFO:tasks.workunit.client.0.smithi016.stdout:9/41: dwrite d3/d4/fa [0,4194304] 0 2024-08-01T06:56:08.022 INFO:tasks.workunit.client.1.smithi089.stdout:3/848: dread d7/d32/d9f/ff4 [0,4194304] 0 2024-08-01T06:56:08.022 INFO:tasks.workunit.client.1.smithi089.stdout:5/951: dread d5/f73 [4194304,4194304] 0 2024-08-01T06:56:08.022 INFO:tasks.workunit.client.1.smithi089.stdout:9/840: creat d18/d33/d6e/dd1/f116 x:0 0 0 2024-08-01T06:56:08.024 INFO:tasks.workunit.client.1.smithi089.stdout:4/999: getdents d3/d109 0 2024-08-01T06:56:08.025 INFO:tasks.workunit.client.1.smithi089.stdout:7/950: mknod d7/d46/d7b/c13f 0 2024-08-01T06:56:08.025 INFO:tasks.workunit.client.0.smithi016.stdout:9/42: mkdir d3/d9/db 0 2024-08-01T06:56:08.026 INFO:tasks.workunit.client.1.smithi089.stdout:3/849: mkdir d7/d32/d4c/d67/d11d 0 2024-08-01T06:56:08.027 INFO:tasks.workunit.client.1.smithi089.stdout:0/924: unlink d9/d40/d25/d46/cb2 0 2024-08-01T06:56:08.030 INFO:tasks.workunit.client.1.smithi089.stdout:5/952: creat d5/de/d10/d33/d5e/f12f x:0 0 0 2024-08-01T06:56:08.031 INFO:tasks.workunit.client.0.smithi016.stdout:9/43: mkdir d3/d9/db/dc 0 2024-08-01T06:56:08.032 INFO:tasks.workunit.client.1.smithi089.stdout:7/951: creat d7/d46/f140 x:0 0 0 2024-08-01T06:56:08.033 INFO:tasks.workunit.client.1.smithi089.stdout:7/952: readlink d7/d1f/d30/ld4 0 2024-08-01T06:56:08.035 INFO:tasks.workunit.client.0.smithi016.stdout:9/44: dread d3/d4/fa [0,4194304] 0 2024-08-01T06:56:08.035 INFO:tasks.workunit.client.1.smithi089.stdout:0/925: mknod d9/d40/d45/d47/d9d/c122 0 2024-08-01T06:56:08.036 INFO:tasks.workunit.client.1.smithi089.stdout:0/926: chown d9/d40/d25/d46/d91/d2e 363701 1 2024-08-01T06:56:08.037 INFO:tasks.workunit.client.1.smithi089.stdout:7/953: chown d7/df/d3b/ca3 96209 1 2024-08-01T06:56:08.041 INFO:tasks.workunit.client.1.smithi089.stdout:9/841: dread d18/fc1 [0,4194304] 0 2024-08-01T06:56:08.043 INFO:tasks.workunit.client.1.smithi089.stdout:7/954: creat d7/df/d10/d42/d4e/d11d/f141 x:0 0 0 2024-08-01T06:56:08.046 INFO:tasks.workunit.client.1.smithi089.stdout:3/850: rename d7/d32/d4c/d69/c45 to d7/d32/d4c/d67/d72/d91/dcb/c11e 0 2024-08-01T06:56:08.047 INFO:tasks.workunit.client.1.smithi089.stdout:3/851: write d7/d32/d4c/d69/f2e [263780,73745] 0 2024-08-01T06:56:08.048 INFO:tasks.workunit.client.1.smithi089.stdout:0/927: mkdir d9/d40/d25/d46/d91/d2e/d3a/d76/d123 0 2024-08-01T06:56:08.048 INFO:tasks.workunit.client.0.smithi016.stdout:9/45: dwrite d3/d4/fa [0,4194304] 0 2024-08-01T06:56:08.050 INFO:tasks.workunit.client.1.smithi089.stdout:7/955: unlink d7/df/d10/d31/c63 0 2024-08-01T06:56:08.051 INFO:tasks.workunit.client.0.smithi016.stdout:3/34: sync 2024-08-01T06:56:08.051 INFO:tasks.workunit.client.0.smithi016.stdout:5/27: sync 2024-08-01T06:56:08.051 INFO:tasks.workunit.client.0.smithi016.stdout:8/38: sync 2024-08-01T06:56:08.051 INFO:tasks.workunit.client.0.smithi016.stdout:8/39: dread - no filename 2024-08-01T06:56:08.051 INFO:tasks.workunit.client.0.smithi016.stdout:7/29: sync 2024-08-01T06:56:08.051 INFO:tasks.workunit.client.0.smithi016.stdout:0/51: sync 2024-08-01T06:56:08.051 INFO:tasks.workunit.client.0.smithi016.stdout:6/89: sync 2024-08-01T06:56:08.051 INFO:tasks.workunit.client.0.smithi016.stdout:1/63: sync 2024-08-01T06:56:08.052 INFO:tasks.workunit.client.0.smithi016.stdout:1/64: chown d2 60 1 2024-08-01T06:56:08.053 INFO:tasks.workunit.client.0.smithi016.stdout:3/35: chown d9/fd 0 1 2024-08-01T06:56:08.053 INFO:tasks.workunit.client.0.smithi016.stdout:1/65: chown d2/d3 6 1 2024-08-01T06:56:08.053 INFO:tasks.workunit.client.0.smithi016.stdout:9/46: mknod d3/d9/db/cd 0 2024-08-01T06:56:08.054 INFO:tasks.workunit.client.0.smithi016.stdout:1/66: readlink d2/d3/l13 0 2024-08-01T06:56:08.055 INFO:tasks.workunit.client.1.smithi089.stdout:9/842: mkdir d18/d33/d49/d7b/d7f/d98/d9f/df1/d117 0 2024-08-01T06:56:08.057 INFO:tasks.workunit.client.1.smithi089.stdout:9/843: truncate d18/d22/d52/fea 1092005 0 2024-08-01T06:56:08.058 INFO:tasks.workunit.client.0.smithi016.stdout:5/28: creat d1/fb x:0 0 0 2024-08-01T06:56:08.058 INFO:tasks.workunit.client.0.smithi016.stdout:2/26: write d0/f5 [459090,4359] 0 2024-08-01T06:56:08.059 INFO:tasks.workunit.client.1.smithi089.stdout:3/852: unlink d7/d68/d50/d6f/d2f/d9c/fd7 0 2024-08-01T06:56:08.062 INFO:tasks.workunit.client.0.smithi016.stdout:7/30: symlink d7/ld 0 2024-08-01T06:56:08.062 INFO:tasks.workunit.client.0.smithi016.stdout:9/47: dwrite d3/d4/fa [0,4194304] 0 2024-08-01T06:56:08.064 INFO:tasks.workunit.client.1.smithi089.stdout:3/853: dwrite d7/d32/d4c/d53/dea/f100 [0,4194304] 0 2024-08-01T06:56:08.065 INFO:tasks.workunit.client.0.smithi016.stdout:0/52: creat d10/d11/f14 x:0 0 0 2024-08-01T06:56:08.069 INFO:tasks.workunit.client.1.smithi089.stdout:2/872: truncate d7/d1f/d52/d6e/f102 2514494 0 2024-08-01T06:56:08.073 INFO:tasks.workunit.client.0.smithi016.stdout:4/26: dwrite d0/f6 [0,4194304] 0 2024-08-01T06:56:08.073 INFO:tasks.workunit.client.0.smithi016.stdout:6/90: creat d1/d8/d1b/f25 x:0 0 0 2024-08-01T06:56:08.075 INFO:tasks.workunit.client.1.smithi089.stdout:0/928: symlink d9/d40/d119/l124 0 2024-08-01T06:56:08.079 INFO:tasks.workunit.client.0.smithi016.stdout:1/67: mknod d2/d3/c16 0 2024-08-01T06:56:08.080 INFO:tasks.workunit.client.1.smithi089.stdout:3/854: mknod d7/d32/d12/d29/d39/d4b/deb/c11f 0 2024-08-01T06:56:08.082 INFO:tasks.workunit.client.1.smithi089.stdout:3/855: write d7/d32/d12/d29/d39/d4b/dd2/dd5/ff2 [127920,19256] 0 2024-08-01T06:56:08.083 INFO:tasks.workunit.client.0.smithi016.stdout:5/29: creat d1/fc x:0 0 0 2024-08-01T06:56:08.083 INFO:tasks.workunit.client.1.smithi089.stdout:3/856: fdatasync d7/d32/d4c/d67/db4/ddc/f11a 0 2024-08-01T06:56:08.084 INFO:tasks.workunit.client.0.smithi016.stdout:1/68: dread d2/d3/f5 [0,4194304] 0 2024-08-01T06:56:08.085 INFO:tasks.workunit.client.1.smithi089.stdout:5/953: write d5/de/d10/d16/d9d/fa4 [159756,116064] 0 2024-08-01T06:56:08.085 INFO:tasks.workunit.client.1.smithi089.stdout:3/857: write d7/d32/d4c/d69/d6d/dc7/fe2 [1275822,19736] 0 2024-08-01T06:56:08.085 INFO:tasks.workunit.client.0.smithi016.stdout:2/27: fdatasync d0/f2 0 2024-08-01T06:56:08.086 INFO:tasks.workunit.client.0.smithi016.stdout:2/28: readlink d0/l1 0 2024-08-01T06:56:08.087 INFO:tasks.workunit.client.1.smithi089.stdout:3/858: truncate d7/d32/f4e 4834949 0 2024-08-01T06:56:08.087 INFO:tasks.workunit.client.1.smithi089.stdout:2/873: chown d7/cbf 43 1 2024-08-01T06:56:08.088 INFO:tasks.workunit.client.1.smithi089.stdout:3/859: write d7/d32/d12/d1b/f51 [5205547,103992] 0 2024-08-01T06:56:08.089 INFO:tasks.workunit.client.0.smithi016.stdout:9/48: mkdir d3/de 0 2024-08-01T06:56:08.093 INFO:tasks.workunit.client.0.smithi016.stdout:0/53: truncate ff 456885 0 2024-08-01T06:56:08.093 INFO:tasks.workunit.client.1.smithi089.stdout:2/874: dwrite d7/d1f/f4b [0,4194304] 0 2024-08-01T06:56:08.095 INFO:tasks.workunit.client.0.smithi016.stdout:2/29: dwrite d0/f3 [0,4194304] 0 2024-08-01T06:56:08.097 INFO:tasks.workunit.client.1.smithi089.stdout:0/929: creat d9/d40/d25/d46/d91/d2e/d44/d53/deb/f125 x:0 0 0 2024-08-01T06:56:08.099 INFO:tasks.workunit.client.1.smithi089.stdout:9/844: getdents d18/d33/d49 0 2024-08-01T06:56:08.100 INFO:tasks.workunit.client.0.smithi016.stdout:3/36: write f3 [4024857,61722] 0 2024-08-01T06:56:08.101 INFO:tasks.workunit.client.1.smithi089.stdout:2/875: readlink d7/d1f/l56 0 2024-08-01T06:56:08.106 INFO:tasks.workunit.client.1.smithi089.stdout:0/930: creat d9/d40/d45/d47/f126 x:0 0 0 2024-08-01T06:56:08.108 INFO:tasks.workunit.client.1.smithi089.stdout:3/860: mknod d7/d32/c120 0 2024-08-01T06:56:08.108 INFO:tasks.workunit.client.1.smithi089.stdout:9/845: dwrite d18/d33/d49/d7b/d7f/d98/d9f/d8e/fa7 [0,4194304] 0 2024-08-01T06:56:08.109 INFO:tasks.workunit.client.1.smithi089.stdout:9/846: readlink d18/d33/df7/da6/lb3 0 2024-08-01T06:56:08.110 INFO:tasks.workunit.client.0.smithi016.stdout:7/31: getdents d7/db 0 2024-08-01T06:56:08.113 INFO:tasks.workunit.client.1.smithi089.stdout:0/931: creat d9/d40/d25/d46/d91/d2e/d44/d53/f127 x:0 0 0 2024-08-01T06:56:08.113 INFO:tasks.workunit.client.0.smithi016.stdout:9/49: mkdir d3/d9/df 0 2024-08-01T06:56:08.114 INFO:tasks.workunit.client.1.smithi089.stdout:0/932: fdatasync d9/dee/ff7 0 2024-08-01T06:56:08.115 INFO:tasks.workunit.client.1.smithi089.stdout:0/933: chown d9/d40/d95/d99/dec/c121 216 1 2024-08-01T06:56:08.117 INFO:tasks.workunit.client.1.smithi089.stdout:5/954: getdents d5/dac/d105/dbd/df0/d5d/d6c/d98 0 2024-08-01T06:56:08.117 INFO:tasks.workunit.client.0.smithi016.stdout:3/37: mkdir d9/da/df 0 2024-08-01T06:56:08.118 INFO:tasks.workunit.client.1.smithi089.stdout:0/934: fdatasync d9/d40/d95/d99/f73 0 2024-08-01T06:56:08.118 INFO:tasks.workunit.client.1.smithi089.stdout:5/955: write d5/de/d10/d16/d1b/d25/fa7 [196062,42377] 0 2024-08-01T06:56:08.119 INFO:tasks.workunit.client.1.smithi089.stdout:0/935: chown d9/d40/d95/d99/dba/ffb 9 1 2024-08-01T06:56:08.119 INFO:tasks.workunit.client.0.smithi016.stdout:7/32: read f6 [1152729,73548] 0 2024-08-01T06:56:08.120 INFO:tasks.workunit.client.0.smithi016.stdout:8/40: getdents d5 0 2024-08-01T06:56:08.120 INFO:tasks.workunit.client.0.smithi016.stdout:8/41: write - no filename 2024-08-01T06:56:08.120 INFO:tasks.workunit.client.0.smithi016.stdout:8/42: write - no filename 2024-08-01T06:56:08.121 INFO:tasks.workunit.client.0.smithi016.stdout:9/50: dwrite d3/d4/fa [0,4194304] 0 2024-08-01T06:56:08.122 INFO:tasks.workunit.client.1.smithi089.stdout:5/956: symlink d5/de/l130 0 2024-08-01T06:56:08.123 INFO:tasks.workunit.client.0.smithi016.stdout:9/51: write d3/d4/fa [954153,12695] 0 2024-08-01T06:56:08.124 INFO:tasks.workunit.client.0.smithi016.stdout:3/38: mkdir d9/d10 0 2024-08-01T06:56:08.127 INFO:tasks.workunit.client.1.smithi089.stdout:5/957: creat d5/d13/d43/dc5/d100/f131 x:0 0 0 2024-08-01T06:56:08.127 INFO:tasks.workunit.client.0.smithi016.stdout:8/43: symlink d5/l7 0 2024-08-01T06:56:08.128 INFO:tasks.workunit.client.0.smithi016.stdout:8/44: chown d5 293 1 2024-08-01T06:56:08.128 INFO:tasks.workunit.client.0.smithi016.stdout:8/45: write - no filename 2024-08-01T06:56:08.128 INFO:tasks.workunit.client.0.smithi016.stdout:8/46: write - no filename 2024-08-01T06:56:08.129 INFO:tasks.workunit.client.0.smithi016.stdout:4/27: getdents d0/d2 0 2024-08-01T06:56:08.130 INFO:tasks.workunit.client.0.smithi016.stdout:6/91: getdents d1/d8 0 2024-08-01T06:56:08.130 INFO:tasks.workunit.client.0.smithi016.stdout:2/30: fsync d0/f3 0 2024-08-01T06:56:08.131 INFO:tasks.workunit.client.1.smithi089.stdout:5/958: chown d5/dac/d105/dbd/df0/d5d/l11f 3527 1 2024-08-01T06:56:08.131 INFO:tasks.workunit.client.0.smithi016.stdout:5/30: write d1/d2/f4 [1830169,101490] 0 2024-08-01T06:56:08.132 INFO:tasks.workunit.client.0.smithi016.stdout:2/31: write d0/f3 [3102696,50558] 0 2024-08-01T06:56:08.133 INFO:tasks.workunit.client.1.smithi089.stdout:5/959: write d5/dac/d105/dbd/df0/d5d/d6c/d98/d12c/f12e [213847,77647] 0 2024-08-01T06:56:08.134 INFO:tasks.workunit.client.0.smithi016.stdout:8/47: mkdir d5/d8 0 2024-08-01T06:56:08.134 INFO:tasks.workunit.client.0.smithi016.stdout:8/48: truncate - no filename 2024-08-01T06:56:08.134 INFO:tasks.workunit.client.1.smithi089.stdout:5/960: chown d5/de/f110 15733 1 2024-08-01T06:56:08.135 INFO:tasks.workunit.client.0.smithi016.stdout:4/28: rename d0/f6 to d0/fb 0 2024-08-01T06:56:08.137 INFO:tasks.workunit.client.0.smithi016.stdout:6/92: rmdir d1/d8/d1b 39 2024-08-01T06:56:08.138 INFO:tasks.workunit.client.0.smithi016.stdout:3/39: getdents d9/da/df 0 2024-08-01T06:56:08.141 INFO:tasks.workunit.client.0.smithi016.stdout:9/52: rename d3/l5 to d3/d9/l10 0 2024-08-01T06:56:08.141 INFO:tasks.workunit.client.0.smithi016.stdout:1/69: dwrite d2/d3/fa [0,4194304] 0 2024-08-01T06:56:08.143 INFO:tasks.workunit.client.0.smithi016.stdout:5/31: unlink d1/d2/f4 0 2024-08-01T06:56:08.144 INFO:tasks.workunit.client.0.smithi016.stdout:5/32: fsync d1/fc 0 2024-08-01T06:56:08.145 INFO:tasks.workunit.client.1.smithi089.stdout:6/952: sync 2024-08-01T06:56:08.146 INFO:tasks.workunit.client.1.smithi089.stdout:9/847: dread d18/d22/f9d [0,4194304] 0 2024-08-01T06:56:08.146 INFO:tasks.workunit.client.0.smithi016.stdout:2/32: mkdir d0/d8 0 2024-08-01T06:56:08.149 INFO:tasks.workunit.client.1.smithi089.stdout:6/953: readlink d2/d30/l59 0 2024-08-01T06:56:08.150 INFO:tasks.workunit.client.0.smithi016.stdout:4/29: mkdir d0/d2/dc 0 2024-08-01T06:56:08.150 INFO:tasks.workunit.client.1.smithi089.stdout:6/954: write d2/d2e/d98/ff0 [1589777,32046] 0 2024-08-01T06:56:08.152 INFO:tasks.workunit.client.0.smithi016.stdout:6/93: fdatasync d1/d8/d1b/f25 0 2024-08-01T06:56:08.153 INFO:tasks.workunit.client.0.smithi016.stdout:0/54: write ff [128685,80584] 0 2024-08-01T06:56:08.153 INFO:tasks.workunit.client.0.smithi016.stdout:3/40: dread - d9/da/fb zero size 2024-08-01T06:56:08.154 INFO:tasks.workunit.client.0.smithi016.stdout:6/94: dread d1/d8/f1a [0,4194304] 0 2024-08-01T06:56:08.155 INFO:tasks.workunit.client.0.smithi016.stdout:7/33: write f6 [4973458,15763] 0 2024-08-01T06:56:08.156 INFO:tasks.workunit.client.1.smithi089.stdout:6/955: mknod d2/d2e/c135 0 2024-08-01T06:56:08.157 INFO:tasks.workunit.client.0.smithi016.stdout:9/53: creat d3/d4/f11 x:0 0 0 2024-08-01T06:56:08.159 INFO:tasks.workunit.client.0.smithi016.stdout:9/54: write d3/d4/fa [3114983,35174] 0 2024-08-01T06:56:08.159 INFO:tasks.workunit.client.1.smithi089.stdout:6/956: readlink d2/d11/d1f/d46/d6b/d7d/dff/l124 0 2024-08-01T06:56:08.160 INFO:tasks.workunit.client.1.smithi089.stdout:6/957: write d2/d11/d1f/d46/dce/f119 [1362300,1724] 0 2024-08-01T06:56:08.161 INFO:tasks.workunit.client.0.smithi016.stdout:5/33: fsync d1/f5 0 2024-08-01T06:56:08.161 INFO:tasks.workunit.client.0.smithi016.stdout:5/34: chown d1/fb 727828386 1 2024-08-01T06:56:08.162 INFO:tasks.workunit.client.0.smithi016.stdout:5/35: read - d1/fb zero size 2024-08-01T06:56:08.166 INFO:tasks.workunit.client.1.smithi089.stdout:6/958: creat d2/d11/d1f/dbd/dc5/f136 x:0 0 0 2024-08-01T06:56:08.166 INFO:tasks.workunit.client.1.smithi089.stdout:5/961: write d5/de/d10/d16/d1b/d25/f74 [867406,108660] 0 2024-08-01T06:56:08.168 INFO:tasks.workunit.client.0.smithi016.stdout:4/30: write d0/fb [3638681,129171] 0 2024-08-01T06:56:08.173 INFO:tasks.workunit.client.0.smithi016.stdout:0/55: dread f6 [0,4194304] 0 2024-08-01T06:56:08.173 INFO:tasks.workunit.client.0.smithi016.stdout:0/56: stat d10/d11/f13 0 2024-08-01T06:56:08.173 INFO:tasks.workunit.client.0.smithi016.stdout:6/95: dread d1/f4 [0,4194304] 0 2024-08-01T06:56:08.174 INFO:tasks.workunit.client.0.smithi016.stdout:9/55: symlink d3/d9/db/l12 0 2024-08-01T06:56:08.174 INFO:tasks.workunit.client.0.smithi016.stdout:6/96: readlink d1/l1e 0 2024-08-01T06:56:08.175 INFO:tasks.workunit.client.0.smithi016.stdout:9/56: fsync d3/d4/fa 0 2024-08-01T06:56:08.175 INFO:tasks.workunit.client.0.smithi016.stdout:2/33: mknod d0/d8/c9 0 2024-08-01T06:56:08.177 INFO:tasks.workunit.client.0.smithi016.stdout:2/34: dread - d0/f2 zero size 2024-08-01T06:56:08.177 INFO:tasks.workunit.client.0.smithi016.stdout:5/36: creat d1/d2/d6/fd x:0 0 0 2024-08-01T06:56:08.178 INFO:tasks.workunit.client.0.smithi016.stdout:8/49: link d5/l7 d5/d8/l9 0 2024-08-01T06:56:08.178 INFO:tasks.workunit.client.0.smithi016.stdout:8/50: write - no filename 2024-08-01T06:56:08.179 INFO:tasks.workunit.client.0.smithi016.stdout:9/57: truncate d3/d4/f11 235713 0 2024-08-01T06:56:08.180 INFO:tasks.workunit.client.0.smithi016.stdout:7/34: write f4 [1355260,107851] 0 2024-08-01T06:56:08.181 INFO:tasks.workunit.client.0.smithi016.stdout:8/51: rename d5 to d5/d8/da 22 2024-08-01T06:56:08.181 INFO:tasks.workunit.client.0.smithi016.stdout:0/57: creat d10/d11/f15 x:0 0 0 2024-08-01T06:56:08.184 INFO:tasks.workunit.client.0.smithi016.stdout:1/70: dwrite d2/de/f14 [0,4194304] 0 2024-08-01T06:56:08.186 INFO:tasks.workunit.client.0.smithi016.stdout:9/58: truncate d3/d4/f11 583710 0 2024-08-01T06:56:08.186 INFO:tasks.workunit.client.0.smithi016.stdout:0/58: creat d10/f16 x:0 0 0 2024-08-01T06:56:08.186 INFO:tasks.workunit.client.0.smithi016.stdout:0/59: readlink - no filename 2024-08-01T06:56:08.187 INFO:tasks.workunit.client.0.smithi016.stdout:8/52: rename l4 to d5/lb 0 2024-08-01T06:56:08.188 INFO:tasks.workunit.client.0.smithi016.stdout:8/53: stat d5 0 2024-08-01T06:56:08.188 INFO:tasks.workunit.client.0.smithi016.stdout:0/60: write d10/d11/f14 [282093,106983] 0 2024-08-01T06:56:08.189 INFO:tasks.workunit.client.0.smithi016.stdout:1/71: rmdir d2/d3 39 2024-08-01T06:56:08.192 INFO:tasks.workunit.client.0.smithi016.stdout:4/31: dread d0/f1 [0,4194304] 0 2024-08-01T06:56:08.193 INFO:tasks.workunit.client.0.smithi016.stdout:5/37: fsync d1/d2/d6/fd 0 2024-08-01T06:56:08.193 INFO:tasks.workunit.client.0.smithi016.stdout:7/35: dread f5 [0,4194304] 0 2024-08-01T06:56:08.195 INFO:tasks.workunit.client.0.smithi016.stdout:2/35: getdents d0/d8 0 2024-08-01T06:56:08.196 INFO:tasks.workunit.client.0.smithi016.stdout:2/36: stat d0 0 2024-08-01T06:56:08.196 INFO:tasks.workunit.client.0.smithi016.stdout:4/32: fdatasync d0/d2/f4 0 2024-08-01T06:56:08.197 INFO:tasks.workunit.client.0.smithi016.stdout:6/97: write d1/f5 [684039,104231] 0 2024-08-01T06:56:08.198 INFO:tasks.workunit.client.0.smithi016.stdout:0/61: dread ff [0,4194304] 0 2024-08-01T06:56:08.201 INFO:tasks.workunit.client.0.smithi016.stdout:5/38: mknod d1/ce 0 2024-08-01T06:56:08.202 INFO:tasks.workunit.client.0.smithi016.stdout:1/72: write d2/fc [2832700,124203] 0 2024-08-01T06:56:08.203 INFO:tasks.workunit.client.0.smithi016.stdout:0/62: dread - d10/f16 zero size 2024-08-01T06:56:08.203 INFO:tasks.workunit.client.0.smithi016.stdout:2/37: mknod d0/d8/ca 0 2024-08-01T06:56:08.204 INFO:tasks.workunit.client.0.smithi016.stdout:9/59: dwrite d3/d4/f11 [0,4194304] 0 2024-08-01T06:56:08.205 INFO:tasks.workunit.client.1.smithi089.stdout:9/848: dread d18/d33/d49/f6c [0,4194304] 0 2024-08-01T06:56:08.206 INFO:tasks.workunit.client.1.smithi089.stdout:9/849: write d18/d22/fce [645645,105871] 0 2024-08-01T06:56:08.207 INFO:tasks.workunit.client.1.smithi089.stdout:5/962: mknod d5/dac/d105/dbd/df0/d5d/d6c/c132 0 2024-08-01T06:56:08.210 INFO:tasks.workunit.client.1.smithi089.stdout:9/850: chown d18/d22/d45/c67 12961057 1 2024-08-01T06:56:08.211 INFO:tasks.workunit.client.0.smithi016.stdout:7/36: dwrite f4 [0,4194304] 0 2024-08-01T06:56:08.211 INFO:tasks.workunit.client.1.smithi089.stdout:9/851: chown d18/d22/d45/ce3 997 1 2024-08-01T06:56:08.212 INFO:tasks.workunit.client.1.smithi089.stdout:9/852: write f5 [8326274,123087] 0 2024-08-01T06:56:08.213 INFO:tasks.workunit.client.1.smithi089.stdout:5/963: creat d5/dac/d105/d103/d115/f133 x:0 0 0 2024-08-01T06:56:08.213 INFO:tasks.workunit.client.1.smithi089.stdout:9/853: chown d18/d22/d39/l71 130344 1 2024-08-01T06:56:08.214 INFO:tasks.workunit.client.1.smithi089.stdout:5/964: write d5/dac/d105/dbd/fbf [791396,23001] 0 2024-08-01T06:56:08.215 INFO:tasks.workunit.client.0.smithi016.stdout:1/73: rmdir d2/d3 39 2024-08-01T06:56:08.215 INFO:tasks.workunit.client.0.smithi016.stdout:7/37: rename d7/d8 to d7/d8/da/de 22 2024-08-01T06:56:08.216 INFO:tasks.workunit.client.1.smithi089.stdout:9/854: chown d18/d33/d49/d7b/d81/d9c/la0 29 1 2024-08-01T06:56:08.219 INFO:tasks.workunit.client.0.smithi016.stdout:2/38: dread d0/f5 [0,4194304] 0 2024-08-01T06:56:08.219 INFO:tasks.workunit.client.0.smithi016.stdout:6/98: dread d1/d8/fa [0,4194304] 0 2024-08-01T06:56:08.220 INFO:tasks.workunit.client.1.smithi089.stdout:9/855: mknod d18/d33/df7/c118 0 2024-08-01T06:56:08.221 INFO:tasks.workunit.client.0.smithi016.stdout:0/63: link fd d10/f17 0 2024-08-01T06:56:08.222 INFO:tasks.workunit.client.0.smithi016.stdout:2/39: readlink d0/l1 0 2024-08-01T06:56:08.223 INFO:tasks.workunit.client.0.smithi016.stdout:4/33: dwrite d0/f9 [0,4194304] 0 2024-08-01T06:56:08.223 INFO:tasks.workunit.client.0.smithi016.stdout:1/74: readlink d2/d3/l13 0 2024-08-01T06:56:08.224 INFO:tasks.workunit.client.0.smithi016.stdout:7/38: rename f4 to d7/ff 0 2024-08-01T06:56:08.224 INFO:tasks.workunit.client.1.smithi089.stdout:5/965: dwrite d5/de/d57/d8e/d97/da5/dde/de9/fb2 [4194304,4194304] 0 2024-08-01T06:56:08.225 INFO:tasks.workunit.client.0.smithi016.stdout:9/60: dread d3/d4/fa [0,4194304] 0 2024-08-01T06:56:08.226 INFO:tasks.workunit.client.0.smithi016.stdout:4/34: chown d0/d2/fa 66417442 1 2024-08-01T06:56:08.226 INFO:tasks.workunit.client.1.smithi089.stdout:9/856: mknod d18/d22/d45/daa/c119 0 2024-08-01T06:56:08.229 INFO:tasks.workunit.client.0.smithi016.stdout:1/75: chown d2/d3/c7 1971 1 2024-08-01T06:56:08.229 INFO:tasks.workunit.client.0.smithi016.stdout:4/35: truncate d0/f8 902586 0 2024-08-01T06:56:08.232 INFO:tasks.workunit.client.0.smithi016.stdout:2/40: rename d0/f2 to d0/fb 0 2024-08-01T06:56:08.232 INFO:tasks.workunit.client.1.smithi089.stdout:6/959: dread d2/d2e/d2f/f6d [4194304,4194304] 0 2024-08-01T06:56:08.234 INFO:tasks.workunit.client.0.smithi016.stdout:2/41: truncate d0/f3 4536342 0 2024-08-01T06:56:08.235 INFO:tasks.workunit.client.0.smithi016.stdout:7/39: dread d7/ff [0,4194304] 0 2024-08-01T06:56:08.237 INFO:tasks.workunit.client.1.smithi089.stdout:9/857: mknod d18/da4/c11a 0 2024-08-01T06:56:08.237 INFO:tasks.workunit.client.0.smithi016.stdout:4/36: dread d0/d2/fa [0,4194304] 0 2024-08-01T06:56:08.238 INFO:tasks.workunit.client.1.smithi089.stdout:7/956: sync 2024-08-01T06:56:08.240 INFO:tasks.workunit.client.1.smithi089.stdout:5/966: link d5/d13/d43/dc5/d100/f129 d5/d13/d83/f134 0 2024-08-01T06:56:08.241 INFO:tasks.workunit.client.0.smithi016.stdout:0/64: rmdir d10 39 2024-08-01T06:56:08.241 INFO:tasks.workunit.client.0.smithi016.stdout:4/37: read d0/f9 [4109545,112035] 0 2024-08-01T06:56:08.244 INFO:tasks.workunit.client.0.smithi016.stdout:7/40: fsync d7/ff 0 2024-08-01T06:56:08.246 INFO:tasks.workunit.client.0.smithi016.stdout:2/42: dwrite d0/f3 [4194304,4194304] 0 2024-08-01T06:56:08.247 INFO:tasks.workunit.client.0.smithi016.stdout:2/43: stat d0/c4 0 2024-08-01T06:56:08.248 INFO:tasks.workunit.client.0.smithi016.stdout:9/61: truncate d3/d4/fa 3184679 0 2024-08-01T06:56:08.248 INFO:tasks.workunit.client.0.smithi016.stdout:9/62: stat d3/d9/db/l12 0 2024-08-01T06:56:08.249 INFO:tasks.workunit.client.1.smithi089.stdout:6/960: creat d2/d11/d1f/d46/dce/d10f/f137 x:0 0 0 2024-08-01T06:56:08.249 INFO:tasks.workunit.client.1.smithi089.stdout:6/961: fdatasync d2/fd6 0 2024-08-01T06:56:08.249 INFO:tasks.workunit.client.0.smithi016.stdout:9/63: write d3/d4/f11 [1441603,9184] 0 2024-08-01T06:56:08.251 INFO:tasks.workunit.client.1.smithi089.stdout:7/957: dwrite d7/d1f/f84 [0,4194304] 0 2024-08-01T06:56:08.251 INFO:tasks.workunit.client.1.smithi089.stdout:6/962: fsync d2/d11/d1a/d1c/dea/d11f/f12c 0 2024-08-01T06:56:08.251 INFO:tasks.workunit.client.1.smithi089.stdout:9/858: creat d18/d33/d49/d7b/d7f/d98/dcd/f11b x:0 0 0 2024-08-01T06:56:08.253 INFO:tasks.workunit.client.1.smithi089.stdout:7/958: stat d7/df/d10/d42/f131 0 2024-08-01T06:56:08.254 INFO:tasks.workunit.client.1.smithi089.stdout:7/959: stat d7/d1f/d3a/dad 0 2024-08-01T06:56:08.254 INFO:tasks.workunit.client.0.smithi016.stdout:0/65: write ff [1332740,36147] 0 2024-08-01T06:56:08.256 INFO:tasks.workunit.client.0.smithi016.stdout:1/76: creat d2/f17 x:0 0 0 2024-08-01T06:56:08.258 INFO:tasks.workunit.client.1.smithi089.stdout:6/963: creat d2/d11/d1f/d46/d6b/f138 x:0 0 0 2024-08-01T06:56:08.262 INFO:tasks.workunit.client.1.smithi089.stdout:5/967: creat d5/dac/d105/dbd/df0/d5d/d6c/d8b/f135 x:0 0 0 2024-08-01T06:56:08.262 INFO:tasks.workunit.client.0.smithi016.stdout:7/41: creat d7/d8/da/f10 x:0 0 0 2024-08-01T06:56:08.262 INFO:tasks.workunit.client.0.smithi016.stdout:2/44: dread - d0/fb zero size 2024-08-01T06:56:08.265 INFO:tasks.workunit.client.1.smithi089.stdout:7/960: rename d7/df/d91/da4/dca/cfd to d7/d1f/d30/dab/c142 0 2024-08-01T06:56:08.265 INFO:tasks.workunit.client.0.smithi016.stdout:9/64: readlink d3/l8 0 2024-08-01T06:56:08.265 INFO:tasks.workunit.client.1.smithi089.stdout:5/968: mknod d5/dac/d10f/c136 0 2024-08-01T06:56:08.267 INFO:tasks.workunit.client.1.smithi089.stdout:7/961: write d7/d46/d7b/d12c/dbb/f132 [331207,41556] 0 2024-08-01T06:56:08.267 INFO:tasks.workunit.client.1.smithi089.stdout:6/964: dwrite d2/d30/fe7 [0,4194304] 0 2024-08-01T06:56:08.267 INFO:tasks.workunit.client.0.smithi016.stdout:4/38: truncate d0/d2/f4 1212146 0 2024-08-01T06:56:08.269 INFO:tasks.workunit.client.0.smithi016.stdout:7/42: fdatasync f5 0 2024-08-01T06:56:08.269 INFO:tasks.workunit.client.0.smithi016.stdout:4/39: chown d0/d2/f4 2614 1 2024-08-01T06:56:08.270 INFO:tasks.workunit.client.1.smithi089.stdout:7/962: dread - d7/df/d10/d42/d4e/d11d/f141 zero size 2024-08-01T06:56:08.270 INFO:tasks.workunit.client.1.smithi089.stdout:5/969: mkdir d5/de/d10/d33/d137 0 2024-08-01T06:56:08.270 INFO:tasks.workunit.client.0.smithi016.stdout:1/77: dread d2/d3/f9 [0,4194304] 0 2024-08-01T06:56:08.271 INFO:tasks.workunit.client.0.smithi016.stdout:2/45: mknod d0/cc 0 2024-08-01T06:56:08.272 INFO:tasks.workunit.client.0.smithi016.stdout:1/78: readlink d2/d3/l13 0 2024-08-01T06:56:08.272 INFO:tasks.workunit.client.1.smithi089.stdout:7/963: dread d7/d15/f73 [0,4194304] 0 2024-08-01T06:56:08.273 INFO:tasks.workunit.client.0.smithi016.stdout:2/46: write d0/f3 [5669519,9416] 0 2024-08-01T06:56:08.273 INFO:tasks.workunit.client.0.smithi016.stdout:1/79: stat d2/d3/c7 0 2024-08-01T06:56:08.273 INFO:tasks.workunit.client.0.smithi016.stdout:0/66: mkdir d10/d11/d18 0 2024-08-01T06:56:08.274 INFO:tasks.workunit.client.0.smithi016.stdout:1/80: chown d2/de/f14 20796 1 2024-08-01T06:56:08.274 INFO:tasks.workunit.client.0.smithi016.stdout:0/67: chown d10/f16 92197 1 2024-08-01T06:56:08.278 INFO:tasks.workunit.client.0.smithi016.stdout:7/43: creat d7/f11 x:0 0 0 2024-08-01T06:56:08.279 INFO:tasks.workunit.client.1.smithi089.stdout:7/964: dread d7/df/d3b/f58 [0,4194304] 0 2024-08-01T06:56:08.281 INFO:tasks.workunit.client.1.smithi089.stdout:5/970: rename d5/de/d10/d16/f44 to d5/dac/d105/dbd/df0/d5d/d6c/d98/f138 0 2024-08-01T06:56:08.282 INFO:tasks.workunit.client.0.smithi016.stdout:7/44: truncate d7/d8/da/f10 2105 0 2024-08-01T06:56:08.283 INFO:tasks.workunit.client.0.smithi016.stdout:0/68: dwrite d10/d11/f14 [0,4194304] 0 2024-08-01T06:56:08.289 INFO:tasks.workunit.client.1.smithi089.stdout:7/965: symlink d7/d1f/d30/dab/l143 0 2024-08-01T06:56:08.289 INFO:tasks.workunit.client.0.smithi016.stdout:9/65: dread d3/d4/fa [0,4194304] 0 2024-08-01T06:56:08.290 INFO:tasks.workunit.client.0.smithi016.stdout:2/47: creat d0/fd x:0 0 0 2024-08-01T06:56:08.292 INFO:tasks.workunit.client.1.smithi089.stdout:5/971: rename d5/de/d10/d16/d1b/l58 to d5/dac/d10f/l139 0 2024-08-01T06:56:08.293 INFO:tasks.workunit.client.0.smithi016.stdout:1/81: creat d2/d3/f18 x:0 0 0 2024-08-01T06:56:08.293 INFO:tasks.workunit.client.1.smithi089.stdout:5/972: readlink d5/de/d10/d16/d1b/d25/d4d/ldd 0 2024-08-01T06:56:08.294 INFO:tasks.workunit.client.1.smithi089.stdout:6/965: link d2/d2e/d98/lb1 d2/d11/d1a/d1c/db6/l139 0 2024-08-01T06:56:08.298 INFO:tasks.workunit.client.1.smithi089.stdout:6/966: dwrite d2/fe1 [0,4194304] 0 2024-08-01T06:56:08.299 INFO:tasks.workunit.client.0.smithi016.stdout:0/69: unlink c8 0 2024-08-01T06:56:08.303 INFO:tasks.workunit.client.1.smithi089.stdout:6/967: symlink d2/d2e/d7c/l13a 0 2024-08-01T06:56:08.304 INFO:tasks.workunit.client.0.smithi016.stdout:4/40: dwrite d0/f5 [0,4194304] 0 2024-08-01T06:56:08.304 INFO:tasks.workunit.client.0.smithi016.stdout:2/48: write d0/f5 [399313,34377] 0 2024-08-01T06:56:08.305 INFO:tasks.workunit.client.0.smithi016.stdout:1/82: fdatasync d2/d3/f9 0 2024-08-01T06:56:08.306 INFO:tasks.workunit.client.1.smithi089.stdout:5/973: mknod d5/de/d10/deb/c13a 0 2024-08-01T06:56:08.306 INFO:tasks.workunit.client.1.smithi089.stdout:5/974: dread - d5/dac/d105/d10c/d121/f12a zero size 2024-08-01T06:56:08.307 INFO:tasks.workunit.client.0.smithi016.stdout:7/45: symlink d7/d8/da/dc/l12 0 2024-08-01T06:56:08.308 INFO:tasks.workunit.client.1.smithi089.stdout:5/975: chown d5/d13/d38/d42/d127/c128 2178013 1 2024-08-01T06:56:08.308 INFO:tasks.workunit.client.1.smithi089.stdout:6/968: truncate d2/d11/d1a/d1c/db6/fbf 982048 0 2024-08-01T06:56:08.310 INFO:tasks.workunit.client.1.smithi089.stdout:6/969: write d2/d11/f1d [684402,106099] 0 2024-08-01T06:56:08.314 INFO:tasks.workunit.client.1.smithi089.stdout:7/966: truncate d7/df/d10/f35 2595410 0 2024-08-01T06:56:08.315 INFO:tasks.workunit.client.0.smithi016.stdout:9/66: creat d3/de/f13 x:0 0 0 2024-08-01T06:56:08.315 INFO:tasks.workunit.client.1.smithi089.stdout:5/976: dwrite d5/d13/f84 [4194304,4194304] 0 2024-08-01T06:56:08.316 INFO:tasks.workunit.client.1.smithi089.stdout:7/967: truncate d7/d1f/d3a/dad/fb2 1067185 0 2024-08-01T06:56:08.317 INFO:tasks.workunit.client.1.smithi089.stdout:6/970: mknod d2/d11/d1f/c13b 0 2024-08-01T06:56:08.319 INFO:tasks.workunit.client.0.smithi016.stdout:0/70: getdents d10/d11/d18 0 2024-08-01T06:56:08.321 INFO:tasks.workunit.client.0.smithi016.stdout:0/71: write d10/d11/f15 [998649,57025] 0 2024-08-01T06:56:08.322 INFO:tasks.workunit.client.1.smithi089.stdout:7/968: mkdir d7/df/d3b/d64/d144 0 2024-08-01T06:56:08.323 INFO:tasks.workunit.client.1.smithi089.stdout:7/969: chown d7/d1f/d30/d4c/dbc/dcd/d104/f128 1293127 1 2024-08-01T06:56:08.324 INFO:tasks.workunit.client.0.smithi016.stdout:9/67: dwrite d3/d4/f11 [0,4194304] 0 2024-08-01T06:56:08.324 INFO:tasks.workunit.client.1.smithi089.stdout:6/971: fdatasync d2/d11/d1a/fad 0 2024-08-01T06:56:08.325 INFO:tasks.workunit.client.0.smithi016.stdout:0/72: truncate d10/f16 866554 0 2024-08-01T06:56:08.326 INFO:tasks.workunit.client.0.smithi016.stdout:9/68: fdatasync d3/de/f13 0 2024-08-01T06:56:08.326 INFO:tasks.workunit.client.1.smithi089.stdout:6/972: write d2/d11/d1f/d46/d6b/d7d/f106 [863699,89670] 0 2024-08-01T06:56:08.329 INFO:tasks.workunit.client.1.smithi089.stdout:5/977: symlink d5/d13/d43/dc5/d100/d10d/d122/l13b 0 2024-08-01T06:56:08.333 INFO:tasks.workunit.client.0.smithi016.stdout:0/73: dread ff [0,4194304] 0 2024-08-01T06:56:08.333 INFO:tasks.workunit.client.0.smithi016.stdout:7/46: creat d7/db/f13 x:0 0 0 2024-08-01T06:56:08.334 INFO:tasks.workunit.client.0.smithi016.stdout:9/69: dread d3/d4/f11 [0,4194304] 0 2024-08-01T06:56:08.335 INFO:tasks.workunit.client.1.smithi089.stdout:6/973: mkdir d2/d11/d1f/dbd/d13c 0 2024-08-01T06:56:08.337 INFO:tasks.workunit.client.0.smithi016.stdout:1/83: creat d2/f19 x:0 0 0 2024-08-01T06:56:08.337 INFO:tasks.workunit.client.0.smithi016.stdout:9/70: write d3/d4/f11 [4663960,111549] 0 2024-08-01T06:56:08.342 INFO:tasks.workunit.client.0.smithi016.stdout:0/74: dwrite d10/f16 [0,4194304] 0 2024-08-01T06:56:08.342 INFO:tasks.workunit.client.1.smithi089.stdout:3/861: sync 2024-08-01T06:56:08.342 INFO:tasks.workunit.client.1.smithi089.stdout:2/876: sync 2024-08-01T06:56:08.343 INFO:tasks.workunit.client.1.smithi089.stdout:2/877: chown d7/d1f/d29/f1a 829607401 1 2024-08-01T06:56:08.343 INFO:tasks.workunit.client.0.smithi016.stdout:2/49: truncate d0/f3 5270537 0 2024-08-01T06:56:08.344 INFO:tasks.workunit.client.0.smithi016.stdout:7/47: mknod d7/d8/da/dc/c14 0 2024-08-01T06:56:08.345 INFO:tasks.workunit.client.0.smithi016.stdout:7/48: read - d7/db/f13 zero size 2024-08-01T06:56:08.346 INFO:tasks.workunit.client.0.smithi016.stdout:1/84: mkdir d2/d3/d1a 0 2024-08-01T06:56:08.350 INFO:tasks.workunit.client.1.smithi089.stdout:7/970: getdents d7/d1f/d3a 0 2024-08-01T06:56:08.351 INFO:tasks.workunit.client.1.smithi089.stdout:7/971: fsync d7/fb 0 2024-08-01T06:56:08.352 INFO:tasks.workunit.client.1.smithi089.stdout:6/974: write d2/d11/d1a/d1c/faf [517244,100259] 0 2024-08-01T06:56:08.354 INFO:tasks.workunit.client.0.smithi016.stdout:2/50: symlink d0/d8/le 0 2024-08-01T06:56:08.355 INFO:tasks.workunit.client.0.smithi016.stdout:2/51: stat d0/d8/le 0 2024-08-01T06:56:08.357 INFO:tasks.workunit.client.0.smithi016.stdout:7/49: creat d7/d8/da/dc/f15 x:0 0 0 2024-08-01T06:56:08.358 INFO:tasks.workunit.client.0.smithi016.stdout:9/71: dwrite d3/d4/f11 [0,4194304] 0 2024-08-01T06:56:08.360 INFO:tasks.workunit.client.0.smithi016.stdout:0/75: rename c2 to d10/d11/d18/c19 0 2024-08-01T06:56:08.361 INFO:tasks.workunit.client.0.smithi016.stdout:0/76: write d10/d11/f15 [366900,79539] 0 2024-08-01T06:56:08.363 INFO:tasks.workunit.client.0.smithi016.stdout:2/52: mknod d0/d8/cf 0 2024-08-01T06:56:08.365 INFO:tasks.workunit.client.1.smithi089.stdout:3/862: truncate d7/d32/d4c/d67/d72/d91/dcb/fa4 2998490 0 2024-08-01T06:56:08.366 INFO:tasks.workunit.client.1.smithi089.stdout:7/972: mkdir d7/df/d10/d31/d145 0 2024-08-01T06:56:08.368 INFO:tasks.workunit.client.0.smithi016.stdout:7/50: mknod d7/d8/da/dc/c16 0 2024-08-01T06:56:08.368 INFO:tasks.workunit.client.0.smithi016.stdout:0/77: dread d10/d11/f14 [0,4194304] 0 2024-08-01T06:56:08.369 INFO:tasks.workunit.client.1.smithi089.stdout:6/975: creat d2/d11/d1a/d1c/d40/f13d x:0 0 0 2024-08-01T06:56:08.370 INFO:tasks.workunit.client.1.smithi089.stdout:5/978: getdents d5/de/d10/deb 0 2024-08-01T06:56:08.371 INFO:tasks.workunit.client.1.smithi089.stdout:5/979: read d5/de/d10/d16/d1b/f22 [2329779,54755] 0 2024-08-01T06:56:08.373 INFO:tasks.workunit.client.0.smithi016.stdout:2/53: dwrite d0/f5 [0,4194304] 0 2024-08-01T06:56:08.373 INFO:tasks.workunit.client.1.smithi089.stdout:2/878: rename d7/d1f/d52/d72/de5/lee to d7/d1f/d29/l10f 0 2024-08-01T06:56:08.374 INFO:tasks.workunit.client.1.smithi089.stdout:9/859: sync 2024-08-01T06:56:08.374 INFO:tasks.workunit.client.1.smithi089.stdout:0/936: sync 2024-08-01T06:56:08.376 INFO:tasks.workunit.client.1.smithi089.stdout:0/937: dread - d9/d40/d25/d46/d91/d2e/d44/d53/f127 zero size 2024-08-01T06:56:08.377 INFO:tasks.workunit.client.0.smithi016.stdout:1/85: creat d2/f1b x:0 0 0 2024-08-01T06:56:08.379 INFO:tasks.workunit.client.0.smithi016.stdout:7/51: mkdir d7/db/d17 0 2024-08-01T06:56:08.381 INFO:tasks.workunit.client.1.smithi089.stdout:7/973: rename d7/d46/d7b/d12c/dbb/cc3 to d7/d1f/d30/d4c/dbc/dcd/d104/c146 0 2024-08-01T06:56:08.382 INFO:tasks.workunit.client.0.smithi016.stdout:0/78: creat d10/d11/d18/f1a x:0 0 0 2024-08-01T06:56:08.384 INFO:tasks.workunit.client.1.smithi089.stdout:5/980: dwrite d5/f73 [0,4194304] 0 2024-08-01T06:56:08.385 INFO:tasks.workunit.client.0.smithi016.stdout:9/72: link d3/de/f13 d3/de/f14 0 2024-08-01T06:56:08.386 INFO:tasks.workunit.client.0.smithi016.stdout:0/79: dread d10/f16 [0,4194304] 0 2024-08-01T06:56:08.390 INFO:tasks.workunit.client.1.smithi089.stdout:3/863: link d7/d32/d12/d29/d39/d4b/ff8 d7/d32/d4c/d67/d72/d91/f121 0 2024-08-01T06:56:08.391 INFO:tasks.workunit.client.1.smithi089.stdout:5/981: dread d5/d13/d43/f4e [0,4194304] 0 2024-08-01T06:56:08.393 INFO:tasks.workunit.client.1.smithi089.stdout:0/938: mknod d9/d40/d45/d47/c128 0 2024-08-01T06:56:08.394 INFO:tasks.workunit.client.1.smithi089.stdout:6/976: mknod d2/d2e/c13e 0 2024-08-01T06:56:08.394 INFO:tasks.workunit.client.1.smithi089.stdout:0/939: chown d9/d40/d45/db7/ce9 823 1 2024-08-01T06:56:08.395 INFO:tasks.workunit.client.0.smithi016.stdout:1/86: unlink d2/d3/fa 0 2024-08-01T06:56:08.395 INFO:tasks.workunit.client.1.smithi089.stdout:6/977: chown d2/d11/c116 169255753 1 2024-08-01T06:56:08.396 INFO:tasks.workunit.client.1.smithi089.stdout:0/940: readlink d9/d40/d95/df1/lae 0 2024-08-01T06:56:08.396 INFO:tasks.workunit.client.0.smithi016.stdout:7/52: creat d7/f18 x:0 0 0 2024-08-01T06:56:08.399 INFO:tasks.workunit.client.0.smithi016.stdout:9/73: creat d3/de/f15 x:0 0 0 2024-08-01T06:56:08.401 INFO:tasks.workunit.client.0.smithi016.stdout:0/80: read d10/d11/f14 [1837582,93545] 0 2024-08-01T06:56:08.402 INFO:tasks.workunit.client.1.smithi089.stdout:6/978: dwrite d2/d11/d1f/d46/d6b/d7d/f106 [0,4194304] 0 2024-08-01T06:56:08.403 INFO:tasks.workunit.client.0.smithi016.stdout:2/54: link d0/f5 d0/f10 0 2024-08-01T06:56:08.404 INFO:tasks.workunit.client.0.smithi016.stdout:1/87: dwrite d2/f1b [0,4194304] 0 2024-08-01T06:56:08.404 INFO:tasks.workunit.client.1.smithi089.stdout:3/864: rmdir d7/d32/d4c/d67/d72/d91/dcb/d78 39 2024-08-01T06:56:08.405 INFO:tasks.workunit.client.0.smithi016.stdout:1/88: stat d2/f12 0 2024-08-01T06:56:08.408 INFO:tasks.workunit.client.0.smithi016.stdout:7/53: mkdir d7/d19 0 2024-08-01T06:56:08.408 INFO:tasks.workunit.client.1.smithi089.stdout:5/982: dwrite d5/de/f34 [0,4194304] 0 2024-08-01T06:56:08.408 INFO:tasks.workunit.client.1.smithi089.stdout:5/983: stat d5/d13/fe0 0 2024-08-01T06:56:08.409 INFO:tasks.workunit.client.0.smithi016.stdout:7/54: stat c3 0 2024-08-01T06:56:08.409 INFO:tasks.workunit.client.0.smithi016.stdout:7/55: dread - d7/d8/da/dc/f15 zero size 2024-08-01T06:56:08.410 INFO:tasks.workunit.client.1.smithi089.stdout:7/974: mknod d7/df/d3b/d64/d144/c147 0 2024-08-01T06:56:08.410 INFO:tasks.workunit.client.0.smithi016.stdout:7/56: fdatasync d7/ff 0 2024-08-01T06:56:08.411 INFO:tasks.workunit.client.1.smithi089.stdout:7/975: write d7/d15/f2d [1514877,108607] 0 2024-08-01T06:56:08.418 INFO:tasks.workunit.client.1.smithi089.stdout:2/879: link d7/d19/l61 d7/d19/db5/l110 0 2024-08-01T06:56:08.420 INFO:tasks.workunit.client.0.smithi016.stdout:7/57: dwrite f6 [0,4194304] 0 2024-08-01T06:56:08.420 INFO:tasks.workunit.client.0.smithi016.stdout:0/81: mknod d10/c1b 0 2024-08-01T06:56:08.424 INFO:tasks.workunit.client.0.smithi016.stdout:2/55: creat d0/d8/f11 x:0 0 0 2024-08-01T06:56:08.425 INFO:tasks.workunit.client.0.smithi016.stdout:1/89: mkdir d2/d3/d1c 0 2024-08-01T06:56:08.427 INFO:tasks.workunit.client.0.smithi016.stdout:9/74: mkdir d3/d9/df/d16 0 2024-08-01T06:56:08.428 INFO:tasks.workunit.client.1.smithi089.stdout:9/860: dwrite f4 [0,4194304] 0 2024-08-01T06:56:08.429 INFO:tasks.workunit.client.0.smithi016.stdout:1/90: dread d2/fc [0,4194304] 0 2024-08-01T06:56:08.431 INFO:tasks.workunit.client.1.smithi089.stdout:0/941: mknod d9/d40/d95/d99/d2b/d55/c129 0 2024-08-01T06:56:08.431 INFO:tasks.workunit.client.0.smithi016.stdout:1/91: write d2/fc [4043268,56246] 0 2024-08-01T06:56:08.433 INFO:tasks.workunit.client.0.smithi016.stdout:1/92: write d2/de/f14 [2157479,66019] 0 2024-08-01T06:56:08.434 INFO:tasks.workunit.client.0.smithi016.stdout:7/58: rename d7/d8 to d7/db/d1a 0 2024-08-01T06:56:08.438 INFO:tasks.workunit.client.1.smithi089.stdout:6/979: mknod d2/d11/d3e/df1/c13f 0 2024-08-01T06:56:08.440 INFO:tasks.workunit.client.1.smithi089.stdout:6/980: stat d2/d2e/d2f/d91/cdf 0 2024-08-01T06:56:08.441 INFO:tasks.workunit.client.0.smithi016.stdout:9/75: creat d3/de/f17 x:0 0 0 2024-08-01T06:56:08.441 INFO:tasks.workunit.client.1.smithi089.stdout:2/880: dwrite d7/f10 [0,4194304] 0 2024-08-01T06:56:08.442 INFO:tasks.workunit.client.0.smithi016.stdout:9/76: readlink d3/l8 0 2024-08-01T06:56:08.443 INFO:tasks.workunit.client.0.smithi016.stdout:9/77: chown d3/d4/f11 4941 1 2024-08-01T06:56:08.444 INFO:tasks.workunit.client.0.smithi016.stdout:2/56: dwrite d0/f10 [0,4194304] 0 2024-08-01T06:56:08.445 INFO:tasks.workunit.client.1.smithi089.stdout:9/861: creat d18/d33/d6e/dd1/f11c x:0 0 0 2024-08-01T06:56:08.445 INFO:tasks.workunit.client.0.smithi016.stdout:9/78: chown d3/d9/l10 35197081 1 2024-08-01T06:56:08.449 INFO:tasks.workunit.client.0.smithi016.stdout:1/93: dread f0 [4194304,4194304] 0 2024-08-01T06:56:08.450 INFO:tasks.workunit.client.1.smithi089.stdout:3/865: link d7/d32/d4c/l9a d7/d68/d50/d6f/d2f/da2/da8/l122 0 2024-08-01T06:56:08.453 INFO:tasks.workunit.client.1.smithi089.stdout:5/984: creat d5/de/f13c x:0 0 0 2024-08-01T06:56:08.454 INFO:tasks.workunit.client.0.smithi016.stdout:9/79: creat d3/de/f18 x:0 0 0 2024-08-01T06:56:08.456 INFO:tasks.workunit.client.0.smithi016.stdout:0/82: getdents d10 0 2024-08-01T06:56:08.458 INFO:tasks.workunit.client.0.smithi016.stdout:1/94: truncate d2/d3/f9 1420273 0 2024-08-01T06:56:08.461 INFO:tasks.workunit.client.0.smithi016.stdout:2/57: dwrite d0/f10 [0,4194304] 0 2024-08-01T06:56:08.462 INFO:tasks.workunit.client.0.smithi016.stdout:9/80: creat d3/d4/f19 x:0 0 0 2024-08-01T06:56:08.462 INFO:tasks.workunit.client.0.smithi016.stdout:2/58: dread - d0/fb zero size 2024-08-01T06:56:08.463 INFO:tasks.workunit.client.0.smithi016.stdout:0/83: read - d10/d11/f13 zero size 2024-08-01T06:56:08.464 INFO:tasks.workunit.client.1.smithi089.stdout:0/942: creat d9/d40/d25/d46/d91/d2e/d3a/d76/d123/f12a x:0 0 0 2024-08-01T06:56:08.466 INFO:tasks.workunit.client.0.smithi016.stdout:9/81: symlink d3/de/l1a 0 2024-08-01T06:56:08.467 INFO:tasks.workunit.client.0.smithi016.stdout:9/82: truncate d3/d4/f11 5259455 0 2024-08-01T06:56:08.468 INFO:tasks.workunit.client.1.smithi089.stdout:5/985: symlink d5/de/d10/d33/d5e/l13d 0 2024-08-01T06:56:08.469 INFO:tasks.workunit.client.0.smithi016.stdout:2/59: rmdir d0/d8 39 2024-08-01T06:56:08.471 INFO:tasks.workunit.client.0.smithi016.stdout:2/60: write d0/f10 [1882828,124049] 0 2024-08-01T06:56:08.472 INFO:tasks.workunit.client.0.smithi016.stdout:0/84: mkdir d10/d1c 0 2024-08-01T06:56:08.473 INFO:tasks.workunit.client.1.smithi089.stdout:7/976: getdents d7/df/d91/da4/dca 0 2024-08-01T06:56:08.475 INFO:tasks.workunit.client.1.smithi089.stdout:7/977: write d7/d1f/d30/d4c/dbc/dcd/f125 [8922,82499] 0 2024-08-01T06:56:08.476 INFO:tasks.workunit.client.0.smithi016.stdout:1/95: write f0 [2025743,127324] 0 2024-08-01T06:56:08.477 INFO:tasks.workunit.client.0.smithi016.stdout:9/83: dwrite d3/de/f15 [0,4194304] 0 2024-08-01T06:56:08.478 INFO:tasks.workunit.client.0.smithi016.stdout:1/96: read d2/de/f14 [1123234,9472] 0 2024-08-01T06:56:08.480 INFO:tasks.workunit.client.0.smithi016.stdout:9/84: dread - d3/de/f18 zero size 2024-08-01T06:56:08.483 INFO:tasks.workunit.client.0.smithi016.stdout:0/85: mknod d10/d1c/c1d 0 2024-08-01T06:56:08.483 INFO:tasks.workunit.client.0.smithi016.stdout:0/86: readlink - no filename 2024-08-01T06:56:08.484 INFO:tasks.workunit.client.1.smithi089.stdout:5/986: mknod d5/dac/d105/dbd/df0/c13e 0 2024-08-01T06:56:08.484 INFO:tasks.workunit.client.0.smithi016.stdout:1/97: write d2/fc [426719,107074] 0 2024-08-01T06:56:08.485 INFO:tasks.workunit.client.1.smithi089.stdout:6/981: creat d2/d30/d3c/f140 x:0 0 0 2024-08-01T06:56:08.487 INFO:tasks.workunit.client.1.smithi089.stdout:5/987: readlink d5/de/d10/d16/l8c 0 2024-08-01T06:56:08.488 INFO:tasks.workunit.client.1.smithi089.stdout:5/988: write d5/d13/d38/d42/f7b [1043049,28028] 0 2024-08-01T06:56:08.489 INFO:tasks.workunit.client.1.smithi089.stdout:7/978: rename d7/df/d3b/d64/c97 to d7/df/d10/db3/c148 0 2024-08-01T06:56:08.491 INFO:tasks.workunit.client.1.smithi089.stdout:2/881: rmdir d7/d1f/d52/df9 0 2024-08-01T06:56:08.492 INFO:tasks.workunit.client.1.smithi089.stdout:6/982: dwrite d2/d11/f17 [0,4194304] 0 2024-08-01T06:56:08.495 INFO:tasks.workunit.client.1.smithi089.stdout:9/862: creat d18/d33/d49/d7b/f11d x:0 0 0 2024-08-01T06:56:08.495 INFO:tasks.workunit.client.1.smithi089.stdout:3/866: truncate d7/f71 1565303 0 2024-08-01T06:56:08.496 INFO:tasks.workunit.client.0.smithi016.stdout:9/85: getdents d3/d9/df/d16 0 2024-08-01T06:56:08.497 INFO:tasks.workunit.client.0.smithi016.stdout:9/86: truncate d3/de/f14 34505 0 2024-08-01T06:56:08.498 INFO:tasks.workunit.client.0.smithi016.stdout:9/87: dread - d3/de/f17 zero size 2024-08-01T06:56:08.502 INFO:tasks.workunit.client.1.smithi089.stdout:7/979: dwrite d7/d46/d7b/d12c/dbb/f132 [0,4194304] 0 2024-08-01T06:56:08.502 INFO:tasks.workunit.client.1.smithi089.stdout:9/863: read d18/d33/d49/d7b/d81/f103 [857598,34112] 0 2024-08-01T06:56:08.503 INFO:tasks.workunit.client.1.smithi089.stdout:0/943: dwrite d9/d40/d45/fe4 [0,4194304] 0 2024-08-01T06:56:08.507 INFO:tasks.workunit.client.1.smithi089.stdout:7/980: chown d7/d46/d7b/d119/f121 538912953 1 2024-08-01T06:56:08.507 INFO:tasks.workunit.client.1.smithi089.stdout:6/983: truncate d2/d2e/d2f/fe0 248736 0 2024-08-01T06:56:08.507 INFO:tasks.workunit.client.0.smithi016.stdout:0/87: getdents d10 0 2024-08-01T06:56:08.508 INFO:tasks.workunit.client.0.smithi016.stdout:0/88: chown d10/d11/f13 15 1 2024-08-01T06:56:08.513 INFO:tasks.workunit.client.1.smithi089.stdout:0/944: creat d9/d40/d95/f12b x:0 0 0 2024-08-01T06:56:08.513 INFO:tasks.workunit.client.1.smithi089.stdout:7/981: dread d7/d46/d7b/d12c/fb7 [0,4194304] 0 2024-08-01T06:56:08.518 INFO:tasks.workunit.client.1.smithi089.stdout:9/864: dwrite d18/d33/d49/d7b/d7f/d98/d9f/f114 [0,4194304] 0 2024-08-01T06:56:08.521 INFO:tasks.workunit.client.1.smithi089.stdout:2/882: link d7/d1f/d52/c7a d7/d1f/c111 0 2024-08-01T06:56:08.522 INFO:tasks.workunit.client.1.smithi089.stdout:9/865: creat d18/d33/d6e/f11e x:0 0 0 2024-08-01T06:56:08.526 INFO:tasks.workunit.client.0.smithi016.stdout:1/98: truncate f0 5641286 0 2024-08-01T06:56:08.526 INFO:tasks.workunit.client.1.smithi089.stdout:2/883: creat d7/d19/dc5/d10b/f112 x:0 0 0 2024-08-01T06:56:08.527 INFO:tasks.workunit.client.1.smithi089.stdout:9/866: fdatasync d18/d33/f109 0 2024-08-01T06:56:08.528 INFO:tasks.workunit.client.0.smithi016.stdout:1/99: symlink d2/d3/d1c/l1d 0 2024-08-01T06:56:08.530 INFO:tasks.workunit.client.1.smithi089.stdout:9/867: rmdir d18/d33/df7/da6 39 2024-08-01T06:56:08.530 INFO:tasks.workunit.client.1.smithi089.stdout:0/945: dwrite d9/d40/d25/fe3 [4194304,4194304] 0 2024-08-01T06:56:08.532 INFO:tasks.workunit.client.1.smithi089.stdout:2/884: mknod d7/d19/dc5/d107/c113 0 2024-08-01T06:56:08.537 INFO:tasks.workunit.client.1.smithi089.stdout:2/885: unlink d7/d19/d1e/d3d/d60/fd0 0 2024-08-01T06:56:08.539 INFO:tasks.workunit.client.1.smithi089.stdout:7/982: dread d7/fd [0,4194304] 0 2024-08-01T06:56:08.540 INFO:tasks.workunit.client.1.smithi089.stdout:2/886: unlink d7/d19/d3b/fd1 0 2024-08-01T06:56:08.542 INFO:tasks.workunit.client.1.smithi089.stdout:2/887: mkdir d7/d19/d68/d114 0 2024-08-01T06:56:08.543 INFO:tasks.workunit.client.1.smithi089.stdout:2/888: read d7/d1f/fba [387905,64316] 0 2024-08-01T06:56:08.546 INFO:tasks.workunit.client.1.smithi089.stdout:2/889: getdents d7 0 2024-08-01T06:56:08.559 INFO:tasks.workunit.client.0.smithi016.stdout:9/88: write d3/de/f14 [567430,96359] 0 2024-08-01T06:56:08.562 INFO:tasks.workunit.client.0.smithi016.stdout:9/89: symlink d3/d9/df/l1b 0 2024-08-01T06:56:08.563 INFO:tasks.workunit.client.1.smithi089.stdout:3/867: dwrite d7/d32/d4c/d67/fac [0,4194304] 0 2024-08-01T06:56:08.565 INFO:tasks.workunit.client.1.smithi089.stdout:3/868: dread - d7/d32/d12/d29/d39/d4b/f94 zero size 2024-08-01T06:56:08.565 INFO:tasks.workunit.client.0.smithi016.stdout:9/90: creat d3/d9/df/f1c x:0 0 0 2024-08-01T06:56:08.566 INFO:tasks.workunit.client.0.smithi016.stdout:0/89: dwrite ff [0,4194304] 0 2024-08-01T06:56:08.567 INFO:tasks.workunit.client.0.smithi016.stdout:9/91: write d3/d4/f19 [223730,38120] 0 2024-08-01T06:56:08.569 INFO:tasks.workunit.client.0.smithi016.stdout:0/90: write d10/d11/d18/f1a [693733,95757] 0 2024-08-01T06:56:08.570 INFO:tasks.workunit.client.1.smithi089.stdout:6/984: truncate d2/d11/d1f/f5a 1020771 0 2024-08-01T06:56:08.571 INFO:tasks.workunit.client.0.smithi016.stdout:0/91: dread - d10/d11/f13 zero size 2024-08-01T06:56:08.571 INFO:tasks.workunit.client.1.smithi089.stdout:6/985: fdatasync d2/ff 0 2024-08-01T06:56:08.574 INFO:tasks.workunit.client.0.smithi016.stdout:1/100: write d2/de/f14 [930432,67406] 0 2024-08-01T06:56:08.578 INFO:tasks.workunit.client.0.smithi016.stdout:0/92: fsync d10/f16 0 2024-08-01T06:56:08.580 INFO:tasks.workunit.client.1.smithi089.stdout:7/983: write d7/d1f/f11f [649849,42464] 0 2024-08-01T06:56:08.581 INFO:tasks.workunit.client.1.smithi089.stdout:7/984: chown d7/d46/d7b/d12c/dbb/de7/deb 9 1 2024-08-01T06:56:08.582 INFO:tasks.workunit.client.1.smithi089.stdout:7/985: dread - d7/d46/f140 zero size 2024-08-01T06:56:08.583 INFO:tasks.workunit.client.1.smithi089.stdout:6/986: mkdir d2/d11/d1f/d46/d141 0 2024-08-01T06:56:08.584 INFO:tasks.workunit.client.1.smithi089.stdout:2/890: write d7/d19/d1e/fdd [2770148,19511] 0 2024-08-01T06:56:08.585 INFO:tasks.workunit.client.1.smithi089.stdout:6/987: write d2/d11/d1a/d1c/f103 [79188,20788] 0 2024-08-01T06:56:08.586 INFO:tasks.workunit.client.0.smithi016.stdout:0/93: mknod d10/d11/c1e 0 2024-08-01T06:56:08.588 INFO:tasks.workunit.client.0.smithi016.stdout:1/101: symlink d2/l1e 0 2024-08-01T06:56:08.591 INFO:tasks.workunit.client.0.smithi016.stdout:0/94: chown d10/d11/d18/c19 619 1 2024-08-01T06:56:08.592 INFO:tasks.workunit.client.1.smithi089.stdout:6/988: symlink d2/d11/d1f/d46/d6b/d7d/l142 0 2024-08-01T06:56:08.592 INFO:tasks.workunit.client.0.smithi016.stdout:1/102: dread d2/de/f14 [0,4194304] 0 2024-08-01T06:56:08.593 INFO:tasks.workunit.client.1.smithi089.stdout:6/989: chown d2/d11/d1f/d46/d6b/d7d/f125 218 1 2024-08-01T06:56:08.595 INFO:tasks.workunit.client.0.smithi016.stdout:0/95: mknod d10/c1f 0 2024-08-01T06:56:08.597 INFO:tasks.workunit.client.1.smithi089.stdout:6/990: mknod d2/d11/d1f/d46/d6b/d7d/c143 0 2024-08-01T06:56:08.597 INFO:tasks.workunit.client.0.smithi016.stdout:1/103: rmdir d2/d3/d1c 39 2024-08-01T06:56:08.601 INFO:tasks.workunit.client.0.smithi016.stdout:1/104: mkdir d2/d3/d1f 0 2024-08-01T06:56:08.603 INFO:tasks.workunit.client.0.smithi016.stdout:0/96: getdents d10/d11/d18 0 2024-08-01T06:56:08.604 INFO:tasks.workunit.client.0.smithi016.stdout:1/105: creat d2/d3/d1a/f20 x:0 0 0 2024-08-01T06:56:08.606 INFO:tasks.workunit.client.0.smithi016.stdout:0/97: rename d10/d11/f13 to d10/d1c/f20 0 2024-08-01T06:56:08.606 INFO:tasks.workunit.client.0.smithi016.stdout:0/98: fsync ff 0 2024-08-01T06:56:08.606 INFO:tasks.workunit.client.0.smithi016.stdout:1/106: fsync d2/de/f14 0 2024-08-01T06:56:08.607 INFO:tasks.workunit.client.0.smithi016.stdout:1/107: readlink d2/l1e 0 2024-08-01T06:56:08.608 INFO:tasks.workunit.client.0.smithi016.stdout:0/99: chown fd 405 1 2024-08-01T06:56:08.609 INFO:tasks.workunit.client.0.smithi016.stdout:0/100: rename d10/d11 to d10/d11/d18/d21 22 2024-08-01T06:56:08.609 INFO:tasks.workunit.client.0.smithi016.stdout:1/108: mkdir d2/de/d21 0 2024-08-01T06:56:08.610 INFO:tasks.workunit.client.0.smithi016.stdout:0/101: read d10/d11/f15 [909739,18213] 0 2024-08-01T06:56:08.611 INFO:tasks.workunit.client.0.smithi016.stdout:1/109: write d2/de/f14 [4150443,47557] 0 2024-08-01T06:56:08.614 INFO:tasks.workunit.client.0.smithi016.stdout:0/102: symlink d10/d1c/l22 0 2024-08-01T06:56:08.615 INFO:tasks.workunit.client.0.smithi016.stdout:1/110: mkdir d2/d3/d1a/d22 0 2024-08-01T06:56:08.617 INFO:tasks.workunit.client.0.smithi016.stdout:1/111: chown d2/d3/lb 27 1 2024-08-01T06:56:08.619 INFO:tasks.workunit.client.0.smithi016.stdout:1/112: readlink d2/d3/d1c/l1d 0 2024-08-01T06:56:08.623 INFO:tasks.workunit.client.0.smithi016.stdout:1/113: rename d2/d3/f9 to d2/de/d21/f23 0 2024-08-01T06:56:08.638 INFO:tasks.workunit.client.0.smithi016.stdout:3/41: sync 2024-08-01T06:56:08.640 INFO:tasks.workunit.client.0.smithi016.stdout:3/42: symlink d9/da/df/l11 0 2024-08-01T06:56:08.642 INFO:tasks.workunit.client.0.smithi016.stdout:3/43: mkdir d9/da/df/d12 0 2024-08-01T06:56:08.643 INFO:tasks.workunit.client.0.smithi016.stdout:3/44: readlink d9/da/df/l11 0 2024-08-01T06:56:08.643 INFO:tasks.workunit.client.0.smithi016.stdout:9/92: truncate d3/d4/f11 5196346 0 2024-08-01T06:56:08.643 INFO:tasks.workunit.client.0.smithi016.stdout:9/93: stat d3/de/f17 0 2024-08-01T06:56:08.644 INFO:tasks.workunit.client.0.smithi016.stdout:3/45: mknod d9/c13 0 2024-08-01T06:56:08.645 INFO:tasks.workunit.client.0.smithi016.stdout:9/94: creat d3/f1d x:0 0 0 2024-08-01T06:56:08.646 INFO:tasks.workunit.client.0.smithi016.stdout:3/46: mknod d9/da/df/c14 0 2024-08-01T06:56:08.646 INFO:tasks.workunit.client.0.smithi016.stdout:9/95: truncate d3/de/f15 5192630 0 2024-08-01T06:56:08.650 INFO:tasks.workunit.client.0.smithi016.stdout:3/47: creat d9/da/df/d12/f15 x:0 0 0 2024-08-01T06:56:08.650 INFO:tasks.workunit.client.0.smithi016.stdout:9/96: dread d3/de/f14 [0,4194304] 0 2024-08-01T06:56:08.653 INFO:tasks.workunit.client.0.smithi016.stdout:9/97: creat d3/d9/df/d16/f1e x:0 0 0 2024-08-01T06:56:08.669 INFO:tasks.workunit.client.1.smithi089.stdout:2/891: dread d7/d1f/f6c [0,4194304] 0 2024-08-01T06:56:08.669 INFO:tasks.workunit.client.1.smithi089.stdout:7/986: dread d7/d1f/d30/d4c/dbc/dcd/d104/f9b [0,4194304] 0 2024-08-01T06:56:08.670 INFO:tasks.workunit.client.1.smithi089.stdout:3/869: dread d7/d32/d12/d29/d39/d4b/dd2/dd5/ff2 [0,4194304] 0 2024-08-01T06:56:08.671 INFO:tasks.workunit.client.1.smithi089.stdout:7/987: read d7/df/d10/d42/d4e/d11d/f130 [69365,94293] 0 2024-08-01T06:56:08.671 INFO:tasks.workunit.client.0.smithi016.stdout:0/103: write d10/d1c/f20 [83606,109029] 0 2024-08-01T06:56:08.672 INFO:tasks.workunit.client.1.smithi089.stdout:6/991: rmdir d2/d2e/dc2/dd2 39 2024-08-01T06:56:08.675 INFO:tasks.workunit.client.0.smithi016.stdout:0/104: read f9 [2946609,58139] 0 2024-08-01T06:56:08.676 INFO:tasks.workunit.client.0.smithi016.stdout:3/48: dwrite d9/da/fb [0,4194304] 0 2024-08-01T06:56:08.677 INFO:tasks.workunit.client.1.smithi089.stdout:3/870: mknod d7/d68/d50/d6f/d46/dd1/c123 0 2024-08-01T06:56:08.679 INFO:tasks.workunit.client.1.smithi089.stdout:7/988: symlink d7/d1f/d30/d4c/dbc/dcd/dd7/l149 0 2024-08-01T06:56:08.682 INFO:tasks.workunit.client.1.smithi089.stdout:6/992: read d2/d11/d3e/f76 [71856,59212] 0 2024-08-01T06:56:08.683 INFO:tasks.workunit.client.0.smithi016.stdout:3/49: rename d9/ce to d9/da/df/c16 0 2024-08-01T06:56:08.684 INFO:tasks.workunit.client.0.smithi016.stdout:0/105: dwrite d10/d11/d18/f1a [0,4194304] 0 2024-08-01T06:56:08.686 INFO:tasks.workunit.client.1.smithi089.stdout:3/871: creat d7/d32/d4c/d69/d6d/f124 x:0 0 0 2024-08-01T06:56:08.687 INFO:tasks.workunit.client.0.smithi016.stdout:0/106: dread d10/d1c/f20 [0,4194304] 0 2024-08-01T06:56:08.689 INFO:tasks.workunit.client.0.smithi016.stdout:3/50: creat d9/da/df/f17 x:0 0 0 2024-08-01T06:56:08.691 INFO:tasks.workunit.client.1.smithi089.stdout:7/989: mknod d7/d1f/d30/d4c/dbc/dcd/c14a 0 2024-08-01T06:56:08.692 INFO:tasks.workunit.client.1.smithi089.stdout:7/990: stat d7/d15/f87 0 2024-08-01T06:56:08.693 INFO:tasks.workunit.client.1.smithi089.stdout:7/991: chown d7/d1f/d30/d4c/l4d 58 1 2024-08-01T06:56:08.693 INFO:tasks.workunit.client.0.smithi016.stdout:0/107: symlink d10/l23 0 2024-08-01T06:56:08.693 INFO:tasks.workunit.client.1.smithi089.stdout:7/992: stat d7/df/d10/f34 0 2024-08-01T06:56:08.696 INFO:tasks.workunit.client.1.smithi089.stdout:6/993: symlink d2/d11/d1a/d1c/l144 0 2024-08-01T06:56:08.697 INFO:tasks.workunit.client.1.smithi089.stdout:2/892: write d7/d1f/d52/d6e/f102 [1957366,77229] 0 2024-08-01T06:56:08.698 INFO:tasks.workunit.client.0.smithi016.stdout:3/51: dwrite f3 [4194304,4194304] 0 2024-08-01T06:56:08.699 INFO:tasks.workunit.client.1.smithi089.stdout:7/993: mknod d7/df/d10/dd6/c14b 0 2024-08-01T06:56:08.701 INFO:tasks.workunit.client.1.smithi089.stdout:7/994: fsync d7/df/d10/db3/de9/f102 0 2024-08-01T06:56:08.702 INFO:tasks.workunit.client.1.smithi089.stdout:2/893: dread d7/f10 [0,4194304] 0 2024-08-01T06:56:08.702 INFO:tasks.workunit.client.1.smithi089.stdout:3/872: link d7/d68/d3d/fda d7/d32/f125 0 2024-08-01T06:56:08.705 INFO:tasks.workunit.client.1.smithi089.stdout:3/873: write d7/d32/d4c/d67/db4/ddc/f11a [515190,35527] 0 2024-08-01T06:56:08.705 INFO:tasks.workunit.client.1.smithi089.stdout:2/894: mknod d7/d19/dc5/c115 0 2024-08-01T06:56:08.706 INFO:tasks.workunit.client.1.smithi089.stdout:3/874: stat d7/d32/d12/d29/l7e 0 2024-08-01T06:56:08.706 INFO:tasks.workunit.client.1.smithi089.stdout:7/995: link d7/df/d10/db3/f11b d7/df/f14c 0 2024-08-01T06:56:08.708 INFO:tasks.workunit.client.1.smithi089.stdout:7/996: chown d7/df/d91/da4/f38 2680 1 2024-08-01T06:56:08.708 INFO:tasks.workunit.client.1.smithi089.stdout:2/895: mkdir d7/d1f/d29/d116 0 2024-08-01T06:56:08.709 INFO:tasks.workunit.client.1.smithi089.stdout:5/989: sync 2024-08-01T06:56:08.710 INFO:tasks.workunit.client.1.smithi089.stdout:2/896: write d7/d19/db5/fea [58864,15977] 0 2024-08-01T06:56:08.710 INFO:tasks.workunit.client.1.smithi089.stdout:3/875: rename d7/d32/d4c/f85 to d7/d32/d12/d29/d39/f126 0 2024-08-01T06:56:08.713 INFO:tasks.workunit.client.1.smithi089.stdout:5/990: creat d5/dac/d105/d103/f13f x:0 0 0 2024-08-01T06:56:08.713 INFO:tasks.workunit.client.1.smithi089.stdout:7/997: read d7/fe5 [370332,122295] 0 2024-08-01T06:56:08.714 INFO:tasks.workunit.client.1.smithi089.stdout:2/897: creat d7/dd7/f117 x:0 0 0 2024-08-01T06:56:08.716 INFO:tasks.workunit.client.1.smithi089.stdout:3/876: mkdir d7/d32/d4c/d127 0 2024-08-01T06:56:08.717 INFO:tasks.workunit.client.1.smithi089.stdout:2/898: creat d7/d19/dc5/dcc/d64/d9c/f118 x:0 0 0 2024-08-01T06:56:08.718 INFO:tasks.workunit.client.1.smithi089.stdout:5/991: dread f0 [0,4194304] 0 2024-08-01T06:56:08.719 INFO:tasks.workunit.client.1.smithi089.stdout:7/998: rename d7/df/d10/dd6/dee to d7/df/d10/d31/d145/d14d 0 2024-08-01T06:56:08.722 INFO:tasks.workunit.client.1.smithi089.stdout:2/899: creat d7/d19/dc5/dcc/d9e/f119 x:0 0 0 2024-08-01T06:56:08.723 INFO:tasks.workunit.client.1.smithi089.stdout:3/877: mknod d7/d32/d4c/d69/c128 0 2024-08-01T06:56:08.724 INFO:tasks.workunit.client.1.smithi089.stdout:3/878: stat d7/d32/d12/lb3 0 2024-08-01T06:56:08.726 INFO:tasks.workunit.client.0.smithi016.stdout:0/108: dwrite fd [0,4194304] 0 2024-08-01T06:56:08.728 INFO:tasks.workunit.client.1.smithi089.stdout:6/994: dread d2/f18 [8388608,4194304] 0 2024-08-01T06:56:08.728 INFO:tasks.workunit.client.1.smithi089.stdout:7/999: dwrite d7/df/d91/f13e [0,4194304] 0 2024-08-01T06:56:08.729 INFO:tasks.workunit.client.0.smithi016.stdout:0/109: mknod d10/d1c/c24 0 2024-08-01T06:56:08.730 INFO:tasks.workunit.client.1.smithi089.stdout:6/995: chown d2/d2e/f12e 56 1 2024-08-01T06:56:08.732 INFO:tasks.workunit.client.1.smithi089.stdout:2/900: getdents d7/d19/db5 0 2024-08-01T06:56:08.734 INFO:tasks.workunit.client.0.smithi016.stdout:0/110: dread d10/d11/f14 [0,4194304] 0 2024-08-01T06:56:08.735 INFO:tasks.workunit.client.0.smithi016.stdout:0/111: readlink d10/l23 0 2024-08-01T06:56:08.736 INFO:tasks.workunit.client.1.smithi089.stdout:6/996: creat d2/d11/d1a/d1c/db6/d10d/f145 x:0 0 0 2024-08-01T06:56:08.736 INFO:tasks.workunit.client.1.smithi089.stdout:3/879: dwrite d7/d68/fc0 [0,4194304] 0 2024-08-01T06:56:08.738 INFO:tasks.workunit.client.0.smithi016.stdout:0/112: dread f6 [0,4194304] 0 2024-08-01T06:56:08.739 INFO:tasks.workunit.client.1.smithi089.stdout:6/997: chown d2/d11/d1a/d1c/d40 0 1 2024-08-01T06:56:08.739 INFO:tasks.workunit.client.1.smithi089.stdout:6/998: readlink d2/d30/l59 0 2024-08-01T06:56:08.741 INFO:tasks.workunit.client.1.smithi089.stdout:5/992: dread d5/d13/d38/d42/f55 [0,4194304] 0 2024-08-01T06:56:08.741 INFO:tasks.workunit.client.1.smithi089.stdout:6/999: mknod d2/d11/d1a/d1c/db6/c146 0 2024-08-01T06:56:08.742 INFO:tasks.workunit.client.1.smithi089.stdout:3/880: write d7/d32/d12/f33 [2235389,59167] 0 2024-08-01T06:56:08.742 INFO:tasks.workunit.client.1.smithi089.stdout:5/993: truncate d5/f3c 4247612 0 2024-08-01T06:56:08.744 INFO:tasks.workunit.client.1.smithi089.stdout:3/881: write d7/d32/d4c/d67/fac [35432,20067] 0 2024-08-01T06:56:08.745 INFO:tasks.workunit.client.1.smithi089.stdout:5/994: creat d5/de/d57/f140 x:0 0 0 2024-08-01T06:56:08.746 INFO:tasks.workunit.client.1.smithi089.stdout:2/901: dread d7/d1f/fba [0,4194304] 0 2024-08-01T06:56:08.747 INFO:tasks.workunit.client.1.smithi089.stdout:3/882: mkdir d7/d68/d50/d6f/d2f/da2/da8/d129 0 2024-08-01T06:56:08.750 INFO:tasks.workunit.client.1.smithi089.stdout:2/902: rename d7/d19/d3b/f59 to d7/d19/dc5/dcc/d64/d9c/f11a 0 2024-08-01T06:56:08.751 INFO:tasks.workunit.client.1.smithi089.stdout:5/995: creat d5/de/d10/d16/f141 x:0 0 0 2024-08-01T06:56:08.753 INFO:tasks.workunit.client.1.smithi089.stdout:2/903: rename d7/d19/dc5/d107/l109 to d7/d19/dc5/dcc/d106/l11b 0 2024-08-01T06:56:08.753 INFO:tasks.workunit.client.1.smithi089.stdout:5/996: creat d5/d13/f142 x:0 0 0 2024-08-01T06:56:08.755 INFO:tasks.workunit.client.1.smithi089.stdout:5/997: write d5/dac/d105/d103/f13f [524500,83141] 0 2024-08-01T06:56:08.758 INFO:tasks.workunit.client.1.smithi089.stdout:5/998: write d5/de/d10/d16/d1b/d25/f10e [6495428,94237] 0 2024-08-01T06:56:08.759 INFO:tasks.workunit.client.1.smithi089.stdout:9/868: sync 2024-08-01T06:56:08.760 INFO:tasks.workunit.client.1.smithi089.stdout:2/904: dwrite d7/d19/d1e/d3d/f103 [0,4194304] 0 2024-08-01T06:56:08.761 INFO:tasks.workunit.client.1.smithi089.stdout:9/869: chown d18/fc1 1406239 1 2024-08-01T06:56:08.761 INFO:tasks.workunit.client.1.smithi089.stdout:5/999: symlink d5/d13/d38/l143 0 2024-08-01T06:56:08.764 INFO:tasks.workunit.client.1.smithi089.stdout:2/905: creat d7/d19/dc5/dcc/d9e/f11c x:0 0 0 2024-08-01T06:56:08.764 INFO:tasks.workunit.client.1.smithi089.stdout:9/870: mkdir d18/d33/df7/d11f 0 2024-08-01T06:56:08.766 INFO:tasks.workunit.client.1.smithi089.stdout:2/906: truncate d7/d19/feb 665415 0 2024-08-01T06:56:08.769 INFO:tasks.workunit.client.1.smithi089.stdout:2/907: creat d7/d19/dc5/dcc/d106/f11d x:0 0 0 2024-08-01T06:56:08.771 INFO:tasks.workunit.client.1.smithi089.stdout:2/908: symlink d7/d1f/d52/l11e 0 2024-08-01T06:56:08.773 INFO:tasks.workunit.client.1.smithi089.stdout:2/909: truncate d7/d19/f37 8773809 0 2024-08-01T06:56:08.774 INFO:tasks.workunit.client.1.smithi089.stdout:2/910: write d7/d19/dc5/dcc/d106/f11d [1015117,101627] 0 2024-08-01T06:56:08.775 INFO:tasks.workunit.client.1.smithi089.stdout:2/911: write d7/d19/d3b/d7c/ffc [72415,49638] 0 2024-08-01T06:56:08.777 INFO:tasks.workunit.client.1.smithi089.stdout:2/912: rmdir d7/d19/d1e/d5b 39 2024-08-01T06:56:08.778 INFO:tasks.workunit.client.1.smithi089.stdout:2/913: symlink d7/dd7/l11f 0 2024-08-01T06:56:08.778 INFO:tasks.workunit.client.1.smithi089.stdout:9/871: truncate d18/f7e 1306397 0 2024-08-01T06:56:08.780 INFO:tasks.workunit.client.1.smithi089.stdout:9/872: fsync f8 0 2024-08-01T06:56:08.781 INFO:tasks.workunit.client.1.smithi089.stdout:2/914: write d7/d1f/d52/d6e/f75 [4030165,75418] 0 2024-08-01T06:56:08.782 INFO:tasks.workunit.client.1.smithi089.stdout:9/873: fdatasync d18/d33/d49/d7b/d81/fe5 0 2024-08-01T06:56:08.782 INFO:tasks.workunit.client.1.smithi089.stdout:3/883: dread d7/d32/f64 [0,4194304] 0 2024-08-01T06:56:08.784 INFO:tasks.workunit.client.1.smithi089.stdout:3/884: fsync d7/d32/d12/d29/d39/fe0 0 2024-08-01T06:56:08.785 INFO:tasks.workunit.client.1.smithi089.stdout:3/885: dread - d7/d32/d9f/fe6 zero size 2024-08-01T06:56:08.786 INFO:tasks.workunit.client.1.smithi089.stdout:9/874: unlink d18/d33/d49/d7b/d7f/d98/fc9 0 2024-08-01T06:56:08.786 INFO:tasks.workunit.client.1.smithi089.stdout:2/915: fsync d7/d19/d1e/f2e 0 2024-08-01T06:56:08.788 INFO:tasks.workunit.client.1.smithi089.stdout:3/886: unlink d7/d32/d4c/d69/l10e 0 2024-08-01T06:56:08.788 INFO:tasks.workunit.client.1.smithi089.stdout:2/916: write d7/d1f/d52/d72/dc0/ff6 [2942713,19168] 0 2024-08-01T06:56:08.795 INFO:tasks.workunit.client.1.smithi089.stdout:2/917: truncate d7/d19/d1e/fdd 132039 0 2024-08-01T06:56:08.796 INFO:tasks.workunit.client.1.smithi089.stdout:3/887: dwrite d7/d32/d4c/d69/d6d/dc7/fe2 [0,4194304] 0 2024-08-01T06:56:08.800 INFO:tasks.workunit.client.1.smithi089.stdout:3/888: creat d7/d68/d50/d6f/d2f/da2/f12a x:0 0 0 2024-08-01T06:56:08.804 INFO:tasks.workunit.client.1.smithi089.stdout:2/918: dwrite d7/d19/dc5/d10b/f112 [0,4194304] 0 2024-08-01T06:56:08.807 INFO:tasks.workunit.client.1.smithi089.stdout:2/919: chown d7/d19/d3b/c63 1 1 2024-08-01T06:56:08.811 INFO:tasks.workunit.client.1.smithi089.stdout:9/875: dread d18/d22/d45/daa/fcf [0,4194304] 0 2024-08-01T06:56:08.812 INFO:tasks.workunit.client.1.smithi089.stdout:3/889: dwrite d7/d32/d12/d29/d39/d4b/d83/f9b [0,4194304] 0 2024-08-01T06:56:08.814 INFO:tasks.workunit.client.1.smithi089.stdout:0/946: sync 2024-08-01T06:56:08.814 INFO:tasks.workunit.client.1.smithi089.stdout:2/920: creat d7/d1f/d29/d48/f120 x:0 0 0 2024-08-01T06:56:08.816 INFO:tasks.workunit.client.1.smithi089.stdout:3/890: mknod d7/d32/d12/d29/d39/d4b/dd2/c12b 0 2024-08-01T06:56:08.816 INFO:tasks.workunit.client.1.smithi089.stdout:2/921: write d7/d1f/f4b [4000577,128139] 0 2024-08-01T06:56:08.818 INFO:tasks.workunit.client.1.smithi089.stdout:0/947: mknod d9/d40/d25/d46/d91/d2e/d44/d53/d9f/c12c 0 2024-08-01T06:56:08.822 INFO:tasks.workunit.client.1.smithi089.stdout:2/922: rename d7/d1f/d28/l5f to d7/d4a/l121 0 2024-08-01T06:56:08.823 INFO:tasks.workunit.client.1.smithi089.stdout:9/876: truncate d18/d22/f9d 3166358 0 2024-08-01T06:56:08.825 INFO:tasks.workunit.client.1.smithi089.stdout:3/891: rename d7/d32/d4c/d69/d6d/dc7/fed to d7/d32/d12/d29/d39/d4b/dd2/f12c 0 2024-08-01T06:56:08.826 INFO:tasks.workunit.client.1.smithi089.stdout:0/948: dwrite d9/d40/d25/d46/d91/d2e/d44/d72/fc2 [0,4194304] 0 2024-08-01T06:56:08.827 INFO:tasks.workunit.client.0.smithi016.stdout:8/54: sync 2024-08-01T06:56:08.829 INFO:tasks.workunit.client.1.smithi089.stdout:0/949: creat d9/d40/d45/dc1/f12d x:0 0 0 2024-08-01T06:56:08.829 INFO:tasks.workunit.client.0.smithi016.stdout:8/55: mkdir d5/dc 0 2024-08-01T06:56:08.829 INFO:tasks.workunit.client.0.smithi016.stdout:8/56: truncate - no filename 2024-08-01T06:56:08.829 INFO:tasks.workunit.client.0.smithi016.stdout:8/57: dwrite - no filename 2024-08-01T06:56:08.830 INFO:tasks.workunit.client.0.smithi016.stdout:8/58: creat d5/d8/fd x:0 0 0 2024-08-01T06:56:08.832 INFO:tasks.workunit.client.1.smithi089.stdout:9/877: dwrite d18/d33/d3b/fe7 [0,4194304] 0 2024-08-01T06:56:08.835 INFO:tasks.workunit.client.1.smithi089.stdout:3/892: dwrite d7/d32/d4c/d67/d72/d91/dcb/da9/fde [0,4194304] 0 2024-08-01T06:56:08.835 INFO:tasks.workunit.client.1.smithi089.stdout:0/950: unlink d9/d40/d25/d46/d91/d2e/d44/f110 0 2024-08-01T06:56:08.837 INFO:tasks.workunit.client.1.smithi089.stdout:0/951: chown d9/d40/l6d 25 1 2024-08-01T06:56:08.841 INFO:tasks.workunit.client.0.smithi016.stdout:8/59: link l0 d5/dc/le 0 2024-08-01T06:56:08.842 INFO:tasks.workunit.client.1.smithi089.stdout:3/893: fdatasync d7/d32/d4c/d67/db4/ddc/fe3 0 2024-08-01T06:56:08.843 INFO:tasks.workunit.client.1.smithi089.stdout:3/894: dread - d7/d32/d12/d1b/fd3 zero size 2024-08-01T06:56:08.850 INFO:tasks.workunit.client.1.smithi089.stdout:3/895: dwrite d7/d32/d4c/fca [4194304,4194304] 0 2024-08-01T06:56:08.853 INFO:tasks.workunit.client.1.smithi089.stdout:3/896: mknod d7/d32/d4c/d67/d72/d91/dcb/dbc/c12d 0 2024-08-01T06:56:08.854 INFO:tasks.workunit.client.0.smithi016.stdout:8/60: getdents d5/d8 0 2024-08-01T06:56:08.855 INFO:tasks.workunit.client.1.smithi089.stdout:3/897: truncate d7/d68/d50/d6f/d46/dd1/f10b 242756 0 2024-08-01T06:56:08.859 INFO:tasks.workunit.client.1.smithi089.stdout:3/898: creat d7/d68/d50/d6f/d46/f12e x:0 0 0 2024-08-01T06:56:08.860 INFO:tasks.workunit.client.0.smithi016.stdout:8/61: link c2 d5/dc/cf 0 2024-08-01T06:56:08.861 INFO:tasks.workunit.client.1.smithi089.stdout:0/952: write d9/d40/d25/d46/f3d [245243,125190] 0 2024-08-01T06:56:08.865 INFO:tasks.workunit.client.0.smithi016.stdout:8/62: rename l0 to d5/l10 0 2024-08-01T06:56:08.865 INFO:tasks.workunit.client.1.smithi089.stdout:9/878: dwrite d18/d33/d49/d7b/f5d [0,4194304] 0 2024-08-01T06:56:08.865 INFO:tasks.workunit.client.0.smithi016.stdout:8/63: read - d5/d8/fd zero size 2024-08-01T06:56:08.867 INFO:tasks.workunit.client.1.smithi089.stdout:3/899: getdents d7/d68 0 2024-08-01T06:56:08.867 INFO:tasks.workunit.client.1.smithi089.stdout:0/953: creat d9/d40/d95/d99/dec/f12e x:0 0 0 2024-08-01T06:56:08.870 INFO:tasks.workunit.client.1.smithi089.stdout:3/900: chown d7/d68/d50/d6f/d2f/da2/da8/lcc 20 1 2024-08-01T06:56:08.871 INFO:tasks.workunit.client.1.smithi089.stdout:0/954: chown d9/d40/d25/d46/d91/d2e/d3a/f97 706 1 2024-08-01T06:56:08.873 INFO:tasks.workunit.client.1.smithi089.stdout:0/955: stat d9/d40/d45/d47/da8/d10c/d11b 0 2024-08-01T06:56:08.874 INFO:tasks.workunit.client.1.smithi089.stdout:3/901: creat d7/d68/d50/d6f/d2f/f12f x:0 0 0 2024-08-01T06:56:08.874 INFO:tasks.workunit.client.1.smithi089.stdout:9/879: dwrite d18/d33/d49/d7b/f11d [0,4194304] 0 2024-08-01T06:56:08.875 INFO:tasks.workunit.client.0.smithi016.stdout:8/64: dwrite d5/d8/fd [0,4194304] 0 2024-08-01T06:56:08.875 INFO:tasks.workunit.client.1.smithi089.stdout:0/956: stat d9/d40/d25/d46/d91/d64/d8c/c98 0 2024-08-01T06:56:08.876 INFO:tasks.workunit.client.1.smithi089.stdout:3/902: chown d7/d32/d4c/d67/d72/d91/dcb/da9 3116 1 2024-08-01T06:56:08.876 INFO:tasks.workunit.client.0.smithi016.stdout:8/65: read d5/d8/fd [2864359,127020] 0 2024-08-01T06:56:08.879 INFO:tasks.workunit.client.1.smithi089.stdout:9/880: chown d18/f23 95898 1 2024-08-01T06:56:08.881 INFO:tasks.workunit.client.1.smithi089.stdout:0/957: mknod d9/d40/d25/d46/d91/d2e/d44/d53/d9f/c12f 0 2024-08-01T06:56:08.884 INFO:tasks.workunit.client.1.smithi089.stdout:9/881: rename d18/d33/d3b/f69 to d18/d22/da2/f120 0 2024-08-01T06:56:08.884 INFO:tasks.workunit.client.1.smithi089.stdout:0/958: mknod d9/d40/d119/c130 0 2024-08-01T06:56:08.886 INFO:tasks.workunit.client.1.smithi089.stdout:9/882: readlink d18/d22/d39/l71 0 2024-08-01T06:56:08.886 INFO:tasks.workunit.client.1.smithi089.stdout:3/903: dwrite d7/d32/d4c/d69/f2e [0,4194304] 0 2024-08-01T06:56:08.887 INFO:tasks.workunit.client.1.smithi089.stdout:9/883: readlink d18/d33/d49/d7b/l8a 0 2024-08-01T06:56:08.888 INFO:tasks.workunit.client.1.smithi089.stdout:0/959: creat d9/d40/d45/dc1/f131 x:0 0 0 2024-08-01T06:56:08.889 INFO:tasks.workunit.client.1.smithi089.stdout:3/904: read d7/d68/d50/d6f/d2f/da2/da8/fe7 [1919036,68823] 0 2024-08-01T06:56:08.890 INFO:tasks.workunit.client.1.smithi089.stdout:0/960: symlink d9/l132 0 2024-08-01T06:56:08.892 INFO:tasks.workunit.client.1.smithi089.stdout:3/905: mkdir d7/d32/d4c/d53/d5f/d130 0 2024-08-01T06:56:08.893 INFO:tasks.workunit.client.1.smithi089.stdout:3/906: write d7/d32/d4c/d69/fb9 [4345389,63099] 0 2024-08-01T06:56:08.896 INFO:tasks.workunit.client.1.smithi089.stdout:3/907: unlink d7/d68/d50/f106 0 2024-08-01T06:56:08.900 INFO:tasks.workunit.client.0.smithi016.stdout:8/66: write d5/d8/fd [4304036,130069] 0 2024-08-01T06:56:08.902 INFO:tasks.workunit.client.0.smithi016.stdout:8/67: creat d5/f11 x:0 0 0 2024-08-01T06:56:08.902 INFO:tasks.workunit.client.0.smithi016.stdout:8/68: dread - d5/f11 zero size 2024-08-01T06:56:08.904 INFO:tasks.workunit.client.0.smithi016.stdout:8/69: creat d5/f12 x:0 0 0 2024-08-01T06:56:08.907 INFO:tasks.workunit.client.0.smithi016.stdout:8/70: symlink d5/dc/l13 0 2024-08-01T06:56:08.908 INFO:tasks.workunit.client.0.smithi016.stdout:8/71: symlink d5/dc/l14 0 2024-08-01T06:56:08.909 INFO:tasks.workunit.client.0.smithi016.stdout:8/72: symlink d5/l15 0 2024-08-01T06:56:08.910 INFO:tasks.workunit.client.1.smithi089.stdout:0/961: dread d9/d40/d45/d47/da8/fac [0,4194304] 0 2024-08-01T06:56:08.911 INFO:tasks.workunit.client.0.smithi016.stdout:8/73: mknod d5/dc/c16 0 2024-08-01T06:56:08.911 INFO:tasks.workunit.client.0.smithi016.stdout:8/74: dread - d5/f11 zero size 2024-08-01T06:56:08.912 INFO:tasks.workunit.client.1.smithi089.stdout:0/962: mkdir d9/d40/d25/d46/d91/d2e/d44/d72/d133 0 2024-08-01T06:56:08.913 INFO:tasks.workunit.client.1.smithi089.stdout:3/908: dread d7/d32/d4c/d53/f99 [0,4194304] 0 2024-08-01T06:56:08.915 INFO:tasks.workunit.client.1.smithi089.stdout:0/963: symlink d9/d40/d25/d46/d91/d2e/d44/d53/daf/l134 0 2024-08-01T06:56:08.917 INFO:tasks.workunit.client.1.smithi089.stdout:3/909: rename d7/d68/d50/d6f/d2f/da2/cc3 to d7/d32/d4c/d53/d5f/c131 0 2024-08-01T06:56:08.918 INFO:tasks.workunit.client.1.smithi089.stdout:3/910: stat d7/d32/d4c/d53 0 2024-08-01T06:56:08.919 INFO:tasks.workunit.client.0.smithi016.stdout:8/75: dwrite d5/f12 [0,4194304] 0 2024-08-01T06:56:08.919 INFO:tasks.workunit.client.0.smithi016.stdout:8/76: chown d5 5 1 2024-08-01T06:56:08.920 INFO:tasks.workunit.client.1.smithi089.stdout:3/911: fsync d7/fb0 0 2024-08-01T06:56:08.922 INFO:tasks.workunit.client.1.smithi089.stdout:0/964: dwrite d9/d40/d25/d46/d91/d2e/d3a/d76/d123/f12a [0,4194304] 0 2024-08-01T06:56:08.923 INFO:tasks.workunit.client.1.smithi089.stdout:9/884: dread d18/d33/d49/d7b/d81/f90 [4194304,4194304] 0 2024-08-01T06:56:08.924 INFO:tasks.workunit.client.1.smithi089.stdout:3/912: fsync d7/f71 0 2024-08-01T06:56:08.927 INFO:tasks.workunit.client.1.smithi089.stdout:9/885: unlink d18/d33/d53/l7d 0 2024-08-01T06:56:08.927 INFO:tasks.workunit.client.1.smithi089.stdout:3/913: write d7/d68/d50/d6f/d2f/d9c/fc8 [157460,123764] 0 2024-08-01T06:56:08.932 INFO:tasks.workunit.client.1.smithi089.stdout:9/886: mkdir d18/d33/d121 0 2024-08-01T06:56:08.933 INFO:tasks.workunit.client.1.smithi089.stdout:0/965: link d9/d40/d25/d46/ff3 d9/d40/d25/d46/d91/d2e/d44/d53/f135 0 2024-08-01T06:56:08.936 INFO:tasks.workunit.client.1.smithi089.stdout:9/887: mknod d18/c122 0 2024-08-01T06:56:08.937 INFO:tasks.workunit.client.1.smithi089.stdout:9/888: dread d18/d22/fca [0,4194304] 0 2024-08-01T06:56:08.943 INFO:tasks.workunit.client.1.smithi089.stdout:9/889: dwrite d18/d22/fca [0,4194304] 0 2024-08-01T06:56:08.945 INFO:tasks.workunit.client.1.smithi089.stdout:0/966: write d9/d40/d95/d99/f3e [230108,45549] 0 2024-08-01T06:56:08.947 INFO:tasks.workunit.client.1.smithi089.stdout:0/967: write d9/d40/d45/dc1/f131 [75409,55175] 0 2024-08-01T06:56:08.949 INFO:tasks.workunit.client.1.smithi089.stdout:0/968: mkdir d9/d40/d25/d46/d136 0 2024-08-01T06:56:08.950 INFO:tasks.workunit.client.1.smithi089.stdout:3/914: dread d7/d32/d4c/d67/d72/d91/dcb/f87 [0,4194304] 0 2024-08-01T06:56:08.951 INFO:tasks.workunit.client.1.smithi089.stdout:2/923: sync 2024-08-01T06:56:08.952 INFO:tasks.workunit.client.1.smithi089.stdout:0/969: chown d9/c4e 60506 1 2024-08-01T06:56:08.954 INFO:tasks.workunit.client.1.smithi089.stdout:3/915: creat d7/d32/d4c/d67/db4/ddc/f132 x:0 0 0 2024-08-01T06:56:08.956 INFO:tasks.workunit.client.1.smithi089.stdout:2/924: creat d7/d19/f122 x:0 0 0 2024-08-01T06:56:08.957 INFO:tasks.workunit.client.1.smithi089.stdout:3/916: creat d7/d32/d4c/d53/d5f/f133 x:0 0 0 2024-08-01T06:56:08.958 INFO:tasks.workunit.client.1.smithi089.stdout:2/925: write d7/d1f/d52/d6e/f9d [1237813,102576] 0 2024-08-01T06:56:08.958 INFO:tasks.workunit.client.1.smithi089.stdout:2/926: stat d7/d19/d1e/f2e 0 2024-08-01T06:56:09.035 INFO:tasks.workunit.client.0.smithi016.stdout:5/39: sync 2024-08-01T06:56:09.035 INFO:tasks.workunit.client.0.smithi016.stdout:5/40: fsync d1/fb 0 2024-08-01T06:56:09.035 INFO:tasks.workunit.client.0.smithi016.stdout:5/41: read - d1/fb zero size 2024-08-01T06:56:09.036 INFO:tasks.workunit.client.0.smithi016.stdout:5/42: chown d1/fb 821 1 2024-08-01T06:56:09.037 INFO:tasks.workunit.client.0.smithi016.stdout:5/43: write d1/fb [919424,42285] 0 2024-08-01T06:56:09.044 INFO:tasks.workunit.client.0.smithi016.stdout:5/44: dread d1/fb [0,4194304] 0 2024-08-01T06:56:09.045 INFO:tasks.workunit.client.0.smithi016.stdout:5/45: write d1/fc [231760,117289] 0 2024-08-01T06:56:09.045 INFO:tasks.workunit.client.0.smithi016.stdout:5/46: chown d1/d2/c3 219 1 2024-08-01T06:56:09.053 INFO:tasks.workunit.client.0.smithi016.stdout:5/47: dwrite d1/d2/d6/fd [0,4194304] 0 2024-08-01T06:56:09.054 INFO:tasks.workunit.client.0.smithi016.stdout:5/48: fdatasync d1/f5 0 2024-08-01T06:56:09.057 INFO:tasks.workunit.client.0.smithi016.stdout:5/49: dread d1/fc [0,4194304] 0 2024-08-01T06:56:09.062 INFO:tasks.workunit.client.1.smithi089.stdout:2/927: rename d7/d1f/f6c to d7/d19/d1e/f123 0 2024-08-01T06:56:09.064 INFO:tasks.workunit.client.1.smithi089.stdout:2/928: rmdir d7/dd7 39 2024-08-01T06:56:09.065 INFO:tasks.workunit.client.1.smithi089.stdout:0/970: dwrite d9/d40/d45/d47/f5c [0,4194304] 0 2024-08-01T06:56:09.065 INFO:tasks.workunit.client.0.smithi016.stdout:5/50: dwrite d1/d2/d6/fd [0,4194304] 0 2024-08-01T06:56:09.066 INFO:tasks.workunit.client.1.smithi089.stdout:3/917: dwrite d7/d32/d12/df3/f109 [0,4194304] 0 2024-08-01T06:56:09.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:08 smithi089 ceph-mon[36617]: pgmap v18: 65 pgs: 65 active+clean; 1.7 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 67 MiB/s rd, 184 MiB/s wr, 410 op/s 2024-08-01T06:56:09.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:08 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:56:09.140 INFO:tasks.workunit.client.1.smithi089.stdout:3/918: creat d7/d68/d50/d119/f134 x:0 0 0 2024-08-01T06:56:09.143 INFO:tasks.workunit.client.1.smithi089.stdout:2/929: creat d7/d19/dc5/dcc/d106/f124 x:0 0 0 2024-08-01T06:56:09.145 INFO:tasks.workunit.client.0.smithi016.stdout:6/99: sync 2024-08-01T06:56:09.148 INFO:tasks.workunit.client.1.smithi089.stdout:0/971: rmdir d9/d40/d25/d46/d91/d2e/d44/d72/d133 0 2024-08-01T06:56:09.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:08 smithi016 ceph-mon[29266]: pgmap v18: 65 pgs: 65 active+clean; 1.7 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 67 MiB/s rd, 184 MiB/s wr, 410 op/s 2024-08-01T06:56:09.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:08 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:56:09.155 INFO:tasks.workunit.client.1.smithi089.stdout:3/919: dread d7/d32/f4e [0,4194304] 0 2024-08-01T06:56:09.161 INFO:tasks.workunit.client.0.smithi016.stdout:6/100: dwrite d1/d9/fb [0,4194304] 0 2024-08-01T06:56:09.164 INFO:tasks.workunit.client.1.smithi089.stdout:0/972: dread d9/d40/d45/db7/ff5 [0,4194304] 0 2024-08-01T06:56:09.166 INFO:tasks.workunit.client.0.smithi016.stdout:6/101: symlink d1/d8/d1b/l26 0 2024-08-01T06:56:09.169 INFO:tasks.workunit.client.1.smithi089.stdout:9/890: sync 2024-08-01T06:56:09.169 INFO:tasks.workunit.client.0.smithi016.stdout:6/102: rmdir d1 39 2024-08-01T06:56:09.171 INFO:tasks.workunit.client.1.smithi089.stdout:9/891: truncate d18/d22/d39/d50/f77 4774116 0 2024-08-01T06:56:09.177 INFO:tasks.workunit.client.1.smithi089.stdout:9/892: creat d18/d33/df7/d11f/f123 x:0 0 0 2024-08-01T06:56:09.177 INFO:tasks.workunit.client.0.smithi016.stdout:6/103: dread d1/d9/fb [0,4194304] 0 2024-08-01T06:56:09.177 INFO:tasks.workunit.client.1.smithi089.stdout:9/893: chown d18/d22/d39/d95/fee 418 1 2024-08-01T06:56:09.181 INFO:tasks.workunit.client.0.smithi016.stdout:6/104: getdents d1/d8/d1b/d22 0 2024-08-01T06:56:09.186 INFO:tasks.workunit.client.1.smithi089.stdout:0/973: dread d9/d40/d95/d99/f34 [0,4194304] 0 2024-08-01T06:56:09.192 INFO:tasks.workunit.client.1.smithi089.stdout:0/974: dwrite d9/d40/d25/d46/d91/d2e/d44/d72/d8b/fe6 [0,4194304] 0 2024-08-01T06:56:09.197 INFO:tasks.workunit.client.1.smithi089.stdout:0/975: creat d9/d40/d45/d47/da8/d10c/f137 x:0 0 0 2024-08-01T06:56:09.208 INFO:tasks.workunit.client.1.smithi089.stdout:9/894: creat d18/d33/d49/d7b/d81/f124 x:0 0 0 2024-08-01T06:56:09.214 INFO:tasks.workunit.client.1.smithi089.stdout:9/895: dwrite d18/f94 [0,4194304] 0 2024-08-01T06:56:09.223 INFO:tasks.workunit.client.0.smithi016.stdout:5/51: dwrite d1/f5 [0,4194304] 0 2024-08-01T06:56:09.226 INFO:tasks.workunit.client.0.smithi016.stdout:5/52: chown d1/d2/d6/l8 967 1 2024-08-01T06:56:09.227 INFO:tasks.workunit.client.0.smithi016.stdout:5/53: truncate d1/fb 1045727 0 2024-08-01T06:56:09.230 INFO:tasks.workunit.client.0.smithi016.stdout:5/54: unlink d1/fc 0 2024-08-01T06:56:09.231 INFO:tasks.workunit.client.0.smithi016.stdout:5/55: chown d1/d2/d6/d9/la 3 1 2024-08-01T06:56:09.233 INFO:tasks.workunit.client.1.smithi089.stdout:9/896: dread d18/d33/d49/d7b/d7f/d98/d9f/d8e/fa7 [0,4194304] 0 2024-08-01T06:56:09.235 INFO:tasks.workunit.client.1.smithi089.stdout:9/897: write d18/d22/d45/daa/ff9 [672637,97004] 0 2024-08-01T06:56:09.237 INFO:tasks.workunit.client.1.smithi089.stdout:9/898: read d18/d33/f37 [49630,4777] 0 2024-08-01T06:56:09.240 INFO:tasks.workunit.client.1.smithi089.stdout:9/899: creat d18/d33/d3b/f125 x:0 0 0 2024-08-01T06:56:09.242 INFO:tasks.workunit.client.1.smithi089.stdout:9/900: creat d18/d22/d39/d95/f126 x:0 0 0 2024-08-01T06:56:09.244 INFO:tasks.workunit.client.1.smithi089.stdout:9/901: dread d18/d33/f62 [0,4194304] 0 2024-08-01T06:56:09.247 INFO:tasks.workunit.client.1.smithi089.stdout:9/902: creat d18/d22/d39/f127 x:0 0 0 2024-08-01T06:56:09.248 INFO:tasks.workunit.client.1.smithi089.stdout:9/903: getdents d18/d33/d49/dd3 0 2024-08-01T06:56:09.249 INFO:tasks.workunit.client.1.smithi089.stdout:9/904: chown d18/d33/d102/f108 21 1 2024-08-01T06:56:09.252 INFO:tasks.workunit.client.1.smithi089.stdout:3/920: unlink d7/d32/l6b 0 2024-08-01T06:56:09.255 INFO:tasks.workunit.client.1.smithi089.stdout:9/905: link d18/d22/d45/c67 d18/d33/d49/d7b/d7f/d98/d9f/d8e/c128 0 2024-08-01T06:56:09.256 INFO:tasks.workunit.client.1.smithi089.stdout:2/930: mknod d7/d19/c125 0 2024-08-01T06:56:09.259 INFO:tasks.workunit.client.1.smithi089.stdout:3/921: dwrite d7/d32/d12/d29/d39/f126 [0,4194304] 0 2024-08-01T06:56:09.261 INFO:tasks.workunit.client.1.smithi089.stdout:3/922: fdatasync d7/d32/d4c/d69/f2e 0 2024-08-01T06:56:09.262 INFO:tasks.workunit.client.1.smithi089.stdout:2/931: symlink d7/d1f/d29/d48/da9/de2/l126 0 2024-08-01T06:56:09.262 INFO:tasks.workunit.client.1.smithi089.stdout:3/923: chown d7/d32/l22 6420850 1 2024-08-01T06:56:09.262 INFO:tasks.workunit.client.0.smithi016.stdout:5/56: getdents d1 0 2024-08-01T06:56:09.267 INFO:tasks.workunit.client.0.smithi016.stdout:5/57: write d1/fb [267587,3072] 0 2024-08-01T06:56:09.268 INFO:tasks.workunit.client.0.smithi016.stdout:5/58: write d1/fb [1611372,41557] 0 2024-08-01T06:56:09.271 INFO:tasks.workunit.client.1.smithi089.stdout:9/906: truncate d18/d33/d49/d7b/d7f/d98/d9f/d8e/f96 1991440 0 2024-08-01T06:56:09.271 INFO:tasks.workunit.client.1.smithi089.stdout:9/907: readlink d18/d33/d3b/dc8/ldd 0 2024-08-01T06:56:09.273 INFO:tasks.workunit.client.1.smithi089.stdout:9/908: mkdir d18/d33/df7/d11f/d129 0 2024-08-01T06:56:09.273 INFO:tasks.workunit.client.1.smithi089.stdout:2/932: rmdir d7/d1f/d29/d48 39 2024-08-01T06:56:09.275 INFO:tasks.workunit.client.1.smithi089.stdout:3/924: truncate d7/d68/d50/d6f/d2f/d9c/f9d 1775658 0 2024-08-01T06:56:09.275 INFO:tasks.workunit.client.0.smithi016.stdout:5/59: dwrite d1/fb [0,4194304] 0 2024-08-01T06:56:09.277 INFO:tasks.workunit.client.1.smithi089.stdout:9/909: creat d18/d33/df7/f12a x:0 0 0 2024-08-01T06:56:09.279 INFO:tasks.workunit.client.1.smithi089.stdout:2/933: creat d7/d1f/f127 x:0 0 0 2024-08-01T06:56:09.279 INFO:tasks.workunit.client.1.smithi089.stdout:9/910: write d18/d33/d6e/dd1/f116 [995471,86797] 0 2024-08-01T06:56:09.283 INFO:tasks.workunit.client.1.smithi089.stdout:2/934: symlink d7/d19/dc5/d10b/l128 0 2024-08-01T06:56:09.283 INFO:tasks.workunit.client.0.smithi016.stdout:5/60: dwrite d1/fb [0,4194304] 0 2024-08-01T06:56:09.287 INFO:tasks.workunit.client.1.smithi089.stdout:9/911: dread d18/d33/f61 [0,4194304] 0 2024-08-01T06:56:09.288 INFO:tasks.workunit.client.0.smithi016.stdout:5/61: dread d1/f5 [0,4194304] 0 2024-08-01T06:56:09.288 INFO:tasks.workunit.client.1.smithi089.stdout:9/912: chown d18/d33/df7 0 1 2024-08-01T06:56:09.290 INFO:tasks.workunit.client.1.smithi089.stdout:9/913: stat ff 0 2024-08-01T06:56:09.292 INFO:tasks.workunit.client.1.smithi089.stdout:3/925: dwrite d7/f71 [0,4194304] 0 2024-08-01T06:56:09.295 INFO:tasks.workunit.client.1.smithi089.stdout:9/914: creat d18/d33/d49/d7b/d4b/db6/f12b x:0 0 0 2024-08-01T06:56:09.295 INFO:tasks.workunit.client.1.smithi089.stdout:2/935: dwrite d7/d1f/d29/f1a [0,4194304] 0 2024-08-01T06:56:09.298 INFO:tasks.workunit.client.0.smithi016.stdout:5/62: dwrite d1/f5 [4194304,4194304] 0 2024-08-01T06:56:09.300 INFO:tasks.workunit.client.1.smithi089.stdout:2/936: read d7/d19/d3b/d7c/ffc [2880,27796] 0 2024-08-01T06:56:09.304 INFO:tasks.workunit.client.0.smithi016.stdout:5/63: symlink d1/d2/d6/d9/lf 0 2024-08-01T06:56:09.309 INFO:tasks.workunit.client.0.smithi016.stdout:5/64: creat d1/d2/f10 x:0 0 0 2024-08-01T06:56:09.313 INFO:tasks.workunit.client.1.smithi089.stdout:9/915: link d18/f7e d18/d33/d49/d7b/f12c 0 2024-08-01T06:56:09.313 INFO:tasks.workunit.client.1.smithi089.stdout:9/916: chown d18/d22/da2 2 1 2024-08-01T06:56:09.315 INFO:tasks.workunit.client.1.smithi089.stdout:3/926: dwrite d7/d32/d4c/d67/d72/d91/f121 [0,4194304] 0 2024-08-01T06:56:09.315 INFO:tasks.workunit.client.1.smithi089.stdout:9/917: write f13 [3471670,125497] 0 2024-08-01T06:56:09.318 INFO:tasks.workunit.client.1.smithi089.stdout:9/918: unlink d18/d22/d39/l70 0 2024-08-01T06:56:09.319 INFO:tasks.workunit.client.0.smithi016.stdout:5/65: dwrite d1/d2/d6/fd [0,4194304] 0 2024-08-01T06:56:09.319 INFO:tasks.workunit.client.1.smithi089.stdout:9/919: write d18/d33/df7/d11f/f123 [520985,54221] 0 2024-08-01T06:56:09.321 INFO:tasks.workunit.client.1.smithi089.stdout:3/927: mkdir d7/d68/d50/d6f/d2f/d9c/d135 0 2024-08-01T06:56:09.321 INFO:tasks.workunit.client.1.smithi089.stdout:2/937: dread d7/d19/dc5/dcc/fb8 [0,4194304] 0 2024-08-01T06:56:09.322 INFO:tasks.workunit.client.1.smithi089.stdout:3/928: write d7/d32/d4c/d69/f103 [617722,121661] 0 2024-08-01T06:56:09.322 INFO:tasks.workunit.client.1.smithi089.stdout:9/920: symlink d18/d22/d45/l12d 0 2024-08-01T06:56:09.323 INFO:tasks.workunit.client.1.smithi089.stdout:2/938: readlink d7/d1f/d29/l9a 0 2024-08-01T06:56:09.326 INFO:tasks.workunit.client.0.smithi016.stdout:5/66: dread d1/d2/d6/fd [0,4194304] 0 2024-08-01T06:56:09.329 INFO:tasks.workunit.client.1.smithi089.stdout:2/939: symlink d7/d19/dc5/dcc/d106/l129 0 2024-08-01T06:56:09.330 INFO:tasks.workunit.client.1.smithi089.stdout:9/921: mknod d18/d33/df7/da6/c12e 0 2024-08-01T06:56:09.331 INFO:tasks.workunit.client.1.smithi089.stdout:2/940: chown d7/l98 174242120 1 2024-08-01T06:56:09.332 INFO:tasks.workunit.client.0.smithi016.stdout:4/41: sync 2024-08-01T06:56:09.335 INFO:tasks.workunit.client.0.smithi016.stdout:4/42: mknod d0/d2/cd 0 2024-08-01T06:56:09.337 INFO:tasks.workunit.client.0.smithi016.stdout:4/43: mknod d0/ce 0 2024-08-01T06:56:09.339 INFO:tasks.workunit.client.1.smithi089.stdout:2/941: rename d7/d19/l61 to d7/d1f/d29/d48/da9/l12a 0 2024-08-01T06:56:09.341 INFO:tasks.workunit.client.0.smithi016.stdout:4/44: fsync d0/d2/f4 0 2024-08-01T06:56:09.343 INFO:tasks.workunit.client.0.smithi016.stdout:5/67: fsync d1/d2/d6/fd 0 2024-08-01T06:56:09.344 INFO:tasks.workunit.client.0.smithi016.stdout:5/68: chown d1/d2/d6/d9 5272 1 2024-08-01T06:56:09.345 INFO:tasks.workunit.client.0.smithi016.stdout:4/45: rename d0/f5 to d0/d2/dc/ff 0 2024-08-01T06:56:09.345 INFO:tasks.workunit.client.0.smithi016.stdout:5/69: rename d1 to d1/d2/d6/d9/d11 22 2024-08-01T06:56:09.347 INFO:tasks.workunit.client.1.smithi089.stdout:9/922: getdents d18/d22/d45 0 2024-08-01T06:56:09.348 INFO:tasks.workunit.client.1.smithi089.stdout:2/942: dread d7/d1f/d52/d6e/f9d [0,4194304] 0 2024-08-01T06:56:09.349 INFO:tasks.workunit.client.0.smithi016.stdout:5/70: mkdir d1/d12 0 2024-08-01T06:56:09.351 INFO:tasks.workunit.client.1.smithi089.stdout:2/943: chown d7/d1f/d29/d48/cb3 481818 1 2024-08-01T06:56:09.351 INFO:tasks.workunit.client.0.smithi016.stdout:4/46: symlink d0/d2/dc/l10 0 2024-08-01T06:56:09.351 INFO:tasks.workunit.client.1.smithi089.stdout:0/976: sync 2024-08-01T06:56:09.353 INFO:tasks.workunit.client.1.smithi089.stdout:2/944: chown d7/d19/d3b/l66 15404 1 2024-08-01T06:56:09.353 INFO:tasks.workunit.client.0.smithi016.stdout:5/71: link d1/fb d1/d2/d6/d9/f13 0 2024-08-01T06:56:09.354 INFO:tasks.workunit.client.1.smithi089.stdout:9/923: dwrite d18/d33/d3b/fc6 [0,4194304] 0 2024-08-01T06:56:09.354 INFO:tasks.workunit.client.1.smithi089.stdout:3/929: dwrite d7/d32/d12/d29/f77 [0,4194304] 0 2024-08-01T06:56:09.358 INFO:tasks.workunit.client.1.smithi089.stdout:2/945: fsync d7/d19/d1e/f54 0 2024-08-01T06:56:09.359 INFO:tasks.workunit.client.1.smithi089.stdout:3/930: write d7/d68/d50/d6f/f58 [5381263,71319] 0 2024-08-01T06:56:09.359 INFO:tasks.workunit.client.0.smithi016.stdout:5/72: dread d1/d2/d6/fd [0,4194304] 0 2024-08-01T06:56:09.360 INFO:tasks.workunit.client.1.smithi089.stdout:9/924: rename f4 to d18/d22/da2/f12f 0 2024-08-01T06:56:09.362 INFO:tasks.workunit.client.0.smithi016.stdout:5/73: mknod d1/d2/d6/d9/c14 0 2024-08-01T06:56:09.364 INFO:tasks.workunit.client.0.smithi016.stdout:5/74: truncate d1/d2/f10 144816 0 2024-08-01T06:56:09.366 INFO:tasks.workunit.client.1.smithi089.stdout:9/925: rename d18/d22/d39/f7c to d18/d22/d43/f130 0 2024-08-01T06:56:09.367 INFO:tasks.workunit.client.1.smithi089.stdout:2/946: dwrite d7/d19/fdb [0,4194304] 0 2024-08-01T06:56:09.370 INFO:tasks.workunit.client.1.smithi089.stdout:3/931: rename d7/d68/d50/d89 to d7/d68/d50/d6f/d2f/da2/da8/d129/d136 0 2024-08-01T06:56:09.371 INFO:tasks.workunit.client.1.smithi089.stdout:3/932: chown d7/d68/fc0 320709226 1 2024-08-01T06:56:09.372 INFO:tasks.workunit.client.1.smithi089.stdout:0/977: write d9/d40/d95/fdf [2198214,75059] 0 2024-08-01T06:56:09.373 INFO:tasks.workunit.client.0.smithi016.stdout:4/47: truncate d0/d2/dc/ff 42529 0 2024-08-01T06:56:09.374 INFO:tasks.workunit.client.0.smithi016.stdout:5/75: link d1/d2/d6/l8 d1/l15 0 2024-08-01T06:56:09.375 INFO:tasks.workunit.client.1.smithi089.stdout:2/947: symlink d7/d19/dc5/dcc/d64/d9c/daf/l12b 0 2024-08-01T06:56:09.376 INFO:tasks.workunit.client.1.smithi089.stdout:3/933: chown d7/d68/d50/d6f/d2f/d9c/f9d 10825837 1 2024-08-01T06:56:09.377 INFO:tasks.workunit.client.1.smithi089.stdout:0/978: creat d9/d40/d95/f138 x:0 0 0 2024-08-01T06:56:09.379 INFO:tasks.workunit.client.1.smithi089.stdout:9/926: dwrite d18/d33/f61 [0,4194304] 0 2024-08-01T06:56:09.379 INFO:tasks.workunit.client.1.smithi089.stdout:2/948: mknod d7/d19/dc5/dcc/c12c 0 2024-08-01T06:56:09.384 INFO:tasks.workunit.client.1.smithi089.stdout:3/934: rename d7/d32/d4c/d69/f62 to d7/d32/d12/d29/d39/d4b/deb/f137 0 2024-08-01T06:56:09.387 INFO:tasks.workunit.client.1.smithi089.stdout:9/927: rename d18/f6b to d18/d22/d39/d50/f131 0 2024-08-01T06:56:09.388 INFO:tasks.workunit.client.1.smithi089.stdout:0/979: dwrite d9/d40/d95/d99/dec/f12e [0,4194304] 0 2024-08-01T06:56:09.389 INFO:tasks.workunit.client.1.smithi089.stdout:3/935: creat d7/d32/d4c/d67/d72/d91/d117/f138 x:0 0 0 2024-08-01T06:56:09.390 INFO:tasks.workunit.client.1.smithi089.stdout:2/949: rename d7/d1f/d52/d6e/ldc to d7/d1f/d29/db7/l12d 0 2024-08-01T06:56:09.391 INFO:tasks.workunit.client.1.smithi089.stdout:0/980: unlink d9/c4e 0 2024-08-01T06:56:09.392 INFO:tasks.workunit.client.1.smithi089.stdout:0/981: write d9/d40/d95/d99/d2b/f48 [7371158,76556] 0 2024-08-01T06:56:09.392 INFO:tasks.workunit.client.1.smithi089.stdout:9/928: mknod d18/d22/d39/d50/c132 0 2024-08-01T06:56:09.394 INFO:tasks.workunit.client.1.smithi089.stdout:2/950: chown d7/ce 2042179024 1 2024-08-01T06:56:09.399 INFO:tasks.workunit.client.1.smithi089.stdout:0/982: creat d9/d40/d25/d46/d91/d2e/d3a/f139 x:0 0 0 2024-08-01T06:56:09.400 INFO:tasks.workunit.client.0.smithi016.stdout:5/76: truncate d1/f5 5724493 0 2024-08-01T06:56:09.402 INFO:tasks.workunit.client.1.smithi089.stdout:2/951: unlink d7/d19/d1e/d3d/d60/l65 0 2024-08-01T06:56:09.403 INFO:tasks.workunit.client.1.smithi089.stdout:0/983: mkdir d9/d40/d25/d46/d91/d2e/d44/d53/d9f/d13a 0 2024-08-01T06:56:09.406 INFO:tasks.workunit.client.1.smithi089.stdout:2/952: chown d7/l3c 22745104 1 2024-08-01T06:56:09.407 INFO:tasks.workunit.client.1.smithi089.stdout:0/984: creat d9/d40/d45/db7/f13b x:0 0 0 2024-08-01T06:56:09.407 INFO:tasks.workunit.client.0.smithi016.stdout:5/77: dwrite d1/d2/f10 [0,4194304] 0 2024-08-01T06:56:09.409 INFO:tasks.workunit.client.1.smithi089.stdout:9/929: getdents d18/d33/d3b/dc8 0 2024-08-01T06:56:09.413 INFO:tasks.workunit.client.0.smithi016.stdout:7/59: sync 2024-08-01T06:56:09.414 INFO:tasks.workunit.client.0.smithi016.stdout:7/60: write d7/db/f13 [920713,1307] 0 2024-08-01T06:56:09.416 INFO:tasks.workunit.client.0.smithi016.stdout:4/48: write d0/d2/dc/ff [1059889,36546] 0 2024-08-01T06:56:09.420 INFO:tasks.workunit.client.0.smithi016.stdout:7/61: dread d7/ff [0,4194304] 0 2024-08-01T06:56:09.422 INFO:tasks.workunit.client.0.smithi016.stdout:4/49: dread d0/f1 [0,4194304] 0 2024-08-01T06:56:09.424 INFO:tasks.workunit.client.0.smithi016.stdout:7/62: creat d7/db/d1a/da/f1b x:0 0 0 2024-08-01T06:56:09.425 INFO:tasks.workunit.client.0.smithi016.stdout:7/63: dread - d7/f11 zero size 2024-08-01T06:56:09.426 INFO:tasks.workunit.client.1.smithi089.stdout:3/936: dwrite d7/d68/d50/d6f/d2f/d9c/f9d [0,4194304] 0 2024-08-01T06:56:09.427 INFO:tasks.workunit.client.1.smithi089.stdout:9/930: dread d18/d22/f9d [0,4194304] 0 2024-08-01T06:56:09.428 INFO:tasks.workunit.client.0.smithi016.stdout:4/50: creat d0/d2/f11 x:0 0 0 2024-08-01T06:56:09.428 INFO:tasks.workunit.client.1.smithi089.stdout:0/985: write d9/d40/d25/d46/d91/d2e/d44/d72/fda [721870,96219] 0 2024-08-01T06:56:09.429 INFO:tasks.workunit.client.0.smithi016.stdout:7/64: mkdir d7/db/d1a/da/d1c 0 2024-08-01T06:56:09.429 INFO:tasks.workunit.client.1.smithi089.stdout:3/937: truncate d7/d68/d50/d119/f134 699399 0 2024-08-01T06:56:09.430 INFO:tasks.workunit.client.0.smithi016.stdout:5/78: link d1/f5 d1/d12/f16 0 2024-08-01T06:56:09.435 INFO:tasks.workunit.client.0.smithi016.stdout:4/51: unlink d0/f9 0 2024-08-01T06:56:09.437 INFO:tasks.workunit.client.1.smithi089.stdout:0/986: creat d9/d40/d45/dc1/f13c x:0 0 0 2024-08-01T06:56:09.437 INFO:tasks.workunit.client.0.smithi016.stdout:7/65: dwrite f6 [4194304,4194304] 0 2024-08-01T06:56:09.441 INFO:tasks.workunit.client.0.smithi016.stdout:7/66: dread f6 [4194304,4194304] 0 2024-08-01T06:56:09.443 INFO:tasks.workunit.client.0.smithi016.stdout:4/52: fdatasync d0/fb 0 2024-08-01T06:56:09.444 INFO:tasks.workunit.client.0.smithi016.stdout:7/67: dread d7/ff [0,4194304] 0 2024-08-01T06:56:09.447 INFO:tasks.workunit.client.0.smithi016.stdout:7/68: unlink c3 0 2024-08-01T06:56:09.447 INFO:tasks.workunit.client.0.smithi016.stdout:4/53: rmdir d0/d2 39 2024-08-01T06:56:09.449 INFO:tasks.workunit.client.0.smithi016.stdout:7/69: rmdir d7/db 39 2024-08-01T06:56:09.450 INFO:tasks.workunit.client.0.smithi016.stdout:4/54: truncate d0/f1 3018866 0 2024-08-01T06:56:09.452 INFO:tasks.workunit.client.0.smithi016.stdout:7/70: chown d7/db/d1a/da/dc/f15 29 1 2024-08-01T06:56:09.453 INFO:tasks.workunit.client.0.smithi016.stdout:7/71: write d7/db/f13 [1885960,98758] 0 2024-08-01T06:56:09.456 INFO:tasks.workunit.client.0.smithi016.stdout:4/55: dread d0/d2/dc/ff [0,4194304] 0 2024-08-01T06:56:09.458 INFO:tasks.workunit.client.0.smithi016.stdout:4/56: mkdir d0/d2/dc/d12 0 2024-08-01T06:56:09.460 INFO:tasks.workunit.client.0.smithi016.stdout:4/57: symlink d0/l13 0 2024-08-01T06:56:09.462 INFO:tasks.workunit.client.0.smithi016.stdout:5/79: write d1/d12/f16 [2686085,106141] 0 2024-08-01T06:56:09.466 INFO:tasks.workunit.client.0.smithi016.stdout:5/80: creat d1/d2/d6/f17 x:0 0 0 2024-08-01T06:56:09.467 INFO:tasks.workunit.client.0.smithi016.stdout:7/72: dread d7/db/f13 [0,4194304] 0 2024-08-01T06:56:09.468 INFO:tasks.workunit.client.0.smithi016.stdout:4/58: dwrite d0/d2/f11 [0,4194304] 0 2024-08-01T06:56:09.470 INFO:tasks.workunit.client.0.smithi016.stdout:7/73: mkdir d7/db/d1a/da/d1c/d1d 0 2024-08-01T06:56:09.476 INFO:tasks.workunit.client.0.smithi016.stdout:4/59: truncate d0/d2/dc/ff 360246 0 2024-08-01T06:56:09.478 INFO:tasks.workunit.client.0.smithi016.stdout:4/60: symlink d0/d2/dc/l14 0 2024-08-01T06:56:09.492 INFO:tasks.workunit.client.0.smithi016.stdout:7/74: dwrite f5 [0,4194304] 0 2024-08-01T06:56:09.493 INFO:tasks.workunit.client.0.smithi016.stdout:4/61: fsync d0/d2/dc/ff 0 2024-08-01T06:56:09.495 INFO:tasks.workunit.client.0.smithi016.stdout:7/75: mkdir d7/db/d1a/da/d1e 0 2024-08-01T06:56:09.500 INFO:tasks.workunit.client.0.smithi016.stdout:4/62: dread d0/d2/f11 [0,4194304] 0 2024-08-01T06:56:09.503 INFO:tasks.workunit.client.0.smithi016.stdout:4/63: getdents d0 0 2024-08-01T06:56:09.504 INFO:tasks.workunit.client.0.smithi016.stdout:7/76: dwrite f5 [4194304,4194304] 0 2024-08-01T06:56:09.505 INFO:tasks.workunit.client.1.smithi089.stdout:0/987: write d9/d40/d45/d47/da8/fb3 [234170,30518] 0 2024-08-01T06:56:09.506 INFO:tasks.workunit.client.1.smithi089.stdout:3/938: creat d7/d32/d4c/d67/d72/d91/dcb/d78/d11c/f139 x:0 0 0 2024-08-01T06:56:09.507 INFO:tasks.workunit.client.1.smithi089.stdout:0/988: write d9/d40/d25/d46/d91/d2e/d44/d53/deb/f125 [675705,23645] 0 2024-08-01T06:56:09.508 INFO:tasks.workunit.client.1.smithi089.stdout:9/931: creat d18/d33/d49/d7b/d7f/d98/f133 x:0 0 0 2024-08-01T06:56:09.509 INFO:tasks.workunit.client.1.smithi089.stdout:9/932: write d18/d33/d3b/f125 [470068,125888] 0 2024-08-01T06:56:09.509 INFO:tasks.workunit.client.0.smithi016.stdout:4/64: write d0/d2/f11 [2620584,51711] 0 2024-08-01T06:56:09.511 INFO:tasks.workunit.client.0.smithi016.stdout:7/77: rename f6 to d7/db/d1a/da/d1e/f1f 0 2024-08-01T06:56:09.513 INFO:tasks.workunit.client.1.smithi089.stdout:9/933: symlink d18/d33/d6e/dd1/l134 0 2024-08-01T06:56:09.513 INFO:tasks.workunit.client.0.smithi016.stdout:4/65: creat d0/d2/dc/f15 x:0 0 0 2024-08-01T06:56:09.517 INFO:tasks.workunit.client.1.smithi089.stdout:0/989: write d9/d40/d45/db7/fe1 [203441,70378] 0 2024-08-01T06:56:09.518 INFO:tasks.workunit.client.0.smithi016.stdout:4/66: mknod d0/c16 0 2024-08-01T06:56:09.518 INFO:tasks.workunit.client.1.smithi089.stdout:3/939: link d7/d32/d4c/d67/d72/d91/cc9 d7/d32/d4c/d67/c13a 0 2024-08-01T06:56:09.520 INFO:tasks.workunit.client.1.smithi089.stdout:9/934: fdatasync d18/d33/d49/d7b/d81/f90 0 2024-08-01T06:56:09.521 INFO:tasks.workunit.client.0.smithi016.stdout:7/78: getdents d7 0 2024-08-01T06:56:09.521 INFO:tasks.workunit.client.0.smithi016.stdout:7/79: rename d7/db to d7/db/d17/d20 22 2024-08-01T06:56:09.522 INFO:tasks.workunit.client.0.smithi016.stdout:7/80: chown d7/db/d1a/da/f1b 647 1 2024-08-01T06:56:09.524 INFO:tasks.workunit.client.0.smithi016.stdout:7/81: symlink d7/l21 0 2024-08-01T06:56:09.525 INFO:tasks.workunit.client.1.smithi089.stdout:0/990: dwrite d9/d40/d25/d46/d91/d2e/d44/d72/ff9 [0,4194304] 0 2024-08-01T06:56:09.526 INFO:tasks.workunit.client.1.smithi089.stdout:3/940: dwrite d7/d68/d50/d6f/d2f/d9c/fc8 [0,4194304] 0 2024-08-01T06:56:09.526 INFO:tasks.workunit.client.1.smithi089.stdout:9/935: rename d18/d22/d43/ce2 to d18/d33/d49/d7b/d7f/d98/d9f/d8e/de0/c135 0 2024-08-01T06:56:09.527 INFO:tasks.workunit.client.0.smithi016.stdout:4/67: mkdir d0/d17 0 2024-08-01T06:56:09.532 INFO:tasks.workunit.client.1.smithi089.stdout:0/991: stat d9/d40/d45/d47/da8/d10c/f114 0 2024-08-01T06:56:09.534 INFO:tasks.workunit.client.0.smithi016.stdout:7/82: chown d7/db/d1a/da/f1b 208247 1 2024-08-01T06:56:09.535 INFO:tasks.workunit.client.0.smithi016.stdout:4/68: mknod d0/d2/dc/d12/c18 0 2024-08-01T06:56:09.536 INFO:tasks.workunit.client.1.smithi089.stdout:3/941: mknod d7/d32/d12/d29/d39/d4b/dd2/c13b 0 2024-08-01T06:56:09.536 INFO:tasks.workunit.client.0.smithi016.stdout:7/83: chown d7/f18 125 1 2024-08-01T06:56:09.538 INFO:tasks.workunit.client.1.smithi089.stdout:0/992: mknod d9/d40/d25/d46/d91/d2e/d3a/d76/d123/c13d 0 2024-08-01T06:56:09.540 INFO:tasks.workunit.client.1.smithi089.stdout:9/936: creat d18/d33/f136 x:0 0 0 2024-08-01T06:56:09.541 INFO:tasks.workunit.client.0.smithi016.stdout:4/69: truncate d0/f1 2122896 0 2024-08-01T06:56:09.542 INFO:tasks.workunit.client.1.smithi089.stdout:3/942: dread d7/d32/f98 [0,4194304] 0 2024-08-01T06:56:09.543 INFO:tasks.workunit.client.0.smithi016.stdout:7/84: rename d7/d19 to d7/db/d1a/da/d22 0 2024-08-01T06:56:09.545 INFO:tasks.workunit.client.0.smithi016.stdout:4/70: symlink d0/d17/l19 0 2024-08-01T06:56:09.546 INFO:tasks.workunit.client.1.smithi089.stdout:9/937: symlink d18/d33/d49/d7b/d115/l137 0 2024-08-01T06:56:09.546 INFO:tasks.workunit.client.1.smithi089.stdout:3/943: creat d7/d32/d4c/d127/f13c x:0 0 0 2024-08-01T06:56:09.548 INFO:tasks.workunit.client.1.smithi089.stdout:0/993: getdents d9/d40/d25/d46/d91/d2e/d44/d53 0 2024-08-01T06:56:09.550 INFO:tasks.workunit.client.1.smithi089.stdout:3/944: rename d7/d32/d9f/ff4 to d7/d32/d4c/d67/d72/d91/dcb/dfd/f13d 0 2024-08-01T06:56:09.551 INFO:tasks.workunit.client.1.smithi089.stdout:9/938: creat d18/f138 x:0 0 0 2024-08-01T06:56:09.551 INFO:tasks.workunit.client.1.smithi089.stdout:3/945: rmdir d7 39 2024-08-01T06:56:09.553 INFO:tasks.workunit.client.1.smithi089.stdout:0/994: creat d9/d40/d45/d47/da8/d10c/d11b/f13e x:0 0 0 2024-08-01T06:56:09.553 INFO:tasks.workunit.client.1.smithi089.stdout:9/939: creat d18/d22/d39/d50/f139 x:0 0 0 2024-08-01T06:56:09.554 INFO:tasks.workunit.client.1.smithi089.stdout:9/940: write d18/f30 [1349808,75838] 0 2024-08-01T06:56:09.555 INFO:tasks.workunit.client.1.smithi089.stdout:9/941: chown d18/d33/d6e 6250 1 2024-08-01T06:56:09.556 INFO:tasks.workunit.client.1.smithi089.stdout:9/942: chown d18/d33/d49/d7b/d7f/d98/d9f/d8e/dde 10288379 1 2024-08-01T06:56:09.559 INFO:tasks.workunit.client.1.smithi089.stdout:9/943: creat d18/dec/f13a x:0 0 0 2024-08-01T06:56:09.562 INFO:tasks.workunit.client.0.smithi016.stdout:7/85: rename d7 to d7/db/d1a/da/d22/d23 22 2024-08-01T06:56:09.563 INFO:tasks.workunit.client.1.smithi089.stdout:9/944: creat d18/d33/d49/d7b/d115/f13b x:0 0 0 2024-08-01T06:56:09.564 INFO:tasks.workunit.client.0.smithi016.stdout:7/86: dread - d7/f11 zero size 2024-08-01T06:56:09.567 INFO:tasks.workunit.client.1.smithi089.stdout:9/945: rename d18/d22/d52/ce9 to d18/d33/d49/d7b/d4b/dbb/d107/c13c 0 2024-08-01T06:56:09.568 INFO:tasks.workunit.client.1.smithi089.stdout:3/946: dread d7/d32/d4c/d67/fac [0,4194304] 0 2024-08-01T06:56:09.569 INFO:tasks.workunit.client.1.smithi089.stdout:3/947: dread d7/d32/f98 [0,4194304] 0 2024-08-01T06:56:09.570 INFO:tasks.workunit.client.0.smithi016.stdout:7/87: symlink d7/db/d1a/da/d1c/l24 0 2024-08-01T06:56:09.572 INFO:tasks.workunit.client.1.smithi089.stdout:0/995: write d9/d40/d25/d46/d91/d2e/d3a/d76/fd5 [328172,34626] 0 2024-08-01T06:56:09.572 INFO:tasks.workunit.client.0.smithi016.stdout:4/71: dwrite d0/fb [0,4194304] 0 2024-08-01T06:56:09.575 INFO:tasks.workunit.client.0.smithi016.stdout:7/88: write d7/f18 [49095,65920] 0 2024-08-01T06:56:09.576 INFO:tasks.workunit.client.0.smithi016.stdout:7/89: dread - d7/f11 zero size 2024-08-01T06:56:09.577 INFO:tasks.workunit.client.1.smithi089.stdout:3/948: link d7/d32/d4c/d53/f99 d7/d32/d12/d29/d39/d4b/d83/f13e 0 2024-08-01T06:56:09.578 INFO:tasks.workunit.client.1.smithi089.stdout:3/949: stat d7/d32/d4c/d53/d10d 0 2024-08-01T06:56:09.579 INFO:tasks.workunit.client.1.smithi089.stdout:0/996: dwrite d9/d40/d25/d46/d91/d2e/d3a/d76/fd5 [0,4194304] 0 2024-08-01T06:56:09.580 INFO:tasks.workunit.client.0.smithi016.stdout:1/114: sync 2024-08-01T06:56:09.580 INFO:tasks.workunit.client.0.smithi016.stdout:6/105: sync 2024-08-01T06:56:09.580 INFO:tasks.workunit.client.0.smithi016.stdout:2/61: sync 2024-08-01T06:56:09.580 INFO:tasks.workunit.client.0.smithi016.stdout:3/52: sync 2024-08-01T06:56:09.581 INFO:tasks.workunit.client.0.smithi016.stdout:9/98: sync 2024-08-01T06:56:09.581 INFO:tasks.workunit.client.0.smithi016.stdout:0/113: sync 2024-08-01T06:56:09.581 INFO:tasks.workunit.client.0.smithi016.stdout:8/77: sync 2024-08-01T06:56:09.582 INFO:tasks.workunit.client.1.smithi089.stdout:9/946: write f17 [348024,125424] 0 2024-08-01T06:56:09.583 INFO:tasks.workunit.client.0.smithi016.stdout:4/72: rename d0/ce to d0/d17/c1a 0 2024-08-01T06:56:09.585 INFO:tasks.workunit.client.0.smithi016.stdout:4/73: readlink d0/d2/dc/l10 0 2024-08-01T06:56:09.585 INFO:tasks.workunit.client.0.smithi016.stdout:3/53: chown d9/da/df/d12/f15 0 1 2024-08-01T06:56:09.586 INFO:tasks.workunit.client.1.smithi089.stdout:0/997: creat d9/d40/d25/d46/d91/d2e/d3a/d76/d96/f13f x:0 0 0 2024-08-01T06:56:09.587 INFO:tasks.workunit.client.1.smithi089.stdout:0/998: chown d9/d40/d95/f12b 230 1 2024-08-01T06:56:09.588 INFO:tasks.workunit.client.1.smithi089.stdout:9/947: rename d18/d22/d39/d50/l5c to d18/d22/d45/l13d 0 2024-08-01T06:56:09.589 INFO:tasks.workunit.client.0.smithi016.stdout:9/99: fdatasync d3/de/f14 0 2024-08-01T06:56:09.590 INFO:tasks.workunit.client.0.smithi016.stdout:8/78: creat d5/dc/f17 x:0 0 0 2024-08-01T06:56:09.593 INFO:tasks.workunit.client.0.smithi016.stdout:8/79: fdatasync d5/f11 0 2024-08-01T06:56:09.593 INFO:tasks.workunit.client.0.smithi016.stdout:9/100: stat d3/d9/db/l12 0 2024-08-01T06:56:09.594 INFO:tasks.workunit.client.0.smithi016.stdout:2/62: symlink d0/l12 0 2024-08-01T06:56:09.595 INFO:tasks.workunit.client.0.smithi016.stdout:6/106: dwrite d1/d8/d1b/f25 [0,4194304] 0 2024-08-01T06:56:09.595 INFO:tasks.workunit.client.0.smithi016.stdout:8/80: chown d5/d8/fd 4 1 2024-08-01T06:56:09.596 INFO:tasks.workunit.client.1.smithi089.stdout:9/948: link d18/d22/d45/c4a d18/d22/d52/c13e 0 2024-08-01T06:56:09.597 INFO:tasks.workunit.client.1.smithi089.stdout:0/999: getdents d9/d40/d25/d46/d91/d2e/dfc 0 2024-08-01T06:56:09.599 INFO:tasks.workunit.client.0.smithi016.stdout:0/114: link d10/f17 d10/d1c/f25 0 2024-08-01T06:56:09.600 INFO:tasks.workunit.client.1.smithi089.stdout:3/950: dread d7/d32/d4c/d67/d72/d91/dcb/fa4 [0,4194304] 0 2024-08-01T06:56:09.601 INFO:tasks.workunit.client.0.smithi016.stdout:8/81: dread d5/f12 [0,4194304] 0 2024-08-01T06:56:09.602 INFO:tasks.workunit.client.0.smithi016.stdout:7/90: truncate d7/ff 2978365 0 2024-08-01T06:56:09.602 INFO:tasks.workunit.client.0.smithi016.stdout:8/82: chown d5/f12 4 1 2024-08-01T06:56:09.603 INFO:tasks.workunit.client.0.smithi016.stdout:7/91: stat d7/db/f13 0 2024-08-01T06:56:09.605 INFO:tasks.workunit.client.0.smithi016.stdout:1/115: creat d2/f24 x:0 0 0 2024-08-01T06:56:09.605 INFO:tasks.workunit.client.0.smithi016.stdout:1/116: chown d2/l1e 1079798 1 2024-08-01T06:56:09.606 INFO:tasks.workunit.client.0.smithi016.stdout:1/117: readlink d2/l1e 0 2024-08-01T06:56:09.606 INFO:tasks.workunit.client.0.smithi016.stdout:1/118: chown d2/l15 70 1 2024-08-01T06:56:09.607 INFO:tasks.workunit.client.0.smithi016.stdout:1/119: fdatasync d2/d3/f18 0 2024-08-01T06:56:09.607 INFO:tasks.workunit.client.0.smithi016.stdout:9/101: symlink d3/d9/db/l1f 0 2024-08-01T06:56:09.611 INFO:tasks.workunit.client.0.smithi016.stdout:4/74: mknod d0/c1b 0 2024-08-01T06:56:09.611 INFO:tasks.workunit.client.1.smithi089.stdout:9/949: getdents d18/d33/df7/da6 0 2024-08-01T06:56:09.612 INFO:tasks.workunit.client.0.smithi016.stdout:1/120: dread d2/d3/f5 [0,4194304] 0 2024-08-01T06:56:09.613 INFO:tasks.workunit.client.0.smithi016.stdout:1/121: write d2/d3/d1a/f20 [106323,112608] 0 2024-08-01T06:56:09.614 INFO:tasks.workunit.client.0.smithi016.stdout:2/63: dread d0/f3 [0,4194304] 0 2024-08-01T06:56:09.614 INFO:tasks.workunit.client.1.smithi089.stdout:3/951: creat d7/d32/d12/d29/f13f x:0 0 0 2024-08-01T06:56:09.615 INFO:tasks.workunit.client.0.smithi016.stdout:1/122: write d2/d3/f18 [890290,93959] 0 2024-08-01T06:56:09.617 INFO:tasks.workunit.client.0.smithi016.stdout:0/115: mknod d10/d11/c26 0 2024-08-01T06:56:09.617 INFO:tasks.workunit.client.0.smithi016.stdout:0/116: read fd [1637629,30875] 0 2024-08-01T06:56:09.618 INFO:tasks.workunit.client.0.smithi016.stdout:0/117: stat d10/d1c/c1d 0 2024-08-01T06:56:09.618 INFO:tasks.workunit.client.0.smithi016.stdout:8/83: chown d5/dc/le 10464 1 2024-08-01T06:56:09.620 INFO:tasks.workunit.client.1.smithi089.stdout:9/950: mkdir d18/d33/d121/d13f 0 2024-08-01T06:56:09.620 INFO:tasks.workunit.client.1.smithi089.stdout:3/952: dwrite d7/d32/d12/f33 [0,4194304] 0 2024-08-01T06:56:09.621 INFO:tasks.workunit.client.1.smithi089.stdout:3/953: chown d7/d68/d50/d6f/c8b 33847845 1 2024-08-01T06:56:09.622 INFO:tasks.workunit.client.0.smithi016.stdout:9/102: creat d3/de/f20 x:0 0 0 2024-08-01T06:56:09.624 INFO:tasks.workunit.client.0.smithi016.stdout:4/75: fdatasync d0/f8 0 2024-08-01T06:56:09.625 INFO:tasks.workunit.client.1.smithi089.stdout:3/954: symlink d7/d32/d9f/l140 0 2024-08-01T06:56:09.626 INFO:tasks.workunit.client.1.smithi089.stdout:3/955: truncate d7/d68/d50/d6f/d2f/fef 885292 0 2024-08-01T06:56:09.627 INFO:tasks.workunit.client.1.smithi089.stdout:9/951: fsync d18/d22/d39/d50/f131 0 2024-08-01T06:56:09.629 INFO:tasks.workunit.client.1.smithi089.stdout:9/952: fsync d18/d22/d39/d95/fd7 0 2024-08-01T06:56:09.631 INFO:tasks.workunit.client.1.smithi089.stdout:3/956: dread d7/d32/d4c/d67/d72/d91/dcb/fa4 [0,4194304] 0 2024-08-01T06:56:09.632 INFO:tasks.workunit.client.0.smithi016.stdout:0/118: creat d10/d1c/f27 x:0 0 0 2024-08-01T06:56:09.632 INFO:tasks.workunit.client.0.smithi016.stdout:7/92: truncate d7/ff 1038446 0 2024-08-01T06:56:09.633 INFO:tasks.workunit.client.0.smithi016.stdout:8/84: dwrite d5/dc/f17 [0,4194304] 0 2024-08-01T06:56:09.636 INFO:tasks.workunit.client.0.smithi016.stdout:8/85: chown d5/d8 250 1 2024-08-01T06:56:09.637 INFO:tasks.workunit.client.0.smithi016.stdout:6/107: dwrite d1/f2 [0,4194304] 0 2024-08-01T06:56:09.638 INFO:tasks.workunit.client.1.smithi089.stdout:3/957: mknod d7/c141 0 2024-08-01T06:56:09.638 INFO:tasks.workunit.client.0.smithi016.stdout:7/93: write d7/db/d1a/da/dc/f15 [219147,10968] 0 2024-08-01T06:56:09.638 INFO:tasks.workunit.client.0.smithi016.stdout:6/108: chown d1/d8/lf 463046841 1 2024-08-01T06:56:09.639 INFO:tasks.workunit.client.0.smithi016.stdout:1/123: dread d2/d3/fd [0,4194304] 0 2024-08-01T06:56:09.640 INFO:tasks.workunit.client.0.smithi016.stdout:2/64: mknod d0/d8/c13 0 2024-08-01T06:56:09.642 INFO:tasks.workunit.client.1.smithi089.stdout:3/958: dread d7/d32/d4c/d69/f103 [0,4194304] 0 2024-08-01T06:56:09.644 INFO:tasks.workunit.client.0.smithi016.stdout:0/119: creat d10/f28 x:0 0 0 2024-08-01T06:56:09.646 INFO:tasks.workunit.client.0.smithi016.stdout:8/86: mkdir d5/d8/d18 0 2024-08-01T06:56:09.647 INFO:tasks.workunit.client.1.smithi089.stdout:3/959: mkdir d7/d32/d4c/d69/d6d/d142 0 2024-08-01T06:56:09.648 INFO:tasks.workunit.client.0.smithi016.stdout:8/87: write d5/d8/fd [543064,99697] 0 2024-08-01T06:56:09.649 INFO:tasks.workunit.client.1.smithi089.stdout:3/960: write d7/d32/d12/d29/d39/d4b/fd9 [1117355,71781] 0 2024-08-01T06:56:09.649 INFO:tasks.workunit.client.0.smithi016.stdout:4/76: truncate d0/d2/fa 2032018 0 2024-08-01T06:56:09.650 INFO:tasks.workunit.client.1.smithi089.stdout:3/961: read - d7/d32/d4c/d67/d72/d91/dcb/d78/d11c/f139 zero size 2024-08-01T06:56:09.651 INFO:tasks.workunit.client.0.smithi016.stdout:0/120: fdatasync f6 0 2024-08-01T06:56:09.652 INFO:tasks.workunit.client.0.smithi016.stdout:6/109: symlink d1/l27 0 2024-08-01T06:56:09.653 INFO:tasks.workunit.client.1.smithi089.stdout:3/962: truncate d7/d32/d12/d29/d39/d4b/dd2/f12c 664287 0 2024-08-01T06:56:09.653 INFO:tasks.workunit.client.0.smithi016.stdout:2/65: mknod d0/c14 0 2024-08-01T06:56:09.654 INFO:tasks.workunit.client.0.smithi016.stdout:4/77: dread d0/f8 [0,4194304] 0 2024-08-01T06:56:09.654 INFO:tasks.workunit.client.0.smithi016.stdout:1/124: mknod d2/c25 0 2024-08-01T06:56:09.654 INFO:tasks.workunit.client.1.smithi089.stdout:3/963: dread - d7/d68/d50/d6f/d2f/da2/da8/d129/d136/fcf zero size 2024-08-01T06:56:09.654 INFO:tasks.workunit.client.0.smithi016.stdout:8/88: fdatasync d5/f12 0 2024-08-01T06:56:09.656 INFO:tasks.workunit.client.0.smithi016.stdout:6/110: mknod d1/d8/d1b/c28 0 2024-08-01T06:56:09.656 INFO:tasks.workunit.client.1.smithi089.stdout:3/964: dread d7/d68/d50/d119/f134 [0,4194304] 0 2024-08-01T06:56:09.659 INFO:tasks.workunit.client.0.smithi016.stdout:4/78: creat d0/d2/f1c x:0 0 0 2024-08-01T06:56:09.663 INFO:tasks.workunit.client.1.smithi089.stdout:3/965: rename d7/d32/d12/d29/d39/d4b/fd9 to d7/d32/d12/d29/d39/d4b/f143 0 2024-08-01T06:56:09.663 INFO:tasks.workunit.client.1.smithi089.stdout:9/953: dwrite d18/d33/df7/fd2 [4194304,4194304] 0 2024-08-01T06:56:09.666 INFO:tasks.workunit.client.0.smithi016.stdout:1/125: dwrite d2/d3/f5 [0,4194304] 0 2024-08-01T06:56:09.672 INFO:tasks.workunit.client.1.smithi089.stdout:2/953: sync 2024-08-01T06:56:09.674 INFO:tasks.workunit.client.0.smithi016.stdout:8/89: creat d5/d8/d18/f19 x:0 0 0 2024-08-01T06:56:09.677 INFO:tasks.workunit.client.0.smithi016.stdout:6/111: creat d1/d8/d1b/d22/f29 x:0 0 0 2024-08-01T06:56:09.678 INFO:tasks.workunit.client.0.smithi016.stdout:9/103: dwrite d3/d4/f11 [4194304,4194304] 0 2024-08-01T06:56:09.679 INFO:tasks.workunit.client.0.smithi016.stdout:1/126: mknod d2/de/c26 0 2024-08-01T06:56:09.681 INFO:tasks.workunit.client.1.smithi089.stdout:3/966: dwrite d7/d32/d12/d1b/f26 [0,4194304] 0 2024-08-01T06:56:09.685 INFO:tasks.workunit.client.0.smithi016.stdout:8/90: mkdir d5/d8/d1a 0 2024-08-01T06:56:09.685 INFO:tasks.workunit.client.0.smithi016.stdout:1/127: dread d2/de/f14 [0,4194304] 0 2024-08-01T06:56:09.686 INFO:tasks.workunit.client.1.smithi089.stdout:9/954: dread f10 [0,4194304] 0 2024-08-01T06:56:09.686 INFO:tasks.workunit.client.0.smithi016.stdout:8/91: truncate d5/f11 577227 0 2024-08-01T06:56:09.689 INFO:tasks.workunit.client.0.smithi016.stdout:8/92: read d5/dc/f17 [3249641,116490] 0 2024-08-01T06:56:09.700 INFO:tasks.workunit.client.0.smithi016.stdout:4/79: getdents d0/d2/dc/d12 0 2024-08-01T06:56:09.702 INFO:tasks.workunit.client.0.smithi016.stdout:9/104: creat d3/d9/db/dc/f21 x:0 0 0 2024-08-01T06:56:09.703 INFO:tasks.workunit.client.0.smithi016.stdout:9/105: dread - d3/de/f20 zero size 2024-08-01T06:56:09.704 INFO:tasks.workunit.client.0.smithi016.stdout:6/112: creat d1/d8/f2a x:0 0 0 2024-08-01T06:56:09.704 INFO:tasks.workunit.client.0.smithi016.stdout:6/113: fdatasync d1/f2 0 2024-08-01T06:56:09.708 INFO:tasks.workunit.client.0.smithi016.stdout:6/114: dread d1/d8/d1b/f25 [0,4194304] 0 2024-08-01T06:56:09.710 INFO:tasks.workunit.client.0.smithi016.stdout:4/80: mknod d0/d2/c1d 0 2024-08-01T06:56:09.712 INFO:tasks.workunit.client.0.smithi016.stdout:9/106: mknod d3/d4/c22 0 2024-08-01T06:56:09.718 INFO:tasks.workunit.client.0.smithi016.stdout:1/128: write d2/de/d21/f23 [565859,126985] 0 2024-08-01T06:56:09.719 INFO:tasks.workunit.client.0.smithi016.stdout:9/107: mknod d3/d9/db/dc/c23 0 2024-08-01T06:56:09.721 INFO:tasks.workunit.client.0.smithi016.stdout:4/81: read d0/d2/fa [856154,62437] 0 2024-08-01T06:56:09.722 INFO:tasks.workunit.client.0.smithi016.stdout:4/82: fdatasync d0/d2/f4 0 2024-08-01T06:56:09.723 INFO:tasks.workunit.client.0.smithi016.stdout:4/83: fsync d0/d2/f1c 0 2024-08-01T06:56:09.723 INFO:tasks.workunit.client.0.smithi016.stdout:1/129: creat d2/d3/d1a/f27 x:0 0 0 2024-08-01T06:56:09.724 INFO:tasks.workunit.client.0.smithi016.stdout:4/84: chown d0/f8 2050511596 1 2024-08-01T06:56:09.724 INFO:tasks.workunit.client.0.smithi016.stdout:1/130: write d2/f19 [754661,52353] 0 2024-08-01T06:56:09.726 INFO:tasks.workunit.client.0.smithi016.stdout:9/108: creat d3/f24 x:0 0 0 2024-08-01T06:56:09.729 INFO:tasks.workunit.client.0.smithi016.stdout:6/115: rename d1/d9/l1f to d1/l2b 0 2024-08-01T06:56:09.731 INFO:tasks.workunit.client.0.smithi016.stdout:6/116: stat d1/d8/fa 0 2024-08-01T06:56:09.732 INFO:tasks.workunit.client.0.smithi016.stdout:1/131: dwrite d2/f17 [0,4194304] 0 2024-08-01T06:56:09.732 INFO:tasks.workunit.client.0.smithi016.stdout:1/132: stat d2/c25 0 2024-08-01T06:56:09.734 INFO:tasks.workunit.client.0.smithi016.stdout:4/85: chown d0/d17/c1a 28 1 2024-08-01T06:56:09.739 INFO:tasks.workunit.client.0.smithi016.stdout:4/86: creat d0/d2/dc/f1e x:0 0 0 2024-08-01T06:56:09.744 INFO:tasks.workunit.client.0.smithi016.stdout:4/87: dread d0/fb [0,4194304] 0 2024-08-01T06:56:09.745 INFO:tasks.workunit.client.0.smithi016.stdout:6/117: creat d1/d8/f2c x:0 0 0 2024-08-01T06:56:09.746 INFO:tasks.workunit.client.0.smithi016.stdout:1/133: creat d2/f28 x:0 0 0 2024-08-01T06:56:09.747 INFO:tasks.workunit.client.0.smithi016.stdout:1/134: stat d2/l15 0 2024-08-01T06:56:09.750 INFO:tasks.workunit.client.0.smithi016.stdout:6/118: mkdir d1/d8/d1b/d22/d2d 0 2024-08-01T06:56:09.752 INFO:tasks.workunit.client.0.smithi016.stdout:1/135: dread d2/f17 [0,4194304] 0 2024-08-01T06:56:09.753 INFO:tasks.workunit.client.0.smithi016.stdout:4/88: fsync d0/d2/dc/f1e 0 2024-08-01T06:56:09.761 INFO:tasks.workunit.client.0.smithi016.stdout:6/119: truncate d1/f2 1891738 0 2024-08-01T06:56:09.761 INFO:tasks.workunit.client.0.smithi016.stdout:6/120: chown d1 3089549 1 2024-08-01T06:56:09.761 INFO:tasks.workunit.client.0.smithi016.stdout:5/81: sync 2024-08-01T06:56:09.765 INFO:tasks.workunit.client.0.smithi016.stdout:4/89: symlink d0/l1f 0 2024-08-01T06:56:09.765 INFO:tasks.workunit.client.0.smithi016.stdout:4/90: chown d0/d2/dc 2 1 2024-08-01T06:56:09.766 INFO:tasks.workunit.client.0.smithi016.stdout:6/121: rmdir d1/d8/d1b 39 2024-08-01T06:56:09.769 INFO:tasks.workunit.client.0.smithi016.stdout:5/82: fdatasync d1/d2/d6/d9/f13 0 2024-08-01T06:56:09.770 INFO:tasks.workunit.client.0.smithi016.stdout:4/91: dread d0/fb [0,4194304] 0 2024-08-01T06:56:09.777 INFO:tasks.workunit.client.0.smithi016.stdout:5/83: rename d1/d2/c3 to d1/d2/d6/c18 0 2024-08-01T06:56:09.778 INFO:tasks.workunit.client.0.smithi016.stdout:4/92: dread d0/d2/f4 [0,4194304] 0 2024-08-01T06:56:09.779 INFO:tasks.workunit.client.0.smithi016.stdout:1/136: dwrite f0 [0,4194304] 0 2024-08-01T06:56:09.779 INFO:tasks.workunit.client.1.smithi089.stdout:2/954: mkdir d7/d1f/d12e 0 2024-08-01T06:56:09.780 INFO:tasks.workunit.client.0.smithi016.stdout:6/122: dread d1/d9/f21 [0,4194304] 0 2024-08-01T06:56:09.781 INFO:tasks.workunit.client.1.smithi089.stdout:9/955: truncate d18/f8f 1050581 0 2024-08-01T06:56:09.782 INFO:tasks.workunit.client.0.smithi016.stdout:5/84: mkdir d1/d2/d6/d9/d19 0 2024-08-01T06:56:09.784 INFO:tasks.workunit.client.1.smithi089.stdout:3/967: rmdir d7/d68/d50/d6f/d46/dd1/dd8 0 2024-08-01T06:56:09.786 INFO:tasks.workunit.client.0.smithi016.stdout:1/137: rename d2/c4 to d2/d3/d1f/c29 0 2024-08-01T06:56:09.788 INFO:tasks.workunit.client.0.smithi016.stdout:6/123: fsync d1/d8/f1a 0 2024-08-01T06:56:09.789 INFO:tasks.workunit.client.0.smithi016.stdout:6/124: write d1/f5 [804214,21629] 0 2024-08-01T06:56:09.791 INFO:tasks.workunit.client.1.smithi089.stdout:3/968: mkdir d7/d32/d4c/d67/d72/d91/dcb/d78/d11c/d144 0 2024-08-01T06:56:09.791 INFO:tasks.workunit.client.0.smithi016.stdout:6/125: truncate d1/d8/f2c 295533 0 2024-08-01T06:56:09.792 INFO:tasks.workunit.client.0.smithi016.stdout:6/126: fsync d1/d8/f2c 0 2024-08-01T06:56:09.792 INFO:tasks.workunit.client.0.smithi016.stdout:6/127: chown d1/f4 402794281 1 2024-08-01T06:56:09.796 INFO:tasks.workunit.client.1.smithi089.stdout:2/955: getdents d7/d1f/d52/d72/de5 0 2024-08-01T06:56:09.798 INFO:tasks.workunit.client.0.smithi016.stdout:5/85: symlink d1/d12/l1a 0 2024-08-01T06:56:09.802 INFO:tasks.workunit.client.1.smithi089.stdout:3/969: truncate d7/d32/d4c/d69/f1a 3256970 0 2024-08-01T06:56:09.803 INFO:tasks.workunit.client.0.smithi016.stdout:6/128: chown d1/f2 443726103 1 2024-08-01T06:56:09.805 INFO:tasks.workunit.client.0.smithi016.stdout:4/93: dwrite d0/d2/fa [0,4194304] 0 2024-08-01T06:56:09.806 INFO:tasks.workunit.client.1.smithi089.stdout:9/956: dwrite fa [0,4194304] 0 2024-08-01T06:56:09.806 INFO:tasks.workunit.client.1.smithi089.stdout:9/957: chown d18/d33/d49/d7b/d7f 178034 1 2024-08-01T06:56:09.807 INFO:tasks.workunit.client.1.smithi089.stdout:3/970: creat d7/d68/d50/d6f/d2f/f145 x:0 0 0 2024-08-01T06:56:09.807 INFO:tasks.workunit.client.0.smithi016.stdout:5/86: dwrite d1/d2/d6/fd [0,4194304] 0 2024-08-01T06:56:09.809 INFO:tasks.workunit.client.0.smithi016.stdout:5/87: read d1/d2/f10 [2893794,54439] 0 2024-08-01T06:56:09.810 INFO:tasks.workunit.client.0.smithi016.stdout:4/94: truncate d0/d2/dc/f15 968003 0 2024-08-01T06:56:09.810 INFO:tasks.workunit.client.0.smithi016.stdout:1/138: link d2/d3/f5 d2/f2a 0 2024-08-01T06:56:09.811 INFO:tasks.workunit.client.0.smithi016.stdout:6/129: creat d1/d9/f2e x:0 0 0 2024-08-01T06:56:09.815 INFO:tasks.workunit.client.0.smithi016.stdout:5/88: unlink d1/d2/d6/f17 0 2024-08-01T06:56:09.818 INFO:tasks.workunit.client.0.smithi016.stdout:4/95: rmdir d0/d2 39 2024-08-01T06:56:09.821 INFO:tasks.workunit.client.0.smithi016.stdout:6/130: mkdir d1/d8/d2f 0 2024-08-01T06:56:09.822 INFO:tasks.workunit.client.0.smithi016.stdout:5/89: mkdir d1/d2/d6/d9/d1b 0 2024-08-01T06:56:09.823 INFO:tasks.workunit.client.1.smithi089.stdout:9/958: truncate d18/d33/d49/d7b/d7f/d98/d9f/d8e/f9e 637708 0 2024-08-01T06:56:09.824 INFO:tasks.workunit.client.0.smithi016.stdout:5/90: mknod d1/d12/c1c 0 2024-08-01T06:56:09.826 INFO:tasks.workunit.client.1.smithi089.stdout:3/971: mkdir d7/d32/d4c/d67/d72/d91/dcb/d78/d11c/d144/d146 0 2024-08-01T06:56:09.830 INFO:tasks.workunit.client.1.smithi089.stdout:9/959: link d18/d22/d39/d50/le6 d18/da4/l140 0 2024-08-01T06:56:09.830 INFO:tasks.workunit.client.0.smithi016.stdout:6/131: rename d1/l13 to d1/d9/l30 0 2024-08-01T06:56:09.833 INFO:tasks.workunit.client.0.smithi016.stdout:4/96: dwrite d0/d2/dc/f1e [0,4194304] 0 2024-08-01T06:56:09.835 INFO:tasks.workunit.client.0.smithi016.stdout:5/91: dwrite d1/f5 [0,4194304] 0 2024-08-01T06:56:09.836 INFO:tasks.workunit.client.1.smithi089.stdout:3/972: link d7/d68/d50/d6f/d46/ca3 d7/d68/d50/d119/c147 0 2024-08-01T06:56:09.841 INFO:tasks.workunit.client.0.smithi016.stdout:5/92: readlink d1/l15 0 2024-08-01T06:56:09.845 INFO:tasks.workunit.client.0.smithi016.stdout:6/132: rename d1/d8/c15 to d1/d8/d1b/d22/d2d/c31 0 2024-08-01T06:56:09.846 INFO:tasks.workunit.client.0.smithi016.stdout:4/97: dwrite d0/fb [4194304,4194304] 0 2024-08-01T06:56:09.847 INFO:tasks.workunit.client.0.smithi016.stdout:4/98: write d0/fb [399133,9843] 0 2024-08-01T06:56:09.848 INFO:tasks.workunit.client.0.smithi016.stdout:5/93: rename d1/l15 to d1/l1d 0 2024-08-01T06:56:09.848 INFO:tasks.workunit.client.0.smithi016.stdout:1/139: write d2/de/f14 [4413712,83038] 0 2024-08-01T06:56:09.857 INFO:tasks.workunit.client.0.smithi016.stdout:1/140: creat d2/d3/d1c/f2b x:0 0 0 2024-08-01T06:56:09.858 INFO:tasks.workunit.client.0.smithi016.stdout:1/141: write d2/f12 [3960074,65080] 0 2024-08-01T06:56:09.859 INFO:tasks.workunit.client.0.smithi016.stdout:4/99: mknod d0/c20 0 2024-08-01T06:56:09.864 INFO:tasks.workunit.client.0.smithi016.stdout:4/100: fsync d0/d2/dc/ff 0 2024-08-01T06:56:09.865 INFO:tasks.workunit.client.0.smithi016.stdout:1/142: creat d2/d3/d1a/d22/f2c x:0 0 0 2024-08-01T06:56:09.865 INFO:tasks.workunit.client.0.smithi016.stdout:4/101: fdatasync d0/d2/f1c 0 2024-08-01T06:56:09.867 INFO:tasks.workunit.client.0.smithi016.stdout:4/102: mknod d0/c21 0 2024-08-01T06:56:09.870 INFO:tasks.workunit.client.0.smithi016.stdout:1/143: getdents d2/de/d21 0 2024-08-01T06:56:09.872 INFO:tasks.workunit.client.0.smithi016.stdout:5/94: truncate d1/d2/d6/fd 2381892 0 2024-08-01T06:56:09.873 INFO:tasks.workunit.client.0.smithi016.stdout:1/144: symlink d2/d3/d1a/d22/l2d 0 2024-08-01T06:56:09.876 INFO:tasks.workunit.client.0.smithi016.stdout:4/103: dwrite d0/f8 [0,4194304] 0 2024-08-01T06:56:09.877 INFO:tasks.workunit.client.0.smithi016.stdout:5/95: mknod d1/d2/d6/c1e 0 2024-08-01T06:56:09.877 INFO:tasks.workunit.client.0.smithi016.stdout:1/145: creat d2/d3/d1c/f2e x:0 0 0 2024-08-01T06:56:09.878 INFO:tasks.workunit.client.0.smithi016.stdout:4/104: read d0/d2/dc/ff [304209,67446] 0 2024-08-01T06:56:09.880 INFO:tasks.workunit.client.0.smithi016.stdout:1/146: read d2/d3/fd [3433945,30047] 0 2024-08-01T06:56:09.880 INFO:tasks.workunit.client.0.smithi016.stdout:4/105: fsync d0/d2/dc/f15 0 2024-08-01T06:56:09.882 INFO:tasks.workunit.client.0.smithi016.stdout:4/106: write d0/fb [8165485,25929] 0 2024-08-01T06:56:09.884 INFO:tasks.workunit.client.0.smithi016.stdout:4/107: write d0/fb [8779549,108128] 0 2024-08-01T06:56:09.886 INFO:tasks.workunit.client.0.smithi016.stdout:4/108: read d0/d2/fa [3417991,11914] 0 2024-08-01T06:56:09.887 INFO:tasks.workunit.client.0.smithi016.stdout:5/96: creat d1/d2/d6/d9/d1b/f1f x:0 0 0 2024-08-01T06:56:09.891 INFO:tasks.workunit.client.0.smithi016.stdout:5/97: mkdir d1/d2/d20 0 2024-08-01T06:56:09.896 INFO:tasks.workunit.client.0.smithi016.stdout:1/147: dwrite d2/de/f10 [0,4194304] 0 2024-08-01T06:56:09.897 INFO:tasks.workunit.client.0.smithi016.stdout:4/109: dread d0/d2/fa [0,4194304] 0 2024-08-01T06:56:09.902 INFO:tasks.workunit.client.0.smithi016.stdout:4/110: write d0/d2/dc/f1e [2666530,98311] 0 2024-08-01T06:56:09.905 INFO:tasks.workunit.client.0.smithi016.stdout:4/111: mkdir d0/d17/d22 0 2024-08-01T06:56:09.909 INFO:tasks.workunit.client.0.smithi016.stdout:1/148: dwrite d2/d3/d1a/d22/f2c [0,4194304] 0 2024-08-01T06:56:09.909 INFO:tasks.workunit.client.0.smithi016.stdout:4/112: write d0/d2/dc/f15 [1203211,95216] 0 2024-08-01T06:56:09.909 INFO:tasks.workunit.client.0.smithi016.stdout:5/98: dwrite d1/fb [0,4194304] 0 2024-08-01T06:56:09.911 INFO:tasks.workunit.client.0.smithi016.stdout:1/149: chown d2/f12 776647628 1 2024-08-01T06:56:09.911 INFO:tasks.workunit.client.0.smithi016.stdout:4/113: chown d0/l1f 3164 1 2024-08-01T06:56:09.914 INFO:tasks.workunit.client.0.smithi016.stdout:5/99: truncate d1/d2/f10 995737 0 2024-08-01T06:56:09.916 INFO:tasks.workunit.client.0.smithi016.stdout:1/150: chown d2/d3/d1a/d22 2 1 2024-08-01T06:56:09.916 INFO:tasks.workunit.client.0.smithi016.stdout:4/114: creat d0/f23 x:0 0 0 2024-08-01T06:56:09.918 INFO:tasks.workunit.client.0.smithi016.stdout:5/100: creat d1/d2/d6/d9/f21 x:0 0 0 2024-08-01T06:56:09.919 INFO:tasks.workunit.client.0.smithi016.stdout:1/151: dread d2/de/d21/f23 [0,4194304] 0 2024-08-01T06:56:09.920 INFO:tasks.workunit.client.0.smithi016.stdout:4/115: creat d0/d2/dc/d12/f24 x:0 0 0 2024-08-01T06:56:09.920 INFO:tasks.workunit.client.0.smithi016.stdout:5/101: creat d1/d2/d6/d9/f22 x:0 0 0 2024-08-01T06:56:09.922 INFO:tasks.workunit.client.0.smithi016.stdout:1/152: mkdir d2/d2f 0 2024-08-01T06:56:09.922 INFO:tasks.workunit.client.0.smithi016.stdout:4/116: fsync d0/d2/fa 0 2024-08-01T06:56:09.923 INFO:tasks.workunit.client.0.smithi016.stdout:5/102: mkdir d1/d2/d23 0 2024-08-01T06:56:09.923 INFO:tasks.workunit.client.0.smithi016.stdout:1/153: chown d2/d3/d1c/f2e 14553 1 2024-08-01T06:56:09.925 INFO:tasks.workunit.client.0.smithi016.stdout:4/117: creat d0/d2/f25 x:0 0 0 2024-08-01T06:56:09.926 INFO:tasks.workunit.client.0.smithi016.stdout:4/118: dread - d0/d2/dc/d12/f24 zero size 2024-08-01T06:56:09.928 INFO:tasks.workunit.client.0.smithi016.stdout:1/154: unlink d2/d3/d1a/d22/f2c 0 2024-08-01T06:56:09.929 INFO:tasks.workunit.client.0.smithi016.stdout:1/155: chown d2/d3/d1a/d22 2237 1 2024-08-01T06:56:09.929 INFO:tasks.workunit.client.0.smithi016.stdout:5/103: dread d1/d12/f16 [0,4194304] 0 2024-08-01T06:56:09.930 INFO:tasks.workunit.client.0.smithi016.stdout:5/104: stat d1/d2/d6/d9 0 2024-08-01T06:56:09.930 INFO:tasks.workunit.client.0.smithi016.stdout:4/119: mkdir d0/d17/d22/d26 0 2024-08-01T06:56:09.931 INFO:tasks.workunit.client.0.smithi016.stdout:4/120: stat d0/d2/fa 0 2024-08-01T06:56:09.932 INFO:tasks.workunit.client.0.smithi016.stdout:5/105: dread - d1/d2/d6/d9/d1b/f1f zero size 2024-08-01T06:56:09.932 INFO:tasks.workunit.client.0.smithi016.stdout:1/156: symlink d2/d3/l30 0 2024-08-01T06:56:09.933 INFO:tasks.workunit.client.0.smithi016.stdout:1/157: write d2/fc [2774847,641] 0 2024-08-01T06:56:09.933 INFO:tasks.workunit.client.0.smithi016.stdout:4/121: symlink d0/d2/l27 0 2024-08-01T06:56:09.935 INFO:tasks.workunit.client.0.smithi016.stdout:1/158: write d2/f19 [1816717,125622] 0 2024-08-01T06:56:09.941 INFO:tasks.workunit.client.0.smithi016.stdout:5/106: truncate d1/d2/d6/fd 2410358 0 2024-08-01T06:56:09.943 INFO:tasks.workunit.client.0.smithi016.stdout:1/159: dwrite d2/f12 [0,4194304] 0 2024-08-01T06:56:09.943 INFO:tasks.workunit.client.0.smithi016.stdout:4/122: mknod d0/c28 0 2024-08-01T06:56:09.945 INFO:tasks.workunit.client.0.smithi016.stdout:1/160: write d2/d3/d1c/f2b [1021680,104788] 0 2024-08-01T06:56:09.945 INFO:tasks.workunit.client.0.smithi016.stdout:5/107: creat d1/d2/d6/d9/f24 x:0 0 0 2024-08-01T06:56:09.945 INFO:tasks.workunit.client.0.smithi016.stdout:3/54: sync 2024-08-01T06:56:09.948 INFO:tasks.workunit.client.0.smithi016.stdout:4/123: mkdir d0/d2/dc/d12/d29 0 2024-08-01T06:56:09.949 INFO:tasks.workunit.client.0.smithi016.stdout:5/108: symlink d1/d2/d6/d9/l25 0 2024-08-01T06:56:09.950 INFO:tasks.workunit.client.0.smithi016.stdout:5/109: stat d1/d2/d6/d9/f22 0 2024-08-01T06:56:09.951 INFO:tasks.workunit.client.0.smithi016.stdout:1/161: creat d2/de/f31 x:0 0 0 2024-08-01T06:56:09.953 INFO:tasks.workunit.client.0.smithi016.stdout:3/55: rename d9/d10 to d9/da/d18 0 2024-08-01T06:56:09.954 INFO:tasks.workunit.client.0.smithi016.stdout:4/124: creat d0/d2/f2a x:0 0 0 2024-08-01T06:56:09.957 INFO:tasks.workunit.client.0.smithi016.stdout:1/162: mkdir d2/de/d32 0 2024-08-01T06:56:09.958 INFO:tasks.workunit.client.0.smithi016.stdout:5/110: creat d1/d2/d23/f26 x:0 0 0 2024-08-01T06:56:09.961 INFO:tasks.workunit.client.0.smithi016.stdout:3/56: dwrite d9/da/df/d12/f15 [0,4194304] 0 2024-08-01T06:56:09.961 INFO:tasks.workunit.client.0.smithi016.stdout:5/111: write d1/d2/d6/d9/f22 [136023,57892] 0 2024-08-01T06:56:09.963 INFO:tasks.workunit.client.0.smithi016.stdout:1/163: link f0 d2/d2f/f33 0 2024-08-01T06:56:09.964 INFO:tasks.workunit.client.0.smithi016.stdout:3/57: symlink d9/l19 0 2024-08-01T06:56:09.966 INFO:tasks.workunit.client.0.smithi016.stdout:5/112: creat d1/d2/d6/f27 x:0 0 0 2024-08-01T06:56:09.967 INFO:tasks.workunit.client.0.smithi016.stdout:3/58: symlink d9/da/l1a 0 2024-08-01T06:56:09.970 INFO:tasks.workunit.client.0.smithi016.stdout:5/113: stat d1/d2/d6/fd 0 2024-08-01T06:56:09.972 INFO:tasks.workunit.client.0.smithi016.stdout:3/59: symlink d9/da/df/d12/l1b 0 2024-08-01T06:56:09.973 INFO:tasks.workunit.client.0.smithi016.stdout:1/164: dread d2/f19 [0,4194304] 0 2024-08-01T06:56:09.973 INFO:tasks.workunit.client.0.smithi016.stdout:3/60: write f3 [8626001,45766] 0 2024-08-01T06:56:09.974 INFO:tasks.workunit.client.0.smithi016.stdout:5/114: creat d1/d2/d6/d9/d1b/f28 x:0 0 0 2024-08-01T06:56:09.974 INFO:tasks.workunit.client.0.smithi016.stdout:1/165: write d2/f24 [149784,18175] 0 2024-08-01T06:56:09.976 INFO:tasks.workunit.client.0.smithi016.stdout:5/115: chown d1/d12/f16 0 1 2024-08-01T06:56:09.977 INFO:tasks.workunit.client.0.smithi016.stdout:3/61: mkdir d9/d1c 0 2024-08-01T06:56:09.979 INFO:tasks.workunit.client.0.smithi016.stdout:1/166: unlink d2/d3/lb 0 2024-08-01T06:56:09.979 INFO:tasks.workunit.client.0.smithi016.stdout:3/62: read - d9/da/df/f17 zero size 2024-08-01T06:56:09.982 INFO:tasks.workunit.client.0.smithi016.stdout:3/63: fsync d9/da/fb 0 2024-08-01T06:56:09.982 INFO:tasks.workunit.client.0.smithi016.stdout:4/125: truncate d0/fb 7646523 0 2024-08-01T06:56:09.987 INFO:tasks.workunit.client.0.smithi016.stdout:5/116: dwrite d1/d2/d6/d9/f24 [0,4194304] 0 2024-08-01T06:56:09.992 INFO:tasks.workunit.client.0.smithi016.stdout:5/117: truncate d1/d2/d23/f26 181982 0 2024-08-01T06:56:09.994 INFO:tasks.workunit.client.0.smithi016.stdout:4/126: rename d0/d2/f4 to d0/d2/dc/f2b 0 2024-08-01T06:56:09.995 INFO:tasks.workunit.client.0.smithi016.stdout:5/118: chown d1/d2/d20 5623 1 2024-08-01T06:56:09.997 INFO:tasks.workunit.client.0.smithi016.stdout:3/64: dwrite d9/da/df/d12/f15 [4194304,4194304] 0 2024-08-01T06:56:10.000 INFO:tasks.workunit.client.0.smithi016.stdout:3/65: write d9/da/fb [1079358,7212] 0 2024-08-01T06:56:10.004 INFO:tasks.workunit.client.0.smithi016.stdout:5/119: creat d1/d2/d6/f29 x:0 0 0 2024-08-01T06:56:10.004 INFO:tasks.workunit.client.0.smithi016.stdout:1/167: truncate d2/d3/d1c/f2b 556516 0 2024-08-01T06:56:10.004 INFO:tasks.workunit.client.0.smithi016.stdout:5/120: stat d1/fb 0 2024-08-01T06:56:10.008 INFO:tasks.workunit.client.0.smithi016.stdout:5/121: chown d1/d2/d6/d9 62 1 2024-08-01T06:56:10.013 INFO:tasks.workunit.client.0.smithi016.stdout:4/127: dwrite d0/d2/f11 [0,4194304] 0 2024-08-01T06:56:10.013 INFO:tasks.workunit.client.0.smithi016.stdout:3/66: dwrite f3 [0,4194304] 0 2024-08-01T06:56:10.020 INFO:tasks.workunit.client.0.smithi016.stdout:5/122: rename d1/d2/d6/f27 to d1/d2/d6/d9/d19/f2a 0 2024-08-01T06:56:10.020 INFO:tasks.workunit.client.0.smithi016.stdout:3/67: write d9/da/df/d12/f15 [9273841,84759] 0 2024-08-01T06:56:10.020 INFO:tasks.workunit.client.0.smithi016.stdout:1/168: write d2/de/f10 [2296149,1772] 0 2024-08-01T06:56:10.020 INFO:tasks.workunit.client.0.smithi016.stdout:3/68: stat d9/da/fb 0 2024-08-01T06:56:10.023 INFO:tasks.workunit.client.0.smithi016.stdout:5/123: fsync d1/f5 0 2024-08-01T06:56:10.024 INFO:tasks.workunit.client.0.smithi016.stdout:4/128: truncate d0/d2/fa 3131071 0 2024-08-01T06:56:10.027 INFO:tasks.workunit.client.0.smithi016.stdout:3/69: mknod d9/da/df/d12/c1d 0 2024-08-01T06:56:10.027 INFO:tasks.workunit.client.0.smithi016.stdout:4/129: read d0/d2/dc/f15 [1156301,31093] 0 2024-08-01T06:56:10.030 INFO:tasks.workunit.client.0.smithi016.stdout:3/70: symlink d9/da/df/d12/l1e 0 2024-08-01T06:56:10.032 INFO:tasks.workunit.client.0.smithi016.stdout:1/169: creat d2/d3/f34 x:0 0 0 2024-08-01T06:56:10.033 INFO:tasks.workunit.client.0.smithi016.stdout:5/124: truncate d1/d2/f10 718612 0 2024-08-01T06:56:10.036 INFO:tasks.workunit.client.1.smithi089.stdout:2/956: sync 2024-08-01T06:56:10.037 INFO:tasks.workunit.client.0.smithi016.stdout:4/130: dwrite d0/d2/dc/f1e [0,4194304] 0 2024-08-01T06:56:10.040 INFO:tasks.workunit.client.0.smithi016.stdout:1/170: rename d2/f19 to d2/d3/d1c/f35 0 2024-08-01T06:56:10.043 INFO:tasks.workunit.client.1.smithi089.stdout:2/957: creat d7/d1f/d29/f12f x:0 0 0 2024-08-01T06:56:10.046 INFO:tasks.workunit.client.0.smithi016.stdout:3/71: dwrite d9/da/df/d12/f15 [0,4194304] 0 2024-08-01T06:56:10.046 INFO:tasks.workunit.client.0.smithi016.stdout:5/125: dread d1/d2/d6/d9/f24 [0,4194304] 0 2024-08-01T06:56:10.048 INFO:tasks.workunit.client.1.smithi089.stdout:2/958: link f2 d7/d19/dc5/d10b/f130 0 2024-08-01T06:56:10.051 INFO:tasks.workunit.client.0.smithi016.stdout:3/72: unlink d9/l19 0 2024-08-01T06:56:10.055 INFO:tasks.workunit.client.0.smithi016.stdout:5/126: mknod d1/d2/d6/c2b 0 2024-08-01T06:56:10.056 INFO:tasks.workunit.client.0.smithi016.stdout:4/131: dwrite d0/d2/dc/d12/f24 [0,4194304] 0 2024-08-01T06:56:10.057 INFO:tasks.workunit.client.1.smithi089.stdout:2/959: dread d7/d1f/d29/db7/fc1 [0,4194304] 0 2024-08-01T06:56:10.057 INFO:tasks.workunit.client.0.smithi016.stdout:5/127: write d1/d2/d6/d9/f21 [325212,85860] 0 2024-08-01T06:56:10.058 INFO:tasks.workunit.client.0.smithi016.stdout:3/73: creat d9/f1f x:0 0 0 2024-08-01T06:56:10.060 INFO:tasks.workunit.client.0.smithi016.stdout:3/74: chown d9/da/df/f17 24079835 1 2024-08-01T06:56:10.060 INFO:tasks.workunit.client.1.smithi089.stdout:2/960: fdatasync d7/d1f/fba 0 2024-08-01T06:56:10.061 INFO:tasks.workunit.client.0.smithi016.stdout:5/128: read d1/d2/d6/d9/f22 [70227,28321] 0 2024-08-01T06:56:10.062 INFO:tasks.workunit.client.1.smithi089.stdout:2/961: write d7/d19/d1e/f30 [2882331,13408] 0 2024-08-01T06:56:10.066 INFO:tasks.workunit.client.0.smithi016.stdout:5/129: truncate d1/d2/d6/d9/d1b/f1f 343649 0 2024-08-01T06:56:10.066 INFO:tasks.workunit.client.0.smithi016.stdout:3/75: dread d9/da/fb [0,4194304] 0 2024-08-01T06:56:10.069 INFO:tasks.workunit.client.1.smithi089.stdout:2/962: creat d7/d19/dc5/d10b/f131 x:0 0 0 2024-08-01T06:56:10.072 INFO:tasks.workunit.client.0.smithi016.stdout:1/171: truncate d2/de/d21/f23 1880719 0 2024-08-01T06:56:10.073 INFO:tasks.workunit.client.0.smithi016.stdout:5/130: symlink d1/d2/d6/d9/d19/l2c 0 2024-08-01T06:56:10.077 INFO:tasks.workunit.client.0.smithi016.stdout:4/132: link d0/d2/l7 d0/d17/d22/d26/l2c 0 2024-08-01T06:56:10.078 INFO:tasks.workunit.client.0.smithi016.stdout:4/133: chown d0/d2/dc/f1e 1 1 2024-08-01T06:56:10.079 INFO:tasks.workunit.client.0.smithi016.stdout:5/131: symlink d1/l2d 0 2024-08-01T06:56:10.080 INFO:tasks.workunit.client.0.smithi016.stdout:1/172: chown d2/d3/d1a/d22/l2d 0 1 2024-08-01T06:56:10.080 INFO:tasks.workunit.client.0.smithi016.stdout:4/134: symlink d0/d17/l2d 0 2024-08-01T06:56:10.081 INFO:tasks.workunit.client.1.smithi089.stdout:2/963: getdents d7/d19/d68 0 2024-08-01T06:56:10.081 INFO:tasks.workunit.client.1.smithi089.stdout:2/964: chown d7/d19/fd6 71776663 1 2024-08-01T06:56:10.083 INFO:tasks.workunit.client.0.smithi016.stdout:1/173: creat d2/d3/d1c/f36 x:0 0 0 2024-08-01T06:56:10.087 INFO:tasks.workunit.client.0.smithi016.stdout:4/135: rename d0/d2/c1d to d0/d17/d22/d26/c2e 0 2024-08-01T06:56:10.087 INFO:tasks.workunit.client.0.smithi016.stdout:5/132: dwrite d1/d2/d6/d9/f21 [0,4194304] 0 2024-08-01T06:56:10.089 INFO:tasks.workunit.client.1.smithi089.stdout:2/965: rename d7/d19/d1e/d5b to d7/d1f/d29/d48/da9/d132 0 2024-08-01T06:56:10.090 INFO:tasks.workunit.client.1.smithi089.stdout:2/966: dread - d7/d19/dc5/dcc/d64/d9c/f118 zero size 2024-08-01T06:56:10.091 INFO:tasks.workunit.client.0.smithi016.stdout:3/76: truncate d9/da/fb 4856168 0 2024-08-01T06:56:10.094 INFO:tasks.workunit.client.0.smithi016.stdout:1/174: dwrite d2/d3/d1a/f20 [0,4194304] 0 2024-08-01T06:56:10.095 INFO:tasks.workunit.client.0.smithi016.stdout:3/77: mkdir d9/da/df/d12/d20 0 2024-08-01T06:56:10.095 INFO:tasks.workunit.client.0.smithi016.stdout:3/78: chown d9/da 7892634 1 2024-08-01T06:56:10.096 INFO:tasks.workunit.client.1.smithi089.stdout:2/967: symlink d7/d19/dc5/dcc/d64/l133 0 2024-08-01T06:56:10.097 INFO:tasks.workunit.client.1.smithi089.stdout:2/968: dread d7/d1f/d29/db7/fc1 [0,4194304] 0 2024-08-01T06:56:10.102 INFO:tasks.workunit.client.1.smithi089.stdout:2/969: mkdir d7/d1f/d52/d6e/d134 0 2024-08-01T06:56:10.105 INFO:tasks.workunit.client.0.smithi016.stdout:1/175: rmdir d2/d3 39 2024-08-01T06:56:10.106 INFO:tasks.workunit.client.0.smithi016.stdout:3/79: dwrite d9/f1f [0,4194304] 0 2024-08-01T06:56:10.111 INFO:tasks.workunit.client.0.smithi016.stdout:3/80: symlink d9/l21 0 2024-08-01T06:56:10.113 INFO:tasks.workunit.client.0.smithi016.stdout:1/176: write d2/de/f14 [83197,15190] 0 2024-08-01T06:56:10.121 INFO:tasks.workunit.client.0.smithi016.stdout:4/136: dwrite d0/d2/dc/ff [0,4194304] 0 2024-08-01T06:56:10.124 INFO:tasks.workunit.client.0.smithi016.stdout:5/133: dwrite d1/d2/d6/d9/f22 [0,4194304] 0 2024-08-01T06:56:10.125 INFO:tasks.workunit.client.0.smithi016.stdout:4/137: unlink d0/c1b 0 2024-08-01T06:56:10.126 INFO:tasks.workunit.client.0.smithi016.stdout:1/177: dread d2/d3/fd [0,4194304] 0 2024-08-01T06:56:10.131 INFO:tasks.workunit.client.0.smithi016.stdout:1/178: creat d2/de/f37 x:0 0 0 2024-08-01T06:56:10.131 INFO:tasks.workunit.client.0.smithi016.stdout:5/134: mknod d1/d2/d6/d9/d19/c2e 0 2024-08-01T06:56:10.137 INFO:tasks.workunit.client.0.smithi016.stdout:4/138: dread d0/fb [4194304,4194304] 0 2024-08-01T06:56:10.137 INFO:tasks.workunit.client.0.smithi016.stdout:3/81: dwrite d9/fd [0,4194304] 0 2024-08-01T06:56:10.163 INFO:tasks.workunit.client.0.smithi016.stdout:5/135: truncate d1/d2/d6/d9/d1b/f1f 692152 0 2024-08-01T06:56:10.165 INFO:tasks.workunit.client.0.smithi016.stdout:4/139: chown d0/d2/dc/l10 33509877 1 2024-08-01T06:56:10.165 INFO:tasks.workunit.client.0.smithi016.stdout:5/136: stat d1/d2/d6/d9/la 0 2024-08-01T06:56:10.168 INFO:tasks.workunit.client.0.smithi016.stdout:1/179: dwrite d2/f1b [0,4194304] 0 2024-08-01T06:56:10.168 INFO:tasks.workunit.client.0.smithi016.stdout:4/140: stat d0/f1 0 2024-08-01T06:56:10.174 INFO:tasks.workunit.client.0.smithi016.stdout:4/141: creat d0/d17/f2f x:0 0 0 2024-08-01T06:56:10.177 INFO:tasks.workunit.client.0.smithi016.stdout:5/137: rename d1/d2/d6/l8 to d1/d2/d23/l2f 0 2024-08-01T06:56:10.178 INFO:tasks.workunit.client.0.smithi016.stdout:1/180: creat d2/de/f38 x:0 0 0 2024-08-01T06:56:10.178 INFO:tasks.workunit.client.0.smithi016.stdout:4/142: creat d0/d17/f30 x:0 0 0 2024-08-01T06:56:10.179 INFO:tasks.workunit.client.0.smithi016.stdout:3/82: dwrite d9/da/df/f17 [0,4194304] 0 2024-08-01T06:56:10.187 INFO:tasks.workunit.client.0.smithi016.stdout:3/83: chown d9/da/fb 62646951 1 2024-08-01T06:56:10.187 INFO:tasks.workunit.client.0.smithi016.stdout:4/143: rename d0/d2/dc/f1e to d0/d17/d22/f31 0 2024-08-01T06:56:10.189 INFO:tasks.workunit.client.1.smithi089.stdout:3/973: sync 2024-08-01T06:56:10.189 INFO:tasks.workunit.client.1.smithi089.stdout:9/960: sync 2024-08-01T06:56:10.190 INFO:tasks.workunit.client.0.smithi016.stdout:5/138: link d1/d2/d6/d9/f21 d1/d12/f30 0 2024-08-01T06:56:10.190 INFO:tasks.workunit.client.0.smithi016.stdout:1/181: dwrite d2/de/f10 [0,4194304] 0 2024-08-01T06:56:10.192 INFO:tasks.workunit.client.0.smithi016.stdout:1/182: dread - d2/de/f38 zero size 2024-08-01T06:56:10.193 INFO:tasks.workunit.client.0.smithi016.stdout:4/144: creat d0/d17/f32 x:0 0 0 2024-08-01T06:56:10.197 INFO:tasks.workunit.client.1.smithi089.stdout:3/974: mkdir d7/d32/d12/d29/d39/d4b/df5/d148 0 2024-08-01T06:56:10.199 INFO:tasks.workunit.client.0.smithi016.stdout:3/84: link f3 d9/da/f22 0 2024-08-01T06:56:10.201 INFO:tasks.workunit.client.0.smithi016.stdout:1/183: fdatasync d2/f17 0 2024-08-01T06:56:10.201 INFO:tasks.workunit.client.0.smithi016.stdout:3/85: write d9/da/df/d12/f15 [2359674,114099] 0 2024-08-01T06:56:10.203 INFO:tasks.workunit.client.0.smithi016.stdout:4/145: link d0/d2/dc/d12/f24 d0/d2/f33 0 2024-08-01T06:56:10.203 INFO:tasks.workunit.client.1.smithi089.stdout:3/975: dwrite d7/d32/d4c/d69/d6d/dc7/fe2 [0,4194304] 0 2024-08-01T06:56:10.205 INFO:tasks.workunit.client.0.smithi016.stdout:5/139: getdents d1/d2/d6/d9/d1b 0 2024-08-01T06:56:10.205 INFO:tasks.workunit.client.1.smithi089.stdout:3/976: dread - d7/d32/d4c/d69/d6d/f124 zero size 2024-08-01T06:56:10.205 INFO:tasks.workunit.client.1.smithi089.stdout:3/977: chown d7 1111740 1 2024-08-01T06:56:10.206 INFO:tasks.workunit.client.0.smithi016.stdout:1/184: creat d2/d3/d1f/f39 x:0 0 0 2024-08-01T06:56:10.208 INFO:tasks.workunit.client.0.smithi016.stdout:3/86: symlink d9/da/df/d12/l23 0 2024-08-01T06:56:10.220 INFO:tasks.workunit.client.0.smithi016.stdout:5/140: link d1/d2/d6/d9/d19/f2a d1/d2/f31 0 2024-08-01T06:56:10.221 INFO:tasks.workunit.client.0.smithi016.stdout:1/185: creat d2/de/d32/f3a x:0 0 0 2024-08-01T06:56:10.222 INFO:tasks.workunit.client.1.smithi089.stdout:3/978: write d7/d32/d12/d1b/f3c [237934,101111] 0 2024-08-01T06:56:10.224 INFO:tasks.workunit.client.1.smithi089.stdout:3/979: chown d7/d32/d12/d29/d39/d4b/dd2 0 1 2024-08-01T06:56:10.225 INFO:tasks.workunit.client.0.smithi016.stdout:5/141: creat d1/d2/d23/f32 x:0 0 0 2024-08-01T06:56:10.225 INFO:tasks.workunit.client.0.smithi016.stdout:4/146: getdents d0/d17/d22 0 2024-08-01T06:56:10.226 INFO:tasks.workunit.client.1.smithi089.stdout:3/980: fsync d7/d68/d50/d119/f134 0 2024-08-01T06:56:10.227 INFO:tasks.workunit.client.0.smithi016.stdout:5/142: fdatasync d1/d2/d6/d9/f22 0 2024-08-01T06:56:10.230 INFO:tasks.workunit.client.0.smithi016.stdout:1/186: symlink d2/d2f/l3b 0 2024-08-01T06:56:10.230 INFO:tasks.workunit.client.0.smithi016.stdout:3/87: truncate d9/da/df/f17 3988673 0 2024-08-01T06:56:10.231 INFO:tasks.workunit.client.0.smithi016.stdout:3/88: stat d9/f1f 0 2024-08-01T06:56:10.232 INFO:tasks.workunit.client.1.smithi089.stdout:3/981: creat d7/d32/d4c/d67/d72/d91/dcb/d78/f149 x:0 0 0 2024-08-01T06:56:10.233 INFO:tasks.workunit.client.0.smithi016.stdout:5/143: dread d1/d2/d6/d9/f21 [0,4194304] 0 2024-08-01T06:56:10.234 INFO:tasks.workunit.client.0.smithi016.stdout:4/147: creat d0/d2/dc/f34 x:0 0 0 2024-08-01T06:56:10.236 INFO:tasks.workunit.client.1.smithi089.stdout:3/982: creat d7/d32/d4c/d67/d72/f14a x:0 0 0 2024-08-01T06:56:10.237 INFO:tasks.workunit.client.0.smithi016.stdout:4/148: truncate d0/d2/dc/ff 4546538 0 2024-08-01T06:56:10.241 INFO:tasks.workunit.client.1.smithi089.stdout:3/983: dread d7/d32/d4c/d67/d72/d91/dcb/da9/fde [0,4194304] 0 2024-08-01T06:56:10.245 INFO:tasks.workunit.client.0.smithi016.stdout:5/144: rename d1/d2/d6/d9/d19/f2a to d1/d2/d23/f33 0 2024-08-01T06:56:10.247 INFO:tasks.workunit.client.0.smithi016.stdout:5/145: write d1/d2/d23/f26 [19251,78140] 0 2024-08-01T06:56:10.251 INFO:tasks.workunit.client.1.smithi089.stdout:3/984: write d7/d32/d12/d29/d39/d4b/f143 [1149230,63183] 0 2024-08-01T06:56:10.251 INFO:tasks.workunit.client.0.smithi016.stdout:4/149: fdatasync d0/d17/d22/f31 0 2024-08-01T06:56:10.252 INFO:tasks.workunit.client.1.smithi089.stdout:3/985: readlink d7/d32/d12/d29/d39/d4b/deb/lff 0 2024-08-01T06:56:10.252 INFO:tasks.workunit.client.1.smithi089.stdout:3/986: read d7/d68/d50/d119/f134 [624560,126012] 0 2024-08-01T06:56:10.255 INFO:tasks.workunit.client.0.smithi016.stdout:5/146: unlink d1/d2/d6/d9/f24 0 2024-08-01T06:56:10.258 INFO:tasks.workunit.client.0.smithi016.stdout:5/147: dread - d1/d2/d6/f29 zero size 2024-08-01T06:56:10.259 INFO:tasks.workunit.client.1.smithi089.stdout:3/987: dwrite d7/d68/d50/d6f/d2f/f12f [0,4194304] 0 2024-08-01T06:56:10.259 INFO:tasks.workunit.client.1.smithi089.stdout:3/988: fdatasync d7/d68/fb8 0 2024-08-01T06:56:10.262 INFO:tasks.workunit.client.1.smithi089.stdout:3/989: fdatasync d7/d32/d12/d29/d39/d4b/d83/f9b 0 2024-08-01T06:56:10.262 INFO:tasks.workunit.client.1.smithi089.stdout:3/990: chown d7/d32/d12/d1b 472093 1 2024-08-01T06:56:10.263 INFO:tasks.workunit.client.0.smithi016.stdout:4/150: dread d0/d2/f33 [0,4194304] 0 2024-08-01T06:56:10.263 INFO:tasks.workunit.client.0.smithi016.stdout:5/148: rmdir d1/d2/d23 39 2024-08-01T06:56:10.265 INFO:tasks.workunit.client.0.smithi016.stdout:5/149: rmdir d1 39 2024-08-01T06:56:10.268 INFO:tasks.workunit.client.0.smithi016.stdout:1/187: dwrite d2/d3/d1c/f2b [0,4194304] 0 2024-08-01T06:56:10.268 INFO:tasks.workunit.client.1.smithi089.stdout:3/991: dread d7/d68/d50/d6f/d2f/d9c/fd0 [0,4194304] 0 2024-08-01T06:56:10.270 INFO:tasks.workunit.client.0.smithi016.stdout:3/89: dwrite f3 [8388608,4194304] 0 2024-08-01T06:56:10.273 INFO:tasks.workunit.client.0.smithi016.stdout:1/188: creat d2/d3/d1a/f3c x:0 0 0 2024-08-01T06:56:10.274 INFO:tasks.workunit.client.0.smithi016.stdout:5/150: chown d1 120800 1 2024-08-01T06:56:10.275 INFO:tasks.workunit.client.0.smithi016.stdout:3/90: write d9/da/f22 [7998586,60128] 0 2024-08-01T06:56:10.276 INFO:tasks.workunit.client.0.smithi016.stdout:1/189: rmdir d2/de/d21 39 2024-08-01T06:56:10.276 INFO:tasks.workunit.client.0.smithi016.stdout:4/151: write d0/d2/f33 [318751,81746] 0 2024-08-01T06:56:10.276 INFO:tasks.workunit.client.0.smithi016.stdout:5/151: creat d1/d2/d6/d9/f34 x:0 0 0 2024-08-01T06:56:10.277 INFO:tasks.workunit.client.0.smithi016.stdout:3/91: chown d9/da/f22 1414 1 2024-08-01T06:56:10.281 INFO:tasks.workunit.client.0.smithi016.stdout:7/94: sync 2024-08-01T06:56:10.283 INFO:tasks.workunit.client.0.smithi016.stdout:1/190: creat d2/d3/d1a/d22/f3d x:0 0 0 2024-08-01T06:56:10.284 INFO:tasks.workunit.client.0.smithi016.stdout:1/191: write d2/de/d32/f3a [886750,127108] 0 2024-08-01T06:56:10.285 INFO:tasks.workunit.client.0.smithi016.stdout:4/152: rename d0/d2/dc/ff to d0/d17/d22/f35 0 2024-08-01T06:56:10.286 INFO:tasks.workunit.client.0.smithi016.stdout:7/95: readlink d7/ld 0 2024-08-01T06:56:10.293 INFO:tasks.workunit.client.0.smithi016.stdout:1/192: mkdir d2/de/d21/d3e 0 2024-08-01T06:56:10.297 INFO:tasks.workunit.client.0.smithi016.stdout:7/96: dread f5 [4194304,4194304] 0 2024-08-01T06:56:10.298 INFO:tasks.workunit.client.0.smithi016.stdout:4/153: dwrite d0/d2/f11 [0,4194304] 0 2024-08-01T06:56:10.299 INFO:tasks.workunit.client.0.smithi016.stdout:5/152: dwrite d1/d2/d23/f32 [0,4194304] 0 2024-08-01T06:56:10.299 INFO:tasks.workunit.client.0.smithi016.stdout:1/193: dread d2/f24 [0,4194304] 0 2024-08-01T06:56:10.301 INFO:tasks.workunit.client.0.smithi016.stdout:3/92: truncate d9/fd 552908 0 2024-08-01T06:56:10.306 INFO:tasks.workunit.client.0.smithi016.stdout:7/97: write d7/db/d1a/da/f10 [779103,80665] 0 2024-08-01T06:56:10.306 INFO:tasks.workunit.client.0.smithi016.stdout:7/98: chown d7/f18 7967 1 2024-08-01T06:56:10.306 INFO:tasks.workunit.client.0.smithi016.stdout:3/93: read d9/da/f22 [10541477,117700] 0 2024-08-01T06:56:10.307 INFO:tasks.workunit.client.0.smithi016.stdout:5/153: symlink d1/d2/l35 0 2024-08-01T06:56:10.311 INFO:tasks.workunit.client.0.smithi016.stdout:1/194: creat d2/d3/f3f x:0 0 0 2024-08-01T06:56:10.312 INFO:tasks.workunit.client.0.smithi016.stdout:3/94: mknod d9/da/c24 0 2024-08-01T06:56:10.313 INFO:tasks.workunit.client.0.smithi016.stdout:7/99: symlink d7/db/d1a/da/dc/l25 0 2024-08-01T06:56:10.315 INFO:tasks.workunit.client.0.smithi016.stdout:5/154: dread d1/f5 [0,4194304] 0 2024-08-01T06:56:10.316 INFO:tasks.workunit.client.0.smithi016.stdout:7/100: chown d7/l21 130549147 1 2024-08-01T06:56:10.316 INFO:tasks.workunit.client.0.smithi016.stdout:1/195: rmdir d2/d3/d1a/d22 39 2024-08-01T06:56:10.317 INFO:tasks.workunit.client.0.smithi016.stdout:4/154: dwrite d0/d17/d22/f35 [0,4194304] 0 2024-08-01T06:56:10.320 INFO:tasks.workunit.client.0.smithi016.stdout:7/101: write d7/db/d1a/da/f10 [1846342,124013] 0 2024-08-01T06:56:10.320 INFO:tasks.workunit.client.0.smithi016.stdout:1/196: mknod d2/de/d32/c40 0 2024-08-01T06:56:10.321 INFO:tasks.workunit.client.0.smithi016.stdout:5/155: truncate d1/d2/d6/f29 898725 0 2024-08-01T06:56:10.323 INFO:tasks.workunit.client.0.smithi016.stdout:4/155: mkdir d0/d2/d36 0 2024-08-01T06:56:10.324 INFO:tasks.workunit.client.0.smithi016.stdout:1/197: readlink d2/l1e 0 2024-08-01T06:56:10.326 INFO:tasks.workunit.client.0.smithi016.stdout:4/156: rmdir d0/d2/dc/d12 39 2024-08-01T06:56:10.326 INFO:tasks.workunit.client.0.smithi016.stdout:7/102: dread d7/db/f13 [0,4194304] 0 2024-08-01T06:56:10.328 INFO:tasks.workunit.client.0.smithi016.stdout:5/156: mknod d1/d2/d6/d9/c36 0 2024-08-01T06:56:10.329 INFO:tasks.workunit.client.0.smithi016.stdout:3/95: truncate d9/f1f 1224077 0 2024-08-01T06:56:10.331 INFO:tasks.workunit.client.0.smithi016.stdout:7/103: mkdir d7/db/d1a/da/d1e/d26 0 2024-08-01T06:56:10.332 INFO:tasks.workunit.client.0.smithi016.stdout:1/198: mkdir d2/d3/d41 0 2024-08-01T06:56:10.335 INFO:tasks.workunit.client.0.smithi016.stdout:3/96: creat d9/da/df/d12/f25 x:0 0 0 2024-08-01T06:56:10.336 INFO:tasks.workunit.client.0.smithi016.stdout:4/157: dwrite d0/f23 [0,4194304] 0 2024-08-01T06:56:10.339 INFO:tasks.workunit.client.0.smithi016.stdout:7/104: creat d7/db/d1a/da/d22/f27 x:0 0 0 2024-08-01T06:56:10.340 INFO:tasks.workunit.client.0.smithi016.stdout:5/157: getdents d1/d12 0 2024-08-01T06:56:10.343 INFO:tasks.workunit.client.1.smithi089.stdout:2/970: sync 2024-08-01T06:56:10.343 INFO:tasks.workunit.client.0.smithi016.stdout:4/158: creat d0/d2/f37 x:0 0 0 2024-08-01T06:56:10.343 INFO:tasks.workunit.client.1.smithi089.stdout:2/971: chown d7/d1f/f4b 4588 1 2024-08-01T06:56:10.346 INFO:tasks.workunit.client.0.smithi016.stdout:7/105: creat d7/db/f28 x:0 0 0 2024-08-01T06:56:10.347 INFO:tasks.workunit.client.0.smithi016.stdout:5/158: mkdir d1/d37 0 2024-08-01T06:56:10.348 INFO:tasks.workunit.client.0.smithi016.stdout:3/97: creat d9/da/df/d12/d20/f26 x:0 0 0 2024-08-01T06:56:10.349 INFO:tasks.workunit.client.0.smithi016.stdout:4/159: unlink d0/d17/l19 0 2024-08-01T06:56:10.351 INFO:tasks.workunit.client.1.smithi089.stdout:2/972: creat d7/d19/dc5/dcc/f135 x:0 0 0 2024-08-01T06:56:10.352 INFO:tasks.workunit.client.0.smithi016.stdout:7/106: creat d7/db/d1a/da/dc/f29 x:0 0 0 2024-08-01T06:56:10.353 INFO:tasks.workunit.client.0.smithi016.stdout:4/160: unlink d0/c21 0 2024-08-01T06:56:10.354 INFO:tasks.workunit.client.0.smithi016.stdout:5/159: mkdir d1/d2/d20/d38 0 2024-08-01T06:56:10.355 INFO:tasks.workunit.client.0.smithi016.stdout:3/98: creat d9/d1c/f27 x:0 0 0 2024-08-01T06:56:10.356 INFO:tasks.workunit.client.0.smithi016.stdout:5/160: dread - d1/d2/d23/f33 zero size 2024-08-01T06:56:10.357 INFO:tasks.workunit.client.0.smithi016.stdout:7/107: mkdir d7/db/d1a/da/d1e/d26/d2a 0 2024-08-01T06:56:10.358 INFO:tasks.workunit.client.1.smithi089.stdout:2/973: getdents d7/d1f/d52/d6e 0 2024-08-01T06:56:10.361 INFO:tasks.workunit.client.1.smithi089.stdout:2/974: creat d7/d1f/d29/d48/f136 x:0 0 0 2024-08-01T06:56:10.361 INFO:tasks.workunit.client.0.smithi016.stdout:3/99: dread d9/fd [0,4194304] 0 2024-08-01T06:56:10.363 INFO:tasks.workunit.client.0.smithi016.stdout:7/108: rename d7/db/d1a/da to d7/db/d1a/da/d2b 22 2024-08-01T06:56:10.364 INFO:tasks.workunit.client.1.smithi089.stdout:2/975: rmdir d7/d19/dc5/d10b 39 2024-08-01T06:56:10.365 INFO:tasks.workunit.client.0.smithi016.stdout:4/161: dwrite d0/d17/f32 [0,4194304] 0 2024-08-01T06:56:10.367 INFO:tasks.workunit.client.0.smithi016.stdout:4/162: chown d0/d17 0 1 2024-08-01T06:56:10.367 INFO:tasks.workunit.client.0.smithi016.stdout:3/100: symlink d9/da/df/d12/l28 0 2024-08-01T06:56:10.368 INFO:tasks.workunit.client.0.smithi016.stdout:7/109: write d7/db/d1a/da/f10 [1524537,73945] 0 2024-08-01T06:56:10.371 INFO:tasks.workunit.client.0.smithi016.stdout:5/161: dwrite d1/d2/d6/d9/d1b/f1f [0,4194304] 0 2024-08-01T06:56:10.374 INFO:tasks.workunit.client.0.smithi016.stdout:5/162: write d1/d2/d6/d9/f13 [2775834,57598] 0 2024-08-01T06:56:10.376 INFO:tasks.workunit.client.0.smithi016.stdout:3/101: creat d9/f29 x:0 0 0 2024-08-01T06:56:10.377 INFO:tasks.workunit.client.0.smithi016.stdout:5/163: write d1/d2/d6/f29 [1497537,76726] 0 2024-08-01T06:56:10.382 INFO:tasks.workunit.client.0.smithi016.stdout:3/102: write d9/da/df/d12/f15 [7214703,31173] 0 2024-08-01T06:56:10.383 INFO:tasks.workunit.client.0.smithi016.stdout:3/103: write d9/d1c/f27 [65009,97361] 0 2024-08-01T06:56:10.383 INFO:tasks.workunit.client.1.smithi089.stdout:2/976: link d7/d19/dc5/dcc/d9e/fc6 d7/d19/d1e/d3d/d60/f137 0 2024-08-01T06:56:10.385 INFO:tasks.workunit.client.0.smithi016.stdout:5/164: dread d1/d2/d6/d9/d1b/f1f [0,4194304] 0 2024-08-01T06:56:10.386 INFO:tasks.workunit.client.0.smithi016.stdout:7/110: mkdir d7/db/d17/d2c 0 2024-08-01T06:56:10.387 INFO:tasks.workunit.client.1.smithi089.stdout:2/977: mkdir d7/d19/d68/d114/d138 0 2024-08-01T06:56:10.388 INFO:tasks.workunit.client.1.smithi089.stdout:2/978: readlink d7/d19/d1e/d3d/l45 0 2024-08-01T06:56:10.389 INFO:tasks.workunit.client.0.smithi016.stdout:7/111: mkdir d7/db/d1a/d2d 0 2024-08-01T06:56:10.390 INFO:tasks.workunit.client.0.smithi016.stdout:5/165: mkdir d1/d2/d6/d9/d19/d39 0 2024-08-01T06:56:10.390 INFO:tasks.workunit.client.1.smithi089.stdout:2/979: write d7/d1f/d52/d6e/f102 [4839062,129968] 0 2024-08-01T06:56:10.391 INFO:tasks.workunit.client.0.smithi016.stdout:4/163: getdents d0 0 2024-08-01T06:56:10.392 INFO:tasks.workunit.client.0.smithi016.stdout:4/164: dread - d0/d2/f25 zero size 2024-08-01T06:56:10.396 INFO:tasks.workunit.client.0.smithi016.stdout:4/165: mkdir d0/d17/d38 0 2024-08-01T06:56:10.398 INFO:tasks.workunit.client.0.smithi016.stdout:3/104: getdents d9/da 0 2024-08-01T06:56:10.399 INFO:tasks.workunit.client.0.smithi016.stdout:7/112: dwrite f5 [0,4194304] 0 2024-08-01T06:56:10.400 INFO:tasks.workunit.client.0.smithi016.stdout:3/105: write d9/f29 [9954,18552] 0 2024-08-01T06:56:10.402 INFO:tasks.workunit.client.0.smithi016.stdout:7/113: read - d7/f11 zero size 2024-08-01T06:56:10.409 INFO:tasks.workunit.client.0.smithi016.stdout:4/166: dwrite d0/d17/f30 [0,4194304] 0 2024-08-01T06:56:10.411 INFO:tasks.workunit.client.0.smithi016.stdout:5/166: dwrite d1/d2/d23/f33 [0,4194304] 0 2024-08-01T06:56:10.414 INFO:tasks.workunit.client.0.smithi016.stdout:3/106: write d9/da/df/f17 [1532822,108061] 0 2024-08-01T06:56:10.417 INFO:tasks.workunit.client.0.smithi016.stdout:5/167: mkdir d1/d2/d23/d3a 0 2024-08-01T06:56:10.419 INFO:tasks.workunit.client.0.smithi016.stdout:7/114: dwrite d7/db/f13 [0,4194304] 0 2024-08-01T06:56:10.421 INFO:tasks.workunit.client.1.smithi089.stdout:9/961: sync 2024-08-01T06:56:10.424 INFO:tasks.workunit.client.1.smithi089.stdout:9/962: fsync d18/d22/f48 0 2024-08-01T06:56:10.428 INFO:tasks.workunit.client.1.smithi089.stdout:9/963: symlink d18/d33/d49/d7b/d81/d10b/l141 0 2024-08-01T06:56:10.429 INFO:tasks.workunit.client.1.smithi089.stdout:9/964: readlink d18/d33/df7/da6/lfe 0 2024-08-01T06:56:10.432 INFO:tasks.workunit.client.1.smithi089.stdout:9/965: rename d18/dec/f13a to d18/d22/d39/d50/f142 0 2024-08-01T06:56:10.445 INFO:tasks.workunit.client.0.smithi016.stdout:7/115: unlink d7/db/d1a/da/dc/c16 0 2024-08-01T06:56:10.446 INFO:tasks.workunit.client.0.smithi016.stdout:5/168: creat d1/d2/d23/d3a/f3b x:0 0 0 2024-08-01T06:56:10.446 INFO:tasks.workunit.client.0.smithi016.stdout:4/167: dwrite d0/d2/f1c [0,4194304] 0 2024-08-01T06:56:10.448 INFO:tasks.workunit.client.0.smithi016.stdout:4/168: write d0/f23 [5194090,130296] 0 2024-08-01T06:56:10.449 INFO:tasks.workunit.client.0.smithi016.stdout:7/116: write d7/db/d1a/da/dc/f29 [67140,125079] 0 2024-08-01T06:56:10.449 INFO:tasks.workunit.client.0.smithi016.stdout:5/169: creat d1/f3c x:0 0 0 2024-08-01T06:56:10.451 INFO:tasks.workunit.client.0.smithi016.stdout:4/169: creat d0/d17/f39 x:0 0 0 2024-08-01T06:56:10.452 INFO:tasks.workunit.client.0.smithi016.stdout:7/117: write d7/db/d1a/da/dc/f15 [132864,42383] 0 2024-08-01T06:56:10.456 INFO:tasks.workunit.client.1.smithi089.stdout:9/966: truncate d18/d22/d52/fea 467137 0 2024-08-01T06:56:10.457 INFO:tasks.workunit.client.1.smithi089.stdout:9/967: symlink d18/d33/df7/d11f/l143 0 2024-08-01T06:56:10.459 INFO:tasks.workunit.client.1.smithi089.stdout:9/968: creat d18/d33/d49/d7b/d115/f144 x:0 0 0 2024-08-01T06:56:10.461 INFO:tasks.workunit.client.1.smithi089.stdout:9/969: mknod d18/d33/d49/d7b/d4b/db6/df8/c145 0 2024-08-01T06:56:10.470 INFO:tasks.workunit.client.1.smithi089.stdout:9/970: write d18/f23 [1840451,13405] 0 2024-08-01T06:56:10.475 INFO:tasks.workunit.client.1.smithi089.stdout:9/971: write d18/d22/d39/d95/f9b [1211401,34077] 0 2024-08-01T06:56:10.477 INFO:tasks.workunit.client.1.smithi089.stdout:9/972: mknod d18/d33/d6e/dd1/c146 0 2024-08-01T06:56:10.484 INFO:tasks.workunit.client.1.smithi089.stdout:9/973: dwrite f10 [0,4194304] 0 2024-08-01T06:56:10.491 INFO:tasks.workunit.client.1.smithi089.stdout:9/974: unlink d18/da4/c11a 0 2024-08-01T06:56:10.492 INFO:tasks.workunit.client.1.smithi089.stdout:9/975: write d18/d22/d39/f10d [318418,5912] 0 2024-08-01T06:56:10.500 INFO:tasks.workunit.client.1.smithi089.stdout:9/976: rename d18/d33/d49/d7b/d7f/d98/d9f/d8e/de0/ff4 to d18/d33/d3b/f147 0 2024-08-01T06:56:10.507 INFO:tasks.workunit.client.1.smithi089.stdout:9/977: truncate d18/d22/d39/d95/f9b 2230227 0 2024-08-01T06:56:10.507 INFO:tasks.workunit.client.1.smithi089.stdout:9/978: dread - d18/d33/d3b/f147 zero size 2024-08-01T06:56:10.510 INFO:tasks.workunit.client.1.smithi089.stdout:3/992: sync 2024-08-01T06:56:10.510 INFO:tasks.workunit.client.1.smithi089.stdout:9/979: unlink d18/d33/df7/l5b 0 2024-08-01T06:56:10.512 INFO:tasks.workunit.client.1.smithi089.stdout:3/993: unlink d7/d68/d50/d6f/d2f/d9c/fd0 0 2024-08-01T06:56:10.515 INFO:tasks.workunit.client.1.smithi089.stdout:9/980: symlink d18/d33/df7/d11f/d129/l148 0 2024-08-01T06:56:10.515 INFO:tasks.workunit.client.1.smithi089.stdout:3/994: truncate d7/d32/d4c/d67/d72/d91/d117/f138 132258 0 2024-08-01T06:56:10.518 INFO:tasks.workunit.client.1.smithi089.stdout:9/981: creat d18/d33/d49/d7b/d7f/d98/d9f/d8e/de0/f149 x:0 0 0 2024-08-01T06:56:10.520 INFO:tasks.workunit.client.1.smithi089.stdout:3/995: link d7/d32/d4c/d67/d72/d91/dcb/d78/f8f d7/d32/d9f/dfa/f14b 0 2024-08-01T06:56:10.526 INFO:tasks.workunit.client.1.smithi089.stdout:3/996: dwrite d7/d32/d9f/fe6 [0,4194304] 0 2024-08-01T06:56:10.527 INFO:tasks.workunit.client.0.smithi016.stdout:8/93: sync 2024-08-01T06:56:10.527 INFO:tasks.workunit.client.0.smithi016.stdout:2/66: sync 2024-08-01T06:56:10.527 INFO:tasks.workunit.client.0.smithi016.stdout:0/121: sync 2024-08-01T06:56:10.528 INFO:tasks.workunit.client.0.smithi016.stdout:9/109: sync 2024-08-01T06:56:10.528 INFO:tasks.workunit.client.0.smithi016.stdout:6/133: sync 2024-08-01T06:56:10.530 INFO:tasks.workunit.client.1.smithi089.stdout:3/997: creat d7/d68/d50/d6f/d2f/da2/da8/d129/d136/f14c x:0 0 0 2024-08-01T06:56:10.532 INFO:tasks.workunit.client.0.smithi016.stdout:2/67: fdatasync d0/f10 0 2024-08-01T06:56:10.532 INFO:tasks.workunit.client.0.smithi016.stdout:5/170: link d1/d2/d23/f33 d1/d2/d23/f3d 0 2024-08-01T06:56:10.533 INFO:tasks.workunit.client.0.smithi016.stdout:7/118: rmdir d7/db 39 2024-08-01T06:56:10.534 INFO:tasks.workunit.client.0.smithi016.stdout:2/68: rename d0/d8 to d0/d8/d15 22 2024-08-01T06:56:10.534 INFO:tasks.workunit.client.0.smithi016.stdout:5/171: fdatasync d1/d2/d23/d3a/f3b 0 2024-08-01T06:56:10.535 INFO:tasks.workunit.client.0.smithi016.stdout:5/172: stat d1/l2d 0 2024-08-01T06:56:10.535 INFO:tasks.workunit.client.1.smithi089.stdout:3/998: creat d7/d32/d4c/d67/d72/d91/dcb/dfd/f14d x:0 0 0 2024-08-01T06:56:10.536 INFO:tasks.workunit.client.0.smithi016.stdout:4/170: dread d0/f8 [0,4194304] 0 2024-08-01T06:56:10.537 INFO:tasks.workunit.client.0.smithi016.stdout:4/171: chown d0/l13 325 1 2024-08-01T06:56:10.537 INFO:tasks.workunit.client.0.smithi016.stdout:8/94: creat d5/f1b x:0 0 0 2024-08-01T06:56:10.538 INFO:tasks.workunit.client.0.smithi016.stdout:9/110: mknod d3/d4/c25 0 2024-08-01T06:56:10.539 INFO:tasks.workunit.client.0.smithi016.stdout:4/172: chown d0/d2/f2a 361174818 1 2024-08-01T06:56:10.541 INFO:tasks.workunit.client.1.smithi089.stdout:3/999: mknod d7/d32/d4c/d53/c14e 0 2024-08-01T06:56:10.541 INFO:tasks.workunit.client.0.smithi016.stdout:6/134: mknod d1/c32 0 2024-08-01T06:56:10.545 INFO:tasks.workunit.client.0.smithi016.stdout:0/122: write d10/f16 [2020876,9228] 0 2024-08-01T06:56:10.547 INFO:tasks.workunit.client.0.smithi016.stdout:5/173: dwrite d1/fb [0,4194304] 0 2024-08-01T06:56:10.547 INFO:tasks.workunit.client.0.smithi016.stdout:9/111: symlink d3/d9/l26 0 2024-08-01T06:56:10.548 INFO:tasks.workunit.client.0.smithi016.stdout:2/69: mkdir d0/d16 0 2024-08-01T06:56:10.549 INFO:tasks.workunit.client.0.smithi016.stdout:4/173: rmdir d0/d17/d22/d26 39 2024-08-01T06:56:10.550 INFO:tasks.workunit.client.0.smithi016.stdout:0/123: chown ca 28773 1 2024-08-01T06:56:10.550 INFO:tasks.workunit.client.0.smithi016.stdout:7/119: creat d7/db/d1a/f2e x:0 0 0 2024-08-01T06:56:10.551 INFO:tasks.workunit.client.0.smithi016.stdout:2/70: dread - d0/d8/f11 zero size 2024-08-01T06:56:10.553 INFO:tasks.workunit.client.0.smithi016.stdout:8/95: dwrite d5/f11 [0,4194304] 0 2024-08-01T06:56:10.553 INFO:tasks.workunit.client.0.smithi016.stdout:6/135: rename d1/d8/l16 to d1/l33 0 2024-08-01T06:56:10.555 INFO:tasks.workunit.client.0.smithi016.stdout:0/124: fdatasync f9 0 2024-08-01T06:56:10.561 INFO:tasks.workunit.client.0.smithi016.stdout:5/174: write d1/d2/d6/d9/d1b/f1f [4284698,67959] 0 2024-08-01T06:56:10.561 INFO:tasks.workunit.client.0.smithi016.stdout:7/120: symlink d7/db/d1a/da/d1e/l2f 0 2024-08-01T06:56:10.561 INFO:tasks.workunit.client.0.smithi016.stdout:5/175: write d1/d12/f16 [1410442,63554] 0 2024-08-01T06:56:10.564 INFO:tasks.workunit.client.0.smithi016.stdout:7/121: truncate d7/db/d1a/da/dc/f29 291785 0 2024-08-01T06:56:10.565 INFO:tasks.workunit.client.0.smithi016.stdout:0/125: creat d10/d1c/f29 x:0 0 0 2024-08-01T06:56:10.568 INFO:tasks.workunit.client.0.smithi016.stdout:9/112: truncate d3/de/f14 113664 0 2024-08-01T06:56:10.571 INFO:tasks.workunit.client.0.smithi016.stdout:6/136: mkdir d1/d8/d34 0 2024-08-01T06:56:10.574 INFO:tasks.workunit.client.0.smithi016.stdout:9/113: creat d3/d9/db/dc/f27 x:0 0 0 2024-08-01T06:56:10.574 INFO:tasks.workunit.client.0.smithi016.stdout:6/137: read d1/d8/f1a [174857,59154] 0 2024-08-01T06:56:10.575 INFO:tasks.workunit.client.0.smithi016.stdout:0/126: dwrite d10/d1c/f29 [0,4194304] 0 2024-08-01T06:56:10.575 INFO:tasks.workunit.client.0.smithi016.stdout:7/122: creat d7/db/d1a/da/d1e/d26/d2a/f30 x:0 0 0 2024-08-01T06:56:10.577 INFO:tasks.workunit.client.0.smithi016.stdout:2/71: getdents d0/d8 0 2024-08-01T06:56:10.577 INFO:tasks.workunit.client.0.smithi016.stdout:4/174: write d0/d2/dc/f2b [4162902,39080] 0 2024-08-01T06:56:10.579 INFO:tasks.workunit.client.0.smithi016.stdout:9/114: creat d3/f28 x:0 0 0 2024-08-01T06:56:10.582 INFO:tasks.workunit.client.0.smithi016.stdout:0/127: creat d10/d11/d18/f2a x:0 0 0 2024-08-01T06:56:10.584 INFO:tasks.workunit.client.0.smithi016.stdout:0/128: stat d10/d1c/c24 0 2024-08-01T06:56:10.585 INFO:tasks.workunit.client.0.smithi016.stdout:4/175: chown d0/d2/dc/d12 93 1 2024-08-01T06:56:10.588 INFO:tasks.workunit.client.0.smithi016.stdout:9/115: mknod d3/d9/db/c29 0 2024-08-01T06:56:10.590 INFO:tasks.workunit.client.0.smithi016.stdout:8/96: dwrite d5/dc/f17 [0,4194304] 0 2024-08-01T06:56:10.592 INFO:tasks.workunit.client.0.smithi016.stdout:8/97: chown d5/d8/d1a 10 1 2024-08-01T06:56:10.594 INFO:tasks.workunit.client.0.smithi016.stdout:0/129: rename d10/d1c/f25 to d10/d11/d18/f2b 0 2024-08-01T06:56:10.595 INFO:tasks.workunit.client.0.smithi016.stdout:4/176: rename d0/d2/dc/d12/d29 to d0/d2/dc/d12/d29/d3a 22 2024-08-01T06:56:10.597 INFO:tasks.workunit.client.0.smithi016.stdout:8/98: truncate d5/d8/d18/f19 448786 0 2024-08-01T06:56:10.597 INFO:tasks.workunit.client.0.smithi016.stdout:5/176: dwrite d1/d2/d6/fd [0,4194304] 0 2024-08-01T06:56:10.598 INFO:tasks.workunit.client.0.smithi016.stdout:2/72: creat d0/f17 x:0 0 0 2024-08-01T06:56:10.599 INFO:tasks.workunit.client.0.smithi016.stdout:7/123: rmdir d7/db/d1a/d2d 0 2024-08-01T06:56:10.600 INFO:tasks.workunit.client.0.smithi016.stdout:9/116: mkdir d3/d9/df/d2a 0 2024-08-01T06:56:10.603 INFO:tasks.workunit.client.0.smithi016.stdout:5/177: truncate d1/d2/f31 4211290 0 2024-08-01T06:56:10.606 INFO:tasks.workunit.client.0.smithi016.stdout:8/99: rmdir d5/d8 39 2024-08-01T06:56:10.606 INFO:tasks.workunit.client.0.smithi016.stdout:0/130: symlink d10/d11/d18/l2c 0 2024-08-01T06:56:10.607 INFO:tasks.workunit.client.0.smithi016.stdout:6/138: dwrite d1/d9/f21 [0,4194304] 0 2024-08-01T06:56:10.611 INFO:tasks.workunit.client.0.smithi016.stdout:2/73: creat d0/d8/f18 x:0 0 0 2024-08-01T06:56:10.611 INFO:tasks.workunit.client.0.smithi016.stdout:9/117: fsync d3/de/f13 0 2024-08-01T06:56:10.613 INFO:tasks.workunit.client.0.smithi016.stdout:0/131: unlink d10/d1c/c1d 0 2024-08-01T06:56:10.618 INFO:tasks.workunit.client.1.smithi089.stdout:2/980: sync 2024-08-01T06:56:10.618 INFO:tasks.workunit.client.0.smithi016.stdout:8/100: mkdir d5/d1c 0 2024-08-01T06:56:10.620 INFO:tasks.workunit.client.0.smithi016.stdout:5/178: dwrite d1/d2/d23/f26 [0,4194304] 0 2024-08-01T06:56:10.625 INFO:tasks.workunit.client.0.smithi016.stdout:7/124: link l1 d7/db/d1a/da/d1e/l31 0 2024-08-01T06:56:10.625 INFO:tasks.workunit.client.0.smithi016.stdout:0/132: dread d10/d1c/f29 [0,4194304] 0 2024-08-01T06:56:10.626 INFO:tasks.workunit.client.0.smithi016.stdout:2/74: mkdir d0/d19 0 2024-08-01T06:56:10.626 INFO:tasks.workunit.client.0.smithi016.stdout:6/139: dwrite d1/d8/d1b/d22/f29 [0,4194304] 0 2024-08-01T06:56:10.626 INFO:tasks.workunit.client.0.smithi016.stdout:0/133: chown f6 4445722 1 2024-08-01T06:56:10.627 INFO:tasks.workunit.client.0.smithi016.stdout:2/75: chown d0/d8/c13 103 1 2024-08-01T06:56:10.628 INFO:tasks.workunit.client.0.smithi016.stdout:7/125: chown d7/db/d1a/da/d1e/d26/d2a 51712 1 2024-08-01T06:56:10.630 INFO:tasks.workunit.client.0.smithi016.stdout:9/118: creat d3/d9/df/d16/f2b x:0 0 0 2024-08-01T06:56:10.631 INFO:tasks.workunit.client.0.smithi016.stdout:9/119: dread - d3/d9/df/d16/f1e zero size 2024-08-01T06:56:10.633 INFO:tasks.workunit.client.0.smithi016.stdout:9/120: fdatasync d3/d4/f11 0 2024-08-01T06:56:10.633 INFO:tasks.workunit.client.0.smithi016.stdout:9/121: fdatasync d3/f24 0 2024-08-01T06:56:10.634 INFO:tasks.workunit.client.0.smithi016.stdout:5/179: mkdir d1/d12/d3e 0 2024-08-01T06:56:10.634 INFO:tasks.workunit.client.0.smithi016.stdout:4/177: getdents d0/d2/dc 0 2024-08-01T06:56:10.637 INFO:tasks.workunit.client.0.smithi016.stdout:5/180: stat d1/d2/d6/d9 0 2024-08-01T06:56:10.638 INFO:tasks.workunit.client.0.smithi016.stdout:5/181: write d1/f3c [521882,68381] 0 2024-08-01T06:56:10.639 INFO:tasks.workunit.client.0.smithi016.stdout:7/126: creat d7/db/d1a/da/d1e/d26/f32 x:0 0 0 2024-08-01T06:56:10.641 INFO:tasks.workunit.client.0.smithi016.stdout:7/127: dread - d7/db/f28 zero size 2024-08-01T06:56:10.641 INFO:tasks.workunit.client.0.smithi016.stdout:9/122: dread d3/de/f13 [0,4194304] 0 2024-08-01T06:56:10.642 INFO:tasks.workunit.client.0.smithi016.stdout:2/76: mknod d0/c1a 0 2024-08-01T06:56:10.642 INFO:tasks.workunit.client.0.smithi016.stdout:8/101: mknod d5/d8/d1a/c1d 0 2024-08-01T06:56:10.643 INFO:tasks.workunit.client.0.smithi016.stdout:4/178: mknod d0/d2/dc/d12/d29/c3b 0 2024-08-01T06:56:10.646 INFO:tasks.workunit.client.0.smithi016.stdout:9/123: stat d3/d9/db/l1f 0 2024-08-01T06:56:10.646 INFO:tasks.workunit.client.0.smithi016.stdout:2/77: mkdir d0/d8/d1b 0 2024-08-01T06:56:10.647 INFO:tasks.workunit.client.1.smithi089.stdout:2/981: write d7/d1f/d28/fd9 [170814,103052] 0 2024-08-01T06:56:10.649 INFO:tasks.workunit.client.0.smithi016.stdout:2/78: read - d0/fb zero size 2024-08-01T06:56:10.650 INFO:tasks.workunit.client.0.smithi016.stdout:0/134: write d10/d1c/f20 [993664,44807] 0 2024-08-01T06:56:10.650 INFO:tasks.workunit.client.0.smithi016.stdout:8/102: mknod d5/d8/d1a/c1e 0 2024-08-01T06:56:10.651 INFO:tasks.workunit.client.0.smithi016.stdout:6/140: dwrite d1/d9/fb [0,4194304] 0 2024-08-01T06:56:10.651 INFO:tasks.workunit.client.0.smithi016.stdout:7/128: mknod d7/db/d1a/da/d1e/d26/c33 0 2024-08-01T06:56:10.652 INFO:tasks.workunit.client.0.smithi016.stdout:4/179: mkdir d0/d2/dc/d12/d29/d3c 0 2024-08-01T06:56:10.657 INFO:tasks.workunit.client.0.smithi016.stdout:2/79: creat d0/d8/d1b/f1c x:0 0 0 2024-08-01T06:56:10.658 INFO:tasks.workunit.client.0.smithi016.stdout:4/180: write d0/fb [835632,82796] 0 2024-08-01T06:56:10.658 INFO:tasks.workunit.client.0.smithi016.stdout:8/103: symlink d5/d1c/l1f 0 2024-08-01T06:56:10.661 INFO:tasks.workunit.client.0.smithi016.stdout:6/141: creat d1/d8/d1b/f35 x:0 0 0 2024-08-01T06:56:10.661 INFO:tasks.workunit.client.0.smithi016.stdout:7/129: write d7/db/d1a/da/f10 [1474596,37855] 0 2024-08-01T06:56:10.664 INFO:tasks.workunit.client.0.smithi016.stdout:8/104: write d5/d8/d18/f19 [1309741,43119] 0 2024-08-01T06:56:10.664 INFO:tasks.workunit.client.0.smithi016.stdout:5/182: dwrite d1/d2/d6/d9/d1b/f28 [0,4194304] 0 2024-08-01T06:56:10.664 INFO:tasks.workunit.client.0.smithi016.stdout:0/135: fsync d10/d11/d18/f2b 0 2024-08-01T06:56:10.666 INFO:tasks.workunit.client.0.smithi016.stdout:9/124: link d3/d4/f19 d3/d9/db/dc/f2c 0 2024-08-01T06:56:10.667 INFO:tasks.workunit.client.0.smithi016.stdout:4/181: mknod d0/d2/c3d 0 2024-08-01T06:56:10.668 INFO:tasks.workunit.client.0.smithi016.stdout:6/142: mkdir d1/d8/d1b/d22/d36 0 2024-08-01T06:56:10.669 INFO:tasks.workunit.client.0.smithi016.stdout:2/80: mkdir d0/d1d 0 2024-08-01T06:56:10.676 INFO:tasks.workunit.client.1.smithi089.stdout:9/982: sync 2024-08-01T06:56:10.686 INFO:tasks.workunit.client.1.smithi089.stdout:2/982: dread f2 [4194304,4194304] 0 2024-08-01T06:56:10.686 INFO:tasks.workunit.client.1.smithi089.stdout:2/983: readlink d7/d1f/d28/lde 0 2024-08-01T06:56:10.686 INFO:tasks.workunit.client.1.smithi089.stdout:2/984: chown d7/d19/fd6 199 1 2024-08-01T06:56:10.714 INFO:tasks.workunit.client.0.smithi016.stdout:8/105: symlink d5/d1c/l20 0 2024-08-01T06:56:10.719 INFO:tasks.workunit.client.0.smithi016.stdout:5/183: mknod d1/d2/d20/d38/c3f 0 2024-08-01T06:56:10.721 INFO:tasks.workunit.client.0.smithi016.stdout:4/182: mknod d0/d17/d22/c3e 0 2024-08-01T06:56:10.724 INFO:tasks.workunit.client.0.smithi016.stdout:5/184: dread d1/d2/d23/f32 [0,4194304] 0 2024-08-01T06:56:10.725 INFO:tasks.workunit.client.0.smithi016.stdout:0/136: dwrite d10/d11/d18/f2b [0,4194304] 0 2024-08-01T06:56:10.731 INFO:tasks.workunit.client.0.smithi016.stdout:8/106: truncate d5/f12 3154718 0 2024-08-01T06:56:10.732 INFO:tasks.workunit.client.0.smithi016.stdout:8/107: stat d5 0 2024-08-01T06:56:10.734 INFO:tasks.workunit.client.0.smithi016.stdout:5/185: creat d1/d2/d6/d9/d19/f40 x:0 0 0 2024-08-01T06:56:10.735 INFO:tasks.workunit.client.0.smithi016.stdout:5/186: chown d1/d2/d6/d9/d19/d39 649376765 1 2024-08-01T06:56:10.736 INFO:tasks.workunit.client.0.smithi016.stdout:8/108: read d5/d8/d18/f19 [1144758,115070] 0 2024-08-01T06:56:10.737 INFO:tasks.workunit.client.0.smithi016.stdout:0/137: dwrite d10/f28 [0,4194304] 0 2024-08-01T06:56:10.737 INFO:tasks.workunit.client.0.smithi016.stdout:4/183: creat d0/d2/dc/d12/d29/d3c/f3f x:0 0 0 2024-08-01T06:56:10.738 INFO:tasks.workunit.client.0.smithi016.stdout:0/138: readlink d10/d1c/l22 0 2024-08-01T06:56:10.740 INFO:tasks.workunit.client.0.smithi016.stdout:8/109: read d5/dc/f17 [2591311,97632] 0 2024-08-01T06:56:10.741 INFO:tasks.workunit.client.0.smithi016.stdout:0/139: write d10/d11/d18/f2b [1095788,54866] 0 2024-08-01T06:56:10.744 INFO:tasks.workunit.client.0.smithi016.stdout:6/143: dread d1/d8/fa [0,4194304] 0 2024-08-01T06:56:10.748 INFO:tasks.workunit.client.0.smithi016.stdout:5/187: rename d1/d2/d6/d9/l25 to d1/d37/l41 0 2024-08-01T06:56:10.749 INFO:tasks.workunit.client.0.smithi016.stdout:4/184: dwrite d0/d2/f25 [0,4194304] 0 2024-08-01T06:56:10.749 INFO:tasks.workunit.client.0.smithi016.stdout:5/188: chown d1/d12 209529 1 2024-08-01T06:56:10.754 INFO:tasks.workunit.client.0.smithi016.stdout:0/140: mknod d10/d11/d18/c2d 0 2024-08-01T06:56:10.755 INFO:tasks.workunit.client.0.smithi016.stdout:0/141: readlink d10/d1c/l22 0 2024-08-01T06:56:10.761 INFO:tasks.workunit.client.0.smithi016.stdout:8/110: rename d5/dc/l14 to d5/d8/l21 0 2024-08-01T06:56:10.764 INFO:tasks.workunit.client.0.smithi016.stdout:4/185: symlink d0/d2/dc/d12/d29/d3c/l40 0 2024-08-01T06:56:10.768 INFO:tasks.workunit.client.0.smithi016.stdout:6/144: creat d1/d8/d34/f37 x:0 0 0 2024-08-01T06:56:10.770 INFO:tasks.workunit.client.0.smithi016.stdout:6/145: chown d1/d8/d34/f37 365697 1 2024-08-01T06:56:10.772 INFO:tasks.workunit.client.0.smithi016.stdout:0/142: dwrite d10/d1c/f29 [0,4194304] 0 2024-08-01T06:56:10.772 INFO:tasks.workunit.client.0.smithi016.stdout:5/189: creat d1/d12/d3e/f42 x:0 0 0 2024-08-01T06:56:10.774 INFO:tasks.workunit.client.0.smithi016.stdout:4/186: mknod d0/d2/dc/d12/d29/c41 0 2024-08-01T06:56:10.774 INFO:tasks.workunit.client.0.smithi016.stdout:8/111: dread d5/dc/f17 [0,4194304] 0 2024-08-01T06:56:10.776 INFO:tasks.workunit.client.0.smithi016.stdout:6/146: creat d1/d8/d34/f38 x:0 0 0 2024-08-01T06:56:10.779 INFO:tasks.workunit.client.0.smithi016.stdout:0/143: fsync d10/f17 0 2024-08-01T06:56:10.779 INFO:tasks.workunit.client.0.smithi016.stdout:4/187: creat d0/d2/dc/f42 x:0 0 0 2024-08-01T06:56:10.780 INFO:tasks.workunit.client.0.smithi016.stdout:8/112: creat d5/dc/f22 x:0 0 0 2024-08-01T06:56:10.781 INFO:tasks.workunit.client.0.smithi016.stdout:6/147: readlink d1/l2b 0 2024-08-01T06:56:10.788 INFO:tasks.workunit.client.0.smithi016.stdout:0/144: creat d10/f2e x:0 0 0 2024-08-01T06:56:10.791 INFO:tasks.workunit.client.0.smithi016.stdout:6/148: mkdir d1/d8/d34/d39 0 2024-08-01T06:56:10.793 INFO:tasks.workunit.client.0.smithi016.stdout:6/149: chown d1/l2b 480353240 1 2024-08-01T06:56:10.794 INFO:tasks.workunit.client.0.smithi016.stdout:5/190: creat d1/d2/f43 x:0 0 0 2024-08-01T06:56:10.797 INFO:tasks.workunit.client.0.smithi016.stdout:8/113: dwrite d5/d8/d18/f19 [0,4194304] 0 2024-08-01T06:56:10.798 INFO:tasks.workunit.client.0.smithi016.stdout:8/114: chown d5/l6 14990 1 2024-08-01T06:56:10.798 INFO:tasks.workunit.client.0.smithi016.stdout:0/145: rename d10/f16 to d10/d11/d18/f2f 0 2024-08-01T06:56:10.801 INFO:tasks.workunit.client.0.smithi016.stdout:6/150: dread d1/d8/d1b/d22/f29 [0,4194304] 0 2024-08-01T06:56:10.803 INFO:tasks.workunit.client.0.smithi016.stdout:5/191: mknod d1/c44 0 2024-08-01T06:56:10.804 INFO:tasks.workunit.client.0.smithi016.stdout:0/146: dread d10/f28 [0,4194304] 0 2024-08-01T06:56:10.804 INFO:tasks.workunit.client.1.smithi089.stdout:2/985: mkdir d7/d1f/d29/d116/d139 0 2024-08-01T06:56:10.805 INFO:tasks.workunit.client.0.smithi016.stdout:0/147: write ff [2979343,80517] 0 2024-08-01T06:56:10.811 INFO:tasks.workunit.client.1.smithi089.stdout:9/983: getdents d18/d33/d102 0 2024-08-01T06:56:10.811 INFO:tasks.workunit.client.0.smithi016.stdout:8/115: read d5/f12 [1101482,67056] 0 2024-08-01T06:56:10.813 INFO:tasks.workunit.client.0.smithi016.stdout:6/151: symlink d1/d8/d1b/d22/d2d/l3a 0 2024-08-01T06:56:10.815 INFO:tasks.workunit.client.1.smithi089.stdout:2/986: dwrite d7/d1f/d52/d72/fec [0,4194304] 0 2024-08-01T06:56:10.819 INFO:tasks.workunit.client.0.smithi016.stdout:8/116: symlink d5/dc/l23 0 2024-08-01T06:56:10.820 INFO:tasks.workunit.client.0.smithi016.stdout:5/192: creat d1/d2/d6/d9/d19/d39/f45 x:0 0 0 2024-08-01T06:56:10.821 INFO:tasks.workunit.client.1.smithi089.stdout:2/987: mknod d7/dd7/c13a 0 2024-08-01T06:56:10.822 INFO:tasks.workunit.client.1.smithi089.stdout:2/988: chown d7/d1f/d29/db7/fc1 448 1 2024-08-01T06:56:10.823 INFO:tasks.workunit.client.0.smithi016.stdout:0/148: dwrite d10/d11/f14 [0,4194304] 0 2024-08-01T06:56:10.825 INFO:tasks.workunit.client.0.smithi016.stdout:5/193: unlink d1/d12/c1c 0 2024-08-01T06:56:10.826 INFO:tasks.workunit.client.0.smithi016.stdout:5/194: write d1/d2/d6/d9/f22 [262346,13778] 0 2024-08-01T06:56:10.828 INFO:tasks.workunit.client.0.smithi016.stdout:8/117: rename d5/d8/d18 to d5/d8/d1a/d24 0 2024-08-01T06:56:10.828 INFO:tasks.workunit.client.1.smithi089.stdout:2/989: dwrite d7/d19/f94 [0,4194304] 0 2024-08-01T06:56:10.832 INFO:tasks.workunit.client.0.smithi016.stdout:5/195: chown d1/d37/l41 4081531 1 2024-08-01T06:56:10.835 INFO:tasks.workunit.client.0.smithi016.stdout:8/118: unlink d5/dc/f22 0 2024-08-01T06:56:10.837 INFO:tasks.workunit.client.1.smithi089.stdout:2/990: dwrite d7/d73/f74 [0,4194304] 0 2024-08-01T06:56:10.844 INFO:tasks.workunit.client.0.smithi016.stdout:8/119: dread d5/dc/f17 [0,4194304] 0 2024-08-01T06:56:10.844 INFO:tasks.workunit.client.0.smithi016.stdout:0/149: link cb d10/c30 0 2024-08-01T06:56:10.845 INFO:tasks.workunit.client.1.smithi089.stdout:2/991: mknod d7/d1f/d29/db7/dd3/c13b 0 2024-08-01T06:56:10.846 INFO:tasks.workunit.client.0.smithi016.stdout:4/188: fsync d0/d2/dc/d12/f24 0 2024-08-01T06:56:10.847 INFO:tasks.workunit.client.0.smithi016.stdout:4/189: fdatasync d0/d2/f2a 0 2024-08-01T06:56:10.850 INFO:tasks.workunit.client.1.smithi089.stdout:2/992: mknod d7/d19/d3b/d7c/c13c 0 2024-08-01T06:56:10.852 INFO:tasks.workunit.client.0.smithi016.stdout:0/150: symlink d10/d1c/l31 0 2024-08-01T06:56:10.854 INFO:tasks.workunit.client.0.smithi016.stdout:4/190: creat d0/d17/d38/f43 x:0 0 0 2024-08-01T06:56:10.856 INFO:tasks.workunit.client.0.smithi016.stdout:4/191: write d0/d17/f39 [737658,107248] 0 2024-08-01T06:56:10.859 INFO:tasks.workunit.client.0.smithi016.stdout:0/151: truncate fd 2152395 0 2024-08-01T06:56:10.859 INFO:tasks.workunit.client.0.smithi016.stdout:0/152: chown d10/d11/c26 6743 1 2024-08-01T06:56:10.861 INFO:tasks.workunit.client.1.smithi089.stdout:2/993: rename d7/d19/dc5/dcc/d64/d9c/f118 to d7/d19/f13d 0 2024-08-01T06:56:10.863 INFO:tasks.workunit.client.1.smithi089.stdout:2/994: truncate d7/d1f/d29/d48/f120 778288 0 2024-08-01T06:56:10.863 INFO:tasks.workunit.client.0.smithi016.stdout:0/153: symlink d10/d11/d18/l32 0 2024-08-01T06:56:10.863 INFO:tasks.workunit.client.0.smithi016.stdout:4/192: rmdir d0/d17/d22/d26 39 2024-08-01T06:56:10.866 INFO:tasks.workunit.client.0.smithi016.stdout:4/193: rmdir d0/d2/dc/d12/d29/d3c 39 2024-08-01T06:56:10.871 INFO:tasks.workunit.client.0.smithi016.stdout:4/194: getdents d0/d17/d22/d26 0 2024-08-01T06:56:10.874 INFO:tasks.workunit.client.0.smithi016.stdout:4/195: getdents d0/d2/d36 0 2024-08-01T06:56:10.875 INFO:tasks.workunit.client.0.smithi016.stdout:6/152: dwrite d1/f2 [0,4194304] 0 2024-08-01T06:56:10.876 INFO:tasks.workunit.client.0.smithi016.stdout:5/196: truncate d1/f5 2907445 0 2024-08-01T06:56:10.877 INFO:tasks.workunit.client.0.smithi016.stdout:6/153: chown d1/d8/d1b/d22/d2d/l3a 484361 1 2024-08-01T06:56:10.882 INFO:tasks.workunit.client.1.smithi089.stdout:2/995: write d7/d1f/d29/db7/fc1 [267600,54921] 0 2024-08-01T06:56:10.883 INFO:tasks.workunit.client.0.smithi016.stdout:5/197: dread d1/f3c [0,4194304] 0 2024-08-01T06:56:10.886 INFO:tasks.workunit.client.0.smithi016.stdout:4/196: dwrite d0/f23 [4194304,4194304] 0 2024-08-01T06:56:10.889 INFO:tasks.workunit.client.0.smithi016.stdout:5/198: mknod d1/d2/d6/d9/d19/c46 0 2024-08-01T06:56:10.889 INFO:tasks.workunit.client.0.smithi016.stdout:6/154: dwrite d1/d9/f21 [0,4194304] 0 2024-08-01T06:56:10.891 INFO:tasks.workunit.client.0.smithi016.stdout:5/199: symlink d1/d2/l47 0 2024-08-01T06:56:10.905 INFO:tasks.workunit.client.0.smithi016.stdout:5/200: truncate d1/d2/d6/d9/f22 946022 0 2024-08-01T06:56:10.908 INFO:tasks.workunit.client.0.smithi016.stdout:5/201: dread d1/d2/f31 [0,4194304] 0 2024-08-01T06:56:10.910 INFO:tasks.workunit.client.0.smithi016.stdout:5/202: dread - d1/d2/d6/d9/d19/d39/f45 zero size 2024-08-01T06:56:10.916 INFO:tasks.workunit.client.0.smithi016.stdout:5/203: dwrite d1/d2/d6/fd [0,4194304] 0 2024-08-01T06:56:10.917 INFO:tasks.workunit.client.0.smithi016.stdout:5/204: write d1/d2/d6/d9/f34 [933172,37880] 0 2024-08-01T06:56:10.924 INFO:tasks.workunit.client.0.smithi016.stdout:5/205: dread d1/d2/d6/d9/d1b/f1f [0,4194304] 0 2024-08-01T06:56:10.924 INFO:tasks.workunit.client.0.smithi016.stdout:5/206: chown d1/d2/d23/d3a/f3b 3177272 1 2024-08-01T06:56:10.928 INFO:tasks.workunit.client.0.smithi016.stdout:5/207: write d1/d2/d23/f33 [48297,75096] 0 2024-08-01T06:56:10.931 INFO:tasks.workunit.client.0.smithi016.stdout:5/208: rename d1/d2/d6/f29 to d1/d2/f48 0 2024-08-01T06:56:10.932 INFO:tasks.workunit.client.0.smithi016.stdout:5/209: chown d1/d2/d6/d9 103748782 1 2024-08-01T06:56:10.996 INFO:tasks.workunit.client.1.smithi089.stdout:9/984: sync 2024-08-01T06:56:11.028 INFO:tasks.workunit.client.0.smithi016.stdout:1/199: sync 2024-08-01T06:56:11.044 INFO:tasks.workunit.client.0.smithi016.stdout:5/210: rename d1/d2/d6/d9/d19/d39 to d1/d2/d6/d9/d49 0 2024-08-01T06:56:11.046 INFO:tasks.workunit.client.1.smithi089.stdout:9/985: symlink d18/d33/d3b/l14a 0 2024-08-01T06:56:11.047 INFO:tasks.workunit.client.1.smithi089.stdout:9/986: write d18/d33/d6e/dd1/f116 [447400,97905] 0 2024-08-01T06:56:11.047 INFO:tasks.workunit.client.1.smithi089.stdout:9/987: chown d18/f1d 34 1 2024-08-01T06:56:11.048 INFO:tasks.workunit.client.0.smithi016.stdout:1/200: rename d2/l1e to d2/d2f/l42 0 2024-08-01T06:56:11.051 INFO:tasks.workunit.client.0.smithi016.stdout:5/211: link d1/d2/d23/l2f d1/d12/d3e/l4a 0 2024-08-01T06:56:11.053 INFO:tasks.workunit.client.1.smithi089.stdout:9/988: dwrite f8 [0,4194304] 0 2024-08-01T06:56:11.054 INFO:tasks.workunit.client.0.smithi016.stdout:5/212: creat d1/d2/d20/d38/f4b x:0 0 0 2024-08-01T06:56:11.056 INFO:tasks.workunit.client.0.smithi016.stdout:5/213: write d1/fb [1723607,10143] 0 2024-08-01T06:56:11.058 INFO:tasks.workunit.client.0.smithi016.stdout:1/201: dwrite d2/de/d21/f23 [0,4194304] 0 2024-08-01T06:56:11.065 INFO:tasks.workunit.client.0.smithi016.stdout:5/214: write d1/d2/d6/d9/f21 [1188437,12834] 0 2024-08-01T06:56:11.068 INFO:tasks.workunit.client.0.smithi016.stdout:5/215: link d1/d2/l47 d1/d2/d6/l4c 0 2024-08-01T06:56:11.069 INFO:tasks.workunit.client.1.smithi089.stdout:9/989: dread d18/f7e [0,4194304] 0 2024-08-01T06:56:11.069 INFO:tasks.workunit.client.0.smithi016.stdout:5/216: write d1/d2/d23/f3d [3645790,65394] 0 2024-08-01T06:56:11.074 INFO:tasks.workunit.client.0.smithi016.stdout:5/217: dread d1/f5 [0,4194304] 0 2024-08-01T06:56:11.075 INFO:tasks.workunit.client.1.smithi089.stdout:9/990: dwrite f10 [4194304,4194304] 0 2024-08-01T06:56:11.076 INFO:tasks.workunit.client.0.smithi016.stdout:5/218: mknod d1/c4d 0 2024-08-01T06:56:11.079 INFO:tasks.workunit.client.0.smithi016.stdout:5/219: mkdir d1/d2/d4e 0 2024-08-01T06:56:11.083 INFO:tasks.workunit.client.0.smithi016.stdout:5/220: dread d1/d12/f30 [0,4194304] 0 2024-08-01T06:56:11.087 INFO:tasks.workunit.client.0.smithi016.stdout:5/221: dread d1/d2/d23/f32 [0,4194304] 0 2024-08-01T06:56:11.088 INFO:tasks.workunit.client.0.smithi016.stdout:5/222: truncate d1/d2/d23/d3a/f3b 397736 0 2024-08-01T06:56:11.090 INFO:tasks.workunit.client.0.smithi016.stdout:5/223: chown d1/d2/d6/d9/f22 6586 1 2024-08-01T06:56:11.091 INFO:tasks.workunit.client.1.smithi089.stdout:2/996: sync 2024-08-01T06:56:11.092 INFO:tasks.workunit.client.1.smithi089.stdout:2/997: stat d7/d1f/d28/f51 0 2024-08-01T06:56:11.094 INFO:tasks.workunit.client.1.smithi089.stdout:9/991: write d18/d33/d49/d7b/fad [913301,52803] 0 2024-08-01T06:56:11.095 INFO:tasks.workunit.client.1.smithi089.stdout:2/998: unlink d7/d1f/d52/d72/dc0/ce8 0 2024-08-01T06:56:11.097 INFO:tasks.workunit.client.1.smithi089.stdout:9/992: rename d18/d22/l26 to d18/d33/d49/d7b/d4b/db6/l14b 0 2024-08-01T06:56:11.100 INFO:tasks.workunit.client.1.smithi089.stdout:2/999: rename d7/d1f/d29/cd to d7/d4a/c13e 0 2024-08-01T06:56:11.102 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:10 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:11.102 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:10 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:11.102 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:10 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:56:11.102 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:10 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:56:11.102 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:10 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:56:11.102 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:10 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:56:11.102 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:10 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:56:11.102 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:10 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:56:11.102 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:10 smithi016 ceph-mon[29266]: Adjusting osd_memory_target on smithi089 to 2239M 2024-08-01T06:56:11.102 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:10 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:11.103 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:10 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:56:11.103 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:10 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:56:11.103 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:10 smithi016 ceph-mon[29266]: Updating smithi016:/etc/ceph/ceph.conf 2024-08-01T06:56:11.103 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:10 smithi016 ceph-mon[29266]: Updating smithi089:/etc/ceph/ceph.conf 2024-08-01T06:56:11.103 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:10 smithi016 ceph-mon[29266]: pgmap v19: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 105 MiB/s rd, 284 MiB/s wr, 610 op/s 2024-08-01T06:56:11.103 INFO:tasks.workunit.client.1.smithi089.stdout:9/993: write d18/d33/d3b/dc8/fcb [834764,18885] 0 2024-08-01T06:56:11.104 INFO:tasks.workunit.client.0.smithi016.stdout:5/224: dwrite d1/d2/f10 [0,4194304] 0 2024-08-01T06:56:11.104 INFO:tasks.workunit.client.0.smithi016.stdout:5/225: dread - d1/d12/d3e/f42 zero size 2024-08-01T06:56:11.111 INFO:tasks.workunit.client.1.smithi089.stdout:9/994: getdents d18/da4 0 2024-08-01T06:56:11.112 INFO:tasks.workunit.client.0.smithi016.stdout:5/226: dwrite d1/d2/d6/d9/f13 [4194304,4194304] 0 2024-08-01T06:56:11.116 INFO:tasks.workunit.client.0.smithi016.stdout:5/227: fdatasync d1/d2/d6/fd 0 2024-08-01T06:56:11.116 INFO:tasks.workunit.client.1.smithi089.stdout:9/995: link d18/d22/d39/d95/f101 d18/d33/d6e/f14c 0 2024-08-01T06:56:11.117 INFO:tasks.workunit.client.0.smithi016.stdout:5/228: write d1/d2/f10 [4451834,6367] 0 2024-08-01T06:56:11.121 INFO:tasks.workunit.client.1.smithi089.stdout:9/996: creat d18/d22/d39/f14d x:0 0 0 2024-08-01T06:56:11.124 INFO:tasks.workunit.client.1.smithi089.stdout:9/997: unlink d18/d22/d39/d95/fd7 0 2024-08-01T06:56:11.127 INFO:tasks.workunit.client.1.smithi089.stdout:9/998: creat d18/d33/df7/da6/f14e x:0 0 0 2024-08-01T06:56:11.128 INFO:tasks.workunit.client.0.smithi016.stdout:5/229: dread d1/d2/f48 [0,4194304] 0 2024-08-01T06:56:11.130 INFO:tasks.workunit.client.0.smithi016.stdout:5/230: dread d1/f5 [0,4194304] 0 2024-08-01T06:56:11.132 INFO:tasks.workunit.client.0.smithi016.stdout:5/231: rename d1/d2/d6 to d1/d2/d6/d9/d4f 22 2024-08-01T06:56:11.132 INFO:tasks.workunit.client.1.smithi089.stdout:9/999: dwrite d18/d33/d6e/f11e [0,4194304] 0 2024-08-01T06:56:11.133 INFO:tasks.workunit.client.0.smithi016.stdout:5/232: unlink d1/d2/d6/d9/f21 0 2024-08-01T06:56:11.137 INFO:tasks.workunit.client.1.smithi089.stderr:+ rm -rf -- ./tmp.t4vdJmP4Nw 2024-08-01T06:56:11.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:10 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:11.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:10 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:11.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:10 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:56:11.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:10 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:56:11.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:10 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:56:11.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:10 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:56:11.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:10 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:56:11.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:10 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-01T06:56:11.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:10 smithi089 ceph-mon[36617]: Adjusting osd_memory_target on smithi089 to 2239M 2024-08-01T06:56:11.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:10 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:11.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:10 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:56:11.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:10 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:56:11.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:10 smithi089 ceph-mon[36617]: Updating smithi016:/etc/ceph/ceph.conf 2024-08-01T06:56:11.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:10 smithi089 ceph-mon[36617]: Updating smithi089:/etc/ceph/ceph.conf 2024-08-01T06:56:11.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:10 smithi089 ceph-mon[36617]: pgmap v19: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 105 MiB/s rd, 284 MiB/s wr, 610 op/s 2024-08-01T06:56:11.139 INFO:tasks.workunit.client.0.smithi016.stdout:5/233: dread d1/d2/d23/f33 [0,4194304] 0 2024-08-01T06:56:11.144 INFO:tasks.workunit.client.0.smithi016.stdout:5/234: dread d1/d2/d23/f26 [0,4194304] 0 2024-08-01T06:56:11.150 INFO:tasks.workunit.client.0.smithi016.stdout:5/235: link d1/d2/d20/d38/c3f d1/c50 0 2024-08-01T06:56:11.158 INFO:tasks.workunit.client.0.smithi016.stdout:5/236: symlink d1/d12/l51 0 2024-08-01T06:56:11.163 INFO:tasks.workunit.client.0.smithi016.stdout:5/237: rmdir d1/d2/d4e 0 2024-08-01T06:56:11.168 INFO:tasks.workunit.client.0.smithi016.stdout:5/238: getdents d1/d12/d3e 0 2024-08-01T06:56:11.174 INFO:tasks.workunit.client.0.smithi016.stdout:5/239: getdents d1/d2/d20/d38 0 2024-08-01T06:56:11.184 INFO:tasks.workunit.client.0.smithi016.stdout:5/240: dwrite d1/d2/f10 [0,4194304] 0 2024-08-01T06:56:11.186 INFO:tasks.workunit.client.0.smithi016.stdout:5/241: readlink d1/d2/d6/l4c 0 2024-08-01T06:56:11.187 INFO:tasks.workunit.client.0.smithi016.stdout:5/242: stat d1/d12/l51 0 2024-08-01T06:56:11.241 INFO:tasks.workunit.client.0.smithi016.stdout:3/107: sync 2024-08-01T06:56:11.246 INFO:tasks.workunit.client.0.smithi016.stdout:7/130: sync 2024-08-01T06:56:11.270 INFO:tasks.workunit.client.0.smithi016.stdout:3/108: rmdir d9/d1c 39 2024-08-01T06:56:11.271 INFO:tasks.workunit.client.0.smithi016.stdout:3/109: readlink l5 0 2024-08-01T06:56:11.272 INFO:tasks.workunit.client.0.smithi016.stdout:7/131: unlink d7/db/d1a/da/d1e/l2f 0 2024-08-01T06:56:11.274 INFO:tasks.workunit.client.0.smithi016.stdout:5/243: mkdir d1/d12/d52 0 2024-08-01T06:56:11.275 INFO:tasks.workunit.client.0.smithi016.stdout:5/244: dread - d1/d12/d3e/f42 zero size 2024-08-01T06:56:11.276 INFO:tasks.workunit.client.0.smithi016.stdout:3/110: mkdir d9/da/df/d2a 0 2024-08-01T06:56:11.277 INFO:tasks.workunit.client.0.smithi016.stdout:7/132: mknod d7/db/d1a/da/dc/c34 0 2024-08-01T06:56:11.278 INFO:tasks.workunit.client.0.smithi016.stdout:7/133: fsync d7/db/d1a/da/d22/f27 0 2024-08-01T06:56:11.279 INFO:tasks.workunit.client.0.smithi016.stdout:5/245: mknod d1/d2/d23/c53 0 2024-08-01T06:56:11.282 INFO:tasks.workunit.client.0.smithi016.stdout:7/134: mknod d7/db/d1a/da/d1e/d26/c35 0 2024-08-01T06:56:11.283 INFO:tasks.workunit.client.0.smithi016.stdout:5/246: rename d1/d2/d6/d9/f22 to d1/f54 0 2024-08-01T06:56:11.285 INFO:tasks.workunit.client.0.smithi016.stdout:7/135: dread d7/db/d1a/da/dc/f29 [0,4194304] 0 2024-08-01T06:56:11.286 INFO:tasks.workunit.client.0.smithi016.stdout:3/111: creat d9/d1c/f2b x:0 0 0 2024-08-01T06:56:11.286 INFO:tasks.workunit.client.0.smithi016.stdout:3/112: stat d9/da/d18 0 2024-08-01T06:56:11.287 INFO:tasks.workunit.client.0.smithi016.stdout:3/113: readlink d9/da/l1a 0 2024-08-01T06:56:11.287 INFO:tasks.workunit.client.0.smithi016.stdout:7/136: dread - d7/db/d1a/da/f1b zero size 2024-08-01T06:56:11.288 INFO:tasks.workunit.client.0.smithi016.stdout:3/114: chown d9/da/c24 300 1 2024-08-01T06:56:11.291 INFO:tasks.workunit.client.0.smithi016.stdout:3/115: write d9/da/df/d12/d20/f26 [1019960,88866] 0 2024-08-01T06:56:11.295 INFO:tasks.workunit.client.0.smithi016.stdout:5/247: dread d1/d12/f30 [0,4194304] 0 2024-08-01T06:56:11.295 INFO:tasks.workunit.client.0.smithi016.stdout:3/116: write d9/da/f22 [1306613,29013] 0 2024-08-01T06:56:11.297 INFO:tasks.workunit.client.0.smithi016.stdout:7/137: dwrite d7/db/d1a/da/dc/f29 [0,4194304] 0 2024-08-01T06:56:11.302 INFO:tasks.workunit.client.0.smithi016.stdout:5/248: creat d1/d2/d6/d9/d49/f55 x:0 0 0 2024-08-01T06:56:11.302 INFO:tasks.workunit.client.0.smithi016.stdout:3/117: mkdir d9/d2c 0 2024-08-01T06:56:11.302 INFO:tasks.workunit.client.0.smithi016.stdout:5/249: readlink d1/d2/d6/d9/d19/l2c 0 2024-08-01T06:56:11.303 INFO:tasks.workunit.client.0.smithi016.stdout:7/138: creat d7/db/f36 x:0 0 0 2024-08-01T06:56:11.307 INFO:tasks.workunit.client.0.smithi016.stdout:3/118: rename d9/da/f22 to d9/d2c/f2d 0 2024-08-01T06:56:11.311 INFO:tasks.workunit.client.0.smithi016.stdout:3/119: creat d9/da/f2e x:0 0 0 2024-08-01T06:56:11.311 INFO:tasks.workunit.client.0.smithi016.stdout:7/139: truncate d7/ff 1515953 0 2024-08-01T06:56:11.313 INFO:tasks.workunit.client.0.smithi016.stdout:7/140: stat d7/db/d1a/da/d1e/d26/d2a/f30 0 2024-08-01T06:56:11.317 INFO:tasks.workunit.client.0.smithi016.stdout:7/141: creat d7/db/d1a/da/d22/f37 x:0 0 0 2024-08-01T06:56:11.321 INFO:tasks.workunit.client.0.smithi016.stdout:7/142: creat d7/db/d1a/da/f38 x:0 0 0 2024-08-01T06:56:11.326 INFO:tasks.workunit.client.0.smithi016.stdout:7/143: rename d7/db/d1a/da/dc to d7/db/d1a/d39 0 2024-08-01T06:56:11.333 INFO:tasks.workunit.client.0.smithi016.stdout:5/250: rmdir d1 39 2024-08-01T06:56:11.336 INFO:tasks.workunit.client.0.smithi016.stdout:5/251: read - d1/d2/d6/d9/d49/f55 zero size 2024-08-01T06:56:11.339 INFO:tasks.workunit.client.0.smithi016.stdout:5/252: symlink d1/d12/l56 0 2024-08-01T06:56:11.342 INFO:tasks.workunit.client.0.smithi016.stdout:3/120: write d9/fd [1013370,42789] 0 2024-08-01T06:56:11.345 INFO:tasks.workunit.client.0.smithi016.stdout:5/253: dread d1/d2/d23/f26 [0,4194304] 0 2024-08-01T06:56:11.349 INFO:tasks.workunit.client.0.smithi016.stdout:5/254: mkdir d1/d2/d6/d9/d49/d57 0 2024-08-01T06:56:11.351 INFO:tasks.workunit.client.0.smithi016.stdout:5/255: dread d1/d2/d23/d3a/f3b [0,4194304] 0 2024-08-01T06:56:11.352 INFO:tasks.workunit.client.0.smithi016.stdout:3/121: link d9/da/df/d12/l28 d9/da/df/d2a/l2f 0 2024-08-01T06:56:11.354 INFO:tasks.workunit.client.0.smithi016.stdout:5/256: unlink d1/fb 0 2024-08-01T06:56:11.357 INFO:tasks.workunit.client.0.smithi016.stdout:5/257: rename d1/d2/d6/d9/d49/f55 to d1/d2/d23/d3a/f58 0 2024-08-01T06:56:11.357 INFO:tasks.workunit.client.0.smithi016.stdout:5/258: dread - d1/d2/d6/d9/d49/f45 zero size 2024-08-01T06:56:11.359 INFO:tasks.workunit.client.0.smithi016.stdout:5/259: getdents d1/d12/d52 0 2024-08-01T06:56:11.360 INFO:tasks.workunit.client.0.smithi016.stdout:5/260: unlink d1/l2d 0 2024-08-01T06:56:11.364 INFO:tasks.workunit.client.0.smithi016.stdout:5/261: dread d1/d12/f30 [0,4194304] 0 2024-08-01T06:56:11.372 INFO:tasks.workunit.client.0.smithi016.stdout:5/262: getdents d1/d2/d6 0 2024-08-01T06:56:11.375 INFO:tasks.workunit.client.0.smithi016.stdout:5/263: creat d1/d2/d6/d9/d1b/f59 x:0 0 0 2024-08-01T06:56:11.377 INFO:tasks.workunit.client.0.smithi016.stdout:5/264: write d1/d2/d6/d9/d1b/f1f [1752426,64134] 0 2024-08-01T06:56:11.381 INFO:tasks.workunit.client.0.smithi016.stdout:5/265: rename d1/d37 to d1/d2/d6/d5a 0 2024-08-01T06:56:11.382 INFO:tasks.workunit.client.0.smithi016.stdout:5/266: truncate d1/d2/d23/f33 4993432 0 2024-08-01T06:56:11.387 INFO:tasks.workunit.client.0.smithi016.stdout:5/267: creat d1/d2/d6/d9/d49/d57/f5b x:0 0 0 2024-08-01T06:56:11.389 INFO:tasks.workunit.client.0.smithi016.stdout:5/268: truncate d1/d2/d6/d9/d1b/f59 676429 0 2024-08-01T06:56:11.391 INFO:tasks.workunit.client.0.smithi016.stdout:5/269: symlink d1/d2/d6/d5a/l5c 0 2024-08-01T06:56:11.393 INFO:tasks.workunit.client.0.smithi016.stdout:5/270: mknod d1/d2/d23/c5d 0 2024-08-01T06:56:11.398 INFO:tasks.workunit.client.0.smithi016.stdout:5/271: symlink d1/d2/d6/d9/d19/l5e 0 2024-08-01T06:56:11.401 INFO:tasks.workunit.client.0.smithi016.stdout:5/272: truncate d1/d2/d23/f32 940749 0 2024-08-01T06:56:11.407 INFO:tasks.workunit.client.0.smithi016.stdout:5/273: dwrite d1/d2/f43 [0,4194304] 0 2024-08-01T06:56:11.410 INFO:tasks.workunit.client.0.smithi016.stdout:5/274: creat d1/d2/d6/d5a/f5f x:0 0 0 2024-08-01T06:56:11.414 INFO:tasks.workunit.client.0.smithi016.stdout:5/275: mknod d1/d2/d6/d9/d19/c60 0 2024-08-01T06:56:11.420 INFO:tasks.workunit.client.0.smithi016.stdout:5/276: link d1/d2/d6/d5a/l5c d1/d12/l61 0 2024-08-01T06:56:11.423 INFO:tasks.workunit.client.0.smithi016.stdout:5/277: dread d1/d2/f43 [0,4194304] 0 2024-08-01T06:56:11.487 INFO:tasks.workunit.client.0.smithi016.stdout:9/125: sync 2024-08-01T06:56:11.549 INFO:tasks.workunit.client.0.smithi016.stdout:9/126: getdents d3/d9 0 2024-08-01T06:56:11.558 INFO:tasks.workunit.client.0.smithi016.stdout:9/127: dwrite d3/d9/df/d16/f2b [0,4194304] 0 2024-08-01T06:56:11.559 INFO:tasks.workunit.client.0.smithi016.stdout:9/128: chown d3/d4 24 1 2024-08-01T06:56:11.560 INFO:tasks.workunit.client.0.smithi016.stdout:9/129: stat d3/d9/df/d16 0 2024-08-01T06:56:11.560 INFO:tasks.workunit.client.0.smithi016.stdout:5/278: dwrite d1/d12/f16 [0,4194304] 0 2024-08-01T06:56:11.562 INFO:tasks.workunit.client.0.smithi016.stdout:9/130: write d3/de/f18 [426470,88626] 0 2024-08-01T06:56:11.568 INFO:tasks.workunit.client.0.smithi016.stdout:5/279: rmdir d1/d2/d6/d9/d1b 39 2024-08-01T06:56:11.570 INFO:tasks.workunit.client.0.smithi016.stdout:9/131: creat d3/d9/df/f2d x:0 0 0 2024-08-01T06:56:11.571 INFO:tasks.workunit.client.0.smithi016.stdout:9/132: dread - d3/f24 zero size 2024-08-01T06:56:11.573 INFO:tasks.workunit.client.0.smithi016.stdout:9/133: write d3/de/f17 [160398,98493] 0 2024-08-01T06:56:11.575 INFO:tasks.workunit.client.0.smithi016.stdout:5/280: dread d1/d2/d23/f3d [0,4194304] 0 2024-08-01T06:56:11.580 INFO:tasks.workunit.client.0.smithi016.stdout:5/281: write d1/f5 [4786277,715] 0 2024-08-01T06:56:11.581 INFO:tasks.workunit.client.0.smithi016.stdout:9/134: rename d3/d9/db/c29 to d3/d9/df/c2e 0 2024-08-01T06:56:11.601 INFO:tasks.workunit.client.0.smithi016.stdout:9/135: dwrite d3/d4/f19 [0,4194304] 0 2024-08-01T06:56:11.602 INFO:tasks.workunit.client.0.smithi016.stdout:5/282: dwrite d1/d2/d6/d9/f13 [0,4194304] 0 2024-08-01T06:56:11.605 INFO:tasks.workunit.client.0.smithi016.stdout:5/283: write d1/d2/d6/d9/d19/f40 [261398,13111] 0 2024-08-01T06:56:11.610 INFO:tasks.workunit.client.0.smithi016.stdout:5/284: rmdir d1/d12 39 2024-08-01T06:56:11.613 INFO:tasks.workunit.client.0.smithi016.stdout:9/136: getdents d3/d9/df/d16 0 2024-08-01T06:56:11.617 INFO:tasks.workunit.client.0.smithi016.stdout:5/285: creat d1/d12/d3e/f62 x:0 0 0 2024-08-01T06:56:11.619 INFO:tasks.workunit.client.0.smithi016.stdout:5/286: chown d1/d2/d6 26883 1 2024-08-01T06:56:11.620 INFO:tasks.workunit.client.0.smithi016.stdout:5/287: read d1/d2/f10 [1620184,73249] 0 2024-08-01T06:56:11.622 INFO:tasks.workunit.client.0.smithi016.stdout:9/137: dwrite d3/d9/df/d16/f1e [0,4194304] 0 2024-08-01T06:56:11.628 INFO:tasks.workunit.client.0.smithi016.stdout:5/288: rename d1/d2/d6/c18 to d1/d2/d20/d38/c63 0 2024-08-01T06:56:11.629 INFO:tasks.workunit.client.0.smithi016.stdout:9/138: mknod d3/c2f 0 2024-08-01T06:56:11.631 INFO:tasks.workunit.client.0.smithi016.stdout:5/289: read d1/d2/f10 [2693694,15070] 0 2024-08-01T06:56:11.633 INFO:tasks.workunit.client.0.smithi016.stdout:9/139: creat d3/d9/df/d16/f30 x:0 0 0 2024-08-01T06:56:11.636 INFO:tasks.workunit.client.0.smithi016.stdout:9/140: write d3/d9/df/d16/f1e [4649857,45632] 0 2024-08-01T06:56:11.638 INFO:tasks.workunit.client.0.smithi016.stdout:9/141: write d3/d4/f11 [3118345,67869] 0 2024-08-01T06:56:11.641 INFO:tasks.workunit.client.0.smithi016.stdout:5/290: dwrite d1/d2/d20/d38/f4b [0,4194304] 0 2024-08-01T06:56:11.644 INFO:tasks.workunit.client.0.smithi016.stdout:9/142: rename d3/d9/db/l1f to d3/d9/db/l31 0 2024-08-01T06:56:11.650 INFO:tasks.workunit.client.0.smithi016.stdout:9/143: mkdir d3/d32 0 2024-08-01T06:56:11.652 INFO:tasks.workunit.client.0.smithi016.stdout:9/144: stat d3/d9/db/dc/f27 0 2024-08-01T06:56:11.655 INFO:tasks.workunit.client.0.smithi016.stdout:5/291: dwrite d1/d2/d23/f3d [0,4194304] 0 2024-08-01T06:56:11.658 INFO:tasks.workunit.client.0.smithi016.stdout:9/145: mkdir d3/d9/db/dc/d33 0 2024-08-01T06:56:11.669 INFO:tasks.workunit.client.0.smithi016.stdout:9/146: dwrite d3/d9/db/dc/f27 [0,4194304] 0 2024-08-01T06:56:11.671 INFO:tasks.workunit.client.0.smithi016.stdout:5/292: dwrite d1/d12/f16 [4194304,4194304] 0 2024-08-01T06:56:11.676 INFO:tasks.workunit.client.0.smithi016.stdout:9/147: dread d3/d4/f19 [0,4194304] 0 2024-08-01T06:56:11.677 INFO:tasks.workunit.client.0.smithi016.stdout:5/293: creat d1/d2/d6/d9/d49/d57/f64 x:0 0 0 2024-08-01T06:56:11.680 INFO:tasks.workunit.client.0.smithi016.stdout:9/148: creat d3/d4/f34 x:0 0 0 2024-08-01T06:56:11.684 INFO:tasks.workunit.client.0.smithi016.stdout:9/149: creat d3/de/f35 x:0 0 0 2024-08-01T06:56:11.695 INFO:tasks.workunit.client.0.smithi016.stdout:2/81: sync 2024-08-01T06:56:11.696 INFO:tasks.workunit.client.0.smithi016.stdout:9/150: dwrite d3/d4/f19 [0,4194304] 0 2024-08-01T06:56:11.696 INFO:tasks.workunit.client.0.smithi016.stdout:2/82: dread - d0/f17 zero size 2024-08-01T06:56:11.697 INFO:tasks.workunit.client.0.smithi016.stdout:9/151: readlink d3/de/l1a 0 2024-08-01T06:56:11.704 INFO:tasks.workunit.client.0.smithi016.stdout:9/152: unlink d3/l8 0 2024-08-01T06:56:11.706 INFO:tasks.workunit.client.0.smithi016.stdout:2/83: symlink d0/d16/l1e 0 2024-08-01T06:56:11.707 INFO:tasks.workunit.client.0.smithi016.stdout:2/84: write d0/d8/f18 [509529,105297] 0 2024-08-01T06:56:11.708 INFO:tasks.workunit.client.0.smithi016.stdout:5/294: truncate d1/d2/d23/f26 3072813 0 2024-08-01T06:56:11.710 INFO:tasks.workunit.client.0.smithi016.stdout:9/153: unlink d3/d9/db/dc/c23 0 2024-08-01T06:56:11.711 INFO:tasks.workunit.client.0.smithi016.stdout:5/295: chown d1/d12/l61 123674 1 2024-08-01T06:56:11.716 INFO:tasks.workunit.client.0.smithi016.stdout:2/85: dwrite d0/d8/f11 [0,4194304] 0 2024-08-01T06:56:11.720 INFO:tasks.workunit.client.0.smithi016.stdout:5/296: mkdir d1/d2/d6/d5a/d65 0 2024-08-01T06:56:11.801 INFO:tasks.workunit.client.0.smithi016.stdout:1/202: sync 2024-08-01T06:56:11.801 INFO:tasks.workunit.client.0.smithi016.stdout:6/155: sync 2024-08-01T06:56:11.801 INFO:tasks.workunit.client.0.smithi016.stdout:7/144: sync 2024-08-01T06:56:11.801 INFO:tasks.workunit.client.0.smithi016.stdout:8/120: sync 2024-08-01T06:56:11.801 INFO:tasks.workunit.client.0.smithi016.stdout:0/154: sync 2024-08-01T06:56:11.802 INFO:tasks.workunit.client.0.smithi016.stdout:3/122: sync 2024-08-01T06:56:11.802 INFO:tasks.workunit.client.0.smithi016.stdout:4/197: sync 2024-08-01T06:56:11.802 INFO:tasks.workunit.client.0.smithi016.stdout:5/297: rename d1/d2/d23/f3d to d1/d12/d3e/f66 0 2024-08-01T06:56:11.804 INFO:tasks.workunit.client.0.smithi016.stdout:9/154: link d3/de/f14 d3/d32/f36 0 2024-08-01T06:56:11.806 INFO:tasks.workunit.client.0.smithi016.stdout:4/198: write d0/d17/d22/f31 [3391212,88550] 0 2024-08-01T06:56:11.807 INFO:tasks.workunit.client.0.smithi016.stdout:9/155: write d3/d9/df/f1c [1008966,5631] 0 2024-08-01T06:56:11.807 INFO:tasks.workunit.client.0.smithi016.stdout:4/199: read d0/d17/f30 [1165801,128515] 0 2024-08-01T06:56:11.808 INFO:tasks.workunit.client.0.smithi016.stdout:9/156: read - d3/f28 zero size 2024-08-01T06:56:11.813 INFO:tasks.workunit.client.0.smithi016.stdout:1/203: mkdir d2/de/d32/d43 0 2024-08-01T06:56:11.813 INFO:tasks.workunit.client.0.smithi016.stdout:1/204: chown d2/d3/f34 96 1 2024-08-01T06:56:11.816 INFO:tasks.workunit.client.0.smithi016.stdout:0/155: rename ff to d10/f33 0 2024-08-01T06:56:11.816 INFO:tasks.workunit.client.0.smithi016.stdout:3/123: rename d9/da/d18 to d9/da/d18/d30 22 2024-08-01T06:56:11.819 INFO:tasks.workunit.client.0.smithi016.stdout:6/156: mkdir d1/d8/d1b/d22/d3b 0 2024-08-01T06:56:11.822 INFO:tasks.workunit.client.0.smithi016.stdout:8/121: creat d5/d8/d1a/d24/f25 x:0 0 0 2024-08-01T06:56:11.826 INFO:tasks.workunit.client.0.smithi016.stdout:5/298: dread d1/d2/d6/d9/d1b/f59 [0,4194304] 0 2024-08-01T06:56:11.828 INFO:tasks.workunit.client.0.smithi016.stdout:4/200: symlink d0/l44 0 2024-08-01T06:56:11.831 INFO:tasks.workunit.client.0.smithi016.stdout:9/157: rmdir d3/d4 39 2024-08-01T06:56:11.838 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:11 smithi016 ceph-mon[29266]: Updating smithi089:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:56:11.838 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:11 smithi016 ceph-mon[29266]: Updating smithi016:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:56:11.838 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:11 smithi016 ceph-mon[29266]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-08-01T06:56:11.838 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:11 smithi016 ceph-mon[29266]: Updating smithi089:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-01T06:56:11.838 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:11 smithi016 ceph-mon[29266]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-08-01T06:56:11.839 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:11 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:11.839 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:11 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:11.839 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:11 smithi016 ceph-mon[29266]: Updating smithi016:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-01T06:56:11.839 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:11 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:11.839 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:11 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:11.839 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:11 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:11.839 INFO:tasks.workunit.client.0.smithi016.stdout:1/205: unlink d2/d3/d1c/f35 0 2024-08-01T06:56:11.842 INFO:tasks.workunit.client.0.smithi016.stdout:0/156: symlink d10/d11/l34 0 2024-08-01T06:56:11.844 INFO:tasks.workunit.client.0.smithi016.stdout:3/124: creat d9/d2c/f31 x:0 0 0 2024-08-01T06:56:11.850 INFO:tasks.workunit.client.0.smithi016.stdout:8/122: creat d5/d8/d1a/d24/f26 x:0 0 0 2024-08-01T06:56:11.851 INFO:tasks.workunit.client.0.smithi016.stdout:8/123: chown d5/dc/l23 117704 1 2024-08-01T06:56:11.858 INFO:tasks.workunit.client.0.smithi016.stdout:6/157: dread d1/d8/d1b/f25 [0,4194304] 0 2024-08-01T06:56:11.861 INFO:tasks.workunit.client.0.smithi016.stdout:9/158: chown d3/d4/f34 110 1 2024-08-01T06:56:11.861 INFO:tasks.workunit.client.0.smithi016.stdout:9/159: truncate d3/f24 686675 0 2024-08-01T06:56:11.864 INFO:tasks.workunit.client.0.smithi016.stdout:1/206: chown d2/l15 20 1 2024-08-01T06:56:11.867 INFO:tasks.workunit.client.0.smithi016.stdout:0/157: unlink d10/d11/d18/f1a 0 2024-08-01T06:56:11.871 INFO:tasks.workunit.client.0.smithi016.stdout:3/125: rmdir d9/da/df/d12/d20 39 2024-08-01T06:56:11.873 INFO:tasks.workunit.client.0.smithi016.stdout:3/126: chown d9/da/df/c14 40466 1 2024-08-01T06:56:11.877 INFO:tasks.workunit.client.0.smithi016.stdout:8/124: rename d5/dc/l13 to d5/dc/l27 0 2024-08-01T06:56:11.885 INFO:tasks.workunit.client.0.smithi016.stdout:6/158: creat d1/d8/d34/f3c x:0 0 0 2024-08-01T06:56:11.886 INFO:tasks.workunit.client.0.smithi016.stdout:7/145: getdents d7/db/d1a/da 0 2024-08-01T06:56:11.890 INFO:tasks.workunit.client.0.smithi016.stdout:9/160: rename d3/d9/l26 to d3/d9/df/d16/l37 0 2024-08-01T06:56:11.893 INFO:tasks.workunit.client.0.smithi016.stdout:8/125: dread d5/d8/fd [0,4194304] 0 2024-08-01T06:56:11.894 INFO:tasks.workunit.client.0.smithi016.stdout:6/159: dwrite d1/d8/d34/f37 [0,4194304] 0 2024-08-01T06:56:11.897 INFO:tasks.workunit.client.0.smithi016.stdout:0/158: truncate f6 183899 0 2024-08-01T06:56:11.898 INFO:tasks.workunit.client.0.smithi016.stdout:3/127: symlink d9/d1c/l32 0 2024-08-01T06:56:11.901 INFO:tasks.workunit.client.0.smithi016.stdout:5/299: write d1/f54 [1035884,17305] 0 2024-08-01T06:56:11.902 INFO:tasks.workunit.client.0.smithi016.stdout:0/159: dread d10/d11/f14 [0,4194304] 0 2024-08-01T06:56:11.904 INFO:tasks.workunit.client.0.smithi016.stdout:4/201: symlink d0/l45 0 2024-08-01T06:56:11.907 INFO:tasks.workunit.client.0.smithi016.stdout:7/146: truncate d7/f11 901531 0 2024-08-01T06:56:11.909 INFO:tasks.workunit.client.0.smithi016.stdout:1/207: mknod d2/d3/d41/c44 0 2024-08-01T06:56:11.911 INFO:tasks.workunit.client.0.smithi016.stdout:9/161: rmdir d3/d9/db 39 2024-08-01T06:56:11.912 INFO:tasks.workunit.client.0.smithi016.stdout:9/162: chown d3/d9/df/f2d 2916 1 2024-08-01T06:56:11.914 INFO:tasks.workunit.client.0.smithi016.stdout:8/126: symlink d5/d1c/l28 0 2024-08-01T06:56:11.929 INFO:tasks.workunit.client.0.smithi016.stdout:2/86: sync 2024-08-01T06:56:11.931 INFO:tasks.workunit.client.0.smithi016.stdout:3/128: write d9/da/fb [386840,33310] 0 2024-08-01T06:56:11.934 INFO:tasks.workunit.client.0.smithi016.stdout:8/127: creat d5/d8/d1a/f29 x:0 0 0 2024-08-01T06:56:11.936 INFO:tasks.workunit.client.0.smithi016.stdout:6/160: symlink d1/d8/l3d 0 2024-08-01T06:56:11.940 INFO:tasks.workunit.client.0.smithi016.stdout:5/300: mknod d1/d12/d52/c67 0 2024-08-01T06:56:11.940 INFO:tasks.workunit.client.0.smithi016.stdout:7/147: dwrite d7/f18 [0,4194304] 0 2024-08-01T06:56:11.944 INFO:tasks.workunit.client.0.smithi016.stdout:2/87: dwrite d0/f17 [0,4194304] 0 2024-08-01T06:56:11.951 INFO:tasks.workunit.client.0.smithi016.stdout:9/163: dwrite d3/d9/db/dc/f21 [0,4194304] 0 2024-08-01T06:56:11.962 INFO:tasks.workunit.client.0.smithi016.stdout:5/301: mkdir d1/d2/d20/d68 0 2024-08-01T06:56:11.963 INFO:tasks.workunit.client.0.smithi016.stdout:6/161: dwrite d1/d8/f2c [0,4194304] 0 2024-08-01T06:56:11.966 INFO:tasks.workunit.client.0.smithi016.stdout:3/129: dwrite d9/da/df/d12/d20/f26 [0,4194304] 0 2024-08-01T06:56:11.966 INFO:tasks.workunit.client.0.smithi016.stdout:3/130: fdatasync d9/da/fb 0 2024-08-01T06:56:11.966 INFO:tasks.workunit.client.0.smithi016.stdout:4/202: dread - d0/d2/dc/d12/d29/d3c/f3f zero size 2024-08-01T06:56:11.971 INFO:tasks.workunit.client.0.smithi016.stdout:1/208: rename d2/d3/d1f/f39 to d2/de/f45 0 2024-08-01T06:56:11.975 INFO:tasks.workunit.client.0.smithi016.stdout:3/131: dwrite d9/da/df/d12/f15 [4194304,4194304] 0 2024-08-01T06:56:11.975 INFO:tasks.workunit.client.0.smithi016.stdout:3/132: chown d9/da 57 1 2024-08-01T06:56:11.977 INFO:tasks.workunit.client.0.smithi016.stdout:2/88: creat d0/d16/f1f x:0 0 0 2024-08-01T06:56:11.978 INFO:tasks.workunit.client.0.smithi016.stdout:2/89: write d0/d8/d1b/f1c [992505,81051] 0 2024-08-01T06:56:11.979 INFO:tasks.workunit.client.0.smithi016.stdout:0/160: link fd d10/d1c/f35 0 2024-08-01T06:56:11.984 INFO:tasks.workunit.client.0.smithi016.stdout:9/164: mkdir d3/d9/df/d38 0 2024-08-01T06:56:11.991 INFO:tasks.workunit.client.0.smithi016.stdout:5/302: fdatasync d1/d12/f30 0 2024-08-01T06:56:11.994 INFO:tasks.workunit.client.0.smithi016.stdout:4/203: chown d0/d17/d22/c3e 101942 1 2024-08-01T06:56:11.995 INFO:tasks.workunit.client.0.smithi016.stdout:6/162: chown d1/d8/d1b/c1d 246 1 2024-08-01T06:56:11.997 INFO:tasks.workunit.client.0.smithi016.stdout:1/209: unlink d2/de/d21/f23 0 2024-08-01T06:56:11.998 INFO:tasks.workunit.client.0.smithi016.stdout:1/210: dread - d2/de/f37 zero size 2024-08-01T06:56:11.999 INFO:tasks.workunit.client.0.smithi016.stdout:3/133: creat d9/da/df/f33 x:0 0 0 2024-08-01T06:56:12.002 INFO:tasks.workunit.client.0.smithi016.stdout:5/303: rmdir d1/d2/d6/d9/d49 39 2024-08-01T06:56:12.002 INFO:tasks.workunit.client.0.smithi016.stdout:0/161: dread fd [0,4194304] 0 2024-08-01T06:56:12.003 INFO:tasks.workunit.client.0.smithi016.stdout:5/304: chown d1/d2/f31 177 1 2024-08-01T06:56:12.004 INFO:tasks.workunit.client.0.smithi016.stdout:0/162: fsync d10/d11/d18/f2a 0 2024-08-01T06:56:12.004 INFO:tasks.workunit.client.0.smithi016.stdout:0/163: chown d10/d11 504 1 2024-08-01T06:56:12.007 INFO:tasks.workunit.client.0.smithi016.stdout:0/164: stat d10/d11/d18/c19 0 2024-08-01T06:56:12.010 INFO:tasks.workunit.client.0.smithi016.stdout:2/90: dread d0/f3 [0,4194304] 0 2024-08-01T06:56:12.011 INFO:tasks.workunit.client.0.smithi016.stdout:5/305: dread d1/d2/f43 [0,4194304] 0 2024-08-01T06:56:12.011 INFO:tasks.workunit.client.0.smithi016.stdout:2/91: fdatasync d0/d8/f18 0 2024-08-01T06:56:12.012 INFO:tasks.workunit.client.0.smithi016.stdout:5/306: chown d1/d2/d6/d9 1474 1 2024-08-01T06:56:12.014 INFO:tasks.workunit.client.0.smithi016.stdout:3/134: unlink l5 0 2024-08-01T06:56:12.017 INFO:tasks.workunit.client.0.smithi016.stdout:9/165: mkdir d3/d9/df/d38/d39 0 2024-08-01T06:56:12.020 INFO:tasks.workunit.client.0.smithi016.stdout:8/128: truncate d5/d8/d1a/d24/f19 2780243 0 2024-08-01T06:56:12.020 INFO:tasks.workunit.client.0.smithi016.stdout:1/211: dwrite d2/d3/d1a/d22/f3d [0,4194304] 0 2024-08-01T06:56:12.021 INFO:tasks.workunit.client.0.smithi016.stdout:6/163: creat d1/d8/d2f/f3e x:0 0 0 2024-08-01T06:56:12.026 INFO:tasks.workunit.client.0.smithi016.stdout:5/307: dread d1/d2/d6/fd [0,4194304] 0 2024-08-01T06:56:12.026 INFO:tasks.workunit.client.0.smithi016.stdout:7/148: rename d7/db/d17/d2c to d7/d3a 0 2024-08-01T06:56:12.028 INFO:tasks.workunit.client.0.smithi016.stdout:3/135: mkdir d9/d2c/d34 0 2024-08-01T06:56:12.031 INFO:tasks.workunit.client.0.smithi016.stdout:9/166: dwrite d3/d9/df/f2d [0,4194304] 0 2024-08-01T06:56:12.034 INFO:tasks.workunit.client.0.smithi016.stdout:6/164: mkdir d1/d9/d3f 0 2024-08-01T06:56:12.035 INFO:tasks.workunit.client.0.smithi016.stdout:2/92: rename d0/d1d to d0/d16/d20 0 2024-08-01T06:56:12.035 INFO:tasks.workunit.client.0.smithi016.stdout:2/93: truncate d0/fd 981489 0 2024-08-01T06:56:12.038 INFO:tasks.workunit.client.0.smithi016.stdout:8/129: creat d5/d8/d1a/d24/f2a x:0 0 0 2024-08-01T06:56:12.040 INFO:tasks.workunit.client.0.smithi016.stdout:5/308: dread - d1/d2/d6/d9/d49/d57/f5b zero size 2024-08-01T06:56:12.043 INFO:tasks.workunit.client.0.smithi016.stdout:7/149: symlink d7/db/d1a/da/d1c/l3b 0 2024-08-01T06:56:12.044 INFO:tasks.workunit.client.0.smithi016.stdout:9/167: mkdir d3/d9/db/d3a 0 2024-08-01T06:56:12.045 INFO:tasks.workunit.client.0.smithi016.stdout:3/136: read d9/f1f [1090603,23982] 0 2024-08-01T06:56:12.047 INFO:tasks.workunit.client.0.smithi016.stdout:6/165: mknod d1/d8/d1b/d22/c40 0 2024-08-01T06:56:12.048 INFO:tasks.workunit.client.0.smithi016.stdout:4/204: write d0/f1 [1138332,22537] 0 2024-08-01T06:56:12.050 INFO:tasks.workunit.client.0.smithi016.stdout:2/94: mknod d0/d8/c21 0 2024-08-01T06:56:12.051 INFO:tasks.workunit.client.0.smithi016.stdout:8/130: creat d5/d8/d1a/d24/f2b x:0 0 0 2024-08-01T06:56:12.052 INFO:tasks.workunit.client.0.smithi016.stdout:0/165: write d10/d11/d18/f2b [1651731,20288] 0 2024-08-01T06:56:12.053 INFO:tasks.workunit.client.0.smithi016.stdout:9/168: dwrite d3/d9/db/dc/f2c [0,4194304] 0 2024-08-01T06:56:12.055 INFO:tasks.workunit.client.0.smithi016.stdout:7/150: symlink d7/db/d1a/l3c 0 2024-08-01T06:56:12.057 INFO:tasks.workunit.client.0.smithi016.stdout:0/166: write d10/d1c/f35 [356051,7051] 0 2024-08-01T06:56:12.057 INFO:tasks.workunit.client.0.smithi016.stdout:7/151: dread - d7/db/f28 zero size 2024-08-01T06:56:12.058 INFO:tasks.workunit.client.0.smithi016.stdout:9/169: truncate d3/de/f18 1533241 0 2024-08-01T06:56:12.062 INFO:tasks.workunit.client.0.smithi016.stdout:8/131: unlink d5/dc/l23 0 2024-08-01T06:56:12.062 INFO:tasks.workunit.client.0.smithi016.stdout:2/95: dread d0/d8/d1b/f1c [0,4194304] 0 2024-08-01T06:56:12.066 INFO:tasks.workunit.client.0.smithi016.stdout:3/137: getdents d9/da/d18 0 2024-08-01T06:56:12.068 INFO:tasks.workunit.client.0.smithi016.stdout:1/212: dwrite d2/d2f/f33 [4194304,4194304] 0 2024-08-01T06:56:12.068 INFO:tasks.workunit.client.0.smithi016.stdout:0/167: symlink d10/d11/l36 0 2024-08-01T06:56:12.070 INFO:tasks.workunit.client.0.smithi016.stdout:1/213: write d2/d3/f18 [175458,63115] 0 2024-08-01T06:56:12.073 INFO:tasks.workunit.client.0.smithi016.stdout:2/96: dread d0/f17 [0,4194304] 0 2024-08-01T06:56:12.073 INFO:tasks.workunit.client.0.smithi016.stdout:7/152: rmdir d7/db/d1a/d39 39 2024-08-01T06:56:12.075 INFO:tasks.workunit.client.0.smithi016.stdout:7/153: write f5 [9247198,118671] 0 2024-08-01T06:56:12.076 INFO:tasks.workunit.client.0.smithi016.stdout:2/97: dread - d0/fb zero size 2024-08-01T06:56:12.076 INFO:tasks.workunit.client.0.smithi016.stdout:4/205: fdatasync d0/f8 0 2024-08-01T06:56:12.078 INFO:tasks.workunit.client.0.smithi016.stdout:1/214: truncate d2/d3/d1c/f2e 797805 0 2024-08-01T06:56:12.079 INFO:tasks.workunit.client.0.smithi016.stdout:3/138: dwrite d9/d1c/f2b [0,4194304] 0 2024-08-01T06:56:12.083 INFO:tasks.workunit.client.0.smithi016.stdout:1/215: truncate d2/de/f37 460476 0 2024-08-01T06:56:12.084 INFO:tasks.workunit.client.0.smithi016.stdout:0/168: mkdir d10/d11/d37 0 2024-08-01T06:56:12.088 INFO:tasks.workunit.client.0.smithi016.stdout:6/166: rename d1/d8/d2f to d1/d41 0 2024-08-01T06:56:12.093 INFO:tasks.workunit.client.0.smithi016.stdout:5/309: link d1/d2/d23/f26 d1/d12/d52/f69 0 2024-08-01T06:56:12.096 INFO:tasks.workunit.client.0.smithi016.stdout:2/98: dwrite d0/d16/f1f [0,4194304] 0 2024-08-01T06:56:12.102 INFO:tasks.workunit.client.0.smithi016.stdout:7/154: dwrite d7/db/d1a/da/f10 [0,4194304] 0 2024-08-01T06:56:12.102 INFO:tasks.workunit.client.0.smithi016.stdout:0/169: dread d10/d1c/f29 [0,4194304] 0 2024-08-01T06:56:12.104 INFO:tasks.workunit.client.0.smithi016.stdout:3/139: creat d9/da/df/d12/d20/f35 x:0 0 0 2024-08-01T06:56:12.104 INFO:tasks.workunit.client.0.smithi016.stdout:9/170: write d3/de/f13 [785947,82791] 0 2024-08-01T06:56:12.105 INFO:tasks.workunit.client.0.smithi016.stdout:3/140: chown d9/da/df/d12/d20 1322 1 2024-08-01T06:56:12.107 INFO:tasks.workunit.client.0.smithi016.stdout:9/171: fdatasync d3/d9/db/dc/f21 0 2024-08-01T06:56:12.110 INFO:tasks.workunit.client.0.smithi016.stdout:9/172: chown d3/de/f17 97602466 1 2024-08-01T06:56:12.110 INFO:tasks.workunit.client.0.smithi016.stdout:6/167: mkdir d1/d8/d1b/d22/d42 0 2024-08-01T06:56:12.110 INFO:tasks.workunit.client.0.smithi016.stdout:3/141: truncate d9/da/df/d12/f25 250604 0 2024-08-01T06:56:12.111 INFO:tasks.workunit.client.0.smithi016.stdout:5/310: stat d1/d12/d52/f69 0 2024-08-01T06:56:12.112 INFO:tasks.workunit.client.0.smithi016.stdout:4/206: symlink d0/d2/dc/d12/d29/l46 0 2024-08-01T06:56:12.112 INFO:tasks.workunit.client.0.smithi016.stdout:3/142: write d9/d2c/f31 [426459,108263] 0 2024-08-01T06:56:12.114 INFO:tasks.workunit.client.0.smithi016.stdout:4/207: truncate d0/d17/f2f 157778 0 2024-08-01T06:56:12.116 INFO:tasks.workunit.client.0.smithi016.stdout:2/99: unlink d0/d8/c9 0 2024-08-01T06:56:12.116 INFO:tasks.workunit.client.0.smithi016.stdout:2/100: chown d0/l1 6148 1 2024-08-01T06:56:12.119 INFO:tasks.workunit.client.0.smithi016.stdout:4/208: truncate d0/d17/f30 3523566 0 2024-08-01T06:56:12.119 INFO:tasks.workunit.client.0.smithi016.stdout:1/216: dread d2/d3/fd [0,4194304] 0 2024-08-01T06:56:12.121 INFO:tasks.workunit.client.0.smithi016.stdout:1/217: write d2/d3/f3f [269184,6439] 0 2024-08-01T06:56:12.123 INFO:tasks.workunit.client.0.smithi016.stdout:1/218: write d2/d3/d1a/f27 [51321,85864] 0 2024-08-01T06:56:12.124 INFO:tasks.workunit.client.0.smithi016.stdout:8/132: rename d5/d8/l9 to d5/l2c 0 2024-08-01T06:56:12.126 INFO:tasks.workunit.client.0.smithi016.stdout:6/168: mkdir d1/d43 0 2024-08-01T06:56:12.126 INFO:tasks.workunit.client.0.smithi016.stdout:8/133: chown d5/lb 13233882 1 2024-08-01T06:56:12.129 INFO:tasks.workunit.client.0.smithi016.stdout:7/155: creat d7/f3d x:0 0 0 2024-08-01T06:56:12.130 INFO:tasks.workunit.client.0.smithi016.stdout:8/134: write d5/d8/d1a/d24/f25 [326155,10975] 0 2024-08-01T06:56:12.132 INFO:tasks.workunit.client.0.smithi016.stdout:1/219: dwrite d2/d3/d1c/f2e [0,4194304] 0 2024-08-01T06:56:12.133 INFO:tasks.workunit.client.0.smithi016.stdout:8/135: write d5/f11 [2087682,100043] 0 2024-08-01T06:56:12.135 INFO:tasks.workunit.client.0.smithi016.stdout:8/136: truncate d5/d8/d1a/d24/f2a 697207 0 2024-08-01T06:56:12.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:11 smithi089 ceph-mon[36617]: Updating smithi089:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:56:12.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:11 smithi089 ceph-mon[36617]: Updating smithi016:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:56:12.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:11 smithi089 ceph-mon[36617]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-08-01T06:56:12.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:11 smithi089 ceph-mon[36617]: Updating smithi089:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-01T06:56:12.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:11 smithi089 ceph-mon[36617]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-08-01T06:56:12.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:11 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:12.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:11 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:12.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:11 smithi089 ceph-mon[36617]: Updating smithi016:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-01T06:56:12.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:11 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:12.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:11 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:12.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:11 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:12.138 INFO:tasks.workunit.client.0.smithi016.stdout:2/101: write d0/f17 [1660995,4745] 0 2024-08-01T06:56:12.138 INFO:tasks.workunit.client.0.smithi016.stdout:2/102: stat d0/f10 0 2024-08-01T06:56:12.141 INFO:tasks.workunit.client.0.smithi016.stdout:3/143: rename d9/da/df/f17 to d9/d2c/f36 0 2024-08-01T06:56:12.142 INFO:tasks.workunit.client.0.smithi016.stdout:9/173: truncate d3/d4/f11 258020 0 2024-08-01T06:56:12.143 INFO:tasks.workunit.client.0.smithi016.stdout:3/144: write d9/da/df/f33 [3775,72151] 0 2024-08-01T06:56:12.143 INFO:tasks.workunit.client.0.smithi016.stdout:2/103: dread d0/d16/f1f [0,4194304] 0 2024-08-01T06:56:12.150 INFO:tasks.workunit.client.0.smithi016.stdout:6/169: creat d1/d8/d1b/d22/d36/f44 x:0 0 0 2024-08-01T06:56:12.151 INFO:tasks.workunit.client.0.smithi016.stdout:6/170: chown d1/d8/f1a 20123599 1 2024-08-01T06:56:12.163 INFO:tasks.workunit.client.0.smithi016.stdout:7/156: rename c2 to d7/db/d1a/da/d1c/d1d/c3e 0 2024-08-01T06:56:12.163 INFO:tasks.workunit.client.0.smithi016.stdout:6/171: rename d1 to d1/d8/d34/d45 22 2024-08-01T06:56:12.165 INFO:tasks.workunit.client.0.smithi016.stdout:9/174: creat d3/d9/df/d2a/f3b x:0 0 0 2024-08-01T06:56:12.165 INFO:tasks.workunit.client.0.smithi016.stdout:2/104: write d0/fb [681653,84967] 0 2024-08-01T06:56:12.167 INFO:tasks.workunit.client.0.smithi016.stdout:1/220: creat d2/f46 x:0 0 0 2024-08-01T06:56:12.169 INFO:tasks.workunit.client.0.smithi016.stdout:7/157: creat d7/db/d1a/da/d1c/f3f x:0 0 0 2024-08-01T06:56:12.171 INFO:tasks.workunit.client.0.smithi016.stdout:7/158: write d7/db/d1a/da/f1b [916289,114689] 0 2024-08-01T06:56:12.171 INFO:tasks.workunit.client.0.smithi016.stdout:6/172: rmdir d1/d8/d1b/d22/d36 39 2024-08-01T06:56:12.173 INFO:tasks.workunit.client.0.smithi016.stdout:6/173: dread d1/d8/f1a [0,4194304] 0 2024-08-01T06:56:12.173 INFO:tasks.workunit.client.0.smithi016.stdout:9/175: unlink d3/de/f14 0 2024-08-01T06:56:12.175 INFO:tasks.workunit.client.0.smithi016.stdout:6/174: write d1/d8/d1b/f35 [218399,30089] 0 2024-08-01T06:56:12.177 INFO:tasks.workunit.client.0.smithi016.stdout:2/105: rmdir d0 39 2024-08-01T06:56:12.178 INFO:tasks.workunit.client.0.smithi016.stdout:3/145: creat d9/f37 x:0 0 0 2024-08-01T06:56:12.180 INFO:tasks.workunit.client.0.smithi016.stdout:3/146: dread d9/da/df/d12/f25 [0,4194304] 0 2024-08-01T06:56:12.184 INFO:tasks.workunit.client.0.smithi016.stdout:8/137: getdents d5 0 2024-08-01T06:56:12.184 INFO:tasks.workunit.client.0.smithi016.stdout:1/221: creat d2/d3/d41/f47 x:0 0 0 2024-08-01T06:56:12.184 INFO:tasks.workunit.client.0.smithi016.stdout:7/159: mkdir d7/db/d1a/da/d1c/d1d/d40 0 2024-08-01T06:56:12.185 INFO:tasks.workunit.client.0.smithi016.stdout:8/138: write d5/f11 [698223,74254] 0 2024-08-01T06:56:12.186 INFO:tasks.workunit.client.0.smithi016.stdout:3/147: write d9/da/fb [2235026,118150] 0 2024-08-01T06:56:12.187 INFO:tasks.workunit.client.0.smithi016.stdout:6/175: mknod d1/d8/d1b/d22/d2d/c46 0 2024-08-01T06:56:12.188 INFO:tasks.workunit.client.0.smithi016.stdout:3/148: write d9/d1c/f2b [955783,47370] 0 2024-08-01T06:56:12.190 INFO:tasks.workunit.client.0.smithi016.stdout:2/106: write d0/f10 [2250585,48887] 0 2024-08-01T06:56:12.192 INFO:tasks.workunit.client.0.smithi016.stdout:2/107: readlink d0/l1 0 2024-08-01T06:56:12.195 INFO:tasks.workunit.client.0.smithi016.stdout:7/160: chown d7/db/d1a/d39/l25 63 1 2024-08-01T06:56:12.196 INFO:tasks.workunit.client.0.smithi016.stdout:7/161: dread - d7/db/d1a/da/d22/f27 zero size 2024-08-01T06:56:12.199 INFO:tasks.workunit.client.0.smithi016.stdout:3/149: unlink d9/d1c/f27 0 2024-08-01T06:56:12.201 INFO:tasks.workunit.client.0.smithi016.stdout:2/108: mkdir d0/d8/d22 0 2024-08-01T06:56:12.202 INFO:tasks.workunit.client.0.smithi016.stdout:2/109: write d0/fb [344250,145] 0 2024-08-01T06:56:12.203 INFO:tasks.workunit.client.0.smithi016.stdout:1/222: mkdir d2/d3/d48 0 2024-08-01T06:56:12.205 INFO:tasks.workunit.client.0.smithi016.stdout:9/176: rmdir d3/d9/df/d38/d39 0 2024-08-01T06:56:12.209 INFO:tasks.workunit.client.0.smithi016.stdout:7/162: creat d7/db/d1a/d39/f41 x:0 0 0 2024-08-01T06:56:12.210 INFO:tasks.workunit.client.0.smithi016.stdout:2/110: dwrite d0/d8/f11 [0,4194304] 0 2024-08-01T06:56:12.211 INFO:tasks.workunit.client.0.smithi016.stdout:1/223: dread d2/d3/d1a/d22/f3d [0,4194304] 0 2024-08-01T06:56:12.212 INFO:tasks.workunit.client.0.smithi016.stdout:2/111: chown d0/d8/d1b/f1c 12 1 2024-08-01T06:56:12.213 INFO:tasks.workunit.client.0.smithi016.stdout:7/163: write d7/db/d1a/d39/f29 [2982185,118439] 0 2024-08-01T06:56:12.213 INFO:tasks.workunit.client.0.smithi016.stdout:6/176: write d1/d8/fa [2494269,94308] 0 2024-08-01T06:56:12.214 INFO:tasks.workunit.client.0.smithi016.stdout:2/112: write d0/d8/f11 [2607792,84365] 0 2024-08-01T06:56:12.216 INFO:tasks.workunit.client.0.smithi016.stdout:2/113: write d0/fb [1152329,117667] 0 2024-08-01T06:56:12.216 INFO:tasks.workunit.client.0.smithi016.stdout:3/150: write f3 [5572524,30274] 0 2024-08-01T06:56:12.225 INFO:tasks.workunit.client.0.smithi016.stdout:9/177: read d3/d32/f36 [262170,84799] 0 2024-08-01T06:56:12.226 INFO:tasks.workunit.client.0.smithi016.stdout:2/114: dwrite d0/f10 [4194304,4194304] 0 2024-08-01T06:56:12.228 INFO:tasks.workunit.client.0.smithi016.stdout:8/139: link d5/d8/d1a/c1e d5/d8/d1a/c2d 0 2024-08-01T06:56:12.228 INFO:tasks.workunit.client.0.smithi016.stdout:2/115: truncate d0/d8/f18 693354 0 2024-08-01T06:56:12.228 INFO:tasks.workunit.client.0.smithi016.stdout:2/116: chown d0/cc 125955380 1 2024-08-01T06:56:12.229 INFO:tasks.workunit.client.0.smithi016.stdout:1/224: mkdir d2/d3/d41/d49 0 2024-08-01T06:56:12.233 INFO:tasks.workunit.client.0.smithi016.stdout:7/164: rename d7/d3a to d7/db/d42 0 2024-08-01T06:56:12.239 INFO:tasks.workunit.client.0.smithi016.stdout:9/178: creat d3/de/f3c x:0 0 0 2024-08-01T06:56:12.239 INFO:tasks.workunit.client.0.smithi016.stdout:8/140: creat d5/d8/f2e x:0 0 0 2024-08-01T06:56:12.241 INFO:tasks.workunit.client.0.smithi016.stdout:2/117: mknod d0/d8/c23 0 2024-08-01T06:56:12.242 INFO:tasks.workunit.client.0.smithi016.stdout:1/225: fdatasync d2/d3/d1a/d22/f3d 0 2024-08-01T06:56:12.243 INFO:tasks.workunit.client.0.smithi016.stdout:7/165: dwrite d7/db/f28 [0,4194304] 0 2024-08-01T06:56:12.243 INFO:tasks.workunit.client.0.smithi016.stdout:3/151: getdents d9/da/d18 0 2024-08-01T06:56:12.247 INFO:tasks.workunit.client.0.smithi016.stdout:6/177: rmdir d1/d8/d34/d39 0 2024-08-01T06:56:12.249 INFO:tasks.workunit.client.0.smithi016.stdout:1/226: write d2/f12 [1975792,113475] 0 2024-08-01T06:56:12.257 INFO:tasks.workunit.client.0.smithi016.stdout:7/166: rename d7/db/d42 to d7/db/d1a/d39/d43 0 2024-08-01T06:56:12.259 INFO:tasks.workunit.client.0.smithi016.stdout:7/167: fdatasync d7/f11 0 2024-08-01T06:56:12.259 INFO:tasks.workunit.client.0.smithi016.stdout:1/227: dwrite d2/d3/d41/f47 [0,4194304] 0 2024-08-01T06:56:12.262 INFO:tasks.workunit.client.0.smithi016.stdout:9/179: dread d3/d4/fa [0,4194304] 0 2024-08-01T06:56:12.265 INFO:tasks.workunit.client.0.smithi016.stdout:8/141: write d5/d8/d1a/d24/f19 [1381333,11538] 0 2024-08-01T06:56:12.271 INFO:tasks.workunit.client.0.smithi016.stdout:6/178: symlink d1/d9/d3f/l47 0 2024-08-01T06:56:12.274 INFO:tasks.workunit.client.0.smithi016.stdout:7/168: creat d7/db/f44 x:0 0 0 2024-08-01T06:56:12.276 INFO:tasks.workunit.client.0.smithi016.stdout:7/169: dread - d7/db/d1a/da/d1e/d26/f32 zero size 2024-08-01T06:56:12.276 INFO:tasks.workunit.client.0.smithi016.stdout:2/118: truncate d0/fd 952273 0 2024-08-01T06:56:12.279 INFO:tasks.workunit.client.0.smithi016.stdout:3/152: rmdir d9/d2c/d34 0 2024-08-01T06:56:12.281 INFO:tasks.workunit.client.0.smithi016.stdout:3/153: write d9/d2c/f31 [1202767,123312] 0 2024-08-01T06:56:12.282 INFO:tasks.workunit.client.0.smithi016.stdout:6/179: mkdir d1/d8/d1b/d48 0 2024-08-01T06:56:12.285 INFO:tasks.workunit.client.0.smithi016.stdout:2/119: dwrite d0/f10 [0,4194304] 0 2024-08-01T06:56:12.285 INFO:tasks.workunit.client.0.smithi016.stdout:6/180: write d1/d8/f2c [1460385,44329] 0 2024-08-01T06:56:12.294 INFO:tasks.workunit.client.0.smithi016.stdout:3/154: dwrite d9/d2c/f31 [0,4194304] 0 2024-08-01T06:56:12.295 INFO:tasks.workunit.client.0.smithi016.stdout:2/120: symlink d0/d16/d20/l24 0 2024-08-01T06:56:12.298 INFO:tasks.workunit.client.0.smithi016.stdout:2/121: readlink d0/d8/le 0 2024-08-01T06:56:12.299 INFO:tasks.workunit.client.0.smithi016.stdout:6/181: dread d1/d8/d34/f37 [0,4194304] 0 2024-08-01T06:56:12.302 INFO:tasks.workunit.client.0.smithi016.stdout:8/142: dwrite d5/f12 [0,4194304] 0 2024-08-01T06:56:12.304 INFO:tasks.workunit.client.0.smithi016.stdout:1/228: getdents d2/d2f 0 2024-08-01T06:56:12.304 INFO:tasks.workunit.client.0.smithi016.stdout:7/170: rename d7/l21 to d7/l45 0 2024-08-01T06:56:12.306 INFO:tasks.workunit.client.0.smithi016.stdout:2/122: mknod d0/d8/c25 0 2024-08-01T06:56:12.308 INFO:tasks.workunit.client.0.smithi016.stdout:3/155: rename d9/da/fb to d9/da/df/d2a/f38 0 2024-08-01T06:56:12.309 INFO:tasks.workunit.client.0.smithi016.stdout:6/182: mknod d1/d9/d3f/c49 0 2024-08-01T06:56:12.310 INFO:tasks.workunit.client.0.smithi016.stdout:6/183: chown d1/d8/d34/f37 89 1 2024-08-01T06:56:12.311 INFO:tasks.workunit.client.0.smithi016.stdout:8/143: rmdir d5/d8/d1a/d24 39 2024-08-01T06:56:12.314 INFO:tasks.workunit.client.0.smithi016.stdout:2/123: creat d0/d8/f26 x:0 0 0 2024-08-01T06:56:12.322 INFO:tasks.workunit.client.0.smithi016.stdout:2/124: dwrite d0/d8/f26 [0,4194304] 0 2024-08-01T06:56:12.324 INFO:tasks.workunit.client.0.smithi016.stdout:8/144: rmdir d5/d8 39 2024-08-01T06:56:12.325 INFO:tasks.workunit.client.0.smithi016.stdout:1/229: link d2/d3/d1c/f36 d2/de/d21/d3e/f4a 0 2024-08-01T06:56:12.327 INFO:tasks.workunit.client.0.smithi016.stdout:7/171: link d7/db/d1a/da/d1c/f3f d7/db/d1a/da/d1e/d26/f46 0 2024-08-01T06:56:12.328 INFO:tasks.workunit.client.0.smithi016.stdout:3/156: dwrite d9/da/df/d2a/f38 [0,4194304] 0 2024-08-01T06:56:12.330 INFO:tasks.workunit.client.0.smithi016.stdout:7/172: write d7/db/d1a/da/d22/f37 [866245,76714] 0 2024-08-01T06:56:12.331 INFO:tasks.workunit.client.0.smithi016.stdout:6/184: creat d1/d43/f4a x:0 0 0 2024-08-01T06:56:12.338 INFO:tasks.workunit.client.0.smithi016.stdout:1/230: rename d2/l15 to d2/d3/d41/l4b 0 2024-08-01T06:56:12.344 INFO:tasks.workunit.client.0.smithi016.stdout:7/173: mknod d7/db/d1a/da/d1e/d26/c47 0 2024-08-01T06:56:12.346 INFO:tasks.workunit.client.0.smithi016.stdout:3/157: rename d9/da/df/d12/l1b to d9/d1c/l39 0 2024-08-01T06:56:12.353 INFO:tasks.workunit.client.0.smithi016.stdout:7/174: symlink d7/db/d1a/da/l48 0 2024-08-01T06:56:12.356 INFO:tasks.workunit.client.0.smithi016.stdout:8/145: rename d5/d8/d1a/d24/f25 to d5/d8/f2f 0 2024-08-01T06:56:12.359 INFO:tasks.workunit.client.0.smithi016.stdout:7/175: unlink d7/db/f36 0 2024-08-01T06:56:12.361 INFO:tasks.workunit.client.0.smithi016.stdout:2/125: dwrite d0/fd [0,4194304] 0 2024-08-01T06:56:12.362 INFO:tasks.workunit.client.0.smithi016.stdout:3/158: creat d9/f3a x:0 0 0 2024-08-01T06:56:12.363 INFO:tasks.workunit.client.0.smithi016.stdout:6/185: dwrite d1/d8/f1a [0,4194304] 0 2024-08-01T06:56:12.365 INFO:tasks.workunit.client.0.smithi016.stdout:3/159: chown d9/da/f2e 319 1 2024-08-01T06:56:12.367 INFO:tasks.workunit.client.0.smithi016.stdout:7/176: dread d7/f11 [0,4194304] 0 2024-08-01T06:56:12.371 INFO:tasks.workunit.client.0.smithi016.stdout:3/160: dread d9/da/df/f33 [0,4194304] 0 2024-08-01T06:56:12.372 INFO:tasks.workunit.client.0.smithi016.stdout:3/161: truncate d9/f29 1013136 0 2024-08-01T06:56:12.378 INFO:tasks.workunit.client.0.smithi016.stdout:7/177: write d7/db/d1a/da/d1e/f1f [7990398,44064] 0 2024-08-01T06:56:12.380 INFO:tasks.workunit.client.0.smithi016.stdout:7/178: write d7/db/d1a/da/d1e/f1f [8311462,69856] 0 2024-08-01T06:56:12.380 INFO:tasks.workunit.client.0.smithi016.stdout:2/126: symlink d0/d8/d22/l27 0 2024-08-01T06:56:12.382 INFO:tasks.workunit.client.0.smithi016.stdout:2/127: read d0/d8/f18 [465384,124582] 0 2024-08-01T06:56:12.384 INFO:tasks.workunit.client.0.smithi016.stdout:6/186: symlink d1/d8/d1b/d48/l4b 0 2024-08-01T06:56:12.388 INFO:tasks.workunit.client.0.smithi016.stdout:6/187: dread d1/d8/f1a [0,4194304] 0 2024-08-01T06:56:12.389 INFO:tasks.workunit.client.0.smithi016.stdout:6/188: chown d1/d8/d1b/d22 212004392 1 2024-08-01T06:56:12.391 INFO:tasks.workunit.client.0.smithi016.stdout:3/162: unlink d9/f3a 0 2024-08-01T06:56:12.395 INFO:tasks.workunit.client.0.smithi016.stdout:2/128: unlink d0/f10 0 2024-08-01T06:56:12.398 INFO:tasks.workunit.client.0.smithi016.stdout:6/189: dwrite d1/d8/d34/f38 [0,4194304] 0 2024-08-01T06:56:12.400 INFO:tasks.workunit.client.0.smithi016.stdout:8/146: rename d5/l6 to d5/d8/d1a/l30 0 2024-08-01T06:56:12.403 INFO:tasks.workunit.client.0.smithi016.stdout:2/129: dwrite d0/f17 [0,4194304] 0 2024-08-01T06:56:12.407 INFO:tasks.workunit.client.0.smithi016.stdout:7/179: link d7/db/d1a/da/f38 d7/db/d1a/da/d1e/d26/f49 0 2024-08-01T06:56:12.413 INFO:tasks.workunit.client.0.smithi016.stdout:6/190: fsync d1/d8/d1b/d22/d36/f44 0 2024-08-01T06:56:12.415 INFO:tasks.workunit.client.0.smithi016.stdout:3/163: rename d9/da/df/d12/l1e to d9/da/df/d12/d20/l3b 0 2024-08-01T06:56:12.418 INFO:tasks.workunit.client.0.smithi016.stdout:2/130: symlink d0/d8/d22/l28 0 2024-08-01T06:56:12.422 INFO:tasks.workunit.client.0.smithi016.stdout:6/191: dwrite d1/d8/d34/f38 [0,4194304] 0 2024-08-01T06:56:12.422 INFO:tasks.workunit.client.0.smithi016.stdout:7/180: creat d7/db/d1a/da/d22/f4a x:0 0 0 2024-08-01T06:56:12.424 INFO:tasks.workunit.client.0.smithi016.stdout:8/147: creat d5/dc/f31 x:0 0 0 2024-08-01T06:56:12.429 INFO:tasks.workunit.client.0.smithi016.stdout:3/164: chown d9/da/df/d2a/l2f 93 1 2024-08-01T06:56:12.431 INFO:tasks.workunit.client.0.smithi016.stdout:6/192: readlink d1/l23 0 2024-08-01T06:56:12.432 INFO:tasks.workunit.client.0.smithi016.stdout:7/181: unlink d7/db/d1a/da/d22/f37 0 2024-08-01T06:56:12.434 INFO:tasks.workunit.client.0.smithi016.stdout:8/148: mkdir d5/d8/d32 0 2024-08-01T06:56:12.434 INFO:tasks.workunit.client.0.smithi016.stdout:7/182: chown d7/db/d1a/d39/l12 6819435 1 2024-08-01T06:56:12.436 INFO:tasks.workunit.client.0.smithi016.stdout:2/131: fsync d0/f5 0 2024-08-01T06:56:12.441 INFO:tasks.workunit.client.0.smithi016.stdout:6/193: creat d1/d9/f4c x:0 0 0 2024-08-01T06:56:12.441 INFO:tasks.workunit.client.0.smithi016.stdout:2/132: dread d0/fb [0,4194304] 0 2024-08-01T06:56:12.444 INFO:tasks.workunit.client.0.smithi016.stdout:7/183: creat d7/db/d1a/da/d1e/d26/d2a/f4b x:0 0 0 2024-08-01T06:56:12.448 INFO:tasks.workunit.client.0.smithi016.stdout:8/149: creat d5/d1c/f33 x:0 0 0 2024-08-01T06:56:12.450 INFO:tasks.workunit.client.0.smithi016.stdout:7/184: chown d7/ld 419222 1 2024-08-01T06:56:12.451 INFO:tasks.workunit.client.0.smithi016.stdout:3/165: dwrite d9/da/df/f33 [0,4194304] 0 2024-08-01T06:56:12.453 INFO:tasks.workunit.client.0.smithi016.stdout:2/133: dwrite d0/fd [0,4194304] 0 2024-08-01T06:56:12.453 INFO:tasks.workunit.client.0.smithi016.stdout:6/194: symlink d1/d8/l4d 0 2024-08-01T06:56:12.456 INFO:tasks.workunit.client.0.smithi016.stdout:2/134: chown d0/d8/d1b 788703081 1 2024-08-01T06:56:12.456 INFO:tasks.workunit.client.0.smithi016.stdout:8/150: dread d5/d8/f2f [0,4194304] 0 2024-08-01T06:56:12.456 INFO:tasks.workunit.client.0.smithi016.stdout:6/195: dread - d1/d43/f4a zero size 2024-08-01T06:56:12.459 INFO:tasks.workunit.client.0.smithi016.stdout:8/151: dread d5/d8/f2f [0,4194304] 0 2024-08-01T06:56:12.461 INFO:tasks.workunit.client.0.smithi016.stdout:2/135: creat d0/d8/d1b/f29 x:0 0 0 2024-08-01T06:56:12.463 INFO:tasks.workunit.client.0.smithi016.stdout:7/185: creat d7/db/d1a/da/d1c/d1d/d40/f4c x:0 0 0 2024-08-01T06:56:12.464 INFO:tasks.workunit.client.0.smithi016.stdout:3/166: dwrite d9/f37 [0,4194304] 0 2024-08-01T06:56:12.465 INFO:tasks.workunit.client.0.smithi016.stdout:3/167: write d9/f29 [1104026,118679] 0 2024-08-01T06:56:12.466 INFO:tasks.workunit.client.0.smithi016.stdout:6/196: rmdir d1/d8/d1b 39 2024-08-01T06:56:12.467 INFO:tasks.workunit.client.0.smithi016.stdout:8/152: chown c2 407316124 1 2024-08-01T06:56:12.470 INFO:tasks.workunit.client.0.smithi016.stdout:2/136: dread d0/fb [0,4194304] 0 2024-08-01T06:56:12.474 INFO:tasks.workunit.client.0.smithi016.stdout:3/168: write d9/d2c/f36 [2224813,17119] 0 2024-08-01T06:56:12.477 INFO:tasks.workunit.client.0.smithi016.stdout:2/137: truncate d0/fb 1619401 0 2024-08-01T06:56:12.481 INFO:tasks.workunit.client.0.smithi016.stdout:7/186: creat d7/db/d1a/f4d x:0 0 0 2024-08-01T06:56:12.482 INFO:tasks.workunit.client.0.smithi016.stdout:6/197: mkdir d1/d8/d1b/d22/d4e 0 2024-08-01T06:56:12.485 INFO:tasks.workunit.client.0.smithi016.stdout:8/153: creat d5/f34 x:0 0 0 2024-08-01T06:56:12.485 INFO:tasks.workunit.client.0.smithi016.stdout:7/187: mkdir d7/db/d17/d4e 0 2024-08-01T06:56:12.487 INFO:tasks.workunit.client.0.smithi016.stdout:2/138: dwrite d0/fd [0,4194304] 0 2024-08-01T06:56:12.489 INFO:tasks.workunit.client.0.smithi016.stdout:6/198: rename d1/d8/c14 to d1/d8/c4f 0 2024-08-01T06:56:12.490 INFO:tasks.workunit.client.0.smithi016.stdout:6/199: write d1/f5 [53414,68594] 0 2024-08-01T06:56:12.491 INFO:tasks.workunit.client.0.smithi016.stdout:6/200: dread - d1/d43/f4a zero size 2024-08-01T06:56:12.493 INFO:tasks.workunit.client.0.smithi016.stdout:2/139: dread d0/fd [0,4194304] 0 2024-08-01T06:56:12.497 INFO:tasks.workunit.client.0.smithi016.stdout:3/169: write d9/da/df/d12/f25 [665322,31035] 0 2024-08-01T06:56:12.498 INFO:tasks.workunit.client.0.smithi016.stdout:3/170: fsync d9/d2c/f36 0 2024-08-01T06:56:12.499 INFO:tasks.workunit.client.0.smithi016.stdout:6/201: chown d1/l33 33 1 2024-08-01T06:56:12.499 INFO:tasks.workunit.client.0.smithi016.stdout:3/171: readlink d9/d1c/l32 0 2024-08-01T06:56:12.500 INFO:tasks.workunit.client.0.smithi016.stdout:2/140: dread d0/fd [0,4194304] 0 2024-08-01T06:56:12.503 INFO:tasks.workunit.client.0.smithi016.stdout:8/154: link d5/d1c/l20 d5/d1c/l35 0 2024-08-01T06:56:12.504 INFO:tasks.workunit.client.0.smithi016.stdout:6/202: dread d1/d8/d1b/f25 [0,4194304] 0 2024-08-01T06:56:12.507 INFO:tasks.workunit.client.0.smithi016.stdout:8/155: creat d5/dc/f36 x:0 0 0 2024-08-01T06:56:12.507 INFO:tasks.workunit.client.0.smithi016.stdout:2/141: write d0/fd [2426704,110434] 0 2024-08-01T06:56:12.509 INFO:tasks.workunit.client.0.smithi016.stdout:6/203: write d1/d8/f1a [1891258,65753] 0 2024-08-01T06:56:12.511 INFO:tasks.workunit.client.0.smithi016.stdout:8/156: rmdir d5/d8 39 2024-08-01T06:56:12.513 INFO:tasks.workunit.client.0.smithi016.stdout:7/188: dwrite d7/db/d1a/da/d1e/d26/f49 [0,4194304] 0 2024-08-01T06:56:12.513 INFO:tasks.workunit.client.0.smithi016.stdout:2/142: write d0/d16/f1f [772706,78673] 0 2024-08-01T06:56:12.526 INFO:tasks.workunit.client.0.smithi016.stdout:7/189: dwrite d7/db/d1a/da/d22/f27 [0,4194304] 0 2024-08-01T06:56:12.527 INFO:tasks.workunit.client.0.smithi016.stdout:8/157: dwrite d5/d8/d1a/d24/f2a [0,4194304] 0 2024-08-01T06:56:12.533 INFO:tasks.workunit.client.0.smithi016.stdout:2/143: symlink d0/d8/d22/l2a 0 2024-08-01T06:56:12.541 INFO:tasks.workunit.client.0.smithi016.stdout:2/144: dwrite d0/d8/f26 [0,4194304] 0 2024-08-01T06:56:12.543 INFO:tasks.workunit.client.0.smithi016.stdout:7/190: mkdir d7/db/d1a/da/d1c/d4f 0 2024-08-01T06:56:12.548 INFO:tasks.workunit.client.0.smithi016.stdout:6/204: rmdir d1/d8/d1b/d22/d42 0 2024-08-01T06:56:12.549 INFO:tasks.workunit.client.0.smithi016.stdout:2/145: mknod d0/d8/c2b 0 2024-08-01T06:56:12.557 INFO:tasks.workunit.client.0.smithi016.stdout:7/191: truncate d7/f11 481520 0 2024-08-01T06:56:12.558 INFO:tasks.workunit.client.0.smithi016.stdout:8/158: dread d5/dc/f17 [0,4194304] 0 2024-08-01T06:56:12.558 INFO:tasks.workunit.client.0.smithi016.stdout:6/205: getdents d1/d8/d1b/d22/d4e 0 2024-08-01T06:56:12.560 INFO:tasks.workunit.client.0.smithi016.stdout:2/146: creat d0/d19/f2c x:0 0 0 2024-08-01T06:56:12.561 INFO:tasks.workunit.client.0.smithi016.stdout:8/159: creat d5/d1c/f37 x:0 0 0 2024-08-01T06:56:12.569 INFO:tasks.workunit.client.0.smithi016.stdout:2/147: truncate d0/fb 392048 0 2024-08-01T06:56:12.570 INFO:tasks.workunit.client.0.smithi016.stdout:2/148: write d0/d19/f2c [609570,111907] 0 2024-08-01T06:56:12.574 INFO:tasks.workunit.client.0.smithi016.stdout:8/160: rename d5/f34 to d5/f38 0 2024-08-01T06:56:12.574 INFO:tasks.workunit.client.0.smithi016.stdout:7/192: link d7/db/d1a/da/d1e/d26/c47 d7/c50 0 2024-08-01T06:56:12.575 INFO:tasks.workunit.client.0.smithi016.stdout:8/161: fdatasync d5/d8/f2e 0 2024-08-01T06:56:12.652 INFO:tasks.workunit.client.0.smithi016.stdout:6/206: write d1/d8/d1b/d22/f29 [3522369,69578] 0 2024-08-01T06:56:12.655 INFO:tasks.workunit.client.0.smithi016.stdout:6/207: dread - d1/d9/f4c zero size 2024-08-01T06:56:12.656 INFO:tasks.workunit.client.0.smithi016.stdout:7/193: dwrite d7/db/d1a/da/d1e/d26/f49 [0,4194304] 0 2024-08-01T06:56:12.657 INFO:tasks.workunit.client.0.smithi016.stdout:6/208: readlink d1/l1e 0 2024-08-01T06:56:12.658 INFO:tasks.workunit.client.0.smithi016.stdout:8/162: link d5/l7 d5/d1c/l39 0 2024-08-01T06:56:12.660 INFO:tasks.workunit.client.0.smithi016.stdout:2/149: dwrite d0/f3 [4194304,4194304] 0 2024-08-01T06:56:12.665 INFO:tasks.workunit.client.0.smithi016.stdout:2/150: creat d0/d16/f2d x:0 0 0 2024-08-01T06:56:12.669 INFO:tasks.workunit.client.0.smithi016.stdout:7/194: link d7/db/d1a/da/d1e/f1f d7/db/d1a/da/d1e/f51 0 2024-08-01T06:56:12.669 INFO:tasks.workunit.client.0.smithi016.stdout:8/163: dwrite d5/f12 [0,4194304] 0 2024-08-01T06:56:12.671 INFO:tasks.workunit.client.0.smithi016.stdout:2/151: mkdir d0/d16/d20/d2e 0 2024-08-01T06:56:12.671 INFO:tasks.workunit.client.0.smithi016.stdout:8/164: dread - d5/d8/d1a/f29 zero size 2024-08-01T06:56:12.677 INFO:tasks.workunit.client.0.smithi016.stdout:2/152: creat d0/d19/f2f x:0 0 0 2024-08-01T06:56:12.678 INFO:tasks.workunit.client.0.smithi016.stdout:8/165: dread d5/dc/f17 [0,4194304] 0 2024-08-01T06:56:12.678 INFO:tasks.workunit.client.0.smithi016.stdout:2/153: chown d0/fd 75939611 1 2024-08-01T06:56:12.685 INFO:tasks.workunit.client.0.smithi016.stdout:2/154: mknod d0/d8/d22/c30 0 2024-08-01T06:56:12.686 INFO:tasks.workunit.client.0.smithi016.stdout:8/166: symlink d5/d8/d1a/d24/l3a 0 2024-08-01T06:56:12.688 INFO:tasks.workunit.client.0.smithi016.stdout:2/155: rmdir d0/d8/d22 39 2024-08-01T06:56:12.693 INFO:tasks.workunit.client.0.smithi016.stdout:8/167: dwrite d5/d1c/f33 [0,4194304] 0 2024-08-01T06:56:12.695 INFO:tasks.workunit.client.0.smithi016.stdout:2/156: mkdir d0/d8/d31 0 2024-08-01T06:56:12.698 INFO:tasks.workunit.client.0.smithi016.stdout:2/157: write d0/d16/f1f [445839,64074] 0 2024-08-01T06:56:12.700 INFO:tasks.workunit.client.0.smithi016.stdout:2/158: fsync d0/f17 0 2024-08-01T06:56:12.702 INFO:tasks.workunit.client.0.smithi016.stdout:6/209: dread d1/f5 [0,4194304] 0 2024-08-01T06:56:12.706 INFO:tasks.workunit.client.0.smithi016.stdout:7/195: dwrite d7/ff [0,4194304] 0 2024-08-01T06:56:12.711 INFO:tasks.workunit.client.0.smithi016.stdout:8/168: dwrite d5/f11 [0,4194304] 0 2024-08-01T06:56:12.720 INFO:tasks.workunit.client.0.smithi016.stdout:2/159: dwrite d0/d19/f2f [0,4194304] 0 2024-08-01T06:56:12.723 INFO:tasks.workunit.client.0.smithi016.stdout:7/196: creat d7/db/d1a/da/d1c/d1d/f52 x:0 0 0 2024-08-01T06:56:12.725 INFO:tasks.workunit.client.0.smithi016.stdout:7/197: chown d7/db/d1a/da/f10 174 1 2024-08-01T06:56:12.726 INFO:tasks.workunit.client.0.smithi016.stdout:8/169: dwrite d5/d8/d1a/d24/f2a [0,4194304] 0 2024-08-01T06:56:12.726 INFO:tasks.workunit.client.0.smithi016.stdout:6/210: dread d1/d9/fb [0,4194304] 0 2024-08-01T06:56:12.735 INFO:tasks.workunit.client.0.smithi016.stdout:8/170: write d5/f38 [280674,35017] 0 2024-08-01T06:56:12.738 INFO:tasks.workunit.client.0.smithi016.stdout:7/198: dwrite d7/db/d1a/da/d1c/d1d/d40/f4c [0,4194304] 0 2024-08-01T06:56:12.741 INFO:tasks.workunit.client.0.smithi016.stdout:8/171: dread d5/d8/f2f [0,4194304] 0 2024-08-01T06:56:12.741 INFO:tasks.workunit.client.0.smithi016.stdout:6/211: link d1/d9/f21 d1/d8/d1b/f50 0 2024-08-01T06:56:12.744 INFO:tasks.workunit.client.0.smithi016.stdout:7/199: mkdir d7/db/d1a/d39/d43/d53 0 2024-08-01T06:56:12.745 INFO:tasks.workunit.client.0.smithi016.stdout:2/160: dwrite d0/d8/d1b/f1c [0,4194304] 0 2024-08-01T06:56:12.747 INFO:tasks.workunit.client.0.smithi016.stdout:7/200: write d7/db/d1a/da/f1b [1481600,90669] 0 2024-08-01T06:56:12.749 INFO:tasks.workunit.client.0.smithi016.stdout:8/172: creat d5/d8/f3b x:0 0 0 2024-08-01T06:56:12.761 INFO:tasks.workunit.client.0.smithi016.stdout:2/161: mknod d0/d8/d31/c32 0 2024-08-01T06:56:12.762 INFO:tasks.workunit.client.0.smithi016.stdout:2/162: truncate d0/d8/d1b/f1c 5184008 0 2024-08-01T06:56:12.762 INFO:tasks.workunit.client.0.smithi016.stdout:7/201: creat d7/db/d17/d4e/f54 x:0 0 0 2024-08-01T06:56:12.764 INFO:tasks.workunit.client.0.smithi016.stdout:2/163: write d0/d8/f11 [304501,52592] 0 2024-08-01T06:56:12.765 INFO:tasks.workunit.client.0.smithi016.stdout:8/173: mknod d5/c3c 0 2024-08-01T06:56:12.767 INFO:tasks.workunit.client.0.smithi016.stdout:6/212: creat d1/d8/f51 x:0 0 0 2024-08-01T06:56:12.768 INFO:tasks.workunit.client.0.smithi016.stdout:6/213: write d1/d8/f1a [1071446,71650] 0 2024-08-01T06:56:12.769 INFO:tasks.workunit.client.0.smithi016.stdout:6/214: dread - d1/d8/d1b/d22/d36/f44 zero size 2024-08-01T06:56:12.770 INFO:tasks.workunit.client.0.smithi016.stdout:6/215: readlink d1/l1e 0 2024-08-01T06:56:12.770 INFO:tasks.workunit.client.0.smithi016.stdout:7/202: creat d7/db/d1a/da/d1c/d1d/d40/f55 x:0 0 0 2024-08-01T06:56:12.771 INFO:tasks.workunit.client.0.smithi016.stdout:8/174: symlink d5/d1c/l3d 0 2024-08-01T06:56:12.779 INFO:tasks.workunit.client.0.smithi016.stdout:8/175: mkdir d5/dc/d3e 0 2024-08-01T06:56:12.781 INFO:tasks.workunit.client.0.smithi016.stdout:2/164: creat d0/d8/f33 x:0 0 0 2024-08-01T06:56:12.783 INFO:tasks.workunit.client.0.smithi016.stdout:7/203: symlink d7/db/d1a/d39/d43/d53/l56 0 2024-08-01T06:56:12.787 INFO:tasks.workunit.client.0.smithi016.stdout:7/204: symlink d7/db/d1a/da/d22/l57 0 2024-08-01T06:56:12.788 INFO:tasks.workunit.client.0.smithi016.stdout:7/205: dread - d7/db/f44 zero size 2024-08-01T06:56:12.789 INFO:tasks.workunit.client.0.smithi016.stdout:7/206: write d7/db/d1a/da/f38 [2064830,70629] 0 2024-08-01T06:56:12.792 INFO:tasks.workunit.client.0.smithi016.stdout:2/165: symlink d0/l34 0 2024-08-01T06:56:12.793 INFO:tasks.workunit.client.0.smithi016.stdout:2/166: write d0/d19/f2f [3571188,6710] 0 2024-08-01T06:56:12.794 INFO:tasks.workunit.client.0.smithi016.stdout:2/167: write d0/d8/d1b/f1c [4601752,80268] 0 2024-08-01T06:56:12.796 INFO:tasks.workunit.client.0.smithi016.stdout:7/207: mkdir d7/db/d1a/da/d1c/d1d/d40/d58 0 2024-08-01T06:56:12.799 INFO:tasks.workunit.client.0.smithi016.stdout:6/216: write d1/d8/f11 [8729783,84213] 0 2024-08-01T06:56:12.803 INFO:tasks.workunit.client.0.smithi016.stdout:7/208: rename d7/db/d17/d4e/f54 to d7/db/d1a/da/f59 0 2024-08-01T06:56:12.805 INFO:tasks.workunit.client.0.smithi016.stdout:2/168: symlink d0/d8/d22/l35 0 2024-08-01T06:56:12.807 INFO:tasks.workunit.client.0.smithi016.stdout:6/217: dwrite d1/d41/f3e [0,4194304] 0 2024-08-01T06:56:12.807 INFO:tasks.workunit.client.0.smithi016.stdout:2/169: write d0/d16/f2d [579897,8816] 0 2024-08-01T06:56:12.811 INFO:tasks.workunit.client.0.smithi016.stdout:7/209: unlink d7/db/d1a/da/d1c/d1d/d40/f4c 0 2024-08-01T06:56:12.813 INFO:tasks.workunit.client.0.smithi016.stdout:7/210: dread - d7/db/d1a/d39/f41 zero size 2024-08-01T06:56:12.814 INFO:tasks.workunit.client.0.smithi016.stdout:8/176: truncate d5/d8/d1a/d24/f19 1452129 0 2024-08-01T06:56:12.815 INFO:tasks.workunit.client.0.smithi016.stdout:2/170: dwrite d0/f3 [4194304,4194304] 0 2024-08-01T06:56:12.816 INFO:tasks.workunit.client.0.smithi016.stdout:8/177: truncate d5/f11 4377270 0 2024-08-01T06:56:12.817 INFO:tasks.workunit.client.0.smithi016.stdout:6/218: rename d1/d9/f21 to d1/d41/f52 0 2024-08-01T06:56:12.822 INFO:tasks.workunit.client.0.smithi016.stdout:7/211: rmdir d7/db/d1a/da/d1e 39 2024-08-01T06:56:12.828 INFO:tasks.workunit.client.0.smithi016.stdout:8/178: rename d5/dc/cf to d5/d8/d1a/d24/c3f 0 2024-08-01T06:56:12.834 INFO:tasks.workunit.client.0.smithi016.stdout:2/171: fdatasync d0/fb 0 2024-08-01T06:56:12.837 INFO:tasks.workunit.client.0.smithi016.stdout:7/212: dwrite d7/db/d1a/da/d1e/d26/f49 [4194304,4194304] 0 2024-08-01T06:56:12.849 INFO:tasks.workunit.client.0.smithi016.stdout:7/213: mknod d7/db/d1a/da/d1c/d1d/c5a 0 2024-08-01T06:56:12.850 INFO:tasks.workunit.client.0.smithi016.stdout:7/214: stat d7/db/d1a/da/d1e/f1f 0 2024-08-01T06:56:12.854 INFO:tasks.workunit.client.0.smithi016.stdout:6/219: getdents d1/d8/d1b/d22/d2d 0 2024-08-01T06:56:12.856 INFO:tasks.workunit.client.0.smithi016.stdout:8/179: rename d5/d1c/l20 to d5/d8/d1a/l40 0 2024-08-01T06:56:12.858 INFO:tasks.workunit.client.0.smithi016.stdout:6/220: mknod d1/d8/d1b/d22/d2d/c53 0 2024-08-01T06:56:12.862 INFO:tasks.workunit.client.0.smithi016.stdout:6/221: symlink d1/d8/d1b/l54 0 2024-08-01T06:56:12.864 INFO:tasks.workunit.client.0.smithi016.stdout:7/215: creat d7/f5b x:0 0 0 2024-08-01T06:56:12.865 INFO:tasks.workunit.client.0.smithi016.stdout:2/172: truncate d0/d16/f1f 3944448 0 2024-08-01T06:56:12.865 INFO:tasks.workunit.client.0.smithi016.stdout:2/173: fsync d0/d19/f2c 0 2024-08-01T06:56:12.868 INFO:tasks.workunit.client.0.smithi016.stdout:7/216: mknod d7/db/d1a/da/d1e/c5c 0 2024-08-01T06:56:12.874 INFO:tasks.workunit.client.0.smithi016.stdout:2/174: mknod d0/d16/d20/d2e/c36 0 2024-08-01T06:56:12.877 INFO:tasks.workunit.client.0.smithi016.stdout:2/175: dread d0/d19/f2c [0,4194304] 0 2024-08-01T06:56:12.881 INFO:tasks.workunit.client.0.smithi016.stdout:2/176: symlink d0/d8/d1b/l37 0 2024-08-01T06:56:12.881 INFO:tasks.workunit.client.0.smithi016.stdout:6/222: write d1/d8/d1b/f25 [4110703,32513] 0 2024-08-01T06:56:12.883 INFO:tasks.workunit.client.0.smithi016.stdout:7/217: link d7/db/d1a/da/d1e/l31 d7/db/d1a/da/d1c/d1d/d40/d58/l5d 0 2024-08-01T06:56:12.886 INFO:tasks.workunit.client.0.smithi016.stdout:2/177: dread d0/d8/d1b/f1c [0,4194304] 0 2024-08-01T06:56:12.887 INFO:tasks.workunit.client.0.smithi016.stdout:6/223: creat d1/d8/d1b/d22/d36/f55 x:0 0 0 2024-08-01T06:56:12.888 INFO:tasks.workunit.client.0.smithi016.stdout:7/218: mkdir d7/db/d1a/da/d1c/d1d/d5e 0 2024-08-01T06:56:12.889 INFO:tasks.workunit.client.0.smithi016.stdout:7/219: read - d7/db/d1a/da/d1e/d26/d2a/f4b zero size 2024-08-01T06:56:12.890 INFO:tasks.workunit.client.0.smithi016.stdout:7/220: chown d7/f3d 3033 1 2024-08-01T06:56:12.891 INFO:tasks.workunit.client.0.smithi016.stdout:7/221: dread - d7/db/d1a/da/d1e/d26/f46 zero size 2024-08-01T06:56:12.892 INFO:tasks.workunit.client.0.smithi016.stdout:6/224: unlink d1/d9/fb 0 2024-08-01T06:56:12.897 INFO:tasks.workunit.client.0.smithi016.stdout:6/225: mknod d1/d9/c56 0 2024-08-01T06:56:12.899 INFO:tasks.workunit.client.0.smithi016.stdout:2/178: rmdir d0/d8/d1b 39 2024-08-01T06:56:12.900 INFO:tasks.workunit.client.0.smithi016.stdout:2/179: write d0/d19/f2c [1527291,122864] 0 2024-08-01T06:56:12.901 INFO:tasks.workunit.client.0.smithi016.stdout:2/180: write d0/f3 [8306468,21319] 0 2024-08-01T06:56:12.905 INFO:tasks.workunit.client.0.smithi016.stdout:2/181: mknod d0/d19/c38 0 2024-08-01T06:56:12.909 INFO:tasks.workunit.client.0.smithi016.stdout:2/182: symlink d0/d16/d20/d2e/l39 0 2024-08-01T06:56:12.910 INFO:tasks.workunit.client.0.smithi016.stdout:6/226: link d1/d8/d1b/d22/d2d/c31 d1/d9/c57 0 2024-08-01T06:56:12.910 INFO:tasks.workunit.client.0.smithi016.stdout:6/227: fsync d1/d43/f4a 0 2024-08-01T06:56:12.913 INFO:tasks.workunit.client.0.smithi016.stdout:2/183: symlink d0/l3a 0 2024-08-01T06:56:12.915 INFO:tasks.workunit.client.0.smithi016.stdout:6/228: mknod d1/d8/d1b/d22/c58 0 2024-08-01T06:56:12.916 INFO:tasks.workunit.client.0.smithi016.stdout:7/222: dwrite d7/db/d1a/da/d1e/f51 [4194304,4194304] 0 2024-08-01T06:56:12.919 INFO:tasks.workunit.client.0.smithi016.stdout:2/184: truncate d0/f17 3778079 0 2024-08-01T06:56:12.969 INFO:tasks.workunit.client.0.smithi016.stdout:7/223: rmdir d7/db/d1a/da/d1e 39 2024-08-01T06:56:12.970 INFO:tasks.workunit.client.0.smithi016.stdout:2/185: dread d0/d19/f2c [0,4194304] 0 2024-08-01T06:56:12.970 INFO:tasks.workunit.client.0.smithi016.stdout:6/229: symlink d1/d8/l59 0 2024-08-01T06:56:12.971 INFO:tasks.workunit.client.0.smithi016.stdout:6/230: fsync d1/d9/f2e 0 2024-08-01T06:56:12.973 INFO:tasks.workunit.client.0.smithi016.stdout:7/224: mknod d7/db/d17/c5f 0 2024-08-01T06:56:12.973 INFO:tasks.workunit.client.0.smithi016.stdout:2/186: rmdir d0 39 2024-08-01T06:56:12.975 INFO:tasks.workunit.client.0.smithi016.stdout:6/231: mknod d1/d8/d1b/d22/d36/c5a 0 2024-08-01T06:56:12.977 INFO:tasks.workunit.client.0.smithi016.stdout:7/225: creat d7/db/d1a/da/d1c/d1d/f60 x:0 0 0 2024-08-01T06:56:13.058 INFO:tasks.workunit.client.0.smithi016.stdout:6/232: rename d1/d8/d1b/c20 to d1/d41/c5b 0 2024-08-01T06:56:13.059 INFO:tasks.workunit.client.0.smithi016.stdout:0/170: sync 2024-08-01T06:56:13.060 INFO:tasks.workunit.client.0.smithi016.stdout:0/171: readlink d10/d1c/l22 0 2024-08-01T06:56:13.062 INFO:tasks.workunit.client.0.smithi016.stdout:2/187: fdatasync d0/d8/d1b/f1c 0 2024-08-01T06:56:13.063 INFO:tasks.workunit.client.0.smithi016.stdout:2/188: readlink d0/d8/le 0 2024-08-01T06:56:13.065 INFO:tasks.workunit.client.0.smithi016.stdout:2/189: write d0/d8/d1b/f29 [95893,101810] 0 2024-08-01T06:56:13.067 INFO:tasks.workunit.client.0.smithi016.stdout:0/172: dwrite fd [0,4194304] 0 2024-08-01T06:56:13.068 INFO:tasks.workunit.client.0.smithi016.stdout:2/190: mkdir d0/d16/d20/d2e/d3b 0 2024-08-01T06:56:13.068 INFO:tasks.workunit.client.0.smithi016.stdout:6/233: getdents d1/d8/d1b/d48 0 2024-08-01T06:56:13.075 INFO:tasks.workunit.client.0.smithi016.stdout:6/234: creat d1/d9/f5c x:0 0 0 2024-08-01T06:56:13.076 INFO:tasks.workunit.client.0.smithi016.stdout:7/226: dwrite d7/db/d1a/da/d1c/f3f [0,4194304] 0 2024-08-01T06:56:13.077 INFO:tasks.workunit.client.0.smithi016.stdout:2/191: dread d0/d8/f26 [0,4194304] 0 2024-08-01T06:56:13.084 INFO:tasks.workunit.client.0.smithi016.stdout:6/235: symlink d1/d8/d1b/d22/l5d 0 2024-08-01T06:56:13.087 INFO:tasks.workunit.client.0.smithi016.stdout:0/173: getdents d10/d11/d18 0 2024-08-01T06:56:13.089 INFO:tasks.workunit.client.0.smithi016.stdout:0/174: readlink d10/d11/d18/l32 0 2024-08-01T06:56:13.089 INFO:tasks.workunit.client.0.smithi016.stdout:7/227: dwrite d7/db/d1a/da/d1e/f1f [0,4194304] 0 2024-08-01T06:56:13.090 INFO:tasks.workunit.client.0.smithi016.stdout:7/228: stat d7/db/d1a/da/d1c/d1d 0 2024-08-01T06:56:13.091 INFO:tasks.workunit.client.0.smithi016.stdout:6/236: creat d1/d8/d1b/d22/d3b/f5e x:0 0 0 2024-08-01T06:56:13.092 INFO:tasks.workunit.client.0.smithi016.stdout:0/175: write d10/d11/d18/f2f [126768,7105] 0 2024-08-01T06:56:13.092 INFO:tasks.workunit.client.0.smithi016.stdout:2/192: link d0/d8/f33 d0/d8/f3c 0 2024-08-01T06:56:13.093 INFO:tasks.workunit.client.0.smithi016.stdout:0/176: dread - d10/f2e zero size 2024-08-01T06:56:13.096 INFO:tasks.workunit.client.0.smithi016.stdout:6/237: link d1/d9/f2e d1/d8/d34/f5f 0 2024-08-01T06:56:13.097 INFO:tasks.workunit.client.0.smithi016.stdout:6/238: stat d1/d9/c56 0 2024-08-01T06:56:13.098 INFO:tasks.workunit.client.0.smithi016.stdout:2/193: symlink d0/l3d 0 2024-08-01T06:56:13.099 INFO:tasks.workunit.client.0.smithi016.stdout:7/229: dwrite d7/db/d1a/da/d1c/d1d/f60 [0,4194304] 0 2024-08-01T06:56:13.099 INFO:tasks.workunit.client.0.smithi016.stdout:0/177: symlink d10/d11/l38 0 2024-08-01T06:56:13.103 INFO:tasks.workunit.client.0.smithi016.stdout:2/194: write d0/d8/f26 [111417,68586] 0 2024-08-01T06:56:13.103 INFO:tasks.workunit.client.0.smithi016.stdout:7/230: dread - d7/db/d1a/d39/f41 zero size 2024-08-01T06:56:13.104 INFO:tasks.workunit.client.0.smithi016.stdout:0/178: symlink d10/l39 0 2024-08-01T06:56:13.106 INFO:tasks.workunit.client.0.smithi016.stdout:0/179: rmdir d10/d11 39 2024-08-01T06:56:13.108 INFO:tasks.workunit.client.0.smithi016.stdout:6/239: dwrite d1/d43/f4a [0,4194304] 0 2024-08-01T06:56:13.108 INFO:tasks.workunit.client.0.smithi016.stdout:2/195: dread d0/d19/f2c [0,4194304] 0 2024-08-01T06:56:13.109 INFO:tasks.workunit.client.0.smithi016.stdout:6/240: dread - d1/d8/f2a zero size 2024-08-01T06:56:13.110 INFO:tasks.workunit.client.0.smithi016.stdout:7/231: symlink d7/db/d1a/da/d1e/l61 0 2024-08-01T06:56:13.117 INFO:tasks.workunit.client.0.smithi016.stdout:2/196: creat d0/f3e x:0 0 0 2024-08-01T06:56:13.122 INFO:tasks.workunit.client.0.smithi016.stdout:2/197: symlink d0/d8/d1b/l3f 0 2024-08-01T06:56:13.124 INFO:tasks.workunit.client.0.smithi016.stdout:7/232: getdents d7/db/d1a/da/d1c/d1d/d40/d58 0 2024-08-01T06:56:13.128 INFO:tasks.workunit.client.0.smithi016.stdout:2/198: link d0/d19/f2c d0/f40 0 2024-08-01T06:56:13.129 INFO:tasks.workunit.client.0.smithi016.stdout:6/241: write d1/f4 [3861376,105476] 0 2024-08-01T06:56:13.130 INFO:tasks.workunit.client.0.smithi016.stdout:6/242: dread - d1/d9/f2e zero size 2024-08-01T06:56:13.131 INFO:tasks.workunit.client.0.smithi016.stdout:6/243: truncate d1/d8/d34/f3c 883863 0 2024-08-01T06:56:13.132 INFO:tasks.workunit.client.0.smithi016.stdout:6/244: readlink d1/d8/d1b/d48/l4b 0 2024-08-01T06:56:13.132 INFO:tasks.workunit.client.0.smithi016.stdout:6/245: chown d1/d8/d1b 0 1 2024-08-01T06:56:13.133 INFO:tasks.workunit.client.0.smithi016.stdout:6/246: dread - d1/d8/f2a zero size 2024-08-01T06:56:13.136 INFO:tasks.workunit.client.0.smithi016.stdout:6/247: mkdir d1/d9/d60 0 2024-08-01T06:56:13.136 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:12 smithi089 ceph-mon[36617]: Reconfiguring prometheus.smithi016 (dependencies changed)... 2024-08-01T06:56:13.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:12 smithi089 ceph-mon[36617]: Reconfiguring daemon prometheus.smithi016 on smithi016 2024-08-01T06:56:13.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:12 smithi089 ceph-mon[36617]: pgmap v20: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 77 MiB/s rd, 205 MiB/s wr, 396 op/s 2024-08-01T06:56:13.138 INFO:tasks.workunit.client.0.smithi016.stdout:6/248: creat d1/d41/f61 x:0 0 0 2024-08-01T06:56:13.139 INFO:tasks.workunit.client.0.smithi016.stdout:2/199: rmdir d0/d19 39 2024-08-01T06:56:13.139 INFO:tasks.workunit.client.0.smithi016.stdout:6/249: dread - d1/d9/f2e zero size 2024-08-01T06:56:13.141 INFO:tasks.workunit.client.0.smithi016.stdout:7/233: truncate d7/db/d1a/da/d22/f27 571379 0 2024-08-01T06:56:13.142 INFO:tasks.workunit.client.0.smithi016.stdout:2/200: creat d0/d16/f41 x:0 0 0 2024-08-01T06:56:13.143 INFO:tasks.workunit.client.0.smithi016.stdout:2/201: write d0/d8/d1b/f1c [2793007,63052] 0 2024-08-01T06:56:13.143 INFO:tasks.workunit.client.0.smithi016.stdout:6/250: creat d1/d8/d34/f62 x:0 0 0 2024-08-01T06:56:13.144 INFO:tasks.workunit.client.0.smithi016.stdout:6/251: chown d1/d43 47402 1 2024-08-01T06:56:13.146 INFO:tasks.workunit.client.0.smithi016.stdout:6/252: truncate d1/d8/f11 9689762 0 2024-08-01T06:56:13.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:12 smithi016 ceph-mon[29266]: Reconfiguring prometheus.smithi016 (dependencies changed)... 2024-08-01T06:56:13.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:12 smithi016 ceph-mon[29266]: Reconfiguring daemon prometheus.smithi016 on smithi016 2024-08-01T06:56:13.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:12 smithi016 ceph-mon[29266]: pgmap v20: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 77 MiB/s rd, 205 MiB/s wr, 396 op/s 2024-08-01T06:56:13.149 INFO:tasks.workunit.client.0.smithi016.stdout:2/202: creat d0/d8/d1b/f42 x:0 0 0 2024-08-01T06:56:13.154 INFO:tasks.workunit.client.0.smithi016.stdout:7/234: rmdir d7 39 2024-08-01T06:56:13.157 INFO:tasks.workunit.client.0.smithi016.stdout:6/253: dread d1/d8/d1b/d22/f29 [0,4194304] 0 2024-08-01T06:56:13.160 INFO:tasks.workunit.client.0.smithi016.stdout:7/235: mknod d7/db/d1a/d39/d43/c62 0 2024-08-01T06:56:13.160 INFO:tasks.workunit.client.0.smithi016.stdout:6/254: creat d1/d9/d3f/f63 x:0 0 0 2024-08-01T06:56:13.161 INFO:tasks.workunit.client.0.smithi016.stdout:2/203: write d0/f40 [696039,81022] 0 2024-08-01T06:56:13.162 INFO:tasks.workunit.client.0.smithi016.stdout:7/236: mkdir d7/db/d1a/da/d1e/d26/d63 0 2024-08-01T06:56:13.164 INFO:tasks.workunit.client.0.smithi016.stdout:2/204: creat d0/d16/d20/f43 x:0 0 0 2024-08-01T06:56:13.165 INFO:tasks.workunit.client.0.smithi016.stdout:6/255: mkdir d1/d64 0 2024-08-01T06:56:13.170 INFO:tasks.workunit.client.0.smithi016.stdout:6/256: write d1/d9/f4c [805068,116329] 0 2024-08-01T06:56:13.170 INFO:tasks.workunit.client.0.smithi016.stdout:7/237: creat d7/db/d1a/d39/d43/f64 x:0 0 0 2024-08-01T06:56:13.171 INFO:tasks.workunit.client.0.smithi016.stdout:6/257: mknod d1/d41/c65 0 2024-08-01T06:56:13.172 INFO:tasks.workunit.client.0.smithi016.stdout:2/205: dwrite d0/f3e [0,4194304] 0 2024-08-01T06:56:13.176 INFO:tasks.workunit.client.0.smithi016.stdout:7/238: rename d7/db/d1a/da/f38 to d7/db/d1a/da/d1c/d1d/f65 0 2024-08-01T06:56:13.178 INFO:tasks.workunit.client.0.smithi016.stdout:2/206: creat d0/d16/f44 x:0 0 0 2024-08-01T06:56:13.183 INFO:tasks.workunit.client.0.smithi016.stdout:7/239: dwrite d7/db/d1a/d39/f29 [0,4194304] 0 2024-08-01T06:56:13.189 INFO:tasks.workunit.client.0.smithi016.stdout:7/240: mknod d7/db/d17/d4e/c66 0 2024-08-01T06:56:13.189 INFO:tasks.workunit.client.0.smithi016.stdout:2/207: dwrite d0/d8/d1b/f1c [0,4194304] 0 2024-08-01T06:56:13.195 INFO:tasks.workunit.client.0.smithi016.stdout:6/258: dwrite d1/d41/f52 [0,4194304] 0 2024-08-01T06:56:13.195 INFO:tasks.workunit.client.0.smithi016.stdout:2/208: truncate d0/f17 1221054 0 2024-08-01T06:56:13.198 INFO:tasks.workunit.client.0.smithi016.stdout:7/241: dread d7/db/d1a/da/f1b [0,4194304] 0 2024-08-01T06:56:13.199 INFO:tasks.workunit.client.0.smithi016.stdout:7/242: chown d7/db/d1a/da/d1c 1488838380 1 2024-08-01T06:56:13.201 INFO:tasks.workunit.client.0.smithi016.stdout:2/209: mkdir d0/d16/d20/d2e/d3b/d45 0 2024-08-01T06:56:13.205 INFO:tasks.workunit.client.0.smithi016.stdout:6/259: link d1/l23 d1/d8/l66 0 2024-08-01T06:56:13.205 INFO:tasks.workunit.client.0.smithi016.stdout:6/260: fsync d1/d8/f2c 0 2024-08-01T06:56:13.208 INFO:tasks.workunit.client.0.smithi016.stdout:2/210: fdatasync d0/f17 0 2024-08-01T06:56:13.210 INFO:tasks.workunit.client.0.smithi016.stdout:2/211: chown d0/d8/d22/l2a 4 1 2024-08-01T06:56:13.211 INFO:tasks.workunit.client.0.smithi016.stdout:2/212: write d0/d8/d1b/f42 [744487,10500] 0 2024-08-01T06:56:13.213 INFO:tasks.workunit.client.0.smithi016.stdout:6/261: dwrite d1/d8/d1b/d22/d3b/f5e [0,4194304] 0 2024-08-01T06:56:13.217 INFO:tasks.workunit.client.0.smithi016.stdout:6/262: mkdir d1/d8/d1b/d22/d3b/d67 0 2024-08-01T06:56:13.221 INFO:tasks.workunit.client.0.smithi016.stdout:2/213: dwrite d0/d8/d1b/f29 [0,4194304] 0 2024-08-01T06:56:13.222 INFO:tasks.workunit.client.0.smithi016.stdout:7/243: truncate d7/db/d1a/da/f10 1870998 0 2024-08-01T06:56:13.223 INFO:tasks.workunit.client.0.smithi016.stdout:6/263: mkdir d1/d9/d60/d68 0 2024-08-01T06:56:13.224 INFO:tasks.workunit.client.0.smithi016.stdout:6/264: write d1/d8/f2c [274123,22783] 0 2024-08-01T06:56:13.226 INFO:tasks.workunit.client.0.smithi016.stdout:2/214: creat d0/d16/d20/d2e/f46 x:0 0 0 2024-08-01T06:56:13.228 INFO:tasks.workunit.client.0.smithi016.stdout:6/265: mknod d1/d41/c69 0 2024-08-01T06:56:13.229 INFO:tasks.workunit.client.0.smithi016.stdout:2/215: read d0/f17 [611895,73167] 0 2024-08-01T06:56:13.231 INFO:tasks.workunit.client.0.smithi016.stdout:7/244: dwrite d7/db/d1a/d39/f29 [4194304,4194304] 0 2024-08-01T06:56:13.235 INFO:tasks.workunit.client.0.smithi016.stdout:2/216: symlink d0/l47 0 2024-08-01T06:56:13.240 INFO:tasks.workunit.client.0.smithi016.stdout:2/217: symlink d0/d16/d20/d2e/d3b/d45/l48 0 2024-08-01T06:56:13.241 INFO:tasks.workunit.client.0.smithi016.stdout:2/218: dread - d0/d16/f44 zero size 2024-08-01T06:56:13.241 INFO:tasks.workunit.client.0.smithi016.stdout:7/245: unlink l1 0 2024-08-01T06:56:13.241 INFO:tasks.workunit.client.0.smithi016.stdout:2/219: readlink d0/l3d 0 2024-08-01T06:56:13.242 INFO:tasks.workunit.client.0.smithi016.stdout:7/246: chown d7/ff 58932442 1 2024-08-01T06:56:13.243 INFO:tasks.workunit.client.0.smithi016.stdout:2/220: mknod d0/d8/c49 0 2024-08-01T06:56:13.244 INFO:tasks.workunit.client.0.smithi016.stdout:7/247: read d7/db/f13 [3742421,77251] 0 2024-08-01T06:56:13.244 INFO:tasks.workunit.client.0.smithi016.stdout:2/221: write d0/f3 [8329381,124235] 0 2024-08-01T06:56:13.245 INFO:tasks.workunit.client.0.smithi016.stdout:7/248: stat d7/db/d17/d4e 0 2024-08-01T06:56:13.246 INFO:tasks.workunit.client.0.smithi016.stdout:2/222: dread - d0/d16/f41 zero size 2024-08-01T06:56:13.249 INFO:tasks.workunit.client.0.smithi016.stdout:2/223: stat d0/d19/f2c 0 2024-08-01T06:56:13.249 INFO:tasks.workunit.client.0.smithi016.stdout:6/266: truncate d1/f4 2354539 0 2024-08-01T06:56:13.250 INFO:tasks.workunit.client.0.smithi016.stdout:7/249: dread d7/db/d1a/da/d1e/d26/f46 [0,4194304] 0 2024-08-01T06:56:13.255 INFO:tasks.workunit.client.0.smithi016.stdout:6/267: rename d1/d8/d34/f5f to d1/d8/d1b/d22/f6a 0 2024-08-01T06:56:13.261 INFO:tasks.workunit.client.0.smithi016.stdout:6/268: symlink d1/d8/l6b 0 2024-08-01T06:56:13.262 INFO:tasks.workunit.client.0.smithi016.stdout:6/269: write d1/f2 [5180228,72801] 0 2024-08-01T06:56:13.267 INFO:tasks.workunit.client.0.smithi016.stdout:2/224: write d0/d16/f1f [4882890,116932] 0 2024-08-01T06:56:13.268 INFO:tasks.workunit.client.0.smithi016.stdout:2/225: readlink d0/l3d 0 2024-08-01T06:56:13.269 INFO:tasks.workunit.client.0.smithi016.stdout:7/250: truncate d7/db/d1a/da/d1e/f51 6524138 0 2024-08-01T06:56:13.273 INFO:tasks.workunit.client.0.smithi016.stdout:2/226: dread d0/d8/f26 [0,4194304] 0 2024-08-01T06:56:13.275 INFO:tasks.workunit.client.0.smithi016.stdout:7/251: mkdir d7/db/d1a/da/d1c/d1d/d40/d67 0 2024-08-01T06:56:13.279 INFO:tasks.workunit.client.0.smithi016.stdout:6/270: getdents d1 0 2024-08-01T06:56:13.281 INFO:tasks.workunit.client.0.smithi016.stdout:2/227: symlink d0/d19/l4a 0 2024-08-01T06:56:13.281 INFO:tasks.workunit.client.0.smithi016.stdout:7/252: fsync d7/db/d1a/da/d1c/f3f 0 2024-08-01T06:56:13.282 INFO:tasks.workunit.client.0.smithi016.stdout:2/228: chown d0/fd 3549957 1 2024-08-01T06:56:13.288 INFO:tasks.workunit.client.0.smithi016.stdout:6/271: dwrite d1/d8/d1b/d22/f29 [0,4194304] 0 2024-08-01T06:56:13.288 INFO:tasks.workunit.client.0.smithi016.stdout:2/229: link d0/d8/d22/l27 d0/d8/d31/l4b 0 2024-08-01T06:56:13.291 INFO:tasks.workunit.client.0.smithi016.stdout:6/272: creat d1/d41/f6c x:0 0 0 2024-08-01T06:56:13.293 INFO:tasks.workunit.client.0.smithi016.stdout:2/230: creat d0/d19/f4c x:0 0 0 2024-08-01T06:56:13.295 INFO:tasks.workunit.client.0.smithi016.stdout:6/273: creat d1/d43/f6d x:0 0 0 2024-08-01T06:56:13.296 INFO:tasks.workunit.client.0.smithi016.stdout:6/274: readlink d1/d9/d3f/l47 0 2024-08-01T06:56:13.296 INFO:tasks.workunit.client.0.smithi016.stdout:2/231: creat d0/d19/f4d x:0 0 0 2024-08-01T06:56:13.297 INFO:tasks.workunit.client.0.smithi016.stdout:2/232: truncate d0/f3e 4285408 0 2024-08-01T06:56:13.301 INFO:tasks.workunit.client.0.smithi016.stdout:6/275: mknod d1/d8/d1b/d22/d4e/c6e 0 2024-08-01T06:56:13.303 INFO:tasks.workunit.client.0.smithi016.stdout:6/276: chown d1/d43/f6d 60614 1 2024-08-01T06:56:13.305 INFO:tasks.workunit.client.0.smithi016.stdout:7/253: dwrite d7/f11 [0,4194304] 0 2024-08-01T06:56:13.306 INFO:tasks.workunit.client.0.smithi016.stdout:2/233: link d0/d8/le d0/d16/d20/l4e 0 2024-08-01T06:56:13.307 INFO:tasks.workunit.client.0.smithi016.stdout:2/234: dread - d0/d16/d20/f43 zero size 2024-08-01T06:56:13.311 INFO:tasks.workunit.client.0.smithi016.stdout:6/277: dread - d1/d9/f2e zero size 2024-08-01T06:56:13.315 INFO:tasks.workunit.client.0.smithi016.stdout:6/278: creat d1/d8/d1b/d22/d36/f6f x:0 0 0 2024-08-01T06:56:13.315 INFO:tasks.workunit.client.0.smithi016.stdout:2/235: dwrite d0/d16/d20/d2e/f46 [0,4194304] 0 2024-08-01T06:56:13.318 INFO:tasks.workunit.client.0.smithi016.stdout:6/279: mknod d1/d9/d3f/c70 0 2024-08-01T06:56:13.323 INFO:tasks.workunit.client.0.smithi016.stdout:6/280: mkdir d1/d8/d1b/d22/d71 0 2024-08-01T06:56:13.324 INFO:tasks.workunit.client.0.smithi016.stdout:7/254: write d7/f18 [4897355,108226] 0 2024-08-01T06:56:13.325 INFO:tasks.workunit.client.0.smithi016.stdout:2/236: getdents d0/d19 0 2024-08-01T06:56:13.330 INFO:tasks.workunit.client.0.smithi016.stdout:2/237: fdatasync d0/d8/f26 0 2024-08-01T06:56:13.331 INFO:tasks.workunit.client.0.smithi016.stdout:7/255: symlink d7/db/d1a/da/l68 0 2024-08-01T06:56:13.332 INFO:tasks.workunit.client.0.smithi016.stdout:7/256: write d7/db/d1a/f2e [937100,4985] 0 2024-08-01T06:56:13.333 INFO:tasks.workunit.client.0.smithi016.stdout:6/281: write d1/d8/d1b/d22/f6a [292020,119403] 0 2024-08-01T06:56:13.336 INFO:tasks.workunit.client.0.smithi016.stdout:7/257: truncate d7/db/d1a/da/d1c/d1d/d40/f55 758254 0 2024-08-01T06:56:13.336 INFO:tasks.workunit.client.0.smithi016.stdout:2/238: creat d0/d16/d20/d2e/f4f x:0 0 0 2024-08-01T06:56:13.338 INFO:tasks.workunit.client.0.smithi016.stdout:6/282: rmdir d1/d8/d34 39 2024-08-01T06:56:13.338 INFO:tasks.workunit.client.0.smithi016.stdout:7/258: write d7/db/d1a/da/d1c/d1d/f60 [3352938,89001] 0 2024-08-01T06:56:13.341 INFO:tasks.workunit.client.0.smithi016.stdout:2/239: rename d0/fb to d0/d16/f50 0 2024-08-01T06:56:13.341 INFO:tasks.workunit.client.0.smithi016.stdout:2/240: chown d0/d16/d20 34947 1 2024-08-01T06:56:13.342 INFO:tasks.workunit.client.0.smithi016.stdout:7/259: rmdir d7/db 39 2024-08-01T06:56:13.344 INFO:tasks.workunit.client.0.smithi016.stdout:6/283: creat d1/d8/d1b/f72 x:0 0 0 2024-08-01T06:56:13.345 INFO:tasks.workunit.client.0.smithi016.stdout:6/284: write d1/d8/d1b/f72 [881201,69437] 0 2024-08-01T06:56:13.347 INFO:tasks.workunit.client.0.smithi016.stdout:2/241: creat d0/d8/d31/f51 x:0 0 0 2024-08-01T06:56:13.349 INFO:tasks.workunit.client.0.smithi016.stdout:7/260: truncate d7/db/d1a/da/f59 413861 0 2024-08-01T06:56:13.350 INFO:tasks.workunit.client.0.smithi016.stdout:6/285: dread d1/d41/f52 [0,4194304] 0 2024-08-01T06:56:13.351 INFO:tasks.workunit.client.0.smithi016.stdout:6/286: stat d1/d9/d60/d68 0 2024-08-01T06:56:13.355 INFO:tasks.workunit.client.0.smithi016.stdout:7/261: dread - d7/db/d1a/da/d1e/d26/d2a/f30 zero size 2024-08-01T06:56:13.359 INFO:tasks.workunit.client.0.smithi016.stdout:6/287: truncate d1/d8/f1a 32014 0 2024-08-01T06:56:13.359 INFO:tasks.workunit.client.0.smithi016.stdout:7/262: dread d7/db/d1a/da/d22/f27 [0,4194304] 0 2024-08-01T06:56:13.361 INFO:tasks.workunit.client.0.smithi016.stdout:2/242: dwrite d0/d8/f18 [0,4194304] 0 2024-08-01T06:56:13.362 INFO:tasks.workunit.client.0.smithi016.stdout:2/243: chown d0/d16/d20/d2e/f46 4 1 2024-08-01T06:56:13.368 INFO:tasks.workunit.client.0.smithi016.stdout:6/288: rename d1/c32 to d1/d8/c73 0 2024-08-01T06:56:13.369 INFO:tasks.workunit.client.0.smithi016.stdout:7/263: creat d7/db/d1a/da/d1e/f69 x:0 0 0 2024-08-01T06:56:13.370 INFO:tasks.workunit.client.0.smithi016.stdout:7/264: dread - d7/f5b zero size 2024-08-01T06:56:13.373 INFO:tasks.workunit.client.0.smithi016.stdout:2/244: rename d0/fd to d0/d8/f52 0 2024-08-01T06:56:13.384 INFO:tasks.workunit.client.0.smithi016.stdout:6/289: creat d1/d9/f74 x:0 0 0 2024-08-01T06:56:13.386 INFO:tasks.workunit.client.0.smithi016.stdout:2/245: write d0/d16/f50 [77545,101948] 0 2024-08-01T06:56:13.388 INFO:tasks.workunit.client.0.smithi016.stdout:2/246: dread d0/f40 [0,4194304] 0 2024-08-01T06:56:13.428 INFO:tasks.workunit.client.0.smithi016.stdout:6/290: creat d1/d8/d1b/d22/f75 x:0 0 0 2024-08-01T06:56:13.428 INFO:tasks.workunit.client.0.smithi016.stdout:2/247: creat d0/d8/d31/f53 x:0 0 0 2024-08-01T06:56:13.428 INFO:tasks.workunit.client.0.smithi016.stdout:2/248: chown d0/d19/f2c 24849 1 2024-08-01T06:56:13.429 INFO:tasks.workunit.client.0.smithi016.stdout:2/249: chown d0/d8/d22/l2a 430611327 1 2024-08-01T06:56:13.429 INFO:tasks.workunit.client.0.smithi016.stdout:6/291: creat d1/d9/d3f/f76 x:0 0 0 2024-08-01T06:56:13.431 INFO:tasks.workunit.client.0.smithi016.stdout:2/250: symlink d0/d19/l54 0 2024-08-01T06:56:13.434 INFO:tasks.workunit.client.0.smithi016.stdout:6/292: rmdir d1/d8 39 2024-08-01T06:56:13.442 INFO:tasks.workunit.client.0.smithi016.stdout:6/293: creat d1/d8/d1b/d48/f77 x:0 0 0 2024-08-01T06:56:13.442 INFO:tasks.workunit.client.0.smithi016.stdout:2/251: rmdir d0 39 2024-08-01T06:56:13.445 INFO:tasks.workunit.client.0.smithi016.stdout:2/252: symlink d0/d8/d31/l55 0 2024-08-01T06:56:13.446 INFO:tasks.workunit.client.0.smithi016.stdout:6/294: rename d1/d8/d1b/d22/f75 to d1/d8/d1b/d22/d71/f78 0 2024-08-01T06:56:13.448 INFO:tasks.workunit.client.0.smithi016.stdout:2/253: creat d0/d19/f56 x:0 0 0 2024-08-01T06:56:13.449 INFO:tasks.workunit.client.0.smithi016.stdout:2/254: dread - d0/d16/d20/f43 zero size 2024-08-01T06:56:13.450 INFO:tasks.workunit.client.0.smithi016.stdout:6/295: write d1/f5 [4934898,129685] 0 2024-08-01T06:56:13.451 INFO:tasks.workunit.client.0.smithi016.stdout:2/255: write d0/d8/f11 [4952836,3046] 0 2024-08-01T06:56:13.454 INFO:tasks.workunit.client.0.smithi016.stdout:6/296: chown d1/d9/d3f/c70 1579 1 2024-08-01T06:56:13.456 INFO:tasks.workunit.client.0.smithi016.stdout:2/256: dread d0/d8/f11 [0,4194304] 0 2024-08-01T06:56:13.461 INFO:tasks.workunit.client.0.smithi016.stdout:2/257: rename d0/d8/d1b/f42 to d0/d16/d20/f57 0 2024-08-01T06:56:13.463 INFO:tasks.workunit.client.0.smithi016.stdout:6/297: dwrite d1/d41/f52 [0,4194304] 0 2024-08-01T06:56:13.464 INFO:tasks.workunit.client.0.smithi016.stdout:6/298: fdatasync d1/d8/d1b/d22/d36/f44 0 2024-08-01T06:56:13.465 INFO:tasks.workunit.client.0.smithi016.stdout:2/258: creat d0/d19/f58 x:0 0 0 2024-08-01T06:56:13.465 INFO:tasks.workunit.client.0.smithi016.stdout:6/299: dread - d1/d8/f51 zero size 2024-08-01T06:56:13.466 INFO:tasks.workunit.client.0.smithi016.stdout:6/300: fdatasync d1/d9/f74 0 2024-08-01T06:56:13.470 INFO:tasks.workunit.client.0.smithi016.stdout:2/259: dread d0/d8/d1b/f29 [0,4194304] 0 2024-08-01T06:56:13.471 INFO:tasks.workunit.client.0.smithi016.stdout:2/260: stat d0/d8/f18 0 2024-08-01T06:56:13.474 INFO:tasks.workunit.client.0.smithi016.stdout:6/301: dwrite d1/d8/d1b/d22/d36/f55 [0,4194304] 0 2024-08-01T06:56:13.489 INFO:tasks.workunit.client.0.smithi016.stdout:6/302: mkdir d1/d9/d60/d68/d79 0 2024-08-01T06:56:13.494 INFO:tasks.workunit.client.0.smithi016.stdout:2/261: write d0/d8/d1b/f29 [4974972,108524] 0 2024-08-01T06:56:13.497 INFO:tasks.workunit.client.0.smithi016.stdout:2/262: read - d0/d16/d20/d2e/f4f zero size 2024-08-01T06:56:13.498 INFO:tasks.workunit.client.0.smithi016.stdout:2/263: chown d0/c1a 1496363 1 2024-08-01T06:56:13.499 INFO:tasks.workunit.client.0.smithi016.stdout:6/303: dwrite d1/d43/f6d [0,4194304] 0 2024-08-01T06:56:13.508 INFO:tasks.workunit.client.0.smithi016.stdout:6/304: dwrite d1/d9/f74 [0,4194304] 0 2024-08-01T06:56:13.508 INFO:tasks.workunit.client.0.smithi016.stdout:2/264: unlink d0/d8/d31/l4b 0 2024-08-01T06:56:13.509 INFO:tasks.workunit.client.0.smithi016.stdout:6/305: fdatasync d1/d8/d1b/d22/f6a 0 2024-08-01T06:56:13.513 INFO:tasks.workunit.client.0.smithi016.stdout:2/265: symlink d0/d8/d31/l59 0 2024-08-01T06:56:13.515 INFO:tasks.workunit.client.0.smithi016.stdout:6/306: mkdir d1/d8/d1b/d22/d36/d7a 0 2024-08-01T06:56:13.516 INFO:tasks.workunit.client.0.smithi016.stdout:6/307: write d1/d8/d1b/f50 [1163090,111287] 0 2024-08-01T06:56:13.519 INFO:tasks.workunit.client.0.smithi016.stdout:2/266: unlink d0/d8/c49 0 2024-08-01T06:56:13.519 INFO:tasks.workunit.client.0.smithi016.stdout:2/267: readlink d0/l1 0 2024-08-01T06:56:13.533 INFO:tasks.workunit.client.0.smithi016.stdout:6/308: rmdir d1/d64 0 2024-08-01T06:56:13.534 INFO:tasks.workunit.client.0.smithi016.stdout:6/309: write d1/d9/f2e [689604,2544] 0 2024-08-01T06:56:13.537 INFO:tasks.workunit.client.0.smithi016.stdout:2/268: dwrite d0/d8/f3c [0,4194304] 0 2024-08-01T06:56:13.541 INFO:tasks.workunit.client.0.smithi016.stdout:6/310: truncate d1/d8/d34/f62 866492 0 2024-08-01T06:56:13.542 INFO:tasks.workunit.client.0.smithi016.stdout:6/311: fsync d1/d8/d1b/d22/d3b/f5e 0 2024-08-01T06:56:13.544 INFO:tasks.workunit.client.0.smithi016.stdout:2/269: write d0/d8/f11 [1826655,75599] 0 2024-08-01T06:56:13.547 INFO:tasks.workunit.client.0.smithi016.stdout:6/312: rename d1/d9/f4c to d1/d9/d60/d68/f7b 0 2024-08-01T06:56:13.550 INFO:tasks.workunit.client.0.smithi016.stdout:2/270: symlink d0/d16/d20/d2e/d3b/l5a 0 2024-08-01T06:56:13.551 INFO:tasks.workunit.client.0.smithi016.stdout:2/271: write d0/d19/f4c [122423,54512] 0 2024-08-01T06:56:13.552 INFO:tasks.workunit.client.0.smithi016.stdout:6/313: creat d1/d9/d60/d68/f7c x:0 0 0 2024-08-01T06:56:13.554 INFO:tasks.workunit.client.0.smithi016.stdout:2/272: rename d0/f3 to d0/d8/d1b/f5b 0 2024-08-01T06:56:13.555 INFO:tasks.workunit.client.0.smithi016.stdout:6/314: mkdir d1/d9/d3f/d7d 0 2024-08-01T06:56:13.563 INFO:tasks.workunit.client.0.smithi016.stdout:6/315: dwrite d1/d8/f51 [0,4194304] 0 2024-08-01T06:56:13.566 INFO:tasks.workunit.client.0.smithi016.stdout:2/273: dwrite d0/f40 [0,4194304] 0 2024-08-01T06:56:13.568 INFO:tasks.workunit.client.0.smithi016.stdout:2/274: readlink d0/d8/d22/l28 0 2024-08-01T06:56:13.568 INFO:tasks.workunit.client.0.smithi016.stdout:2/275: dread - d0/d16/f41 zero size 2024-08-01T06:56:13.568 INFO:tasks.workunit.client.0.smithi016.stdout:6/316: symlink d1/d8/d1b/l7e 0 2024-08-01T06:56:13.569 INFO:tasks.workunit.client.0.smithi016.stdout:2/276: dread - d0/d19/f4d zero size 2024-08-01T06:56:13.570 INFO:tasks.workunit.client.0.smithi016.stdout:6/317: write d1/d43/f4a [4947820,37108] 0 2024-08-01T06:56:13.572 INFO:tasks.workunit.client.0.smithi016.stdout:6/318: chown d1/d43/f6d 74 1 2024-08-01T06:56:13.573 INFO:tasks.workunit.client.0.smithi016.stdout:6/319: fsync d1/d8/d1b/d48/f77 0 2024-08-01T06:56:13.574 INFO:tasks.workunit.client.0.smithi016.stdout:6/320: readlink d1/d8/d1b/l54 0 2024-08-01T06:56:13.578 INFO:tasks.workunit.client.0.smithi016.stdout:6/321: dread d1/d41/f3e [0,4194304] 0 2024-08-01T06:56:13.579 INFO:tasks.workunit.client.0.smithi016.stdout:6/322: readlink d1/d8/d1b/l7e 0 2024-08-01T06:56:13.586 INFO:tasks.workunit.client.0.smithi016.stdout:6/323: dwrite d1/d8/d1b/d22/d36/f44 [0,4194304] 0 2024-08-01T06:56:13.590 INFO:tasks.workunit.client.0.smithi016.stdout:6/324: creat d1/d8/d1b/d22/d71/f7f x:0 0 0 2024-08-01T06:56:13.590 INFO:tasks.workunit.client.0.smithi016.stdout:6/325: fsync d1/d9/f5c 0 2024-08-01T06:56:13.591 INFO:tasks.workunit.client.0.smithi016.stdout:6/326: fsync d1/d43/f6d 0 2024-08-01T06:56:13.592 INFO:tasks.workunit.client.0.smithi016.stdout:6/327: dread - d1/d9/d3f/f76 zero size 2024-08-01T06:56:13.594 INFO:tasks.workunit.client.0.smithi016.stdout:6/328: mknod d1/d9/c80 0 2024-08-01T06:56:13.595 INFO:tasks.workunit.client.0.smithi016.stdout:6/329: write d1/d9/f2e [663430,114056] 0 2024-08-01T06:56:13.598 INFO:tasks.workunit.client.0.smithi016.stdout:6/330: symlink d1/d9/d60/d68/d79/l81 0 2024-08-01T06:56:13.599 INFO:tasks.workunit.client.0.smithi016.stdout:6/331: stat d1/d8/d1b/d22/d36/d7a 0 2024-08-01T06:56:13.600 INFO:tasks.workunit.client.0.smithi016.stdout:6/332: write d1/d8/f11 [9473729,114552] 0 2024-08-01T06:56:13.603 INFO:tasks.workunit.client.0.smithi016.stdout:6/333: creat d1/d41/f82 x:0 0 0 2024-08-01T06:56:13.609 INFO:tasks.workunit.client.0.smithi016.stdout:6/334: dwrite d1/d8/d1b/d22/d36/f44 [0,4194304] 0 2024-08-01T06:56:13.610 INFO:tasks.workunit.client.0.smithi016.stdout:6/335: write d1/d8/d34/f62 [1489311,122483] 0 2024-08-01T06:56:13.683 INFO:tasks.workunit.client.0.smithi016.stdout:5/311: sync 2024-08-01T06:56:13.685 INFO:tasks.workunit.client.0.smithi016.stdout:5/312: readlink d1/d12/l1a 0 2024-08-01T06:56:13.686 INFO:tasks.workunit.client.0.smithi016.stdout:5/313: write d1/d2/d6/d5a/f5f [553801,125770] 0 2024-08-01T06:56:13.842 INFO:tasks.workunit.client.0.smithi016.stdout:5/314: rename d1/d2/f10 to d1/d2/d6/d9/f6a 0 2024-08-01T06:56:13.845 INFO:tasks.workunit.client.0.smithi016.stdout:5/315: creat d1/d2/d6/f6b x:0 0 0 2024-08-01T06:56:13.849 INFO:tasks.workunit.client.0.smithi016.stdout:5/316: creat d1/d2/d20/f6c x:0 0 0 2024-08-01T06:56:13.854 INFO:tasks.workunit.client.0.smithi016.stdout:5/317: dread d1/f54 [0,4194304] 0 2024-08-01T06:56:13.866 INFO:tasks.workunit.client.0.smithi016.stdout:5/318: dread d1/d12/d52/f69 [0,4194304] 0 2024-08-01T06:56:13.869 INFO:tasks.workunit.client.0.smithi016.stdout:4/209: sync 2024-08-01T06:56:13.870 INFO:tasks.workunit.client.0.smithi016.stdout:4/210: dread - d0/d2/f2a zero size 2024-08-01T06:56:13.871 INFO:tasks.workunit.client.0.smithi016.stdout:4/211: chown d0/d2/dc/d12/f24 10755870 1 2024-08-01T06:56:13.876 INFO:tasks.workunit.client.0.smithi016.stdout:5/319: rename d1/l1d to d1/d2/l6d 0 2024-08-01T06:56:13.882 INFO:tasks.workunit.client.0.smithi016.stdout:5/320: fdatasync d1/d2/d6/d9/f34 0 2024-08-01T06:56:13.890 INFO:tasks.workunit.client.0.smithi016.stdout:5/321: creat d1/d2/f6e x:0 0 0 2024-08-01T06:56:13.893 INFO:tasks.workunit.client.0.smithi016.stdout:5/322: write d1/d2/f48 [2337344,21906] 0 2024-08-01T06:56:13.898 INFO:tasks.workunit.client.0.smithi016.stdout:5/323: dread d1/d2/d23/d3a/f3b [0,4194304] 0 2024-08-01T06:56:13.919 INFO:tasks.workunit.client.0.smithi016.stdout:4/212: truncate d0/d17/f39 681994 0 2024-08-01T06:56:13.927 INFO:tasks.workunit.client.0.smithi016.stdout:5/324: link d1/d2/l6d d1/d12/d52/l6f 0 2024-08-01T06:56:13.933 INFO:tasks.workunit.client.0.smithi016.stdout:5/325: dwrite d1/d2/d23/f33 [0,4194304] 0 2024-08-01T06:56:13.934 INFO:tasks.workunit.client.0.smithi016.stdout:5/326: rename d1/d2 to d1/d2/d6/d9/d19/d70 22 2024-08-01T06:56:13.938 INFO:tasks.workunit.client.0.smithi016.stdout:5/327: creat d1/d2/d6/d9/d1b/f71 x:0 0 0 2024-08-01T06:56:13.942 INFO:tasks.workunit.client.0.smithi016.stdout:5/328: dread d1/f3c [0,4194304] 0 2024-08-01T06:56:13.942 INFO:tasks.workunit.client.0.smithi016.stdout:5/329: chown d1/d2/d20/d38/f4b 16814 1 2024-08-01T06:56:13.944 INFO:tasks.workunit.client.0.smithi016.stdout:5/330: write d1/d2/d6/d9/f34 [1975630,12197] 0 2024-08-01T06:56:13.944 INFO:tasks.workunit.client.0.smithi016.stdout:5/331: write d1/d12/f30 [5001899,69075] 0 2024-08-01T06:56:13.947 INFO:tasks.workunit.client.0.smithi016.stdout:5/332: mkdir d1/d2/d20/d72 0 2024-08-01T06:56:13.950 INFO:tasks.workunit.client.0.smithi016.stdout:5/333: rmdir d1/d2/d20/d38 39 2024-08-01T06:56:13.969 INFO:tasks.workunit.client.0.smithi016.stdout:4/213: write d0/d17/f39 [977334,120756] 0 2024-08-01T06:56:13.972 INFO:tasks.workunit.client.0.smithi016.stdout:4/214: creat d0/d2/dc/d12/d29/d3c/f47 x:0 0 0 2024-08-01T06:56:13.974 INFO:tasks.workunit.client.0.smithi016.stdout:5/334: truncate d1/d2/d23/f33 4929105 0 2024-08-01T06:56:13.976 INFO:tasks.workunit.client.0.smithi016.stdout:4/215: mknod d0/d2/dc/c48 0 2024-08-01T06:56:13.977 INFO:tasks.workunit.client.0.smithi016.stdout:4/216: dread - d0/d2/f37 zero size 2024-08-01T06:56:13.981 INFO:tasks.workunit.client.0.smithi016.stdout:4/217: getdents d0 0 2024-08-01T06:56:13.984 INFO:tasks.workunit.client.0.smithi016.stdout:4/218: creat d0/d17/f49 x:0 0 0 2024-08-01T06:56:13.984 INFO:tasks.workunit.client.0.smithi016.stdout:5/335: truncate d1/f5 1178672 0 2024-08-01T06:56:13.987 INFO:tasks.workunit.client.0.smithi016.stdout:5/336: mknod d1/d2/d6/d9/d19/c73 0 2024-08-01T06:56:13.990 INFO:tasks.workunit.client.0.smithi016.stdout:5/337: chown d1/d2/d6/d9/f34 0 1 2024-08-01T06:56:13.990 INFO:tasks.workunit.client.0.smithi016.stdout:4/219: dwrite d0/fb [4194304,4194304] 0 2024-08-01T06:56:13.991 INFO:tasks.workunit.client.0.smithi016.stdout:5/338: write d1/d2/d6/d9/f13 [310465,47730] 0 2024-08-01T06:56:13.996 INFO:tasks.workunit.client.0.smithi016.stdout:5/339: unlink d1/d2/d20/d38/f4b 0 2024-08-01T06:56:13.998 INFO:tasks.workunit.client.0.smithi016.stdout:4/220: dwrite d0/d2/dc/d12/f24 [0,4194304] 0 2024-08-01T06:56:14.001 INFO:tasks.workunit.client.0.smithi016.stdout:5/340: mknod d1/d2/d23/d3a/c74 0 2024-08-01T06:56:14.002 INFO:tasks.workunit.client.0.smithi016.stdout:4/221: mknod d0/d17/d22/d26/c4a 0 2024-08-01T06:56:14.005 INFO:tasks.workunit.client.0.smithi016.stdout:4/222: creat d0/d17/d38/f4b x:0 0 0 2024-08-01T06:56:14.005 INFO:tasks.workunit.client.0.smithi016.stdout:5/341: dread d1/d12/d3e/f66 [0,4194304] 0 2024-08-01T06:56:14.007 INFO:tasks.workunit.client.0.smithi016.stdout:5/342: dread - d1/d2/f6e zero size 2024-08-01T06:56:14.009 INFO:tasks.workunit.client.0.smithi016.stdout:5/343: fdatasync d1/d2/d6/f6b 0 2024-08-01T06:56:14.011 INFO:tasks.workunit.client.0.smithi016.stdout:5/344: write d1/d12/d3e/f62 [220870,22747] 0 2024-08-01T06:56:14.014 INFO:tasks.workunit.client.0.smithi016.stdout:4/223: dwrite d0/d2/f2a [0,4194304] 0 2024-08-01T06:56:14.017 INFO:tasks.workunit.client.0.smithi016.stdout:5/345: rename d1/d12/f30 to d1/d2/d6/d9/d49/d57/f75 0 2024-08-01T06:56:14.025 INFO:tasks.workunit.client.0.smithi016.stdout:5/346: mknod d1/d12/c76 0 2024-08-01T06:56:14.025 INFO:tasks.workunit.client.0.smithi016.stdout:4/224: getdents d0 0 2024-08-01T06:56:14.025 INFO:tasks.workunit.client.0.smithi016.stdout:4/225: truncate d0/f1 3976843 0 2024-08-01T06:56:14.026 INFO:tasks.workunit.client.0.smithi016.stdout:5/347: fsync d1/f3c 0 2024-08-01T06:56:14.028 INFO:tasks.workunit.client.0.smithi016.stdout:4/226: unlink d0/d17/l2d 0 2024-08-01T06:56:14.028 INFO:tasks.workunit.client.0.smithi016.stdout:5/348: readlink d1/d12/d3e/l4a 0 2024-08-01T06:56:14.033 INFO:tasks.workunit.client.0.smithi016.stdout:5/349: link d1/d2/l47 d1/d2/d6/l77 0 2024-08-01T06:56:14.039 INFO:tasks.workunit.client.0.smithi016.stdout:5/350: link d1/d2/d6/d9/d19/c2e d1/d2/d23/c78 0 2024-08-01T06:56:14.041 INFO:tasks.workunit.client.0.smithi016.stdout:4/227: truncate d0/d2/dc/d12/f24 207522 0 2024-08-01T06:56:14.042 INFO:tasks.workunit.client.0.smithi016.stdout:5/351: symlink d1/d2/d6/d9/d19/l79 0 2024-08-01T06:56:14.042 INFO:tasks.workunit.client.0.smithi016.stdout:5/352: readlink d1/d12/d52/l6f 0 2024-08-01T06:56:14.043 INFO:tasks.workunit.client.0.smithi016.stdout:4/228: fsync d0/d2/dc/f2b 0 2024-08-01T06:56:14.043 INFO:tasks.workunit.client.0.smithi016.stdout:4/229: stat d0/d2/f2a 0 2024-08-01T06:56:14.045 INFO:tasks.workunit.client.0.smithi016.stdout:5/353: mkdir d1/d2/d6/d9/d19/d7a 0 2024-08-01T06:56:14.045 INFO:tasks.workunit.client.0.smithi016.stdout:4/230: mknod d0/d17/d38/c4c 0 2024-08-01T06:56:14.045 INFO:tasks.workunit.client.0.smithi016.stdout:5/354: chown d1/d2/l6d 0 1 2024-08-01T06:56:14.046 INFO:tasks.workunit.client.0.smithi016.stdout:4/231: fdatasync d0/fb 0 2024-08-01T06:56:14.047 INFO:tasks.workunit.client.0.smithi016.stdout:5/355: symlink d1/d2/d6/d9/d1b/l7b 0 2024-08-01T06:56:14.051 INFO:tasks.workunit.client.0.smithi016.stdout:4/232: dread d0/d2/dc/d12/f24 [0,4194304] 0 2024-08-01T06:56:14.052 INFO:tasks.workunit.client.0.smithi016.stdout:5/356: mknod d1/d12/c7c 0 2024-08-01T06:56:14.053 INFO:tasks.workunit.client.0.smithi016.stdout:5/357: chown d1/d2/d6/d9/d49/d57/f75 230 1 2024-08-01T06:56:14.058 INFO:tasks.workunit.client.0.smithi016.stdout:5/358: mkdir d1/d12/d7d 0 2024-08-01T06:56:14.058 INFO:tasks.workunit.client.0.smithi016.stdout:4/233: link d0/l44 d0/d17/d38/l4d 0 2024-08-01T06:56:14.059 INFO:tasks.workunit.client.0.smithi016.stdout:4/234: truncate d0/f1 4459847 0 2024-08-01T06:56:14.061 INFO:tasks.workunit.client.0.smithi016.stdout:5/359: symlink d1/d2/d20/l7e 0 2024-08-01T06:56:14.062 INFO:tasks.workunit.client.0.smithi016.stdout:4/235: rmdir d0/d17 39 2024-08-01T06:56:14.065 INFO:tasks.workunit.client.0.smithi016.stdout:4/236: read - d0/d2/dc/f34 zero size 2024-08-01T06:56:14.072 INFO:tasks.workunit.client.0.smithi016.stdout:5/360: dread d1/d12/f16 [0,4194304] 0 2024-08-01T06:56:14.120 INFO:tasks.workunit.client.0.smithi016.stdout:4/237: link d0/d17/d22/d26/c2e d0/d2/dc/d12/c4e 0 2024-08-01T06:56:14.125 INFO:tasks.workunit.client.0.smithi016.stdout:4/238: dwrite d0/d2/dc/d12/d29/d3c/f3f [0,4194304] 0 2024-08-01T06:56:14.132 INFO:tasks.workunit.client.0.smithi016.stdout:4/239: dwrite d0/d17/f39 [0,4194304] 0 2024-08-01T06:56:14.136 INFO:tasks.workunit.client.0.smithi016.stdout:4/240: mknod d0/d17/d38/c4f 0 2024-08-01T06:56:14.145 INFO:tasks.workunit.client.0.smithi016.stdout:4/241: dwrite d0/d17/d22/f31 [0,4194304] 0 2024-08-01T06:56:14.148 INFO:tasks.workunit.client.0.smithi016.stdout:4/242: read - d0/d2/dc/f34 zero size 2024-08-01T06:56:14.150 INFO:tasks.workunit.client.0.smithi016.stdout:4/243: mkdir d0/d2/d36/d50 0 2024-08-01T06:56:14.152 INFO:tasks.workunit.client.0.smithi016.stdout:4/244: write d0/d2/dc/f42 [288848,121558] 0 2024-08-01T06:56:14.152 INFO:tasks.workunit.client.0.smithi016.stdout:4/245: stat d0/l13 0 2024-08-01T06:56:14.158 INFO:tasks.workunit.client.0.smithi016.stdout:4/246: rename d0/d2/dc/l14 to d0/d17/d22/l51 0 2024-08-01T06:56:14.158 INFO:tasks.workunit.client.0.smithi016.stdout:4/247: write d0/f23 [6247749,109792] 0 2024-08-01T06:56:14.165 INFO:tasks.workunit.client.0.smithi016.stdout:4/248: dwrite d0/f8 [0,4194304] 0 2024-08-01T06:56:14.174 INFO:tasks.workunit.client.0.smithi016.stdout:4/249: dwrite d0/d2/f11 [4194304,4194304] 0 2024-08-01T06:56:14.176 INFO:tasks.workunit.client.0.smithi016.stdout:4/250: creat d0/d2/f52 x:0 0 0 2024-08-01T06:56:14.180 INFO:tasks.workunit.client.0.smithi016.stdout:4/251: chown d0/d2/dc/f15 110768 1 2024-08-01T06:56:14.187 INFO:tasks.workunit.client.0.smithi016.stdout:4/252: dread d0/f8 [0,4194304] 0 2024-08-01T06:56:14.193 INFO:tasks.workunit.client.0.smithi016.stdout:5/361: truncate d1/d2/d23/f33 1267539 0 2024-08-01T06:56:14.221 INFO:tasks.workunit.client.0.smithi016.stdout:4/253: write d0/d17/f30 [2484974,114835] 0 2024-08-01T06:56:14.222 INFO:tasks.workunit.client.0.smithi016.stdout:4/254: fsync d0/d17/f39 0 2024-08-01T06:56:14.225 INFO:tasks.workunit.client.0.smithi016.stdout:4/255: creat d0/d17/d22/f53 x:0 0 0 2024-08-01T06:56:14.231 INFO:tasks.workunit.client.0.smithi016.stdout:4/256: dwrite d0/d17/f2f [0,4194304] 0 2024-08-01T06:56:14.233 INFO:tasks.workunit.client.0.smithi016.stdout:4/257: truncate d0/d2/f52 120283 0 2024-08-01T06:56:14.238 INFO:tasks.workunit.client.0.smithi016.stdout:4/258: rename d0/c16 to d0/d17/c54 0 2024-08-01T06:56:14.240 INFO:tasks.workunit.client.0.smithi016.stdout:4/259: write d0/d2/dc/d12/d29/d3c/f47 [531602,106563] 0 2024-08-01T06:56:14.243 INFO:tasks.workunit.client.0.smithi016.stdout:4/260: creat d0/d2/dc/d12/d29/d3c/f55 x:0 0 0 2024-08-01T06:56:14.247 INFO:tasks.workunit.client.0.smithi016.stdout:4/261: link d0/d2/f25 d0/d2/d36/f56 0 2024-08-01T06:56:14.250 INFO:tasks.workunit.client.0.smithi016.stdout:4/262: creat d0/d2/dc/d12/d29/f57 x:0 0 0 2024-08-01T06:56:14.257 INFO:tasks.workunit.client.0.smithi016.stdout:4/263: dwrite d0/d2/d36/f56 [0,4194304] 0 2024-08-01T06:56:14.264 INFO:tasks.workunit.client.0.smithi016.stdout:4/264: dwrite d0/d2/f52 [0,4194304] 0 2024-08-01T06:56:14.266 INFO:tasks.workunit.client.0.smithi016.stdout:4/265: symlink d0/d17/d22/d26/l58 0 2024-08-01T06:56:14.268 INFO:tasks.workunit.client.0.smithi016.stdout:4/266: write d0/d17/f2f [3678405,66922] 0 2024-08-01T06:56:14.282 INFO:tasks.workunit.client.0.smithi016.stdout:4/267: write d0/d2/dc/f15 [2344274,43322] 0 2024-08-01T06:56:14.326 INFO:tasks.workunit.client.0.smithi016.stdout:9/180: sync 2024-08-01T06:56:14.358 INFO:tasks.workunit.client.0.smithi016.stdout:9/181: rename d3/d9/db/dc/f21 to d3/d9/df/f3d 0 2024-08-01T06:56:14.358 INFO:tasks.workunit.client.0.smithi016.stdout:9/182: stat d3/d9/db/cd 0 2024-08-01T06:56:14.358 INFO:tasks.workunit.client.0.smithi016.stdout:9/183: mkdir d3/d9/db/d3e 0 2024-08-01T06:56:14.358 INFO:tasks.workunit.client.0.smithi016.stdout:9/184: rmdir d3/d9 39 2024-08-01T06:56:14.359 INFO:tasks.workunit.client.0.smithi016.stdout:9/185: chown d3/d9/df/d2a/f3b 3 1 2024-08-01T06:56:14.359 INFO:tasks.workunit.client.0.smithi016.stdout:9/186: getdents d3 0 2024-08-01T06:56:14.359 INFO:tasks.workunit.client.0.smithi016.stdout:9/187: chown d3/de/f3c 984760394 1 2024-08-01T06:56:14.359 INFO:tasks.workunit.client.0.smithi016.stdout:9/188: chown d3/d9/df/d16/f2b 7229 1 2024-08-01T06:56:14.359 INFO:tasks.workunit.client.0.smithi016.stdout:9/189: dwrite d3/d9/df/f3d [0,4194304] 0 2024-08-01T06:56:14.359 INFO:tasks.workunit.client.0.smithi016.stdout:9/190: mknod d3/d9/db/c3f 0 2024-08-01T06:56:14.511 INFO:tasks.workunit.client.0.smithi016.stdout:1/231: sync 2024-08-01T06:56:14.511 INFO:tasks.workunit.client.0.smithi016.stdout:3/172: sync 2024-08-01T06:56:14.512 INFO:tasks.workunit.client.0.smithi016.stdout:8/180: sync 2024-08-01T06:56:14.515 INFO:tasks.workunit.client.0.smithi016.stdout:8/181: mknod d5/dc/c41 0 2024-08-01T06:56:14.516 INFO:tasks.workunit.client.0.smithi016.stdout:3/173: chown d9/da/df/c16 41949750 1 2024-08-01T06:56:14.517 INFO:tasks.workunit.client.0.smithi016.stdout:8/182: symlink d5/d1c/l42 0 2024-08-01T06:56:14.518 INFO:tasks.workunit.client.0.smithi016.stdout:8/183: chown d5/d8/fd 6075 1 2024-08-01T06:56:14.518 INFO:tasks.workunit.client.0.smithi016.stdout:1/232: creat d2/d3/f4c x:0 0 0 2024-08-01T06:56:14.520 INFO:tasks.workunit.client.0.smithi016.stdout:3/174: mkdir d9/da/df/d12/d20/d3c 0 2024-08-01T06:56:14.521 INFO:tasks.workunit.client.0.smithi016.stdout:8/184: symlink d5/d8/l43 0 2024-08-01T06:56:14.524 INFO:tasks.workunit.client.0.smithi016.stdout:3/175: symlink d9/d2c/l3d 0 2024-08-01T06:56:14.524 INFO:tasks.workunit.client.0.smithi016.stdout:3/176: fdatasync f3 0 2024-08-01T06:56:14.531 INFO:tasks.workunit.client.0.smithi016.stdout:1/233: dread d2/de/f10 [0,4194304] 0 2024-08-01T06:56:14.532 INFO:tasks.workunit.client.0.smithi016.stdout:1/234: chown d2/de/f45 243541120 1 2024-08-01T06:56:14.541 INFO:tasks.workunit.client.0.smithi016.stdout:8/185: getdents d5/d8/d1a 0 2024-08-01T06:56:14.546 INFO:tasks.workunit.client.0.smithi016.stdout:1/235: dread d2/d3/f5 [0,4194304] 0 2024-08-01T06:56:14.549 INFO:tasks.workunit.client.0.smithi016.stdout:8/186: dwrite d5/d8/f2e [0,4194304] 0 2024-08-01T06:56:14.551 INFO:tasks.workunit.client.0.smithi016.stdout:3/177: rename d9/d2c to d9/d3e 0 2024-08-01T06:56:14.559 INFO:tasks.workunit.client.0.smithi016.stdout:1/236: mkdir d2/de/d4d 0 2024-08-01T06:56:14.560 INFO:tasks.workunit.client.0.smithi016.stdout:3/178: dwrite d9/d3e/f36 [4194304,4194304] 0 2024-08-01T06:56:14.560 INFO:tasks.workunit.client.0.smithi016.stdout:1/237: stat d2/d3/f4c 0 2024-08-01T06:56:14.570 INFO:tasks.workunit.client.0.smithi016.stdout:8/187: getdents d5/d8 0 2024-08-01T06:56:14.570 INFO:tasks.workunit.client.0.smithi016.stdout:3/179: dwrite d9/da/df/d12/d20/f35 [0,4194304] 0 2024-08-01T06:56:14.573 INFO:tasks.workunit.client.0.smithi016.stdout:1/238: creat d2/d3/d1a/f4e x:0 0 0 2024-08-01T06:56:14.575 INFO:tasks.workunit.client.0.smithi016.stdout:8/188: symlink d5/d1c/l44 0 2024-08-01T06:56:14.576 INFO:tasks.workunit.client.0.smithi016.stdout:8/189: fsync d5/d8/f3b 0 2024-08-01T06:56:14.577 INFO:tasks.workunit.client.0.smithi016.stdout:8/190: truncate d5/dc/f36 624472 0 2024-08-01T06:56:14.579 INFO:tasks.workunit.client.0.smithi016.stdout:3/180: rename d9/da/df/d2a/l2f to d9/da/df/d2a/l3f 0 2024-08-01T06:56:14.581 INFO:tasks.workunit.client.0.smithi016.stdout:3/181: write f3 [1070100,79050] 0 2024-08-01T06:56:14.581 INFO:tasks.workunit.client.0.smithi016.stdout:1/239: write d2/de/f45 [312401,6818] 0 2024-08-01T06:56:14.581 INFO:tasks.workunit.client.0.smithi016.stdout:1/240: fsync f0 0 2024-08-01T06:56:14.594 INFO:tasks.workunit.client.0.smithi016.stdout:3/182: getdents d9/da/df 0 2024-08-01T06:56:14.597 INFO:tasks.workunit.client.0.smithi016.stdout:3/183: mkdir d9/d3e/d40 0 2024-08-01T06:56:14.604 INFO:tasks.workunit.client.0.smithi016.stdout:3/184: dwrite d9/da/df/d12/f25 [0,4194304] 0 2024-08-01T06:56:14.610 INFO:tasks.workunit.client.0.smithi016.stdout:3/185: symlink d9/da/df/d12/d20/d3c/l41 0 2024-08-01T06:56:14.611 INFO:tasks.workunit.client.0.smithi016.stdout:3/186: fdatasync d9/fd 0 2024-08-01T06:56:14.614 INFO:tasks.workunit.client.0.smithi016.stdout:8/191: dwrite d5/dc/f17 [0,4194304] 0 2024-08-01T06:56:14.620 INFO:tasks.workunit.client.0.smithi016.stdout:8/192: mknod d5/d8/d1a/d24/c45 0 2024-08-01T06:56:14.621 INFO:tasks.workunit.client.0.smithi016.stdout:8/193: chown d5/d8/d1a/c1d 58176483 1 2024-08-01T06:56:14.622 INFO:tasks.workunit.client.0.smithi016.stdout:8/194: stat d5/d8/d1a/d24 0 2024-08-01T06:56:14.623 INFO:tasks.workunit.client.0.smithi016.stdout:3/187: creat d9/da/df/d12/f42 x:0 0 0 2024-08-01T06:56:14.623 INFO:tasks.workunit.client.0.smithi016.stdout:8/195: dread - d5/d8/d1a/f29 zero size 2024-08-01T06:56:14.626 INFO:tasks.workunit.client.0.smithi016.stdout:3/188: rmdir d9/d3e 39 2024-08-01T06:56:14.629 INFO:tasks.workunit.client.0.smithi016.stdout:8/196: getdents d5/dc/d3e 0 2024-08-01T06:56:14.631 INFO:tasks.workunit.client.0.smithi016.stdout:3/189: link d9/da/df/f33 d9/da/df/d2a/f43 0 2024-08-01T06:56:14.640 INFO:tasks.workunit.client.0.smithi016.stdout:3/190: dwrite d9/da/df/d12/f42 [0,4194304] 0 2024-08-01T06:56:14.646 INFO:tasks.workunit.client.0.smithi016.stdout:3/191: rename d9/da/c24 to d9/d1c/c44 0 2024-08-01T06:56:14.650 INFO:tasks.workunit.client.0.smithi016.stdout:3/192: creat d9/da/df/f45 x:0 0 0 2024-08-01T06:56:14.659 INFO:tasks.workunit.client.0.smithi016.stdout:8/197: dwrite d5/d8/d1a/d24/f19 [0,4194304] 0 2024-08-01T06:56:14.661 INFO:tasks.workunit.client.0.smithi016.stdout:8/198: read - d5/d8/f3b zero size 2024-08-01T06:56:14.662 INFO:tasks.workunit.client.0.smithi016.stdout:3/193: dwrite d9/d3e/f36 [0,4194304] 0 2024-08-01T06:56:14.664 INFO:tasks.workunit.client.0.smithi016.stdout:3/194: chown c8 12 1 2024-08-01T06:56:14.670 INFO:tasks.workunit.client.0.smithi016.stdout:3/195: creat d9/da/df/f46 x:0 0 0 2024-08-01T06:56:14.672 INFO:tasks.workunit.client.0.smithi016.stdout:8/199: dwrite d5/dc/f36 [0,4194304] 0 2024-08-01T06:56:14.674 INFO:tasks.workunit.client.0.smithi016.stdout:8/200: write d5/d8/d1a/d24/f2b [69036,94669] 0 2024-08-01T06:56:14.676 INFO:tasks.workunit.client.0.smithi016.stdout:8/201: read d5/d8/f2f [86719,99392] 0 2024-08-01T06:56:14.971 INFO:tasks.workunit.client.0.smithi016.stdout:0/180: sync 2024-08-01T06:56:14.971 INFO:tasks.workunit.client.0.smithi016.stdout:7/265: sync 2024-08-01T06:56:14.972 INFO:tasks.workunit.client.0.smithi016.stdout:0/181: readlink d10/d11/l34 0 2024-08-01T06:56:14.974 INFO:tasks.workunit.client.0.smithi016.stdout:7/266: creat d7/db/d1a/da/d1c/d4f/f6a x:0 0 0 2024-08-01T06:56:14.976 INFO:tasks.workunit.client.0.smithi016.stdout:0/182: mknod d10/d11/d37/c3a 0 2024-08-01T06:56:14.976 INFO:tasks.workunit.client.0.smithi016.stdout:7/267: rmdir d7/db/d1a/da/d1e/d26/d2a 39 2024-08-01T06:56:14.977 INFO:tasks.workunit.client.0.smithi016.stdout:0/183: mknod d10/d11/c3b 0 2024-08-01T06:56:14.978 INFO:tasks.workunit.client.0.smithi016.stdout:7/268: truncate d7/db/d1a/da/d1e/d26/f32 1034424 0 2024-08-01T06:56:14.979 INFO:tasks.workunit.client.0.smithi016.stdout:0/184: read f9 [1369175,84132] 0 2024-08-01T06:56:14.980 INFO:tasks.workunit.client.0.smithi016.stdout:7/269: mknod d7/db/d1a/da/d1c/d1d/d40/d67/c6b 0 2024-08-01T06:56:14.981 INFO:tasks.workunit.client.0.smithi016.stdout:7/270: stat d7/db/d1a/d39/f29 0 2024-08-01T06:56:14.981 INFO:tasks.workunit.client.0.smithi016.stdout:7/271: chown d7/db/d1a/da 11 1 2024-08-01T06:56:14.982 INFO:tasks.workunit.client.0.smithi016.stdout:0/185: rmdir d10/d11/d37 39 2024-08-01T06:56:14.989 INFO:tasks.workunit.client.0.smithi016.stdout:0/186: dwrite d10/d1c/f29 [0,4194304] 0 2024-08-01T06:56:15.006 INFO:tasks.workunit.client.0.smithi016.stdout:0/187: getdents d10/d11 0 2024-08-01T06:56:15.006 INFO:tasks.workunit.client.0.smithi016.stdout:7/272: dread d7/db/d1a/da/d1e/f1f [0,4194304] 0 2024-08-01T06:56:15.007 INFO:tasks.workunit.client.0.smithi016.stdout:0/188: chown d10/l23 14883008 1 2024-08-01T06:56:15.008 INFO:tasks.workunit.client.0.smithi016.stdout:0/189: stat d10/d11/d18/l2c 0 2024-08-01T06:56:15.010 INFO:tasks.workunit.client.0.smithi016.stdout:7/273: creat d7/db/d17/d4e/f6c x:0 0 0 2024-08-01T06:56:15.011 INFO:tasks.workunit.client.0.smithi016.stdout:7/274: readlink d7/db/d1a/d39/d43/d53/l56 0 2024-08-01T06:56:15.011 INFO:tasks.workunit.client.0.smithi016.stdout:0/190: unlink d10/d11/l36 0 2024-08-01T06:56:15.015 INFO:tasks.workunit.client.0.smithi016.stdout:7/275: mkdir d7/db/d1a/da/d1c/d1d/d6d 0 2024-08-01T06:56:15.019 INFO:tasks.workunit.client.0.smithi016.stdout:7/276: creat d7/db/d1a/d39/f6e x:0 0 0 2024-08-01T06:56:15.019 INFO:tasks.workunit.client.0.smithi016.stdout:0/191: dwrite d10/d11/d18/f2b [0,4194304] 0 2024-08-01T06:56:15.027 INFO:tasks.workunit.client.0.smithi016.stdout:7/277: dwrite d7/db/d1a/da/d1e/d26/f32 [0,4194304] 0 2024-08-01T06:56:15.111 INFO:tasks.workunit.client.0.smithi016.stdout:0/192: mknod d10/d11/d18/c3c 0 2024-08-01T06:56:15.116 INFO:tasks.workunit.client.0.smithi016.stdout:7/278: creat d7/db/f6f x:0 0 0 2024-08-01T06:56:15.119 INFO:tasks.workunit.client.0.smithi016.stdout:7/279: mknod d7/db/d1a/da/d22/c70 0 2024-08-01T06:56:15.121 INFO:tasks.workunit.client.0.smithi016.stdout:7/280: mkdir d7/db/d1a/d39/d71 0 2024-08-01T06:56:15.125 INFO:tasks.workunit.client.0.smithi016.stdout:0/193: dread d10/d11/d18/f2f [0,4194304] 0 2024-08-01T06:56:15.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:14 smithi089 ceph-mon[36617]: pgmap v21: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 77 MiB/s rd, 205 MiB/s wr, 396 op/s 2024-08-01T06:56:15.138 INFO:tasks.workunit.client.0.smithi016.stdout:0/194: creat d10/d11/f3d x:0 0 0 2024-08-01T06:56:15.139 INFO:tasks.workunit.client.0.smithi016.stdout:7/281: rename d7/db/d1a/da to d7/db/d17/d72 0 2024-08-01T06:56:15.140 INFO:tasks.workunit.client.0.smithi016.stdout:7/282: stat d7/db/d17/d72/d1c/d4f/f6a 0 2024-08-01T06:56:15.140 INFO:tasks.workunit.client.0.smithi016.stdout:7/283: dread - d7/db/d1a/d39/f41 zero size 2024-08-01T06:56:15.140 INFO:tasks.workunit.client.0.smithi016.stdout:0/195: mknod d10/d1c/c3e 0 2024-08-01T06:56:15.144 INFO:tasks.workunit.client.0.smithi016.stdout:7/284: creat d7/db/d17/d72/d1c/d1d/d40/f73 x:0 0 0 2024-08-01T06:56:15.145 INFO:tasks.workunit.client.0.smithi016.stdout:7/285: write d7/db/f6f [903103,14974] 0 2024-08-01T06:56:15.145 INFO:tasks.workunit.client.0.smithi016.stdout:0/196: mknod d10/d11/d37/c3f 0 2024-08-01T06:56:15.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:14 smithi016 ceph-mon[29266]: pgmap v21: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 77 MiB/s rd, 205 MiB/s wr, 396 op/s 2024-08-01T06:56:15.149 INFO:tasks.workunit.client.0.smithi016.stdout:7/286: symlink d7/db/d17/d72/d1e/d26/d2a/l74 0 2024-08-01T06:56:15.156 INFO:tasks.workunit.client.0.smithi016.stdout:7/287: dwrite d7/db/d17/d72/d1c/d1d/d40/f73 [0,4194304] 0 2024-08-01T06:56:15.164 INFO:tasks.workunit.client.0.smithi016.stdout:7/288: dwrite d7/db/d1a/d39/f15 [0,4194304] 0 2024-08-01T06:56:15.164 INFO:tasks.workunit.client.0.smithi016.stdout:0/197: truncate fd 402988 0 2024-08-01T06:56:15.170 INFO:tasks.workunit.client.0.smithi016.stdout:7/289: rename d7/db/d1a/d39/f6e to d7/db/d17/d72/d1c/d4f/f75 0 2024-08-01T06:56:15.174 INFO:tasks.workunit.client.0.smithi016.stdout:7/290: symlink d7/db/d17/d72/d1c/d1d/d5e/l76 0 2024-08-01T06:56:15.177 INFO:tasks.workunit.client.0.smithi016.stdout:7/291: mkdir d7/db/d17/d72/d22/d77 0 2024-08-01T06:56:15.191 INFO:tasks.workunit.client.0.smithi016.stdout:7/292: dread d7/f18 [0,4194304] 0 2024-08-01T06:56:15.193 INFO:tasks.workunit.client.0.smithi016.stdout:0/198: dwrite d10/d1c/f35 [0,4194304] 0 2024-08-01T06:56:15.193 INFO:tasks.workunit.client.0.smithi016.stdout:0/199: fsync d10/d11/d18/f2a 0 2024-08-01T06:56:15.198 INFO:tasks.workunit.client.0.smithi016.stdout:7/293: rename d7/db/d1a/f4d to d7/db/d17/d72/d1c/f78 0 2024-08-01T06:56:15.203 INFO:tasks.workunit.client.0.smithi016.stdout:7/294: dwrite d7/f11 [0,4194304] 0 2024-08-01T06:56:15.211 INFO:tasks.workunit.client.0.smithi016.stdout:7/295: dwrite d7/db/f6f [0,4194304] 0 2024-08-01T06:56:15.212 INFO:tasks.workunit.client.0.smithi016.stdout:0/200: truncate d10/f17 3505757 0 2024-08-01T06:56:15.214 INFO:tasks.workunit.client.0.smithi016.stdout:7/296: mkdir d7/db/d17/d72/d1c/d79 0 2024-08-01T06:56:15.218 INFO:tasks.workunit.client.0.smithi016.stdout:0/201: mknod d10/d11/d37/c40 0 2024-08-01T06:56:15.218 INFO:tasks.workunit.client.0.smithi016.stdout:7/297: stat d7/c50 0 2024-08-01T06:56:15.221 INFO:tasks.workunit.client.0.smithi016.stdout:0/202: rename d10/d11/d18 to d10/d11/d41 0 2024-08-01T06:56:15.222 INFO:tasks.workunit.client.0.smithi016.stdout:0/203: readlink d10/d1c/l22 0 2024-08-01T06:56:15.222 INFO:tasks.workunit.client.0.smithi016.stdout:2/277: sync 2024-08-01T06:56:15.222 INFO:tasks.workunit.client.0.smithi016.stdout:0/204: stat d10/d11/d41/c3c 0 2024-08-01T06:56:15.223 INFO:tasks.workunit.client.0.smithi016.stdout:2/278: chown d0/d8/f52 4 1 2024-08-01T06:56:15.224 INFO:tasks.workunit.client.0.smithi016.stdout:2/279: dread - d0/d8/d31/f53 zero size 2024-08-01T06:56:15.224 INFO:tasks.workunit.client.0.smithi016.stdout:7/298: creat d7/db/d17/d72/f7a x:0 0 0 2024-08-01T06:56:15.225 INFO:tasks.workunit.client.0.smithi016.stdout:2/280: fdatasync d0/d8/d31/f53 0 2024-08-01T06:56:15.225 INFO:tasks.workunit.client.0.smithi016.stdout:0/205: unlink c0 0 2024-08-01T06:56:15.227 INFO:tasks.workunit.client.0.smithi016.stdout:7/299: unlink d7/db/d1a/d39/d43/d53/l56 0 2024-08-01T06:56:15.230 INFO:tasks.workunit.client.0.smithi016.stdout:0/206: creat d10/d11/f42 x:0 0 0 2024-08-01T06:56:15.232 INFO:tasks.workunit.client.0.smithi016.stdout:2/281: dwrite d0/d8/d31/f53 [0,4194304] 0 2024-08-01T06:56:15.233 INFO:tasks.workunit.client.0.smithi016.stdout:7/300: truncate d7/db/d17/d72/d1c/d1d/f60 4796308 0 2024-08-01T06:56:15.238 INFO:tasks.workunit.client.0.smithi016.stdout:7/301: creat d7/db/d17/d72/d1e/d26/d2a/f7b x:0 0 0 2024-08-01T06:56:15.241 INFO:tasks.workunit.client.0.smithi016.stdout:7/302: mkdir d7/db/d17/d72/d1c/d1d/d40/d67/d7c 0 2024-08-01T06:56:15.242 INFO:tasks.workunit.client.0.smithi016.stdout:7/303: chown d7/db/d17/d72/d1e/d26/f49 6 1 2024-08-01T06:56:15.242 INFO:tasks.workunit.client.0.smithi016.stdout:7/304: stat d7/db/d1a/d39/f29 0 2024-08-01T06:56:15.246 INFO:tasks.workunit.client.0.smithi016.stdout:7/305: link d7/db/d17/d72/d1e/d26/d2a/f30 d7/db/d17/d72/d1c/f7d 0 2024-08-01T06:56:15.249 INFO:tasks.workunit.client.0.smithi016.stdout:7/306: creat d7/db/d17/d72/d1c/d79/f7e x:0 0 0 2024-08-01T06:56:15.250 INFO:tasks.workunit.client.0.smithi016.stdout:7/307: write d7/db/d1a/d39/d43/f64 [912419,116131] 0 2024-08-01T06:56:15.251 INFO:tasks.workunit.client.0.smithi016.stdout:0/207: write d10/d11/f14 [3224826,35186] 0 2024-08-01T06:56:15.254 INFO:tasks.workunit.client.0.smithi016.stdout:2/282: truncate d0/f40 3433756 0 2024-08-01T06:56:15.255 INFO:tasks.workunit.client.0.smithi016.stdout:2/283: stat d0/c4 0 2024-08-01T06:56:15.255 INFO:tasks.workunit.client.0.smithi016.stdout:0/208: chown d10/d11/f15 227 1 2024-08-01T06:56:15.255 INFO:tasks.workunit.client.0.smithi016.stdout:2/284: fsync d0/d19/f58 0 2024-08-01T06:56:15.256 INFO:tasks.workunit.client.0.smithi016.stdout:7/308: mkdir d7/db/d17/d72/d1c/d1d/d40/d7f 0 2024-08-01T06:56:15.256 INFO:tasks.workunit.client.0.smithi016.stdout:2/285: readlink d0/l3a 0 2024-08-01T06:56:15.259 INFO:tasks.workunit.client.0.smithi016.stdout:0/209: dread d10/d1c/f35 [0,4194304] 0 2024-08-01T06:56:15.260 INFO:tasks.workunit.client.0.smithi016.stdout:7/309: mkdir d7/db/d17/d72/d1c/d1d/d40/d58/d80 0 2024-08-01T06:56:15.262 INFO:tasks.workunit.client.0.smithi016.stdout:2/286: getdents d0/d16/d20/d2e/d3b/d45 0 2024-08-01T06:56:15.263 INFO:tasks.workunit.client.0.smithi016.stdout:7/310: fsync d7/db/d17/d72/f1b 0 2024-08-01T06:56:15.263 INFO:tasks.workunit.client.0.smithi016.stdout:7/311: stat d7/db/d17/d72/d1c/d1d/f52 0 2024-08-01T06:56:15.264 INFO:tasks.workunit.client.0.smithi016.stdout:2/287: creat d0/d8/d1b/f5c x:0 0 0 2024-08-01T06:56:15.266 INFO:tasks.workunit.client.0.smithi016.stdout:7/312: unlink d7/f3d 0 2024-08-01T06:56:15.267 INFO:tasks.workunit.client.0.smithi016.stdout:0/210: dread d10/d11/f15 [0,4194304] 0 2024-08-01T06:56:15.271 INFO:tasks.workunit.client.0.smithi016.stdout:6/336: sync 2024-08-01T06:56:15.272 INFO:tasks.workunit.client.0.smithi016.stdout:6/337: readlink d1/d8/d1b/l26 0 2024-08-01T06:56:15.274 INFO:tasks.workunit.client.0.smithi016.stdout:6/338: write d1/d8/d34/f62 [764659,67179] 0 2024-08-01T06:56:15.280 INFO:tasks.workunit.client.0.smithi016.stdout:2/288: dread d0/d19/f2f [0,4194304] 0 2024-08-01T06:56:15.284 INFO:tasks.workunit.client.0.smithi016.stdout:2/289: mknod d0/d8/c5d 0 2024-08-01T06:56:15.284 INFO:tasks.workunit.client.0.smithi016.stdout:0/211: write d10/d1c/f27 [85513,94160] 0 2024-08-01T06:56:15.288 INFO:tasks.workunit.client.0.smithi016.stdout:2/290: mkdir d0/d8/d31/d5e 0 2024-08-01T06:56:15.289 INFO:tasks.workunit.client.0.smithi016.stdout:6/339: truncate d1/d41/f3e 669823 0 2024-08-01T06:56:15.291 INFO:tasks.workunit.client.0.smithi016.stdout:7/313: dwrite d7/db/d17/d72/d1e/f51 [0,4194304] 0 2024-08-01T06:56:15.294 INFO:tasks.workunit.client.0.smithi016.stdout:0/212: dwrite d10/f2e [0,4194304] 0 2024-08-01T06:56:15.296 INFO:tasks.workunit.client.0.smithi016.stdout:7/314: symlink d7/db/l81 0 2024-08-01T06:56:15.302 INFO:tasks.workunit.client.0.smithi016.stdout:2/291: dwrite d0/d16/d20/d2e/f46 [4194304,4194304] 0 2024-08-01T06:56:15.304 INFO:tasks.workunit.client.0.smithi016.stdout:0/213: stat d10/d11/d41/f2b 0 2024-08-01T06:56:15.306 INFO:tasks.workunit.client.0.smithi016.stdout:2/292: symlink d0/d16/d20/d2e/l5f 0 2024-08-01T06:56:15.307 INFO:tasks.workunit.client.0.smithi016.stdout:0/214: chown d10/d11/d41/l2c 1582942 1 2024-08-01T06:56:15.308 INFO:tasks.workunit.client.0.smithi016.stdout:2/293: read d0/d19/f2c [3125804,106993] 0 2024-08-01T06:56:15.311 INFO:tasks.workunit.client.0.smithi016.stdout:7/315: dread f5 [0,4194304] 0 2024-08-01T06:56:15.313 INFO:tasks.workunit.client.0.smithi016.stdout:0/215: creat d10/d11/f43 x:0 0 0 2024-08-01T06:56:15.314 INFO:tasks.workunit.client.0.smithi016.stdout:2/294: dread d0/d8/d1b/f29 [0,4194304] 0 2024-08-01T06:56:15.315 INFO:tasks.workunit.client.0.smithi016.stdout:2/295: truncate d0/d16/f41 982488 0 2024-08-01T06:56:15.317 INFO:tasks.workunit.client.0.smithi016.stdout:2/296: chown d0/d16/d20/d2e/l5f 207439848 1 2024-08-01T06:56:15.317 INFO:tasks.workunit.client.0.smithi016.stdout:0/216: symlink d10/d1c/l44 0 2024-08-01T06:56:15.317 INFO:tasks.workunit.client.0.smithi016.stdout:0/217: chown d10/d11/f3d 1792181 1 2024-08-01T06:56:15.318 INFO:tasks.workunit.client.0.smithi016.stdout:2/297: write d0/d16/f2d [28622,59021] 0 2024-08-01T06:56:15.319 INFO:tasks.workunit.client.0.smithi016.stdout:2/298: fdatasync d0/d19/f56 0 2024-08-01T06:56:15.325 INFO:tasks.workunit.client.0.smithi016.stdout:2/299: dwrite d0/d16/d20/d2e/f46 [4194304,4194304] 0 2024-08-01T06:56:15.328 INFO:tasks.workunit.client.0.smithi016.stdout:2/300: read d0/d19/f4c [71558,109211] 0 2024-08-01T06:56:15.334 INFO:tasks.workunit.client.0.smithi016.stdout:2/301: dwrite d0/d19/f4c [0,4194304] 0 2024-08-01T06:56:15.338 INFO:tasks.workunit.client.0.smithi016.stdout:2/302: rename d0/d8/d1b/l3f to d0/d16/d20/d2e/d3b/l60 0 2024-08-01T06:56:15.340 INFO:tasks.workunit.client.0.smithi016.stdout:6/340: truncate d1/d8/d1b/f35 11267 0 2024-08-01T06:56:15.343 INFO:tasks.workunit.client.0.smithi016.stdout:2/303: rename d0/f17 to d0/d8/d31/f61 0 2024-08-01T06:56:15.346 INFO:tasks.workunit.client.0.smithi016.stdout:7/316: write d7/db/f6f [4715479,61879] 0 2024-08-01T06:56:15.348 INFO:tasks.workunit.client.0.smithi016.stdout:2/304: link d0/d8/c2b d0/d8/d31/d5e/c62 0 2024-08-01T06:56:15.348 INFO:tasks.workunit.client.0.smithi016.stdout:7/317: read d7/db/d1a/d39/f29 [5866087,12568] 0 2024-08-01T06:56:15.353 INFO:tasks.workunit.client.0.smithi016.stdout:6/341: dread d1/d8/fa [0,4194304] 0 2024-08-01T06:56:15.354 INFO:tasks.workunit.client.0.smithi016.stdout:2/305: link d0/d8/f3c d0/d8/d22/f63 0 2024-08-01T06:56:15.355 INFO:tasks.workunit.client.0.smithi016.stdout:2/306: write d0/d16/f50 [1002173,77386] 0 2024-08-01T06:56:15.356 INFO:tasks.workunit.client.0.smithi016.stdout:6/342: truncate d1/d9/d3f/f63 744106 0 2024-08-01T06:56:15.358 INFO:tasks.workunit.client.0.smithi016.stdout:7/318: truncate d7/db/d17/d72/f10 1195900 0 2024-08-01T06:56:15.362 INFO:tasks.workunit.client.0.smithi016.stdout:2/307: creat d0/d16/f64 x:0 0 0 2024-08-01T06:56:15.364 INFO:tasks.workunit.client.0.smithi016.stdout:7/319: dwrite d7/db/d17/d72/d1c/d1d/d40/f55 [0,4194304] 0 2024-08-01T06:56:15.368 INFO:tasks.workunit.client.0.smithi016.stdout:6/343: symlink d1/d8/d1b/d22/d36/d7a/l83 0 2024-08-01T06:56:15.370 INFO:tasks.workunit.client.0.smithi016.stdout:2/308: rename d0/d8/d22/l35 to d0/d8/d31/d5e/l65 0 2024-08-01T06:56:15.372 INFO:tasks.workunit.client.0.smithi016.stdout:7/320: mknod d7/db/d17/d4e/c82 0 2024-08-01T06:56:15.374 INFO:tasks.workunit.client.0.smithi016.stdout:6/344: creat d1/d9/d60/f84 x:0 0 0 2024-08-01T06:56:15.377 INFO:tasks.workunit.client.0.smithi016.stdout:2/309: symlink d0/d16/d20/d2e/d3b/d45/l66 0 2024-08-01T06:56:15.379 INFO:tasks.workunit.client.0.smithi016.stdout:6/345: rename d1/d8/d1b/d22/l5d to d1/d8/d1b/d22/d36/l85 0 2024-08-01T06:56:15.381 INFO:tasks.workunit.client.0.smithi016.stdout:2/310: rename d0/c1a to d0/d8/d31/c67 0 2024-08-01T06:56:15.384 INFO:tasks.workunit.client.0.smithi016.stdout:2/311: mkdir d0/d16/d20/d2e/d68 0 2024-08-01T06:56:15.384 INFO:tasks.workunit.client.0.smithi016.stdout:2/312: dread - d0/d19/f56 zero size 2024-08-01T06:56:15.385 INFO:tasks.workunit.client.0.smithi016.stdout:6/346: rename d1/l2b to d1/d9/d3f/l86 0 2024-08-01T06:56:15.386 INFO:tasks.workunit.client.0.smithi016.stdout:2/313: fsync d0/d8/d1b/f5b 0 2024-08-01T06:56:15.386 INFO:tasks.workunit.client.0.smithi016.stdout:6/347: chown d1/d8/d1b/d48/l4b 7 1 2024-08-01T06:56:15.387 INFO:tasks.workunit.client.0.smithi016.stdout:6/348: write d1/d9/d60/f84 [439267,37566] 0 2024-08-01T06:56:15.388 INFO:tasks.workunit.client.0.smithi016.stdout:2/314: mknod d0/d8/d31/d5e/c69 0 2024-08-01T06:56:15.390 INFO:tasks.workunit.client.0.smithi016.stdout:6/349: truncate d1/d9/d60/d68/f7b 1324039 0 2024-08-01T06:56:15.391 INFO:tasks.workunit.client.0.smithi016.stdout:2/315: mknod d0/d8/c6a 0 2024-08-01T06:56:15.392 INFO:tasks.workunit.client.0.smithi016.stdout:2/316: readlink d0/d16/d20/d2e/d3b/d45/l48 0 2024-08-01T06:56:15.393 INFO:tasks.workunit.client.0.smithi016.stdout:6/350: rename d1/f4 to d1/d9/d60/d68/d79/f87 0 2024-08-01T06:56:15.395 INFO:tasks.workunit.client.0.smithi016.stdout:2/317: mkdir d0/d8/d6b 0 2024-08-01T06:56:15.396 INFO:tasks.workunit.client.0.smithi016.stdout:2/318: write d0/d19/f56 [663028,87133] 0 2024-08-01T06:56:15.399 INFO:tasks.workunit.client.0.smithi016.stdout:2/319: mknod d0/d8/c6c 0 2024-08-01T06:56:15.409 INFO:tasks.workunit.client.0.smithi016.stdout:6/351: dread d1/d8/f11 [4194304,4194304] 0 2024-08-01T06:56:15.417 INFO:tasks.workunit.client.0.smithi016.stdout:6/352: truncate d1/d43/f4a 716287 0 2024-08-01T06:56:15.418 INFO:tasks.workunit.client.0.smithi016.stdout:6/353: mkdir d1/d43/d88 0 2024-08-01T06:56:15.421 INFO:tasks.workunit.client.0.smithi016.stdout:6/354: write d1/d8/f51 [3306229,60588] 0 2024-08-01T06:56:15.421 INFO:tasks.workunit.client.0.smithi016.stdout:6/355: creat d1/d8/d34/f89 x:0 0 0 2024-08-01T06:56:15.426 INFO:tasks.workunit.client.0.smithi016.stdout:6/356: mkdir d1/d9/d3f/d7d/d8a 0 2024-08-01T06:56:15.435 INFO:tasks.workunit.client.0.smithi016.stdout:6/357: write d1/d43/f4a [1062353,35988] 0 2024-08-01T06:56:15.435 INFO:tasks.workunit.client.0.smithi016.stdout:6/358: fdatasync d1/d8/d34/f89 0 2024-08-01T06:56:15.436 INFO:tasks.workunit.client.0.smithi016.stdout:6/359: write d1/d41/f82 [1043337,70754] 0 2024-08-01T06:56:15.437 INFO:tasks.workunit.client.0.smithi016.stdout:6/360: write d1/d43/f4a [146392,36877] 0 2024-08-01T06:56:15.444 INFO:tasks.workunit.client.0.smithi016.stdout:6/361: dwrite d1/d9/d60/d68/f7c [0,4194304] 0 2024-08-01T06:56:15.446 INFO:tasks.workunit.client.0.smithi016.stdout:6/362: mkdir d1/d9/d3f/d7d/d8b 0 2024-08-01T06:56:15.453 INFO:tasks.workunit.client.0.smithi016.stdout:6/363: dwrite d1/d43/f4a [0,4194304] 0 2024-08-01T06:56:15.457 INFO:tasks.workunit.client.0.smithi016.stdout:6/364: mknod d1/d43/d88/c8c 0 2024-08-01T06:56:15.457 INFO:tasks.workunit.client.0.smithi016.stdout:6/365: write d1/d41/f61 [241198,29339] 0 2024-08-01T06:56:15.459 INFO:tasks.workunit.client.0.smithi016.stdout:6/366: symlink d1/d41/l8d 0 2024-08-01T06:56:15.462 INFO:tasks.workunit.client.0.smithi016.stdout:6/367: mkdir d1/d9/d60/d68/d79/d8e 0 2024-08-01T06:56:15.468 INFO:tasks.workunit.client.0.smithi016.stdout:6/368: dwrite d1/d41/f52 [4194304,4194304] 0 2024-08-01T06:56:15.471 INFO:tasks.workunit.client.0.smithi016.stdout:6/369: mkdir d1/d8/d1b/d22/d3b/d67/d8f 0 2024-08-01T06:56:15.472 INFO:tasks.workunit.client.0.smithi016.stdout:6/370: write d1/d8/d1b/f72 [1435006,86672] 0 2024-08-01T06:56:15.473 INFO:tasks.workunit.client.0.smithi016.stdout:6/371: write d1/d8/f2c [5119825,106708] 0 2024-08-01T06:56:15.479 INFO:tasks.workunit.client.0.smithi016.stdout:9/191: sync 2024-08-01T06:56:15.479 INFO:tasks.workunit.client.0.smithi016.stdout:5/362: sync 2024-08-01T06:56:15.479 INFO:tasks.workunit.client.0.smithi016.stdout:8/202: sync 2024-08-01T06:56:15.480 INFO:tasks.workunit.client.0.smithi016.stdout:1/241: sync 2024-08-01T06:56:15.480 INFO:tasks.workunit.client.0.smithi016.stdout:4/268: sync 2024-08-01T06:56:15.480 INFO:tasks.workunit.client.0.smithi016.stdout:3/196: sync 2024-08-01T06:56:15.481 INFO:tasks.workunit.client.0.smithi016.stdout:3/197: fdatasync d9/d3e/f2d 0 2024-08-01T06:56:15.482 INFO:tasks.workunit.client.0.smithi016.stdout:1/242: write d2/d3/d1c/f2e [1470336,56388] 0 2024-08-01T06:56:15.483 INFO:tasks.workunit.client.0.smithi016.stdout:3/198: readlink d9/d1c/l32 0 2024-08-01T06:56:15.485 INFO:tasks.workunit.client.0.smithi016.stdout:5/363: write d1/d2/d23/d3a/f58 [142053,124552] 0 2024-08-01T06:56:15.486 INFO:tasks.workunit.client.0.smithi016.stdout:9/192: mkdir d3/d9/db/d3e/d40 0 2024-08-01T06:56:15.489 INFO:tasks.workunit.client.0.smithi016.stdout:8/203: rename d5/l7 to d5/d8/d1a/d24/l46 0 2024-08-01T06:56:15.490 INFO:tasks.workunit.client.0.smithi016.stdout:8/204: write d5/f11 [281458,68246] 0 2024-08-01T06:56:15.491 INFO:tasks.workunit.client.0.smithi016.stdout:3/199: creat d9/da/f47 x:0 0 0 2024-08-01T06:56:15.492 INFO:tasks.workunit.client.0.smithi016.stdout:1/243: dread d2/f2a [0,4194304] 0 2024-08-01T06:56:15.493 INFO:tasks.workunit.client.0.smithi016.stdout:4/269: symlink d0/d2/d36/d50/l59 0 2024-08-01T06:56:15.496 INFO:tasks.workunit.client.0.smithi016.stdout:1/244: chown d2/d2f/l3b 6347653 1 2024-08-01T06:56:15.500 INFO:tasks.workunit.client.0.smithi016.stdout:3/200: dwrite f3 [8388608,4194304] 0 2024-08-01T06:56:15.500 INFO:tasks.workunit.client.0.smithi016.stdout:8/205: dread d5/dc/f36 [0,4194304] 0 2024-08-01T06:56:15.500 INFO:tasks.workunit.client.0.smithi016.stdout:5/364: symlink d1/d12/l7f 0 2024-08-01T06:56:15.504 INFO:tasks.workunit.client.0.smithi016.stdout:4/270: dwrite d0/d2/f2a [0,4194304] 0 2024-08-01T06:56:15.506 INFO:tasks.workunit.client.0.smithi016.stdout:9/193: rename d3/d4/f11 to d3/d9/df/d2a/f41 0 2024-08-01T06:56:15.506 INFO:tasks.workunit.client.0.smithi016.stdout:5/365: truncate d1/d2/d6/d9/d49/d57/f64 649366 0 2024-08-01T06:56:15.512 INFO:tasks.workunit.client.0.smithi016.stdout:1/245: rename d2/d3/d41/c44 to d2/de/d21/d3e/c4f 0 2024-08-01T06:56:15.512 INFO:tasks.workunit.client.0.smithi016.stdout:8/206: rename d5/d8/d1a to d5/d8/d1a/d47 22 2024-08-01T06:56:15.513 INFO:tasks.workunit.client.0.smithi016.stdout:3/201: rename d9/d3e to d9/d3e/d40/d48 22 2024-08-01T06:56:15.514 INFO:tasks.workunit.client.0.smithi016.stdout:9/194: creat d3/d9/db/dc/f42 x:0 0 0 2024-08-01T06:56:15.514 INFO:tasks.workunit.client.0.smithi016.stdout:6/372: truncate d1/d8/f51 1841447 0 2024-08-01T06:56:15.515 INFO:tasks.workunit.client.0.smithi016.stdout:8/207: dread - d5/dc/f31 zero size 2024-08-01T06:56:15.515 INFO:tasks.workunit.client.0.smithi016.stdout:9/195: stat d3/d9/df/l1b 0 2024-08-01T06:56:15.516 INFO:tasks.workunit.client.0.smithi016.stdout:6/373: write d1/f5 [3305205,18632] 0 2024-08-01T06:56:15.590 INFO:tasks.workunit.client.0.smithi016.stdout:1/246: fsync d2/d3/d1a/f20 0 2024-08-01T06:56:15.591 INFO:tasks.workunit.client.0.smithi016.stdout:3/202: mkdir d9/da/df/d2a/d49 0 2024-08-01T06:56:15.593 INFO:tasks.workunit.client.0.smithi016.stdout:9/196: chown d3/d9/db/dc/f27 101434758 1 2024-08-01T06:56:15.594 INFO:tasks.workunit.client.0.smithi016.stdout:8/208: mkdir d5/d8/d1a/d24/d48 0 2024-08-01T06:56:15.594 INFO:tasks.workunit.client.0.smithi016.stdout:9/197: chown d3/de/f15 1353705357 1 2024-08-01T06:56:15.596 INFO:tasks.workunit.client.0.smithi016.stdout:6/374: write d1/d8/d34/f37 [606305,101672] 0 2024-08-01T06:56:15.600 INFO:tasks.workunit.client.0.smithi016.stdout:5/366: dread d1/d2/d6/d9/d1b/f1f [0,4194304] 0 2024-08-01T06:56:15.601 INFO:tasks.workunit.client.0.smithi016.stdout:3/203: mknod d9/da/d18/c4a 0 2024-08-01T06:56:15.602 INFO:tasks.workunit.client.0.smithi016.stdout:8/209: chown d5/l10 17140521 1 2024-08-01T06:56:15.606 INFO:tasks.workunit.client.0.smithi016.stdout:6/375: stat d1/d9/d60/d68/d79/f87 0 2024-08-01T06:56:15.608 INFO:tasks.workunit.client.0.smithi016.stdout:6/376: write d1/d8/d1b/f50 [7000119,9438] 0 2024-08-01T06:56:15.610 INFO:tasks.workunit.client.0.smithi016.stdout:3/204: creat d9/da/df/d12/d20/d3c/f4b x:0 0 0 2024-08-01T06:56:15.612 INFO:tasks.workunit.client.0.smithi016.stdout:8/210: unlink d5/d8/d1a/d24/c3f 0 2024-08-01T06:56:15.613 INFO:tasks.workunit.client.0.smithi016.stdout:6/377: symlink d1/d43/l90 0 2024-08-01T06:56:15.615 INFO:tasks.workunit.client.0.smithi016.stdout:6/378: write d1/d9/d60/f84 [1320008,66966] 0 2024-08-01T06:56:15.617 INFO:tasks.workunit.client.0.smithi016.stdout:5/367: link d1/d2/d6/d9/f34 d1/d2/f80 0 2024-08-01T06:56:15.618 INFO:tasks.workunit.client.0.smithi016.stdout:3/205: dread d9/f1f [0,4194304] 0 2024-08-01T06:56:15.619 INFO:tasks.workunit.client.0.smithi016.stdout:3/206: chown d9/da/df/d12/d20/d3c/l41 367 1 2024-08-01T06:56:15.625 INFO:tasks.workunit.client.0.smithi016.stdout:8/211: rename d5/d8/d1a/d24/c45 to d5/d1c/c49 0 2024-08-01T06:56:15.629 INFO:tasks.workunit.client.0.smithi016.stdout:5/368: rename d1/d2/d6/d9/d49/f45 to d1/d2/d23/f81 0 2024-08-01T06:56:15.636 INFO:tasks.workunit.client.0.smithi016.stdout:6/379: dread d1/d41/f52 [0,4194304] 0 2024-08-01T06:56:15.640 INFO:tasks.workunit.client.0.smithi016.stdout:3/207: rename d9/d3e/f31 to d9/da/df/d12/d20/f4c 0 2024-08-01T06:56:15.642 INFO:tasks.workunit.client.0.smithi016.stdout:8/212: getdents d5/dc/d3e 0 2024-08-01T06:56:15.645 INFO:tasks.workunit.client.0.smithi016.stdout:6/380: dwrite d1/d8/d1b/f72 [0,4194304] 0 2024-08-01T06:56:15.645 INFO:tasks.workunit.client.0.smithi016.stdout:8/213: chown d5/d8/d1a/d24/f2a 313377 1 2024-08-01T06:56:15.654 INFO:tasks.workunit.client.0.smithi016.stdout:3/208: dwrite d9/da/df/d12/d20/f35 [0,4194304] 0 2024-08-01T06:56:15.659 INFO:tasks.workunit.client.0.smithi016.stdout:8/214: dwrite d5/d8/f3b [0,4194304] 0 2024-08-01T06:56:15.671 INFO:tasks.workunit.client.0.smithi016.stdout:8/215: getdents d5/d8/d32 0 2024-08-01T06:56:15.673 INFO:tasks.workunit.client.0.smithi016.stdout:6/381: getdents d1/d8/d1b/d22/d3b 0 2024-08-01T06:56:15.676 INFO:tasks.workunit.client.0.smithi016.stdout:8/216: creat d5/d8/d1a/d24/f4a x:0 0 0 2024-08-01T06:56:15.677 INFO:tasks.workunit.client.0.smithi016.stdout:8/217: write d5/dc/f36 [4269256,57512] 0 2024-08-01T06:56:15.681 INFO:tasks.workunit.client.0.smithi016.stdout:8/218: creat d5/dc/f4b x:0 0 0 2024-08-01T06:56:15.683 INFO:tasks.workunit.client.0.smithi016.stdout:1/247: truncate d2/de/f14 3871605 0 2024-08-01T06:56:15.684 INFO:tasks.workunit.client.0.smithi016.stdout:8/219: write d5/d1c/f37 [792911,68518] 0 2024-08-01T06:56:15.688 INFO:tasks.workunit.client.0.smithi016.stdout:6/382: dwrite d1/d9/d60/d68/f7b [0,4194304] 0 2024-08-01T06:56:15.689 INFO:tasks.workunit.client.0.smithi016.stdout:6/383: readlink d1/d8/d1b/l26 0 2024-08-01T06:56:15.691 INFO:tasks.workunit.client.0.smithi016.stdout:8/220: creat d5/d1c/f4c x:0 0 0 2024-08-01T06:56:15.694 INFO:tasks.workunit.client.0.smithi016.stdout:6/384: chown d1/d8/f51 4630190 1 2024-08-01T06:56:15.702 INFO:tasks.workunit.client.0.smithi016.stdout:6/385: mkdir d1/d9/d3f/d7d/d8b/d91 0 2024-08-01T06:56:15.704 INFO:tasks.workunit.client.0.smithi016.stdout:8/221: dwrite d5/f38 [0,4194304] 0 2024-08-01T06:56:15.705 INFO:tasks.workunit.client.0.smithi016.stdout:8/222: dread - d5/dc/f4b zero size 2024-08-01T06:56:15.713 INFO:tasks.workunit.client.0.smithi016.stdout:3/209: write d9/da/df/d2a/f43 [3643637,69470] 0 2024-08-01T06:56:15.715 INFO:tasks.workunit.client.0.smithi016.stdout:8/223: dwrite d5/d1c/f37 [0,4194304] 0 2024-08-01T06:56:15.720 INFO:tasks.workunit.client.0.smithi016.stdout:6/386: getdents d1/d9/d3f/d7d/d8a 0 2024-08-01T06:56:15.720 INFO:tasks.workunit.client.0.smithi016.stdout:6/387: write d1/d8/f2a [935785,22925] 0 2024-08-01T06:56:15.723 INFO:tasks.workunit.client.0.smithi016.stdout:3/210: mknod d9/da/df/c4d 0 2024-08-01T06:56:15.724 INFO:tasks.workunit.client.0.smithi016.stdout:1/248: write d2/fc [2296933,10123] 0 2024-08-01T06:56:15.724 INFO:tasks.workunit.client.0.smithi016.stdout:8/224: symlink d5/d8/d1a/l4d 0 2024-08-01T06:56:15.726 INFO:tasks.workunit.client.0.smithi016.stdout:8/225: readlink d5/d1c/l44 0 2024-08-01T06:56:15.726 INFO:tasks.workunit.client.0.smithi016.stdout:3/211: fsync d9/da/df/d12/f15 0 2024-08-01T06:56:15.728 INFO:tasks.workunit.client.0.smithi016.stdout:8/226: write d5/d1c/f37 [3818387,47284] 0 2024-08-01T06:56:15.730 INFO:tasks.workunit.client.0.smithi016.stdout:1/249: read d2/d3/d1c/f2b [1637954,48455] 0 2024-08-01T06:56:15.731 INFO:tasks.workunit.client.0.smithi016.stdout:1/250: write d2/d3/d1c/f2e [2078762,24711] 0 2024-08-01T06:56:15.732 INFO:tasks.workunit.client.0.smithi016.stdout:1/251: readlink d2/d3/l30 0 2024-08-01T06:56:15.749 INFO:tasks.workunit.client.0.smithi016.stdout:8/227: creat d5/d8/d1a/d24/f4e x:0 0 0 2024-08-01T06:56:15.750 INFO:tasks.workunit.client.0.smithi016.stdout:1/252: mknod d2/d3/d1f/c50 0 2024-08-01T06:56:15.751 INFO:tasks.workunit.client.0.smithi016.stdout:8/228: fsync d5/d8/d1a/d24/f2b 0 2024-08-01T06:56:15.758 INFO:tasks.workunit.client.0.smithi016.stdout:3/212: mkdir d9/d4e 0 2024-08-01T06:56:15.762 INFO:tasks.workunit.client.0.smithi016.stdout:1/253: dwrite d2/d3/d1c/f2e [0,4194304] 0 2024-08-01T06:56:15.765 INFO:tasks.workunit.client.0.smithi016.stdout:3/213: chown d9/da/df/d12/l23 1 1 2024-08-01T06:56:15.766 INFO:tasks.workunit.client.0.smithi016.stdout:8/229: dwrite d5/d8/f3b [4194304,4194304] 0 2024-08-01T06:56:15.773 INFO:tasks.workunit.client.0.smithi016.stdout:3/214: rename d9/da/df/d12/c1d to d9/d4e/c4f 0 2024-08-01T06:56:15.775 INFO:tasks.workunit.client.0.smithi016.stdout:3/215: chown d9/da/df/f46 4725 1 2024-08-01T06:56:15.776 INFO:tasks.workunit.client.0.smithi016.stdout:3/216: fsync d9/da/df/d12/f42 0 2024-08-01T06:56:15.779 INFO:tasks.workunit.client.0.smithi016.stdout:8/230: rename d5/d8/d1a/d24/f2a to d5/d1c/f4f 0 2024-08-01T06:56:15.780 INFO:tasks.workunit.client.0.smithi016.stdout:1/254: chown d2/f12 91409 1 2024-08-01T06:56:15.788 INFO:tasks.workunit.client.0.smithi016.stdout:8/231: symlink d5/d8/d32/l50 0 2024-08-01T06:56:15.789 INFO:tasks.workunit.client.0.smithi016.stdout:8/232: stat d5/d1c/l1f 0 2024-08-01T06:56:15.789 INFO:tasks.workunit.client.0.smithi016.stdout:1/255: mkdir d2/d3/d41/d49/d51 0 2024-08-01T06:56:15.789 INFO:tasks.workunit.client.0.smithi016.stdout:1/256: fsync d2/d3/d1a/f27 0 2024-08-01T06:56:15.791 INFO:tasks.workunit.client.0.smithi016.stdout:8/233: rmdir d5/dc 39 2024-08-01T06:56:15.793 INFO:tasks.workunit.client.0.smithi016.stdout:8/234: readlink d5/lb 0 2024-08-01T06:56:15.796 INFO:tasks.workunit.client.0.smithi016.stdout:8/235: write d5/dc/f36 [2152229,30755] 0 2024-08-01T06:56:15.801 INFO:tasks.workunit.client.0.smithi016.stdout:8/236: symlink d5/d8/d1a/l51 0 2024-08-01T06:56:15.802 INFO:tasks.workunit.client.0.smithi016.stdout:8/237: fsync d5/d8/d1a/d24/f26 0 2024-08-01T06:56:15.804 INFO:tasks.workunit.client.0.smithi016.stdout:3/217: truncate d9/d3e/f2d 10957402 0 2024-08-01T06:56:15.806 INFO:tasks.workunit.client.0.smithi016.stdout:8/238: rename d5/d8/d1a/c2d to d5/d8/d1a/d24/c52 0 2024-08-01T06:56:15.807 INFO:tasks.workunit.client.0.smithi016.stdout:8/239: write d5/d8/d1a/d24/f26 [135848,76458] 0 2024-08-01T06:56:15.807 INFO:tasks.workunit.client.0.smithi016.stdout:3/218: symlink d9/da/df/l50 0 2024-08-01T06:56:15.808 INFO:tasks.workunit.client.0.smithi016.stdout:8/240: chown d5/dc/f36 148 1 2024-08-01T06:56:15.809 INFO:tasks.workunit.client.0.smithi016.stdout:8/241: stat d5/d8/d1a/d24/f4e 0 2024-08-01T06:56:15.810 INFO:tasks.workunit.client.0.smithi016.stdout:8/242: fdatasync d5/d8/d1a/f29 0 2024-08-01T06:56:15.814 INFO:tasks.workunit.client.0.smithi016.stdout:3/219: link d9/d3e/l3d d9/da/df/d12/d20/d3c/l51 0 2024-08-01T06:56:15.816 INFO:tasks.workunit.client.0.smithi016.stdout:3/220: stat d9/da/df/f45 0 2024-08-01T06:56:15.818 INFO:tasks.workunit.client.0.smithi016.stdout:8/243: dwrite d5/f38 [0,4194304] 0 2024-08-01T06:56:15.819 INFO:tasks.workunit.client.0.smithi016.stdout:1/257: dwrite d2/de/f31 [0,4194304] 0 2024-08-01T06:56:15.821 INFO:tasks.workunit.client.0.smithi016.stdout:8/244: write d5/d8/f2e [4406789,32399] 0 2024-08-01T06:56:15.824 INFO:tasks.workunit.client.0.smithi016.stdout:1/258: dread d2/de/f45 [0,4194304] 0 2024-08-01T06:56:15.829 INFO:tasks.workunit.client.0.smithi016.stdout:8/245: rename d5/d8/f3b to d5/dc/f53 0 2024-08-01T06:56:15.835 INFO:tasks.workunit.client.0.smithi016.stdout:1/259: link d2/d3/d1a/f3c d2/de/d32/f52 0 2024-08-01T06:56:15.835 INFO:tasks.workunit.client.0.smithi016.stdout:8/246: creat d5/d8/d1a/f54 x:0 0 0 2024-08-01T06:56:15.835 INFO:tasks.workunit.client.0.smithi016.stdout:1/260: read - d2/d3/f4c zero size 2024-08-01T06:56:15.837 INFO:tasks.workunit.client.0.smithi016.stdout:8/247: unlink d5/dc/c16 0 2024-08-01T06:56:15.838 INFO:tasks.workunit.client.0.smithi016.stdout:1/261: creat d2/d3/d48/f53 x:0 0 0 2024-08-01T06:56:15.839 INFO:tasks.workunit.client.0.smithi016.stdout:8/248: mknod d5/d1c/c55 0 2024-08-01T06:56:15.839 INFO:tasks.workunit.client.0.smithi016.stdout:1/262: dread - d2/de/d32/f52 zero size 2024-08-01T06:56:15.841 INFO:tasks.workunit.client.0.smithi016.stdout:1/263: write d2/d3/d48/f53 [817837,119650] 0 2024-08-01T06:56:15.843 INFO:tasks.workunit.client.0.smithi016.stdout:8/249: getdents d5 0 2024-08-01T06:56:15.844 INFO:tasks.workunit.client.0.smithi016.stdout:1/264: read d2/d3/d48/f53 [262809,33486] 0 2024-08-01T06:56:15.845 INFO:tasks.workunit.client.0.smithi016.stdout:8/250: creat d5/d8/d1a/d24/d48/f56 x:0 0 0 2024-08-01T06:56:15.846 INFO:tasks.workunit.client.0.smithi016.stdout:8/251: read d5/dc/f36 [3120164,45984] 0 2024-08-01T06:56:15.848 INFO:tasks.workunit.client.0.smithi016.stdout:1/265: rename d2/de/d32/f3a to d2/de/d32/d43/f54 0 2024-08-01T06:56:15.852 INFO:tasks.workunit.client.0.smithi016.stdout:8/252: rename d5/d8/f2f to d5/d1c/f57 0 2024-08-01T06:56:15.853 INFO:tasks.workunit.client.0.smithi016.stdout:1/266: mknod d2/d3/d48/c55 0 2024-08-01T06:56:15.858 INFO:tasks.workunit.client.0.smithi016.stdout:1/267: getdents d2/d2f 0 2024-08-01T06:56:15.861 INFO:tasks.workunit.client.0.smithi016.stdout:1/268: rename d2/d3/d1a/d22/l2d to d2/d2f/l56 0 2024-08-01T06:56:15.862 INFO:tasks.workunit.client.0.smithi016.stdout:8/253: rmdir d5/d8/d1a 39 2024-08-01T06:56:15.866 INFO:tasks.workunit.client.0.smithi016.stdout:1/269: symlink d2/l57 0 2024-08-01T06:56:15.867 INFO:tasks.workunit.client.0.smithi016.stdout:8/254: rmdir d5/d8/d1a/d24 39 2024-08-01T06:56:15.871 INFO:tasks.workunit.client.0.smithi016.stdout:8/255: truncate d5/d8/d1a/d24/f4a 1031955 0 2024-08-01T06:56:15.873 INFO:tasks.workunit.client.0.smithi016.stdout:8/256: write d5/d1c/f4f [1963518,87452] 0 2024-08-01T06:56:15.874 INFO:tasks.workunit.client.0.smithi016.stdout:8/257: stat d5/d8/d1a/d24 0 2024-08-01T06:56:15.875 INFO:tasks.workunit.client.0.smithi016.stdout:8/258: fsync d5/d8/d1a/d24/f4e 0 2024-08-01T06:56:15.875 INFO:tasks.workunit.client.0.smithi016.stdout:8/259: chown d5/f12 2045326 1 2024-08-01T06:56:15.876 INFO:tasks.workunit.client.0.smithi016.stdout:1/270: write d2/de/d21/d3e/f4a [508535,4584] 0 2024-08-01T06:56:15.880 INFO:tasks.workunit.client.0.smithi016.stdout:1/271: link d2/d3/d1f/c50 d2/d3/d41/c58 0 2024-08-01T06:56:15.882 INFO:tasks.workunit.client.0.smithi016.stdout:1/272: getdents d2/d3/d48 0 2024-08-01T06:56:15.884 INFO:tasks.workunit.client.0.smithi016.stdout:1/273: creat d2/de/d32/f59 x:0 0 0 2024-08-01T06:56:15.888 INFO:tasks.workunit.client.0.smithi016.stdout:1/274: write d2/de/d32/f52 [540690,122174] 0 2024-08-01T06:56:15.891 INFO:tasks.workunit.client.0.smithi016.stdout:1/275: creat d2/d3/f5a x:0 0 0 2024-08-01T06:56:15.892 INFO:tasks.workunit.client.0.smithi016.stdout:1/276: creat d2/de/d21/f5b x:0 0 0 2024-08-01T06:56:15.899 INFO:tasks.workunit.client.0.smithi016.stdout:1/277: dwrite d2/d3/d1a/f4e [0,4194304] 0 2024-08-01T06:56:15.901 INFO:tasks.workunit.client.0.smithi016.stdout:1/278: fsync d2/f24 0 2024-08-01T06:56:15.904 INFO:tasks.workunit.client.0.smithi016.stdout:1/279: symlink d2/de/d32/l5c 0 2024-08-01T06:56:15.911 INFO:tasks.workunit.client.0.smithi016.stdout:1/280: link d2/de/d32/d43/f54 d2/f5d 0 2024-08-01T06:56:15.912 INFO:tasks.workunit.client.0.smithi016.stdout:1/281: chown d2/d2f/l42 62107 1 2024-08-01T06:56:15.913 INFO:tasks.workunit.client.0.smithi016.stdout:1/282: rmdir d2 39 2024-08-01T06:56:15.916 INFO:tasks.workunit.client.0.smithi016.stdout:1/283: unlink d2/de/c26 0 2024-08-01T06:56:15.922 INFO:tasks.workunit.client.0.smithi016.stdout:1/284: rename d2/d3/f3f to d2/de/f5e 0 2024-08-01T06:56:15.926 INFO:tasks.workunit.client.0.smithi016.stdout:1/285: creat d2/d3/f5f x:0 0 0 2024-08-01T06:56:15.928 INFO:tasks.workunit.client.0.smithi016.stdout:1/286: creat d2/d3/d41/d49/f60 x:0 0 0 2024-08-01T06:56:15.930 INFO:tasks.workunit.client.0.smithi016.stdout:1/287: mknod d2/d2f/c61 0 2024-08-01T06:56:15.930 INFO:tasks.workunit.client.0.smithi016.stdout:1/288: chown d2/d3/d48/c55 4585275 1 2024-08-01T06:56:15.932 INFO:tasks.workunit.client.0.smithi016.stdout:1/289: symlink d2/d3/d1a/d22/l62 0 2024-08-01T06:56:15.933 INFO:tasks.workunit.client.0.smithi016.stdout:1/290: rmdir d2/de/d21 39 2024-08-01T06:56:15.935 INFO:tasks.workunit.client.0.smithi016.stdout:1/291: write d2/d3/d1c/f36 [1174136,17575] 0 2024-08-01T06:56:15.940 INFO:tasks.workunit.client.0.smithi016.stdout:1/292: mkdir d2/de/d63 0 2024-08-01T06:56:15.944 INFO:tasks.workunit.client.0.smithi016.stdout:1/293: creat d2/d3/d1a/d22/f64 x:0 0 0 2024-08-01T06:56:15.947 INFO:tasks.workunit.client.0.smithi016.stdout:1/294: creat d2/de/d32/f65 x:0 0 0 2024-08-01T06:56:15.950 INFO:tasks.workunit.client.0.smithi016.stdout:1/295: rename d2/d3/f18 to d2/de/d4d/f66 0 2024-08-01T06:56:15.950 INFO:tasks.workunit.client.0.smithi016.stdout:1/296: dread - d2/de/f38 zero size 2024-08-01T06:56:15.970 INFO:tasks.workunit.client.0.smithi016.stdout:1/297: dwrite d2/d3/fd [0,4194304] 0 2024-08-01T06:56:15.983 INFO:tasks.workunit.client.0.smithi016.stdout:1/298: dwrite d2/de/f45 [0,4194304] 0 2024-08-01T06:56:15.984 INFO:tasks.workunit.client.0.smithi016.stdout:1/299: write d2/d3/d1a/f4e [4866011,81715] 0 2024-08-01T06:56:15.986 INFO:tasks.workunit.client.0.smithi016.stdout:1/300: chown d2/d2f/l42 85251377 1 2024-08-01T06:56:15.986 INFO:tasks.workunit.client.0.smithi016.stdout:1/301: stat d2/d2f/l42 0 2024-08-01T06:56:15.989 INFO:tasks.workunit.client.0.smithi016.stdout:1/302: mknod d2/de/d4d/c67 0 2024-08-01T06:56:15.989 INFO:tasks.workunit.client.0.smithi016.stdout:1/303: chown d2/d3/f4c 114134 1 2024-08-01T06:56:15.990 INFO:tasks.workunit.client.0.smithi016.stdout:1/304: fdatasync d2/de/f37 0 2024-08-01T06:56:15.993 INFO:tasks.workunit.client.0.smithi016.stdout:1/305: mknod d2/d3/d1a/d22/c68 0 2024-08-01T06:56:15.993 INFO:tasks.workunit.client.0.smithi016.stdout:1/306: stat d2/d3/d1a/d22/l62 0 2024-08-01T06:56:15.995 INFO:tasks.workunit.client.0.smithi016.stdout:1/307: symlink d2/d2f/l69 0 2024-08-01T06:56:15.998 INFO:tasks.workunit.client.0.smithi016.stdout:1/308: creat d2/de/d21/d3e/f6a x:0 0 0 2024-08-01T06:56:15.998 INFO:tasks.workunit.client.0.smithi016.stdout:1/309: write d2/f24 [862669,48231] 0 2024-08-01T06:56:16.000 INFO:tasks.workunit.client.0.smithi016.stdout:1/310: unlink d2/de/d4d/f66 0 2024-08-01T06:56:16.001 INFO:tasks.workunit.client.0.smithi016.stdout:1/311: write f0 [7000266,63790] 0 2024-08-01T06:56:16.004 INFO:tasks.workunit.client.0.smithi016.stdout:1/312: mknod d2/de/c6b 0 2024-08-01T06:56:16.004 INFO:tasks.workunit.client.0.smithi016.stdout:1/313: chown d2/de/cf 5613 1 2024-08-01T06:56:16.008 INFO:tasks.workunit.client.0.smithi016.stdout:1/314: dread d2/f24 [0,4194304] 0 2024-08-01T06:56:16.017 INFO:tasks.workunit.client.0.smithi016.stdout:1/315: dread d2/d3/d1a/f20 [0,4194304] 0 2024-08-01T06:56:16.018 INFO:tasks.workunit.client.0.smithi016.stdout:1/316: truncate d2/f24 1903266 0 2024-08-01T06:56:16.020 INFO:tasks.workunit.client.0.smithi016.stdout:1/317: dread d2/f24 [0,4194304] 0 2024-08-01T06:56:16.118 INFO:tasks.workunit.client.0.smithi016.stdout:1/318: dwrite d2/d3/f5 [4194304,4194304] 0 2024-08-01T06:56:16.119 INFO:tasks.workunit.client.0.smithi016.stdout:1/319: chown d2/de/d21/d3e 188912 1 2024-08-01T06:56:16.124 INFO:tasks.workunit.client.0.smithi016.stdout:1/320: dread d2/f5d [0,4194304] 0 2024-08-01T06:56:16.129 INFO:tasks.workunit.client.0.smithi016.stdout:1/321: creat d2/d3/d1a/d22/f6c x:0 0 0 2024-08-01T06:56:16.132 INFO:tasks.workunit.client.0.smithi016.stdout:1/322: rename d2/de/f10 to d2/de/d4d/f6d 0 2024-08-01T06:56:16.134 INFO:tasks.workunit.client.0.smithi016.stdout:1/323: mkdir d2/de/d6e 0 2024-08-01T06:56:16.135 INFO:tasks.workunit.client.0.smithi016.stdout:1/324: write d2/de/f45 [1375492,130767] 0 2024-08-01T06:56:16.138 INFO:tasks.workunit.client.0.smithi016.stdout:1/325: chown d2/d3/d1f/c29 43438981 1 2024-08-01T06:56:16.139 INFO:tasks.workunit.client.0.smithi016.stdout:1/326: dread - d2/d3/d41/d49/f60 zero size 2024-08-01T06:56:16.142 INFO:tasks.workunit.client.0.smithi016.stdout:1/327: creat d2/de/d32/f6f x:0 0 0 2024-08-01T06:56:16.143 INFO:tasks.workunit.client.0.smithi016.stdout:1/328: dread - d2/d3/f5f zero size 2024-08-01T06:56:16.144 INFO:tasks.workunit.client.0.smithi016.stdout:1/329: write d2/de/d21/d3e/f6a [314081,28687] 0 2024-08-01T06:56:16.150 INFO:tasks.workunit.client.0.smithi016.stdout:1/330: getdents d2/d2f 0 2024-08-01T06:56:16.151 INFO:tasks.workunit.client.0.smithi016.stdout:1/331: fsync d2/d3/d1c/f2e 0 2024-08-01T06:56:16.152 INFO:tasks.workunit.client.0.smithi016.stdout:1/332: fdatasync d2/d3/d1c/f2e 0 2024-08-01T06:56:16.156 INFO:tasks.workunit.client.0.smithi016.stdout:1/333: dread d2/d3/d1a/f4e [0,4194304] 0 2024-08-01T06:56:16.161 INFO:tasks.workunit.client.0.smithi016.stdout:1/334: dwrite d2/f2a [4194304,4194304] 0 2024-08-01T06:56:16.163 INFO:tasks.workunit.client.0.smithi016.stdout:1/335: creat d2/de/d32/d43/f70 x:0 0 0 2024-08-01T06:56:16.166 INFO:tasks.workunit.client.0.smithi016.stdout:1/336: creat d2/d3/d48/f71 x:0 0 0 2024-08-01T06:56:16.171 INFO:tasks.workunit.client.0.smithi016.stdout:1/337: creat d2/f72 x:0 0 0 2024-08-01T06:56:16.174 INFO:tasks.workunit.client.0.smithi016.stdout:1/338: rename d2/d3/d48/f71 to d2/d3/d41/d49/d51/f73 0 2024-08-01T06:56:16.175 INFO:tasks.workunit.client.0.smithi016.stdout:1/339: rmdir d2/d3/d1f 39 2024-08-01T06:56:16.176 INFO:tasks.workunit.client.0.smithi016.stdout:1/340: chown d2/de/d32/d43 3 1 2024-08-01T06:56:16.177 INFO:tasks.workunit.client.0.smithi016.stdout:1/341: write d2/d3/f5a [606673,18181] 0 2024-08-01T06:56:16.179 INFO:tasks.workunit.client.0.smithi016.stdout:1/342: write d2/d3/d1a/f3c [1408941,101429] 0 2024-08-01T06:56:16.183 INFO:tasks.workunit.client.0.smithi016.stdout:1/343: dread d2/d3/f5 [4194304,4194304] 0 2024-08-01T06:56:16.183 INFO:tasks.workunit.client.0.smithi016.stdout:1/344: dread - d2/de/d32/f6f zero size 2024-08-01T06:56:16.186 INFO:tasks.workunit.client.0.smithi016.stdout:1/345: mknod d2/de/d21/d3e/c74 0 2024-08-01T06:56:16.187 INFO:tasks.workunit.client.0.smithi016.stdout:1/346: write d2/de/d32/f65 [983874,74382] 0 2024-08-01T06:56:16.188 INFO:tasks.workunit.client.0.smithi016.stdout:1/347: write d2/d3/d1a/f27 [583471,13844] 0 2024-08-01T06:56:16.237 INFO:tasks.workunit.client.0.smithi016.stdout:1/348: dread - d2/de/d32/f6f zero size 2024-08-01T06:56:16.240 INFO:tasks.workunit.client.0.smithi016.stdout:1/349: link d2/f17 d2/d2f/f75 0 2024-08-01T06:56:16.242 INFO:tasks.workunit.client.0.smithi016.stdout:1/350: fdatasync d2/d3/d41/d49/d51/f73 0 2024-08-01T06:56:16.243 INFO:tasks.workunit.client.0.smithi016.stdout:1/351: write d2/de/f45 [2037547,31217] 0 2024-08-01T06:56:16.244 INFO:tasks.workunit.client.0.smithi016.stdout:1/352: fdatasync d2/d3/d1a/d22/f64 0 2024-08-01T06:56:16.248 INFO:tasks.workunit.client.0.smithi016.stdout:1/353: chown d2/d3/d1f/c50 245254 1 2024-08-01T06:56:16.249 INFO:tasks.workunit.client.0.smithi016.stdout:1/354: truncate d2/d3/d1c/f36 1986403 0 2024-08-01T06:56:16.253 INFO:tasks.workunit.client.0.smithi016.stdout:1/355: truncate d2/f17 3981891 0 2024-08-01T06:56:16.255 INFO:tasks.workunit.client.0.smithi016.stdout:1/356: creat d2/d3/d1a/d22/f76 x:0 0 0 2024-08-01T06:56:16.255 INFO:tasks.workunit.client.0.smithi016.stdout:1/357: readlink d2/l57 0 2024-08-01T06:56:16.256 INFO:tasks.workunit.client.0.smithi016.stdout:1/358: dread - d2/d3/f4c zero size 2024-08-01T06:56:16.256 INFO:tasks.workunit.client.0.smithi016.stdout:1/359: chown d2/f2a 9660 1 2024-08-01T06:56:16.258 INFO:tasks.workunit.client.0.smithi016.stdout:1/360: symlink d2/de/d21/d3e/l77 0 2024-08-01T06:56:16.259 INFO:tasks.workunit.client.0.smithi016.stdout:1/361: chown d2/f12 16746 1 2024-08-01T06:56:16.271 INFO:tasks.workunit.client.0.smithi016.stdout:1/362: dread d2/d3/d41/f47 [0,4194304] 0 2024-08-01T06:56:16.273 INFO:tasks.workunit.client.0.smithi016.stdout:1/363: creat d2/de/d6e/f78 x:0 0 0 2024-08-01T06:56:16.278 INFO:tasks.workunit.client.0.smithi016.stdout:1/364: dread d2/d3/d1c/f36 [0,4194304] 0 2024-08-01T06:56:16.280 INFO:tasks.workunit.client.0.smithi016.stdout:1/365: truncate d2/d3/f5a 686817 0 2024-08-01T06:56:16.280 INFO:tasks.workunit.client.0.smithi016.stdout:1/366: fdatasync d2/d3/d1a/f27 0 2024-08-01T06:56:16.285 INFO:tasks.workunit.client.0.smithi016.stdout:1/367: rename d2/d2f/f33 to d2/d3/d41/d49/f79 0 2024-08-01T06:56:16.286 INFO:tasks.workunit.client.0.smithi016.stdout:1/368: chown d2/de/f14 4 1 2024-08-01T06:56:16.289 INFO:tasks.workunit.client.0.smithi016.stdout:1/369: creat d2/d2f/f7a x:0 0 0 2024-08-01T06:56:16.291 INFO:tasks.workunit.client.0.smithi016.stdout:1/370: mknod d2/d3/d1f/c7b 0 2024-08-01T06:56:16.297 INFO:tasks.workunit.client.0.smithi016.stdout:1/371: dwrite d2/d3/d1a/d22/f6c [0,4194304] 0 2024-08-01T06:56:16.299 INFO:tasks.workunit.client.0.smithi016.stdout:1/372: rmdir d2/d3/d1f 39 2024-08-01T06:56:16.304 INFO:tasks.workunit.client.0.smithi016.stdout:1/373: dread d2/d3/d1a/d22/f6c [0,4194304] 0 2024-08-01T06:56:16.307 INFO:tasks.workunit.client.0.smithi016.stdout:1/374: truncate d2/d3/d1a/f27 1111615 0 2024-08-01T06:56:16.314 INFO:tasks.workunit.client.0.smithi016.stdout:1/375: truncate d2/de/f31 1895733 0 2024-08-01T06:56:16.325 INFO:tasks.workunit.client.0.smithi016.stdout:1/376: dread d2/f12 [0,4194304] 0 2024-08-01T06:56:16.327 INFO:tasks.workunit.client.0.smithi016.stdout:1/377: mknod d2/de/d21/d3e/c7c 0 2024-08-01T06:56:16.329 INFO:tasks.workunit.client.0.smithi016.stdout:1/378: mknod d2/d3/d41/c7d 0 2024-08-01T06:56:16.330 INFO:tasks.workunit.client.0.smithi016.stdout:1/379: chown d2/d3/d1f/c50 29 1 2024-08-01T06:56:16.333 INFO:tasks.workunit.client.0.smithi016.stdout:1/380: mknod d2/c7e 0 2024-08-01T06:56:16.338 INFO:tasks.workunit.client.0.smithi016.stdout:1/381: rename d2/f24 to d2/de/f7f 0 2024-08-01T06:56:16.414 INFO:tasks.workunit.client.0.smithi016.stdout:1/382: write d2/de/d21/d3e/f4a [1245980,78524] 0 2024-08-01T06:56:16.417 INFO:tasks.workunit.client.0.smithi016.stdout:1/383: symlink d2/de/d21/l80 0 2024-08-01T06:56:16.419 INFO:tasks.workunit.client.0.smithi016.stdout:1/384: creat d2/d3/d1c/f81 x:0 0 0 2024-08-01T06:56:16.422 INFO:tasks.workunit.client.0.smithi016.stdout:1/385: link d2/de/d32/f59 d2/de/f82 0 2024-08-01T06:56:16.427 INFO:tasks.workunit.client.0.smithi016.stdout:1/386: dwrite d2/de/d32/f6f [0,4194304] 0 2024-08-01T06:56:16.440 INFO:tasks.workunit.client.0.smithi016.stdout:1/387: getdents d2/de/d21/d3e 0 2024-08-01T06:56:16.446 INFO:tasks.workunit.client.0.smithi016.stdout:1/388: rmdir d2/d2f 39 2024-08-01T06:56:16.446 INFO:tasks.workunit.client.0.smithi016.stdout:1/389: truncate d2/de/f38 333730 0 2024-08-01T06:56:16.447 INFO:tasks.workunit.client.0.smithi016.stdout:1/390: fsync d2/d3/f34 0 2024-08-01T06:56:16.536 INFO:tasks.workunit.client.0.smithi016.stdout:0/218: sync 2024-08-01T06:56:16.542 INFO:tasks.workunit.client.0.smithi016.stdout:0/219: dwrite d10/f33 [0,4194304] 0 2024-08-01T06:56:16.543 INFO:tasks.workunit.client.0.smithi016.stdout:0/220: readlink d10/d11/d41/l2c 0 2024-08-01T06:56:16.544 INFO:tasks.workunit.client.0.smithi016.stdout:0/221: chown d10/d11/f14 17382 1 2024-08-01T06:56:16.548 INFO:tasks.workunit.client.0.smithi016.stdout:0/222: getdents d10/d11/d41 0 2024-08-01T06:56:16.554 INFO:tasks.workunit.client.0.smithi016.stdout:0/223: dwrite d10/d1c/f27 [0,4194304] 0 2024-08-01T06:56:16.557 INFO:tasks.workunit.client.0.smithi016.stdout:0/224: unlink d10/d1c/c3e 0 2024-08-01T06:56:16.665 INFO:tasks.workunit.client.0.smithi016.stdout:2/320: sync 2024-08-01T06:56:16.666 INFO:tasks.workunit.client.0.smithi016.stdout:7/321: sync 2024-08-01T06:56:16.666 INFO:tasks.workunit.client.0.smithi016.stdout:7/322: chown d7/db/d17/d72/d1c/d1d/d40 119763141 1 2024-08-01T06:56:16.671 INFO:tasks.workunit.client.0.smithi016.stdout:7/323: mknod d7/db/d17/d72/d22/c83 0 2024-08-01T06:56:16.673 INFO:tasks.workunit.client.0.smithi016.stdout:2/321: getdents d0/d16/d20/d2e 0 2024-08-01T06:56:16.681 INFO:tasks.workunit.client.0.smithi016.stdout:2/322: rename d0/d16/d20/l4e to d0/d16/d20/d2e/l6d 0 2024-08-01T06:56:16.683 INFO:tasks.workunit.client.0.smithi016.stdout:7/324: dwrite d7/db/d17/d72/d22/f27 [0,4194304] 0 2024-08-01T06:56:16.685 INFO:tasks.workunit.client.0.smithi016.stdout:7/325: fdatasync d7/ff 0 2024-08-01T06:56:16.689 INFO:tasks.workunit.client.0.smithi016.stdout:2/323: dwrite d0/f3e [0,4194304] 0 2024-08-01T06:56:16.699 INFO:tasks.workunit.client.0.smithi016.stdout:2/324: write d0/d8/f3c [1541345,81496] 0 2024-08-01T06:56:16.703 INFO:tasks.workunit.client.0.smithi016.stdout:2/325: dread d0/d19/f56 [0,4194304] 0 2024-08-01T06:56:16.706 INFO:tasks.workunit.client.0.smithi016.stdout:2/326: mknod d0/d8/d31/c6e 0 2024-08-01T06:56:16.835 INFO:tasks.workunit.client.0.smithi016.stdout:4/271: sync 2024-08-01T06:56:16.835 INFO:tasks.workunit.client.0.smithi016.stdout:9/198: sync 2024-08-01T06:56:16.835 INFO:tasks.workunit.client.0.smithi016.stdout:9/199: fsync d3/d9/df/f1c 0 2024-08-01T06:56:16.836 INFO:tasks.workunit.client.0.smithi016.stdout:4/272: mkdir d0/d17/d5a 0 2024-08-01T06:56:16.842 INFO:tasks.workunit.client.0.smithi016.stdout:9/200: dwrite d3/de/f35 [0,4194304] 0 2024-08-01T06:56:16.846 INFO:tasks.workunit.client.0.smithi016.stdout:9/201: symlink d3/d9/df/d38/l43 0 2024-08-01T06:56:16.850 INFO:tasks.workunit.client.0.smithi016.stdout:9/202: mknod d3/d9/db/c44 0 2024-08-01T06:56:16.853 INFO:tasks.workunit.client.0.smithi016.stdout:4/273: dread d0/f8 [0,4194304] 0 2024-08-01T06:56:16.856 INFO:tasks.workunit.client.0.smithi016.stdout:4/274: chown d0/d2/dc/d12/c4e 1 1 2024-08-01T06:56:16.857 INFO:tasks.workunit.client.0.smithi016.stdout:9/203: dwrite d3/de/f35 [0,4194304] 0 2024-08-01T06:56:16.863 INFO:tasks.workunit.client.0.smithi016.stdout:4/275: dwrite d0/d17/f2f [0,4194304] 0 2024-08-01T06:56:16.865 INFO:tasks.workunit.client.0.smithi016.stdout:9/204: creat d3/d9/db/d3e/d40/f45 x:0 0 0 2024-08-01T06:56:16.869 INFO:tasks.workunit.client.0.smithi016.stdout:9/205: fdatasync d3/de/f20 0 2024-08-01T06:56:16.871 INFO:tasks.workunit.client.0.smithi016.stdout:9/206: rmdir d3/d9 39 2024-08-01T06:56:16.876 INFO:tasks.workunit.client.0.smithi016.stdout:9/207: mkdir d3/d9/d46 0 2024-08-01T06:56:16.883 INFO:tasks.workunit.client.0.smithi016.stdout:4/276: dwrite d0/d17/d22/f35 [0,4194304] 0 2024-08-01T06:56:16.884 INFO:tasks.workunit.client.0.smithi016.stdout:4/277: chown d0/d17/d22/f31 918014439 1 2024-08-01T06:56:16.891 INFO:tasks.workunit.client.0.smithi016.stdout:4/278: rename d0/d17/d38/f4b to d0/d2/dc/d12/d29/d3c/f5b 0 2024-08-01T06:56:16.892 INFO:tasks.workunit.client.0.smithi016.stdout:9/208: dread d3/d4/f19 [0,4194304] 0 2024-08-01T06:56:16.899 INFO:tasks.workunit.client.0.smithi016.stdout:4/279: dwrite d0/d17/f39 [4194304,4194304] 0 2024-08-01T06:56:16.899 INFO:tasks.workunit.client.0.smithi016.stdout:9/209: dread d3/d32/f36 [0,4194304] 0 2024-08-01T06:56:16.905 INFO:tasks.workunit.client.0.smithi016.stdout:9/210: mknod d3/d9/df/c47 0 2024-08-01T06:56:16.905 INFO:tasks.workunit.client.0.smithi016.stdout:9/211: read - d3/d9/db/dc/f42 zero size 2024-08-01T06:56:16.909 INFO:tasks.workunit.client.0.smithi016.stdout:4/280: mknod d0/d2/dc/c5c 0 2024-08-01T06:56:16.910 INFO:tasks.workunit.client.0.smithi016.stdout:4/281: write d0/d2/d36/f56 [529788,18038] 0 2024-08-01T06:56:16.911 INFO:tasks.workunit.client.0.smithi016.stdout:9/212: unlink d3/d9/db/d3e/d40/f45 0 2024-08-01T06:56:16.911 INFO:tasks.workunit.client.0.smithi016.stdout:4/282: chown d0/d2/f1c 12 1 2024-08-01T06:56:16.916 INFO:tasks.workunit.client.0.smithi016.stdout:9/213: truncate d3/de/f15 4550433 0 2024-08-01T06:56:16.919 INFO:tasks.workunit.client.0.smithi016.stdout:9/214: mkdir d3/d9/d46/d48 0 2024-08-01T06:56:16.922 INFO:tasks.workunit.client.0.smithi016.stdout:9/215: symlink d3/d9/df/l49 0 2024-08-01T06:56:16.924 INFO:tasks.workunit.client.0.smithi016.stdout:9/216: creat d3/d9/d46/f4a x:0 0 0 2024-08-01T06:56:16.924 INFO:tasks.workunit.client.0.smithi016.stdout:4/283: dread d0/d2/f52 [0,4194304] 0 2024-08-01T06:56:16.925 INFO:tasks.workunit.client.0.smithi016.stdout:4/284: fdatasync d0/f23 0 2024-08-01T06:56:16.927 INFO:tasks.workunit.client.0.smithi016.stdout:4/285: write d0/d2/dc/f15 [2362648,31463] 0 2024-08-01T06:56:16.929 INFO:tasks.workunit.client.0.smithi016.stdout:4/286: write d0/d2/dc/f15 [70875,116380] 0 2024-08-01T06:56:16.931 INFO:tasks.workunit.client.0.smithi016.stdout:4/287: symlink d0/d2/l5d 0 2024-08-01T06:56:16.938 INFO:tasks.workunit.client.0.smithi016.stdout:4/288: dwrite d0/fb [4194304,4194304] 0 2024-08-01T06:56:16.938 INFO:tasks.workunit.client.0.smithi016.stdout:9/217: dread d3/d9/df/f3d [0,4194304] 0 2024-08-01T06:56:16.939 INFO:tasks.workunit.client.0.smithi016.stdout:9/218: fsync d3/d4/f34 0 2024-08-01T06:56:16.946 INFO:tasks.workunit.client.0.smithi016.stdout:4/289: creat d0/d2/dc/d12/d29/f5e x:0 0 0 2024-08-01T06:56:16.947 INFO:tasks.workunit.client.0.smithi016.stdout:4/290: write d0/d17/f2f [4756327,84381] 0 2024-08-01T06:56:16.952 INFO:tasks.workunit.client.0.smithi016.stdout:4/291: mknod d0/d17/d22/c5f 0 2024-08-01T06:56:16.953 INFO:tasks.workunit.client.0.smithi016.stdout:4/292: read d0/d2/dc/f2b [6446929,95952] 0 2024-08-01T06:56:16.953 INFO:tasks.workunit.client.0.smithi016.stdout:4/293: fdatasync d0/d2/dc/f34 0 2024-08-01T06:56:16.959 INFO:tasks.workunit.client.0.smithi016.stdout:4/294: creat d0/d2/dc/d12/d29/f60 x:0 0 0 2024-08-01T06:56:16.960 INFO:tasks.workunit.client.0.smithi016.stdout:4/295: dread - d0/d2/dc/d12/d29/d3c/f55 zero size 2024-08-01T06:56:16.961 INFO:tasks.workunit.client.0.smithi016.stdout:4/296: write d0/d2/dc/d12/d29/d3c/f47 [612016,11610] 0 2024-08-01T06:56:16.962 INFO:tasks.workunit.client.0.smithi016.stdout:4/297: write d0/d2/dc/f34 [456854,50232] 0 2024-08-01T06:56:16.966 INFO:tasks.workunit.client.0.smithi016.stdout:4/298: dread d0/d2/f2a [0,4194304] 0 2024-08-01T06:56:16.968 INFO:tasks.workunit.client.0.smithi016.stdout:4/299: mknod d0/d17/c61 0 2024-08-01T06:56:16.970 INFO:tasks.workunit.client.0.smithi016.stdout:4/300: mknod d0/d17/d22/d26/c62 0 2024-08-01T06:56:16.971 INFO:tasks.workunit.client.0.smithi016.stdout:4/301: write d0/d17/f39 [18239,117818] 0 2024-08-01T06:56:16.973 INFO:tasks.workunit.client.0.smithi016.stdout:4/302: truncate d0/d17/f32 1423750 0 2024-08-01T06:56:16.978 INFO:tasks.workunit.client.0.smithi016.stdout:4/303: getdents d0/d17/d22 0 2024-08-01T06:56:16.985 INFO:tasks.workunit.client.0.smithi016.stdout:4/304: dwrite d0/d2/dc/d12/d29/d3c/f5b [0,4194304] 0 2024-08-01T06:56:16.987 INFO:tasks.workunit.client.0.smithi016.stdout:4/305: mknod d0/d2/dc/d12/c63 0 2024-08-01T06:56:16.991 INFO:tasks.workunit.client.0.smithi016.stdout:4/306: mknod d0/d2/d36/c64 0 2024-08-01T06:56:16.999 INFO:tasks.workunit.client.0.smithi016.stdout:4/307: link d0/d2/dc/d12/d29/l46 d0/d17/d22/l65 0 2024-08-01T06:56:17.001 INFO:tasks.workunit.client.0.smithi016.stdout:4/308: rmdir d0/d2/d36 39 2024-08-01T06:56:17.007 INFO:tasks.workunit.client.0.smithi016.stdout:4/309: rmdir d0/d17/d5a 0 2024-08-01T06:56:17.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:16 smithi089 ceph-mon[36617]: pgmap v22: 65 pgs: 65 active+clean; 2.7 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 87 MiB/s rd, 279 MiB/s wr, 524 op/s 2024-08-01T06:56:17.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:16 smithi016 ceph-mon[29266]: pgmap v22: 65 pgs: 65 active+clean; 2.7 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 87 MiB/s rd, 279 MiB/s wr, 524 op/s 2024-08-01T06:56:17.370 INFO:tasks.workunit.client.0.smithi016.stdout:5/369: sync 2024-08-01T06:56:17.393 INFO:tasks.workunit.client.0.smithi016.stdout:5/370: dwrite d1/f5 [0,4194304] 0 2024-08-01T06:56:17.398 INFO:tasks.workunit.client.0.smithi016.stdout:5/371: fdatasync d1/d2/f31 0 2024-08-01T06:56:17.399 INFO:tasks.workunit.client.0.smithi016.stdout:5/372: stat d1/d12/d3e 0 2024-08-01T06:56:17.422 INFO:tasks.workunit.client.0.smithi016.stdout:5/373: dread d1/d2/d6/d9/d49/d57/f75 [0,4194304] 0 2024-08-01T06:56:17.424 INFO:tasks.workunit.client.0.smithi016.stdout:5/374: creat d1/d2/d6/d9/d49/d57/f82 x:0 0 0 2024-08-01T06:56:17.428 INFO:tasks.workunit.client.0.smithi016.stdout:5/375: write d1/d12/d3e/f66 [2308558,47838] 0 2024-08-01T06:56:17.436 INFO:tasks.workunit.client.0.smithi016.stdout:5/376: truncate d1/d2/d6/d9/d1b/f1f 3567095 0 2024-08-01T06:56:17.437 INFO:tasks.workunit.client.0.smithi016.stdout:5/377: write d1/d2/d23/d3a/f58 [941398,41011] 0 2024-08-01T06:56:17.441 INFO:tasks.workunit.client.0.smithi016.stdout:5/378: creat d1/f83 x:0 0 0 2024-08-01T06:56:17.442 INFO:tasks.workunit.client.0.smithi016.stdout:5/379: truncate d1/f83 768054 0 2024-08-01T06:56:17.443 INFO:tasks.workunit.client.0.smithi016.stdout:5/380: write d1/d2/d23/f33 [2133201,62992] 0 2024-08-01T06:56:17.447 INFO:tasks.workunit.client.0.smithi016.stdout:5/381: dread d1/d2/d6/d9/d19/f40 [0,4194304] 0 2024-08-01T06:56:17.450 INFO:tasks.workunit.client.0.smithi016.stdout:5/382: mknod d1/d2/d6/d5a/d65/c84 0 2024-08-01T06:56:17.459 INFO:tasks.workunit.client.0.smithi016.stdout:6/388: sync 2024-08-01T06:56:17.460 INFO:tasks.workunit.client.0.smithi016.stdout:5/383: dwrite d1/d2/d6/fd [0,4194304] 0 2024-08-01T06:56:17.465 INFO:tasks.workunit.client.0.smithi016.stdout:6/389: symlink d1/d8/l92 0 2024-08-01T06:56:17.466 INFO:tasks.workunit.client.0.smithi016.stdout:6/390: chown d1/d8/d1b/d48 6283 1 2024-08-01T06:56:17.466 INFO:tasks.workunit.client.0.smithi016.stdout:5/384: mknod d1/d2/d23/d3a/c85 0 2024-08-01T06:56:17.474 INFO:tasks.workunit.client.0.smithi016.stdout:6/391: dwrite d1/d8/f11 [4194304,4194304] 0 2024-08-01T06:56:17.478 INFO:tasks.workunit.client.0.smithi016.stdout:6/392: unlink d1/d8/d1b/d22/d71/f78 0 2024-08-01T06:56:17.479 INFO:tasks.workunit.client.0.smithi016.stdout:6/393: chown d1/d8/d1b/d22/d2d 61294175 1 2024-08-01T06:56:17.482 INFO:tasks.workunit.client.0.smithi016.stdout:5/385: dwrite d1/d2/f43 [0,4194304] 0 2024-08-01T06:56:17.483 INFO:tasks.workunit.client.0.smithi016.stdout:6/394: mkdir d1/d9/d60/d68/d79/d93 0 2024-08-01T06:56:17.485 INFO:tasks.workunit.client.0.smithi016.stdout:6/395: write d1/d9/d3f/f76 [350527,37485] 0 2024-08-01T06:56:17.485 INFO:tasks.workunit.client.0.smithi016.stdout:6/396: readlink d1/d41/l8d 0 2024-08-01T06:56:17.487 INFO:tasks.workunit.client.0.smithi016.stdout:5/386: unlink d1/d2/d23/c53 0 2024-08-01T06:56:17.490 INFO:tasks.workunit.client.0.smithi016.stdout:6/397: mkdir d1/d8/d94 0 2024-08-01T06:56:17.492 INFO:tasks.workunit.client.0.smithi016.stdout:5/387: creat d1/d2/d20/d68/f86 x:0 0 0 2024-08-01T06:56:17.493 INFO:tasks.workunit.client.0.smithi016.stdout:5/388: mknod d1/d2/d6/c87 0 2024-08-01T06:56:17.497 INFO:tasks.workunit.client.0.smithi016.stdout:5/389: dread d1/d2/d6/d9/d49/d57/f64 [0,4194304] 0 2024-08-01T06:56:17.508 INFO:tasks.workunit.client.0.smithi016.stdout:6/398: write d1/d8/f1a [478641,116463] 0 2024-08-01T06:56:17.511 INFO:tasks.workunit.client.0.smithi016.stdout:6/399: creat d1/d9/d60/d68/d79/f95 x:0 0 0 2024-08-01T06:56:17.516 INFO:tasks.workunit.client.0.smithi016.stdout:6/400: rmdir d1/d9/d60 39 2024-08-01T06:56:17.523 INFO:tasks.workunit.client.0.smithi016.stdout:6/401: dread d1/d8/f51 [0,4194304] 0 2024-08-01T06:56:17.525 INFO:tasks.workunit.client.0.smithi016.stdout:6/402: creat d1/d9/d3f/f96 x:0 0 0 2024-08-01T06:56:17.527 INFO:tasks.workunit.client.0.smithi016.stdout:6/403: getdents d1/d8/d94 0 2024-08-01T06:56:17.528 INFO:tasks.workunit.client.0.smithi016.stdout:6/404: creat d1/d8/d1b/d22/d3b/f97 x:0 0 0 2024-08-01T06:56:17.539 INFO:tasks.workunit.client.0.smithi016.stdout:6/405: dread d1/d8/d1b/d22/f29 [0,4194304] 0 2024-08-01T06:56:17.550 INFO:tasks.workunit.client.0.smithi016.stdout:6/406: creat d1/d8/d1b/d22/d36/f98 x:0 0 0 2024-08-01T06:56:17.553 INFO:tasks.workunit.client.0.smithi016.stdout:6/407: mkdir d1/d8/d1b/d22/d36/d7a/d99 0 2024-08-01T06:56:17.554 INFO:tasks.workunit.client.0.smithi016.stdout:6/408: chown d1/d8/l6b 10 1 2024-08-01T06:56:17.559 INFO:tasks.workunit.client.0.smithi016.stdout:6/409: getdents d1/d8/d34 0 2024-08-01T06:56:17.560 INFO:tasks.workunit.client.0.smithi016.stdout:6/410: creat d1/d8/d1b/d22/d2d/f9a x:0 0 0 2024-08-01T06:56:17.563 INFO:tasks.workunit.client.0.smithi016.stdout:6/411: creat d1/d8/d1b/d22/d36/f9b x:0 0 0 2024-08-01T06:56:17.566 INFO:tasks.workunit.client.0.smithi016.stdout:6/412: mknod d1/d8/d1b/d22/d3b/d67/c9c 0 2024-08-01T06:56:17.571 INFO:tasks.workunit.client.0.smithi016.stdout:6/413: link d1/l27 d1/d8/d1b/d22/d2d/l9d 0 2024-08-01T06:56:17.573 INFO:tasks.workunit.client.0.smithi016.stdout:6/414: mknod d1/d8/d1b/d48/c9e 0 2024-08-01T06:56:17.573 INFO:tasks.workunit.client.0.smithi016.stdout:6/415: fdatasync d1/d8/f1a 0 2024-08-01T06:56:17.575 INFO:tasks.workunit.client.0.smithi016.stdout:6/416: write d1/d8/d1b/d22/d36/f9b [334887,56552] 0 2024-08-01T06:56:17.576 INFO:tasks.workunit.client.0.smithi016.stdout:6/417: write d1/d41/f61 [1260033,82078] 0 2024-08-01T06:56:17.583 INFO:tasks.workunit.client.0.smithi016.stdout:6/418: dwrite d1/d9/f74 [0,4194304] 0 2024-08-01T06:56:17.584 INFO:tasks.workunit.client.0.smithi016.stdout:6/419: write d1/d8/d1b/d22/d36/f9b [503427,6530] 0 2024-08-01T06:56:17.586 INFO:tasks.workunit.client.0.smithi016.stdout:6/420: truncate d1/d8/d1b/d22/f29 4805666 0 2024-08-01T06:56:17.588 INFO:tasks.workunit.client.0.smithi016.stdout:6/421: stat d1/d8/d1b/d22/d2d/c31 0 2024-08-01T06:56:17.589 INFO:tasks.workunit.client.0.smithi016.stdout:6/422: chown d1/d43 1177891 1 2024-08-01T06:56:17.598 INFO:tasks.workunit.client.0.smithi016.stdout:6/423: dwrite d1/d9/d60/d68/f7b [0,4194304] 0 2024-08-01T06:56:17.601 INFO:tasks.workunit.client.0.smithi016.stdout:6/424: rmdir d1/d8/d1b/d22/d4e 39 2024-08-01T06:56:17.603 INFO:tasks.workunit.client.0.smithi016.stdout:6/425: rename d1 to d1/d9/d3f/d7d/d8b/d91/d9f 22 2024-08-01T06:56:17.605 INFO:tasks.workunit.client.0.smithi016.stdout:6/426: truncate d1/d8/d1b/d22/d36/f44 5067952 0 2024-08-01T06:56:17.614 INFO:tasks.workunit.client.0.smithi016.stdout:6/427: dwrite d1/d9/d3f/f63 [0,4194304] 0 2024-08-01T06:56:17.617 INFO:tasks.workunit.client.0.smithi016.stdout:6/428: fsync d1/d8/d1b/d22/d36/f6f 0 2024-08-01T06:56:17.623 INFO:tasks.workunit.client.0.smithi016.stdout:6/429: rename d1/d8/d34 to d1/d9/d60/da0 0 2024-08-01T06:56:17.631 INFO:tasks.workunit.client.0.smithi016.stdout:6/430: mknod d1/d9/d3f/d7d/d8a/ca1 0 2024-08-01T06:56:17.632 INFO:tasks.workunit.client.0.smithi016.stdout:6/431: dread - d1/d8/d1b/d22/d3b/f97 zero size 2024-08-01T06:56:17.640 INFO:tasks.workunit.client.0.smithi016.stdout:6/432: getdents d1/d8/d1b/d22/d3b/d67/d8f 0 2024-08-01T06:56:17.643 INFO:tasks.workunit.client.0.smithi016.stdout:6/433: mkdir d1/d9/d3f/d7d/d8a/da2 0 2024-08-01T06:56:17.644 INFO:tasks.workunit.client.0.smithi016.stdout:6/434: stat d1/d8/d1b/d22/d3b/d67/c9c 0 2024-08-01T06:56:17.650 INFO:tasks.workunit.client.0.smithi016.stdout:6/435: mkdir d1/d9/da3 0 2024-08-01T06:56:17.658 INFO:tasks.workunit.client.0.smithi016.stdout:6/436: dwrite d1/d9/f2e [0,4194304] 0 2024-08-01T06:56:17.662 INFO:tasks.workunit.client.0.smithi016.stdout:6/437: write d1/d8/d1b/d22/d36/f55 [2162973,71343] 0 2024-08-01T06:56:17.663 INFO:tasks.workunit.client.0.smithi016.stdout:6/438: rename d1/d9/d3f to d1/d9/d3f/d7d/d8b/da4 22 2024-08-01T06:56:17.670 INFO:tasks.workunit.client.0.smithi016.stdout:8/260: sync 2024-08-01T06:56:17.670 INFO:tasks.workunit.client.0.smithi016.stdout:3/221: sync 2024-08-01T06:56:17.671 INFO:tasks.workunit.client.0.smithi016.stdout:1/391: sync 2024-08-01T06:56:17.671 INFO:tasks.workunit.client.0.smithi016.stdout:0/225: sync 2024-08-01T06:56:17.673 INFO:tasks.workunit.client.0.smithi016.stdout:1/392: write d2/d3/d1c/f2e [1676386,116954] 0 2024-08-01T06:56:17.675 INFO:tasks.workunit.client.0.smithi016.stdout:3/222: creat d9/da/df/d12/d20/d3c/f52 x:0 0 0 2024-08-01T06:56:17.677 INFO:tasks.workunit.client.0.smithi016.stdout:8/261: creat d5/d8/f58 x:0 0 0 2024-08-01T06:56:17.680 INFO:tasks.workunit.client.0.smithi016.stdout:0/226: creat d10/f45 x:0 0 0 2024-08-01T06:56:17.682 INFO:tasks.workunit.client.0.smithi016.stdout:6/439: dread d1/d43/f6d [0,4194304] 0 2024-08-01T06:56:17.683 INFO:tasks.workunit.client.0.smithi016.stdout:1/393: fsync d2/de/f82 0 2024-08-01T06:56:17.686 INFO:tasks.workunit.client.0.smithi016.stdout:3/223: rmdir d9/d1c 39 2024-08-01T06:56:17.686 INFO:tasks.workunit.client.0.smithi016.stdout:8/262: dwrite d5/d1c/f4f [4194304,4194304] 0 2024-08-01T06:56:17.687 INFO:tasks.workunit.client.0.smithi016.stdout:4/310: sync 2024-08-01T06:56:17.689 INFO:tasks.workunit.client.0.smithi016.stdout:2/327: sync 2024-08-01T06:56:17.689 INFO:tasks.workunit.client.0.smithi016.stdout:7/326: sync 2024-08-01T06:56:17.689 INFO:tasks.workunit.client.0.smithi016.stdout:9/219: sync 2024-08-01T06:56:17.689 INFO:tasks.workunit.client.0.smithi016.stdout:5/390: sync 2024-08-01T06:56:17.691 INFO:tasks.workunit.client.0.smithi016.stdout:0/227: creat d10/d1c/f46 x:0 0 0 2024-08-01T06:56:17.691 INFO:tasks.workunit.client.0.smithi016.stdout:2/328: dread - d0/d19/f4d zero size 2024-08-01T06:56:17.692 INFO:tasks.workunit.client.0.smithi016.stdout:6/440: unlink d1/d9/c80 0 2024-08-01T06:56:17.698 INFO:tasks.workunit.client.0.smithi016.stdout:0/228: truncate d10/d11/d41/f2a 459496 0 2024-08-01T06:56:17.701 INFO:tasks.workunit.client.0.smithi016.stdout:7/327: readlink d7/db/d17/d72/d1e/l31 0 2024-08-01T06:56:17.702 INFO:tasks.workunit.client.0.smithi016.stdout:0/229: dread - d10/d11/f43 zero size 2024-08-01T06:56:17.704 INFO:tasks.workunit.client.0.smithi016.stdout:4/311: mknod d0/d2/dc/d12/d29/d3c/c66 0 2024-08-01T06:56:17.704 INFO:tasks.workunit.client.0.smithi016.stdout:3/224: dwrite d9/d3e/f36 [4194304,4194304] 0 2024-08-01T06:56:17.706 INFO:tasks.workunit.client.0.smithi016.stdout:5/391: rename d1/d2/d20/f6c to d1/d2/d23/f88 0 2024-08-01T06:56:17.708 INFO:tasks.workunit.client.0.smithi016.stdout:8/263: mkdir d5/d8/d1a/d59 0 2024-08-01T06:56:17.713 INFO:tasks.workunit.client.0.smithi016.stdout:3/225: write d9/da/f47 [275859,18954] 0 2024-08-01T06:56:17.713 INFO:tasks.workunit.client.0.smithi016.stdout:2/329: dread d0/f40 [0,4194304] 0 2024-08-01T06:56:17.714 INFO:tasks.workunit.client.0.smithi016.stdout:6/441: dwrite d1/d9/d60/da0/f37 [0,4194304] 0 2024-08-01T06:56:17.716 INFO:tasks.workunit.client.0.smithi016.stdout:9/220: fsync d3/f28 0 2024-08-01T06:56:17.721 INFO:tasks.workunit.client.0.smithi016.stdout:4/312: mkdir d0/d17/d67 0 2024-08-01T06:56:17.722 INFO:tasks.workunit.client.0.smithi016.stdout:0/230: write d10/f17 [4011583,19694] 0 2024-08-01T06:56:17.723 INFO:tasks.workunit.client.0.smithi016.stdout:3/226: write d9/da/f47 [184158,24357] 0 2024-08-01T06:56:17.723 INFO:tasks.workunit.client.0.smithi016.stdout:6/442: chown d1/d41/f52 148185053 1 2024-08-01T06:56:17.723 INFO:tasks.workunit.client.0.smithi016.stdout:7/328: symlink d7/db/d17/d72/d1e/d26/d63/l84 0 2024-08-01T06:56:17.727 INFO:tasks.workunit.client.0.smithi016.stdout:2/330: symlink d0/d16/d20/l6f 0 2024-08-01T06:56:17.727 INFO:tasks.workunit.client.0.smithi016.stdout:1/394: dwrite d2/de/d32/d43/f54 [0,4194304] 0 2024-08-01T06:56:17.730 INFO:tasks.workunit.client.0.smithi016.stdout:8/264: dwrite d5/d8/f58 [0,4194304] 0 2024-08-01T06:56:17.733 INFO:tasks.workunit.client.0.smithi016.stdout:8/265: chown d5/dc/f31 45 1 2024-08-01T06:56:17.734 INFO:tasks.workunit.client.0.smithi016.stdout:1/395: write d2/d3/d1a/d22/f64 [164584,94094] 0 2024-08-01T06:56:17.737 INFO:tasks.workunit.client.0.smithi016.stdout:0/231: write d10/d11/d41/f2f [817578,127729] 0 2024-08-01T06:56:17.739 INFO:tasks.workunit.client.0.smithi016.stdout:6/443: symlink d1/d8/d1b/d48/la5 0 2024-08-01T06:56:17.739 INFO:tasks.workunit.client.0.smithi016.stdout:4/313: mkdir d0/d2/d68 0 2024-08-01T06:56:17.742 INFO:tasks.workunit.client.0.smithi016.stdout:1/396: dread d2/d3/d41/f47 [0,4194304] 0 2024-08-01T06:56:17.742 INFO:tasks.workunit.client.0.smithi016.stdout:6/444: write d1/d9/d60/f84 [629563,117083] 0 2024-08-01T06:56:17.742 INFO:tasks.workunit.client.0.smithi016.stdout:2/331: rename d0/d8/d31/c32 to d0/d8/d22/c70 0 2024-08-01T06:56:17.744 INFO:tasks.workunit.client.0.smithi016.stdout:7/329: rename d7 to d7/db/d17/d72/d1e/d26/d2a/d85 22 2024-08-01T06:56:17.744 INFO:tasks.workunit.client.0.smithi016.stdout:6/445: write d1/d9/d60/d68/d79/f95 [769614,34166] 0 2024-08-01T06:56:17.746 INFO:tasks.workunit.client.0.smithi016.stdout:5/392: getdents d1/d2/d23/d3a 0 2024-08-01T06:56:17.747 INFO:tasks.workunit.client.0.smithi016.stdout:6/446: fdatasync d1/d9/d3f/f63 0 2024-08-01T06:56:17.749 INFO:tasks.workunit.client.0.smithi016.stdout:6/447: write d1/d9/f74 [2927637,4706] 0 2024-08-01T06:56:17.750 INFO:tasks.workunit.client.0.smithi016.stdout:4/314: readlink d0/d17/d22/d26/l58 0 2024-08-01T06:56:17.751 INFO:tasks.workunit.client.0.smithi016.stdout:3/227: write f3 [9869593,127562] 0 2024-08-01T06:56:17.754 INFO:tasks.workunit.client.0.smithi016.stdout:1/397: chown d2/d2f 5163 1 2024-08-01T06:56:17.756 INFO:tasks.workunit.client.0.smithi016.stdout:2/332: rename d0/l3a to d0/d16/l71 0 2024-08-01T06:56:17.757 INFO:tasks.workunit.client.0.smithi016.stdout:2/333: fsync d0/d8/d31/f53 0 2024-08-01T06:56:17.759 INFO:tasks.workunit.client.0.smithi016.stdout:9/221: link d3/d9/df/d16/f1e d3/d9/db/d3e/d40/f4b 0 2024-08-01T06:56:17.760 INFO:tasks.workunit.client.0.smithi016.stdout:9/222: chown d3/de/f17 494 1 2024-08-01T06:56:17.765 INFO:tasks.workunit.client.0.smithi016.stdout:8/266: dread d5/dc/f17 [0,4194304] 0 2024-08-01T06:56:17.766 INFO:tasks.workunit.client.0.smithi016.stdout:8/267: dread - d5/d1c/f4c zero size 2024-08-01T06:56:17.768 INFO:tasks.workunit.client.0.smithi016.stdout:3/228: rmdir d9/da/df/d12/d20 39 2024-08-01T06:56:17.768 INFO:tasks.workunit.client.0.smithi016.stdout:0/232: dread d10/f2e [0,4194304] 0 2024-08-01T06:56:17.770 INFO:tasks.workunit.client.0.smithi016.stdout:4/315: dwrite d0/d2/d36/f56 [0,4194304] 0 2024-08-01T06:56:17.770 INFO:tasks.workunit.client.0.smithi016.stdout:1/398: creat d2/d3/d41/d49/f83 x:0 0 0 2024-08-01T06:56:17.771 INFO:tasks.workunit.client.0.smithi016.stdout:3/229: write d9/da/f47 [484983,44283] 0 2024-08-01T06:56:17.772 INFO:tasks.workunit.client.0.smithi016.stdout:4/316: truncate d0/d2/dc/f34 550394 0 2024-08-01T06:56:17.776 INFO:tasks.workunit.client.0.smithi016.stdout:7/330: mknod d7/db/d17/d72/d22/d77/c86 0 2024-08-01T06:56:17.778 INFO:tasks.workunit.client.0.smithi016.stdout:9/223: creat d3/d9/df/d38/f4c x:0 0 0 2024-08-01T06:56:17.779 INFO:tasks.workunit.client.0.smithi016.stdout:7/331: write d7/db/d17/d72/d1e/d26/f32 [4752603,24497] 0 2024-08-01T06:56:17.780 INFO:tasks.workunit.client.0.smithi016.stdout:6/448: mknod d1/d8/d1b/d22/ca6 0 2024-08-01T06:56:17.785 INFO:tasks.workunit.client.0.smithi016.stdout:3/230: dread d9/da/df/d12/f42 [0,4194304] 0 2024-08-01T06:56:17.786 INFO:tasks.workunit.client.0.smithi016.stdout:3/231: readlink d9/da/df/l11 0 2024-08-01T06:56:17.789 INFO:tasks.workunit.client.0.smithi016.stdout:4/317: rename d0/d2/dc/d12/d29/d3c/f47 to d0/d2/dc/d12/d29/d3c/f69 0 2024-08-01T06:56:17.791 INFO:tasks.workunit.client.0.smithi016.stdout:0/233: write d10/f28 [2654647,23807] 0 2024-08-01T06:56:17.794 INFO:tasks.workunit.client.0.smithi016.stdout:4/318: dread d0/f8 [0,4194304] 0 2024-08-01T06:56:17.795 INFO:tasks.workunit.client.0.smithi016.stdout:8/268: creat d5/d8/d1a/d59/f5a x:0 0 0 2024-08-01T06:56:17.797 INFO:tasks.workunit.client.0.smithi016.stdout:2/334: write d0/d8/d31/f61 [35195,80892] 0 2024-08-01T06:56:17.801 INFO:tasks.workunit.client.0.smithi016.stdout:3/232: read - d9/da/df/d12/d20/d3c/f52 zero size 2024-08-01T06:56:17.802 INFO:tasks.workunit.client.0.smithi016.stdout:5/393: getdents d1/d2/d6/d9/d49 0 2024-08-01T06:56:17.803 INFO:tasks.workunit.client.0.smithi016.stdout:3/233: chown d9/da/df/c16 28332225 1 2024-08-01T06:56:17.804 INFO:tasks.workunit.client.0.smithi016.stdout:2/335: dwrite d0/d16/f50 [0,4194304] 0 2024-08-01T06:56:17.805 INFO:tasks.workunit.client.0.smithi016.stdout:9/224: creat d3/d32/f4d x:0 0 0 2024-08-01T06:56:17.806 INFO:tasks.workunit.client.0.smithi016.stdout:0/234: unlink d10/d11/d41/l32 0 2024-08-01T06:56:17.806 INFO:tasks.workunit.client.0.smithi016.stdout:2/336: write d0/d8/d1b/f1c [515490,81100] 0 2024-08-01T06:56:17.808 INFO:tasks.workunit.client.0.smithi016.stdout:0/235: chown fd 2883 1 2024-08-01T06:56:17.810 INFO:tasks.workunit.client.0.smithi016.stdout:4/319: write d0/d17/d22/f31 [5224934,36934] 0 2024-08-01T06:56:17.813 INFO:tasks.workunit.client.0.smithi016.stdout:1/399: creat d2/d3/f84 x:0 0 0 2024-08-01T06:56:17.816 INFO:tasks.workunit.client.0.smithi016.stdout:3/234: mkdir d9/da/df/d53 0 2024-08-01T06:56:17.817 INFO:tasks.workunit.client.0.smithi016.stdout:5/394: creat d1/d2/d6/d9/d49/d57/f89 x:0 0 0 2024-08-01T06:56:17.819 INFO:tasks.workunit.client.0.smithi016.stdout:1/400: fdatasync d2/d3/d1a/d22/f3d 0 2024-08-01T06:56:17.821 INFO:tasks.workunit.client.0.smithi016.stdout:2/337: dwrite d0/d19/f58 [0,4194304] 0 2024-08-01T06:56:17.821 INFO:tasks.workunit.client.0.smithi016.stdout:7/332: getdents d7/db/d17/d72/d1e/d26 0 2024-08-01T06:56:17.821 INFO:tasks.workunit.client.0.smithi016.stdout:4/320: mknod d0/d17/d22/c6a 0 2024-08-01T06:56:17.823 INFO:tasks.workunit.client.0.smithi016.stdout:8/269: dread d5/dc/f36 [0,4194304] 0 2024-08-01T06:56:17.823 INFO:tasks.workunit.client.0.smithi016.stdout:3/235: dread - d9/da/df/d12/d20/d3c/f52 zero size 2024-08-01T06:56:17.823 INFO:tasks.workunit.client.0.smithi016.stdout:4/321: stat d0/d2/f11 0 2024-08-01T06:56:17.825 INFO:tasks.workunit.client.0.smithi016.stdout:7/333: readlink d7/db/d17/d72/l48 0 2024-08-01T06:56:17.826 INFO:tasks.workunit.client.0.smithi016.stdout:4/322: dread - d0/d2/dc/d12/d29/d3c/f55 zero size 2024-08-01T06:56:17.827 INFO:tasks.workunit.client.0.smithi016.stdout:2/338: mkdir d0/d16/d72 0 2024-08-01T06:56:17.830 INFO:tasks.workunit.client.0.smithi016.stdout:6/449: truncate d1/d8/d1b/f72 97423 0 2024-08-01T06:56:17.830 INFO:tasks.workunit.client.0.smithi016.stdout:2/339: read d0/d8/f3c [1328911,104867] 0 2024-08-01T06:56:17.831 INFO:tasks.workunit.client.0.smithi016.stdout:8/270: mknod d5/c5b 0 2024-08-01T06:56:17.836 INFO:tasks.workunit.client.0.smithi016.stdout:1/401: fdatasync d2/d3/d1a/d22/f6c 0 2024-08-01T06:56:17.837 INFO:tasks.workunit.client.0.smithi016.stdout:9/225: write d3/f28 [574996,112790] 0 2024-08-01T06:56:17.841 INFO:tasks.workunit.client.0.smithi016.stdout:7/334: unlink d7/db/d1a/d39/f29 0 2024-08-01T06:56:17.847 INFO:tasks.workunit.client.0.smithi016.stdout:2/340: dwrite d0/d16/f64 [0,4194304] 0 2024-08-01T06:56:17.857 INFO:tasks.workunit.client.0.smithi016.stdout:1/402: dwrite d2/de/d21/f5b [0,4194304] 0 2024-08-01T06:56:17.859 INFO:tasks.workunit.client.0.smithi016.stdout:5/395: dread d1/d2/d6/d9/d1b/f28 [0,4194304] 0 2024-08-01T06:56:17.864 INFO:tasks.workunit.client.0.smithi016.stdout:5/396: truncate d1/d2/d20/d68/f86 753908 0 2024-08-01T06:56:17.866 INFO:tasks.workunit.client.0.smithi016.stdout:4/323: link d0/d2/f2a d0/d17/d22/f6b 0 2024-08-01T06:56:17.868 INFO:tasks.workunit.client.0.smithi016.stdout:9/226: dread d3/d9/db/d3e/d40/f4b [0,4194304] 0 2024-08-01T06:56:17.870 INFO:tasks.workunit.client.0.smithi016.stdout:2/341: write d0/d16/d20/f57 [44397,119071] 0 2024-08-01T06:56:17.873 INFO:tasks.workunit.client.0.smithi016.stdout:3/236: write d9/da/df/d12/d20/f26 [2353496,78141] 0 2024-08-01T06:56:17.873 INFO:tasks.workunit.client.0.smithi016.stdout:6/450: write d1/d8/f51 [2046530,83347] 0 2024-08-01T06:56:17.875 INFO:tasks.workunit.client.0.smithi016.stdout:8/271: chown d5/d1c/l28 24 1 2024-08-01T06:56:17.879 INFO:tasks.workunit.client.0.smithi016.stdout:0/236: rename d10/d11/d41/c3c to d10/d11/c47 0 2024-08-01T06:56:17.882 INFO:tasks.workunit.client.0.smithi016.stdout:5/397: dread d1/d2/d6/d9/f34 [0,4194304] 0 2024-08-01T06:56:17.883 INFO:tasks.workunit.client.0.smithi016.stdout:6/451: chown d1/d8/c4f 3 1 2024-08-01T06:56:17.884 INFO:tasks.workunit.client.0.smithi016.stdout:2/342: dwrite d0/d8/f11 [0,4194304] 0 2024-08-01T06:56:17.887 INFO:tasks.workunit.client.0.smithi016.stdout:2/343: chown d0/d8/d22/f63 123037293 1 2024-08-01T06:56:17.889 INFO:tasks.workunit.client.0.smithi016.stdout:8/272: write d5/d8/d1a/d24/d48/f56 [810383,105166] 0 2024-08-01T06:56:17.893 INFO:tasks.workunit.client.0.smithi016.stdout:7/335: rename d7/db/d17/d72/l68 to d7/db/d17/d72/d1e/d26/d63/l87 0 2024-08-01T06:56:17.895 INFO:tasks.workunit.client.0.smithi016.stdout:7/336: write d7/db/f28 [1618950,3670] 0 2024-08-01T06:56:17.895 INFO:tasks.workunit.client.0.smithi016.stdout:9/227: write d3/f1d [317793,11330] 0 2024-08-01T06:56:17.896 INFO:tasks.workunit.client.0.smithi016.stdout:9/228: chown d3/de 5 1 2024-08-01T06:56:17.898 INFO:tasks.workunit.client.0.smithi016.stdout:3/237: mknod d9/da/df/d12/c54 0 2024-08-01T06:56:17.899 INFO:tasks.workunit.client.0.smithi016.stdout:4/324: link d0/d2/dc/f34 d0/d2/dc/d12/d29/f6c 0 2024-08-01T06:56:17.900 INFO:tasks.workunit.client.0.smithi016.stdout:3/238: write f3 [3735513,41811] 0 2024-08-01T06:56:17.902 INFO:tasks.workunit.client.0.smithi016.stdout:2/344: mknod d0/d16/d20/d2e/d3b/d45/c73 0 2024-08-01T06:56:17.902 INFO:tasks.workunit.client.0.smithi016.stdout:4/325: write d0/d17/f30 [4122682,68774] 0 2024-08-01T06:56:17.905 INFO:tasks.workunit.client.0.smithi016.stdout:0/237: truncate f6 966725 0 2024-08-01T06:56:17.906 INFO:tasks.workunit.client.0.smithi016.stdout:5/398: symlink d1/d2/d6/d9/d19/d7a/l8a 0 2024-08-01T06:56:17.909 INFO:tasks.workunit.client.0.smithi016.stdout:7/337: dwrite d7/db/d17/d72/d1e/d26/d2a/f4b [0,4194304] 0 2024-08-01T06:56:17.913 INFO:tasks.workunit.client.0.smithi016.stdout:9/229: mkdir d3/d9/db/d3e/d40/d4e 0 2024-08-01T06:56:17.914 INFO:tasks.workunit.client.0.smithi016.stdout:8/273: fdatasync d5/f1b 0 2024-08-01T06:56:17.919 INFO:tasks.workunit.client.0.smithi016.stdout:3/239: unlink d9/da/df/l11 0 2024-08-01T06:56:17.923 INFO:tasks.workunit.client.0.smithi016.stdout:2/345: mkdir d0/d8/d1b/d74 0 2024-08-01T06:56:17.925 INFO:tasks.workunit.client.0.smithi016.stdout:7/338: dread d7/db/d1a/f2e [0,4194304] 0 2024-08-01T06:56:17.927 INFO:tasks.workunit.client.0.smithi016.stdout:5/399: rmdir d1/d2 39 2024-08-01T06:56:17.929 INFO:tasks.workunit.client.0.smithi016.stdout:7/339: write d7/db/d17/d72/d1e/d26/f32 [2149029,45010] 0 2024-08-01T06:56:17.931 INFO:tasks.workunit.client.0.smithi016.stdout:2/346: dwrite d0/d16/f44 [0,4194304] 0 2024-08-01T06:56:17.980 INFO:tasks.workunit.client.0.smithi016.stdout:9/230: creat d3/d9/df/d38/f4f x:0 0 0 2024-08-01T06:56:17.980 INFO:tasks.workunit.client.0.smithi016.stdout:8/274: creat d5/d8/d1a/d59/f5c x:0 0 0 2024-08-01T06:56:17.981 INFO:tasks.workunit.client.0.smithi016.stdout:8/275: chown d5/d1c 7050 1 2024-08-01T06:56:17.983 INFO:tasks.workunit.client.0.smithi016.stdout:2/347: dread d0/d16/f64 [0,4194304] 0 2024-08-01T06:56:17.988 INFO:tasks.workunit.client.0.smithi016.stdout:3/240: dread d9/da/df/d12/d20/f26 [0,4194304] 0 2024-08-01T06:56:18.025 INFO:tasks.workunit.client.0.smithi016.stdout:5/400: dread - d1/d12/d3e/f42 zero size 2024-08-01T06:56:18.027 INFO:tasks.workunit.client.0.smithi016.stdout:3/241: dwrite d9/da/df/d12/f15 [4194304,4194304] 0 2024-08-01T06:56:18.034 INFO:tasks.workunit.client.0.smithi016.stdout:8/276: dread - d5/dc/f4b zero size 2024-08-01T06:56:18.036 INFO:tasks.workunit.client.0.smithi016.stdout:4/326: rename d0/f8 to d0/d2/f6d 0 2024-08-01T06:56:18.037 INFO:tasks.workunit.client.0.smithi016.stdout:4/327: chown d0/d2/f25 0 1 2024-08-01T06:56:18.039 INFO:tasks.workunit.client.0.smithi016.stdout:2/348: creat d0/d8/d31/d5e/f75 x:0 0 0 2024-08-01T06:56:18.047 INFO:tasks.workunit.client.0.smithi016.stdout:0/238: rename d10/d11/d41/l2c to d10/d11/d37/l48 0 2024-08-01T06:56:18.050 INFO:tasks.workunit.client.0.smithi016.stdout:9/231: dwrite d3/d9/df/d16/f30 [0,4194304] 0 2024-08-01T06:56:18.051 INFO:tasks.workunit.client.0.smithi016.stdout:2/349: dread d0/d19/f2f [0,4194304] 0 2024-08-01T06:56:18.052 INFO:tasks.workunit.client.0.smithi016.stdout:2/350: stat d0/d8/f3c 0 2024-08-01T06:56:18.055 INFO:tasks.workunit.client.0.smithi016.stdout:5/401: write d1/d2/d6/d9/d1b/f1f [3429715,26713] 0 2024-08-01T06:56:18.059 INFO:tasks.workunit.client.0.smithi016.stdout:9/232: dread d3/de/f35 [0,4194304] 0 2024-08-01T06:56:18.060 INFO:tasks.workunit.client.0.smithi016.stdout:0/239: dwrite d10/d11/f14 [0,4194304] 0 2024-08-01T06:56:18.060 INFO:tasks.workunit.client.0.smithi016.stdout:8/277: rename d5/dc/l27 to d5/d8/d1a/d24/l5d 0 2024-08-01T06:56:18.061 INFO:tasks.workunit.client.0.smithi016.stdout:2/351: mknod d0/d16/d20/d2e/d3b/c76 0 2024-08-01T06:56:18.062 INFO:tasks.workunit.client.0.smithi016.stdout:0/240: chown d10/d1c/l31 228 1 2024-08-01T06:56:18.063 INFO:tasks.workunit.client.0.smithi016.stdout:5/402: chown d1/d2/d6/d9/c14 832587280 1 2024-08-01T06:56:18.065 INFO:tasks.workunit.client.0.smithi016.stdout:2/352: unlink d0/d8/c23 0 2024-08-01T06:56:18.067 INFO:tasks.workunit.client.0.smithi016.stdout:9/233: mkdir d3/d9/db/d3e/d50 0 2024-08-01T06:56:18.067 INFO:tasks.workunit.client.0.smithi016.stdout:5/403: dread d1/f5 [0,4194304] 0 2024-08-01T06:56:18.068 INFO:tasks.workunit.client.0.smithi016.stdout:8/278: mknod d5/d8/c5e 0 2024-08-01T06:56:18.070 INFO:tasks.workunit.client.0.smithi016.stdout:2/353: dread d0/d16/f41 [0,4194304] 0 2024-08-01T06:56:18.070 INFO:tasks.workunit.client.0.smithi016.stdout:0/241: write d10/f2e [3899693,8358] 0 2024-08-01T06:56:18.071 INFO:tasks.workunit.client.0.smithi016.stdout:8/279: fdatasync d5/d8/d1a/d24/f26 0 2024-08-01T06:56:18.073 INFO:tasks.workunit.client.0.smithi016.stdout:5/404: dread d1/d2/d6/d9/d49/d57/f64 [0,4194304] 0 2024-08-01T06:56:18.075 INFO:tasks.workunit.client.0.smithi016.stdout:9/234: dread d3/d9/df/d16/f1e [0,4194304] 0 2024-08-01T06:56:18.081 INFO:tasks.workunit.client.0.smithi016.stdout:2/354: symlink d0/d8/d6b/l77 0 2024-08-01T06:56:18.083 INFO:tasks.workunit.client.0.smithi016.stdout:8/280: rename d5/l15 to d5/dc/l5f 0 2024-08-01T06:56:18.084 INFO:tasks.workunit.client.0.smithi016.stdout:5/405: unlink d1/d2/d6/d9/la 0 2024-08-01T06:56:18.085 INFO:tasks.workunit.client.0.smithi016.stdout:0/242: creat d10/f49 x:0 0 0 2024-08-01T06:56:18.087 INFO:tasks.workunit.client.0.smithi016.stdout:2/355: creat d0/d19/f78 x:0 0 0 2024-08-01T06:56:18.090 INFO:tasks.workunit.client.0.smithi016.stdout:5/406: write d1/d2/d23/f88 [342105,28682] 0 2024-08-01T06:56:18.094 INFO:tasks.workunit.client.0.smithi016.stdout:0/243: symlink d10/l4a 0 2024-08-01T06:56:18.095 INFO:tasks.workunit.client.0.smithi016.stdout:9/235: dread d3/d9/db/dc/f27 [0,4194304] 0 2024-08-01T06:56:18.098 INFO:tasks.workunit.client.0.smithi016.stdout:8/281: write d5/dc/f31 [225413,33455] 0 2024-08-01T06:56:18.100 INFO:tasks.workunit.client.0.smithi016.stdout:5/407: dread d1/d12/d3e/f66 [0,4194304] 0 2024-08-01T06:56:18.104 INFO:tasks.workunit.client.0.smithi016.stdout:9/236: link d3/de/f35 d3/d9/db/dc/d33/f51 0 2024-08-01T06:56:18.107 INFO:tasks.workunit.client.0.smithi016.stdout:2/356: getdents d0 0 2024-08-01T06:56:18.108 INFO:tasks.workunit.client.0.smithi016.stdout:8/282: mkdir d5/d8/d1a/d24/d48/d60 0 2024-08-01T06:56:18.109 INFO:tasks.workunit.client.0.smithi016.stdout:5/408: dwrite d1/d2/f48 [0,4194304] 0 2024-08-01T06:56:18.112 INFO:tasks.workunit.client.0.smithi016.stdout:2/357: write d0/d19/f2f [752652,93655] 0 2024-08-01T06:56:18.117 INFO:tasks.workunit.client.0.smithi016.stdout:5/409: rename d1/d2/d23/f33 to d1/d2/d23/d3a/f8b 0 2024-08-01T06:56:18.118 INFO:tasks.workunit.client.0.smithi016.stdout:0/244: link d10/d11/l38 d10/l4b 0 2024-08-01T06:56:18.119 INFO:tasks.workunit.client.0.smithi016.stdout:9/237: mknod d3/d9/db/dc/d33/c52 0 2024-08-01T06:56:18.120 INFO:tasks.workunit.client.0.smithi016.stdout:9/238: chown d3/d9/db/d3e/d40/f4b 0 1 2024-08-01T06:56:18.122 INFO:tasks.workunit.client.0.smithi016.stdout:0/245: symlink d10/d1c/l4c 0 2024-08-01T06:56:18.122 INFO:tasks.workunit.client.0.smithi016.stdout:0/246: chown d10/c1b 656 1 2024-08-01T06:56:18.125 INFO:tasks.workunit.client.0.smithi016.stdout:8/283: creat d5/f61 x:0 0 0 2024-08-01T06:56:18.128 INFO:tasks.workunit.client.0.smithi016.stdout:5/410: mkdir d1/d12/d8c 0 2024-08-01T06:56:18.130 INFO:tasks.workunit.client.0.smithi016.stdout:5/411: write d1/d2/d6/fd [4396946,122774] 0 2024-08-01T06:56:18.135 INFO:tasks.workunit.client.0.smithi016.stdout:2/358: truncate d0/d19/f2f 631870 0 2024-08-01T06:56:18.136 INFO:tasks.workunit.client.0.smithi016.stdout:2/359: dread - d0/d16/d20/f43 zero size 2024-08-01T06:56:18.137 INFO:tasks.workunit.client.0.smithi016.stdout:8/284: symlink d5/d8/d1a/d24/d48/l62 0 2024-08-01T06:56:18.138 INFO:tasks.workunit.client.0.smithi016.stdout:9/239: write d3/de/f13 [377891,125308] 0 2024-08-01T06:56:18.138 INFO:tasks.workunit.client.0.smithi016.stdout:2/360: read d0/d19/f58 [131592,14423] 0 2024-08-01T06:56:18.138 INFO:tasks.workunit.client.0.smithi016.stdout:0/247: creat d10/d11/f4d x:0 0 0 2024-08-01T06:56:18.139 INFO:tasks.workunit.client.0.smithi016.stdout:0/248: chown d10/d11 6 1 2024-08-01T06:56:18.141 INFO:tasks.workunit.client.0.smithi016.stdout:8/285: readlink d5/d1c/l1f 0 2024-08-01T06:56:18.143 INFO:tasks.workunit.client.0.smithi016.stdout:9/240: readlink d3/d9/db/l31 0 2024-08-01T06:56:18.150 INFO:tasks.workunit.client.0.smithi016.stdout:8/286: dwrite d5/d8/d1a/f54 [0,4194304] 0 2024-08-01T06:56:18.150 INFO:tasks.workunit.client.0.smithi016.stdout:9/241: rename d3/d9/df/c47 to d3/d9/db/dc/c53 0 2024-08-01T06:56:18.159 INFO:tasks.workunit.client.0.smithi016.stdout:8/287: rename d5/d8/d32 to d5/d8/d1a/d24/d48/d60/d63 0 2024-08-01T06:56:18.161 INFO:tasks.workunit.client.0.smithi016.stdout:9/242: truncate d3/d9/df/d16/f2b 2226111 0 2024-08-01T06:56:18.162 INFO:tasks.workunit.client.0.smithi016.stdout:0/249: dread d10/d11/d41/f2b [0,4194304] 0 2024-08-01T06:56:18.165 INFO:tasks.workunit.client.0.smithi016.stdout:2/361: link d0/d16/d20/l6f d0/d8/d1b/d74/l79 0 2024-08-01T06:56:18.165 INFO:tasks.workunit.client.0.smithi016.stdout:2/362: stat d0/d16/f2d 0 2024-08-01T06:56:18.169 INFO:tasks.workunit.client.0.smithi016.stdout:8/288: symlink d5/d8/d1a/d24/d48/d60/d63/l64 0 2024-08-01T06:56:18.172 INFO:tasks.workunit.client.0.smithi016.stdout:2/363: symlink d0/d8/d6b/l7a 0 2024-08-01T06:56:18.174 INFO:tasks.workunit.client.0.smithi016.stdout:9/243: link d3/d9/df/d38/f4f d3/d9/db/dc/d33/f54 0 2024-08-01T06:56:18.180 INFO:tasks.workunit.client.0.smithi016.stdout:2/364: dread d0/d8/d31/f61 [0,4194304] 0 2024-08-01T06:56:18.181 INFO:tasks.workunit.client.0.smithi016.stdout:2/365: fsync d0/d16/d20/d2e/f4f 0 2024-08-01T06:56:18.181 INFO:tasks.workunit.client.0.smithi016.stdout:9/244: fdatasync d3/de/f15 0 2024-08-01T06:56:18.186 INFO:tasks.workunit.client.0.smithi016.stdout:8/289: getdents d5/d8/d1a/d24/d48/d60/d63 0 2024-08-01T06:56:18.187 INFO:tasks.workunit.client.0.smithi016.stdout:2/366: dwrite d0/d19/f4d [0,4194304] 0 2024-08-01T06:56:18.188 INFO:tasks.workunit.client.0.smithi016.stdout:9/245: creat d3/d9/d46/d48/f55 x:0 0 0 2024-08-01T06:56:18.190 INFO:tasks.workunit.client.0.smithi016.stdout:9/246: stat d3/d9/df/d2a/f3b 0 2024-08-01T06:56:18.198 INFO:tasks.workunit.client.0.smithi016.stdout:2/367: creat d0/d16/d20/d2e/d3b/d45/f7b x:0 0 0 2024-08-01T06:56:18.198 INFO:tasks.workunit.client.0.smithi016.stdout:8/290: chown d5/dc/f31 358 1 2024-08-01T06:56:18.201 INFO:tasks.workunit.client.0.smithi016.stdout:9/247: write d3/d9/db/d3e/d40/f4b [916789,48351] 0 2024-08-01T06:56:18.295 INFO:tasks.workunit.client.0.smithi016.stdout:8/291: symlink d5/d8/d1a/d59/l65 0 2024-08-01T06:56:18.296 INFO:tasks.workunit.client.0.smithi016.stdout:2/368: mknod d0/d16/d20/d2e/d3b/c7c 0 2024-08-01T06:56:18.298 INFO:tasks.workunit.client.0.smithi016.stdout:9/248: mkdir d3/d9/db/dc/d56 0 2024-08-01T06:56:18.299 INFO:tasks.workunit.client.0.smithi016.stdout:2/369: mkdir d0/d7d 0 2024-08-01T06:56:18.302 INFO:tasks.workunit.client.0.smithi016.stdout:8/292: creat d5/d8/d1a/d24/d48/d60/f66 x:0 0 0 2024-08-01T06:56:18.307 INFO:tasks.workunit.client.0.smithi016.stdout:8/293: mkdir d5/d67 0 2024-08-01T06:56:18.311 INFO:tasks.workunit.client.0.smithi016.stdout:8/294: creat d5/d8/f68 x:0 0 0 2024-08-01T06:56:18.350 INFO:tasks.workunit.client.0.smithi016.stdout:8/295: mkdir d5/d8/d1a/d24/d48/d69 0 2024-08-01T06:56:18.352 INFO:tasks.workunit.client.0.smithi016.stdout:8/296: chown d5/d8/d1a/l51 1852 1 2024-08-01T06:56:18.353 INFO:tasks.workunit.client.0.smithi016.stdout:9/249: dwrite d3/d9/df/d38/f4f [0,4194304] 0 2024-08-01T06:56:18.357 INFO:tasks.workunit.client.0.smithi016.stdout:8/297: mkdir d5/d8/d1a/d24/d6a 0 2024-08-01T06:56:18.358 INFO:tasks.workunit.client.0.smithi016.stdout:8/298: stat d5/dc/f4b 0 2024-08-01T06:56:18.358 INFO:tasks.workunit.client.0.smithi016.stdout:9/250: dread - d3/de/f3c zero size 2024-08-01T06:56:18.362 INFO:tasks.workunit.client.0.smithi016.stdout:8/299: truncate d5/d8/fd 3286013 0 2024-08-01T06:56:18.363 INFO:tasks.workunit.client.0.smithi016.stdout:2/370: link d0/d19/c38 d0/d8/d1b/d74/c7e 0 2024-08-01T06:56:18.364 INFO:tasks.workunit.client.0.smithi016.stdout:8/300: truncate d5/dc/f4b 417161 0 2024-08-01T06:56:18.365 INFO:tasks.workunit.client.0.smithi016.stdout:2/371: write d0/d19/f4d [4322220,77096] 0 2024-08-01T06:56:18.370 INFO:tasks.workunit.client.0.smithi016.stdout:8/301: dread d5/dc/f36 [0,4194304] 0 2024-08-01T06:56:18.374 INFO:tasks.workunit.client.0.smithi016.stdout:2/372: rename d0/d16/f44 to d0/d16/d20/d2e/d3b/d45/f7f 0 2024-08-01T06:56:18.375 INFO:tasks.workunit.client.0.smithi016.stdout:9/251: dwrite d3/de/f17 [0,4194304] 0 2024-08-01T06:56:18.380 INFO:tasks.workunit.client.0.smithi016.stdout:2/373: creat d0/d16/d20/d2e/f80 x:0 0 0 2024-08-01T06:56:18.382 INFO:tasks.workunit.client.0.smithi016.stdout:9/252: mkdir d3/d4/d57 0 2024-08-01T06:56:18.386 INFO:tasks.workunit.client.0.smithi016.stdout:2/374: rename d0/d16/d20/f43 to d0/d8/d1b/d74/f81 0 2024-08-01T06:56:18.386 INFO:tasks.workunit.client.0.smithi016.stdout:9/253: symlink d3/d9/d46/d48/l58 0 2024-08-01T06:56:18.389 INFO:tasks.workunit.client.0.smithi016.stdout:9/254: creat d3/d9/db/d3e/d40/f59 x:0 0 0 2024-08-01T06:56:18.397 INFO:tasks.workunit.client.0.smithi016.stdout:2/375: rmdir d0/d16 39 2024-08-01T06:56:18.407 INFO:tasks.workunit.client.0.smithi016.stdout:9/255: dwrite d3/de/f18 [0,4194304] 0 2024-08-01T06:56:18.412 INFO:tasks.workunit.client.0.smithi016.stdout:9/256: symlink d3/d9/db/l5a 0 2024-08-01T06:56:18.415 INFO:tasks.workunit.client.0.smithi016.stdout:2/376: dwrite d0/d19/f2c [0,4194304] 0 2024-08-01T06:56:18.423 INFO:tasks.workunit.client.0.smithi016.stdout:2/377: read d0/d8/f33 [3670257,63577] 0 2024-08-01T06:56:18.432 INFO:tasks.workunit.client.0.smithi016.stdout:9/257: dwrite d3/d9/db/dc/f27 [0,4194304] 0 2024-08-01T06:56:18.434 INFO:tasks.workunit.client.0.smithi016.stdout:2/378: getdents d0/d16/d20/d2e/d3b 0 2024-08-01T06:56:18.435 INFO:tasks.workunit.client.0.smithi016.stdout:2/379: dread - d0/d19/f78 zero size 2024-08-01T06:56:18.436 INFO:tasks.workunit.client.0.smithi016.stdout:9/258: unlink d3/d4/c25 0 2024-08-01T06:56:18.441 INFO:tasks.workunit.client.0.smithi016.stdout:2/380: rmdir d0/d16/d72 0 2024-08-01T06:56:18.444 INFO:tasks.workunit.client.0.smithi016.stdout:9/259: dwrite d3/d9/df/d16/f1e [0,4194304] 0 2024-08-01T06:56:18.445 INFO:tasks.workunit.client.0.smithi016.stdout:2/381: mknod d0/d19/c82 0 2024-08-01T06:56:18.446 INFO:tasks.workunit.client.0.smithi016.stdout:2/382: write d0/d8/d31/f53 [1245070,8701] 0 2024-08-01T06:56:18.449 INFO:tasks.workunit.client.0.smithi016.stdout:9/260: creat d3/d9/df/f5b x:0 0 0 2024-08-01T06:56:18.449 INFO:tasks.workunit.client.0.smithi016.stdout:2/383: fdatasync d0/d16/d20/d2e/d3b/d45/f7f 0 2024-08-01T06:56:18.453 INFO:tasks.workunit.client.0.smithi016.stdout:9/261: mkdir d3/d32/d5c 0 2024-08-01T06:56:18.458 INFO:tasks.workunit.client.0.smithi016.stdout:2/384: dwrite d0/d8/f18 [4194304,4194304] 0 2024-08-01T06:56:18.459 INFO:tasks.workunit.client.0.smithi016.stdout:2/385: chown d0/d8/d22/c30 18601745 1 2024-08-01T06:56:18.462 INFO:tasks.workunit.client.0.smithi016.stdout:2/386: symlink d0/d16/l83 0 2024-08-01T06:56:18.464 INFO:tasks.workunit.client.0.smithi016.stdout:2/387: rmdir d0/d8/d6b 39 2024-08-01T06:56:18.470 INFO:tasks.workunit.client.0.smithi016.stdout:2/388: rename d0/d16/d20/d2e/d3b/d45/l66 to d0/d8/l84 0 2024-08-01T06:56:18.472 INFO:tasks.workunit.client.0.smithi016.stdout:9/262: dwrite d3/de/f20 [0,4194304] 0 2024-08-01T06:56:18.473 INFO:tasks.workunit.client.0.smithi016.stdout:2/389: chown d0/d16/d20/l6f 271 1 2024-08-01T06:56:18.475 INFO:tasks.workunit.client.0.smithi016.stdout:2/390: dread d0/d8/d31/f61 [0,4194304] 0 2024-08-01T06:56:18.481 INFO:tasks.workunit.client.0.smithi016.stdout:2/391: truncate d0/d19/f4c 2231068 0 2024-08-01T06:56:18.501 INFO:tasks.workunit.client.0.smithi016.stdout:2/392: dread d0/d8/d22/f63 [0,4194304] 0 2024-08-01T06:56:18.503 INFO:tasks.workunit.client.0.smithi016.stdout:2/393: rmdir d0/d16/d20/d2e/d3b 39 2024-08-01T06:56:18.504 INFO:tasks.workunit.client.0.smithi016.stdout:2/394: truncate d0/d19/f56 847806 0 2024-08-01T06:56:18.517 INFO:tasks.workunit.client.0.smithi016.stdout:2/395: dread d0/d8/d1b/f29 [0,4194304] 0 2024-08-01T06:56:18.520 INFO:tasks.workunit.client.0.smithi016.stdout:2/396: dread d0/d19/f4d [0,4194304] 0 2024-08-01T06:56:18.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:18 smithi089 ceph-mon[36617]: pgmap v23: 65 pgs: 65 active+clean; 2.7 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 48 MiB/s rd, 175 MiB/s wr, 327 op/s 2024-08-01T06:56:18.915 INFO:tasks.workunit.client.0.smithi016.stdout:1/403: sync 2024-08-01T06:56:18.917 INFO:tasks.workunit.client.0.smithi016.stdout:1/404: mkdir d2/d3/d41/d49/d85 0 2024-08-01T06:56:18.920 INFO:tasks.workunit.client.0.smithi016.stdout:1/405: rename d2/f28 to d2/de/d21/d3e/f86 0 2024-08-01T06:56:18.922 INFO:tasks.workunit.client.0.smithi016.stdout:1/406: creat d2/d2f/f87 x:0 0 0 2024-08-01T06:56:18.937 INFO:tasks.workunit.client.0.smithi016.stdout:1/407: write d2/de/d21/d3e/f86 [592425,21940] 0 2024-08-01T06:56:18.940 INFO:tasks.workunit.client.0.smithi016.stdout:1/408: mkdir d2/d88 0 2024-08-01T06:56:18.946 INFO:tasks.workunit.client.0.smithi016.stdout:1/409: dwrite d2/de/d21/f5b [0,4194304] 0 2024-08-01T06:56:18.948 INFO:tasks.workunit.client.0.smithi016.stdout:1/410: read d2/d3/d1a/f4e [2195222,38620] 0 2024-08-01T06:56:18.952 INFO:tasks.workunit.client.0.smithi016.stdout:1/411: rmdir d2/d3/d41/d49/d51 39 2024-08-01T06:56:18.955 INFO:tasks.workunit.client.0.smithi016.stdout:1/412: symlink d2/d2f/l89 0 2024-08-01T06:56:18.966 INFO:tasks.workunit.client.0.smithi016.stdout:4/328: sync 2024-08-01T06:56:18.966 INFO:tasks.workunit.client.0.smithi016.stdout:3/242: sync 2024-08-01T06:56:18.966 INFO:tasks.workunit.client.0.smithi016.stdout:7/340: sync 2024-08-01T06:56:18.966 INFO:tasks.workunit.client.0.smithi016.stdout:9/263: sync 2024-08-01T06:56:18.966 INFO:tasks.workunit.client.0.smithi016.stdout:0/250: sync 2024-08-01T06:56:18.966 INFO:tasks.workunit.client.0.smithi016.stdout:6/452: sync 2024-08-01T06:56:18.966 INFO:tasks.workunit.client.0.smithi016.stdout:8/302: sync 2024-08-01T06:56:18.966 INFO:tasks.workunit.client.0.smithi016.stdout:5/412: sync 2024-08-01T06:56:18.966 INFO:tasks.workunit.client.0.smithi016.stdout:2/397: sync 2024-08-01T06:56:18.968 INFO:tasks.workunit.client.0.smithi016.stdout:9/264: stat d3/d9/d46/f4a 0 2024-08-01T06:56:18.970 INFO:tasks.workunit.client.0.smithi016.stdout:0/251: write d10/d11/f4d [64543,13764] 0 2024-08-01T06:56:18.974 INFO:tasks.workunit.client.0.smithi016.stdout:7/341: readlink d7/db/d17/d72/d1e/d26/d63/l84 0 2024-08-01T06:56:18.976 INFO:tasks.workunit.client.0.smithi016.stdout:5/413: truncate d1/d2/f80 2207607 0 2024-08-01T06:56:18.976 INFO:tasks.workunit.client.0.smithi016.stdout:2/398: mknod d0/c85 0 2024-08-01T06:56:18.976 INFO:tasks.workunit.client.0.smithi016.stdout:9/265: write d3/d9/db/dc/d33/f54 [2608581,64369] 0 2024-08-01T06:56:18.978 INFO:tasks.workunit.client.0.smithi016.stdout:6/453: symlink d1/d8/d1b/d22/d2d/la7 0 2024-08-01T06:56:18.980 INFO:tasks.workunit.client.0.smithi016.stdout:9/266: dread - d3/d32/f4d zero size 2024-08-01T06:56:18.980 INFO:tasks.workunit.client.0.smithi016.stdout:8/303: creat d5/dc/d3e/f6b x:0 0 0 2024-08-01T06:56:18.981 INFO:tasks.workunit.client.0.smithi016.stdout:1/413: dread d2/d3/d1a/f20 [0,4194304] 0 2024-08-01T06:56:18.984 INFO:tasks.workunit.client.0.smithi016.stdout:2/399: rmdir d0/d8 39 2024-08-01T06:56:18.984 INFO:tasks.workunit.client.0.smithi016.stdout:5/414: write d1/d2/d6/d9/f13 [5390533,8058] 0 2024-08-01T06:56:18.984 INFO:tasks.workunit.client.0.smithi016.stdout:4/329: dread d0/d2/d36/f56 [0,4194304] 0 2024-08-01T06:56:18.988 INFO:tasks.workunit.client.0.smithi016.stdout:4/330: dread - d0/d2/dc/d12/d29/d3c/f55 zero size 2024-08-01T06:56:18.990 INFO:tasks.workunit.client.0.smithi016.stdout:4/331: write d0/d17/f49 [675252,109665] 0 2024-08-01T06:56:18.990 INFO:tasks.workunit.client.0.smithi016.stdout:3/243: dread d9/da/df/d2a/f43 [0,4194304] 0 2024-08-01T06:56:18.991 INFO:tasks.workunit.client.0.smithi016.stdout:8/304: stat d5/f1b 0 2024-08-01T06:56:18.994 INFO:tasks.workunit.client.0.smithi016.stdout:4/332: dread d0/d17/f49 [0,4194304] 0 2024-08-01T06:56:18.995 INFO:tasks.workunit.client.0.smithi016.stdout:6/454: symlink d1/d9/d60/da0/la8 0 2024-08-01T06:56:18.995 INFO:tasks.workunit.client.0.smithi016.stdout:4/333: chown d0/d2/d36/f56 14 1 2024-08-01T06:56:18.999 INFO:tasks.workunit.client.0.smithi016.stdout:0/252: getdents d10/d11/d41 0 2024-08-01T06:56:19.001 INFO:tasks.workunit.client.0.smithi016.stdout:9/267: truncate d3/d9/df/d2a/f41 1185324 0 2024-08-01T06:56:19.004 INFO:tasks.workunit.client.0.smithi016.stdout:4/334: dwrite d0/d2/fa [0,4194304] 0 2024-08-01T06:56:19.006 INFO:tasks.workunit.client.0.smithi016.stdout:3/244: creat d9/da/d18/f55 x:0 0 0 2024-08-01T06:56:19.007 INFO:tasks.workunit.client.0.smithi016.stdout:9/268: dread d3/f28 [0,4194304] 0 2024-08-01T06:56:19.007 INFO:tasks.workunit.client.0.smithi016.stdout:3/245: stat d9/da/df/d12/f25 0 2024-08-01T06:56:19.008 INFO:tasks.workunit.client.0.smithi016.stdout:8/305: chown d5/d1c/l39 139 1 2024-08-01T06:56:19.008 INFO:tasks.workunit.client.0.smithi016.stdout:4/335: truncate d0/d2/dc/d12/d29/d3c/f5b 4542851 0 2024-08-01T06:56:19.010 INFO:tasks.workunit.client.0.smithi016.stdout:3/246: fdatasync d9/da/df/d12/d20/d3c/f4b 0 2024-08-01T06:56:19.011 INFO:tasks.workunit.client.0.smithi016.stdout:3/247: dread - d9/da/df/d12/d20/d3c/f4b zero size 2024-08-01T06:56:19.012 INFO:tasks.workunit.client.0.smithi016.stdout:1/414: link d2/d3/d1a/f27 d2/de/d6e/f8a 0 2024-08-01T06:56:19.012 INFO:tasks.workunit.client.0.smithi016.stdout:2/400: dread d0/f5 [0,4194304] 0 2024-08-01T06:56:19.019 INFO:tasks.workunit.client.0.smithi016.stdout:1/415: dwrite d2/d3/d41/d49/f60 [0,4194304] 0 2024-08-01T06:56:19.020 INFO:tasks.workunit.client.0.smithi016.stdout:1/416: chown d2/d3/d1a/d22 193 1 2024-08-01T06:56:19.021 INFO:tasks.workunit.client.0.smithi016.stdout:1/417: truncate d2/f72 111875 0 2024-08-01T06:56:19.022 INFO:tasks.workunit.client.0.smithi016.stdout:9/269: symlink d3/d9/db/dc/d33/l5d 0 2024-08-01T06:56:19.022 INFO:tasks.workunit.client.0.smithi016.stdout:1/418: stat d2/de/d32/c40 0 2024-08-01T06:56:19.025 INFO:tasks.workunit.client.0.smithi016.stdout:6/455: mkdir d1/d8/d1b/d22/d4e/da9 0 2024-08-01T06:56:19.027 INFO:tasks.workunit.client.0.smithi016.stdout:9/270: read d3/de/f15 [3535194,113910] 0 2024-08-01T06:56:19.030 INFO:tasks.workunit.client.0.smithi016.stdout:9/271: write d3/d9/df/d16/f1e [737693,124914] 0 2024-08-01T06:56:19.031 INFO:tasks.workunit.client.0.smithi016.stdout:5/415: rename d1/d2/d6/d9/d19/c60 to d1/d2/d20/c8d 0 2024-08-01T06:56:19.035 INFO:tasks.workunit.client.0.smithi016.stdout:2/401: dread d0/d8/d22/f63 [0,4194304] 0 2024-08-01T06:56:19.035 INFO:tasks.workunit.client.0.smithi016.stdout:7/342: getdents d7/db/d17/d72/d1c/d79 0 2024-08-01T06:56:19.036 INFO:tasks.workunit.client.0.smithi016.stdout:3/248: dwrite d9/da/df/d12/d20/f4c [0,4194304] 0 2024-08-01T06:56:19.036 INFO:tasks.workunit.client.0.smithi016.stdout:2/402: chown d0/d8/d31 1995 1 2024-08-01T06:56:19.038 INFO:tasks.workunit.client.0.smithi016.stdout:1/419: unlink d2/d3/d1a/f20 0 2024-08-01T06:56:19.042 INFO:tasks.workunit.client.0.smithi016.stdout:6/456: creat d1/d8/d1b/d22/d2d/faa x:0 0 0 2024-08-01T06:56:19.046 INFO:tasks.workunit.client.0.smithi016.stdout:0/253: rename d10/d11/f14 to d10/d1c/f4e 0 2024-08-01T06:56:19.047 INFO:tasks.workunit.client.0.smithi016.stdout:9/272: mknod d3/d32/c5e 0 2024-08-01T06:56:19.047 INFO:tasks.workunit.client.0.smithi016.stdout:5/416: symlink d1/d2/d6/d5a/d65/l8e 0 2024-08-01T06:56:19.048 INFO:tasks.workunit.client.0.smithi016.stdout:0/254: chown d10/d1c/f35 32626641 1 2024-08-01T06:56:19.049 INFO:tasks.workunit.client.0.smithi016.stdout:0/255: fsync d10/d1c/f46 0 2024-08-01T06:56:19.050 INFO:tasks.workunit.client.0.smithi016.stdout:1/420: mknod d2/d3/d41/c8b 0 2024-08-01T06:56:19.051 INFO:tasks.workunit.client.0.smithi016.stdout:1/421: write d2/d3/d1c/f2e [2594736,61736] 0 2024-08-01T06:56:19.054 INFO:tasks.workunit.client.0.smithi016.stdout:0/256: dread d10/d1c/f35 [0,4194304] 0 2024-08-01T06:56:19.056 INFO:tasks.workunit.client.0.smithi016.stdout:3/249: creat d9/da/df/d53/f56 x:0 0 0 2024-08-01T06:56:19.057 INFO:tasks.workunit.client.0.smithi016.stdout:9/273: creat d3/d9/db/f5f x:0 0 0 2024-08-01T06:56:19.059 INFO:tasks.workunit.client.0.smithi016.stdout:5/417: creat d1/d2/d6/d9/d19/d7a/f8f x:0 0 0 2024-08-01T06:56:19.060 INFO:tasks.workunit.client.0.smithi016.stdout:6/457: symlink d1/d8/lab 0 2024-08-01T06:56:19.062 INFO:tasks.workunit.client.0.smithi016.stdout:5/418: chown d1/ce 943 1 2024-08-01T06:56:19.064 INFO:tasks.workunit.client.0.smithi016.stdout:0/257: mknod d10/d11/d37/c4f 0 2024-08-01T06:56:19.065 INFO:tasks.workunit.client.0.smithi016.stdout:9/274: dread d3/d9/df/d16/f1e [0,4194304] 0 2024-08-01T06:56:19.066 INFO:tasks.workunit.client.0.smithi016.stdout:8/306: rename d5/d8/l21 to d5/l6c 0 2024-08-01T06:56:19.069 INFO:tasks.workunit.client.0.smithi016.stdout:0/258: dread - d10/d1c/f46 zero size 2024-08-01T06:56:19.070 INFO:tasks.workunit.client.0.smithi016.stdout:8/307: stat d5/d8/d1a/d24/d48/f56 0 2024-08-01T06:56:19.074 INFO:tasks.workunit.client.0.smithi016.stdout:1/422: dread d2/de/f14 [0,4194304] 0 2024-08-01T06:56:19.075 INFO:tasks.workunit.client.0.smithi016.stdout:8/308: chown d5/d8/d1a/d24/f4e 6142 1 2024-08-01T06:56:19.075 INFO:tasks.workunit.client.0.smithi016.stdout:6/458: dwrite d1/d8/d1b/d22/d2d/faa [0,4194304] 0 2024-08-01T06:56:19.076 INFO:tasks.workunit.client.0.smithi016.stdout:1/423: chown d2/d2f/c61 26244289 1 2024-08-01T06:56:19.076 INFO:tasks.workunit.client.0.smithi016.stdout:0/259: chown d10/d11/f42 360933408 1 2024-08-01T06:56:19.078 INFO:tasks.workunit.client.0.smithi016.stdout:9/275: dread d3/de/f17 [0,4194304] 0 2024-08-01T06:56:19.079 INFO:tasks.workunit.client.0.smithi016.stdout:0/260: truncate d10/f45 553088 0 2024-08-01T06:56:19.082 INFO:tasks.workunit.client.0.smithi016.stdout:8/309: dread - d5/d1c/f4c zero size 2024-08-01T06:56:19.131 INFO:tasks.workunit.client.0.smithi016.stdout:3/250: mkdir d9/d57 0 2024-08-01T06:56:19.140 INFO:tasks.workunit.client.0.smithi016.stdout:6/459: creat d1/d8/d1b/d22/d71/fac x:0 0 0 2024-08-01T06:56:19.143 INFO:tasks.workunit.client.0.smithi016.stdout:9/276: symlink d3/d9/d46/d48/l60 0 2024-08-01T06:56:19.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:18 smithi016 ceph-mon[29266]: pgmap v23: 65 pgs: 65 active+clean; 2.7 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 48 MiB/s rd, 175 MiB/s wr, 327 op/s 2024-08-01T06:56:19.152 INFO:tasks.workunit.client.0.smithi016.stdout:9/277: dwrite d3/d9/df/d16/f30 [0,4194304] 0 2024-08-01T06:56:19.153 INFO:tasks.workunit.client.0.smithi016.stdout:9/278: chown d3/d9/db/dc/d33/l5d 45180590 1 2024-08-01T06:56:19.165 INFO:tasks.workunit.client.0.smithi016.stdout:6/460: rmdir d1/d8/d1b/d22/d36/d7a 39 2024-08-01T06:56:19.176 INFO:tasks.workunit.client.0.smithi016.stdout:3/251: mkdir d9/d3e/d40/d58 0 2024-08-01T06:56:19.177 INFO:tasks.workunit.client.0.smithi016.stdout:3/252: dread - d9/da/df/d12/d20/d3c/f4b zero size 2024-08-01T06:56:19.178 INFO:tasks.workunit.client.0.smithi016.stdout:8/310: truncate d5/f12 341731 0 2024-08-01T06:56:19.180 INFO:tasks.workunit.client.0.smithi016.stdout:9/279: fdatasync d3/d9/df/f3d 0 2024-08-01T06:56:19.181 INFO:tasks.workunit.client.0.smithi016.stdout:8/311: chown d5/d8/d1a/d24/d48/d60/d63/l50 491121072 1 2024-08-01T06:56:19.182 INFO:tasks.workunit.client.0.smithi016.stdout:8/312: dread - d5/d8/d1a/d24/f4e zero size 2024-08-01T06:56:19.183 INFO:tasks.workunit.client.0.smithi016.stdout:3/253: dread d9/da/f47 [0,4194304] 0 2024-08-01T06:56:19.183 INFO:tasks.workunit.client.0.smithi016.stdout:5/419: link d1/d2/d23/f32 d1/d12/d8c/f90 0 2024-08-01T06:56:19.185 INFO:tasks.workunit.client.0.smithi016.stdout:6/461: dread d1/d9/d60/d68/f7c [0,4194304] 0 2024-08-01T06:56:19.195 INFO:tasks.workunit.client.0.smithi016.stdout:8/313: creat d5/d8/d1a/d24/d48/d60/f6d x:0 0 0 2024-08-01T06:56:19.196 INFO:tasks.workunit.client.0.smithi016.stdout:8/314: readlink d5/d8/d1a/d24/d48/d60/d63/l64 0 2024-08-01T06:56:19.197 INFO:tasks.workunit.client.0.smithi016.stdout:1/424: getdents d2/d3/d41 0 2024-08-01T06:56:19.215 INFO:tasks.workunit.client.0.smithi016.stdout:3/254: dread d9/d1c/f2b [0,4194304] 0 2024-08-01T06:56:19.218 INFO:tasks.workunit.client.0.smithi016.stdout:4/336: rename d0/d17/d22/l65 to d0/d17/d22/d26/l6e 0 2024-08-01T06:56:19.230 INFO:tasks.workunit.client.0.smithi016.stdout:8/315: mkdir d5/d8/d1a/d24/d48/d6e 0 2024-08-01T06:56:19.231 INFO:tasks.workunit.client.0.smithi016.stdout:1/425: mknod d2/de/d4d/c8c 0 2024-08-01T06:56:19.232 INFO:tasks.workunit.client.0.smithi016.stdout:1/426: readlink d2/d3/l13 0 2024-08-01T06:56:19.238 INFO:tasks.workunit.client.0.smithi016.stdout:6/462: getdents d1/d41 0 2024-08-01T06:56:19.241 INFO:tasks.workunit.client.0.smithi016.stdout:4/337: creat d0/d2/d68/f6f x:0 0 0 2024-08-01T06:56:19.243 INFO:tasks.workunit.client.0.smithi016.stdout:6/463: mknod d1/d8/d1b/d48/cad 0 2024-08-01T06:56:19.246 INFO:tasks.workunit.client.0.smithi016.stdout:6/464: fsync d1/d8/d1b/f72 0 2024-08-01T06:56:19.250 INFO:tasks.workunit.client.0.smithi016.stdout:6/465: getdents d1/d41 0 2024-08-01T06:56:19.250 INFO:tasks.workunit.client.0.smithi016.stdout:6/466: stat d1/d8/d1b/l54 0 2024-08-01T06:56:19.251 INFO:tasks.workunit.client.0.smithi016.stdout:6/467: fsync d1/d8/d1b/d22/d3b/f97 0 2024-08-01T06:56:19.254 INFO:tasks.workunit.client.0.smithi016.stdout:6/468: unlink d1/d9/d3f/f63 0 2024-08-01T06:56:19.257 INFO:tasks.workunit.client.0.smithi016.stdout:6/469: read d1/d8/d1b/f50 [7427494,99029] 0 2024-08-01T06:56:19.258 INFO:tasks.workunit.client.0.smithi016.stdout:6/470: fdatasync d1/d9/d3f/f76 0 2024-08-01T06:56:19.262 INFO:tasks.workunit.client.0.smithi016.stdout:6/471: unlink d1/d41/c5b 0 2024-08-01T06:56:19.271 INFO:tasks.workunit.client.0.smithi016.stdout:0/261: write d10/d1c/f20 [229996,36020] 0 2024-08-01T06:56:19.278 INFO:tasks.workunit.client.0.smithi016.stdout:0/262: dwrite d10/d1c/f27 [0,4194304] 0 2024-08-01T06:56:19.282 INFO:tasks.workunit.client.0.smithi016.stdout:0/263: mkdir d10/d11/d37/d50 0 2024-08-01T06:56:19.286 INFO:tasks.workunit.client.0.smithi016.stdout:0/264: mknod d10/d11/d37/d50/c51 0 2024-08-01T06:56:19.287 INFO:tasks.workunit.client.0.smithi016.stdout:0/265: stat fd 0 2024-08-01T06:56:19.288 INFO:tasks.workunit.client.0.smithi016.stdout:0/266: chown d10/d11/f3d 666 1 2024-08-01T06:56:19.293 INFO:tasks.workunit.client.0.smithi016.stdout:0/267: dread d10/d11/f15 [0,4194304] 0 2024-08-01T06:56:19.303 INFO:tasks.workunit.client.0.smithi016.stdout:9/280: dwrite d3/f28 [0,4194304] 0 2024-08-01T06:56:19.309 INFO:tasks.workunit.client.0.smithi016.stdout:9/281: dread d3/d9/db/dc/d33/f54 [0,4194304] 0 2024-08-01T06:56:19.310 INFO:tasks.workunit.client.0.smithi016.stdout:9/282: write d3/f1d [840382,110746] 0 2024-08-01T06:56:19.311 INFO:tasks.workunit.client.0.smithi016.stdout:9/283: stat d3/d9/db/dc/d56 0 2024-08-01T06:56:19.311 INFO:tasks.workunit.client.0.smithi016.stdout:2/403: sync 2024-08-01T06:56:19.313 INFO:tasks.workunit.client.0.smithi016.stdout:2/404: fsync d0/d8/d31/d5e/f75 0 2024-08-01T06:56:19.314 INFO:tasks.workunit.client.0.smithi016.stdout:9/284: symlink d3/d32/d5c/l61 0 2024-08-01T06:56:19.315 INFO:tasks.workunit.client.0.smithi016.stdout:0/268: dread d10/f28 [0,4194304] 0 2024-08-01T06:56:19.317 INFO:tasks.workunit.client.0.smithi016.stdout:9/285: truncate d3/d4/f34 668849 0 2024-08-01T06:56:19.317 INFO:tasks.workunit.client.0.smithi016.stdout:5/420: creat d1/d12/f91 x:0 0 0 2024-08-01T06:56:19.320 INFO:tasks.workunit.client.0.smithi016.stdout:5/421: creat d1/d12/d3e/f92 x:0 0 0 2024-08-01T06:56:19.320 INFO:tasks.workunit.client.0.smithi016.stdout:0/269: dread fd [0,4194304] 0 2024-08-01T06:56:19.323 INFO:tasks.workunit.client.0.smithi016.stdout:7/343: rename d7/db/d17/d72/d1c/l24 to d7/db/d17/d72/d1c/d1d/d40/d67/l88 0 2024-08-01T06:56:19.324 INFO:tasks.workunit.client.0.smithi016.stdout:0/270: unlink d10/d11/d41/f2b 0 2024-08-01T06:56:19.329 INFO:tasks.workunit.client.0.smithi016.stdout:3/255: truncate d9/da/df/d12/d20/f4c 2731111 0 2024-08-01T06:56:19.332 INFO:tasks.workunit.client.0.smithi016.stdout:7/344: mknod d7/db/d17/d72/c89 0 2024-08-01T06:56:19.334 INFO:tasks.workunit.client.0.smithi016.stdout:5/422: dread d1/d2/d6/d9/d1b/f1f [0,4194304] 0 2024-08-01T06:56:19.334 INFO:tasks.workunit.client.0.smithi016.stdout:2/405: unlink d0/d16/d20/d2e/l6d 0 2024-08-01T06:56:19.335 INFO:tasks.workunit.client.0.smithi016.stdout:2/406: chown d0/d16/d20/f57 1264316 1 2024-08-01T06:56:19.335 INFO:tasks.workunit.client.0.smithi016.stdout:3/256: unlink d9/da/df/f33 0 2024-08-01T06:56:19.337 INFO:tasks.workunit.client.0.smithi016.stdout:8/316: rename d5/d8/d1a/d24/d48/d60/d63/l64 to d5/d8/d1a/l6f 0 2024-08-01T06:56:19.338 INFO:tasks.workunit.client.0.smithi016.stdout:5/423: readlink d1/d2/d6/l4c 0 2024-08-01T06:56:19.339 INFO:tasks.workunit.client.0.smithi016.stdout:8/317: fsync d5/d1c/f37 0 2024-08-01T06:56:19.340 INFO:tasks.workunit.client.0.smithi016.stdout:3/257: mkdir d9/d3e/d40/d58/d59 0 2024-08-01T06:56:19.342 INFO:tasks.workunit.client.0.smithi016.stdout:0/271: dread d10/d1c/f29 [0,4194304] 0 2024-08-01T06:56:19.342 INFO:tasks.workunit.client.0.smithi016.stdout:1/427: rename d2/d3/fd to d2/de/d32/d43/f8d 0 2024-08-01T06:56:19.344 INFO:tasks.workunit.client.0.smithi016.stdout:5/424: read d1/d2/d23/d3a/f58 [835441,125088] 0 2024-08-01T06:56:19.344 INFO:tasks.workunit.client.0.smithi016.stdout:2/407: dwrite d0/d8/d1b/f5b [4194304,4194304] 0 2024-08-01T06:56:19.352 INFO:tasks.workunit.client.0.smithi016.stdout:2/408: readlink d0/d16/d20/d2e/d3b/l5a 0 2024-08-01T06:56:19.353 INFO:tasks.workunit.client.0.smithi016.stdout:3/258: symlink d9/d3e/d40/d58/d59/l5a 0 2024-08-01T06:56:19.354 INFO:tasks.workunit.client.0.smithi016.stdout:3/259: chown d9/da/df/c4d 42788031 1 2024-08-01T06:56:19.356 INFO:tasks.workunit.client.0.smithi016.stdout:1/428: fsync d2/f17 0 2024-08-01T06:56:19.356 INFO:tasks.workunit.client.0.smithi016.stdout:3/260: readlink d9/da/l1a 0 2024-08-01T06:56:19.356 INFO:tasks.workunit.client.0.smithi016.stdout:1/429: chown d2/f12 26448068 1 2024-08-01T06:56:19.358 INFO:tasks.workunit.client.0.smithi016.stdout:4/338: rename d0/d2/dc/d12/d29/f57 to d0/d2/d36/f70 0 2024-08-01T06:56:19.359 INFO:tasks.workunit.client.0.smithi016.stdout:5/425: fsync d1/d12/d8c/f90 0 2024-08-01T06:56:19.361 INFO:tasks.workunit.client.0.smithi016.stdout:6/472: creat d1/d9/fae x:0 0 0 2024-08-01T06:56:19.369 INFO:tasks.workunit.client.0.smithi016.stdout:6/473: dwrite d1/d8/d1b/d22/d2d/faa [0,4194304] 0 2024-08-01T06:56:19.371 INFO:tasks.workunit.client.0.smithi016.stdout:4/339: mknod d0/d2/dc/d12/d29/d3c/c71 0 2024-08-01T06:56:19.373 INFO:tasks.workunit.client.0.smithi016.stdout:2/409: truncate d0/d16/d20/d2e/d3b/d45/f7f 4155032 0 2024-08-01T06:56:19.378 INFO:tasks.workunit.client.0.smithi016.stdout:6/474: readlink d1/d8/l66 0 2024-08-01T06:56:19.379 INFO:tasks.workunit.client.0.smithi016.stdout:1/430: dread d2/d3/f5 [4194304,4194304] 0 2024-08-01T06:56:19.379 INFO:tasks.workunit.client.0.smithi016.stdout:6/475: stat d1/d8/d1b/d22/d4e/c6e 0 2024-08-01T06:56:19.380 INFO:tasks.workunit.client.0.smithi016.stdout:4/340: unlink d0/d17/c1a 0 2024-08-01T06:56:19.382 INFO:tasks.workunit.client.0.smithi016.stdout:4/341: write d0/d2/d68/f6f [948109,128204] 0 2024-08-01T06:56:19.384 INFO:tasks.workunit.client.0.smithi016.stdout:2/410: mknod d0/d8/d31/d5e/c86 0 2024-08-01T06:56:19.385 INFO:tasks.workunit.client.0.smithi016.stdout:7/345: rename d7/db/d17/d72/d1e/d26/c33 to d7/db/d17/d72/c8a 0 2024-08-01T06:56:19.388 INFO:tasks.workunit.client.0.smithi016.stdout:1/431: creat d2/de/d4d/f8e x:0 0 0 2024-08-01T06:56:19.388 INFO:tasks.workunit.client.0.smithi016.stdout:1/432: chown d2/f1b 478863 1 2024-08-01T06:56:19.390 INFO:tasks.workunit.client.0.smithi016.stdout:2/411: creat d0/d16/d20/f87 x:0 0 0 2024-08-01T06:56:19.390 INFO:tasks.workunit.client.0.smithi016.stdout:8/318: rename d5/d8 to d5/d8/d1a/d70 22 2024-08-01T06:56:19.396 INFO:tasks.workunit.client.0.smithi016.stdout:2/412: fdatasync d0/d8/f52 0 2024-08-01T06:56:19.399 INFO:tasks.workunit.client.0.smithi016.stdout:4/342: rename d0/d2/f52 to d0/d2/dc/d12/f72 0 2024-08-01T06:56:19.402 INFO:tasks.workunit.client.0.smithi016.stdout:8/319: creat d5/d8/d1a/d24/d48/d60/d63/f71 x:0 0 0 2024-08-01T06:56:19.407 INFO:tasks.workunit.client.0.smithi016.stdout:2/413: rename d0/f5 to d0/d8/d22/f88 0 2024-08-01T06:56:19.408 INFO:tasks.workunit.client.0.smithi016.stdout:4/343: readlink d0/d2/dc/l10 0 2024-08-01T06:56:19.413 INFO:tasks.workunit.client.0.smithi016.stdout:4/344: rmdir d0/d2/dc/d12 39 2024-08-01T06:56:19.415 INFO:tasks.workunit.client.0.smithi016.stdout:7/346: rename d7/l45 to d7/l8b 0 2024-08-01T06:56:19.419 INFO:tasks.workunit.client.0.smithi016.stdout:1/433: getdents d2/d3 0 2024-08-01T06:56:19.419 INFO:tasks.workunit.client.0.smithi016.stdout:1/434: dread - d2/d3/f84 zero size 2024-08-01T06:56:19.423 INFO:tasks.workunit.client.0.smithi016.stdout:3/261: write d9/f1f [186203,88382] 0 2024-08-01T06:56:19.427 INFO:tasks.workunit.client.0.smithi016.stdout:1/435: rename d2/fc to d2/de/d21/d3e/f8f 0 2024-08-01T06:56:19.429 INFO:tasks.workunit.client.0.smithi016.stdout:4/345: fdatasync d0/d2/dc/d12/f24 0 2024-08-01T06:56:19.430 INFO:tasks.workunit.client.0.smithi016.stdout:0/272: link d10/d11/l34 d10/d11/d41/l52 0 2024-08-01T06:56:19.432 INFO:tasks.workunit.client.0.smithi016.stdout:5/426: dwrite d1/f5 [0,4194304] 0 2024-08-01T06:56:19.435 INFO:tasks.workunit.client.0.smithi016.stdout:8/320: getdents d5/d8/d1a 0 2024-08-01T06:56:19.436 INFO:tasks.workunit.client.0.smithi016.stdout:2/414: link d0/d8/d31/c67 d0/d16/d20/c89 0 2024-08-01T06:56:19.446 INFO:tasks.workunit.client.0.smithi016.stdout:8/321: mkdir d5/dc/d3e/d72 0 2024-08-01T06:56:19.448 INFO:tasks.workunit.client.0.smithi016.stdout:8/322: chown d5/d8/d1a/d24/l46 15 1 2024-08-01T06:56:19.449 INFO:tasks.workunit.client.0.smithi016.stdout:3/262: dread d9/da/df/d12/f25 [0,4194304] 0 2024-08-01T06:56:19.454 INFO:tasks.workunit.client.0.smithi016.stdout:5/427: symlink d1/d12/d7d/l93 0 2024-08-01T06:56:19.455 INFO:tasks.workunit.client.0.smithi016.stdout:2/415: unlink d0/d8/d31/c67 0 2024-08-01T06:56:19.458 INFO:tasks.workunit.client.0.smithi016.stdout:3/263: dwrite d9/da/df/d12/d20/f35 [0,4194304] 0 2024-08-01T06:56:19.458 INFO:tasks.workunit.client.0.smithi016.stdout:3/264: fdatasync d9/d3e/f2d 0 2024-08-01T06:56:19.461 INFO:tasks.workunit.client.0.smithi016.stdout:7/347: write d7/f5b [238540,89714] 0 2024-08-01T06:56:19.463 INFO:tasks.workunit.client.0.smithi016.stdout:0/273: dread d10/d11/d41/f2f [0,4194304] 0 2024-08-01T06:56:19.465 INFO:tasks.workunit.client.0.smithi016.stdout:4/346: rename d0/d2/d36/d50 to d0/d17/d22/d73 0 2024-08-01T06:56:19.465 INFO:tasks.workunit.client.0.smithi016.stdout:0/274: write d10/f2e [3888278,130303] 0 2024-08-01T06:56:19.469 INFO:tasks.workunit.client.0.smithi016.stdout:2/416: stat d0/d8/d1b/d74/c7e 0 2024-08-01T06:56:19.471 INFO:tasks.workunit.client.0.smithi016.stdout:2/417: dread - d0/d16/d20/d2e/f4f zero size 2024-08-01T06:56:19.472 INFO:tasks.workunit.client.0.smithi016.stdout:1/436: write d2/de/f14 [1060520,29009] 0 2024-08-01T06:56:19.472 INFO:tasks.workunit.client.0.smithi016.stdout:2/418: chown d0/d8/ca 10707836 1 2024-08-01T06:56:19.473 INFO:tasks.workunit.client.0.smithi016.stdout:3/265: dread d9/da/f47 [0,4194304] 0 2024-08-01T06:56:19.474 INFO:tasks.workunit.client.0.smithi016.stdout:1/437: write d2/de/f45 [2002731,73086] 0 2024-08-01T06:56:19.477 INFO:tasks.workunit.client.0.smithi016.stdout:8/323: rename d5/dc/f53 to d5/dc/d3e/f73 0 2024-08-01T06:56:19.479 INFO:tasks.workunit.client.0.smithi016.stdout:0/275: mkdir d10/d11/d37/d53 0 2024-08-01T06:56:19.483 INFO:tasks.workunit.client.0.smithi016.stdout:2/419: mknod d0/d19/c8a 0 2024-08-01T06:56:19.486 INFO:tasks.workunit.client.0.smithi016.stdout:3/266: rmdir d9/d3e/d40/d58 39 2024-08-01T06:56:19.487 INFO:tasks.workunit.client.0.smithi016.stdout:1/438: creat d2/d3/d41/f90 x:0 0 0 2024-08-01T06:56:19.488 INFO:tasks.workunit.client.0.smithi016.stdout:4/347: rename d0/d2/dc/d12/d29/c41 to d0/d17/d67/c74 0 2024-08-01T06:56:19.493 INFO:tasks.workunit.client.0.smithi016.stdout:0/276: mknod d10/d1c/c54 0 2024-08-01T06:56:19.494 INFO:tasks.workunit.client.0.smithi016.stdout:2/420: readlink d0/l1 0 2024-08-01T06:56:19.495 INFO:tasks.workunit.client.0.smithi016.stdout:0/277: write d10/f2e [4235029,40684] 0 2024-08-01T06:56:19.495 INFO:tasks.workunit.client.0.smithi016.stdout:1/439: dwrite d2/d3/d1c/f2e [4194304,4194304] 0 2024-08-01T06:56:19.498 INFO:tasks.workunit.client.0.smithi016.stdout:3/267: chown d9/d1c/l39 2278562 1 2024-08-01T06:56:19.499 INFO:tasks.workunit.client.0.smithi016.stdout:3/268: write f3 [1928949,49166] 0 2024-08-01T06:56:19.500 INFO:tasks.workunit.client.0.smithi016.stdout:4/348: mknod d0/d17/d22/d26/c75 0 2024-08-01T06:56:19.506 INFO:tasks.workunit.client.0.smithi016.stdout:0/278: rename d10/f28 to d10/d11/d37/f55 0 2024-08-01T06:56:19.509 INFO:tasks.workunit.client.0.smithi016.stdout:3/269: symlink d9/da/l5b 0 2024-08-01T06:56:19.510 INFO:tasks.workunit.client.0.smithi016.stdout:3/270: write d9/da/d18/f55 [91538,28453] 0 2024-08-01T06:56:19.510 INFO:tasks.workunit.client.0.smithi016.stdout:8/324: link d5/d1c/l39 d5/d8/d1a/d24/d6a/l74 0 2024-08-01T06:56:19.512 INFO:tasks.workunit.client.0.smithi016.stdout:7/348: link d7/db/d17/d72/d1e/f69 d7/db/d17/d72/d1e/d26/d2a/f8c 0 2024-08-01T06:56:19.512 INFO:tasks.workunit.client.0.smithi016.stdout:8/325: chown d5/d1c/f33 171 1 2024-08-01T06:56:19.512 INFO:tasks.workunit.client.0.smithi016.stdout:4/349: chown d0/d17/d38/l4d 180 1 2024-08-01T06:56:19.512 INFO:tasks.workunit.client.0.smithi016.stdout:0/279: dread d10/d1c/f4e [0,4194304] 0 2024-08-01T06:56:19.513 INFO:tasks.workunit.client.0.smithi016.stdout:2/421: mkdir d0/d7d/d8b 0 2024-08-01T06:56:19.514 INFO:tasks.workunit.client.0.smithi016.stdout:1/440: rename d2/d3/d41/f90 to d2/de/d32/f91 0 2024-08-01T06:56:19.515 INFO:tasks.workunit.client.0.smithi016.stdout:3/271: mkdir d9/da/df/d12/d20/d5c 0 2024-08-01T06:56:19.518 INFO:tasks.workunit.client.0.smithi016.stdout:8/326: write d5/d1c/f57 [458143,81699] 0 2024-08-01T06:56:19.519 INFO:tasks.workunit.client.0.smithi016.stdout:0/280: truncate f9 4827930 0 2024-08-01T06:56:19.519 INFO:tasks.workunit.client.0.smithi016.stdout:8/327: chown d5/d8/d1a/d24/d48/d69 1 1 2024-08-01T06:56:19.520 INFO:tasks.workunit.client.0.smithi016.stdout:8/328: stat d5/d8/d1a/c1d 0 2024-08-01T06:56:19.521 INFO:tasks.workunit.client.0.smithi016.stdout:8/329: dread - d5/d8/f68 zero size 2024-08-01T06:56:19.521 INFO:tasks.workunit.client.0.smithi016.stdout:1/441: rmdir d2/d2f 39 2024-08-01T06:56:19.523 INFO:tasks.workunit.client.0.smithi016.stdout:8/330: read d5/d8/f2e [736554,77747] 0 2024-08-01T06:56:19.524 INFO:tasks.workunit.client.0.smithi016.stdout:4/350: mknod d0/d2/dc/c76 0 2024-08-01T06:56:19.524 INFO:tasks.workunit.client.0.smithi016.stdout:2/422: dread - d0/d16/d20/d2e/f4f zero size 2024-08-01T06:56:19.529 INFO:tasks.workunit.client.0.smithi016.stdout:1/442: fdatasync d2/de/d32/d43/f8d 0 2024-08-01T06:56:19.533 INFO:tasks.workunit.client.0.smithi016.stdout:3/272: mknod d9/c5d 0 2024-08-01T06:56:19.534 INFO:tasks.workunit.client.0.smithi016.stdout:1/443: dwrite d2/d3/d1a/d22/f76 [0,4194304] 0 2024-08-01T06:56:19.537 INFO:tasks.workunit.client.0.smithi016.stdout:2/423: creat d0/d8/d22/f8c x:0 0 0 2024-08-01T06:56:19.588 INFO:tasks.workunit.client.0.smithi016.stdout:0/281: mknod d10/d11/c56 0 2024-08-01T06:56:19.588 INFO:tasks.workunit.client.0.smithi016.stdout:4/351: truncate d0/d2/dc/d12/f24 838289 0 2024-08-01T06:56:19.589 INFO:tasks.workunit.client.0.smithi016.stdout:8/331: mkdir d5/d8/d75 0 2024-08-01T06:56:19.590 INFO:tasks.workunit.client.0.smithi016.stdout:1/444: mkdir d2/de/d4d/d92 0 2024-08-01T06:56:19.591 INFO:tasks.workunit.client.0.smithi016.stdout:2/424: unlink d0/d8/d1b/f5b 0 2024-08-01T06:56:19.591 INFO:tasks.workunit.client.0.smithi016.stdout:1/445: readlink d2/d3/d1a/d22/l62 0 2024-08-01T06:56:19.592 INFO:tasks.workunit.client.0.smithi016.stdout:7/349: getdents d7/db/d17/d72/d1e/d26/d2a 0 2024-08-01T06:56:19.595 INFO:tasks.workunit.client.0.smithi016.stdout:8/332: unlink d5/d8/d1a/d24/f26 0 2024-08-01T06:56:19.596 INFO:tasks.workunit.client.0.smithi016.stdout:8/333: read - d5/dc/d3e/f6b zero size 2024-08-01T06:56:19.599 INFO:tasks.workunit.client.0.smithi016.stdout:0/282: rename d10/d11/c12 to d10/d1c/c57 0 2024-08-01T06:56:19.601 INFO:tasks.workunit.client.0.smithi016.stdout:3/273: unlink d9/da/df/d2a/l3f 0 2024-08-01T06:56:19.604 INFO:tasks.workunit.client.0.smithi016.stdout:1/446: creat d2/d88/f93 x:0 0 0 2024-08-01T06:56:19.605 INFO:tasks.workunit.client.0.smithi016.stdout:1/447: write d2/de/f37 [395933,114675] 0 2024-08-01T06:56:19.613 INFO:tasks.workunit.client.0.smithi016.stdout:4/352: write d0/d2/f33 [574332,110844] 0 2024-08-01T06:56:19.615 INFO:tasks.workunit.client.0.smithi016.stdout:8/334: creat d5/dc/d3e/f76 x:0 0 0 2024-08-01T06:56:19.615 INFO:tasks.workunit.client.0.smithi016.stdout:4/353: read d0/fb [1085688,23667] 0 2024-08-01T06:56:19.616 INFO:tasks.workunit.client.0.smithi016.stdout:2/425: creat d0/d16/d20/d2e/d68/f8d x:0 0 0 2024-08-01T06:56:19.618 INFO:tasks.workunit.client.0.smithi016.stdout:4/354: write d0/d2/dc/d12/d29/f60 [807624,87413] 0 2024-08-01T06:56:19.618 INFO:tasks.workunit.client.0.smithi016.stdout:0/283: readlink d10/d11/d41/l52 0 2024-08-01T06:56:19.619 INFO:tasks.workunit.client.0.smithi016.stdout:2/426: read - d0/d8/d22/f8c zero size 2024-08-01T06:56:19.619 INFO:tasks.workunit.client.0.smithi016.stdout:7/350: mkdir d7/db/d17/d72/d1c/d1d/d40/d67/d7c/d8d 0 2024-08-01T06:56:19.619 INFO:tasks.workunit.client.0.smithi016.stdout:3/274: truncate d9/da/f47 93276 0 2024-08-01T06:56:19.620 INFO:tasks.workunit.client.0.smithi016.stdout:3/275: readlink d9/da/l5b 0 2024-08-01T06:56:19.621 INFO:tasks.workunit.client.0.smithi016.stdout:2/427: truncate d0/d19/f78 782487 0 2024-08-01T06:56:19.622 INFO:tasks.workunit.client.0.smithi016.stdout:3/276: write d9/da/df/f45 [314179,79981] 0 2024-08-01T06:56:19.622 INFO:tasks.workunit.client.0.smithi016.stdout:2/428: stat d0/d16/d20/d2e/d3b/l60 0 2024-08-01T06:56:19.623 INFO:tasks.workunit.client.0.smithi016.stdout:8/335: rename d5/d8/d1a/d24/l3a to d5/dc/l77 0 2024-08-01T06:56:19.625 INFO:tasks.workunit.client.0.smithi016.stdout:7/351: creat d7/db/d17/d72/d1c/d79/f8e x:0 0 0 2024-08-01T06:56:19.630 INFO:tasks.workunit.client.0.smithi016.stdout:4/355: rename d0/f1 to d0/d17/d67/f77 0 2024-08-01T06:56:19.633 INFO:tasks.workunit.client.0.smithi016.stdout:7/352: unlink d7/db/d17/d4e/c82 0 2024-08-01T06:56:19.634 INFO:tasks.workunit.client.0.smithi016.stdout:1/448: link d2/de/d6e/f8a d2/de/d4d/f94 0 2024-08-01T06:56:19.638 INFO:tasks.workunit.client.0.smithi016.stdout:2/429: rename d0/d8/d6b/l7a to d0/d8/d1b/d74/l8e 0 2024-08-01T06:56:19.640 INFO:tasks.workunit.client.0.smithi016.stdout:8/336: creat d5/d8/d1a/d24/d48/d69/f78 x:0 0 0 2024-08-01T06:56:19.642 INFO:tasks.workunit.client.0.smithi016.stdout:7/353: dwrite d7/db/d17/d72/d1c/d1d/d40/f55 [0,4194304] 0 2024-08-01T06:56:19.644 INFO:tasks.workunit.client.0.smithi016.stdout:4/356: rename d0/d2/dc/d12/d29/d3c/c71 to d0/d2/dc/d12/c78 0 2024-08-01T06:56:19.645 INFO:tasks.workunit.client.0.smithi016.stdout:4/357: stat d0/l44 0 2024-08-01T06:56:19.645 INFO:tasks.workunit.client.0.smithi016.stdout:2/430: readlink d0/d16/d20/l6f 0 2024-08-01T06:56:19.650 INFO:tasks.workunit.client.0.smithi016.stdout:3/277: read d9/da/f47 [32043,75087] 0 2024-08-01T06:56:19.652 INFO:tasks.workunit.client.0.smithi016.stdout:7/354: rename d7/db/d1a to d7/db/d17/d72/d1c/d79/d8f 0 2024-08-01T06:56:19.653 INFO:tasks.workunit.client.0.smithi016.stdout:8/337: dwrite d5/d8/d1a/d59/f5a [0,4194304] 0 2024-08-01T06:56:19.657 INFO:tasks.workunit.client.0.smithi016.stdout:4/358: dwrite d0/d2/dc/d12/f24 [0,4194304] 0 2024-08-01T06:56:19.659 INFO:tasks.workunit.client.0.smithi016.stdout:4/359: stat d0/d17/f30 0 2024-08-01T06:56:19.667 INFO:tasks.workunit.client.0.smithi016.stdout:8/338: chown d5/d8/d1a/d24/l46 5005 1 2024-08-01T06:56:19.669 INFO:tasks.workunit.client.0.smithi016.stdout:3/278: dread d9/da/df/d2a/f43 [0,4194304] 0 2024-08-01T06:56:19.672 INFO:tasks.workunit.client.0.smithi016.stdout:4/360: write d0/d2/dc/d12/d29/d3c/f69 [1192084,104400] 0 2024-08-01T06:56:19.672 INFO:tasks.workunit.client.0.smithi016.stdout:8/339: write d5/d8/d1a/d24/f2b [1078318,48287] 0 2024-08-01T06:56:19.673 INFO:tasks.workunit.client.0.smithi016.stdout:7/355: dwrite f5 [4194304,4194304] 0 2024-08-01T06:56:19.676 INFO:tasks.workunit.client.0.smithi016.stdout:4/361: write d0/d2/dc/d12/d29/d3c/f55 [4914,102903] 0 2024-08-01T06:56:19.682 INFO:tasks.workunit.client.0.smithi016.stdout:0/284: truncate d10/d11/d37/f55 1694590 0 2024-08-01T06:56:19.686 INFO:tasks.workunit.client.0.smithi016.stdout:3/279: getdents d9/da/df/d12 0 2024-08-01T06:56:19.691 INFO:tasks.workunit.client.0.smithi016.stdout:8/340: dwrite d5/dc/d3e/f73 [4194304,4194304] 0 2024-08-01T06:56:19.692 INFO:tasks.workunit.client.0.smithi016.stdout:3/280: chown d9/da/df/c4d 257201693 1 2024-08-01T06:56:19.696 INFO:tasks.workunit.client.0.smithi016.stdout:1/449: truncate d2/f5d 926152 0 2024-08-01T06:56:19.698 INFO:tasks.workunit.client.0.smithi016.stdout:3/281: creat d9/d3e/f5e x:0 0 0 2024-08-01T06:56:19.700 INFO:tasks.workunit.client.0.smithi016.stdout:4/362: dwrite d0/d17/d22/f53 [0,4194304] 0 2024-08-01T06:56:19.702 INFO:tasks.workunit.client.0.smithi016.stdout:8/341: getdents d5/d8/d75 0 2024-08-01T06:56:19.705 INFO:tasks.workunit.client.0.smithi016.stdout:0/285: dwrite d10/f17 [0,4194304] 0 2024-08-01T06:56:19.706 INFO:tasks.workunit.client.0.smithi016.stdout:7/356: dread d7/db/d17/d72/d1e/d26/f49 [4194304,4194304] 0 2024-08-01T06:56:19.708 INFO:tasks.workunit.client.0.smithi016.stdout:2/431: truncate d0/d8/d1b/f29 3715762 0 2024-08-01T06:56:19.710 INFO:tasks.workunit.client.0.smithi016.stdout:7/357: read f5 [5609870,117519] 0 2024-08-01T06:56:19.710 INFO:tasks.workunit.client.0.smithi016.stdout:8/342: read d5/dc/f17 [908522,123048] 0 2024-08-01T06:56:19.710 INFO:tasks.workunit.client.0.smithi016.stdout:4/363: dread d0/d17/d22/f35 [4194304,4194304] 0 2024-08-01T06:56:19.713 INFO:tasks.workunit.client.0.smithi016.stdout:8/343: chown d5/d8/d1a/f29 1759700 1 2024-08-01T06:56:19.713 INFO:tasks.workunit.client.0.smithi016.stdout:1/450: rename d2/de/d32/f59 to d2/d3/d48/f95 0 2024-08-01T06:56:19.718 INFO:tasks.workunit.client.0.smithi016.stdout:0/286: mkdir d10/d11/d37/d58 0 2024-08-01T06:56:19.720 INFO:tasks.workunit.client.0.smithi016.stdout:2/432: truncate d0/f40 4288362 0 2024-08-01T06:56:19.721 INFO:tasks.workunit.client.0.smithi016.stdout:7/358: unlink d7/db/d17/d72/d1c/d79/d8f/l3c 0 2024-08-01T06:56:19.727 INFO:tasks.workunit.client.0.smithi016.stdout:8/344: write d5/f11 [3513152,97464] 0 2024-08-01T06:56:19.727 INFO:tasks.workunit.client.0.smithi016.stdout:1/451: dread d2/d3/f5 [0,4194304] 0 2024-08-01T06:56:19.728 INFO:tasks.workunit.client.0.smithi016.stdout:8/345: stat d5/dc/f17 0 2024-08-01T06:56:19.731 INFO:tasks.workunit.client.0.smithi016.stdout:0/287: readlink d10/d11/d37/l48 0 2024-08-01T06:56:19.733 INFO:tasks.workunit.client.0.smithi016.stdout:2/433: rename d0/d19/l4a to d0/d7d/d8b/l8f 0 2024-08-01T06:56:19.733 INFO:tasks.workunit.client.0.smithi016.stdout:2/434: stat d0/d19/f78 0 2024-08-01T06:56:19.736 INFO:tasks.workunit.client.0.smithi016.stdout:4/364: mkdir d0/d2/dc/d12/d29/d79 0 2024-08-01T06:56:19.738 INFO:tasks.workunit.client.0.smithi016.stdout:2/435: dwrite d0/d16/f2d [0,4194304] 0 2024-08-01T06:56:19.741 INFO:tasks.workunit.client.0.smithi016.stdout:1/452: creat d2/d3/d1f/f96 x:0 0 0 2024-08-01T06:56:19.743 INFO:tasks.workunit.client.0.smithi016.stdout:7/359: creat d7/db/d17/d72/d1c/d1d/d40/d7f/f90 x:0 0 0 2024-08-01T06:56:19.745 INFO:tasks.workunit.client.0.smithi016.stdout:4/365: creat d0/d2/d68/f7a x:0 0 0 2024-08-01T06:56:19.748 INFO:tasks.workunit.client.0.smithi016.stdout:8/346: link d5/d1c/f57 d5/d8/d1a/d24/d48/d60/f79 0 2024-08-01T06:56:19.754 INFO:tasks.workunit.client.0.smithi016.stdout:7/360: chown d7/db/d17/d72/d1e/d26/d2a/f8c 1892236 1 2024-08-01T06:56:19.761 INFO:tasks.workunit.client.0.smithi016.stdout:1/453: mkdir d2/d2f/d97 0 2024-08-01T06:56:19.762 INFO:tasks.workunit.client.0.smithi016.stdout:7/361: creat d7/db/d17/d72/d1c/d79/d8f/d39/d43/f91 x:0 0 0 2024-08-01T06:56:19.764 INFO:tasks.workunit.client.0.smithi016.stdout:1/454: write d2/d3/d48/f53 [611360,130804] 0 2024-08-01T06:56:19.765 INFO:tasks.workunit.client.0.smithi016.stdout:7/362: stat d7/db/d17/d72/d1e/d26/c35 0 2024-08-01T06:56:19.765 INFO:tasks.workunit.client.0.smithi016.stdout:1/455: chown d2/d2f/f87 0 1 2024-08-01T06:56:19.769 INFO:tasks.workunit.client.0.smithi016.stdout:7/363: mknod d7/db/d17/d72/d1c/d79/d8f/c92 0 2024-08-01T06:56:19.770 INFO:tasks.workunit.client.0.smithi016.stdout:7/364: chown d7/db/d17/d72/d1e/d26/c35 1 1 2024-08-01T06:56:19.770 INFO:tasks.workunit.client.0.smithi016.stdout:1/456: rename d2/d3/d1c/f81 to d2/de/d4d/d92/f98 0 2024-08-01T06:56:19.772 INFO:tasks.workunit.client.0.smithi016.stdout:7/365: creat d7/db/d17/d4e/f93 x:0 0 0 2024-08-01T06:56:19.776 INFO:tasks.workunit.client.0.smithi016.stdout:3/282: write d9/da/df/d2a/f38 [3351906,13817] 0 2024-08-01T06:56:19.779 INFO:tasks.workunit.client.0.smithi016.stdout:1/457: creat d2/d3/d41/d49/f99 x:0 0 0 2024-08-01T06:56:19.781 INFO:tasks.workunit.client.0.smithi016.stdout:7/366: dwrite d7/f11 [4194304,4194304] 0 2024-08-01T06:56:19.781 INFO:tasks.workunit.client.0.smithi016.stdout:3/283: write d9/da/df/d2a/f43 [2655400,60454] 0 2024-08-01T06:56:19.783 INFO:tasks.workunit.client.0.smithi016.stdout:1/458: mkdir d2/d3/d1a/d22/d9a 0 2024-08-01T06:56:19.791 INFO:tasks.workunit.client.0.smithi016.stdout:1/459: dread d2/de/d21/f5b [0,4194304] 0 2024-08-01T06:56:19.797 INFO:tasks.workunit.client.0.smithi016.stdout:7/367: mkdir d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94 0 2024-08-01T06:56:19.797 INFO:tasks.workunit.client.0.smithi016.stdout:3/284: dwrite d9/da/df/d12/f25 [0,4194304] 0 2024-08-01T06:56:19.799 INFO:tasks.workunit.client.0.smithi016.stdout:7/368: chown f5 79972 1 2024-08-01T06:56:19.805 INFO:tasks.workunit.client.0.smithi016.stdout:3/285: creat d9/d1c/f5f x:0 0 0 2024-08-01T06:56:19.805 INFO:tasks.workunit.client.0.smithi016.stdout:1/460: dwrite d2/de/f45 [0,4194304] 0 2024-08-01T06:56:19.807 INFO:tasks.workunit.client.0.smithi016.stdout:3/286: write f3 [4468427,83469] 0 2024-08-01T06:56:19.810 INFO:tasks.workunit.client.0.smithi016.stdout:3/287: write d9/da/df/d2a/f38 [652162,111030] 0 2024-08-01T06:56:19.811 INFO:tasks.workunit.client.0.smithi016.stdout:1/461: creat d2/de/d32/f9b x:0 0 0 2024-08-01T06:56:19.813 INFO:tasks.workunit.client.0.smithi016.stdout:1/462: write d2/de/f38 [997699,35907] 0 2024-08-01T06:56:19.815 INFO:tasks.workunit.client.0.smithi016.stdout:3/288: rmdir d9/da/df/d53 39 2024-08-01T06:56:19.824 INFO:tasks.workunit.client.0.smithi016.stdout:1/463: dwrite d2/de/d21/f5b [0,4194304] 0 2024-08-01T06:56:19.824 INFO:tasks.workunit.client.0.smithi016.stdout:2/436: write d0/d19/f4d [1058770,58624] 0 2024-08-01T06:56:19.826 INFO:tasks.workunit.client.0.smithi016.stdout:3/289: dwrite d9/da/df/d12/d20/f26 [0,4194304] 0 2024-08-01T06:56:19.834 INFO:tasks.workunit.client.0.smithi016.stdout:2/437: dwrite d0/d16/f2d [0,4194304] 0 2024-08-01T06:56:19.838 INFO:tasks.workunit.client.0.smithi016.stdout:0/288: dwrite f9 [4194304,4194304] 0 2024-08-01T06:56:19.840 INFO:tasks.workunit.client.0.smithi016.stdout:0/289: chown c1 63460 1 2024-08-01T06:56:19.840 INFO:tasks.workunit.client.0.smithi016.stdout:2/438: fsync d0/d8/f26 0 2024-08-01T06:56:19.846 INFO:tasks.workunit.client.0.smithi016.stdout:4/366: dwrite d0/d2/f11 [0,4194304] 0 2024-08-01T06:56:19.847 INFO:tasks.workunit.client.0.smithi016.stdout:0/290: write d10/d1c/f4e [1957106,118748] 0 2024-08-01T06:56:19.850 INFO:tasks.workunit.client.0.smithi016.stdout:0/291: fsync d10/f33 0 2024-08-01T06:56:19.855 INFO:tasks.workunit.client.0.smithi016.stdout:8/347: dwrite d5/dc/f36 [4194304,4194304] 0 2024-08-01T06:56:19.883 INFO:tasks.workunit.client.0.smithi016.stdout:8/348: fsync d5/dc/f36 0 2024-08-01T06:56:19.885 INFO:tasks.workunit.client.0.smithi016.stdout:2/439: dread d0/d16/f1f [0,4194304] 0 2024-08-01T06:56:19.889 INFO:tasks.workunit.client.0.smithi016.stdout:8/349: mknod d5/d8/d1a/d24/d6a/c7a 0 2024-08-01T06:56:19.890 INFO:tasks.workunit.client.0.smithi016.stdout:2/440: readlink d0/d8/d31/d5e/l65 0 2024-08-01T06:56:19.894 INFO:tasks.workunit.client.0.smithi016.stdout:2/441: mkdir d0/d8/d1b/d74/d90 0 2024-08-01T06:56:19.897 INFO:tasks.workunit.client.0.smithi016.stdout:2/442: fdatasync d0/d8/d31/f51 0 2024-08-01T06:56:19.909 INFO:tasks.workunit.client.0.smithi016.stdout:0/292: dwrite d10/d11/f15 [0,4194304] 0 2024-08-01T06:56:19.913 INFO:tasks.workunit.client.0.smithi016.stdout:8/350: truncate d5/d8/d1a/d24/f19 3357718 0 2024-08-01T06:56:19.914 INFO:tasks.workunit.client.0.smithi016.stdout:0/293: getdents d10/d11/d37/d53 0 2024-08-01T06:56:19.916 INFO:tasks.workunit.client.0.smithi016.stdout:1/464: write d2/de/d32/d43/f54 [1616160,117526] 0 2024-08-01T06:56:19.917 INFO:tasks.workunit.client.0.smithi016.stdout:2/443: write d0/d8/f26 [618507,111019] 0 2024-08-01T06:56:19.919 INFO:tasks.workunit.client.0.smithi016.stdout:8/351: symlink d5/d8/d1a/d59/l7b 0 2024-08-01T06:56:19.920 INFO:tasks.workunit.client.0.smithi016.stdout:0/294: creat d10/d11/d37/d58/f59 x:0 0 0 2024-08-01T06:56:19.921 INFO:tasks.workunit.client.0.smithi016.stdout:8/352: chown d5/d8/d1a/d24/l46 7 1 2024-08-01T06:56:19.924 INFO:tasks.workunit.client.0.smithi016.stdout:1/465: dread d2/f2a [4194304,4194304] 0 2024-08-01T06:56:19.926 INFO:tasks.workunit.client.0.smithi016.stdout:8/353: unlink d5/d1c/l3d 0 2024-08-01T06:56:19.928 INFO:tasks.workunit.client.0.smithi016.stdout:8/354: read - d5/d8/d1a/d24/d48/d60/f6d zero size 2024-08-01T06:56:19.929 INFO:tasks.workunit.client.0.smithi016.stdout:8/355: chown d5/dc/c41 1964 1 2024-08-01T06:56:19.933 INFO:tasks.workunit.client.0.smithi016.stdout:0/295: creat d10/f5a x:0 0 0 2024-08-01T06:56:19.934 INFO:tasks.workunit.client.0.smithi016.stdout:8/356: creat d5/d8/d1a/d24/d48/f7c x:0 0 0 2024-08-01T06:56:19.935 INFO:tasks.workunit.client.0.smithi016.stdout:1/466: fsync d2/de/f82 0 2024-08-01T06:56:19.937 INFO:tasks.workunit.client.0.smithi016.stdout:1/467: chown d2/d2f/f7a 108 1 2024-08-01T06:56:19.937 INFO:tasks.workunit.client.0.smithi016.stdout:8/357: symlink d5/d8/d1a/d59/l7d 0 2024-08-01T06:56:19.939 INFO:tasks.workunit.client.0.smithi016.stdout:2/444: dread d0/d8/d1b/f1c [0,4194304] 0 2024-08-01T06:56:19.939 INFO:tasks.workunit.client.0.smithi016.stdout:8/358: read - d5/d8/d1a/d24/d48/d69/f78 zero size 2024-08-01T06:56:19.940 INFO:tasks.workunit.client.0.smithi016.stdout:8/359: chown d5/d8 16227227 1 2024-08-01T06:56:19.940 INFO:tasks.workunit.client.0.smithi016.stdout:0/296: rename d10/d11/d37/d50/c51 to d10/d11/d37/d58/c5b 0 2024-08-01T06:56:19.947 INFO:tasks.workunit.client.0.smithi016.stdout:8/360: symlink d5/d8/d1a/l7e 0 2024-08-01T06:56:19.950 INFO:tasks.workunit.client.0.smithi016.stdout:2/445: dwrite d0/d8/d22/f8c [0,4194304] 0 2024-08-01T06:56:19.950 INFO:tasks.workunit.client.0.smithi016.stdout:0/297: dread d10/d11/f15 [0,4194304] 0 2024-08-01T06:56:19.958 INFO:tasks.workunit.client.0.smithi016.stdout:2/446: rmdir d0/d16/d20/d2e/d68 39 2024-08-01T06:56:19.961 INFO:tasks.workunit.client.0.smithi016.stdout:2/447: write d0/d16/f64 [4113071,58892] 0 2024-08-01T06:56:19.968 INFO:tasks.workunit.client.0.smithi016.stdout:0/298: dwrite d10/d11/f15 [0,4194304] 0 2024-08-01T06:56:19.968 INFO:tasks.workunit.client.0.smithi016.stdout:2/448: truncate d0/d16/d20/d2e/d3b/d45/f7b 472046 0 2024-08-01T06:56:19.975 INFO:tasks.workunit.client.0.smithi016.stdout:0/299: mkdir d10/d5c 0 2024-08-01T06:56:19.976 INFO:tasks.workunit.client.0.smithi016.stdout:8/361: mknod d5/d8/d1a/d24/d48/c7f 0 2024-08-01T06:56:19.982 INFO:tasks.workunit.client.0.smithi016.stdout:0/300: symlink d10/d11/d37/l5d 0 2024-08-01T06:56:19.985 INFO:tasks.workunit.client.0.smithi016.stdout:2/449: dwrite d0/d19/f58 [4194304,4194304] 0 2024-08-01T06:56:19.989 INFO:tasks.workunit.client.0.smithi016.stdout:0/301: unlink d10/d11/d37/d58/c5b 0 2024-08-01T06:56:19.996 INFO:tasks.workunit.client.0.smithi016.stdout:2/450: mknod d0/d16/d20/d2e/d68/c91 0 2024-08-01T06:56:20.006 INFO:tasks.workunit.client.0.smithi016.stdout:0/302: truncate d10/d1c/f27 21601 0 2024-08-01T06:56:20.012 INFO:tasks.workunit.client.0.smithi016.stdout:2/451: dwrite d0/d19/f4c [0,4194304] 0 2024-08-01T06:56:20.017 INFO:tasks.workunit.client.0.smithi016.stdout:0/303: link d10/d11/d37/c3a d10/d11/c5e 0 2024-08-01T06:56:20.021 INFO:tasks.workunit.client.0.smithi016.stdout:2/452: unlink d0/d16/d20/f57 0 2024-08-01T06:56:20.022 INFO:tasks.workunit.client.0.smithi016.stdout:0/304: mknod d10/d11/d37/d58/c5f 0 2024-08-01T06:56:20.024 INFO:tasks.workunit.client.0.smithi016.stdout:0/305: truncate d10/d11/f4d 1024011 0 2024-08-01T06:56:20.027 INFO:tasks.workunit.client.0.smithi016.stdout:2/453: dwrite d0/d8/f52 [0,4194304] 0 2024-08-01T06:56:20.040 INFO:tasks.workunit.client.0.smithi016.stdout:2/454: dwrite d0/d8/d1b/d74/f81 [0,4194304] 0 2024-08-01T06:56:20.049 INFO:tasks.workunit.client.0.smithi016.stdout:2/455: truncate d0/d19/f78 743355 0 2024-08-01T06:56:20.063 INFO:tasks.workunit.client.0.smithi016.stdout:2/456: dread d0/d16/f50 [0,4194304] 0 2024-08-01T06:56:20.067 INFO:tasks.workunit.client.0.smithi016.stdout:2/457: symlink d0/d8/d6b/l92 0 2024-08-01T06:56:20.070 INFO:tasks.workunit.client.0.smithi016.stdout:2/458: chown d0/c7 7 1 2024-08-01T06:56:20.076 INFO:tasks.workunit.client.0.smithi016.stdout:2/459: rename d0/d19 to d0/d8/d1b/d74/d90/d93 0 2024-08-01T06:56:20.079 INFO:tasks.workunit.client.0.smithi016.stdout:2/460: dread d0/d16/f41 [0,4194304] 0 2024-08-01T06:56:20.080 INFO:tasks.workunit.client.0.smithi016.stdout:2/461: readlink d0/d8/d31/d5e/l65 0 2024-08-01T06:56:20.082 INFO:tasks.workunit.client.0.smithi016.stdout:2/462: read d0/f40 [1616362,12250] 0 2024-08-01T06:56:20.085 INFO:tasks.workunit.client.0.smithi016.stdout:2/463: rmdir d0/d8/d22 39 2024-08-01T06:56:20.088 INFO:tasks.workunit.client.0.smithi016.stdout:2/464: mknod d0/d16/d20/d2e/d3b/d45/c94 0 2024-08-01T06:56:20.094 INFO:tasks.workunit.client.0.smithi016.stdout:9/286: sync 2024-08-01T06:56:20.095 INFO:tasks.workunit.client.0.smithi016.stdout:2/465: dwrite d0/f3e [0,4194304] 0 2024-08-01T06:56:20.096 INFO:tasks.workunit.client.0.smithi016.stdout:9/287: creat d3/d9/df/d16/f62 x:0 0 0 2024-08-01T06:56:20.100 INFO:tasks.workunit.client.0.smithi016.stdout:9/288: symlink d3/d9/db/d3e/d40/d4e/l63 0 2024-08-01T06:56:20.102 INFO:tasks.workunit.client.0.smithi016.stdout:9/289: truncate d3/d9/df/d16/f62 547875 0 2024-08-01T06:56:20.103 INFO:tasks.workunit.client.0.smithi016.stdout:2/466: link d0/d16/f50 d0/d8/d1b/d74/f95 0 2024-08-01T06:56:20.104 INFO:tasks.workunit.client.0.smithi016.stdout:9/290: mknod d3/d9/db/d3e/d40/d4e/c64 0 2024-08-01T06:56:20.108 INFO:tasks.workunit.client.0.smithi016.stdout:9/291: unlink d3/d9/df/f1c 0 2024-08-01T06:56:20.113 INFO:tasks.workunit.client.0.smithi016.stdout:2/467: link d0/d16/l71 d0/d16/d20/d2e/l96 0 2024-08-01T06:56:20.116 INFO:tasks.workunit.client.0.smithi016.stdout:9/292: dwrite d3/d9/db/f5f [0,4194304] 0 2024-08-01T06:56:20.117 INFO:tasks.workunit.client.0.smithi016.stdout:2/468: creat d0/d16/d20/d2e/f97 x:0 0 0 2024-08-01T06:56:20.117 INFO:tasks.workunit.client.0.smithi016.stdout:9/293: chown d3/d4/d57 22791 1 2024-08-01T06:56:20.123 INFO:tasks.workunit.client.0.smithi016.stdout:2/469: rename d0/d8/f33 to d0/d8/d22/f98 0 2024-08-01T06:56:20.124 INFO:tasks.workunit.client.0.smithi016.stdout:9/294: creat d3/f65 x:0 0 0 2024-08-01T06:56:20.128 INFO:tasks.workunit.client.0.smithi016.stdout:9/295: unlink d3/d9/df/d38/l43 0 2024-08-01T06:56:20.129 INFO:tasks.workunit.client.0.smithi016.stdout:2/470: dwrite d0/d16/f2d [0,4194304] 0 2024-08-01T06:56:20.131 INFO:tasks.workunit.client.0.smithi016.stdout:2/471: chown d0/d16/d20/d2e/d3b/l60 6175791 1 2024-08-01T06:56:20.133 INFO:tasks.workunit.client.0.smithi016.stdout:9/296: creat d3/d9/db/d3e/f66 x:0 0 0 2024-08-01T06:56:20.134 INFO:tasks.workunit.client.0.smithi016.stdout:9/297: chown d3/d9/df/d16/f62 3 1 2024-08-01T06:56:20.134 INFO:tasks.workunit.client.0.smithi016.stdout:2/472: mkdir d0/d8/d1b/d74/d99 0 2024-08-01T06:56:20.135 INFO:tasks.workunit.client.0.smithi016.stdout:9/298: write d3/d9/db/dc/f42 [1024071,56520] 0 2024-08-01T06:56:20.137 INFO:tasks.workunit.client.0.smithi016.stdout:2/473: mknod d0/d16/d20/d2e/d3b/d45/c9a 0 2024-08-01T06:56:20.138 INFO:tasks.workunit.client.0.smithi016.stdout:2/474: readlink d0/d8/d1b/d74/l8e 0 2024-08-01T06:56:20.140 INFO:tasks.workunit.client.0.smithi016.stdout:2/475: rmdir d0/d8/d31/d5e 39 2024-08-01T06:56:20.144 INFO:tasks.workunit.client.0.smithi016.stdout:2/476: rename d0/d8/d1b/d74/d90/d93/f56 to d0/d8/d22/f9b 0 2024-08-01T06:56:20.148 INFO:tasks.workunit.client.0.smithi016.stdout:2/477: creat d0/f9c x:0 0 0 2024-08-01T06:56:20.151 INFO:tasks.workunit.client.0.smithi016.stdout:2/478: symlink d0/d16/d20/d2e/l9d 0 2024-08-01T06:56:20.158 INFO:tasks.workunit.client.0.smithi016.stdout:2/479: dwrite d0/f9c [0,4194304] 0 2024-08-01T06:56:20.159 INFO:tasks.workunit.client.0.smithi016.stdout:2/480: write d0/d8/f52 [3105506,11637] 0 2024-08-01T06:56:20.163 INFO:tasks.workunit.client.0.smithi016.stdout:2/481: symlink d0/d8/d1b/l9e 0 2024-08-01T06:56:20.167 INFO:tasks.workunit.client.0.smithi016.stdout:2/482: rmdir d0/d8/d31/d5e 39 2024-08-01T06:56:20.179 INFO:tasks.workunit.client.0.smithi016.stdout:2/483: dwrite d0/d8/d1b/f29 [4194304,4194304] 0 2024-08-01T06:56:20.182 INFO:tasks.workunit.client.0.smithi016.stdout:2/484: symlink d0/d16/d20/d2e/d3b/d45/l9f 0 2024-08-01T06:56:20.193 INFO:tasks.workunit.client.0.smithi016.stdout:2/485: dread d0/d8/d1b/f29 [0,4194304] 0 2024-08-01T06:56:20.194 INFO:tasks.workunit.client.0.smithi016.stdout:2/486: write d0/d8/d1b/f5c [115641,108237] 0 2024-08-01T06:56:20.335 INFO:tasks.workunit.client.0.smithi016.stdout:2/487: getdents d0/d7d/d8b 0 2024-08-01T06:56:20.346 INFO:tasks.workunit.client.0.smithi016.stdout:2/488: dwrite d0/d8/d22/f98 [0,4194304] 0 2024-08-01T06:56:20.350 INFO:tasks.workunit.client.0.smithi016.stdout:2/489: creat d0/d8/d1b/d74/d99/fa0 x:0 0 0 2024-08-01T06:56:20.357 INFO:tasks.workunit.client.0.smithi016.stdout:2/490: dwrite d0/d16/f64 [0,4194304] 0 2024-08-01T06:56:20.361 INFO:tasks.workunit.client.0.smithi016.stdout:2/491: dread d0/d8/f52 [0,4194304] 0 2024-08-01T06:56:20.363 INFO:tasks.workunit.client.0.smithi016.stdout:2/492: fdatasync d0/d16/f41 0 2024-08-01T06:56:20.375 INFO:tasks.workunit.client.0.smithi016.stdout:2/493: rename d0/d16/d20/c89 to d0/d16/d20/d2e/ca1 0 2024-08-01T06:56:20.376 INFO:tasks.workunit.client.0.smithi016.stdout:2/494: fsync d0/d8/f52 0 2024-08-01T06:56:20.383 INFO:tasks.workunit.client.0.smithi016.stdout:2/495: dwrite d0/d8/f18 [0,4194304] 0 2024-08-01T06:56:20.389 INFO:tasks.workunit.client.0.smithi016.stdout:6/476: sync 2024-08-01T06:56:20.390 INFO:tasks.workunit.client.0.smithi016.stdout:6/477: readlink d1/d8/d1b/d22/d2d/l3a 0 2024-08-01T06:56:20.393 INFO:tasks.workunit.client.0.smithi016.stdout:2/496: write d0/d8/d1b/d74/d90/d93/f2f [597875,66036] 0 2024-08-01T06:56:20.401 INFO:tasks.workunit.client.0.smithi016.stdout:2/497: dwrite d0/d8/d1b/d74/d90/d93/f2f [0,4194304] 0 2024-08-01T06:56:20.405 INFO:tasks.workunit.client.0.smithi016.stdout:2/498: read d0/d8/f11 [3814394,46193] 0 2024-08-01T06:56:20.407 INFO:tasks.workunit.client.0.smithi016.stdout:2/499: symlink d0/d8/d1b/d74/la2 0 2024-08-01T06:56:20.411 INFO:tasks.workunit.client.0.smithi016.stdout:2/500: dread d0/d8/d1b/d74/d90/d93/f78 [0,4194304] 0 2024-08-01T06:56:20.412 INFO:tasks.workunit.client.0.smithi016.stdout:2/501: chown d0/d8/d1b/f5c 426 1 2024-08-01T06:56:20.414 INFO:tasks.workunit.client.0.smithi016.stdout:2/502: mknod d0/d8/d1b/d74/d90/d93/ca3 0 2024-08-01T06:56:20.416 INFO:tasks.workunit.client.0.smithi016.stdout:2/503: creat d0/d16/d20/d2e/d3b/fa4 x:0 0 0 2024-08-01T06:56:20.417 INFO:tasks.workunit.client.0.smithi016.stdout:2/504: dread - d0/d16/d20/d2e/f4f zero size 2024-08-01T06:56:20.424 INFO:tasks.workunit.client.0.smithi016.stdout:2/505: rename d0/d16/d20/d2e/d68/f8d to d0/d8/d31/d5e/fa5 0 2024-08-01T06:56:20.425 INFO:tasks.workunit.client.0.smithi016.stdout:2/506: write d0/d8/f52 [1232065,79089] 0 2024-08-01T06:56:20.439 INFO:tasks.workunit.client.0.smithi016.stdout:2/507: dread d0/d8/d22/f88 [0,4194304] 0 2024-08-01T06:56:20.450 INFO:tasks.workunit.client.0.smithi016.stdout:2/508: dread d0/d8/d1b/d74/d90/d93/f58 [0,4194304] 0 2024-08-01T06:56:20.451 INFO:tasks.workunit.client.0.smithi016.stdout:2/509: chown d0/d8/c6c 52912 1 2024-08-01T06:56:20.734 INFO:tasks.workunit.client.0.smithi016.stdout:5/428: sync 2024-08-01T06:56:20.741 INFO:tasks.workunit.client.0.smithi016.stdout:5/429: creat d1/d2/d20/d72/f94 x:0 0 0 2024-08-01T06:56:20.763 INFO:tasks.workunit.client.0.smithi016.stdout:5/430: dwrite d1/d2/d6/d9/d19/f40 [0,4194304] 0 2024-08-01T06:56:20.766 INFO:tasks.workunit.client.0.smithi016.stdout:5/431: write d1/d2/f31 [3225997,59678] 0 2024-08-01T06:56:20.767 INFO:tasks.workunit.client.0.smithi016.stdout:5/432: chown d1/d12/d3e/f62 468 1 2024-08-01T06:56:20.772 INFO:tasks.workunit.client.0.smithi016.stdout:5/433: truncate d1/d2/d6/d9/d1b/f28 94484 0 2024-08-01T06:56:20.788 INFO:tasks.workunit.client.0.smithi016.stdout:5/434: dread d1/d2/d6/fd [0,4194304] 0 2024-08-01T06:56:20.791 INFO:tasks.workunit.client.0.smithi016.stdout:5/435: mknod d1/d12/d7d/c95 0 2024-08-01T06:56:20.793 INFO:tasks.workunit.client.0.smithi016.stdout:5/436: creat d1/d12/d52/f96 x:0 0 0 2024-08-01T06:56:20.803 INFO:tasks.workunit.client.0.smithi016.stdout:3/290: sync 2024-08-01T06:56:20.804 INFO:tasks.workunit.client.0.smithi016.stdout:4/367: sync 2024-08-01T06:56:20.804 INFO:tasks.workunit.client.0.smithi016.stdout:7/369: sync 2024-08-01T06:56:20.806 INFO:tasks.workunit.client.0.smithi016.stdout:7/370: stat d7/db/d17/d72/d1c/d1d/f65 0 2024-08-01T06:56:20.806 INFO:tasks.workunit.client.0.smithi016.stdout:7/371: chown d7/c50 167323505 1 2024-08-01T06:56:20.811 INFO:tasks.workunit.client.0.smithi016.stdout:4/368: write d0/d2/dc/d12/f72 [1762537,103098] 0 2024-08-01T06:56:20.818 INFO:tasks.workunit.client.0.smithi016.stdout:5/437: write d1/d12/d3e/f62 [1276868,44686] 0 2024-08-01T06:56:20.818 INFO:tasks.workunit.client.0.smithi016.stdout:4/369: write d0/d2/f6d [1170223,96223] 0 2024-08-01T06:56:20.827 INFO:tasks.workunit.client.0.smithi016.stdout:3/291: dwrite d9/da/f47 [0,4194304] 0 2024-08-01T06:56:20.827 INFO:tasks.workunit.client.0.smithi016.stdout:7/372: getdents d7/db/d17/d72/d1c/d79/d8f/d39 0 2024-08-01T06:56:20.830 INFO:tasks.workunit.client.0.smithi016.stdout:4/370: symlink d0/d2/dc/l7b 0 2024-08-01T06:56:20.834 INFO:tasks.workunit.client.0.smithi016.stdout:7/373: fsync d7/db/d17/d72/d1e/d26/f32 0 2024-08-01T06:56:20.837 INFO:tasks.workunit.client.0.smithi016.stdout:4/371: creat d0/d17/d38/f7c x:0 0 0 2024-08-01T06:56:20.841 INFO:tasks.workunit.client.0.smithi016.stdout:7/374: unlink d7/db/d17/d72/d1c/d4f/f75 0 2024-08-01T06:56:20.842 INFO:tasks.workunit.client.0.smithi016.stdout:5/438: getdents d1/d2/d6/d9/d1b 0 2024-08-01T06:56:20.843 INFO:tasks.workunit.client.0.smithi016.stdout:3/292: creat d9/da/df/d2a/d49/f60 x:0 0 0 2024-08-01T06:56:20.847 INFO:tasks.workunit.client.0.smithi016.stdout:7/375: mknod d7/db/d17/d72/d1e/d26/d2a/c95 0 2024-08-01T06:56:20.847 INFO:tasks.workunit.client.0.smithi016.stdout:4/372: dwrite d0/d2/dc/f15 [0,4194304] 0 2024-08-01T06:56:20.849 INFO:tasks.workunit.client.0.smithi016.stdout:7/376: fsync d7/f5b 0 2024-08-01T06:56:20.851 INFO:tasks.workunit.client.0.smithi016.stdout:4/373: dread - d0/d2/d36/f70 zero size 2024-08-01T06:56:20.857 INFO:tasks.workunit.client.0.smithi016.stdout:5/439: dwrite d1/d2/d23/f81 [0,4194304] 0 2024-08-01T06:56:20.858 INFO:tasks.workunit.client.0.smithi016.stdout:4/374: symlink d0/d17/d67/l7d 0 2024-08-01T06:56:20.862 INFO:tasks.workunit.client.0.smithi016.stdout:5/440: mknod d1/d2/d6/d9/d1b/c97 0 2024-08-01T06:56:20.862 INFO:tasks.workunit.client.0.smithi016.stdout:3/293: getdents d9/da/df/d2a/d49 0 2024-08-01T06:56:20.871 INFO:tasks.workunit.client.0.smithi016.stdout:3/294: mkdir d9/da/df/d2a/d49/d61 0 2024-08-01T06:56:20.871 INFO:tasks.workunit.client.0.smithi016.stdout:4/375: getdents d0/d17/d22/d73 0 2024-08-01T06:56:20.872 INFO:tasks.workunit.client.0.smithi016.stdout:7/377: write d7/db/f13 [73302,56239] 0 2024-08-01T06:56:20.874 INFO:tasks.workunit.client.0.smithi016.stdout:7/378: dread - d7/db/d17/d72/f7a zero size 2024-08-01T06:56:20.877 INFO:tasks.workunit.client.0.smithi016.stdout:5/441: dread d1/d2/f80 [0,4194304] 0 2024-08-01T06:56:20.879 INFO:tasks.workunit.client.0.smithi016.stdout:7/379: getdents d7 0 2024-08-01T06:56:20.880 INFO:tasks.workunit.client.0.smithi016.stdout:5/442: stat d1/d2/d6/d9/lf 0 2024-08-01T06:56:20.881 INFO:tasks.workunit.client.0.smithi016.stdout:5/443: unlink d1/d12/d7d/c95 0 2024-08-01T06:56:20.883 INFO:tasks.workunit.client.0.smithi016.stdout:3/295: getdents d9/da/df/d2a/d49 0 2024-08-01T06:56:20.884 INFO:tasks.workunit.client.0.smithi016.stdout:4/376: truncate d0/d17/f30 2846150 0 2024-08-01T06:56:20.886 INFO:tasks.workunit.client.0.smithi016.stdout:5/444: dread - d1/d2/d6/f6b zero size 2024-08-01T06:56:20.886 INFO:tasks.workunit.client.0.smithi016.stdout:9/299: sync 2024-08-01T06:56:20.886 INFO:tasks.workunit.client.0.smithi016.stdout:8/362: sync 2024-08-01T06:56:20.886 INFO:tasks.workunit.client.0.smithi016.stdout:6/478: sync 2024-08-01T06:56:20.886 INFO:tasks.workunit.client.0.smithi016.stdout:1/468: sync 2024-08-01T06:56:20.886 INFO:tasks.workunit.client.0.smithi016.stdout:0/306: sync 2024-08-01T06:56:20.886 INFO:tasks.workunit.client.0.smithi016.stdout:2/510: sync 2024-08-01T06:56:20.887 INFO:tasks.workunit.client.0.smithi016.stdout:7/380: dwrite d7/f5b [0,4194304] 0 2024-08-01T06:56:20.890 INFO:tasks.workunit.client.0.smithi016.stdout:1/469: dread - d2/d3/f84 zero size 2024-08-01T06:56:20.890 INFO:tasks.workunit.client.0.smithi016.stdout:0/307: write d10/f17 [2747253,12254] 0 2024-08-01T06:56:20.892 INFO:tasks.workunit.client.0.smithi016.stdout:8/363: read d5/dc/f36 [7723731,83691] 0 2024-08-01T06:56:20.895 INFO:tasks.workunit.client.0.smithi016.stdout:3/296: rename d9/da/df/f46 to d9/da/df/d2a/d49/f62 0 2024-08-01T06:56:20.897 INFO:tasks.workunit.client.0.smithi016.stdout:6/479: write d1/d9/d60/d68/d79/f95 [438468,97538] 0 2024-08-01T06:56:20.898 INFO:tasks.workunit.client.0.smithi016.stdout:0/308: stat d10/d11/l38 0 2024-08-01T06:56:20.901 INFO:tasks.workunit.client.0.smithi016.stdout:8/364: chown d5/l6c 0 1 2024-08-01T06:56:20.904 INFO:tasks.workunit.client.0.smithi016.stdout:2/511: creat d0/d16/d20/d2e/d68/fa6 x:0 0 0 2024-08-01T06:56:20.907 INFO:tasks.workunit.client.0.smithi016.stdout:4/377: write d0/d17/d38/f43 [50839,32942] 0 2024-08-01T06:56:20.908 INFO:tasks.workunit.client.0.smithi016.stdout:7/381: truncate d7/db/d17/d72/d1c/d79/d8f/f2e 427444 0 2024-08-01T06:56:20.913 INFO:tasks.workunit.client.0.smithi016.stdout:1/470: dwrite d2/de/d4d/f8e [0,4194304] 0 2024-08-01T06:56:20.914 INFO:tasks.workunit.client.0.smithi016.stdout:5/445: dwrite d1/d2/f6e [0,4194304] 0 2024-08-01T06:56:20.914 INFO:tasks.workunit.client.0.smithi016.stdout:3/297: creat d9/da/df/d12/d20/d5c/f63 x:0 0 0 2024-08-01T06:56:20.916 INFO:tasks.workunit.client.0.smithi016.stdout:9/300: dread d3/d9/db/dc/f2c [0,4194304] 0 2024-08-01T06:56:20.917 INFO:tasks.workunit.client.0.smithi016.stdout:6/480: mkdir d1/d9/d60/d68/d79/d93/daf 0 2024-08-01T06:56:20.917 INFO:tasks.workunit.client.0.smithi016.stdout:7/382: chown d7/db/d17/d72/d1c/d1d/d40/d67 55 1 2024-08-01T06:56:20.920 INFO:tasks.workunit.client.0.smithi016.stdout:8/365: symlink d5/d8/d1a/l80 0 2024-08-01T06:56:20.923 INFO:tasks.workunit.client.0.smithi016.stdout:2/512: mkdir d0/d8/d31/da7 0 2024-08-01T06:56:20.924 INFO:tasks.workunit.client.0.smithi016.stdout:1/471: write d2/d3/d41/d49/f99 [403999,127584] 0 2024-08-01T06:56:20.927 INFO:tasks.workunit.client.0.smithi016.stdout:5/446: write d1/d12/d52/f96 [249289,14134] 0 2024-08-01T06:56:20.929 INFO:tasks.workunit.client.0.smithi016.stdout:4/378: dwrite d0/d17/d22/f53 [0,4194304] 0 2024-08-01T06:56:20.930 INFO:tasks.workunit.client.0.smithi016.stdout:0/309: creat d10/d11/d41/f60 x:0 0 0 2024-08-01T06:56:20.930 INFO:tasks.workunit.client.0.smithi016.stdout:3/298: creat d9/d4e/f64 x:0 0 0 2024-08-01T06:56:20.931 INFO:tasks.workunit.client.0.smithi016.stdout:0/310: fsync d10/d11/f15 0 2024-08-01T06:56:20.932 INFO:tasks.workunit.client.0.smithi016.stdout:5/447: write d1/d2/d6/d9/d19/d7a/f8f [507469,39720] 0 2024-08-01T06:56:20.932 INFO:tasks.workunit.client.0.smithi016.stdout:3/299: stat d9/da/f47 0 2024-08-01T06:56:20.933 INFO:tasks.workunit.client.0.smithi016.stdout:0/311: readlink d10/d11/l34 0 2024-08-01T06:56:20.938 INFO:tasks.workunit.client.0.smithi016.stdout:7/383: creat d7/db/d17/d72/d1c/d1d/d40/d58/f96 x:0 0 0 2024-08-01T06:56:20.946 INFO:tasks.workunit.client.0.smithi016.stdout:3/300: chown d9/da/df/d12/d20/d3c/l51 337772 1 2024-08-01T06:56:20.946 INFO:tasks.workunit.client.0.smithi016.stdout:6/481: symlink d1/d9/d3f/d7d/d8a/da2/lb0 0 2024-08-01T06:56:20.948 INFO:tasks.workunit.client.0.smithi016.stdout:2/513: rename d0/l34 to d0/d8/d22/la8 0 2024-08-01T06:56:20.949 INFO:tasks.workunit.client.0.smithi016.stdout:8/366: mknod d5/dc/d3e/d72/c81 0 2024-08-01T06:56:20.949 INFO:tasks.workunit.client.0.smithi016.stdout:7/384: readlink d7/db/d17/d72/d1c/d1d/d40/d67/l88 0 2024-08-01T06:56:20.951 INFO:tasks.workunit.client.0.smithi016.stdout:7/385: read d7/db/d17/d72/f1b [1039621,6712] 0 2024-08-01T06:56:20.952 INFO:tasks.workunit.client.0.smithi016.stdout:4/379: mknod d0/d17/d22/c7e 0 2024-08-01T06:56:20.953 INFO:tasks.workunit.client.0.smithi016.stdout:9/301: link d3/d9/db/dc/d33/l5d d3/d4/d57/l67 0 2024-08-01T06:56:20.959 INFO:tasks.workunit.client.0.smithi016.stdout:8/367: unlink d5/f11 0 2024-08-01T06:56:20.963 INFO:tasks.workunit.client.0.smithi016.stdout:7/386: mkdir d7/db/d17/d72/d1c/d97 0 2024-08-01T06:56:20.964 INFO:tasks.workunit.client.0.smithi016.stdout:2/514: dwrite d0/d8/d1b/d74/d90/d93/f58 [0,4194304] 0 2024-08-01T06:56:20.966 INFO:tasks.workunit.client.0.smithi016.stdout:6/482: dread d1/d43/f4a [0,4194304] 0 2024-08-01T06:56:20.971 INFO:tasks.workunit.client.0.smithi016.stdout:9/302: creat d3/d9/db/d3e/f68 x:0 0 0 2024-08-01T06:56:20.978 INFO:tasks.workunit.client.0.smithi016.stdout:8/368: fsync d5/d8/d1a/d24/d48/d60/f6d 0 2024-08-01T06:56:20.978 INFO:tasks.workunit.client.0.smithi016.stdout:3/301: write d9/da/df/d2a/d49/f62 [614335,51576] 0 2024-08-01T06:56:20.980 INFO:tasks.workunit.client.0.smithi016.stdout:3/302: rename d9/da to d9/da/d18/d65 22 2024-08-01T06:56:20.981 INFO:tasks.workunit.client.0.smithi016.stdout:2/515: creat d0/d16/d20/d2e/d3b/fa9 x:0 0 0 2024-08-01T06:56:20.981 INFO:tasks.workunit.client.0.smithi016.stdout:4/380: mkdir d0/d17/d22/d7f 0 2024-08-01T06:56:20.983 INFO:tasks.workunit.client.0.smithi016.stdout:5/448: getdents d1 0 2024-08-01T06:56:20.985 INFO:tasks.workunit.client.0.smithi016.stdout:6/483: mkdir d1/d8/d1b/d22/d71/db1 0 2024-08-01T06:56:20.988 INFO:tasks.workunit.client.0.smithi016.stdout:6/484: write d1/d41/f61 [2372210,92354] 0 2024-08-01T06:56:20.989 INFO:tasks.workunit.client.0.smithi016.stdout:4/381: dwrite d0/d17/f39 [8388608,4194304] 0 2024-08-01T06:56:20.991 INFO:tasks.workunit.client.0.smithi016.stdout:8/369: rename d5/d1c/f37 to d5/d8/d1a/d24/d48/d69/f82 0 2024-08-01T06:56:20.997 INFO:tasks.workunit.client.0.smithi016.stdout:6/485: dread d1/d41/f61 [0,4194304] 0 2024-08-01T06:56:21.005 INFO:tasks.workunit.client.0.smithi016.stdout:3/303: mkdir d9/d57/d66 0 2024-08-01T06:56:21.007 INFO:tasks.workunit.client.0.smithi016.stdout:8/370: fdatasync d5/d8/f2e 0 2024-08-01T06:56:21.011 INFO:tasks.workunit.client.0.smithi016.stdout:4/382: write d0/d2/dc/d12/d29/f6c [175531,116047] 0 2024-08-01T06:56:21.012 INFO:tasks.workunit.client.0.smithi016.stdout:1/472: getdents d2/d3 0 2024-08-01T06:56:21.013 INFO:tasks.workunit.client.0.smithi016.stdout:2/516: dwrite d0/d8/d1b/d74/d90/d93/f78 [0,4194304] 0 2024-08-01T06:56:21.015 INFO:tasks.workunit.client.0.smithi016.stdout:5/449: truncate d1/d2/d23/f81 385842 0 2024-08-01T06:56:21.015 INFO:tasks.workunit.client.0.smithi016.stdout:2/517: chown d0/d8/d1b/d74/d90/d93/c82 1375 1 2024-08-01T06:56:21.018 INFO:tasks.workunit.client.0.smithi016.stdout:6/486: rename d1/d9/d60/d68/d79/l81 to d1/d8/d1b/d22/d4e/da9/lb2 0 2024-08-01T06:56:21.021 INFO:tasks.workunit.client.0.smithi016.stdout:8/371: unlink d5/d8/d1a/d24/d48/d60/f6d 0 2024-08-01T06:56:21.024 INFO:tasks.workunit.client.0.smithi016.stdout:8/372: write d5/dc/f36 [4131015,54778] 0 2024-08-01T06:56:21.025 INFO:tasks.workunit.client.0.smithi016.stdout:9/303: getdents d3/d32 0 2024-08-01T06:56:21.025 INFO:tasks.workunit.client.0.smithi016.stdout:5/450: dwrite d1/d2/f43 [0,4194304] 0 2024-08-01T06:56:21.025 INFO:tasks.workunit.client.0.smithi016.stdout:4/383: rmdir d0/d17/d67 39 2024-08-01T06:56:21.031 INFO:tasks.workunit.client.0.smithi016.stdout:1/473: symlink d2/de/d32/d43/l9c 0 2024-08-01T06:56:21.035 INFO:tasks.workunit.client.0.smithi016.stdout:1/474: dread d2/f2a [0,4194304] 0 2024-08-01T06:56:21.036 INFO:tasks.workunit.client.0.smithi016.stdout:2/518: symlink d0/d8/d1b/d74/d90/laa 0 2024-08-01T06:56:21.039 INFO:tasks.workunit.client.0.smithi016.stdout:3/304: mknod d9/da/df/d53/c67 0 2024-08-01T06:56:21.040 INFO:tasks.workunit.client.0.smithi016.stdout:6/487: stat d1/d8/d1b/d22/d36/d7a 0 2024-08-01T06:56:21.042 INFO:tasks.workunit.client.0.smithi016.stdout:8/373: write d5/d8/d1a/d59/f5a [617979,121960] 0 2024-08-01T06:56:21.042 INFO:tasks.workunit.client.0.smithi016.stdout:6/488: chown d1/d8/d1b/d48/l4b 1990284 1 2024-08-01T06:56:21.044 INFO:tasks.workunit.client.0.smithi016.stdout:9/304: mknod d3/d9/db/dc/d33/c69 0 2024-08-01T06:56:21.045 INFO:tasks.workunit.client.0.smithi016.stdout:5/451: symlink d1/d2/d20/d72/l98 0 2024-08-01T06:56:21.049 INFO:tasks.workunit.client.0.smithi016.stdout:1/475: creat d2/de/d21/d3e/f9d x:0 0 0 2024-08-01T06:56:21.049 INFO:tasks.workunit.client.0.smithi016.stdout:2/519: mknod d0/d8/d1b/d74/cab 0 2024-08-01T06:56:21.049 INFO:tasks.workunit.client.0.smithi016.stdout:3/305: dwrite d9/f1f [0,4194304] 0 2024-08-01T06:56:21.050 INFO:tasks.workunit.client.0.smithi016.stdout:6/489: truncate d1/d8/d1b/d22/d36/f98 238521 0 2024-08-01T06:56:21.052 INFO:tasks.workunit.client.0.smithi016.stdout:3/306: chown d9/d1c 108722 1 2024-08-01T06:56:21.052 INFO:tasks.workunit.client.0.smithi016.stdout:9/305: fdatasync d3/d4/fa 0 2024-08-01T06:56:21.056 INFO:tasks.workunit.client.0.smithi016.stdout:5/452: symlink d1/d2/d6/l99 0 2024-08-01T06:56:21.057 INFO:tasks.workunit.client.0.smithi016.stdout:1/476: symlink d2/d88/l9e 0 2024-08-01T06:56:21.057 INFO:tasks.workunit.client.0.smithi016.stdout:4/384: dread d0/d17/f30 [0,4194304] 0 2024-08-01T06:56:21.058 INFO:tasks.workunit.client.0.smithi016.stdout:8/374: mkdir d5/d8/d1a/d24/d48/d6e/d83 0 2024-08-01T06:56:21.059 INFO:tasks.workunit.client.0.smithi016.stdout:4/385: stat d0/d2/dc/c5c 0 2024-08-01T06:56:21.064 INFO:tasks.workunit.client.0.smithi016.stdout:1/477: dwrite d2/de/d21/d3e/f9d [0,4194304] 0 2024-08-01T06:56:21.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:20 smithi089 ceph-mon[36617]: pgmap v24: 65 pgs: 65 active+clean; 2.4 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 62 MiB/s rd, 211 MiB/s wr, 445 op/s 2024-08-01T06:56:21.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:20 smithi016 ceph-mon[29266]: pgmap v24: 65 pgs: 65 active+clean; 2.4 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 62 MiB/s rd, 211 MiB/s wr, 445 op/s 2024-08-01T06:56:21.153 INFO:tasks.workunit.client.0.smithi016.stdout:9/306: rmdir d3/d9/d46 39 2024-08-01T06:56:21.155 INFO:tasks.workunit.client.0.smithi016.stdout:6/490: rename d1/d9/f5c to d1/d8/d1b/d22/d3b/d67/fb3 0 2024-08-01T06:56:21.157 INFO:tasks.workunit.client.0.smithi016.stdout:3/307: creat d9/da/df/d2a/d49/f68 x:0 0 0 2024-08-01T06:56:21.158 INFO:tasks.workunit.client.0.smithi016.stdout:3/308: write d9/da/df/d2a/d49/f60 [726823,89907] 0 2024-08-01T06:56:21.159 INFO:tasks.workunit.client.0.smithi016.stdout:3/309: fdatasync d9/da/df/d12/d20/f35 0 2024-08-01T06:56:21.163 INFO:tasks.workunit.client.0.smithi016.stdout:1/478: rename d2/de/d32/f9b to d2/d3/d1a/d22/f9f 0 2024-08-01T06:56:21.164 INFO:tasks.workunit.client.0.smithi016.stdout:6/491: mknod d1/d43/d88/cb4 0 2024-08-01T06:56:21.165 INFO:tasks.workunit.client.0.smithi016.stdout:6/492: chown d1/d8/l3d 14898 1 2024-08-01T06:56:21.171 INFO:tasks.workunit.client.0.smithi016.stdout:2/520: creat d0/d16/d20/fac x:0 0 0 2024-08-01T06:56:21.172 INFO:tasks.workunit.client.0.smithi016.stdout:2/521: chown d0/d8/d1b/d74 2581387 1 2024-08-01T06:56:21.172 INFO:tasks.workunit.client.0.smithi016.stdout:2/522: dread - d0/d16/d20/d2e/f97 zero size 2024-08-01T06:56:21.173 INFO:tasks.workunit.client.0.smithi016.stdout:2/523: stat d0/d8/d1b/f1c 0 2024-08-01T06:56:21.177 INFO:tasks.workunit.client.0.smithi016.stdout:4/386: truncate d0/d17/f39 10659659 0 2024-08-01T06:56:21.178 INFO:tasks.workunit.client.0.smithi016.stdout:1/479: mkdir d2/d3/da0 0 2024-08-01T06:56:21.179 INFO:tasks.workunit.client.0.smithi016.stdout:5/453: creat d1/d12/f9a x:0 0 0 2024-08-01T06:56:21.179 INFO:tasks.workunit.client.0.smithi016.stdout:1/480: chown d2/d2f/l42 15 1 2024-08-01T06:56:21.180 INFO:tasks.workunit.client.0.smithi016.stdout:4/387: write d0/d2/dc/d12/d29/d3c/f55 [323972,73348] 0 2024-08-01T06:56:21.180 INFO:tasks.workunit.client.0.smithi016.stdout:2/524: dwrite d0/d8/d1b/d74/d90/d93/f2f [0,4194304] 0 2024-08-01T06:56:21.181 INFO:tasks.workunit.client.0.smithi016.stdout:8/375: creat d5/f84 x:0 0 0 2024-08-01T06:56:21.184 INFO:tasks.workunit.client.0.smithi016.stdout:3/310: mkdir d9/da/df/d2a/d69 0 2024-08-01T06:56:21.186 INFO:tasks.workunit.client.0.smithi016.stdout:9/307: creat d3/f6a x:0 0 0 2024-08-01T06:56:21.188 INFO:tasks.workunit.client.0.smithi016.stdout:2/525: write d0/d16/d20/d2e/f4f [732715,29667] 0 2024-08-01T06:56:21.188 INFO:tasks.workunit.client.0.smithi016.stdout:5/454: creat d1/d2/d20/d72/f9b x:0 0 0 2024-08-01T06:56:21.191 INFO:tasks.workunit.client.0.smithi016.stdout:4/388: stat d0/d17/c54 0 2024-08-01T06:56:21.192 INFO:tasks.workunit.client.0.smithi016.stdout:3/311: mknod d9/d4e/c6a 0 2024-08-01T06:56:21.194 INFO:tasks.workunit.client.0.smithi016.stdout:5/455: dread d1/d12/d52/f96 [0,4194304] 0 2024-08-01T06:56:21.196 INFO:tasks.workunit.client.0.smithi016.stdout:2/526: dread d0/d8/f3c [0,4194304] 0 2024-08-01T06:56:21.197 INFO:tasks.workunit.client.0.smithi016.stdout:9/308: unlink d3/de/f3c 0 2024-08-01T06:56:21.197 INFO:tasks.workunit.client.0.smithi016.stdout:6/493: dread d1/d8/d1b/f25 [0,4194304] 0 2024-08-01T06:56:21.198 INFO:tasks.workunit.client.0.smithi016.stdout:9/309: dread - d3/d32/f4d zero size 2024-08-01T06:56:21.199 INFO:tasks.workunit.client.0.smithi016.stdout:2/527: truncate d0/d8/f11 5761407 0 2024-08-01T06:56:21.201 INFO:tasks.workunit.client.0.smithi016.stdout:1/481: symlink d2/d3/d41/d49/d51/la1 0 2024-08-01T06:56:21.208 INFO:tasks.workunit.client.0.smithi016.stdout:4/389: rename d0/d17/d22/c7e to d0/d17/d38/c80 0 2024-08-01T06:56:21.209 INFO:tasks.workunit.client.0.smithi016.stdout:4/390: write d0/d2/d68/f6f [1405537,63839] 0 2024-08-01T06:56:21.210 INFO:tasks.workunit.client.0.smithi016.stdout:6/494: unlink d1/d8/f2c 0 2024-08-01T06:56:21.212 INFO:tasks.workunit.client.0.smithi016.stdout:4/391: truncate d0/d2/f25 5013703 0 2024-08-01T06:56:21.214 INFO:tasks.workunit.client.0.smithi016.stdout:4/392: truncate d0/d2/dc/d12/f24 5241646 0 2024-08-01T06:56:21.215 INFO:tasks.workunit.client.0.smithi016.stdout:1/482: symlink d2/d88/la2 0 2024-08-01T06:56:21.218 INFO:tasks.workunit.client.0.smithi016.stdout:8/376: write d5/d8/d1a/d24/f19 [3747563,31444] 0 2024-08-01T06:56:21.219 INFO:tasks.workunit.client.0.smithi016.stdout:8/377: stat d5/d8/d1a/d24/d48/f7c 0 2024-08-01T06:56:21.221 INFO:tasks.workunit.client.0.smithi016.stdout:8/378: dread - d5/d8/d1a/d24/d48/d60/d63/f71 zero size 2024-08-01T06:56:21.221 INFO:tasks.workunit.client.0.smithi016.stdout:2/528: dread d0/d16/d20/d2e/f46 [0,4194304] 0 2024-08-01T06:56:21.221 INFO:tasks.workunit.client.0.smithi016.stdout:2/529: stat d0/d8/d31/l55 0 2024-08-01T06:56:21.228 INFO:tasks.workunit.client.0.smithi016.stdout:2/530: dwrite d0/d8/d22/f8c [0,4194304] 0 2024-08-01T06:56:21.236 INFO:tasks.workunit.client.0.smithi016.stdout:2/531: dwrite d0/d8/d1b/d74/d99/fa0 [0,4194304] 0 2024-08-01T06:56:21.240 INFO:tasks.workunit.client.0.smithi016.stdout:3/312: truncate d9/da/df/d12/f42 303089 0 2024-08-01T06:56:21.246 INFO:tasks.workunit.client.0.smithi016.stdout:6/495: rename d1/d8/d1b/d22/d3b to d1/d8/d1b/db5 0 2024-08-01T06:56:21.251 INFO:tasks.workunit.client.0.smithi016.stdout:8/379: chown d5/c3c 235610 1 2024-08-01T06:56:21.252 INFO:tasks.workunit.client.0.smithi016.stdout:8/380: chown d5/dc/f17 183 1 2024-08-01T06:56:21.253 INFO:tasks.workunit.client.0.smithi016.stdout:8/381: dread - d5/d8/f68 zero size 2024-08-01T06:56:21.255 INFO:tasks.workunit.client.0.smithi016.stdout:2/532: dread - d0/d16/d20/f87 zero size 2024-08-01T06:56:21.256 INFO:tasks.workunit.client.0.smithi016.stdout:3/313: mkdir d9/da/df/d12/d20/d6b 0 2024-08-01T06:56:21.258 INFO:tasks.workunit.client.0.smithi016.stdout:6/496: read d1/d9/d60/da0/f3c [25534,46581] 0 2024-08-01T06:56:21.259 INFO:tasks.workunit.client.0.smithi016.stdout:4/393: mknod d0/d17/c81 0 2024-08-01T06:56:21.260 INFO:tasks.workunit.client.0.smithi016.stdout:1/483: symlink d2/d3/d1a/d22/d9a/la3 0 2024-08-01T06:56:21.264 INFO:tasks.workunit.client.0.smithi016.stdout:6/497: stat d1/d8/d1b/d22/d36/d7a/l83 0 2024-08-01T06:56:21.266 INFO:tasks.workunit.client.0.smithi016.stdout:3/314: dwrite d9/da/f47 [0,4194304] 0 2024-08-01T06:56:21.268 INFO:tasks.workunit.client.0.smithi016.stdout:2/533: dwrite d0/d8/d1b/d74/d90/d93/f4d [0,4194304] 0 2024-08-01T06:56:21.270 INFO:tasks.workunit.client.0.smithi016.stdout:9/310: getdents d3/d9/d46/d48 0 2024-08-01T06:56:21.271 INFO:tasks.workunit.client.0.smithi016.stdout:4/394: creat d0/d17/d38/f82 x:0 0 0 2024-08-01T06:56:21.271 INFO:tasks.workunit.client.0.smithi016.stdout:3/315: write d9/da/df/d53/f56 [257028,105584] 0 2024-08-01T06:56:21.276 INFO:tasks.workunit.client.0.smithi016.stdout:2/534: chown d0/d8/d1b/d74/d90/d93/c38 24335030 1 2024-08-01T06:56:21.278 INFO:tasks.workunit.client.0.smithi016.stdout:9/311: symlink d3/d9/df/d16/l6b 0 2024-08-01T06:56:21.282 INFO:tasks.workunit.client.0.smithi016.stdout:6/498: dwrite d1/d8/d1b/d22/d71/fac [0,4194304] 0 2024-08-01T06:56:21.284 INFO:tasks.workunit.client.0.smithi016.stdout:8/382: dwrite d5/d8/d1a/d24/f4a [0,4194304] 0 2024-08-01T06:56:21.288 INFO:tasks.workunit.client.0.smithi016.stdout:1/484: rename d2/de/d32/f6f to d2/d3/d41/d49/fa4 0 2024-08-01T06:56:21.289 INFO:tasks.workunit.client.0.smithi016.stdout:2/535: readlink d0/l47 0 2024-08-01T06:56:21.290 INFO:tasks.workunit.client.0.smithi016.stdout:6/499: rmdir d1/d43/d88 39 2024-08-01T06:56:21.291 INFO:tasks.workunit.client.0.smithi016.stdout:4/395: mknod d0/d17/d22/c83 0 2024-08-01T06:56:21.294 INFO:tasks.workunit.client.0.smithi016.stdout:3/316: rename d9/d1c/f5f to d9/da/df/d53/f6c 0 2024-08-01T06:56:21.296 INFO:tasks.workunit.client.0.smithi016.stdout:9/312: dwrite d3/d9/df/d16/f1e [0,4194304] 0 2024-08-01T06:56:21.298 INFO:tasks.workunit.client.0.smithi016.stdout:1/485: symlink d2/d3/d48/la5 0 2024-08-01T06:56:21.299 INFO:tasks.workunit.client.0.smithi016.stdout:9/313: dread - d3/d9/df/f5b zero size 2024-08-01T06:56:21.300 INFO:tasks.workunit.client.0.smithi016.stdout:6/500: fdatasync d1/d9/d60/d68/f7c 0 2024-08-01T06:56:21.304 INFO:tasks.workunit.client.0.smithi016.stdout:6/501: creat d1/d41/fb6 x:0 0 0 2024-08-01T06:56:21.306 INFO:tasks.workunit.client.0.smithi016.stdout:4/396: fsync d0/d17/f39 0 2024-08-01T06:56:21.308 INFO:tasks.workunit.client.0.smithi016.stdout:1/486: rename d2/de/d21/d3e/f9d to d2/d3/d1c/fa6 0 2024-08-01T06:56:21.310 INFO:tasks.workunit.client.0.smithi016.stdout:9/314: truncate d3/de/f15 5025407 0 2024-08-01T06:56:21.312 INFO:tasks.workunit.client.0.smithi016.stdout:2/536: link d0/d16/d20/d2e/f46 d0/d8/d1b/d74/fad 0 2024-08-01T06:56:21.313 INFO:tasks.workunit.client.0.smithi016.stdout:2/537: dread - d0/d8/d31/f51 zero size 2024-08-01T06:56:21.313 INFO:tasks.workunit.client.0.smithi016.stdout:4/397: dwrite d0/d17/f2f [4194304,4194304] 0 2024-08-01T06:56:21.314 INFO:tasks.workunit.client.0.smithi016.stdout:3/317: creat d9/da/df/d2a/d69/f6d x:0 0 0 2024-08-01T06:56:21.315 INFO:tasks.workunit.client.0.smithi016.stdout:6/502: creat d1/d9/d3f/d7d/d8a/da2/fb7 x:0 0 0 2024-08-01T06:56:21.322 INFO:tasks.workunit.client.0.smithi016.stdout:4/398: chown d0/d17/d22/c3e 101729 1 2024-08-01T06:56:21.322 INFO:tasks.workunit.client.0.smithi016.stdout:2/538: creat d0/d16/d20/d2e/d68/fae x:0 0 0 2024-08-01T06:56:21.325 INFO:tasks.workunit.client.0.smithi016.stdout:6/503: creat d1/d9/d60/d68/d79/d93/daf/fb8 x:0 0 0 2024-08-01T06:56:21.327 INFO:tasks.workunit.client.0.smithi016.stdout:4/399: truncate d0/d2/dc/d12/d29/f5e 216711 0 2024-08-01T06:56:21.327 INFO:tasks.workunit.client.0.smithi016.stdout:1/487: dwrite d2/d3/d1a/f4e [4194304,4194304] 0 2024-08-01T06:56:21.327 INFO:tasks.workunit.client.0.smithi016.stdout:2/539: mkdir d0/d8/d1b/d74/d90/daf 0 2024-08-01T06:56:21.331 INFO:tasks.workunit.client.0.smithi016.stdout:4/400: getdents d0/d17/d22/d7f 0 2024-08-01T06:56:21.338 INFO:tasks.workunit.client.0.smithi016.stdout:1/488: dwrite d2/d3/d41/d49/f60 [4194304,4194304] 0 2024-08-01T06:56:21.339 INFO:tasks.workunit.client.0.smithi016.stdout:2/540: dwrite d0/d8/f26 [0,4194304] 0 2024-08-01T06:56:21.341 INFO:tasks.workunit.client.0.smithi016.stdout:2/541: chown d0/f40 181 1 2024-08-01T06:56:21.342 INFO:tasks.workunit.client.0.smithi016.stdout:2/542: write d0/d8/d31/f53 [509602,17029] 0 2024-08-01T06:56:21.343 INFO:tasks.workunit.client.0.smithi016.stdout:2/543: chown d0 543352 1 2024-08-01T06:56:21.346 INFO:tasks.workunit.client.0.smithi016.stdout:9/315: link d3/de/f15 d3/d9/db/dc/d33/f6c 0 2024-08-01T06:56:21.348 INFO:tasks.workunit.client.0.smithi016.stdout:9/316: chown d3/de/f20 0 1 2024-08-01T06:56:21.349 INFO:tasks.workunit.client.0.smithi016.stdout:9/317: dread - d3/f6a zero size 2024-08-01T06:56:21.350 INFO:tasks.workunit.client.0.smithi016.stdout:2/544: dread d0/d8/d1b/d74/d90/d93/f78 [0,4194304] 0 2024-08-01T06:56:21.353 INFO:tasks.workunit.client.0.smithi016.stdout:9/318: read - d3/d9/d46/d48/f55 zero size 2024-08-01T06:56:21.357 INFO:tasks.workunit.client.0.smithi016.stdout:1/489: dread d2/de/f14 [0,4194304] 0 2024-08-01T06:56:21.357 INFO:tasks.workunit.client.0.smithi016.stdout:2/545: unlink d0/d8/d31/c6e 0 2024-08-01T06:56:21.359 INFO:tasks.workunit.client.0.smithi016.stdout:9/319: mkdir d3/de/d6d 0 2024-08-01T06:56:21.360 INFO:tasks.workunit.client.0.smithi016.stdout:2/546: symlink d0/d16/d20/d2e/d3b/lb0 0 2024-08-01T06:56:21.361 INFO:tasks.workunit.client.0.smithi016.stdout:2/547: fsync d0/d16/d20/d2e/f97 0 2024-08-01T06:56:21.362 INFO:tasks.workunit.client.0.smithi016.stdout:1/490: creat d2/d3/da0/fa7 x:0 0 0 2024-08-01T06:56:21.368 INFO:tasks.workunit.client.0.smithi016.stdout:1/491: symlink d2/d3/d1a/la8 0 2024-08-01T06:56:21.369 INFO:tasks.workunit.client.0.smithi016.stdout:2/548: dwrite d0/d8/f26 [4194304,4194304] 0 2024-08-01T06:56:21.374 INFO:tasks.workunit.client.0.smithi016.stdout:2/549: rename d0/d8/d1b/d74/f95 to d0/d8/d1b/fb1 0 2024-08-01T06:56:21.375 INFO:tasks.workunit.client.0.smithi016.stdout:4/401: dread d0/d2/f25 [0,4194304] 0 2024-08-01T06:56:21.379 INFO:tasks.workunit.client.0.smithi016.stdout:2/550: mkdir d0/d8/d6b/db2 0 2024-08-01T06:56:21.387 INFO:tasks.workunit.client.0.smithi016.stdout:1/492: write d2/f17 [4874763,108978] 0 2024-08-01T06:56:21.390 INFO:tasks.workunit.client.0.smithi016.stdout:9/320: dwrite d3/d9/df/d2a/f3b [0,4194304] 0 2024-08-01T06:56:21.394 INFO:tasks.workunit.client.0.smithi016.stdout:2/551: write d0/d8/d22/f88 [1235099,23146] 0 2024-08-01T06:56:21.396 INFO:tasks.workunit.client.0.smithi016.stdout:4/402: truncate d0/d17/d22/f53 2612534 0 2024-08-01T06:56:21.397 INFO:tasks.workunit.client.0.smithi016.stdout:2/552: readlink d0/d16/d20/l6f 0 2024-08-01T06:56:21.399 INFO:tasks.workunit.client.0.smithi016.stdout:1/493: creat d2/d2f/fa9 x:0 0 0 2024-08-01T06:56:21.403 INFO:tasks.workunit.client.0.smithi016.stdout:4/403: fsync d0/d2/dc/f2b 0 2024-08-01T06:56:21.403 INFO:tasks.workunit.client.0.smithi016.stdout:9/321: dwrite d3/d9/df/f5b [0,4194304] 0 2024-08-01T06:56:21.407 INFO:tasks.workunit.client.0.smithi016.stdout:2/553: dread d0/d8/d1b/d74/d90/d93/f58 [4194304,4194304] 0 2024-08-01T06:56:21.409 INFO:tasks.workunit.client.0.smithi016.stdout:2/554: read - d0/d16/d20/d2e/d3b/fa9 zero size 2024-08-01T06:56:21.409 INFO:tasks.workunit.client.0.smithi016.stdout:4/404: read d0/d2/f33 [483844,82126] 0 2024-08-01T06:56:21.409 INFO:tasks.workunit.client.0.smithi016.stdout:1/494: rename c1 to d2/de/d6e/caa 0 2024-08-01T06:56:21.411 INFO:tasks.workunit.client.0.smithi016.stdout:1/495: readlink d2/d2f/l56 0 2024-08-01T06:56:21.414 INFO:tasks.workunit.client.0.smithi016.stdout:9/322: symlink d3/d32/l6e 0 2024-08-01T06:56:21.422 INFO:tasks.workunit.client.0.smithi016.stdout:9/323: dwrite d3/d9/db/dc/f42 [0,4194304] 0 2024-08-01T06:56:21.424 INFO:tasks.workunit.client.0.smithi016.stdout:9/324: write d3/f65 [868250,64576] 0 2024-08-01T06:56:21.426 INFO:tasks.workunit.client.0.smithi016.stdout:2/555: symlink d0/d8/d6b/db2/lb3 0 2024-08-01T06:56:21.429 INFO:tasks.workunit.client.0.smithi016.stdout:4/405: creat d0/d2/dc/d12/d29/d79/f84 x:0 0 0 2024-08-01T06:56:21.429 INFO:tasks.workunit.client.0.smithi016.stdout:1/496: getdents d2/de/d63 0 2024-08-01T06:56:21.433 INFO:tasks.workunit.client.0.smithi016.stdout:2/556: dread d0/d8/f26 [0,4194304] 0 2024-08-01T06:56:21.434 INFO:tasks.workunit.client.0.smithi016.stdout:4/406: mkdir d0/d17/d22/d26/d85 0 2024-08-01T06:56:21.435 INFO:tasks.workunit.client.0.smithi016.stdout:1/497: symlink d2/d2f/lab 0 2024-08-01T06:56:21.435 INFO:tasks.workunit.client.0.smithi016.stdout:2/557: chown d0/d8/d1b/fb1 13616 1 2024-08-01T06:56:21.439 INFO:tasks.workunit.client.0.smithi016.stdout:1/498: symlink d2/d3/da0/lac 0 2024-08-01T06:56:21.442 INFO:tasks.workunit.client.0.smithi016.stdout:2/558: unlink d0/f3e 0 2024-08-01T06:56:21.445 INFO:tasks.workunit.client.0.smithi016.stdout:4/407: dwrite d0/d2/dc/d12/d29/f60 [0,4194304] 0 2024-08-01T06:56:21.446 INFO:tasks.workunit.client.0.smithi016.stdout:2/559: write d0/d8/d31/f53 [3245206,108288] 0 2024-08-01T06:56:21.446 INFO:tasks.workunit.client.0.smithi016.stdout:9/325: dread d3/d9/df/d16/f30 [0,4194304] 0 2024-08-01T06:56:21.446 INFO:tasks.workunit.client.0.smithi016.stdout:1/499: mknod d2/de/d63/cad 0 2024-08-01T06:56:21.449 INFO:tasks.workunit.client.0.smithi016.stdout:9/326: write d3/d9/db/d3e/d40/f4b [199202,3782] 0 2024-08-01T06:56:21.454 INFO:tasks.workunit.client.0.smithi016.stdout:1/500: dread d2/d3/d41/d49/f99 [0,4194304] 0 2024-08-01T06:56:21.454 INFO:tasks.workunit.client.0.smithi016.stdout:4/408: rmdir d0/d17 39 2024-08-01T06:56:21.455 INFO:tasks.workunit.client.0.smithi016.stdout:2/560: mkdir d0/d8/d31/da7/db4 0 2024-08-01T06:56:21.456 INFO:tasks.workunit.client.0.smithi016.stdout:2/561: readlink d0/d8/d1b/d74/l8e 0 2024-08-01T06:56:21.462 INFO:tasks.workunit.client.0.smithi016.stdout:1/501: symlink d2/d2f/lae 0 2024-08-01T06:56:21.463 INFO:tasks.workunit.client.0.smithi016.stdout:2/562: mkdir d0/d8/d22/db5 0 2024-08-01T06:56:21.465 INFO:tasks.workunit.client.0.smithi016.stdout:4/409: truncate d0/d17/f30 2227084 0 2024-08-01T06:56:21.469 INFO:tasks.workunit.client.0.smithi016.stdout:9/327: getdents d3/d9/db/d3e/d40/d4e 0 2024-08-01T06:56:21.471 INFO:tasks.workunit.client.0.smithi016.stdout:2/563: fsync d0/d16/f41 0 2024-08-01T06:56:21.473 INFO:tasks.workunit.client.0.smithi016.stdout:1/502: rmdir d2 39 2024-08-01T06:56:21.482 INFO:tasks.workunit.client.0.smithi016.stdout:2/564: mkdir d0/d8/d31/db6 0 2024-08-01T06:56:21.483 INFO:tasks.workunit.client.0.smithi016.stdout:1/503: symlink d2/d3/d41/laf 0 2024-08-01T06:56:21.483 INFO:tasks.workunit.client.0.smithi016.stdout:1/504: stat d2/d3/d41/d49/f83 0 2024-08-01T06:56:21.484 INFO:tasks.workunit.client.0.smithi016.stdout:4/410: creat d0/f86 x:0 0 0 2024-08-01T06:56:21.487 INFO:tasks.workunit.client.0.smithi016.stdout:1/505: creat d2/d88/fb0 x:0 0 0 2024-08-01T06:56:21.489 INFO:tasks.workunit.client.0.smithi016.stdout:4/411: dread d0/d2/dc/d12/d29/f6c [0,4194304] 0 2024-08-01T06:56:21.490 INFO:tasks.workunit.client.0.smithi016.stdout:4/412: readlink d0/d2/dc/l7b 0 2024-08-01T06:56:21.492 INFO:tasks.workunit.client.0.smithi016.stdout:9/328: dwrite d3/f24 [0,4194304] 0 2024-08-01T06:56:21.496 INFO:tasks.workunit.client.0.smithi016.stdout:2/565: getdents d0/d7d 0 2024-08-01T06:56:21.497 INFO:tasks.workunit.client.0.smithi016.stdout:1/506: dread d2/de/d6e/f8a [0,4194304] 0 2024-08-01T06:56:21.499 INFO:tasks.workunit.client.0.smithi016.stdout:4/413: rename d0/d2/dc/d12/d29/c3b to d0/d2/dc/d12/d29/d3c/c87 0 2024-08-01T06:56:21.500 INFO:tasks.workunit.client.0.smithi016.stdout:2/566: symlink d0/d16/lb7 0 2024-08-01T06:56:21.500 INFO:tasks.workunit.client.0.smithi016.stdout:4/414: fdatasync d0/d2/dc/d12/d29/d3c/f69 0 2024-08-01T06:56:21.504 INFO:tasks.workunit.client.0.smithi016.stdout:1/507: rename d2/de/d32/f52 to d2/d3/d41/fb1 0 2024-08-01T06:56:21.504 INFO:tasks.workunit.client.0.smithi016.stdout:1/508: readlink d2/d2f/l3b 0 2024-08-01T06:56:21.507 INFO:tasks.workunit.client.0.smithi016.stdout:9/329: link d3/d9/db/d3e/d40/f4b d3/de/d6d/f6f 0 2024-08-01T06:56:21.509 INFO:tasks.workunit.client.0.smithi016.stdout:2/567: rename d0/d16/f2d to d0/d8/d31/db6/fb8 0 2024-08-01T06:56:21.511 INFO:tasks.workunit.client.0.smithi016.stdout:1/509: dread d2/de/d21/d3e/f86 [0,4194304] 0 2024-08-01T06:56:21.511 INFO:tasks.workunit.client.0.smithi016.stdout:4/415: symlink d0/d17/d22/d7f/l88 0 2024-08-01T06:56:21.511 INFO:tasks.workunit.client.0.smithi016.stdout:1/510: readlink d2/d88/l9e 0 2024-08-01T06:56:21.512 INFO:tasks.workunit.client.0.smithi016.stdout:9/330: mknod d3/d9/db/c70 0 2024-08-01T06:56:21.514 INFO:tasks.workunit.client.0.smithi016.stdout:2/568: symlink d0/lb9 0 2024-08-01T06:56:21.515 INFO:tasks.workunit.client.0.smithi016.stdout:2/569: stat d0/d8/f3c 0 2024-08-01T06:56:21.516 INFO:tasks.workunit.client.0.smithi016.stdout:1/511: rename d2/de/d21/d3e/f6a to d2/fb2 0 2024-08-01T06:56:21.517 INFO:tasks.workunit.client.0.smithi016.stdout:2/570: read d0/d16/d20/d2e/f4f [536394,63391] 0 2024-08-01T06:56:21.519 INFO:tasks.workunit.client.0.smithi016.stdout:4/416: rename d0/d2/l27 to d0/d2/d68/l89 0 2024-08-01T06:56:21.521 INFO:tasks.workunit.client.0.smithi016.stdout:4/417: write d0/d2/d68/f7a [513957,17738] 0 2024-08-01T06:56:21.522 INFO:tasks.workunit.client.0.smithi016.stdout:2/571: symlink d0/d16/d20/lba 0 2024-08-01T06:56:21.524 INFO:tasks.workunit.client.0.smithi016.stdout:2/572: write d0/d16/d20/d2e/f97 [409096,112460] 0 2024-08-01T06:56:21.525 INFO:tasks.workunit.client.0.smithi016.stdout:9/331: rename d3/d9/d46/d48/l58 to d3/d9/db/dc/l71 0 2024-08-01T06:56:21.527 INFO:tasks.workunit.client.0.smithi016.stdout:2/573: stat d0/d8/l84 0 2024-08-01T06:56:21.531 INFO:tasks.workunit.client.0.smithi016.stdout:2/574: creat d0/d8/d31/d5e/fbb x:0 0 0 2024-08-01T06:56:21.532 INFO:tasks.workunit.client.0.smithi016.stdout:9/332: truncate d3/de/f15 3032677 0 2024-08-01T06:56:21.532 INFO:tasks.workunit.client.0.smithi016.stdout:4/418: dread d0/fb [0,4194304] 0 2024-08-01T06:56:21.537 INFO:tasks.workunit.client.0.smithi016.stdout:2/575: dread d0/d8/d1b/d74/d99/fa0 [0,4194304] 0 2024-08-01T06:56:21.538 INFO:tasks.workunit.client.0.smithi016.stdout:9/333: creat d3/d32/f72 x:0 0 0 2024-08-01T06:56:21.539 INFO:tasks.workunit.client.0.smithi016.stdout:1/512: chown d2/fb2 1176523233 1 2024-08-01T06:56:21.542 INFO:tasks.workunit.client.0.smithi016.stdout:2/576: unlink d0/d8/d1b/d74/d90/d93/c38 0 2024-08-01T06:56:21.542 INFO:tasks.workunit.client.0.smithi016.stdout:9/334: dread d3/de/d6d/f6f [4194304,4194304] 0 2024-08-01T06:56:21.543 INFO:tasks.workunit.client.0.smithi016.stdout:4/419: dread d0/d17/f32 [0,4194304] 0 2024-08-01T06:56:21.543 INFO:tasks.workunit.client.0.smithi016.stdout:2/577: fsync d0/d16/d20/fac 0 2024-08-01T06:56:21.549 INFO:tasks.workunit.client.0.smithi016.stdout:2/578: unlink d0/d8/f3c 0 2024-08-01T06:56:21.552 INFO:tasks.workunit.client.0.smithi016.stdout:9/335: mkdir d3/d9/d73 0 2024-08-01T06:56:21.552 INFO:tasks.workunit.client.0.smithi016.stdout:9/336: stat d3/de/f18 0 2024-08-01T06:56:21.553 INFO:tasks.workunit.client.0.smithi016.stdout:9/337: fsync d3/f65 0 2024-08-01T06:56:21.554 INFO:tasks.workunit.client.0.smithi016.stdout:2/579: creat d0/d8/d1b/d74/d99/fbc x:0 0 0 2024-08-01T06:56:21.559 INFO:tasks.workunit.client.0.smithi016.stdout:9/338: creat d3/d9/db/dc/f74 x:0 0 0 2024-08-01T06:56:21.560 INFO:tasks.workunit.client.0.smithi016.stdout:4/420: dwrite d0/d2/f37 [0,4194304] 0 2024-08-01T06:56:21.564 INFO:tasks.workunit.client.0.smithi016.stdout:9/339: unlink d3/d9/df/f5b 0 2024-08-01T06:56:21.571 INFO:tasks.workunit.client.0.smithi016.stdout:4/421: creat d0/d2/dc/d12/d29/f8a x:0 0 0 2024-08-01T06:56:21.572 INFO:tasks.workunit.client.0.smithi016.stdout:9/340: fsync d3/d9/db/dc/d33/f6c 0 2024-08-01T06:56:21.574 INFO:tasks.workunit.client.0.smithi016.stdout:2/580: creat d0/d8/d1b/d74/d90/daf/fbd x:0 0 0 2024-08-01T06:56:21.574 INFO:tasks.workunit.client.0.smithi016.stdout:4/422: truncate d0/d2/dc/d12/d29/f6c 1235853 0 2024-08-01T06:56:21.575 INFO:tasks.workunit.client.0.smithi016.stdout:2/581: dread - d0/d16/d20/d2e/d68/fa6 zero size 2024-08-01T06:56:21.576 INFO:tasks.workunit.client.0.smithi016.stdout:9/341: rename d3/d32/f72 to d3/d4/f75 0 2024-08-01T06:56:21.578 INFO:tasks.workunit.client.0.smithi016.stdout:2/582: dread d0/d8/d1b/f5c [0,4194304] 0 2024-08-01T06:56:21.579 INFO:tasks.workunit.client.0.smithi016.stdout:4/423: mkdir d0/d17/d22/d26/d8b 0 2024-08-01T06:56:21.589 INFO:tasks.workunit.client.0.smithi016.stdout:2/583: getdents d0/d16/d20/d2e 0 2024-08-01T06:56:21.590 INFO:tasks.workunit.client.0.smithi016.stdout:2/584: readlink d0/d8/d31/d5e/l65 0 2024-08-01T06:56:21.591 INFO:tasks.workunit.client.0.smithi016.stdout:2/585: chown d0/d16/f1f 38 1 2024-08-01T06:56:21.592 INFO:tasks.workunit.client.0.smithi016.stdout:4/424: dread d0/d2/dc/d12/d29/d3c/f5b [0,4194304] 0 2024-08-01T06:56:21.592 INFO:tasks.workunit.client.0.smithi016.stdout:2/586: chown d0/d16/d20/d2e/d68 240 1 2024-08-01T06:56:21.594 INFO:tasks.workunit.client.0.smithi016.stdout:2/587: write d0/f9c [4817249,52528] 0 2024-08-01T06:56:21.594 INFO:tasks.workunit.client.0.smithi016.stdout:9/342: dread d3/d9/df/d38/f4f [0,4194304] 0 2024-08-01T06:56:21.597 INFO:tasks.workunit.client.0.smithi016.stdout:4/425: rename d0/d17/c81 to d0/d2/dc/d12/d29/d3c/c8c 0 2024-08-01T06:56:21.598 INFO:tasks.workunit.client.0.smithi016.stdout:9/343: write d3/d4/f75 [1012235,116955] 0 2024-08-01T06:56:21.602 INFO:tasks.workunit.client.0.smithi016.stdout:2/588: dwrite d0/d8/d1b/d74/d90/d93/f2f [0,4194304] 0 2024-08-01T06:56:21.604 INFO:tasks.workunit.client.0.smithi016.stdout:9/344: creat d3/d9/df/d2a/f76 x:0 0 0 2024-08-01T06:56:21.604 INFO:tasks.workunit.client.0.smithi016.stdout:9/345: fsync d3/d9/df/f3d 0 2024-08-01T06:56:21.605 INFO:tasks.workunit.client.0.smithi016.stdout:2/589: symlink d0/d8/d1b/d74/d90/daf/lbe 0 2024-08-01T06:56:21.606 INFO:tasks.workunit.client.0.smithi016.stdout:4/426: rename d0/d17/d22/d26/l2c to d0/d2/dc/d12/d29/d79/l8d 0 2024-08-01T06:56:21.607 INFO:tasks.workunit.client.0.smithi016.stdout:9/346: chown d3/f28 1 1 2024-08-01T06:56:21.612 INFO:tasks.workunit.client.0.smithi016.stdout:9/347: rename d3/d9/df/l49 to d3/d9/db/l77 0 2024-08-01T06:56:21.728 INFO:tasks.workunit.client.0.smithi016.stdout:0/312: sync 2024-08-01T06:56:21.728 INFO:tasks.workunit.client.0.smithi016.stdout:7/387: sync 2024-08-01T06:56:21.745 INFO:tasks.workunit.client.0.smithi016.stdout:4/427: symlink d0/d17/d22/d26/d85/l8e 0 2024-08-01T06:56:21.745 INFO:tasks.workunit.client.0.smithi016.stdout:2/590: link d0/d16/f41 d0/d8/d31/da7/fbf 0 2024-08-01T06:56:21.747 INFO:tasks.workunit.client.0.smithi016.stdout:0/313: stat d10/d11/c1e 0 2024-08-01T06:56:21.747 INFO:tasks.workunit.client.0.smithi016.stdout:7/388: readlink d7/db/d17/d72/l48 0 2024-08-01T06:56:21.752 INFO:tasks.workunit.client.0.smithi016.stdout:4/428: write d0/d2/dc/d12/d29/f6c [1843897,102985] 0 2024-08-01T06:56:21.753 INFO:tasks.workunit.client.0.smithi016.stdout:9/348: truncate d3/d9/db/dc/d33/f6c 1487538 0 2024-08-01T06:56:21.756 INFO:tasks.workunit.client.0.smithi016.stdout:7/389: creat d7/db/d17/d72/d1c/d79/f98 x:0 0 0 2024-08-01T06:56:21.760 INFO:tasks.workunit.client.0.smithi016.stdout:9/349: truncate d3/de/f17 2143048 0 2024-08-01T06:56:21.762 INFO:tasks.workunit.client.0.smithi016.stdout:0/314: dread f9 [4194304,4194304] 0 2024-08-01T06:56:21.763 INFO:tasks.workunit.client.0.smithi016.stdout:9/350: creat d3/d32/f78 x:0 0 0 2024-08-01T06:56:21.767 INFO:tasks.workunit.client.0.smithi016.stdout:0/315: symlink d10/d11/d37/l61 0 2024-08-01T06:56:21.768 INFO:tasks.workunit.client.0.smithi016.stdout:4/429: dread d0/d2/f2a [0,4194304] 0 2024-08-01T06:56:21.773 INFO:tasks.workunit.client.0.smithi016.stdout:9/351: link d3/de/f18 d3/d9/d46/f79 0 2024-08-01T06:56:21.774 INFO:tasks.workunit.client.0.smithi016.stdout:0/316: dwrite d10/d11/d41/f60 [0,4194304] 0 2024-08-01T06:56:21.775 INFO:tasks.workunit.client.0.smithi016.stdout:4/430: mkdir d0/d2/dc/d12/d29/d8f 0 2024-08-01T06:56:21.777 INFO:tasks.workunit.client.0.smithi016.stdout:4/431: write d0/d17/d22/f31 [1290567,105344] 0 2024-08-01T06:56:21.778 INFO:tasks.workunit.client.0.smithi016.stdout:2/591: write d0/d16/f1f [4772042,117728] 0 2024-08-01T06:56:21.780 INFO:tasks.workunit.client.0.smithi016.stdout:2/592: fsync d0/d8/f52 0 2024-08-01T06:56:21.780 INFO:tasks.workunit.client.0.smithi016.stdout:4/432: rmdir d0/d17/d22 39 2024-08-01T06:56:21.782 INFO:tasks.workunit.client.0.smithi016.stdout:9/352: dread d3/d9/df/d16/f30 [0,4194304] 0 2024-08-01T06:56:21.782 INFO:tasks.workunit.client.0.smithi016.stdout:2/593: readlink d0/d8/d1b/l37 0 2024-08-01T06:56:21.783 INFO:tasks.workunit.client.0.smithi016.stdout:0/317: truncate d10/d11/f15 812316 0 2024-08-01T06:56:21.784 INFO:tasks.workunit.client.0.smithi016.stdout:2/594: chown d0/d8/d6b/db2 2 1 2024-08-01T06:56:21.785 INFO:tasks.workunit.client.0.smithi016.stdout:2/595: chown d0/d16 21675 1 2024-08-01T06:56:21.786 INFO:tasks.workunit.client.0.smithi016.stdout:4/433: dread d0/d2/dc/f34 [0,4194304] 0 2024-08-01T06:56:21.787 INFO:tasks.workunit.client.0.smithi016.stdout:4/434: stat d0/d17/c54 0 2024-08-01T06:56:21.790 INFO:tasks.workunit.client.0.smithi016.stdout:9/353: rename d3/de/f20 to d3/de/f7a 0 2024-08-01T06:56:21.791 INFO:tasks.workunit.client.0.smithi016.stdout:2/596: fsync d0/d8/d1b/d74/f81 0 2024-08-01T06:56:21.793 INFO:tasks.workunit.client.0.smithi016.stdout:0/318: symlink d10/l62 0 2024-08-01T06:56:21.796 INFO:tasks.workunit.client.0.smithi016.stdout:9/354: dread d3/f24 [0,4194304] 0 2024-08-01T06:56:21.798 INFO:tasks.workunit.client.0.smithi016.stdout:2/597: dread d0/d8/d1b/d74/d90/d93/f58 [4194304,4194304] 0 2024-08-01T06:56:21.801 INFO:tasks.workunit.client.0.smithi016.stdout:9/355: symlink d3/d9/df/d38/l7b 0 2024-08-01T06:56:21.803 INFO:tasks.workunit.client.0.smithi016.stdout:9/356: write d3/d9/db/d3e/d40/f59 [711947,3590] 0 2024-08-01T06:56:21.803 INFO:tasks.workunit.client.0.smithi016.stdout:0/319: rename d10/d11/d37/c3a to d10/d11/d37/c63 0 2024-08-01T06:56:21.804 INFO:tasks.workunit.client.0.smithi016.stdout:7/390: write d7/db/d17/d72/d1e/d26/f46 [4930991,119755] 0 2024-08-01T06:56:21.807 INFO:tasks.workunit.client.0.smithi016.stdout:4/435: getdents d0/d17/d22/d26/d85 0 2024-08-01T06:56:21.809 INFO:tasks.workunit.client.0.smithi016.stdout:2/598: creat d0/d8/fc0 x:0 0 0 2024-08-01T06:56:21.810 INFO:tasks.workunit.client.0.smithi016.stdout:2/599: readlink d0/l1 0 2024-08-01T06:56:21.810 INFO:tasks.workunit.client.0.smithi016.stdout:7/391: mkdir d7/db/d17/d72/d22/d77/d99 0 2024-08-01T06:56:21.812 INFO:tasks.workunit.client.0.smithi016.stdout:9/357: mknod d3/d9/db/d3a/c7c 0 2024-08-01T06:56:21.818 INFO:tasks.workunit.client.0.smithi016.stdout:7/392: rmdir d7/db/d17/d72/d1c/d1d/d40/d7f 39 2024-08-01T06:56:21.820 INFO:tasks.workunit.client.0.smithi016.stdout:9/358: dwrite d3/d32/f4d [0,4194304] 0 2024-08-01T06:56:21.820 INFO:tasks.workunit.client.0.smithi016.stdout:0/320: creat d10/d11/f64 x:0 0 0 2024-08-01T06:56:21.823 INFO:tasks.workunit.client.0.smithi016.stdout:2/600: mkdir d0/d8/d31/dc1 0 2024-08-01T06:56:21.828 INFO:tasks.workunit.client.0.smithi016.stdout:9/359: mkdir d3/d9/db/d7d 0 2024-08-01T06:56:21.829 INFO:tasks.workunit.client.0.smithi016.stdout:9/360: write d3/d9/db/d3e/f66 [454964,59602] 0 2024-08-01T06:56:21.829 INFO:tasks.workunit.client.0.smithi016.stdout:0/321: creat d10/d11/d37/d58/f65 x:0 0 0 2024-08-01T06:56:21.830 INFO:tasks.workunit.client.0.smithi016.stdout:0/322: chown d10/d11/c56 0 1 2024-08-01T06:56:21.831 INFO:tasks.workunit.client.0.smithi016.stdout:2/601: mknod d0/d8/d1b/cc2 0 2024-08-01T06:56:21.831 INFO:tasks.workunit.client.0.smithi016.stdout:0/323: dread - d10/d11/f64 zero size 2024-08-01T06:56:21.832 INFO:tasks.workunit.client.0.smithi016.stdout:0/324: dread - d10/f5a zero size 2024-08-01T06:56:21.835 INFO:tasks.workunit.client.0.smithi016.stdout:9/361: symlink d3/d9/db/d3e/d50/l7e 0 2024-08-01T06:56:21.835 INFO:tasks.workunit.client.0.smithi016.stdout:9/362: chown d3/d9/db/dc/d56 1 1 2024-08-01T06:56:21.894 INFO:tasks.workunit.client.0.smithi016.stdout:5/456: sync 2024-08-01T06:56:21.897 INFO:tasks.workunit.client.0.smithi016.stdout:2/602: dwrite d0/d8/d1b/d74/d90/d93/f58 [4194304,4194304] 0 2024-08-01T06:56:21.904 INFO:tasks.workunit.client.0.smithi016.stdout:9/363: dwrite d3/d9/d46/d48/f55 [0,4194304] 0 2024-08-01T06:56:21.910 INFO:tasks.workunit.client.0.smithi016.stdout:2/603: dwrite d0/d8/fc0 [0,4194304] 0 2024-08-01T06:56:21.915 INFO:tasks.workunit.client.0.smithi016.stdout:9/364: chown d3/d9/db/dc/c53 92558917 1 2024-08-01T06:56:21.919 INFO:tasks.workunit.client.0.smithi016.stdout:9/365: stat d3/d9/db/l77 0 2024-08-01T06:56:21.940 INFO:tasks.workunit.client.0.smithi016.stdout:4/436: write d0/d2/d36/f70 [607236,3063] 0 2024-08-01T06:56:21.944 INFO:tasks.workunit.client.0.smithi016.stdout:0/325: getdents d10/d11 0 2024-08-01T06:56:21.945 INFO:tasks.workunit.client.0.smithi016.stdout:2/604: getdents d0/d8/d31 0 2024-08-01T06:56:21.947 INFO:tasks.workunit.client.0.smithi016.stdout:4/437: mkdir d0/d2/dc/d90 0 2024-08-01T06:56:21.950 INFO:tasks.workunit.client.0.smithi016.stdout:2/605: mkdir d0/dc3 0 2024-08-01T06:56:21.952 INFO:tasks.workunit.client.0.smithi016.stdout:7/393: write d7/db/d17/d72/d1e/f1f [4707268,2539] 0 2024-08-01T06:56:21.954 INFO:tasks.workunit.client.0.smithi016.stdout:4/438: mkdir d0/d2/dc/d12/d29/d91 0 2024-08-01T06:56:21.954 INFO:tasks.workunit.client.0.smithi016.stdout:0/326: dwrite d10/d11/f4d [0,4194304] 0 2024-08-01T06:56:21.956 INFO:tasks.workunit.client.0.smithi016.stdout:0/327: readlink d10/l62 0 2024-08-01T06:56:21.959 INFO:tasks.workunit.client.0.smithi016.stdout:2/606: rename d0/d8/d6b/db2 to d0/d8/d31/dc1/dc4 0 2024-08-01T06:56:21.962 INFO:tasks.workunit.client.0.smithi016.stdout:0/328: mknod d10/d1c/c66 0 2024-08-01T06:56:21.963 INFO:tasks.workunit.client.0.smithi016.stdout:0/329: dread - d10/d11/f3d zero size 2024-08-01T06:56:21.966 INFO:tasks.workunit.client.0.smithi016.stdout:2/607: chown d0/d8/d22/la8 6 1 2024-08-01T06:56:21.967 INFO:tasks.workunit.client.0.smithi016.stdout:0/330: symlink d10/d11/d37/d58/l67 0 2024-08-01T06:56:21.968 INFO:tasks.workunit.client.0.smithi016.stdout:0/331: fsync d10/f5a 0 2024-08-01T06:56:21.976 INFO:tasks.workunit.client.0.smithi016.stdout:5/457: dwrite d1/f54 [0,4194304] 0 2024-08-01T06:56:21.994 INFO:tasks.workunit.client.0.smithi016.stdout:7/394: write d7/db/d17/d72/d1c/f7d [765242,22039] 0 2024-08-01T06:56:21.996 INFO:tasks.workunit.client.0.smithi016.stdout:4/439: truncate d0/d2/d36/f70 48105 0 2024-08-01T06:56:21.997 INFO:tasks.workunit.client.0.smithi016.stdout:2/608: truncate d0/d8/d31/f61 743504 0 2024-08-01T06:56:22.000 INFO:tasks.workunit.client.0.smithi016.stdout:7/395: creat d7/db/d17/d72/d1c/f9a x:0 0 0 2024-08-01T06:56:22.006 INFO:tasks.workunit.client.0.smithi016.stdout:4/440: mkdir d0/d2/dc/d90/d92 0 2024-08-01T06:56:22.009 INFO:tasks.workunit.client.0.smithi016.stdout:2/609: rename d0/c14 to d0/d8/d31/dc1/dc4/cc5 0 2024-08-01T06:56:22.010 INFO:tasks.workunit.client.0.smithi016.stdout:7/396: write d7/db/d17/d72/d1c/f78 [348236,19161] 0 2024-08-01T06:56:22.011 INFO:tasks.workunit.client.0.smithi016.stdout:0/332: dwrite f6 [0,4194304] 0 2024-08-01T06:56:22.016 INFO:tasks.workunit.client.0.smithi016.stdout:5/458: dwrite d1/d2/d6/d9/f6a [0,4194304] 0 2024-08-01T06:56:22.018 INFO:tasks.workunit.client.0.smithi016.stdout:7/397: readlink d7/db/d17/d72/d1c/d1d/d40/d58/l5d 0 2024-08-01T06:56:22.020 INFO:tasks.workunit.client.0.smithi016.stdout:2/610: creat d0/d16/d20/d2e/d68/fc6 x:0 0 0 2024-08-01T06:56:22.021 INFO:tasks.workunit.client.0.smithi016.stdout:2/611: readlink d0/d8/d1b/l9e 0 2024-08-01T06:56:22.022 INFO:tasks.workunit.client.0.smithi016.stdout:2/612: chown d0/d8/d1b/d74/d90/d93/f2f 2744754 1 2024-08-01T06:56:22.024 INFO:tasks.workunit.client.0.smithi016.stdout:5/459: rmdir d1/d2/d6 39 2024-08-01T06:56:22.026 INFO:tasks.workunit.client.0.smithi016.stdout:0/333: creat d10/d11/d37/d58/f68 x:0 0 0 2024-08-01T06:56:22.028 INFO:tasks.workunit.client.0.smithi016.stdout:7/398: write d7/db/d17/d72/d1e/d26/f49 [8660134,89586] 0 2024-08-01T06:56:22.032 INFO:tasks.workunit.client.0.smithi016.stdout:4/441: truncate d0/d2/dc/f2b 5469277 0 2024-08-01T06:56:22.034 INFO:tasks.workunit.client.0.smithi016.stdout:2/613: mkdir d0/d8/d31/dc7 0 2024-08-01T06:56:22.035 INFO:tasks.workunit.client.0.smithi016.stdout:5/460: symlink d1/d12/d7d/l9c 0 2024-08-01T06:56:22.038 INFO:tasks.workunit.client.0.smithi016.stdout:7/399: write d7/db/d17/d72/d1c/d1d/d40/d7f/f90 [714248,98522] 0 2024-08-01T06:56:22.041 INFO:tasks.workunit.client.0.smithi016.stdout:4/442: mkdir d0/d17/d22/d7f/d93 0 2024-08-01T06:56:22.046 INFO:tasks.workunit.client.0.smithi016.stdout:4/443: dread d0/d17/d22/f6b [0,4194304] 0 2024-08-01T06:56:22.047 INFO:tasks.workunit.client.0.smithi016.stdout:4/444: fdatasync d0/f86 0 2024-08-01T06:56:22.048 INFO:tasks.workunit.client.0.smithi016.stdout:2/614: symlink d0/d16/d20/d2e/lc8 0 2024-08-01T06:56:22.049 INFO:tasks.workunit.client.0.smithi016.stdout:0/334: creat d10/d11/d37/d53/f69 x:0 0 0 2024-08-01T06:56:22.049 INFO:tasks.workunit.client.0.smithi016.stdout:3/318: sync 2024-08-01T06:56:22.049 INFO:tasks.workunit.client.0.smithi016.stdout:8/383: sync 2024-08-01T06:56:22.050 INFO:tasks.workunit.client.0.smithi016.stdout:3/319: write d9/f1f [1000162,10799] 0 2024-08-01T06:56:22.052 INFO:tasks.workunit.client.0.smithi016.stdout:3/320: stat d9/da/df/d2a/d49/f68 0 2024-08-01T06:56:22.054 INFO:tasks.workunit.client.0.smithi016.stdout:0/335: chown d10/d11/f15 600 1 2024-08-01T06:56:22.054 INFO:tasks.workunit.client.0.smithi016.stdout:8/384: truncate d5/d8/d1a/d24/f4e 571304 0 2024-08-01T06:56:22.062 INFO:tasks.workunit.client.0.smithi016.stdout:8/385: chown d5/d8/f68 6930 1 2024-08-01T06:56:22.066 INFO:tasks.workunit.client.0.smithi016.stdout:5/461: unlink d1/d2/d6/d9/d19/c46 0 2024-08-01T06:56:22.066 INFO:tasks.workunit.client.0.smithi016.stdout:4/445: symlink d0/d17/d22/l94 0 2024-08-01T06:56:22.067 INFO:tasks.workunit.client.0.smithi016.stdout:3/321: dwrite d9/da/df/d12/d20/d3c/f52 [0,4194304] 0 2024-08-01T06:56:22.073 INFO:tasks.workunit.client.0.smithi016.stdout:4/446: stat d0/c20 0 2024-08-01T06:56:22.075 INFO:tasks.workunit.client.0.smithi016.stdout:7/400: write d7/db/d17/d72/f59 [1402734,3892] 0 2024-08-01T06:56:22.075 INFO:tasks.workunit.client.0.smithi016.stdout:5/462: chown d1/d2/d6/d9/d19/d7a/l8a 3 1 2024-08-01T06:56:22.078 INFO:tasks.workunit.client.0.smithi016.stdout:8/386: mkdir d5/d8/d1a/d24/d48/d85 0 2024-08-01T06:56:22.080 INFO:tasks.workunit.client.0.smithi016.stdout:3/322: dwrite d9/da/df/d2a/d69/f6d [0,4194304] 0 2024-08-01T06:56:22.081 INFO:tasks.workunit.client.0.smithi016.stdout:0/336: write d10/d1c/f29 [2580076,41583] 0 2024-08-01T06:56:22.082 INFO:tasks.workunit.client.0.smithi016.stdout:4/447: dread - d0/d17/d38/f7c zero size 2024-08-01T06:56:22.086 INFO:tasks.workunit.client.0.smithi016.stdout:2/615: write d0/d8/d31/f51 [122554,99591] 0 2024-08-01T06:56:22.086 INFO:tasks.workunit.client.0.smithi016.stdout:3/323: dread - d9/da/df/d12/d20/d3c/f4b zero size 2024-08-01T06:56:22.087 INFO:tasks.workunit.client.0.smithi016.stdout:8/387: write d5/d1c/f4c [783264,113032] 0 2024-08-01T06:56:22.091 INFO:tasks.workunit.client.0.smithi016.stdout:3/324: chown d9/da/df/d2a/f43 2070511 1 2024-08-01T06:56:22.099 INFO:tasks.workunit.client.0.smithi016.stdout:2/616: unlink d0/d8/d1b/f29 0 2024-08-01T06:56:22.101 INFO:tasks.workunit.client.0.smithi016.stdout:0/337: symlink d10/d5c/l6a 0 2024-08-01T06:56:22.103 INFO:tasks.workunit.client.0.smithi016.stdout:4/448: creat d0/d17/d22/d7f/d93/f95 x:0 0 0 2024-08-01T06:56:22.106 INFO:tasks.workunit.client.0.smithi016.stdout:8/388: mkdir d5/d67/d86 0 2024-08-01T06:56:22.107 INFO:tasks.workunit.client.0.smithi016.stdout:8/389: chown d5/d8/d1a/d24/f2b 108953 1 2024-08-01T06:56:22.108 INFO:tasks.workunit.client.0.smithi016.stdout:6/504: sync 2024-08-01T06:56:22.111 INFO:tasks.workunit.client.0.smithi016.stdout:2/617: mkdir d0/d7d/dc9 0 2024-08-01T06:56:22.112 INFO:tasks.workunit.client.0.smithi016.stdout:6/505: read d1/d43/f4a [2000393,119678] 0 2024-08-01T06:56:22.114 INFO:tasks.workunit.client.0.smithi016.stdout:6/506: chown d1/d8/l92 110665 1 2024-08-01T06:56:22.115 INFO:tasks.workunit.client.0.smithi016.stdout:7/401: dread d7/db/d17/d72/d1c/f3f [0,4194304] 0 2024-08-01T06:56:22.117 INFO:tasks.workunit.client.0.smithi016.stdout:8/390: dwrite d5/d8/d1a/d24/f4a [0,4194304] 0 2024-08-01T06:56:22.118 INFO:tasks.workunit.client.0.smithi016.stdout:5/463: link d1/d2/d6/l4c d1/d2/d6/l9d 0 2024-08-01T06:56:22.118 INFO:tasks.workunit.client.0.smithi016.stdout:4/449: creat d0/d17/d22/d7f/d93/f96 x:0 0 0 2024-08-01T06:56:22.119 INFO:tasks.workunit.client.0.smithi016.stdout:3/325: link d9/da/f2e d9/da/df/d2a/d49/d61/f6e 0 2024-08-01T06:56:22.123 INFO:tasks.workunit.client.0.smithi016.stdout:0/338: link d10/d11/c56 d10/d11/c6b 0 2024-08-01T06:56:22.123 INFO:tasks.workunit.client.0.smithi016.stdout:8/391: read - d5/f61 zero size 2024-08-01T06:56:22.125 INFO:tasks.workunit.client.0.smithi016.stdout:4/450: write d0/d17/d38/f43 [868730,89666] 0 2024-08-01T06:56:22.128 INFO:tasks.workunit.client.0.smithi016.stdout:3/326: creat d9/d1c/f6f x:0 0 0 2024-08-01T06:56:22.131 INFO:tasks.workunit.client.0.smithi016.stdout:7/402: dwrite d7/db/d17/d72/d1c/d79/d8f/d39/d43/f91 [0,4194304] 0 2024-08-01T06:56:22.131 INFO:tasks.workunit.client.0.smithi016.stdout:4/451: chown d0/d2/dc/l10 29313511 1 2024-08-01T06:56:22.134 INFO:tasks.workunit.client.0.smithi016.stdout:3/327: truncate d9/d3e/f36 9391102 0 2024-08-01T06:56:22.135 INFO:tasks.workunit.client.0.smithi016.stdout:5/464: rename d1/d2/d6/d9/d1b/l7b to d1/d2/d6/d5a/d65/l9e 0 2024-08-01T06:56:22.139 INFO:tasks.workunit.client.0.smithi016.stdout:6/507: getdents d1/d8/d1b/db5 0 2024-08-01T06:56:22.140 INFO:tasks.workunit.client.0.smithi016.stdout:3/328: mknod d9/da/d18/c70 0 2024-08-01T06:56:22.140 INFO:tasks.workunit.client.0.smithi016.stdout:0/339: fsync d10/d11/d41/f2a 0 2024-08-01T06:56:22.142 INFO:tasks.workunit.client.0.smithi016.stdout:5/465: symlink d1/d12/d52/l9f 0 2024-08-01T06:56:22.144 INFO:tasks.workunit.client.0.smithi016.stdout:6/508: read - d1/d41/fb6 zero size 2024-08-01T06:56:22.148 INFO:tasks.workunit.client.0.smithi016.stdout:4/452: dwrite d0/d2/dc/d12/d29/f6c [0,4194304] 0 2024-08-01T06:56:22.152 INFO:tasks.workunit.client.0.smithi016.stdout:2/618: getdents d0/d8/d31/da7 0 2024-08-01T06:56:22.155 INFO:tasks.workunit.client.0.smithi016.stdout:8/392: write d5/d8/fd [1075749,56898] 0 2024-08-01T06:56:22.158 INFO:tasks.workunit.client.0.smithi016.stdout:3/329: creat d9/da/df/d12/d20/d3c/f71 x:0 0 0 2024-08-01T06:56:22.159 INFO:tasks.workunit.client.0.smithi016.stdout:5/466: creat d1/d2/d6/d9/d49/fa0 x:0 0 0 2024-08-01T06:56:22.161 INFO:tasks.workunit.client.0.smithi016.stdout:8/393: write d5/dc/f36 [8730129,37023] 0 2024-08-01T06:56:22.161 INFO:tasks.workunit.client.0.smithi016.stdout:4/453: dwrite d0/d2/dc/d12/d29/d3c/f55 [0,4194304] 0 2024-08-01T06:56:22.163 INFO:tasks.workunit.client.0.smithi016.stdout:7/403: link d7/ld d7/db/d17/d72/d1c/d1d/d6d/l9b 0 2024-08-01T06:56:22.180 INFO:tasks.workunit.client.0.smithi016.stdout:5/467: mkdir d1/d2/d6/d5a/da1 0 2024-08-01T06:56:22.182 INFO:tasks.workunit.client.0.smithi016.stdout:5/468: fdatasync d1/d2/d20/d72/f9b 0 2024-08-01T06:56:22.183 INFO:tasks.workunit.client.0.smithi016.stdout:4/454: mkdir d0/d2/dc/d90/d97 0 2024-08-01T06:56:22.183 INFO:tasks.workunit.client.0.smithi016.stdout:5/469: stat d1/d2/d20/d68 0 2024-08-01T06:56:22.184 INFO:tasks.workunit.client.0.smithi016.stdout:8/394: fsync d5/d1c/f33 0 2024-08-01T06:56:22.185 INFO:tasks.workunit.client.0.smithi016.stdout:5/470: write d1/d2/d6/d9/d49/fa0 [449129,36741] 0 2024-08-01T06:56:22.185 INFO:tasks.workunit.client.0.smithi016.stdout:0/340: truncate d10/f17 121906 0 2024-08-01T06:56:22.188 INFO:tasks.workunit.client.0.smithi016.stdout:1/513: sync 2024-08-01T06:56:22.189 INFO:tasks.workunit.client.0.smithi016.stdout:9/366: sync 2024-08-01T06:56:22.190 INFO:tasks.workunit.client.0.smithi016.stdout:9/367: dread - d3/d32/f78 zero size 2024-08-01T06:56:22.191 INFO:tasks.workunit.client.0.smithi016.stdout:7/404: creat d7/db/d17/d72/d22/f9c x:0 0 0 2024-08-01T06:56:22.194 INFO:tasks.workunit.client.0.smithi016.stdout:3/330: write d9/d1c/f2b [459423,78393] 0 2024-08-01T06:56:22.196 INFO:tasks.workunit.client.0.smithi016.stdout:0/341: dwrite d10/f2e [0,4194304] 0 2024-08-01T06:56:22.198 INFO:tasks.workunit.client.0.smithi016.stdout:0/342: chown c5 0 1 2024-08-01T06:56:22.200 INFO:tasks.workunit.client.0.smithi016.stdout:5/471: creat d1/d2/d23/fa2 x:0 0 0 2024-08-01T06:56:22.201 INFO:tasks.workunit.client.0.smithi016.stdout:0/343: fsync d10/d1c/f20 0 2024-08-01T06:56:22.201 INFO:tasks.workunit.client.0.smithi016.stdout:8/395: mknod d5/d8/d1a/d24/d48/d60/c87 0 2024-08-01T06:56:22.203 INFO:tasks.workunit.client.0.smithi016.stdout:6/509: dwrite d1/f2 [0,4194304] 0 2024-08-01T06:56:22.203 INFO:tasks.workunit.client.0.smithi016.stdout:7/405: dread - d7/db/d17/d72/d1c/d79/d8f/d39/f41 zero size 2024-08-01T06:56:22.214 INFO:tasks.workunit.client.0.smithi016.stdout:2/619: symlink d0/d16/d20/d2e/lca 0 2024-08-01T06:56:22.214 INFO:tasks.workunit.client.0.smithi016.stdout:1/514: write d2/d3/d41/d49/f99 [65072,97794] 0 2024-08-01T06:56:22.216 INFO:tasks.workunit.client.0.smithi016.stdout:3/331: mkdir d9/d4e/d72 0 2024-08-01T06:56:22.222 INFO:tasks.workunit.client.0.smithi016.stdout:1/515: dread d2/d3/d1a/d22/f64 [0,4194304] 0 2024-08-01T06:56:22.223 INFO:tasks.workunit.client.0.smithi016.stdout:5/472: dwrite d1/d12/d3e/f66 [0,4194304] 0 2024-08-01T06:56:22.224 INFO:tasks.workunit.client.0.smithi016.stdout:1/516: fdatasync d2/de/d32/d43/f8d 0 2024-08-01T06:56:22.225 INFO:tasks.workunit.client.0.smithi016.stdout:1/517: stat d2/d3/f34 0 2024-08-01T06:56:22.230 INFO:tasks.workunit.client.0.smithi016.stdout:9/368: dwrite d3/d9/d46/f79 [0,4194304] 0 2024-08-01T06:56:22.232 INFO:tasks.workunit.client.0.smithi016.stdout:7/406: fsync d7/db/d17/d72/d1c/f3f 0 2024-08-01T06:56:22.233 INFO:tasks.workunit.client.0.smithi016.stdout:4/455: dwrite d0/d17/f30 [0,4194304] 0 2024-08-01T06:56:22.234 INFO:tasks.workunit.client.0.smithi016.stdout:6/510: fdatasync d1/d8/d1b/d22/f29 0 2024-08-01T06:56:22.239 INFO:tasks.workunit.client.0.smithi016.stdout:7/407: dread d7/db/d17/d72/d1e/d26/f46 [0,4194304] 0 2024-08-01T06:56:22.243 INFO:tasks.workunit.client.0.smithi016.stdout:0/344: rename d10/l39 to d10/d11/d37/d58/l6c 0 2024-08-01T06:56:22.246 INFO:tasks.workunit.client.0.smithi016.stdout:5/473: chown d1/d2/d20/c8d 62929763 1 2024-08-01T06:56:22.247 INFO:tasks.workunit.client.0.smithi016.stdout:1/518: creat d2/de/d63/fb3 x:0 0 0 2024-08-01T06:56:22.248 INFO:tasks.workunit.client.0.smithi016.stdout:7/408: dwrite d7/db/d17/d72/d1e/f1f [4194304,4194304] 0 2024-08-01T06:56:22.248 INFO:tasks.workunit.client.0.smithi016.stdout:9/369: chown d3/d9/db/dc/l71 6490 1 2024-08-01T06:56:22.249 INFO:tasks.workunit.client.0.smithi016.stdout:1/519: readlink d2/d88/l9e 0 2024-08-01T06:56:22.252 INFO:tasks.workunit.client.0.smithi016.stdout:1/520: truncate d2/d2f/f87 378680 0 2024-08-01T06:56:22.252 INFO:tasks.workunit.client.0.smithi016.stdout:2/620: fdatasync d0/d16/d20/d2e/d3b/fa4 0 2024-08-01T06:56:22.255 INFO:tasks.workunit.client.0.smithi016.stdout:9/370: dread d3/d9/db/d3e/d40/f4b [0,4194304] 0 2024-08-01T06:56:22.257 INFO:tasks.workunit.client.0.smithi016.stdout:5/474: rmdir d1/d12 39 2024-08-01T06:56:22.258 INFO:tasks.workunit.client.0.smithi016.stdout:4/456: mknod d0/d17/d22/c98 0 2024-08-01T06:56:22.260 INFO:tasks.workunit.client.0.smithi016.stdout:7/409: dread - d7/db/d17/d72/d1c/d79/f7e zero size 2024-08-01T06:56:22.260 INFO:tasks.workunit.client.0.smithi016.stdout:1/521: creat d2/d3/d41/fb4 x:0 0 0 2024-08-01T06:56:22.261 INFO:tasks.workunit.client.0.smithi016.stdout:2/621: dread - d0/d8/d31/d5e/f75 zero size 2024-08-01T06:56:22.262 INFO:tasks.workunit.client.0.smithi016.stdout:8/396: getdents d5/d8/d1a/d59 0 2024-08-01T06:56:22.264 INFO:tasks.workunit.client.0.smithi016.stdout:4/457: rename d0/d17/d22/d26/c62 to d0/d2/d68/c99 0 2024-08-01T06:56:22.265 INFO:tasks.workunit.client.0.smithi016.stdout:7/410: unlink d7/db/d17/d72/d1e/d26/f46 0 2024-08-01T06:56:22.267 INFO:tasks.workunit.client.0.smithi016.stdout:3/332: getdents d9/da/df/d2a/d49/d61 0 2024-08-01T06:56:22.268 INFO:tasks.workunit.client.0.smithi016.stdout:9/371: truncate d3/d9/db/dc/d33/f51 1953565 0 2024-08-01T06:56:22.269 INFO:tasks.workunit.client.0.smithi016.stdout:3/333: chown d9/da/df/d2a/d49 36501 1 2024-08-01T06:56:22.270 INFO:tasks.workunit.client.0.smithi016.stdout:5/475: stat d1/d2/l47 0 2024-08-01T06:56:22.273 INFO:tasks.workunit.client.0.smithi016.stdout:4/458: dwrite d0/d2/dc/d12/d29/f8a [0,4194304] 0 2024-08-01T06:56:22.275 INFO:tasks.workunit.client.0.smithi016.stdout:1/522: link d2/d3/da0/fa7 d2/de/d32/d43/fb5 0 2024-08-01T06:56:22.275 INFO:tasks.workunit.client.0.smithi016.stdout:7/411: readlink d7/db/d17/d72/d1e/d26/d63/l84 0 2024-08-01T06:56:22.278 INFO:tasks.workunit.client.0.smithi016.stdout:4/459: truncate d0/d2/dc/d12/d29/f8a 4543288 0 2024-08-01T06:56:22.279 INFO:tasks.workunit.client.0.smithi016.stdout:0/345: readlink d10/d11/d37/d58/l6c 0 2024-08-01T06:56:22.280 INFO:tasks.workunit.client.0.smithi016.stdout:6/511: write d1/d8/d1b/d22/d71/f7f [713350,111344] 0 2024-08-01T06:56:22.283 INFO:tasks.workunit.client.0.smithi016.stdout:7/412: truncate d7/db/d17/d72/d1c/d4f/f6a 187573 0 2024-08-01T06:56:22.286 INFO:tasks.workunit.client.0.smithi016.stdout:1/523: truncate d2/d3/d1a/f3c 2282726 0 2024-08-01T06:56:22.287 INFO:tasks.workunit.client.0.smithi016.stdout:6/512: creat d1/d9/d60/d68/d79/d93/fb9 x:0 0 0 2024-08-01T06:56:22.291 INFO:tasks.workunit.client.0.smithi016.stdout:7/413: rename d7/c50 to d7/db/d17/d72/d1c/d97/c9d 0 2024-08-01T06:56:22.292 INFO:tasks.workunit.client.0.smithi016.stdout:1/524: creat d2/d3/d1a/d22/fb6 x:0 0 0 2024-08-01T06:56:22.294 INFO:tasks.workunit.client.0.smithi016.stdout:1/525: readlink d2/d3/d1a/d22/d9a/la3 0 2024-08-01T06:56:22.295 INFO:tasks.workunit.client.0.smithi016.stdout:8/397: write d5/d1c/f57 [425152,22915] 0 2024-08-01T06:56:22.295 INFO:tasks.workunit.client.0.smithi016.stdout:0/346: creat d10/d11/d41/f6d x:0 0 0 2024-08-01T06:56:22.298 INFO:tasks.workunit.client.0.smithi016.stdout:2/622: write d0/d8/d22/f98 [4685956,65473] 0 2024-08-01T06:56:22.299 INFO:tasks.workunit.client.0.smithi016.stdout:8/398: truncate d5/d8/d1a/d24/d48/d60/d63/f71 81946 0 2024-08-01T06:56:22.300 INFO:tasks.workunit.client.0.smithi016.stdout:2/623: chown d0/d16/d20/d2e/d3b/d45/c94 24 1 2024-08-01T06:56:22.306 INFO:tasks.workunit.client.0.smithi016.stdout:1/526: rename d2/de/d32/f65 to d2/d2f/fb7 0 2024-08-01T06:56:22.307 INFO:tasks.workunit.client.0.smithi016.stdout:1/527: fsync d2/d2f/fa9 0 2024-08-01T06:56:22.308 INFO:tasks.workunit.client.0.smithi016.stdout:0/347: unlink c5 0 2024-08-01T06:56:22.308 INFO:tasks.workunit.client.0.smithi016.stdout:3/334: dwrite d9/fd [0,4194304] 0 2024-08-01T06:56:22.310 INFO:tasks.workunit.client.0.smithi016.stdout:1/528: fdatasync d2/d3/d41/d49/f99 0 2024-08-01T06:56:22.312 INFO:tasks.workunit.client.0.smithi016.stdout:6/513: mkdir d1/d8/d1b/db5/d67/d8f/dba 0 2024-08-01T06:56:22.322 INFO:tasks.workunit.client.0.smithi016.stdout:6/514: dwrite d1/d9/d3f/f96 [0,4194304] 0 2024-08-01T06:56:22.323 INFO:tasks.workunit.client.0.smithi016.stdout:9/372: dwrite d3/d9/db/dc/d33/f51 [0,4194304] 0 2024-08-01T06:56:22.323 INFO:tasks.workunit.client.0.smithi016.stdout:0/348: mknod d10/d11/d37/d50/c6e 0 2024-08-01T06:56:22.325 INFO:tasks.workunit.client.0.smithi016.stdout:0/349: chown d10/d11/d37/l61 0 1 2024-08-01T06:56:22.334 INFO:tasks.workunit.client.0.smithi016.stdout:2/624: mkdir d0/d16/d20/d2e/dcb 0 2024-08-01T06:56:22.336 INFO:tasks.workunit.client.0.smithi016.stdout:8/399: dwrite d5/d8/f2e [0,4194304] 0 2024-08-01T06:56:22.338 INFO:tasks.workunit.client.0.smithi016.stdout:9/373: creat d3/d9/db/d3e/f7f x:0 0 0 2024-08-01T06:56:22.341 INFO:tasks.workunit.client.0.smithi016.stdout:7/414: rename d7/db/d17/d72/d1c/d79/d8f/l9 to d7/db/d17/d72/d22/d77/d99/l9e 0 2024-08-01T06:56:22.345 INFO:tasks.workunit.client.0.smithi016.stdout:1/529: dwrite d2/d3/d1a/d22/f9f [0,4194304] 0 2024-08-01T06:56:22.346 INFO:tasks.workunit.client.0.smithi016.stdout:3/335: getdents d9/da/df/d2a/d49 0 2024-08-01T06:56:22.350 INFO:tasks.workunit.client.0.smithi016.stdout:8/400: rename d5/dc/f36 to d5/d67/d86/f88 0 2024-08-01T06:56:22.352 INFO:tasks.workunit.client.0.smithi016.stdout:9/374: mkdir d3/d9/db/d3e/d40/d80 0 2024-08-01T06:56:22.356 INFO:tasks.workunit.client.0.smithi016.stdout:3/336: unlink d9/da/df/d2a/d69/f6d 0 2024-08-01T06:56:22.356 INFO:tasks.workunit.client.0.smithi016.stdout:3/337: chown d9/f37 229 1 2024-08-01T06:56:22.358 INFO:tasks.workunit.client.0.smithi016.stdout:1/530: truncate d2/d3/d1a/d22/f3d 3537037 0 2024-08-01T06:56:22.359 INFO:tasks.workunit.client.0.smithi016.stdout:9/375: unlink d3/de/d6d/f6f 0 2024-08-01T06:56:22.360 INFO:tasks.workunit.client.0.smithi016.stdout:8/401: fdatasync d5/f38 0 2024-08-01T06:56:22.362 INFO:tasks.workunit.client.0.smithi016.stdout:3/338: rename f3 to d9/d57/d66/f73 0 2024-08-01T06:56:22.364 INFO:tasks.workunit.client.0.smithi016.stdout:9/376: unlink d3/d32/f78 0 2024-08-01T06:56:22.366 INFO:tasks.workunit.client.0.smithi016.stdout:6/515: write d1/d41/f82 [1935651,76822] 0 2024-08-01T06:56:22.368 INFO:tasks.workunit.client.0.smithi016.stdout:8/402: chown d5/d8/d1a/l4d 401165 1 2024-08-01T06:56:22.370 INFO:tasks.workunit.client.0.smithi016.stdout:8/403: read - d5/d8/d1a/d24/d48/f7c zero size 2024-08-01T06:56:22.372 INFO:tasks.workunit.client.0.smithi016.stdout:9/377: dwrite d3/d9/df/d2a/f76 [0,4194304] 0 2024-08-01T06:56:22.381 INFO:tasks.workunit.client.0.smithi016.stdout:8/404: dwrite d5/d8/f58 [4194304,4194304] 0 2024-08-01T06:56:22.382 INFO:tasks.workunit.client.0.smithi016.stdout:8/405: fdatasync d5/f84 0 2024-08-01T06:56:22.385 INFO:tasks.workunit.client.0.smithi016.stdout:7/415: dwrite d7/f18 [0,4194304] 0 2024-08-01T06:56:22.385 INFO:tasks.workunit.client.0.smithi016.stdout:8/406: write d5/f61 [263312,74963] 0 2024-08-01T06:56:22.388 INFO:tasks.workunit.client.0.smithi016.stdout:9/378: creat d3/de/d6d/f81 x:0 0 0 2024-08-01T06:56:22.389 INFO:tasks.workunit.client.0.smithi016.stdout:1/531: write d2/d3/f4c [906102,3158] 0 2024-08-01T06:56:22.390 INFO:tasks.workunit.client.0.smithi016.stdout:8/407: read d5/d8/f58 [737270,112587] 0 2024-08-01T06:56:22.393 INFO:tasks.workunit.client.0.smithi016.stdout:7/416: creat d7/db/d17/d72/d1e/d26/d2a/f9f x:0 0 0 2024-08-01T06:56:22.397 INFO:tasks.workunit.client.0.smithi016.stdout:6/516: creat d1/d9/fbb x:0 0 0 2024-08-01T06:56:22.398 INFO:tasks.workunit.client.0.smithi016.stdout:1/532: dwrite d2/f5d [0,4194304] 0 2024-08-01T06:56:22.403 INFO:tasks.workunit.client.0.smithi016.stdout:8/408: unlink d5/d1c/f57 0 2024-08-01T06:56:22.404 INFO:tasks.workunit.client.0.smithi016.stdout:3/339: truncate d9/d3e/f36 754917 0 2024-08-01T06:56:22.406 INFO:tasks.workunit.client.0.smithi016.stdout:3/340: dread - d9/da/df/d12/d20/d3c/f4b zero size 2024-08-01T06:56:22.406 INFO:tasks.workunit.client.0.smithi016.stdout:9/379: rename d3/d32/f4d to d3/d4/d57/f82 0 2024-08-01T06:56:22.407 INFO:tasks.workunit.client.0.smithi016.stdout:8/409: dread d5/d8/d1a/d24/d48/d60/d63/f71 [0,4194304] 0 2024-08-01T06:56:22.408 INFO:tasks.workunit.client.0.smithi016.stdout:8/410: read d5/d8/d1a/d24/f2b [1095121,26081] 0 2024-08-01T06:56:22.410 INFO:tasks.workunit.client.0.smithi016.stdout:6/517: mkdir d1/d9/d3f/d7d/d8a/dbc 0 2024-08-01T06:56:22.411 INFO:tasks.workunit.client.0.smithi016.stdout:6/518: readlink d1/d8/d1b/l54 0 2024-08-01T06:56:22.412 INFO:tasks.workunit.client.0.smithi016.stdout:1/533: mknod d2/de/d6e/cb8 0 2024-08-01T06:56:22.413 INFO:tasks.workunit.client.0.smithi016.stdout:6/519: fdatasync d1/d9/d60/da0/f37 0 2024-08-01T06:56:22.417 INFO:tasks.workunit.client.0.smithi016.stdout:6/520: write d1/d8/d1b/d22/d36/f55 [2882040,108072] 0 2024-08-01T06:56:22.417 INFO:tasks.workunit.client.0.smithi016.stdout:8/411: dwrite d5/d8/d1a/d24/f4e [0,4194304] 0 2024-08-01T06:56:22.420 INFO:tasks.workunit.client.0.smithi016.stdout:3/341: creat d9/d57/f74 x:0 0 0 2024-08-01T06:56:22.430 INFO:tasks.workunit.client.0.smithi016.stdout:7/417: mknod d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/ca0 0 2024-08-01T06:56:22.436 INFO:tasks.workunit.client.0.smithi016.stdout:1/534: mknod d2/d3/da0/cb9 0 2024-08-01T06:56:22.437 INFO:tasks.workunit.client.0.smithi016.stdout:1/535: chown d2/de/d6e/f8a 9335 1 2024-08-01T06:56:22.438 INFO:tasks.workunit.client.0.smithi016.stdout:1/536: chown d2/d3/d1f/c7b 1 1 2024-08-01T06:56:22.440 INFO:tasks.workunit.client.0.smithi016.stdout:9/380: write d3/d4/fa [135304,13189] 0 2024-08-01T06:56:22.443 INFO:tasks.workunit.client.0.smithi016.stdout:8/412: creat d5/d1c/f89 x:0 0 0 2024-08-01T06:56:22.444 INFO:tasks.workunit.client.0.smithi016.stdout:6/521: fsync d1/d8/d1b/f50 0 2024-08-01T06:56:22.447 INFO:tasks.workunit.client.0.smithi016.stdout:3/342: mkdir d9/da/df/d12/d75 0 2024-08-01T06:56:22.451 INFO:tasks.workunit.client.0.smithi016.stdout:8/413: dwrite d5/dc/f4b [0,4194304] 0 2024-08-01T06:56:22.451 INFO:tasks.workunit.client.0.smithi016.stdout:1/537: dread d2/d3/d41/f47 [0,4194304] 0 2024-08-01T06:56:22.457 INFO:tasks.workunit.client.0.smithi016.stdout:7/418: symlink d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/la1 0 2024-08-01T06:56:22.459 INFO:tasks.workunit.client.0.smithi016.stdout:9/381: fdatasync d3/d9/df/d16/f30 0 2024-08-01T06:56:22.463 INFO:tasks.workunit.client.0.smithi016.stdout:1/538: rename d2/d3/d1a/d22/d9a to d2/d2f/dba 0 2024-08-01T06:56:22.465 INFO:tasks.workunit.client.0.smithi016.stdout:7/419: unlink d7/db/d17/d72/d22/f9c 0 2024-08-01T06:56:22.465 INFO:tasks.workunit.client.0.smithi016.stdout:9/382: rmdir d3/d9/d46 39 2024-08-01T06:56:22.473 INFO:tasks.workunit.client.0.smithi016.stdout:9/383: dwrite d3/de/f13 [0,4194304] 0 2024-08-01T06:56:22.473 INFO:tasks.workunit.client.0.smithi016.stdout:1/539: rename d2/de/d21/d3e/f86 to d2/d88/fbb 0 2024-08-01T06:56:22.482 INFO:tasks.workunit.client.0.smithi016.stdout:3/343: truncate d9/da/df/d2a/f43 979123 0 2024-08-01T06:56:22.486 INFO:tasks.workunit.client.0.smithi016.stdout:1/540: creat d2/d88/fbc x:0 0 0 2024-08-01T06:56:22.487 INFO:tasks.workunit.client.0.smithi016.stdout:6/522: getdents d1/d9/d60/d68/d79 0 2024-08-01T06:56:22.490 INFO:tasks.workunit.client.0.smithi016.stdout:9/384: mknod d3/c83 0 2024-08-01T06:56:22.493 INFO:tasks.workunit.client.0.smithi016.stdout:6/523: dread d1/d8/d1b/d22/d36/f98 [0,4194304] 0 2024-08-01T06:56:22.494 INFO:tasks.workunit.client.0.smithi016.stdout:7/420: dwrite d7/db/f44 [0,4194304] 0 2024-08-01T06:56:22.503 INFO:tasks.workunit.client.0.smithi016.stdout:3/344: mkdir d9/da/df/d12/d20/d5c/d76 0 2024-08-01T06:56:22.505 INFO:tasks.workunit.client.0.smithi016.stdout:6/524: fsync d1/d8/f2a 0 2024-08-01T06:56:22.506 INFO:tasks.workunit.client.0.smithi016.stdout:1/541: write d2/de/f31 [298844,43245] 0 2024-08-01T06:56:22.507 INFO:tasks.workunit.client.0.smithi016.stdout:6/525: stat d1/d8/d1b/c28 0 2024-08-01T06:56:22.507 INFO:tasks.workunit.client.0.smithi016.stdout:7/421: symlink d7/db/d17/d72/d22/d77/d99/la2 0 2024-08-01T06:56:22.508 INFO:tasks.workunit.client.0.smithi016.stdout:6/526: chown d1/d41/f82 91 1 2024-08-01T06:56:22.509 INFO:tasks.workunit.client.0.smithi016.stdout:6/527: chown d1/d8/d1b/d22/d2d/la7 3 1 2024-08-01T06:56:22.512 INFO:tasks.workunit.client.0.smithi016.stdout:1/542: creat d2/de/d4d/fbd x:0 0 0 2024-08-01T06:56:22.512 INFO:tasks.workunit.client.0.smithi016.stdout:9/385: dread d3/d9/db/dc/d33/f6c [0,4194304] 0 2024-08-01T06:56:22.514 INFO:tasks.workunit.client.0.smithi016.stdout:9/386: fdatasync d3/d9/df/d2a/f3b 0 2024-08-01T06:56:22.516 INFO:tasks.workunit.client.0.smithi016.stdout:7/422: dread d7/db/d17/d72/d1c/d79/d8f/d39/d43/f64 [0,4194304] 0 2024-08-01T06:56:22.518 INFO:tasks.workunit.client.0.smithi016.stdout:6/528: rename d1/d9/d60 to d1/d8/d1b/db5/d67/d8f/dba/dbd 0 2024-08-01T06:56:22.519 INFO:tasks.workunit.client.0.smithi016.stdout:6/529: chown d1/d9/d3f/c70 100 1 2024-08-01T06:56:22.520 INFO:tasks.workunit.client.0.smithi016.stdout:6/530: fsync d1/d8/d1b/d22/d36/f55 0 2024-08-01T06:56:22.523 INFO:tasks.workunit.client.0.smithi016.stdout:9/387: readlink d3/d4/d57/l67 0 2024-08-01T06:56:22.525 INFO:tasks.workunit.client.0.smithi016.stdout:3/345: link d9/da/df/d2a/d49/f68 d9/da/df/d2a/f77 0 2024-08-01T06:56:22.527 INFO:tasks.workunit.client.0.smithi016.stdout:7/423: stat d7/db/d17/d72/c8a 0 2024-08-01T06:56:22.530 INFO:tasks.workunit.client.0.smithi016.stdout:1/543: dread d2/d3/d1a/d22/f3d [0,4194304] 0 2024-08-01T06:56:22.530 INFO:tasks.workunit.client.0.smithi016.stdout:9/388: symlink d3/d9/db/dc/l84 0 2024-08-01T06:56:22.541 INFO:tasks.workunit.client.0.smithi016.stdout:7/424: truncate d7/db/d17/d72/d1c/d79/f7e 470132 0 2024-08-01T06:56:22.542 INFO:tasks.workunit.client.0.smithi016.stdout:3/346: creat d9/da/df/d12/d20/d5c/d76/f78 x:0 0 0 2024-08-01T06:56:22.543 INFO:tasks.workunit.client.0.smithi016.stdout:9/389: fdatasync d3/d9/d46/f79 0 2024-08-01T06:56:22.548 INFO:tasks.workunit.client.0.smithi016.stdout:7/425: mkdir d7/db/d17/d72/d1c/d1d/d40/d58/da3 0 2024-08-01T06:56:22.552 INFO:tasks.workunit.client.0.smithi016.stdout:7/426: write d7/db/d17/d72/d1e/f1f [6775455,31915] 0 2024-08-01T06:56:22.552 INFO:tasks.workunit.client.0.smithi016.stdout:3/347: dwrite d9/da/df/d53/f56 [0,4194304] 0 2024-08-01T06:56:22.557 INFO:tasks.workunit.client.0.smithi016.stdout:9/390: dwrite d3/de/f7a [4194304,4194304] 0 2024-08-01T06:56:22.559 INFO:tasks.workunit.client.0.smithi016.stdout:3/348: creat d9/d3e/f79 x:0 0 0 2024-08-01T06:56:22.565 INFO:tasks.workunit.client.0.smithi016.stdout:7/427: creat d7/db/d17/d72/d22/d77/d99/fa4 x:0 0 0 2024-08-01T06:56:22.566 INFO:tasks.workunit.client.0.smithi016.stdout:1/544: dread d2/de/d4d/f8e [0,4194304] 0 2024-08-01T06:56:22.568 INFO:tasks.workunit.client.0.smithi016.stdout:9/391: mknod d3/d9/db/dc/d33/c85 0 2024-08-01T06:56:22.570 INFO:tasks.workunit.client.0.smithi016.stdout:3/349: mkdir d9/da/df/d12/d20/d5c/d7a 0 2024-08-01T06:56:22.572 INFO:tasks.workunit.client.0.smithi016.stdout:3/350: dread - d9/d4e/f64 zero size 2024-08-01T06:56:22.574 INFO:tasks.workunit.client.0.smithi016.stdout:7/428: dwrite d7/db/d17/d72/d1e/d26/f32 [0,4194304] 0 2024-08-01T06:56:22.582 INFO:tasks.workunit.client.0.smithi016.stdout:3/351: rename d9/da/df/d2a/f38 to d9/da/df/d12/d20/d5c/d7a/f7b 0 2024-08-01T06:56:22.584 INFO:tasks.workunit.client.0.smithi016.stdout:3/352: write d9/da/df/d12/d20/f35 [4815041,126780] 0 2024-08-01T06:56:22.587 INFO:tasks.workunit.client.0.smithi016.stdout:9/392: rmdir d3/d9/db/d7d 0 2024-08-01T06:56:22.589 INFO:tasks.workunit.client.0.smithi016.stdout:9/393: chown d3/d9/db/f5f 0 1 2024-08-01T06:56:22.590 INFO:tasks.workunit.client.0.smithi016.stdout:7/429: creat d7/db/d17/d72/d1c/d1d/d6d/fa5 x:0 0 0 2024-08-01T06:56:22.591 INFO:tasks.workunit.client.0.smithi016.stdout:1/545: dwrite d2/de/f82 [0,4194304] 0 2024-08-01T06:56:22.600 INFO:tasks.workunit.client.0.smithi016.stdout:1/546: dwrite d2/de/f82 [0,4194304] 0 2024-08-01T06:56:22.601 INFO:tasks.workunit.client.0.smithi016.stdout:3/353: rename d9/da/d18/f55 to d9/f7c 0 2024-08-01T06:56:22.605 INFO:tasks.workunit.client.0.smithi016.stdout:7/430: unlink d7/db/d17/d72/d1c/d1d/d6d/l9b 0 2024-08-01T06:56:22.606 INFO:tasks.workunit.client.0.smithi016.stdout:7/431: read d7/db/d17/d72/d1e/d26/f32 [3943116,69441] 0 2024-08-01T06:56:22.607 INFO:tasks.workunit.client.0.smithi016.stdout:7/432: readlink d7/db/d17/d72/d1c/d1d/d5e/l76 0 2024-08-01T06:56:22.608 INFO:tasks.workunit.client.0.smithi016.stdout:3/354: fsync d9/f29 0 2024-08-01T06:56:22.610 INFO:tasks.workunit.client.0.smithi016.stdout:9/394: creat d3/d9/db/dc/d56/f86 x:0 0 0 2024-08-01T06:56:22.611 INFO:tasks.workunit.client.0.smithi016.stdout:1/547: rename d2/d3/l30 to d2/d3/d1c/lbe 0 2024-08-01T06:56:22.613 INFO:tasks.workunit.client.0.smithi016.stdout:3/355: mknod d9/d1c/c7d 0 2024-08-01T06:56:22.620 INFO:tasks.workunit.client.0.smithi016.stdout:1/548: symlink d2/d3/lbf 0 2024-08-01T06:56:22.622 INFO:tasks.workunit.client.0.smithi016.stdout:3/356: rmdir d9/d57 39 2024-08-01T06:56:22.625 INFO:tasks.workunit.client.0.smithi016.stdout:7/433: write d7/db/d17/d72/d1c/d1d/f60 [1449008,114141] 0 2024-08-01T06:56:22.627 INFO:tasks.workunit.client.0.smithi016.stdout:1/549: rename d2/d3/d1a/d22/c68 to d2/de/d4d/cc0 0 2024-08-01T06:56:22.629 INFO:tasks.workunit.client.0.smithi016.stdout:1/550: stat d2/de/cf 0 2024-08-01T06:56:22.629 INFO:tasks.workunit.client.0.smithi016.stdout:3/357: dwrite d9/fd [0,4194304] 0 2024-08-01T06:56:22.632 INFO:tasks.workunit.client.0.smithi016.stdout:7/434: unlink d7/db/d17/d72/d1c/d1d/d40/d67/c6b 0 2024-08-01T06:56:22.633 INFO:tasks.workunit.client.0.smithi016.stdout:9/395: truncate d3/d9/df/d2a/f76 159337 0 2024-08-01T06:56:22.635 INFO:tasks.workunit.client.0.smithi016.stdout:3/358: symlink d9/da/d18/l7e 0 2024-08-01T06:56:22.636 INFO:tasks.workunit.client.0.smithi016.stdout:3/359: write d9/d1c/f2b [4494012,64509] 0 2024-08-01T06:56:22.637 INFO:tasks.workunit.client.0.smithi016.stdout:1/551: rename d2/d3/da0 to d2/d3/d41/d49/d85/dc1 0 2024-08-01T06:56:22.639 INFO:tasks.workunit.client.0.smithi016.stdout:9/396: mkdir d3/d9/d46/d48/d87 0 2024-08-01T06:56:22.644 INFO:tasks.workunit.client.0.smithi016.stdout:3/360: unlink d9/f37 0 2024-08-01T06:56:22.646 INFO:tasks.workunit.client.0.smithi016.stdout:1/552: rename d2/de/d21/d3e/c4f to d2/d3/d41/d49/d85/cc2 0 2024-08-01T06:56:22.649 INFO:tasks.workunit.client.0.smithi016.stdout:3/361: rename d9/da/df/d2a to d9/da/df/d2a/d7f 22 2024-08-01T06:56:22.651 INFO:tasks.workunit.client.0.smithi016.stdout:9/397: read d3/d9/df/f2d [2140373,61918] 0 2024-08-01T06:56:22.653 INFO:tasks.workunit.client.0.smithi016.stdout:3/362: dread - d9/d57/f74 zero size 2024-08-01T06:56:22.654 INFO:tasks.workunit.client.0.smithi016.stdout:1/553: dwrite d2/d3/d1a/d22/fb6 [0,4194304] 0 2024-08-01T06:56:22.660 INFO:tasks.workunit.client.0.smithi016.stdout:9/398: rename d3/d9/db/dc/l84 to d3/d9/df/d38/l88 0 2024-08-01T06:56:22.662 INFO:tasks.workunit.client.0.smithi016.stdout:3/363: dread d9/da/df/d2a/d49/f62 [0,4194304] 0 2024-08-01T06:56:22.664 INFO:tasks.workunit.client.0.smithi016.stdout:1/554: dwrite d2/d88/f93 [0,4194304] 0 2024-08-01T06:56:22.666 INFO:tasks.workunit.client.0.smithi016.stdout:3/364: fdatasync d9/da/df/d12/d20/d3c/f52 0 2024-08-01T06:56:22.666 INFO:tasks.workunit.client.0.smithi016.stdout:9/399: chown d3/d9/df/d2a/f41 3 1 2024-08-01T06:56:22.668 INFO:tasks.workunit.client.0.smithi016.stdout:9/400: truncate d3/d4/f75 1862686 0 2024-08-01T06:56:22.672 INFO:tasks.workunit.client.0.smithi016.stdout:9/401: mkdir d3/de/d89 0 2024-08-01T06:56:22.673 INFO:tasks.workunit.client.0.smithi016.stdout:1/555: dwrite d2/d3/d1c/f2e [4194304,4194304] 0 2024-08-01T06:56:22.677 INFO:tasks.workunit.client.0.smithi016.stdout:9/402: rename d3/d4 to d3/d32/d5c/d8a 0 2024-08-01T06:56:22.679 INFO:tasks.workunit.client.0.smithi016.stdout:1/556: mkdir d2/de/d21/d3e/dc3 0 2024-08-01T06:56:22.681 INFO:tasks.workunit.client.0.smithi016.stdout:1/557: chown d2/d3/d41/d49/d85/dc1/cb9 3572804 1 2024-08-01T06:56:22.685 INFO:tasks.workunit.client.0.smithi016.stdout:3/365: write d9/da/df/d2a/f77 [972818,17466] 0 2024-08-01T06:56:22.687 INFO:tasks.workunit.client.0.smithi016.stdout:1/558: dread d2/de/d4d/f94 [0,4194304] 0 2024-08-01T06:56:22.693 INFO:tasks.workunit.client.0.smithi016.stdout:3/366: dwrite d9/da/df/d12/d20/d5c/f63 [0,4194304] 0 2024-08-01T06:56:22.694 INFO:tasks.workunit.client.0.smithi016.stdout:3/367: fdatasync d9/d4e/f64 0 2024-08-01T06:56:22.699 INFO:tasks.workunit.client.0.smithi016.stdout:3/368: mkdir d9/d3e/d80 0 2024-08-01T06:56:22.705 INFO:tasks.workunit.client.0.smithi016.stdout:9/403: dwrite d3/de/f17 [0,4194304] 0 2024-08-01T06:56:22.708 INFO:tasks.workunit.client.0.smithi016.stdout:3/369: dwrite d9/fd [0,4194304] 0 2024-08-01T06:56:22.708 INFO:tasks.workunit.client.0.smithi016.stdout:1/559: truncate d2/d3/d41/d49/f79 4501086 0 2024-08-01T06:56:22.711 INFO:tasks.workunit.client.0.smithi016.stdout:1/560: truncate d2/d3/f5a 730690 0 2024-08-01T06:56:22.715 INFO:tasks.workunit.client.0.smithi016.stdout:3/370: rename d9/da/df/d2a/d69 to d9/d4e/d81 0 2024-08-01T06:56:22.717 INFO:tasks.workunit.client.0.smithi016.stdout:3/371: write d9/d1c/f2b [4217803,130485] 0 2024-08-01T06:56:22.722 INFO:tasks.workunit.client.0.smithi016.stdout:3/372: creat d9/d57/f82 x:0 0 0 2024-08-01T06:56:22.725 INFO:tasks.workunit.client.0.smithi016.stdout:1/561: mkdir d2/de/dc4 0 2024-08-01T06:56:22.727 INFO:tasks.workunit.client.0.smithi016.stdout:3/373: write d9/d57/d66/f73 [799418,3349] 0 2024-08-01T06:56:22.728 INFO:tasks.workunit.client.0.smithi016.stdout:1/562: mkdir d2/d3/d41/d49/d51/dc5 0 2024-08-01T06:56:22.728 INFO:tasks.workunit.client.0.smithi016.stdout:1/563: readlink d2/d2f/l69 0 2024-08-01T06:56:22.730 INFO:tasks.workunit.client.0.smithi016.stdout:3/374: unlink d9/d1c/f2b 0 2024-08-01T06:56:22.734 INFO:tasks.workunit.client.0.smithi016.stdout:9/404: truncate d3/d9/db/dc/d33/f54 437619 0 2024-08-01T06:56:22.737 INFO:tasks.workunit.client.0.smithi016.stdout:9/405: mkdir d3/d9/d46/d48/d8b 0 2024-08-01T06:56:22.738 INFO:tasks.workunit.client.0.smithi016.stdout:3/375: dwrite d9/da/df/d12/d20/d3c/f4b [0,4194304] 0 2024-08-01T06:56:22.758 INFO:tasks.workunit.client.0.smithi016.stdout:9/406: dwrite d3/de/f15 [0,4194304] 0 2024-08-01T06:56:22.762 INFO:tasks.workunit.client.0.smithi016.stdout:3/376: dread d9/da/f47 [0,4194304] 0 2024-08-01T06:56:22.762 INFO:tasks.workunit.client.0.smithi016.stdout:9/407: symlink d3/d9/l8c 0 2024-08-01T06:56:22.764 INFO:tasks.workunit.client.0.smithi016.stdout:3/377: stat d9/da/df/d12/f15 0 2024-08-01T06:56:22.769 INFO:tasks.workunit.client.0.smithi016.stdout:9/408: creat d3/de/d89/f8d x:0 0 0 2024-08-01T06:56:22.771 INFO:tasks.workunit.client.0.smithi016.stdout:3/378: creat d9/da/df/d12/f83 x:0 0 0 2024-08-01T06:56:22.774 INFO:tasks.workunit.client.0.smithi016.stdout:9/409: rename d3/d9/db/d3e/d40/d4e/l63 to d3/d9/db/d3e/d40/l8e 0 2024-08-01T06:56:22.775 INFO:tasks.workunit.client.0.smithi016.stdout:3/379: creat d9/d57/d66/f84 x:0 0 0 2024-08-01T06:56:22.777 INFO:tasks.workunit.client.0.smithi016.stdout:9/410: creat d3/d9/d46/d48/d87/f8f x:0 0 0 2024-08-01T06:56:22.777 INFO:tasks.workunit.client.0.smithi016.stdout:9/411: readlink d3/d9/db/l12 0 2024-08-01T06:56:22.779 INFO:tasks.workunit.client.0.smithi016.stdout:9/412: getdents d3/d9/d73 0 2024-08-01T06:56:22.781 INFO:tasks.workunit.client.0.smithi016.stdout:9/413: symlink d3/d9/db/l90 0 2024-08-01T06:56:22.787 INFO:tasks.workunit.client.0.smithi016.stdout:9/414: link d3/d9/df/l1b d3/l91 0 2024-08-01T06:56:22.795 INFO:tasks.workunit.client.0.smithi016.stdout:9/415: dwrite d3/de/d89/f8d [0,4194304] 0 2024-08-01T06:56:22.798 INFO:tasks.workunit.client.0.smithi016.stdout:9/416: creat d3/d9/df/f92 x:0 0 0 2024-08-01T06:56:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:9/417: dwrite d3/d9/d46/f4a [0,4194304] 0 2024-08-01T06:56:22.847 INFO:tasks.workunit.client.0.smithi016.stdout:9/418: chown d3/de/f7a 7 1 2024-08-01T06:56:22.856 INFO:tasks.workunit.client.0.smithi016.stdout:9/419: dwrite d3/d32/d5c/d8a/d57/f82 [0,4194304] 0 2024-08-01T06:56:22.859 INFO:tasks.workunit.client.0.smithi016.stdout:9/420: mknod d3/d9/db/dc/c93 0 2024-08-01T06:56:22.861 INFO:tasks.workunit.client.0.smithi016.stdout:9/421: write d3/d9/db/dc/d56/f86 [587496,40677] 0 2024-08-01T06:56:22.868 INFO:tasks.workunit.client.0.smithi016.stdout:9/422: dread d3/d32/d5c/d8a/f75 [0,4194304] 0 2024-08-01T06:56:22.869 INFO:tasks.workunit.client.0.smithi016.stdout:9/423: write d3/de/f7a [1738335,57617] 0 2024-08-01T06:56:22.874 INFO:tasks.workunit.client.0.smithi016.stdout:9/424: dread d3/d9/db/d3e/d40/f59 [0,4194304] 0 2024-08-01T06:56:22.875 INFO:tasks.workunit.client.0.smithi016.stdout:9/425: chown d3/d9/db/cd 15979 1 2024-08-01T06:56:22.878 INFO:tasks.workunit.client.0.smithi016.stdout:9/426: rmdir d3/de 39 2024-08-01T06:56:22.879 INFO:tasks.workunit.client.0.smithi016.stdout:9/427: dread - d3/d9/d46/d48/d87/f8f zero size 2024-08-01T06:56:22.883 INFO:tasks.workunit.client.0.smithi016.stdout:9/428: rename d3/d9/db/d3e/d50 to d3/d9/df/d16/d94 0 2024-08-01T06:56:22.884 INFO:tasks.workunit.client.0.smithi016.stdout:9/429: readlink d3/d9/df/l1b 0 2024-08-01T06:56:22.886 INFO:tasks.workunit.client.0.smithi016.stdout:9/430: mknod d3/d9/df/c95 0 2024-08-01T06:56:22.888 INFO:tasks.workunit.client.0.smithi016.stdout:9/431: mknod d3/d32/c96 0 2024-08-01T06:56:22.890 INFO:tasks.workunit.client.0.smithi016.stdout:9/432: rename d3/d32/l6e to d3/d9/db/dc/d33/l97 0 2024-08-01T06:56:22.891 INFO:tasks.workunit.client.0.smithi016.stdout:9/433: rmdir d3/d9/db/d3a 39 2024-08-01T06:56:22.892 INFO:tasks.workunit.client.0.smithi016.stdout:9/434: fsync d3/d9/db/dc/f74 0 2024-08-01T06:56:22.898 INFO:tasks.workunit.client.0.smithi016.stdout:9/435: getdents d3/de/d89 0 2024-08-01T06:56:22.898 INFO:tasks.workunit.client.0.smithi016.stdout:9/436: read - d3/d9/df/f92 zero size 2024-08-01T06:56:22.903 INFO:tasks.workunit.client.0.smithi016.stdout:9/437: dread d3/d9/db/dc/d33/f51 [0,4194304] 0 2024-08-01T06:56:22.906 INFO:tasks.workunit.client.0.smithi016.stdout:9/438: symlink d3/d9/db/d3e/d40/l98 0 2024-08-01T06:56:22.919 INFO:tasks.workunit.client.0.smithi016.stdout:9/439: dread d3/de/f7a [0,4194304] 0 2024-08-01T06:56:22.926 INFO:tasks.workunit.client.0.smithi016.stdout:9/440: dwrite d3/d32/d5c/d8a/fa [0,4194304] 0 2024-08-01T06:56:22.935 INFO:tasks.workunit.client.0.smithi016.stdout:9/441: dread d3/d9/df/d2a/f41 [0,4194304] 0 2024-08-01T06:56:22.939 INFO:tasks.workunit.client.0.smithi016.stdout:9/442: creat d3/d9/db/d3e/f99 x:0 0 0 2024-08-01T06:56:22.946 INFO:tasks.workunit.client.0.smithi016.stdout:9/443: write d3/d9/df/d2a/f41 [39201,32679] 0 2024-08-01T06:56:22.948 INFO:tasks.workunit.client.0.smithi016.stdout:9/444: write d3/d9/db/d3e/f7f [426912,92449] 0 2024-08-01T06:56:22.952 INFO:tasks.workunit.client.0.smithi016.stdout:9/445: dread d3/d9/db/dc/d33/f51 [0,4194304] 0 2024-08-01T06:56:22.956 INFO:tasks.workunit.client.0.smithi016.stdout:9/446: rename d3/d9/d46/d48/d87/f8f to d3/d32/d5c/d8a/d57/f9a 0 2024-08-01T06:56:22.957 INFO:tasks.workunit.client.0.smithi016.stdout:9/447: write d3/d9/db/dc/f42 [2674127,121188] 0 2024-08-01T06:56:22.968 INFO:tasks.workunit.client.0.smithi016.stdout:9/448: dread d3/d9/df/f3d [0,4194304] 0 2024-08-01T06:56:22.972 INFO:tasks.workunit.client.0.smithi016.stdout:9/449: getdents d3/d32/d5c 0 2024-08-01T06:56:22.973 INFO:tasks.workunit.client.0.smithi016.stdout:9/450: write d3/d9/df/f92 [697381,32314] 0 2024-08-01T06:56:22.974 INFO:tasks.workunit.client.0.smithi016.stdout:9/451: write d3/d9/db/dc/d33/f6c [3864357,15664] 0 2024-08-01T06:56:22.977 INFO:tasks.workunit.client.0.smithi016.stdout:9/452: mkdir d3/d9/db/dc/d56/d9b 0 2024-08-01T06:56:22.979 INFO:tasks.workunit.client.0.smithi016.stdout:9/453: readlink d3/d9/db/d3e/d40/l8e 0 2024-08-01T06:56:22.991 INFO:tasks.workunit.client.0.smithi016.stdout:9/454: dread d3/d9/df/d16/f2b [0,4194304] 0 2024-08-01T06:56:22.993 INFO:tasks.workunit.client.0.smithi016.stdout:9/455: symlink d3/d32/d5c/l9c 0 2024-08-01T06:56:22.998 INFO:tasks.workunit.client.0.smithi016.stdout:9/456: dwrite d3/d32/d5c/d8a/d57/f82 [0,4194304] 0 2024-08-01T06:56:23.002 INFO:tasks.workunit.client.0.smithi016.stdout:9/457: symlink d3/d9/db/d3e/d40/d4e/l9d 0 2024-08-01T06:56:23.006 INFO:tasks.workunit.client.0.smithi016.stdout:9/458: dread d3/d32/d5c/d8a/fa [0,4194304] 0 2024-08-01T06:56:23.009 INFO:tasks.workunit.client.0.smithi016.stdout:9/459: read d3/d9/db/f5f [1658089,46181] 0 2024-08-01T06:56:23.012 INFO:tasks.workunit.client.0.smithi016.stdout:9/460: getdents d3/d9/d46/d48/d8b 0 2024-08-01T06:56:23.013 INFO:tasks.workunit.client.0.smithi016.stdout:9/461: write d3/d9/d46/d48/f55 [4840355,84449] 0 2024-08-01T06:56:23.014 INFO:tasks.workunit.client.0.smithi016.stdout:9/462: stat d3/d9/d46/d48/l60 0 2024-08-01T06:56:23.015 INFO:tasks.workunit.client.0.smithi016.stdout:9/463: dread - d3/d9/db/d3e/f99 zero size 2024-08-01T06:56:23.019 INFO:tasks.workunit.client.0.smithi016.stdout:9/464: truncate d3/f65 602978 0 2024-08-01T06:56:23.021 INFO:tasks.workunit.client.0.smithi016.stdout:9/465: creat d3/d9/d73/f9e x:0 0 0 2024-08-01T06:56:23.024 INFO:tasks.workunit.client.0.smithi016.stdout:9/466: getdents d3/d9/d46 0 2024-08-01T06:56:23.025 INFO:tasks.workunit.client.0.smithi016.stdout:9/467: write d3/d9/df/d16/f30 [1748692,38538] 0 2024-08-01T06:56:23.036 INFO:tasks.workunit.client.0.smithi016.stdout:9/468: truncate d3/d32/d5c/d8a/d57/f82 3633464 0 2024-08-01T06:56:23.038 INFO:tasks.workunit.client.0.smithi016.stdout:9/469: creat d3/d9/df/d16/f9f x:0 0 0 2024-08-01T06:56:23.041 INFO:tasks.workunit.client.0.smithi016.stdout:9/470: dread d3/d9/db/d3e/f66 [0,4194304] 0 2024-08-01T06:56:23.042 INFO:tasks.workunit.client.0.smithi016.stdout:9/471: write d3/de/d6d/f81 [429713,98747] 0 2024-08-01T06:56:23.051 INFO:tasks.workunit.client.0.smithi016.stdout:9/472: rename d3/d9/db/dc/l71 to d3/d32/la0 0 2024-08-01T06:56:23.051 INFO:tasks.workunit.client.0.smithi016.stdout:9/473: rename d3/d9/db/dc to d3/d9/db/dc/da1 22 2024-08-01T06:56:23.057 INFO:tasks.workunit.client.0.smithi016.stdout:9/474: link d3/d9/db/dc/d33/c52 d3/d9/df/d2a/ca2 0 2024-08-01T06:56:23.058 INFO:tasks.workunit.client.0.smithi016.stdout:9/475: chown d3/de/f13 1041473193 1 2024-08-01T06:56:23.061 INFO:tasks.workunit.client.0.smithi016.stdout:9/476: dread d3/d9/db/dc/d33/f51 [0,4194304] 0 2024-08-01T06:56:23.062 INFO:tasks.workunit.client.0.smithi016.stdout:9/477: truncate d3/d9/df/d38/f4c 355980 0 2024-08-01T06:56:23.064 INFO:tasks.workunit.client.0.smithi016.stdout:9/478: rmdir d3/d9/db/dc 39 2024-08-01T06:56:23.065 INFO:tasks.workunit.client.0.smithi016.stdout:9/479: readlink d3/d9/db/d3e/d40/l98 0 2024-08-01T06:56:23.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:22 smithi089 ceph-mon[36617]: pgmap v25: 65 pgs: 65 active+clean; 2.4 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 24 MiB/s rd, 110 MiB/s wr, 245 op/s 2024-08-01T06:56:23.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:22 smithi016 ceph-mon[29266]: pgmap v25: 65 pgs: 65 active+clean; 2.4 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 24 MiB/s rd, 110 MiB/s wr, 245 op/s 2024-08-01T06:56:23.194 INFO:tasks.workunit.client.0.smithi016.stdout:9/480: dwrite d3/d32/d5c/d8a/f75 [0,4194304] 0 2024-08-01T06:56:23.198 INFO:tasks.workunit.client.0.smithi016.stdout:9/481: read d3/d9/db/dc/d56/f86 [134219,71192] 0 2024-08-01T06:56:23.205 INFO:tasks.workunit.client.0.smithi016.stdout:9/482: dwrite d3/de/d6d/f81 [0,4194304] 0 2024-08-01T06:56:23.207 INFO:tasks.workunit.client.0.smithi016.stdout:9/483: mknod d3/de/d6d/ca3 0 2024-08-01T06:56:23.212 INFO:tasks.workunit.client.0.smithi016.stdout:9/484: dread d3/de/f15 [0,4194304] 0 2024-08-01T06:56:23.213 INFO:tasks.workunit.client.0.smithi016.stdout:9/485: fsync d3/d9/d46/d48/f55 0 2024-08-01T06:56:23.235 INFO:tasks.workunit.client.0.smithi016.stdout:9/486: fsync d3/d9/db/dc/f2c 0 2024-08-01T06:56:23.236 INFO:tasks.workunit.client.0.smithi016.stdout:9/487: readlink d3/d9/db/d3e/d40/l8e 0 2024-08-01T06:56:23.238 INFO:tasks.workunit.client.0.smithi016.stdout:9/488: symlink d3/d9/db/dc/d33/la4 0 2024-08-01T06:56:23.240 INFO:tasks.workunit.client.0.smithi016.stdout:9/489: chown d3/d9/df/d2a/ca2 21 1 2024-08-01T06:56:23.244 INFO:tasks.workunit.client.0.smithi016.stdout:9/490: mkdir d3/d9/df/d16/d94/da5 0 2024-08-01T06:56:23.247 INFO:tasks.workunit.client.0.smithi016.stdout:9/491: dread d3/d9/df/f3d [0,4194304] 0 2024-08-01T06:56:23.251 INFO:tasks.workunit.client.0.smithi016.stdout:9/492: mknod d3/d32/d5c/ca6 0 2024-08-01T06:56:23.254 INFO:tasks.workunit.client.0.smithi016.stdout:9/493: dread d3/d9/df/d16/f2b [0,4194304] 0 2024-08-01T06:56:23.260 INFO:tasks.workunit.client.0.smithi016.stdout:9/494: dwrite d3/d9/db/dc/f42 [0,4194304] 0 2024-08-01T06:56:23.265 INFO:tasks.workunit.client.0.smithi016.stdout:9/495: dread d3/d9/db/dc/d33/f51 [0,4194304] 0 2024-08-01T06:56:23.268 INFO:tasks.workunit.client.0.smithi016.stdout:9/496: rmdir d3/d9/d46/d48 39 2024-08-01T06:56:23.269 INFO:tasks.workunit.client.0.smithi016.stdout:9/497: read d3/de/f17 [2415630,96069] 0 2024-08-01T06:56:23.276 INFO:tasks.workunit.client.0.smithi016.stdout:9/498: dwrite d3/d9/df/d2a/f3b [0,4194304] 0 2024-08-01T06:56:23.284 INFO:tasks.workunit.client.0.smithi016.stdout:9/499: rename d3/d9/df/d16/d94/l7e to d3/la7 0 2024-08-01T06:56:23.286 INFO:tasks.workunit.client.0.smithi016.stdout:9/500: chown d3/d9/d46/d48 4773668 1 2024-08-01T06:56:23.301 INFO:tasks.workunit.client.0.smithi016.stdout:9/501: write d3/d9/db/d3e/d40/f4b [4447802,67809] 0 2024-08-01T06:56:23.306 INFO:tasks.workunit.client.0.smithi016.stdout:9/502: dread d3/d9/db/dc/d33/f6c [0,4194304] 0 2024-08-01T06:56:23.307 INFO:tasks.workunit.client.0.smithi016.stdout:9/503: truncate d3/d9/db/d3e/f66 1066992 0 2024-08-01T06:56:23.310 INFO:tasks.workunit.client.0.smithi016.stdout:9/504: write d3/de/f15 [3982597,71485] 0 2024-08-01T06:56:23.314 INFO:tasks.workunit.client.0.smithi016.stdout:9/505: dread d3/d9/d46/f4a [0,4194304] 0 2024-08-01T06:56:23.324 INFO:tasks.workunit.client.0.smithi016.stdout:9/506: dread d3/d9/d46/d48/f55 [0,4194304] 0 2024-08-01T06:56:23.694 INFO:tasks.workunit.client.0.smithi016.stdout:5/476: sync 2024-08-01T06:56:23.694 INFO:tasks.workunit.client.0.smithi016.stdout:0/350: sync 2024-08-01T06:56:23.694 INFO:tasks.workunit.client.0.smithi016.stdout:4/460: sync 2024-08-01T06:56:23.696 INFO:tasks.workunit.client.0.smithi016.stdout:0/351: rmdir d10 39 2024-08-01T06:56:23.700 INFO:tasks.workunit.client.0.smithi016.stdout:4/461: dwrite d0/d17/d22/f31 [0,4194304] 0 2024-08-01T06:56:23.705 INFO:tasks.workunit.client.0.smithi016.stdout:5/477: dwrite d1/d12/d3e/f92 [0,4194304] 0 2024-08-01T06:56:23.711 INFO:tasks.workunit.client.0.smithi016.stdout:5/478: creat d1/d2/d6/d9/d49/fa3 x:0 0 0 2024-08-01T06:56:23.711 INFO:tasks.workunit.client.0.smithi016.stdout:0/352: rename d10/d11/d37/d58/f65 to d10/d11/d41/f6f 0 2024-08-01T06:56:23.713 INFO:tasks.workunit.client.0.smithi016.stdout:5/479: symlink d1/la4 0 2024-08-01T06:56:23.714 INFO:tasks.workunit.client.0.smithi016.stdout:0/353: unlink d10/l62 0 2024-08-01T06:56:23.721 INFO:tasks.workunit.client.0.smithi016.stdout:4/462: truncate d0/d17/d38/f43 423975 0 2024-08-01T06:56:23.722 INFO:tasks.workunit.client.0.smithi016.stdout:0/354: dwrite d10/d11/d41/f60 [0,4194304] 0 2024-08-01T06:56:23.726 INFO:tasks.workunit.client.0.smithi016.stdout:0/355: creat d10/d11/d37/d58/f70 x:0 0 0 2024-08-01T06:56:23.732 INFO:tasks.workunit.client.0.smithi016.stdout:0/356: creat d10/d11/d41/f71 x:0 0 0 2024-08-01T06:56:23.736 INFO:tasks.workunit.client.0.smithi016.stdout:5/480: dwrite d1/d2/d23/f88 [0,4194304] 0 2024-08-01T06:56:23.741 INFO:tasks.workunit.client.0.smithi016.stdout:5/481: symlink d1/d12/d3e/la5 0 2024-08-01T06:56:23.744 INFO:tasks.workunit.client.0.smithi016.stdout:0/357: link d10/d5c/l6a d10/d11/d37/l72 0 2024-08-01T06:56:23.758 INFO:tasks.workunit.client.0.smithi016.stdout:5/482: write d1/d2/f48 [283376,70199] 0 2024-08-01T06:56:23.759 INFO:tasks.workunit.client.0.smithi016.stdout:5/483: readlink d1/d2/d6/d9/lf 0 2024-08-01T06:56:23.762 INFO:tasks.workunit.client.0.smithi016.stdout:5/484: unlink d1/d2/d23/fa2 0 2024-08-01T06:56:23.763 INFO:tasks.workunit.client.0.smithi016.stdout:0/358: dread d10/d1c/f29 [0,4194304] 0 2024-08-01T06:56:23.769 INFO:tasks.workunit.client.0.smithi016.stdout:0/359: dwrite d10/f45 [0,4194304] 0 2024-08-01T06:56:23.774 INFO:tasks.workunit.client.0.smithi016.stdout:0/360: symlink d10/l73 0 2024-08-01T06:56:23.792 INFO:tasks.workunit.client.0.smithi016.stdout:2/625: sync 2024-08-01T06:56:23.801 INFO:tasks.workunit.client.0.smithi016.stdout:0/361: write d10/f49 [39912,85012] 0 2024-08-01T06:56:23.802 INFO:tasks.workunit.client.0.smithi016.stdout:0/362: stat d10/c1f 0 2024-08-01T06:56:23.802 INFO:tasks.workunit.client.0.smithi016.stdout:0/363: chown d10/l4a 38235689 1 2024-08-01T06:56:23.807 INFO:tasks.workunit.client.0.smithi016.stdout:2/626: dread d0/d8/f18 [4194304,4194304] 0 2024-08-01T06:56:23.808 INFO:tasks.workunit.client.0.smithi016.stdout:0/364: truncate d10/d11/d37/f55 2489886 0 2024-08-01T06:56:23.813 INFO:tasks.workunit.client.0.smithi016.stdout:2/627: rename d0/d16/d20/d2e to d0/d8/d1b/dcc 0 2024-08-01T06:56:23.819 INFO:tasks.workunit.client.0.smithi016.stdout:2/628: mknod d0/d8/d1b/dcc/d3b/d45/ccd 0 2024-08-01T06:56:23.821 INFO:tasks.workunit.client.0.smithi016.stdout:0/365: link d10/l4b d10/d11/d37/d58/l74 0 2024-08-01T06:56:23.827 INFO:tasks.workunit.client.0.smithi016.stdout:0/366: stat fd 0 2024-08-01T06:56:23.828 INFO:tasks.workunit.client.0.smithi016.stdout:0/367: read - d10/d11/d41/f6f zero size 2024-08-01T06:56:23.828 INFO:tasks.workunit.client.0.smithi016.stdout:2/629: rmdir d0 39 2024-08-01T06:56:23.830 INFO:tasks.workunit.client.0.smithi016.stdout:0/368: rename f6 to d10/d5c/f75 0 2024-08-01T06:56:23.834 INFO:tasks.workunit.client.0.smithi016.stdout:2/630: rename d0/d8/c13 to d0/d8/d1b/d74/d90/cce 0 2024-08-01T06:56:23.837 INFO:tasks.workunit.client.0.smithi016.stdout:0/369: unlink d10/d11/c47 0 2024-08-01T06:56:23.838 INFO:tasks.workunit.client.0.smithi016.stdout:2/631: symlink d0/d8/d1b/dcc/d3b/lcf 0 2024-08-01T06:56:23.838 INFO:tasks.workunit.client.0.smithi016.stdout:0/370: dread d10/f17 [0,4194304] 0 2024-08-01T06:56:23.840 INFO:tasks.workunit.client.0.smithi016.stdout:2/632: rmdir d0/d8/d31/da7 39 2024-08-01T06:56:23.841 INFO:tasks.workunit.client.0.smithi016.stdout:0/371: mknod d10/d11/d37/d58/c76 0 2024-08-01T06:56:23.843 INFO:tasks.workunit.client.0.smithi016.stdout:2/633: truncate d0/d8/f52 1104443 0 2024-08-01T06:56:23.844 INFO:tasks.workunit.client.0.smithi016.stdout:0/372: creat d10/d11/d37/d50/f77 x:0 0 0 2024-08-01T06:56:23.849 INFO:tasks.workunit.client.0.smithi016.stdout:0/373: symlink d10/d11/d37/d50/l78 0 2024-08-01T06:56:23.851 INFO:tasks.workunit.client.0.smithi016.stdout:0/374: dread - d10/d11/f43 zero size 2024-08-01T06:56:23.852 INFO:tasks.workunit.client.0.smithi016.stdout:0/375: dread d10/f17 [0,4194304] 0 2024-08-01T06:56:23.853 INFO:tasks.workunit.client.0.smithi016.stdout:0/376: fdatasync d10/f33 0 2024-08-01T06:56:23.854 INFO:tasks.workunit.client.0.smithi016.stdout:0/377: dread - d10/f5a zero size 2024-08-01T06:56:23.854 INFO:tasks.workunit.client.0.smithi016.stdout:0/378: fsync d10/f45 0 2024-08-01T06:56:23.857 INFO:tasks.workunit.client.0.smithi016.stdout:2/634: dwrite d0/f40 [0,4194304] 0 2024-08-01T06:56:23.860 INFO:tasks.workunit.client.0.smithi016.stdout:0/379: creat d10/d11/d37/d58/f79 x:0 0 0 2024-08-01T06:56:23.860 INFO:tasks.workunit.client.0.smithi016.stdout:2/635: write d0/d8/d31/d5e/fbb [123736,108074] 0 2024-08-01T06:56:23.865 INFO:tasks.workunit.client.0.smithi016.stdout:0/380: mkdir d10/d11/d37/d53/d7a 0 2024-08-01T06:56:23.865 INFO:tasks.workunit.client.0.smithi016.stdout:0/381: fsync d10/d1c/f46 0 2024-08-01T06:56:23.868 INFO:tasks.workunit.client.0.smithi016.stdout:0/382: write d10/d11/f64 [791452,116942] 0 2024-08-01T06:56:23.870 INFO:tasks.workunit.client.0.smithi016.stdout:0/383: write d10/d1c/f4e [2144377,20816] 0 2024-08-01T06:56:23.870 INFO:tasks.workunit.client.0.smithi016.stdout:2/636: link d0/d8/d1b/d74/d99/fbc d0/d8/d1b/d74/fd0 0 2024-08-01T06:56:23.874 INFO:tasks.workunit.client.0.smithi016.stdout:2/637: write d0/d8/d1b/d74/d90/d93/f4d [2670265,55580] 0 2024-08-01T06:56:23.875 INFO:tasks.workunit.client.0.smithi016.stdout:2/638: chown d0/d8/d1b/d74/d90/d93/ca3 29792 1 2024-08-01T06:56:23.880 INFO:tasks.workunit.client.0.smithi016.stdout:0/384: getdents d10/d11/d37/d58 0 2024-08-01T06:56:23.881 INFO:tasks.workunit.client.0.smithi016.stdout:0/385: symlink d10/d11/d37/d58/l7b 0 2024-08-01T06:56:23.884 INFO:tasks.workunit.client.0.smithi016.stdout:0/386: mkdir d10/d1c/d7c 0 2024-08-01T06:56:23.892 INFO:tasks.workunit.client.0.smithi016.stdout:2/639: dread d0/d8/d1b/d74/d99/fa0 [0,4194304] 0 2024-08-01T06:56:23.893 INFO:tasks.workunit.client.0.smithi016.stdout:2/640: readlink d0/d16/l1e 0 2024-08-01T06:56:23.895 INFO:tasks.workunit.client.0.smithi016.stdout:2/641: write d0/d8/d1b/dcc/d3b/fa9 [695612,55696] 0 2024-08-01T06:56:23.898 INFO:tasks.workunit.client.0.smithi016.stdout:0/387: dread d10/d11/f4d [0,4194304] 0 2024-08-01T06:56:23.898 INFO:tasks.workunit.client.0.smithi016.stdout:2/642: creat d0/d8/d31/dc1/dc4/fd1 x:0 0 0 2024-08-01T06:56:23.903 INFO:tasks.workunit.client.0.smithi016.stdout:0/388: rmdir d10/d11/d37/d53/d7a 0 2024-08-01T06:56:23.911 INFO:tasks.workunit.client.0.smithi016.stdout:0/389: write d10/d11/f3d [828117,31298] 0 2024-08-01T06:56:23.915 INFO:tasks.workunit.client.0.smithi016.stdout:2/643: dread d0/d8/d1b/d74/f81 [0,4194304] 0 2024-08-01T06:56:23.915 INFO:tasks.workunit.client.0.smithi016.stdout:2/644: chown d0/d8/d1b 32472 1 2024-08-01T06:56:23.917 INFO:tasks.workunit.client.0.smithi016.stdout:2/645: symlink d0/d8/d1b/ld2 0 2024-08-01T06:56:23.920 INFO:tasks.workunit.client.0.smithi016.stdout:2/646: creat d0/d8/d31/da7/fd3 x:0 0 0 2024-08-01T06:56:23.923 INFO:tasks.workunit.client.0.smithi016.stdout:2/647: mkdir d0/d8/d31/da7/dd4 0 2024-08-01T06:56:23.924 INFO:tasks.workunit.client.0.smithi016.stdout:2/648: chown d0/d8/d1b/d74/d99/fa0 292 1 2024-08-01T06:56:23.925 INFO:tasks.workunit.client.0.smithi016.stdout:2/649: chown d0/d8/f26 33242 1 2024-08-01T06:56:23.925 INFO:tasks.workunit.client.0.smithi016.stdout:0/390: dread d10/d5c/f75 [0,4194304] 0 2024-08-01T06:56:23.926 INFO:tasks.workunit.client.0.smithi016.stdout:2/650: stat d0/d8/d1b/d74/f81 0 2024-08-01T06:56:23.927 INFO:tasks.workunit.client.0.smithi016.stdout:0/391: chown d10/d11/c6b 55155 1 2024-08-01T06:56:23.929 INFO:tasks.workunit.client.0.smithi016.stdout:2/651: mknod d0/d8/d31/dc1/dc4/cd5 0 2024-08-01T06:56:23.932 INFO:tasks.workunit.client.0.smithi016.stdout:2/652: write d0/d8/d22/f88 [6458836,7411] 0 2024-08-01T06:56:23.933 INFO:tasks.workunit.client.0.smithi016.stdout:2/653: chown d0/d16/f50 1 1 2024-08-01T06:56:23.934 INFO:tasks.workunit.client.0.smithi016.stdout:0/392: dwrite d10/d11/d41/f2a [0,4194304] 0 2024-08-01T06:56:23.939 INFO:tasks.workunit.client.0.smithi016.stdout:0/393: getdents d10/d1c/d7c 0 2024-08-01T06:56:23.943 INFO:tasks.workunit.client.0.smithi016.stdout:0/394: link d10/f45 d10/d11/d37/f7d 0 2024-08-01T06:56:23.943 INFO:tasks.workunit.client.0.smithi016.stdout:2/654: dwrite d0/d8/d31/f53 [0,4194304] 0 2024-08-01T06:56:23.947 INFO:tasks.workunit.client.0.smithi016.stdout:0/395: stat d10/d11/f15 0 2024-08-01T06:56:23.947 INFO:tasks.workunit.client.0.smithi016.stdout:2/655: rmdir d0/d7d 39 2024-08-01T06:56:23.958 INFO:tasks.workunit.client.0.smithi016.stdout:2/656: dwrite d0/d16/f50 [0,4194304] 0 2024-08-01T06:56:23.963 INFO:tasks.workunit.client.0.smithi016.stdout:2/657: creat d0/d8/d31/dc1/fd6 x:0 0 0 2024-08-01T06:56:23.970 INFO:tasks.workunit.client.0.smithi016.stdout:2/658: dwrite d0/d8/d1b/dcc/d3b/fa9 [0,4194304] 0 2024-08-01T06:56:23.975 INFO:tasks.workunit.client.0.smithi016.stdout:0/396: dread d10/d1c/f4e [0,4194304] 0 2024-08-01T06:56:23.978 INFO:tasks.workunit.client.0.smithi016.stdout:2/659: dwrite d0/d8/d1b/dcc/d3b/d45/f7b [0,4194304] 0 2024-08-01T06:56:23.987 INFO:tasks.workunit.client.0.smithi016.stdout:2/660: truncate d0/d16/f41 422881 0 2024-08-01T06:56:23.990 INFO:tasks.workunit.client.0.smithi016.stdout:0/397: link d10/d11/d41/c19 d10/d11/d37/c7e 0 2024-08-01T06:56:23.995 INFO:tasks.workunit.client.0.smithi016.stdout:2/661: dwrite d0/d8/d31/dc1/dc4/fd1 [0,4194304] 0 2024-08-01T06:56:23.997 INFO:tasks.workunit.client.0.smithi016.stdout:2/662: dread - d0/d8/d31/dc1/fd6 zero size 2024-08-01T06:56:23.998 INFO:tasks.workunit.client.0.smithi016.stdout:0/398: rename d10/d1c/f29 to d10/f7f 0 2024-08-01T06:56:23.998 INFO:tasks.workunit.client.0.smithi016.stdout:2/663: fdatasync d0/d8/d31/f53 0 2024-08-01T06:56:24.000 INFO:tasks.workunit.client.0.smithi016.stdout:0/399: write d10/d11/d37/d53/f69 [332155,65961] 0 2024-08-01T06:56:24.001 INFO:tasks.workunit.client.0.smithi016.stdout:2/664: readlink d0/d7d/d8b/l8f 0 2024-08-01T06:56:24.005 INFO:tasks.workunit.client.0.smithi016.stdout:2/665: truncate d0/d8/d1b/dcc/d68/fae 851884 0 2024-08-01T06:56:24.006 INFO:tasks.workunit.client.0.smithi016.stdout:2/666: truncate d0/d16/d20/f87 472620 0 2024-08-01T06:56:24.009 INFO:tasks.workunit.client.0.smithi016.stdout:2/667: symlink d0/d8/d1b/ld7 0 2024-08-01T06:56:24.011 INFO:tasks.workunit.client.0.smithi016.stdout:0/400: truncate d10/d11/f4d 1697461 0 2024-08-01T06:56:24.012 INFO:tasks.workunit.client.0.smithi016.stdout:0/401: write d10/d11/d41/f60 [3232425,126682] 0 2024-08-01T06:56:24.013 INFO:tasks.workunit.client.0.smithi016.stdout:2/668: creat d0/d8/d1b/dcc/d68/fd8 x:0 0 0 2024-08-01T06:56:24.022 INFO:tasks.workunit.client.0.smithi016.stdout:2/669: dwrite d0/d8/d1b/d74/d99/fa0 [0,4194304] 0 2024-08-01T06:56:24.024 INFO:tasks.workunit.client.0.smithi016.stdout:2/670: mkdir d0/d8/d1b/dd9 0 2024-08-01T06:56:24.028 INFO:tasks.workunit.client.0.smithi016.stdout:2/671: mknod d0/cda 0 2024-08-01T06:56:24.029 INFO:tasks.workunit.client.0.smithi016.stdout:0/402: dwrite d10/d11/d37/f55 [0,4194304] 0 2024-08-01T06:56:24.033 INFO:tasks.workunit.client.0.smithi016.stdout:0/403: mknod d10/d11/d37/d53/c80 0 2024-08-01T06:56:24.034 INFO:tasks.workunit.client.0.smithi016.stdout:0/404: write d10/d11/d37/d58/f59 [182079,34691] 0 2024-08-01T06:56:24.038 INFO:tasks.workunit.client.0.smithi016.stdout:2/672: link d0/d8/d1b/dcc/d3b/d45/l48 d0/ldb 0 2024-08-01T06:56:24.039 INFO:tasks.workunit.client.0.smithi016.stdout:2/673: stat d0/d16/l71 0 2024-08-01T06:56:24.042 INFO:tasks.workunit.client.0.smithi016.stdout:2/674: mknod d0/d8/d1b/d74/d90/daf/cdc 0 2024-08-01T06:56:24.045 INFO:tasks.workunit.client.0.smithi016.stdout:2/675: rename d0/d8/d1b/d74/d90/d93/f2f to d0/d8/d31/d5e/fdd 0 2024-08-01T06:56:24.046 INFO:tasks.workunit.client.0.smithi016.stdout:2/676: readlink d0/d8/d1b/dcc/d3b/l5a 0 2024-08-01T06:56:24.046 INFO:tasks.workunit.client.0.smithi016.stdout:2/677: fdatasync d0/d8/d1b/dcc/d68/fc6 0 2024-08-01T06:56:24.052 INFO:tasks.workunit.client.0.smithi016.stdout:2/678: dread d0/d8/d22/f9b [0,4194304] 0 2024-08-01T06:56:24.058 INFO:tasks.workunit.client.0.smithi016.stdout:2/679: dwrite d0/d8/d1b/dcc/d68/fc6 [0,4194304] 0 2024-08-01T06:56:24.062 INFO:tasks.workunit.client.0.smithi016.stdout:2/680: write d0/d8/d1b/dcc/f80 [88815,2699] 0 2024-08-01T06:56:24.109 INFO:tasks.workunit.client.0.smithi016.stdout:2/681: link d0/lb9 d0/d8/d1b/dcc/d68/lde 0 2024-08-01T06:56:24.118 INFO:tasks.workunit.client.0.smithi016.stdout:2/682: fdatasync d0/d8/d1b/d74/d99/fbc 0 2024-08-01T06:56:24.126 INFO:tasks.workunit.client.0.smithi016.stdout:2/683: dwrite d0/d8/d31/dc1/dc4/fd1 [0,4194304] 0 2024-08-01T06:56:24.134 INFO:tasks.workunit.client.0.smithi016.stdout:2/684: getdents d0/d8/d31/d5e 0 2024-08-01T06:56:24.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:23 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:56:24.143 INFO:tasks.workunit.client.0.smithi016.stdout:2/685: rmdir d0/d8/d1b/dcc/dcb 0 2024-08-01T06:56:24.144 INFO:tasks.workunit.client.0.smithi016.stdout:2/686: chown d0/d8/d31/da7 0 1 2024-08-01T06:56:24.147 INFO:tasks.workunit.client.0.smithi016.stdout:2/687: mkdir d0/d8/d31/da7/ddf 0 2024-08-01T06:56:24.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:23 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:56:24.152 INFO:tasks.workunit.client.0.smithi016.stdout:2/688: rename d0/d7d/d8b/l8f to d0/d8/d22/le0 0 2024-08-01T06:56:24.179 INFO:tasks.workunit.client.0.smithi016.stdout:2/689: truncate d0/d8/d31/d5e/fdd 412483 0 2024-08-01T06:56:24.184 INFO:tasks.workunit.client.0.smithi016.stdout:2/690: link d0/l47 d0/d8/d1b/d74/d99/le1 0 2024-08-01T06:56:24.186 INFO:tasks.workunit.client.0.smithi016.stdout:2/691: read d0/d8/d1b/dcc/f4f [346871,20590] 0 2024-08-01T06:56:24.187 INFO:tasks.workunit.client.0.smithi016.stdout:2/692: fdatasync d0/d8/d31/da7/fd3 0 2024-08-01T06:56:24.190 INFO:tasks.workunit.client.0.smithi016.stdout:2/693: truncate d0/d8/d1b/dcc/f46 8165841 0 2024-08-01T06:56:24.192 INFO:tasks.workunit.client.0.smithi016.stdout:2/694: write d0/d8/d1b/f1c [3086047,50483] 0 2024-08-01T06:56:24.196 INFO:tasks.workunit.client.0.smithi016.stdout:2/695: dread d0/d16/f50 [0,4194304] 0 2024-08-01T06:56:24.199 INFO:tasks.workunit.client.0.smithi016.stdout:2/696: creat d0/d8/d1b/dcc/d68/fe2 x:0 0 0 2024-08-01T06:56:24.208 INFO:tasks.workunit.client.0.smithi016.stdout:2/697: truncate d0/d8/f26 4205932 0 2024-08-01T06:56:24.209 INFO:tasks.workunit.client.0.smithi016.stdout:2/698: fsync d0/d8/d1b/dcc/f80 0 2024-08-01T06:56:24.212 INFO:tasks.workunit.client.0.smithi016.stdout:2/699: mknod d0/d8/d1b/dcc/ce3 0 2024-08-01T06:56:24.214 INFO:tasks.workunit.client.0.smithi016.stdout:2/700: mkdir d0/d8/d31/d5e/de4 0 2024-08-01T06:56:24.215 INFO:tasks.workunit.client.0.smithi016.stdout:2/701: write d0/f40 [3537594,57802] 0 2024-08-01T06:56:24.218 INFO:tasks.workunit.client.0.smithi016.stdout:2/702: mkdir d0/d8/d1b/de5 0 2024-08-01T06:56:24.221 INFO:tasks.workunit.client.0.smithi016.stdout:6/531: sync 2024-08-01T06:56:24.221 INFO:tasks.workunit.client.0.smithi016.stdout:8/414: sync 2024-08-01T06:56:24.221 INFO:tasks.workunit.client.0.smithi016.stdout:7/435: sync 2024-08-01T06:56:24.221 INFO:tasks.workunit.client.0.smithi016.stdout:4/463: sync 2024-08-01T06:56:24.221 INFO:tasks.workunit.client.0.smithi016.stdout:9/507: sync 2024-08-01T06:56:24.221 INFO:tasks.workunit.client.0.smithi016.stdout:3/380: sync 2024-08-01T06:56:24.221 INFO:tasks.workunit.client.0.smithi016.stdout:5/485: sync 2024-08-01T06:56:24.222 INFO:tasks.workunit.client.0.smithi016.stdout:1/564: sync 2024-08-01T06:56:24.226 INFO:tasks.workunit.client.0.smithi016.stdout:8/415: dread - d5/d8/d1a/d24/d48/d69/f78 zero size 2024-08-01T06:56:24.229 INFO:tasks.workunit.client.0.smithi016.stdout:2/703: chown d0/d8/d1b/dcc/d68/lde 956452716 1 2024-08-01T06:56:24.237 INFO:tasks.workunit.client.0.smithi016.stdout:4/464: dread d0/d17/f30 [0,4194304] 0 2024-08-01T06:56:24.240 INFO:tasks.workunit.client.0.smithi016.stdout:9/508: mknod d3/d9/db/d3e/d40/d80/ca8 0 2024-08-01T06:56:24.241 INFO:tasks.workunit.client.0.smithi016.stdout:9/509: chown d3/de/f7a 0 1 2024-08-01T06:56:24.242 INFO:tasks.workunit.client.0.smithi016.stdout:9/510: write d3/d9/df/d16/f1e [5365282,3591] 0 2024-08-01T06:56:24.242 INFO:tasks.workunit.client.0.smithi016.stdout:5/486: write d1/d2/d6/d9/d49/d57/f64 [781723,109085] 0 2024-08-01T06:56:24.243 INFO:tasks.workunit.client.0.smithi016.stdout:9/511: readlink d3/l91 0 2024-08-01T06:56:24.243 INFO:tasks.workunit.client.0.smithi016.stdout:5/487: chown d1/d12/d3e 302 1 2024-08-01T06:56:24.248 INFO:tasks.workunit.client.0.smithi016.stdout:8/416: dread d5/f38 [0,4194304] 0 2024-08-01T06:56:24.249 INFO:tasks.workunit.client.0.smithi016.stdout:7/436: link d7/db/d17/d72/d1e/f1f d7/db/fa6 0 2024-08-01T06:56:24.249 INFO:tasks.workunit.client.0.smithi016.stdout:8/417: dread - d5/f1b zero size 2024-08-01T06:56:24.249 INFO:tasks.workunit.client.0.smithi016.stdout:9/512: dread d3/d9/df/f92 [0,4194304] 0 2024-08-01T06:56:24.250 INFO:tasks.workunit.client.0.smithi016.stdout:6/532: dwrite d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f62 [0,4194304] 0 2024-08-01T06:56:24.259 INFO:tasks.workunit.client.0.smithi016.stdout:5/488: creat d1/d12/d52/fa6 x:0 0 0 2024-08-01T06:56:24.260 INFO:tasks.workunit.client.0.smithi016.stdout:8/418: dwrite d5/f84 [0,4194304] 0 2024-08-01T06:56:24.263 INFO:tasks.workunit.client.0.smithi016.stdout:1/565: link d2/f2a d2/de/fc6 0 2024-08-01T06:56:24.265 INFO:tasks.workunit.client.0.smithi016.stdout:3/381: truncate d9/da/df/d12/d20/f35 2910836 0 2024-08-01T06:56:24.266 INFO:tasks.workunit.client.0.smithi016.stdout:9/513: fsync d3/d9/d46/f4a 0 2024-08-01T06:56:24.269 INFO:tasks.workunit.client.0.smithi016.stdout:7/437: creat d7/db/d17/d72/d1c/d1d/d40/d7f/fa7 x:0 0 0 2024-08-01T06:56:24.270 INFO:tasks.workunit.client.0.smithi016.stdout:2/704: link d0/d8/d1b/dcc/lc8 d0/d8/d31/da7/db4/le6 0 2024-08-01T06:56:24.279 INFO:tasks.workunit.client.0.smithi016.stdout:0/405: sync 2024-08-01T06:56:24.279 INFO:tasks.workunit.client.0.smithi016.stdout:1/566: chown d2/d3/d41/d49/f79 2592903 1 2024-08-01T06:56:24.280 INFO:tasks.workunit.client.0.smithi016.stdout:4/465: rename d0/d17/d22/c83 to d0/d17/c9a 0 2024-08-01T06:56:24.283 INFO:tasks.workunit.client.0.smithi016.stdout:9/514: creat d3/de/d89/fa9 x:0 0 0 2024-08-01T06:56:24.288 INFO:tasks.workunit.client.0.smithi016.stdout:7/438: truncate d7/db/f28 4146154 0 2024-08-01T06:56:24.289 INFO:tasks.workunit.client.0.smithi016.stdout:7/439: stat d7/db/d17/d72/d1c/d1d/d5e 0 2024-08-01T06:56:24.290 INFO:tasks.workunit.client.0.smithi016.stdout:8/419: creat d5/d8/d75/f8a x:0 0 0 2024-08-01T06:56:24.291 INFO:tasks.workunit.client.0.smithi016.stdout:8/420: chown d5/d8/d1a/d59 53 1 2024-08-01T06:56:24.292 INFO:tasks.workunit.client.0.smithi016.stdout:5/489: creat d1/d2/d6/d5a/da1/fa7 x:0 0 0 2024-08-01T06:56:24.294 INFO:tasks.workunit.client.0.smithi016.stdout:0/406: unlink d10/l4a 0 2024-08-01T06:56:24.295 INFO:tasks.workunit.client.0.smithi016.stdout:0/407: fdatasync d10/d11/d37/f55 0 2024-08-01T06:56:24.295 INFO:tasks.workunit.client.0.smithi016.stdout:1/567: symlink d2/d3/d1a/d22/lc7 0 2024-08-01T06:56:24.296 INFO:tasks.workunit.client.0.smithi016.stdout:6/533: write d1/d8/d1b/f35 [317380,4994] 0 2024-08-01T06:56:24.298 INFO:tasks.workunit.client.0.smithi016.stdout:2/705: rename d0/d8/d1b/d74/d90/daf to d0/d8/d31/dc1/de7 0 2024-08-01T06:56:24.300 INFO:tasks.workunit.client.0.smithi016.stdout:3/382: symlink d9/d4e/d72/l85 0 2024-08-01T06:56:24.303 INFO:tasks.workunit.client.0.smithi016.stdout:7/440: readlink d7/ld 0 2024-08-01T06:56:24.304 INFO:tasks.workunit.client.0.smithi016.stdout:8/421: symlink d5/d67/d86/l8b 0 2024-08-01T06:56:24.308 INFO:tasks.workunit.client.0.smithi016.stdout:3/383: write d9/d57/d66/f84 [848121,30898] 0 2024-08-01T06:56:24.308 INFO:tasks.workunit.client.0.smithi016.stdout:0/408: dwrite d10/f2e [0,4194304] 0 2024-08-01T06:56:24.308 INFO:tasks.workunit.client.0.smithi016.stdout:6/534: dread d1/d8/d1b/f35 [0,4194304] 0 2024-08-01T06:56:24.310 INFO:tasks.workunit.client.0.smithi016.stdout:0/409: stat d10/d11/d41/f60 0 2024-08-01T06:56:24.312 INFO:tasks.workunit.client.0.smithi016.stdout:2/706: creat d0/d8/d6b/fe8 x:0 0 0 2024-08-01T06:56:24.314 INFO:tasks.workunit.client.0.smithi016.stdout:0/410: chown d10/d1c/c66 2638 1 2024-08-01T06:56:24.318 INFO:tasks.workunit.client.0.smithi016.stdout:4/466: dread d0/f23 [0,4194304] 0 2024-08-01T06:56:24.322 INFO:tasks.workunit.client.0.smithi016.stdout:6/535: dwrite d1/d8/d1b/d22/d71/fac [0,4194304] 0 2024-08-01T06:56:24.323 INFO:tasks.workunit.client.0.smithi016.stdout:3/384: creat d9/da/f86 x:0 0 0 2024-08-01T06:56:24.324 INFO:tasks.workunit.client.0.smithi016.stdout:3/385: fsync d9/d57/d66/f84 0 2024-08-01T06:56:24.326 INFO:tasks.workunit.client.0.smithi016.stdout:3/386: stat d9/da/df/c16 0 2024-08-01T06:56:24.329 INFO:tasks.workunit.client.0.smithi016.stdout:1/568: rename d2/d3/f5 to d2/de/d32/fc8 0 2024-08-01T06:56:24.335 INFO:tasks.workunit.client.0.smithi016.stdout:0/411: creat d10/d11/d37/d58/f81 x:0 0 0 2024-08-01T06:56:24.339 INFO:tasks.workunit.client.0.smithi016.stdout:6/536: symlink d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d93/lbe 0 2024-08-01T06:56:24.341 INFO:tasks.workunit.client.0.smithi016.stdout:3/387: creat d9/da/df/d12/d20/d5c/d76/f87 x:0 0 0 2024-08-01T06:56:24.341 INFO:tasks.workunit.client.0.smithi016.stdout:8/422: dread d5/d8/d1a/d24/f4a [0,4194304] 0 2024-08-01T06:56:24.342 INFO:tasks.workunit.client.0.smithi016.stdout:1/569: creat d2/d3/d41/d49/d85/fc9 x:0 0 0 2024-08-01T06:56:24.343 INFO:tasks.workunit.client.0.smithi016.stdout:2/707: symlink d0/d8/d31/db6/le9 0 2024-08-01T06:56:24.346 INFO:tasks.workunit.client.0.smithi016.stdout:5/490: getdents d1/d2/d23/d3a 0 2024-08-01T06:56:24.346 INFO:tasks.workunit.client.0.smithi016.stdout:0/412: stat d10/d11/c56 0 2024-08-01T06:56:24.348 INFO:tasks.workunit.client.0.smithi016.stdout:6/537: mkdir d1/d41/dbf 0 2024-08-01T06:56:24.352 INFO:tasks.workunit.client.0.smithi016.stdout:9/515: dwrite d3/f65 [0,4194304] 0 2024-08-01T06:56:24.355 INFO:tasks.workunit.client.0.smithi016.stdout:7/441: dwrite d7/db/f6f [0,4194304] 0 2024-08-01T06:56:24.355 INFO:tasks.workunit.client.0.smithi016.stdout:1/570: symlink d2/d2f/dba/lca 0 2024-08-01T06:56:24.357 INFO:tasks.workunit.client.0.smithi016.stdout:2/708: rmdir d0/d8/d1b/d74/d90 39 2024-08-01T06:56:24.359 INFO:tasks.workunit.client.0.smithi016.stdout:4/467: creat d0/d2/dc/d12/d29/f9b x:0 0 0 2024-08-01T06:56:24.364 INFO:tasks.workunit.client.0.smithi016.stdout:1/571: dwrite d2/d88/f93 [0,4194304] 0 2024-08-01T06:56:24.365 INFO:tasks.workunit.client.0.smithi016.stdout:3/388: symlink d9/da/df/l88 0 2024-08-01T06:56:24.367 INFO:tasks.workunit.client.0.smithi016.stdout:3/389: dread - d9/d57/f74 zero size 2024-08-01T06:56:24.371 INFO:tasks.workunit.client.0.smithi016.stdout:5/491: mkdir d1/d2/d6/d9/d19/d7a/da8 0 2024-08-01T06:56:24.375 INFO:tasks.workunit.client.0.smithi016.stdout:1/572: symlink d2/de/d21/d3e/lcb 0 2024-08-01T06:56:24.376 INFO:tasks.workunit.client.0.smithi016.stdout:2/709: read d0/d8/f26 [1784224,69184] 0 2024-08-01T06:56:24.377 INFO:tasks.workunit.client.0.smithi016.stdout:1/573: stat d2/de/d4d/fbd 0 2024-08-01T06:56:24.377 INFO:tasks.workunit.client.0.smithi016.stdout:7/442: chown d7/db/d17/d72/d1c/d79/f7e 0 1 2024-08-01T06:56:24.380 INFO:tasks.workunit.client.0.smithi016.stdout:5/492: rename d1/d2/d23/d3a/f8b to d1/d12/d3e/fa9 0 2024-08-01T06:56:24.380 INFO:tasks.workunit.client.0.smithi016.stdout:1/574: chown d2/d3/f4c 44 1 2024-08-01T06:56:24.382 INFO:tasks.workunit.client.0.smithi016.stdout:2/710: truncate d0/d8/d22/f63 4952238 0 2024-08-01T06:56:24.386 INFO:tasks.workunit.client.0.smithi016.stdout:3/390: truncate d9/d3e/f36 707753 0 2024-08-01T06:56:24.389 INFO:tasks.workunit.client.0.smithi016.stdout:4/468: creat d0/d17/f9c x:0 0 0 2024-08-01T06:56:24.391 INFO:tasks.workunit.client.0.smithi016.stdout:7/443: rename d7/db/d17/d72/d1c/d79/f8e to d7/db/d17/fa8 0 2024-08-01T06:56:24.391 INFO:tasks.workunit.client.0.smithi016.stdout:0/413: write d10/d11/f43 [140636,102231] 0 2024-08-01T06:56:24.394 INFO:tasks.workunit.client.0.smithi016.stdout:1/575: creat d2/de/dc4/fcc x:0 0 0 2024-08-01T06:56:24.395 INFO:tasks.workunit.client.0.smithi016.stdout:7/444: write d7/db/d17/d72/d1c/d79/f98 [354048,84925] 0 2024-08-01T06:56:24.396 INFO:tasks.workunit.client.0.smithi016.stdout:3/391: creat d9/da/df/d2a/d49/d61/f89 x:0 0 0 2024-08-01T06:56:24.397 INFO:tasks.workunit.client.0.smithi016.stdout:6/538: write d1/d9/f2e [1623903,54886] 0 2024-08-01T06:56:24.400 INFO:tasks.workunit.client.0.smithi016.stdout:3/392: fdatasync d9/da/df/d12/d20/d5c/d76/f78 0 2024-08-01T06:56:24.401 INFO:tasks.workunit.client.0.smithi016.stdout:9/516: getdents d3/d9/db/d3a 0 2024-08-01T06:56:24.403 INFO:tasks.workunit.client.0.smithi016.stdout:5/493: rename d1/d2/d20/c8d to d1/d2/d20/d72/caa 0 2024-08-01T06:56:24.410 INFO:tasks.workunit.client.0.smithi016.stdout:8/423: getdents d5/d8/d1a/d24/d48/d60/d63 0 2024-08-01T06:56:24.413 INFO:tasks.workunit.client.0.smithi016.stdout:4/469: mkdir d0/d9d 0 2024-08-01T06:56:24.415 INFO:tasks.workunit.client.0.smithi016.stdout:1/576: dread d2/d3/d1c/f36 [0,4194304] 0 2024-08-01T06:56:24.417 INFO:tasks.workunit.client.0.smithi016.stdout:3/393: creat d9/d57/f8a x:0 0 0 2024-08-01T06:56:24.418 INFO:tasks.workunit.client.0.smithi016.stdout:7/445: truncate d7/db/d17/d72/d1e/d26/d2a/f8c 909248 0 2024-08-01T06:56:24.419 INFO:tasks.workunit.client.0.smithi016.stdout:7/446: chown f5 382129 1 2024-08-01T06:56:24.422 INFO:tasks.workunit.client.0.smithi016.stdout:2/711: link d0/d8/d1b/dcc/d68/fa6 d0/d8/d1b/d74/d90/d93/fea 0 2024-08-01T06:56:24.423 INFO:tasks.workunit.client.0.smithi016.stdout:8/424: mkdir d5/d8/d1a/d24/d8c 0 2024-08-01T06:56:24.425 INFO:tasks.workunit.client.0.smithi016.stdout:3/394: dwrite d9/da/df/d2a/f77 [0,4194304] 0 2024-08-01T06:56:24.427 INFO:tasks.workunit.client.0.smithi016.stdout:6/539: mkdir d1/d9/d3f/d7d/d8b/d91/dc0 0 2024-08-01T06:56:24.429 INFO:tasks.workunit.client.0.smithi016.stdout:1/577: creat d2/de/d4d/d92/fcd x:0 0 0 2024-08-01T06:56:24.430 INFO:tasks.workunit.client.0.smithi016.stdout:1/578: write d2/de/d21/f5b [3477774,62991] 0 2024-08-01T06:56:24.432 INFO:tasks.workunit.client.0.smithi016.stdout:9/517: symlink d3/d9/db/laa 0 2024-08-01T06:56:24.433 INFO:tasks.workunit.client.0.smithi016.stdout:1/579: chown d2/de/d4d/d92/fcd 3 1 2024-08-01T06:56:24.434 INFO:tasks.workunit.client.0.smithi016.stdout:0/414: truncate d10/d11/f3d 160800 0 2024-08-01T06:56:24.435 INFO:tasks.workunit.client.0.smithi016.stdout:1/580: truncate d2/d3/d1a/d22/f9f 4825609 0 2024-08-01T06:56:24.437 INFO:tasks.workunit.client.0.smithi016.stdout:5/494: fdatasync d1/d2/d23/f81 0 2024-08-01T06:56:24.439 INFO:tasks.workunit.client.0.smithi016.stdout:7/447: symlink d7/db/d17/d72/d1c/d1d/d40/d67/d7c/la9 0 2024-08-01T06:56:24.439 INFO:tasks.workunit.client.0.smithi016.stdout:2/712: rmdir d0/d8/d22 39 2024-08-01T06:56:24.443 INFO:tasks.workunit.client.0.smithi016.stdout:8/425: mknod d5/dc/d3e/d72/c8d 0 2024-08-01T06:56:24.445 INFO:tasks.workunit.client.0.smithi016.stdout:5/495: dwrite d1/d2/d6/d9/d19/f40 [0,4194304] 0 2024-08-01T06:56:24.445 INFO:tasks.workunit.client.0.smithi016.stdout:6/540: creat d1/d8/d1b/d22/d2d/fc1 x:0 0 0 2024-08-01T06:56:24.451 INFO:tasks.workunit.client.0.smithi016.stdout:9/518: read d3/d9/df/d2a/f76 [57037,123966] 0 2024-08-01T06:56:24.452 INFO:tasks.workunit.client.0.smithi016.stdout:0/415: mkdir d10/d11/d37/d82 0 2024-08-01T06:56:24.457 INFO:tasks.workunit.client.0.smithi016.stdout:2/713: unlink d0/d16/d20/f87 0 2024-08-01T06:56:24.460 INFO:tasks.workunit.client.0.smithi016.stdout:4/470: dread d0/d2/dc/d12/d29/d3c/f3f [0,4194304] 0 2024-08-01T06:56:24.463 INFO:tasks.workunit.client.0.smithi016.stdout:6/541: truncate d1/d8/fa 4253443 0 2024-08-01T06:56:24.465 INFO:tasks.workunit.client.0.smithi016.stdout:0/416: dwrite d10/f5a [0,4194304] 0 2024-08-01T06:56:24.467 INFO:tasks.workunit.client.0.smithi016.stdout:4/471: write d0/d2/dc/d12/d29/f8a [1875464,31723] 0 2024-08-01T06:56:24.468 INFO:tasks.workunit.client.0.smithi016.stdout:3/395: dread d9/da/df/d12/d20/f35 [0,4194304] 0 2024-08-01T06:56:24.469 INFO:tasks.workunit.client.0.smithi016.stdout:1/581: write d2/de/d21/d3e/f4a [878991,101922] 0 2024-08-01T06:56:24.469 INFO:tasks.workunit.client.0.smithi016.stdout:4/472: chown d0/d17/d22/d7f 251200 1 2024-08-01T06:56:24.471 INFO:tasks.workunit.client.0.smithi016.stdout:4/473: stat d0/d17/d38/c4c 0 2024-08-01T06:56:24.474 INFO:tasks.workunit.client.0.smithi016.stdout:5/496: write d1/d2/d6/d9/d49/d57/f5b [449523,50267] 0 2024-08-01T06:56:24.477 INFO:tasks.workunit.client.0.smithi016.stdout:3/396: chown d9/da/df/d12/d20/d5c/d7a 2622282 1 2024-08-01T06:56:24.478 INFO:tasks.workunit.client.0.smithi016.stdout:0/417: readlink d10/l4b 0 2024-08-01T06:56:24.478 INFO:tasks.workunit.client.0.smithi016.stdout:6/542: mknod d1/d9/d3f/cc2 0 2024-08-01T06:56:24.479 INFO:tasks.workunit.client.0.smithi016.stdout:9/519: dread d3/d9/df/d38/f4f [0,4194304] 0 2024-08-01T06:56:24.479 INFO:tasks.workunit.client.0.smithi016.stdout:7/448: creat d7/db/d17/d72/d1e/faa x:0 0 0 2024-08-01T06:56:24.479 INFO:tasks.workunit.client.0.smithi016.stdout:8/426: dread d5/d8/d1a/d59/f5a [0,4194304] 0 2024-08-01T06:56:24.483 INFO:tasks.workunit.client.0.smithi016.stdout:5/497: mknod d1/d2/d6/d5a/cab 0 2024-08-01T06:56:24.486 INFO:tasks.workunit.client.0.smithi016.stdout:4/474: mknod d0/d17/d67/c9e 0 2024-08-01T06:56:24.488 INFO:tasks.workunit.client.0.smithi016.stdout:8/427: creat d5/d1c/f8e x:0 0 0 2024-08-01T06:56:24.489 INFO:tasks.workunit.client.0.smithi016.stdout:2/714: dwrite d0/d8/f18 [4194304,4194304] 0 2024-08-01T06:56:24.490 INFO:tasks.workunit.client.0.smithi016.stdout:9/520: creat d3/d9/d46/d48/fab x:0 0 0 2024-08-01T06:56:24.490 INFO:tasks.workunit.client.0.smithi016.stdout:4/475: chown d0/d17/d67 54586 1 2024-08-01T06:56:24.491 INFO:tasks.workunit.client.0.smithi016.stdout:1/582: dwrite d2/d3/d41/d49/f99 [0,4194304] 0 2024-08-01T06:56:24.495 INFO:tasks.workunit.client.0.smithi016.stdout:8/428: stat d5/d8/d1a/d24/d48/d60/d63/f71 0 2024-08-01T06:56:24.504 INFO:tasks.workunit.client.0.smithi016.stdout:0/418: creat d10/d11/f83 x:0 0 0 2024-08-01T06:56:24.506 INFO:tasks.workunit.client.0.smithi016.stdout:2/715: rmdir d0/d8/d1b/dcc 39 2024-08-01T06:56:24.508 INFO:tasks.workunit.client.0.smithi016.stdout:6/543: dwrite d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d93/daf/fb8 [0,4194304] 0 2024-08-01T06:56:24.508 INFO:tasks.workunit.client.0.smithi016.stdout:4/476: rename d0/d2/f6d to d0/d2/d36/f9f 0 2024-08-01T06:56:24.511 INFO:tasks.workunit.client.0.smithi016.stdout:9/521: dwrite d3/d32/d5c/d8a/f75 [0,4194304] 0 2024-08-01T06:56:24.514 INFO:tasks.workunit.client.0.smithi016.stdout:8/429: getdents d5/d8/d1a/d24/d48/d85 0 2024-08-01T06:56:24.514 INFO:tasks.workunit.client.0.smithi016.stdout:0/419: chown d10/d11/f4d 0 1 2024-08-01T06:56:24.515 INFO:tasks.workunit.client.0.smithi016.stdout:8/430: fdatasync d5/f84 0 2024-08-01T06:56:24.517 INFO:tasks.workunit.client.0.smithi016.stdout:9/522: dread - d3/d9/d73/f9e zero size 2024-08-01T06:56:24.517 INFO:tasks.workunit.client.0.smithi016.stdout:3/397: write d9/da/df/d12/d20/f4c [1662346,16510] 0 2024-08-01T06:56:24.517 INFO:tasks.workunit.client.0.smithi016.stdout:8/431: readlink d5/d8/d1a/l7e 0 2024-08-01T06:56:24.519 INFO:tasks.workunit.client.0.smithi016.stdout:8/432: write d5/d8/f2e [647259,81599] 0 2024-08-01T06:56:24.520 INFO:tasks.workunit.client.0.smithi016.stdout:0/420: dread d10/f49 [0,4194304] 0 2024-08-01T06:56:24.520 INFO:tasks.workunit.client.0.smithi016.stdout:1/583: mknod d2/cce 0 2024-08-01T06:56:24.522 INFO:tasks.workunit.client.0.smithi016.stdout:5/498: write d1/d2/d6/d9/d49/d57/f82 [349259,66207] 0 2024-08-01T06:56:24.522 INFO:tasks.workunit.client.0.smithi016.stdout:4/477: truncate d0/d2/dc/d12/d29/d3c/f69 2019449 0 2024-08-01T06:56:24.523 INFO:tasks.workunit.client.0.smithi016.stdout:9/523: write d3/d9/db/dc/f42 [3226464,130350] 0 2024-08-01T06:56:24.525 INFO:tasks.workunit.client.0.smithi016.stdout:1/584: dread - d2/d3/f34 zero size 2024-08-01T06:56:24.526 INFO:tasks.workunit.client.0.smithi016.stdout:0/421: dread - d10/d11/f83 zero size 2024-08-01T06:56:24.527 INFO:tasks.workunit.client.0.smithi016.stdout:3/398: write d9/da/df/d2a/f77 [2865377,115451] 0 2024-08-01T06:56:24.529 INFO:tasks.workunit.client.0.smithi016.stdout:9/524: chown d3/d9/d73 1713 1 2024-08-01T06:56:24.531 INFO:tasks.workunit.client.0.smithi016.stdout:0/422: chown d10/d11/d37/d50/l78 675821 1 2024-08-01T06:56:24.533 INFO:tasks.workunit.client.0.smithi016.stdout:7/449: dwrite d7/db/d17/d72/d1c/d79/d8f/d39/f15 [4194304,4194304] 0 2024-08-01T06:56:24.536 INFO:tasks.workunit.client.0.smithi016.stdout:6/544: dread d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/f7c [0,4194304] 0 2024-08-01T06:56:24.537 INFO:tasks.workunit.client.0.smithi016.stdout:2/716: mkdir d0/d8/d31/d5e/de4/deb 0 2024-08-01T06:56:24.539 INFO:tasks.workunit.client.0.smithi016.stdout:1/585: symlink d2/d2f/lcf 0 2024-08-01T06:56:24.542 INFO:tasks.workunit.client.0.smithi016.stdout:1/586: truncate d2/f5d 4830181 0 2024-08-01T06:56:24.544 INFO:tasks.workunit.client.0.smithi016.stdout:3/399: creat d9/da/df/d2a/d49/f8b x:0 0 0 2024-08-01T06:56:24.546 INFO:tasks.workunit.client.0.smithi016.stdout:0/423: unlink d10/f7f 0 2024-08-01T06:56:24.547 INFO:tasks.workunit.client.0.smithi016.stdout:0/424: dread - d10/d11/d37/d58/f81 zero size 2024-08-01T06:56:24.548 INFO:tasks.workunit.client.0.smithi016.stdout:9/525: unlink d3/de/d6d/f81 0 2024-08-01T06:56:24.551 INFO:tasks.workunit.client.0.smithi016.stdout:4/478: mkdir d0/d2/da0 0 2024-08-01T06:56:24.552 INFO:tasks.workunit.client.0.smithi016.stdout:4/479: chown d0/d17/d22/d26/c75 557567027 1 2024-08-01T06:56:24.553 INFO:tasks.workunit.client.0.smithi016.stdout:7/450: rename d7/db/d17/d72/d1c/d79/d8f/d39/l12 to d7/db/d17/d72/d1c/d1d/d40/d58/lab 0 2024-08-01T06:56:24.553 INFO:tasks.workunit.client.0.smithi016.stdout:4/480: truncate d0/d17/d38/f7c 905942 0 2024-08-01T06:56:24.554 INFO:tasks.workunit.client.0.smithi016.stdout:6/545: rmdir d1/d8/d1b/db5/d67/d8f/dba/dbd/d68 39 2024-08-01T06:56:24.556 INFO:tasks.workunit.client.0.smithi016.stdout:7/451: write d7/db/d17/d72/d1c/d1d/d40/d58/f96 [470243,17810] 0 2024-08-01T06:56:24.556 INFO:tasks.workunit.client.0.smithi016.stdout:2/717: unlink d0/d8/d31/dc1/de7/fbd 0 2024-08-01T06:56:24.561 INFO:tasks.workunit.client.0.smithi016.stdout:1/587: fdatasync d2/d3/d41/d49/d51/f73 0 2024-08-01T06:56:24.563 INFO:tasks.workunit.client.0.smithi016.stdout:3/400: mknod d9/da/df/d12/d20/d5c/d7a/c8c 0 2024-08-01T06:56:24.563 INFO:tasks.workunit.client.0.smithi016.stdout:5/499: dwrite d1/d12/d8c/f90 [0,4194304] 0 2024-08-01T06:56:24.564 INFO:tasks.workunit.client.0.smithi016.stdout:3/401: stat d9/da/df/l88 0 2024-08-01T06:56:24.565 INFO:tasks.workunit.client.0.smithi016.stdout:3/402: stat d9/d3e/l3d 0 2024-08-01T06:56:24.574 INFO:tasks.workunit.client.0.smithi016.stdout:4/481: creat d0/d17/d22/d7f/d93/fa1 x:0 0 0 2024-08-01T06:56:24.579 INFO:tasks.workunit.client.0.smithi016.stdout:8/433: link d5/d8/d1a/d24/d48/d60/d63/l50 d5/d67/d86/l8f 0 2024-08-01T06:56:24.580 INFO:tasks.workunit.client.0.smithi016.stdout:9/526: write d3/d9/db/dc/d33/f54 [988456,13105] 0 2024-08-01T06:56:24.582 INFO:tasks.workunit.client.0.smithi016.stdout:4/482: dwrite d0/d2/dc/d12/d29/f60 [0,4194304] 0 2024-08-01T06:56:24.588 INFO:tasks.workunit.client.0.smithi016.stdout:1/588: creat d2/d3/d41/d49/d85/fd0 x:0 0 0 2024-08-01T06:56:24.590 INFO:tasks.workunit.client.0.smithi016.stdout:5/500: creat d1/d2/d6/d9/d1b/fac x:0 0 0 2024-08-01T06:56:24.590 INFO:tasks.workunit.client.0.smithi016.stdout:3/403: mknod d9/da/df/d12/d20/d5c/d7a/c8d 0 2024-08-01T06:56:24.592 INFO:tasks.workunit.client.0.smithi016.stdout:0/425: link d10/d11/d37/d50/f77 d10/d11/d37/d50/f84 0 2024-08-01T06:56:24.594 INFO:tasks.workunit.client.0.smithi016.stdout:6/546: rmdir d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d93/daf 39 2024-08-01T06:56:24.595 INFO:tasks.workunit.client.0.smithi016.stdout:3/404: dread d9/da/df/d2a/d49/f62 [0,4194304] 0 2024-08-01T06:56:24.596 INFO:tasks.workunit.client.0.smithi016.stdout:3/405: stat d9/d1c/f6f 0 2024-08-01T06:56:24.597 INFO:tasks.workunit.client.0.smithi016.stdout:7/452: mknod d7/db/d17/d72/cac 0 2024-08-01T06:56:24.598 INFO:tasks.workunit.client.0.smithi016.stdout:2/718: creat d0/d8/d31/da7/db4/fec x:0 0 0 2024-08-01T06:56:24.599 INFO:tasks.workunit.client.0.smithi016.stdout:8/434: mknod d5/d8/d1a/d59/c90 0 2024-08-01T06:56:24.601 INFO:tasks.workunit.client.0.smithi016.stdout:9/527: symlink d3/d9/df/d16/d94/lac 0 2024-08-01T06:56:24.605 INFO:tasks.workunit.client.0.smithi016.stdout:9/528: dread d3/de/f15 [0,4194304] 0 2024-08-01T06:56:24.607 INFO:tasks.workunit.client.0.smithi016.stdout:9/529: chown d3/d9/db/c3f 289656335 1 2024-08-01T06:56:24.612 INFO:tasks.workunit.client.0.smithi016.stdout:4/483: mkdir d0/d9d/da2 0 2024-08-01T06:56:24.615 INFO:tasks.workunit.client.0.smithi016.stdout:1/589: symlink d2/de/d21/d3e/dc3/ld1 0 2024-08-01T06:56:24.616 INFO:tasks.workunit.client.0.smithi016.stdout:6/547: write d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/f7b [4512447,15491] 0 2024-08-01T06:56:24.617 INFO:tasks.workunit.client.0.smithi016.stdout:1/590: readlink d2/d2f/dba/la3 0 2024-08-01T06:56:24.621 INFO:tasks.workunit.client.0.smithi016.stdout:2/719: fdatasync d0/d8/d31/da7/fbf 0 2024-08-01T06:56:24.623 INFO:tasks.workunit.client.0.smithi016.stdout:8/435: dread d5/dc/d3e/f73 [0,4194304] 0 2024-08-01T06:56:24.623 INFO:tasks.workunit.client.0.smithi016.stdout:9/530: mkdir d3/d9/df/d38/dad 0 2024-08-01T06:56:24.625 INFO:tasks.workunit.client.0.smithi016.stdout:4/484: rmdir d0/d17/d22/d73 39 2024-08-01T06:56:24.628 INFO:tasks.workunit.client.0.smithi016.stdout:9/531: chown d3/d9/d46/d48/d87 30937 1 2024-08-01T06:56:24.628 INFO:tasks.workunit.client.0.smithi016.stdout:7/453: dread d7/db/f28 [0,4194304] 0 2024-08-01T06:56:24.629 INFO:tasks.workunit.client.0.smithi016.stdout:5/501: dwrite d1/d2/d6/d9/d1b/f71 [0,4194304] 0 2024-08-01T06:56:24.631 INFO:tasks.workunit.client.0.smithi016.stdout:0/426: link d10/c1b d10/d5c/c85 0 2024-08-01T06:56:24.632 INFO:tasks.workunit.client.0.smithi016.stdout:9/532: readlink d3/d9/db/d3e/d40/d4e/l9d 0 2024-08-01T06:56:24.632 INFO:tasks.workunit.client.0.smithi016.stdout:3/406: creat d9/da/df/d12/f8e x:0 0 0 2024-08-01T06:56:24.634 INFO:tasks.workunit.client.0.smithi016.stdout:9/533: dread - d3/d9/d46/d48/fab zero size 2024-08-01T06:56:24.634 INFO:tasks.workunit.client.0.smithi016.stdout:3/407: chown d9/da/df/d12/d20/d5c/d76 4 1 2024-08-01T06:56:24.635 INFO:tasks.workunit.client.0.smithi016.stdout:3/408: chown d9/da/df/d2a/d49 1729 1 2024-08-01T06:56:24.636 INFO:tasks.workunit.client.0.smithi016.stdout:1/591: unlink d2/d88/f93 0 2024-08-01T06:56:24.637 INFO:tasks.workunit.client.0.smithi016.stdout:3/409: write d9/d3e/f79 [501734,61800] 0 2024-08-01T06:56:24.639 INFO:tasks.workunit.client.0.smithi016.stdout:6/548: rename d1/d9/d3f/f76 to d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/fc3 0 2024-08-01T06:56:24.644 INFO:tasks.workunit.client.0.smithi016.stdout:7/454: fsync d7/db/d17/d72/d1e/d26/d2a/f7b 0 2024-08-01T06:56:24.646 INFO:tasks.workunit.client.0.smithi016.stdout:7/455: write d7/db/d17/d72/f7a [275875,95364] 0 2024-08-01T06:56:24.647 INFO:tasks.workunit.client.0.smithi016.stdout:7/456: chown d7/db/d17/d72/d1e/l31 1480 1 2024-08-01T06:56:24.653 INFO:tasks.workunit.client.0.smithi016.stdout:9/534: write d3/d9/df/d2a/f76 [453417,20729] 0 2024-08-01T06:56:24.656 INFO:tasks.workunit.client.0.smithi016.stdout:1/592: mknod d2/de/d4d/cd2 0 2024-08-01T06:56:24.658 INFO:tasks.workunit.client.0.smithi016.stdout:8/436: link d5/f84 d5/d8/d1a/d24/d48/d60/d63/f91 0 2024-08-01T06:56:24.658 INFO:tasks.workunit.client.0.smithi016.stdout:2/720: dwrite d0/d8/d1b/d74/d90/d93/fea [0,4194304] 0 2024-08-01T06:56:24.660 INFO:tasks.workunit.client.0.smithi016.stdout:7/457: dwrite d7/db/d17/d72/d1c/d1d/d40/d7f/f90 [0,4194304] 0 2024-08-01T06:56:24.663 INFO:tasks.workunit.client.0.smithi016.stdout:0/427: creat d10/d1c/d7c/f86 x:0 0 0 2024-08-01T06:56:24.668 INFO:tasks.workunit.client.0.smithi016.stdout:3/410: symlink d9/d3e/d80/l8f 0 2024-08-01T06:56:24.670 INFO:tasks.workunit.client.0.smithi016.stdout:6/549: creat d1/d9/d3f/d7d/d8a/dbc/fc4 x:0 0 0 2024-08-01T06:56:24.671 INFO:tasks.workunit.client.0.smithi016.stdout:1/593: mknod d2/d3/d41/d49/d85/cd3 0 2024-08-01T06:56:24.672 INFO:tasks.workunit.client.0.smithi016.stdout:7/458: dread d7/db/d17/d72/d1e/d26/d2a/f30 [0,4194304] 0 2024-08-01T06:56:24.673 INFO:tasks.workunit.client.0.smithi016.stdout:5/502: creat d1/d12/fad x:0 0 0 2024-08-01T06:56:24.674 INFO:tasks.workunit.client.0.smithi016.stdout:7/459: chown d7/db/d17/d72/d1c/d1d/d5e/l76 9258915 1 2024-08-01T06:56:24.675 INFO:tasks.workunit.client.0.smithi016.stdout:8/437: mkdir d5/d8/d1a/d24/d48/d6e/d92 0 2024-08-01T06:56:24.675 INFO:tasks.workunit.client.0.smithi016.stdout:7/460: chown d7/db/l81 80 1 2024-08-01T06:56:24.677 INFO:tasks.workunit.client.0.smithi016.stdout:1/594: dread d2/de/d4d/f94 [0,4194304] 0 2024-08-01T06:56:24.682 INFO:tasks.workunit.client.0.smithi016.stdout:0/428: fsync d10/d11/d37/d50/f84 0 2024-08-01T06:56:24.684 INFO:tasks.workunit.client.0.smithi016.stdout:5/503: dwrite d1/d2/d23/f32 [0,4194304] 0 2024-08-01T06:56:24.684 INFO:tasks.workunit.client.0.smithi016.stdout:7/461: dread d7/db/d17/d72/d1c/d1d/d40/d58/f96 [0,4194304] 0 2024-08-01T06:56:24.686 INFO:tasks.workunit.client.0.smithi016.stdout:5/504: chown d1/d2/l47 4053025 1 2024-08-01T06:56:24.692 INFO:tasks.workunit.client.0.smithi016.stdout:2/721: symlink d0/d8/d31/da7/ddf/led 0 2024-08-01T06:56:24.692 INFO:tasks.workunit.client.0.smithi016.stdout:6/550: dwrite d1/d41/f61 [0,4194304] 0 2024-08-01T06:56:24.694 INFO:tasks.workunit.client.0.smithi016.stdout:2/722: write d0/d8/d31/f51 [17244,66953] 0 2024-08-01T06:56:24.701 INFO:tasks.workunit.client.0.smithi016.stdout:3/411: mkdir d9/da/df/d2a/d90 0 2024-08-01T06:56:24.706 INFO:tasks.workunit.client.0.smithi016.stdout:7/462: rename d7/db/d17/d72/d1c/d79/d8f/d39/f15 to d7/db/d17/d72/d1c/d1d/d40/d58/d80/fad 0 2024-08-01T06:56:24.708 INFO:tasks.workunit.client.0.smithi016.stdout:1/595: creat d2/d2f/d97/fd4 x:0 0 0 2024-08-01T06:56:24.709 INFO:tasks.workunit.client.0.smithi016.stdout:3/412: dwrite d9/da/df/d2a/d49/f68 [0,4194304] 0 2024-08-01T06:56:24.710 INFO:tasks.workunit.client.0.smithi016.stdout:1/596: dread - d2/de/d4d/fbd zero size 2024-08-01T06:56:24.711 INFO:tasks.workunit.client.0.smithi016.stdout:2/723: creat d0/d8/d31/da7/ddf/fee x:0 0 0 2024-08-01T06:56:24.713 INFO:tasks.workunit.client.0.smithi016.stdout:3/413: write d9/da/df/d12/f8e [435771,37648] 0 2024-08-01T06:56:24.713 INFO:tasks.workunit.client.0.smithi016.stdout:8/438: truncate d5/d8/d1a/d24/d48/d60/d63/f91 1182274 0 2024-08-01T06:56:24.716 INFO:tasks.workunit.client.0.smithi016.stdout:0/429: mknod d10/d11/d41/c87 0 2024-08-01T06:56:24.720 INFO:tasks.workunit.client.0.smithi016.stdout:7/463: creat d7/db/d17/d72/d1c/d97/fae x:0 0 0 2024-08-01T06:56:24.721 INFO:tasks.workunit.client.0.smithi016.stdout:7/464: write d7/db/d17/d72/d1e/faa [76982,116187] 0 2024-08-01T06:56:24.722 INFO:tasks.workunit.client.0.smithi016.stdout:1/597: creat d2/de/d6e/fd5 x:0 0 0 2024-08-01T06:56:24.724 INFO:tasks.workunit.client.0.smithi016.stdout:8/439: unlink d5/dc/d3e/f76 0 2024-08-01T06:56:24.727 INFO:tasks.workunit.client.0.smithi016.stdout:3/414: unlink d9/d4e/d72/l85 0 2024-08-01T06:56:24.729 INFO:tasks.workunit.client.0.smithi016.stdout:1/598: dwrite d2/de/d4d/fbd [0,4194304] 0 2024-08-01T06:56:24.739 INFO:tasks.workunit.client.0.smithi016.stdout:5/505: getdents d1/d2/d6/d9 0 2024-08-01T06:56:24.740 INFO:tasks.workunit.client.0.smithi016.stdout:3/415: mkdir d9/d57/d91 0 2024-08-01T06:56:24.741 INFO:tasks.workunit.client.0.smithi016.stdout:0/430: symlink d10/l88 0 2024-08-01T06:56:24.743 INFO:tasks.workunit.client.0.smithi016.stdout:6/551: rename d1/d8/d1b/d22/d2d/c53 to d1/cc5 0 2024-08-01T06:56:24.750 INFO:tasks.workunit.client.0.smithi016.stdout:5/506: symlink d1/d2/d20/d68/lae 0 2024-08-01T06:56:24.753 INFO:tasks.workunit.client.0.smithi016.stdout:6/552: dread d1/d41/f82 [0,4194304] 0 2024-08-01T06:56:24.754 INFO:tasks.workunit.client.0.smithi016.stdout:7/465: dread d7/f11 [0,4194304] 0 2024-08-01T06:56:24.754 INFO:tasks.workunit.client.0.smithi016.stdout:3/416: creat d9/da/df/d12/d20/d5c/d7a/f92 x:0 0 0 2024-08-01T06:56:24.755 INFO:tasks.workunit.client.0.smithi016.stdout:0/431: symlink d10/d11/d37/d58/l89 0 2024-08-01T06:56:24.759 INFO:tasks.workunit.client.0.smithi016.stdout:1/599: dread d2/f2a [0,4194304] 0 2024-08-01T06:56:24.760 INFO:tasks.workunit.client.0.smithi016.stdout:3/417: read d9/d57/d66/f73 [3414185,78467] 0 2024-08-01T06:56:24.763 INFO:tasks.workunit.client.0.smithi016.stdout:0/432: dread d10/d11/f64 [0,4194304] 0 2024-08-01T06:56:24.764 INFO:tasks.workunit.client.0.smithi016.stdout:0/433: dread - d10/d11/d41/f6f zero size 2024-08-01T06:56:24.766 INFO:tasks.workunit.client.0.smithi016.stdout:2/724: rename d0/d8/d1b/d74/d90/laa to d0/d8/d31/dc7/lef 0 2024-08-01T06:56:24.773 INFO:tasks.workunit.client.0.smithi016.stdout:8/440: creat d5/d8/f93 x:0 0 0 2024-08-01T06:56:24.773 INFO:tasks.workunit.client.0.smithi016.stdout:8/441: chown d5/d8/d1a/d24/d6a 551126852 1 2024-08-01T06:56:24.776 INFO:tasks.workunit.client.0.smithi016.stdout:7/466: dread d7/db/fa6 [4194304,4194304] 0 2024-08-01T06:56:24.777 INFO:tasks.workunit.client.0.smithi016.stdout:6/553: read - d1/d8/d1b/d48/f77 zero size 2024-08-01T06:56:24.785 INFO:tasks.workunit.client.0.smithi016.stdout:0/434: symlink d10/d11/d37/d53/l8a 0 2024-08-01T06:56:24.786 INFO:tasks.workunit.client.0.smithi016.stdout:2/725: rmdir d0/d8/d31/db6 39 2024-08-01T06:56:24.788 INFO:tasks.workunit.client.0.smithi016.stdout:0/435: dread d10/d11/d37/f55 [0,4194304] 0 2024-08-01T06:56:24.792 INFO:tasks.workunit.client.0.smithi016.stdout:5/507: write d1/d2/d6/d9/d1b/f28 [343950,110874] 0 2024-08-01T06:56:24.792 INFO:tasks.workunit.client.0.smithi016.stdout:7/467: fdatasync d7/db/fa6 0 2024-08-01T06:56:24.799 INFO:tasks.workunit.client.0.smithi016.stdout:0/436: creat d10/d11/d37/f8b x:0 0 0 2024-08-01T06:56:24.801 INFO:tasks.workunit.client.0.smithi016.stdout:5/508: unlink d1/d2/d6/d9/d1b/f71 0 2024-08-01T06:56:24.804 INFO:tasks.workunit.client.0.smithi016.stdout:2/726: symlink d0/d8/d1b/dcc/d68/lf0 0 2024-08-01T06:56:24.806 INFO:tasks.workunit.client.0.smithi016.stdout:2/727: write d0/d8/d31/dc1/fd6 [361634,130595] 0 2024-08-01T06:56:24.807 INFO:tasks.workunit.client.0.smithi016.stdout:5/509: symlink d1/d2/d6/d9/laf 0 2024-08-01T06:56:24.809 INFO:tasks.workunit.client.0.smithi016.stdout:7/468: creat d7/db/d17/d72/d1c/d1d/d40/d67/d7c/d8d/faf x:0 0 0 2024-08-01T06:56:24.811 INFO:tasks.workunit.client.0.smithi016.stdout:7/469: read d7/db/d17/d72/d1e/faa [56631,3156] 0 2024-08-01T06:56:24.812 INFO:tasks.workunit.client.0.smithi016.stdout:7/470: readlink d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/la1 0 2024-08-01T06:56:24.813 INFO:tasks.workunit.client.0.smithi016.stdout:6/554: link d1/d8/l66 d1/d8/d1b/d22/d36/lc6 0 2024-08-01T06:56:24.814 INFO:tasks.workunit.client.0.smithi016.stdout:6/555: readlink d1/d8/d1b/d48/la5 0 2024-08-01T06:56:24.818 INFO:tasks.workunit.client.0.smithi016.stdout:0/437: getdents d10/d11/d37/d50 0 2024-08-01T06:56:24.820 INFO:tasks.workunit.client.0.smithi016.stdout:0/438: write d10/d11/d37/d58/f79 [155827,72630] 0 2024-08-01T06:56:24.821 INFO:tasks.workunit.client.0.smithi016.stdout:6/556: symlink d1/d9/d3f/d7d/d8b/lc7 0 2024-08-01T06:56:24.822 INFO:tasks.workunit.client.0.smithi016.stdout:6/557: dread - d1/d41/f6c zero size 2024-08-01T06:56:24.822 INFO:tasks.workunit.client.0.smithi016.stdout:6/558: chown d1/d43/l90 7889 1 2024-08-01T06:56:24.823 INFO:tasks.workunit.client.0.smithi016.stdout:2/728: link d0/d8/d1b/dcc/d68/lf0 d0/d8/d1b/d74/d90/lf1 0 2024-08-01T06:56:24.827 INFO:tasks.workunit.client.0.smithi016.stdout:7/471: link d7/db/d17/d72/d1e/f1f d7/db/d17/d72/d1c/d79/fb0 0 2024-08-01T06:56:24.828 INFO:tasks.workunit.client.0.smithi016.stdout:0/439: creat d10/d11/d37/d58/f8c x:0 0 0 2024-08-01T06:56:24.830 INFO:tasks.workunit.client.0.smithi016.stdout:3/418: truncate d9/da/df/d2a/d49/f60 371423 0 2024-08-01T06:56:24.834 INFO:tasks.workunit.client.0.smithi016.stdout:2/729: symlink d0/d8/d1b/d74/d99/lf2 0 2024-08-01T06:56:24.834 INFO:tasks.workunit.client.0.smithi016.stdout:7/472: dwrite d7/db/d17/d72/d1c/f9a [0,4194304] 0 2024-08-01T06:56:24.836 INFO:tasks.workunit.client.0.smithi016.stdout:6/559: creat d1/d41/dbf/fc8 x:0 0 0 2024-08-01T06:56:24.838 INFO:tasks.workunit.client.0.smithi016.stdout:7/473: dread - d7/db/d17/d72/d1c/d1d/d6d/fa5 zero size 2024-08-01T06:56:24.838 INFO:tasks.workunit.client.0.smithi016.stdout:8/442: truncate d5/d8/f58 722795 0 2024-08-01T06:56:24.850 INFO:tasks.workunit.client.0.smithi016.stdout:7/474: rename d7/db/d17/d72/d1c/d1d/d40/d58/l5d to d7/db/d17/d72/d22/d77/lb1 0 2024-08-01T06:56:24.855 INFO:tasks.workunit.client.0.smithi016.stdout:6/560: link d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/fc3 d1/d9/da3/fc9 0 2024-08-01T06:56:24.857 INFO:tasks.workunit.client.0.smithi016.stdout:2/730: rename d0/d8/d1b/dcc/d3b/fa9 to d0/d8/d22/ff3 0 2024-08-01T06:56:24.858 INFO:tasks.workunit.client.0.smithi016.stdout:2/731: read d0/d8/d31/f51 [199700,19126] 0 2024-08-01T06:56:24.859 INFO:tasks.workunit.client.0.smithi016.stdout:2/732: write d0/d8/d22/f63 [3141358,70080] 0 2024-08-01T06:56:24.859 INFO:tasks.workunit.client.0.smithi016.stdout:7/475: unlink d7/db/d17/d72/d1c/d1d/d40/d58/f96 0 2024-08-01T06:56:24.860 INFO:tasks.workunit.client.0.smithi016.stdout:2/733: fsync d0/d8/fc0 0 2024-08-01T06:56:24.862 INFO:tasks.workunit.client.0.smithi016.stdout:2/734: readlink d0/d8/d1b/dcc/d3b/d45/l9f 0 2024-08-01T06:56:24.864 INFO:tasks.workunit.client.0.smithi016.stdout:6/561: mknod d1/d8/d1b/d22/d2d/cca 0 2024-08-01T06:56:24.866 INFO:tasks.workunit.client.0.smithi016.stdout:7/476: dread d7/db/d17/d72/d1c/d79/d8f/d39/d43/f64 [0,4194304] 0 2024-08-01T06:56:24.868 INFO:tasks.workunit.client.0.smithi016.stdout:8/443: link d5/f38 d5/d8/f94 0 2024-08-01T06:56:24.869 INFO:tasks.workunit.client.0.smithi016.stdout:8/444: stat d5/dc/d3e/d72/c8d 0 2024-08-01T06:56:24.872 INFO:tasks.workunit.client.0.smithi016.stdout:2/735: unlink d0/d8/d1b/ld7 0 2024-08-01T06:56:24.874 INFO:tasks.workunit.client.0.smithi016.stdout:6/562: dread d1/d41/f82 [0,4194304] 0 2024-08-01T06:56:24.877 INFO:tasks.workunit.client.0.smithi016.stdout:7/477: symlink d7/db/d17/d72/d22/d77/d99/lb2 0 2024-08-01T06:56:24.878 INFO:tasks.workunit.client.0.smithi016.stdout:8/445: unlink d5/d8/d1a/d59/c90 0 2024-08-01T06:56:24.878 INFO:tasks.workunit.client.0.smithi016.stdout:5/510: truncate d1/f5 2410801 0 2024-08-01T06:56:24.880 INFO:tasks.workunit.client.0.smithi016.stdout:2/736: symlink d0/d8/d1b/dcc/d3b/d45/lf4 0 2024-08-01T06:56:24.880 INFO:tasks.workunit.client.0.smithi016.stdout:7/478: dread d7/db/d17/d72/d1c/d79/f98 [0,4194304] 0 2024-08-01T06:56:24.881 INFO:tasks.workunit.client.0.smithi016.stdout:6/563: creat d1/d9/d3f/d7d/d8b/fcb x:0 0 0 2024-08-01T06:56:24.892 INFO:tasks.workunit.client.0.smithi016.stdout:8/446: rename d5/d8/d1a/l6f to d5/d8/d1a/d24/d48/d60/d63/l95 0 2024-08-01T06:56:24.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:24 smithi016 ceph-mon[29266]: pgmap v26: 65 pgs: 65 active+clean; 2.4 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 24 MiB/s rd, 110 MiB/s wr, 245 op/s 2024-08-01T06:56:24.898 INFO:tasks.workunit.client.0.smithi016.stdout:8/447: creat d5/d8/d75/f96 x:0 0 0 2024-08-01T06:56:24.901 INFO:tasks.workunit.client.0.smithi016.stdout:0/440: dwrite d10/d11/d37/d50/f77 [0,4194304] 0 2024-08-01T06:56:24.902 INFO:tasks.workunit.client.0.smithi016.stdout:0/441: dread - d10/d1c/f46 zero size 2024-08-01T06:56:24.903 INFO:tasks.workunit.client.0.smithi016.stdout:5/511: rename d1/d2/d6/d9/d49/fa0 to d1/d2/d6/d9/d19/fb0 0 2024-08-01T06:56:24.906 INFO:tasks.workunit.client.0.smithi016.stdout:7/479: getdents d7/db/d17/d72/d1c/d97 0 2024-08-01T06:56:24.911 INFO:tasks.workunit.client.0.smithi016.stdout:0/442: unlink d10/d11/d37/l61 0 2024-08-01T06:56:24.913 INFO:tasks.workunit.client.0.smithi016.stdout:5/512: rmdir d1/d2/d6/d5a 39 2024-08-01T06:56:24.915 INFO:tasks.workunit.client.0.smithi016.stdout:3/419: write d9/d3e/f36 [406720,33332] 0 2024-08-01T06:56:24.919 INFO:tasks.workunit.client.0.smithi016.stdout:5/513: mkdir d1/d2/d6/d9/d49/d57/db1 0 2024-08-01T06:56:24.919 INFO:tasks.workunit.client.0.smithi016.stdout:7/480: mkdir d7/db3 0 2024-08-01T06:56:24.922 INFO:tasks.workunit.client.0.smithi016.stdout:0/443: creat d10/d11/d37/d82/f8d x:0 0 0 2024-08-01T06:56:24.927 INFO:tasks.workunit.client.0.smithi016.stdout:7/481: write d7/db/d17/d72/d1e/d26/f49 [7746982,47868] 0 2024-08-01T06:56:24.929 INFO:tasks.workunit.client.0.smithi016.stdout:7/482: readlink d7/db/d17/d72/d22/d77/d99/la2 0 2024-08-01T06:56:24.929 INFO:tasks.workunit.client.0.smithi016.stdout:3/420: dwrite d9/da/df/d2a/d49/f62 [0,4194304] 0 2024-08-01T06:56:24.930 INFO:tasks.workunit.client.0.smithi016.stdout:0/444: symlink d10/d1c/l8e 0 2024-08-01T06:56:24.931 INFO:tasks.workunit.client.0.smithi016.stdout:0/445: stat d10/d11/d37/d82 0 2024-08-01T06:56:24.932 INFO:tasks.workunit.client.0.smithi016.stdout:5/514: symlink d1/d2/d6/d9/lb2 0 2024-08-01T06:56:24.936 INFO:tasks.workunit.client.0.smithi016.stdout:5/515: truncate d1/d2/d6/d9/d49/d57/f64 1482119 0 2024-08-01T06:56:24.937 INFO:tasks.workunit.client.0.smithi016.stdout:7/483: mkdir d7/db/d17/d72/d22/db4 0 2024-08-01T06:56:24.941 INFO:tasks.workunit.client.0.smithi016.stdout:3/421: creat d9/da/df/d2a/d49/d61/f93 x:0 0 0 2024-08-01T06:56:24.942 INFO:tasks.workunit.client.0.smithi016.stdout:0/446: unlink d10/d11/d37/c40 0 2024-08-01T06:56:24.944 INFO:tasks.workunit.client.0.smithi016.stdout:5/516: write d1/d12/d3e/f66 [4447271,28967] 0 2024-08-01T06:56:24.946 INFO:tasks.workunit.client.0.smithi016.stdout:7/484: mkdir d7/db/d17/d72/d1e/d26/d2a/db5 0 2024-08-01T06:56:24.950 INFO:tasks.workunit.client.0.smithi016.stdout:0/447: getdents d10/d11/d37/d50 0 2024-08-01T06:56:24.951 INFO:tasks.workunit.client.0.smithi016.stdout:0/448: fdatasync d10/d11/d37/d58/f79 0 2024-08-01T06:56:24.962 INFO:tasks.workunit.client.0.smithi016.stdout:7/485: dread d7/f5b [0,4194304] 0 2024-08-01T06:56:24.963 INFO:tasks.workunit.client.0.smithi016.stdout:7/486: write d7/db/f6f [4433750,8494] 0 2024-08-01T06:56:24.969 INFO:tasks.workunit.client.0.smithi016.stdout:6/564: write d1/d8/d1b/d22/d36/f44 [5917504,72739] 0 2024-08-01T06:56:24.970 INFO:tasks.workunit.client.0.smithi016.stdout:6/565: chown d1 52856747 1 2024-08-01T06:56:25.007 INFO:tasks.workunit.client.0.smithi016.stdout:3/422: write d9/da/df/d12/f42 [1001169,109916] 0 2024-08-01T06:56:25.011 INFO:tasks.workunit.client.0.smithi016.stdout:5/517: truncate d1/d2/f48 737434 0 2024-08-01T06:56:25.016 INFO:tasks.workunit.client.0.smithi016.stdout:5/518: fsync d1/d2/d23/f81 0 2024-08-01T06:56:25.021 INFO:tasks.workunit.client.0.smithi016.stdout:5/519: mkdir d1/d12/d7d/db3 0 2024-08-01T06:56:25.022 INFO:tasks.workunit.client.0.smithi016.stdout:0/449: write d10/d11/f42 [526816,71834] 0 2024-08-01T06:56:25.025 INFO:tasks.workunit.client.0.smithi016.stdout:5/520: unlink d1/d2/d6/d9/d49/d57/f5b 0 2024-08-01T06:56:25.028 INFO:tasks.workunit.client.0.smithi016.stdout:0/450: rename d10/d11/d41/f71 to d10/d1c/d7c/f8f 0 2024-08-01T06:56:25.029 INFO:tasks.workunit.client.0.smithi016.stdout:7/487: write d7/db/d17/d72/d22/f4a [387773,52357] 0 2024-08-01T06:56:25.040 INFO:tasks.workunit.client.0.smithi016.stdout:6/566: dwrite d1/d8/d1b/db5/d67/fb3 [0,4194304] 0 2024-08-01T06:56:25.042 INFO:tasks.workunit.client.0.smithi016.stdout:0/451: unlink d10/d1c/d7c/f86 0 2024-08-01T06:56:25.043 INFO:tasks.workunit.client.0.smithi016.stdout:0/452: write d10/d11/f43 [632518,43717] 0 2024-08-01T06:56:25.051 INFO:tasks.workunit.client.0.smithi016.stdout:7/488: truncate d7/db/d17/d4e/f6c 440554 0 2024-08-01T06:56:25.051 INFO:tasks.workunit.client.0.smithi016.stdout:5/521: unlink d1/d2/d6/d5a/f5f 0 2024-08-01T06:56:25.052 INFO:tasks.workunit.client.0.smithi016.stdout:5/522: read d1/d2/d23/f32 [411048,16099] 0 2024-08-01T06:56:25.055 INFO:tasks.workunit.client.0.smithi016.stdout:6/567: symlink d1/d9/d3f/d7d/d8b/lcc 0 2024-08-01T06:56:25.055 INFO:tasks.workunit.client.0.smithi016.stdout:7/489: truncate d7/db/d17/d72/d1c/d1d/d40/d7f/fa7 274239 0 2024-08-01T06:56:25.058 INFO:tasks.workunit.client.0.smithi016.stdout:0/453: mkdir d10/d5c/d90 0 2024-08-01T06:56:25.061 INFO:tasks.workunit.client.0.smithi016.stdout:0/454: dread d10/f17 [0,4194304] 0 2024-08-01T06:56:25.073 INFO:tasks.workunit.client.0.smithi016.stdout:0/455: mkdir d10/d5c/d91 0 2024-08-01T06:56:25.078 INFO:tasks.workunit.client.0.smithi016.stdout:6/568: mknod d1/d8/d1b/d22/d71/db1/ccd 0 2024-08-01T06:56:25.080 INFO:tasks.workunit.client.0.smithi016.stdout:3/423: link d9/da/df/d2a/d49/f60 d9/da/df/d12/f94 0 2024-08-01T06:56:25.083 INFO:tasks.workunit.client.0.smithi016.stdout:0/456: chown d10/d11/c5e 296485 1 2024-08-01T06:56:25.088 INFO:tasks.workunit.client.0.smithi016.stdout:0/457: mknod d10/d1c/c92 0 2024-08-01T06:56:25.090 INFO:tasks.workunit.client.0.smithi016.stdout:7/490: dwrite d7/db/d17/d72/d1c/d79/d8f/d39/f41 [0,4194304] 0 2024-08-01T06:56:25.092 INFO:tasks.workunit.client.0.smithi016.stdout:7/491: chown d7/db/d17/d72/d1c/d79/f7e 1041712 1 2024-08-01T06:56:25.095 INFO:tasks.workunit.client.0.smithi016.stdout:6/569: dread d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f37 [0,4194304] 0 2024-08-01T06:56:25.097 INFO:tasks.workunit.client.0.smithi016.stdout:0/458: creat d10/d11/d37/d53/f93 x:0 0 0 2024-08-01T06:56:25.097 INFO:tasks.workunit.client.0.smithi016.stdout:6/570: dread - d1/d8/d1b/d22/d2d/fc1 zero size 2024-08-01T06:56:25.099 INFO:tasks.workunit.client.0.smithi016.stdout:7/492: rename d7/db/d17/d72/d1c/d1d/d40/f55 to d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/fb6 0 2024-08-01T06:56:25.099 INFO:tasks.workunit.client.0.smithi016.stdout:7/493: chown d7/db/d17/d72/d1c/d79/f98 814574493 1 2024-08-01T06:56:25.102 INFO:tasks.workunit.client.0.smithi016.stdout:6/571: creat d1/d8/d1b/d22/d36/d7a/fce x:0 0 0 2024-08-01T06:56:25.104 INFO:tasks.workunit.client.0.smithi016.stdout:7/494: symlink d7/db/d17/d72/d1c/d1d/d40/d58/d80/lb7 0 2024-08-01T06:56:25.106 INFO:tasks.workunit.client.0.smithi016.stdout:0/459: creat d10/d11/d41/f94 x:0 0 0 2024-08-01T06:56:25.106 INFO:tasks.workunit.client.0.smithi016.stdout:0/460: stat f9 0 2024-08-01T06:56:25.107 INFO:tasks.workunit.client.0.smithi016.stdout:6/572: truncate d1/d41/f3e 568794 0 2024-08-01T06:56:25.107 INFO:tasks.workunit.client.0.smithi016.stdout:3/424: dwrite d9/da/df/d12/f15 [4194304,4194304] 0 2024-08-01T06:56:25.109 INFO:tasks.workunit.client.0.smithi016.stdout:6/573: fsync d1/d9/d3f/d7d/d8a/da2/fb7 0 2024-08-01T06:56:25.110 INFO:tasks.workunit.client.0.smithi016.stdout:3/425: dread - d9/da/df/d2a/d49/d61/f93 zero size 2024-08-01T06:56:25.114 INFO:tasks.workunit.client.0.smithi016.stdout:0/461: mkdir d10/d11/d41/d95 0 2024-08-01T06:56:25.114 INFO:tasks.workunit.client.0.smithi016.stdout:7/495: getdents d7 0 2024-08-01T06:56:25.115 INFO:tasks.workunit.client.0.smithi016.stdout:0/462: chown d10/d11/d41/f6d 683489997 1 2024-08-01T06:56:25.117 INFO:tasks.workunit.client.0.smithi016.stdout:3/426: creat d9/d57/f95 x:0 0 0 2024-08-01T06:56:25.117 INFO:tasks.workunit.client.0.smithi016.stdout:0/463: write d10/d11/f83 [271662,55432] 0 2024-08-01T06:56:25.118 INFO:tasks.workunit.client.0.smithi016.stdout:6/574: rename d1/d8/d1b/d22/d4e to d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d8e/dcf 0 2024-08-01T06:56:25.118 INFO:tasks.workunit.client.0.smithi016.stdout:3/427: dread - d9/da/f86 zero size 2024-08-01T06:56:25.120 INFO:tasks.workunit.client.0.smithi016.stdout:7/496: mknod d7/db/d17/d72/d1e/d26/d63/cb8 0 2024-08-01T06:56:25.123 INFO:tasks.workunit.client.0.smithi016.stdout:3/428: mkdir d9/da/d96 0 2024-08-01T06:56:25.124 INFO:tasks.workunit.client.0.smithi016.stdout:6/575: fsync d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/fc3 0 2024-08-01T06:56:25.127 INFO:tasks.workunit.client.0.smithi016.stdout:6/576: dread d1/d8/d1b/f72 [0,4194304] 0 2024-08-01T06:56:25.130 INFO:tasks.workunit.client.0.smithi016.stdout:7/497: rename d7/db/d17/d72/d1e/l31 to d7/db/d17/d72/d1c/d4f/lb9 0 2024-08-01T06:56:25.134 INFO:tasks.workunit.client.0.smithi016.stdout:7/498: stat d7/db/d17/d72/d1c/d1d/d40/d58/lab 0 2024-08-01T06:56:25.135 INFO:tasks.workunit.client.0.smithi016.stdout:7/499: write d7/db/d17/d72/d22/f4a [110286,93251] 0 2024-08-01T06:56:25.136 INFO:tasks.workunit.client.0.smithi016.stdout:6/577: creat d1/d8/d1b/d22/d36/fd0 x:0 0 0 2024-08-01T06:56:25.136 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:24 smithi089 ceph-mon[36617]: pgmap v26: 65 pgs: 65 active+clean; 2.4 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 24 MiB/s rd, 110 MiB/s wr, 245 op/s 2024-08-01T06:56:25.137 INFO:tasks.workunit.client.0.smithi016.stdout:6/578: dread - d1/d8/d1b/d22/d36/d7a/fce zero size 2024-08-01T06:56:25.138 INFO:tasks.workunit.client.0.smithi016.stdout:7/500: readlink d7/db/d17/d72/d22/d77/d99/l9e 0 2024-08-01T06:56:25.140 INFO:tasks.workunit.client.0.smithi016.stdout:6/579: symlink d1/d9/d3f/d7d/ld1 0 2024-08-01T06:56:25.140 INFO:tasks.workunit.client.0.smithi016.stdout:7/501: chown d7/db/d17/d72/d1e/d26/d2a/l74 3 1 2024-08-01T06:56:25.141 INFO:tasks.workunit.client.0.smithi016.stdout:7/502: read - d7/db/d17/d4e/f93 zero size 2024-08-01T06:56:25.144 INFO:tasks.workunit.client.0.smithi016.stdout:7/503: creat d7/db/d17/d72/d1c/d1d/d5e/fba x:0 0 0 2024-08-01T06:56:25.145 INFO:tasks.workunit.client.0.smithi016.stdout:6/580: truncate d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/f95 1436021 0 2024-08-01T06:56:25.149 INFO:tasks.workunit.client.0.smithi016.stdout:6/581: mknod d1/d8/d1b/cd2 0 2024-08-01T06:56:25.149 INFO:tasks.workunit.client.0.smithi016.stdout:0/464: dwrite d10/f45 [4194304,4194304] 0 2024-08-01T06:56:25.155 INFO:tasks.workunit.client.0.smithi016.stdout:7/504: creat d7/db/d17/d72/d1c/d1d/d40/d58/da3/fbb x:0 0 0 2024-08-01T06:56:25.155 INFO:tasks.workunit.client.0.smithi016.stdout:3/429: dwrite d9/d3e/f2d [8388608,4194304] 0 2024-08-01T06:56:25.158 INFO:tasks.workunit.client.0.smithi016.stdout:6/582: unlink d1/d9/d3f/d7d/d8b/lc7 0 2024-08-01T06:56:25.163 INFO:tasks.workunit.client.0.smithi016.stdout:7/505: creat d7/db/d17/d72/d1c/d1d/d40/d58/fbc x:0 0 0 2024-08-01T06:56:25.164 INFO:tasks.workunit.client.0.smithi016.stdout:0/465: dwrite d10/d11/d41/f2f [0,4194304] 0 2024-08-01T06:56:25.169 INFO:tasks.workunit.client.0.smithi016.stdout:0/466: stat d10/d11/f3d 0 2024-08-01T06:56:25.171 INFO:tasks.workunit.client.0.smithi016.stdout:0/467: write d10/d11/d37/f8b [78284,76085] 0 2024-08-01T06:56:25.171 INFO:tasks.workunit.client.0.smithi016.stdout:7/506: rmdir d7/db/d17/d72/d1c/d1d/d5e 39 2024-08-01T06:56:25.173 INFO:tasks.workunit.client.0.smithi016.stdout:0/468: write d10/d11/d37/d58/f68 [375606,92305] 0 2024-08-01T06:56:25.175 INFO:tasks.workunit.client.0.smithi016.stdout:6/583: rename d1/d9 to d1/d8/d1b/d22/d36/d7a/dd3 0 2024-08-01T06:56:25.180 INFO:tasks.workunit.client.0.smithi016.stdout:7/507: truncate d7/db/d17/d72/d1c/d1d/d40/f73 4231070 0 2024-08-01T06:56:25.181 INFO:tasks.workunit.client.0.smithi016.stdout:6/584: creat d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/d91/fd4 x:0 0 0 2024-08-01T06:56:25.183 INFO:tasks.workunit.client.0.smithi016.stdout:3/430: link d9/l21 d9/d3e/d40/l97 0 2024-08-01T06:56:25.184 INFO:tasks.workunit.client.0.smithi016.stdout:3/431: dread - d9/d57/f74 zero size 2024-08-01T06:56:25.185 INFO:tasks.workunit.client.0.smithi016.stdout:3/432: truncate d9/d57/d66/f84 1125061 0 2024-08-01T06:56:25.185 INFO:tasks.workunit.client.0.smithi016.stdout:3/433: fdatasync d9/d57/f95 0 2024-08-01T06:56:25.188 INFO:tasks.workunit.client.0.smithi016.stdout:7/508: unlink d7/db/d17/d72/d1c/d1d/d40/d7f/fa7 0 2024-08-01T06:56:25.192 INFO:tasks.workunit.client.0.smithi016.stdout:6/585: dread d1/d41/f3e [0,4194304] 0 2024-08-01T06:56:25.192 INFO:tasks.workunit.client.0.smithi016.stdout:3/434: dwrite d9/f1f [0,4194304] 0 2024-08-01T06:56:25.192 INFO:tasks.workunit.client.0.smithi016.stdout:0/469: truncate d10/d11/f43 17026 0 2024-08-01T06:56:25.195 INFO:tasks.workunit.client.0.smithi016.stdout:3/435: chown d9/da/df/d12/d20/d5c/d76/f87 43 1 2024-08-01T06:56:25.196 INFO:tasks.workunit.client.0.smithi016.stdout:7/509: unlink d7/db/d17/d72/d1c/d79/d8f/d39/d43/f64 0 2024-08-01T06:56:25.200 INFO:tasks.workunit.client.0.smithi016.stdout:6/586: symlink d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/ld5 0 2024-08-01T06:56:25.253 INFO:tasks.workunit.client.0.smithi016.stdout:3/436: mkdir d9/d98 0 2024-08-01T06:56:25.254 INFO:tasks.workunit.client.0.smithi016.stdout:3/437: fsync d9/d57/f95 0 2024-08-01T06:56:25.260 INFO:tasks.workunit.client.0.smithi016.stdout:0/470: write d10/d1c/f27 [680491,76337] 0 2024-08-01T06:56:25.262 INFO:tasks.workunit.client.0.smithi016.stdout:7/510: write d7/db/d17/d72/d1e/d26/d2a/f7b [673428,104649] 0 2024-08-01T06:56:25.263 INFO:tasks.workunit.client.0.smithi016.stdout:0/471: truncate d10/d11/d37/d58/f8c 850335 0 2024-08-01T06:56:25.264 INFO:tasks.workunit.client.0.smithi016.stdout:6/587: write d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f38 [1157525,127397] 0 2024-08-01T06:56:25.271 INFO:tasks.workunit.client.0.smithi016.stdout:6/588: dwrite d1/d8/d1b/d22/d71/fac [0,4194304] 0 2024-08-01T06:56:25.279 INFO:tasks.workunit.client.0.smithi016.stdout:3/438: rename d9/da/df/d12/d20/d3c/l41 to d9/da/l99 0 2024-08-01T06:56:25.279 INFO:tasks.workunit.client.0.smithi016.stdout:3/439: stat d9/d57/f82 0 2024-08-01T06:56:25.281 INFO:tasks.workunit.client.0.smithi016.stdout:6/589: mkdir d1/d8/d1b/db5/dd6 0 2024-08-01T06:56:25.282 INFO:tasks.workunit.client.0.smithi016.stdout:7/511: creat d7/db/d17/d72/d22/db4/fbd x:0 0 0 2024-08-01T06:56:25.284 INFO:tasks.workunit.client.0.smithi016.stdout:7/512: chown d7/db/d17/d72/d1c/d79/d8f/d39 41 1 2024-08-01T06:56:25.284 INFO:tasks.workunit.client.0.smithi016.stdout:0/472: mknod d10/d5c/d91/c96 0 2024-08-01T06:56:25.285 INFO:tasks.workunit.client.0.smithi016.stdout:0/473: readlink d10/d11/d37/d58/l67 0 2024-08-01T06:56:25.285 INFO:tasks.workunit.client.0.smithi016.stdout:6/590: creat d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/d91/fd7 x:0 0 0 2024-08-01T06:56:25.286 INFO:tasks.workunit.client.0.smithi016.stdout:3/440: symlink d9/da/df/d12/l9a 0 2024-08-01T06:56:25.287 INFO:tasks.workunit.client.0.smithi016.stdout:3/441: write d9/d57/f95 [846419,70629] 0 2024-08-01T06:56:25.288 INFO:tasks.workunit.client.0.smithi016.stdout:7/513: mknod d7/db/d17/d72/d22/cbe 0 2024-08-01T06:56:25.289 INFO:tasks.workunit.client.0.smithi016.stdout:7/514: chown d7/db/d17/d72/d22/c70 15 1 2024-08-01T06:56:25.290 INFO:tasks.workunit.client.0.smithi016.stdout:0/474: readlink d10/d11/l34 0 2024-08-01T06:56:25.290 INFO:tasks.workunit.client.0.smithi016.stdout:0/475: chown d10/f33 1684625108 1 2024-08-01T06:56:25.292 INFO:tasks.workunit.client.0.smithi016.stdout:6/591: creat d1/d8/d94/fd8 x:0 0 0 2024-08-01T06:56:25.294 INFO:tasks.workunit.client.0.smithi016.stdout:6/592: write d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/da2/fb7 [629486,103411] 0 2024-08-01T06:56:25.295 INFO:tasks.workunit.client.0.smithi016.stdout:0/476: rmdir d10/d5c 39 2024-08-01T06:56:25.296 INFO:tasks.workunit.client.0.smithi016.stdout:7/515: creat d7/db/d17/d72/d1c/fbf x:0 0 0 2024-08-01T06:56:25.297 INFO:tasks.workunit.client.0.smithi016.stdout:6/593: chown d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/ca1 1113125 1 2024-08-01T06:56:25.298 INFO:tasks.workunit.client.0.smithi016.stdout:7/516: read d7/db/f44 [2496824,35530] 0 2024-08-01T06:56:25.300 INFO:tasks.workunit.client.0.smithi016.stdout:7/517: stat d7/db/d17/d72/d1c/d79/d8f/d39/l25 0 2024-08-01T06:56:25.301 INFO:tasks.workunit.client.0.smithi016.stdout:7/518: chown d7/db/d17/d72/d1c/d1d/d6d/fa5 20431 1 2024-08-01T06:56:25.302 INFO:tasks.workunit.client.0.smithi016.stdout:7/519: readlink d7/db/d17/d72/d1c/d1d/d40/d67/d7c/la9 0 2024-08-01T06:56:25.303 INFO:tasks.workunit.client.0.smithi016.stdout:6/594: mkdir d1/d8/d1b/d48/dd9 0 2024-08-01T06:56:25.305 INFO:tasks.workunit.client.0.smithi016.stdout:6/595: write d1/d8/d1b/d22/d71/f7f [1755681,18111] 0 2024-08-01T06:56:25.305 INFO:tasks.workunit.client.0.smithi016.stdout:3/442: getdents d9/da/df/d12/d20/d5c/d76 0 2024-08-01T06:56:25.310 INFO:tasks.workunit.client.0.smithi016.stdout:7/520: read - d7/db/d17/d72/d1c/d1d/f52 zero size 2024-08-01T06:56:25.314 INFO:tasks.workunit.client.0.smithi016.stdout:6/596: unlink d1/d8/d1b/d22/d36/fd0 0 2024-08-01T06:56:25.315 INFO:tasks.workunit.client.0.smithi016.stdout:3/443: creat d9/da/df/d12/d20/d5c/d7a/f9b x:0 0 0 2024-08-01T06:56:25.322 INFO:tasks.workunit.client.0.smithi016.stdout:7/521: dread d7/f18 [0,4194304] 0 2024-08-01T06:56:25.322 INFO:tasks.workunit.client.0.smithi016.stdout:6/597: getdents d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/d91/dc0 0 2024-08-01T06:56:25.323 INFO:tasks.workunit.client.0.smithi016.stdout:7/522: readlink d7/db/d17/d72/d1c/d1d/d40/d58/lab 0 2024-08-01T06:56:25.324 INFO:tasks.workunit.client.0.smithi016.stdout:3/444: creat d9/f9c x:0 0 0 2024-08-01T06:56:25.324 INFO:tasks.workunit.client.0.smithi016.stdout:6/598: chown d1/d8/d1b/d22/d2d/l3a 281361542 1 2024-08-01T06:56:25.325 INFO:tasks.workunit.client.0.smithi016.stdout:3/445: readlink d9/d1c/l39 0 2024-08-01T06:56:25.326 INFO:tasks.workunit.client.0.smithi016.stdout:3/446: read - d9/d57/f82 zero size 2024-08-01T06:56:25.327 INFO:tasks.workunit.client.0.smithi016.stdout:3/447: stat d9/da/df/d53 0 2024-08-01T06:56:25.327 INFO:tasks.workunit.client.0.smithi016.stdout:7/523: mkdir d7/db/d17/d72/d1e/d26/d63/dc0 0 2024-08-01T06:56:25.330 INFO:tasks.workunit.client.0.smithi016.stdout:3/448: write d9/da/df/d12/d20/d3c/f4b [5139172,78] 0 2024-08-01T06:56:25.330 INFO:tasks.workunit.client.0.smithi016.stdout:7/524: creat d7/db/d17/d4e/fc1 x:0 0 0 2024-08-01T06:56:25.331 INFO:tasks.workunit.client.0.smithi016.stdout:6/599: dwrite d1/d41/f52 [4194304,4194304] 0 2024-08-01T06:56:25.335 INFO:tasks.workunit.client.0.smithi016.stdout:0/477: truncate f9 235026 0 2024-08-01T06:56:25.336 INFO:tasks.workunit.client.0.smithi016.stdout:3/449: unlink d9/da/l1a 0 2024-08-01T06:56:25.336 INFO:tasks.workunit.client.0.smithi016.stdout:7/525: creat d7/db/d17/d72/d22/fc2 x:0 0 0 2024-08-01T06:56:25.344 INFO:tasks.workunit.client.0.smithi016.stdout:3/450: rename d9/d3e/f5e to d9/da/df/d12/d20/d5c/f9d 0 2024-08-01T06:56:25.346 INFO:tasks.workunit.client.0.smithi016.stdout:3/451: write d9/da/df/d2a/d49/d61/f93 [639810,100745] 0 2024-08-01T06:56:25.348 INFO:tasks.workunit.client.0.smithi016.stdout:0/478: symlink d10/d5c/d90/l97 0 2024-08-01T06:56:25.348 INFO:tasks.workunit.client.0.smithi016.stdout:0/479: stat d10/d1c/c66 0 2024-08-01T06:56:25.349 INFO:tasks.workunit.client.0.smithi016.stdout:0/480: fsync d10/f45 0 2024-08-01T06:56:25.358 INFO:tasks.workunit.client.0.smithi016.stdout:6/600: dwrite d1/d8/d1b/db5/d67/d8f/dba/dbd/f84 [0,4194304] 0 2024-08-01T06:56:25.362 INFO:tasks.workunit.client.0.smithi016.stdout:7/526: write d7/db/d17/d72/d1e/d26/d2a/f8c [75450,89416] 0 2024-08-01T06:56:25.367 INFO:tasks.workunit.client.0.smithi016.stdout:3/452: getdents d9/d3e/d40/d58/d59 0 2024-08-01T06:56:25.368 INFO:tasks.workunit.client.0.smithi016.stdout:6/601: dwrite d1/d43/f4a [0,4194304] 0 2024-08-01T06:56:25.369 INFO:tasks.workunit.client.0.smithi016.stdout:7/527: dread d7/db/d17/d72/d1e/d26/d2a/f30 [0,4194304] 0 2024-08-01T06:56:25.370 INFO:tasks.workunit.client.0.smithi016.stdout:3/453: truncate d9/d57/f8a 285303 0 2024-08-01T06:56:25.373 INFO:tasks.workunit.client.0.smithi016.stdout:3/454: write d9/da/df/d12/d20/d5c/d76/f87 [925980,107132] 0 2024-08-01T06:56:25.374 INFO:tasks.workunit.client.0.smithi016.stdout:7/528: creat d7/db/d17/fc3 x:0 0 0 2024-08-01T06:56:25.375 INFO:tasks.workunit.client.0.smithi016.stdout:6/602: readlink d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d8e/dcf/da9/lb2 0 2024-08-01T06:56:25.386 INFO:tasks.workunit.client.0.smithi016.stdout:7/529: creat d7/db/d17/d72/d1c/d79/d8f/fc4 x:0 0 0 2024-08-01T06:56:25.387 INFO:tasks.workunit.client.0.smithi016.stdout:7/530: chown d7/db/d17/d72/d1c/d1d/d6d/fa5 9833630 1 2024-08-01T06:56:25.391 INFO:tasks.workunit.client.0.smithi016.stdout:3/455: truncate d9/da/df/d12/d20/d5c/d7a/f7b 4244156 0 2024-08-01T06:56:25.396 INFO:tasks.workunit.client.0.smithi016.stdout:6/603: dwrite d1/d8/d1b/d22/d36/d7a/dd3/da3/fc9 [0,4194304] 0 2024-08-01T06:56:25.398 INFO:tasks.workunit.client.0.smithi016.stdout:3/456: rmdir d9/da/df/d2a/d49/d61 39 2024-08-01T06:56:25.403 INFO:tasks.workunit.client.0.smithi016.stdout:3/457: dread d9/da/df/d12/d20/f35 [0,4194304] 0 2024-08-01T06:56:25.405 INFO:tasks.workunit.client.0.smithi016.stdout:6/604: rename d1/d8/d1b/db5/f5e to d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/dbc/fda 0 2024-08-01T06:56:25.407 INFO:tasks.workunit.client.0.smithi016.stdout:3/458: rmdir d9/da/df/d53 39 2024-08-01T06:56:25.408 INFO:tasks.workunit.client.0.smithi016.stdout:7/531: dread d7/db/d17/d72/d1c/d79/fb0 [0,4194304] 0 2024-08-01T06:56:25.410 INFO:tasks.workunit.client.0.smithi016.stdout:6/605: creat d1/d8/d1b/db5/fdb x:0 0 0 2024-08-01T06:56:25.413 INFO:tasks.workunit.client.0.smithi016.stdout:3/459: creat d9/da/d96/f9e x:0 0 0 2024-08-01T06:56:25.414 INFO:tasks.workunit.client.0.smithi016.stdout:6/606: mkdir d1/d8/d94/ddc 0 2024-08-01T06:56:25.417 INFO:tasks.workunit.client.0.smithi016.stdout:3/460: dread d9/da/df/d12/d20/d3c/f4b [4194304,4194304] 0 2024-08-01T06:56:25.418 INFO:tasks.workunit.client.0.smithi016.stdout:3/461: stat d9/da/df/c16 0 2024-08-01T06:56:25.418 INFO:tasks.workunit.client.0.smithi016.stdout:3/462: write d9/da/df/d2a/f77 [4778388,121999] 0 2024-08-01T06:56:25.425 INFO:tasks.workunit.client.0.smithi016.stdout:7/532: rename d7/db/d17/fa8 to d7/db/d17/d72/d1c/d79/d8f/fc5 0 2024-08-01T06:56:25.428 INFO:tasks.workunit.client.0.smithi016.stdout:6/607: mknod d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/cdd 0 2024-08-01T06:56:25.429 INFO:tasks.workunit.client.0.smithi016.stdout:6/608: write d1/d8/d1b/d22/f6a [827879,76059] 0 2024-08-01T06:56:25.431 INFO:tasks.workunit.client.0.smithi016.stdout:6/609: write d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/f95 [425707,36156] 0 2024-08-01T06:56:25.437 INFO:tasks.workunit.client.0.smithi016.stdout:6/610: dwrite d1/d41/f52 [4194304,4194304] 0 2024-08-01T06:56:25.464 INFO:tasks.workunit.client.0.smithi016.stdout:3/463: read - d9/da/f2e zero size 2024-08-01T06:56:25.465 INFO:tasks.workunit.client.0.smithi016.stdout:7/533: mkdir d7/db/d17/d72/d1c/dc6 0 2024-08-01T06:56:25.465 INFO:tasks.workunit.client.0.smithi016.stdout:3/464: dread - d9/f9c zero size 2024-08-01T06:56:25.466 INFO:tasks.workunit.client.0.smithi016.stdout:7/534: readlink d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/la1 0 2024-08-01T06:56:25.468 INFO:tasks.workunit.client.0.smithi016.stdout:6/611: truncate d1/d8/d1b/d22/d36/d7a/dd3/f74 3096776 0 2024-08-01T06:56:25.468 INFO:tasks.workunit.client.0.smithi016.stdout:7/535: fsync d7/db/d17/d72/d1e/d26/d2a/f8c 0 2024-08-01T06:56:25.469 INFO:tasks.workunit.client.0.smithi016.stdout:3/465: rmdir d9/da/df/d12/d20/d5c/d76 39 2024-08-01T06:56:25.470 INFO:tasks.workunit.client.0.smithi016.stdout:6/612: readlink d1/l27 0 2024-08-01T06:56:25.472 INFO:tasks.workunit.client.0.smithi016.stdout:6/613: dread - d1/d41/f6c zero size 2024-08-01T06:56:25.478 INFO:tasks.workunit.client.0.smithi016.stdout:7/536: dwrite d7/db/f13 [0,4194304] 0 2024-08-01T06:56:25.482 INFO:tasks.workunit.client.0.smithi016.stdout:6/614: dwrite d1/d8/d1b/d22/d71/fac [0,4194304] 0 2024-08-01T06:56:25.489 INFO:tasks.workunit.client.0.smithi016.stdout:6/615: symlink d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/d91/dc0/lde 0 2024-08-01T06:56:25.493 INFO:tasks.workunit.client.0.smithi016.stdout:6/616: rmdir d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d 39 2024-08-01T06:56:25.494 INFO:tasks.workunit.client.0.smithi016.stdout:6/617: stat d1/d8/d1b/d22/d71 0 2024-08-01T06:56:25.495 INFO:tasks.workunit.client.0.smithi016.stdout:6/618: symlink d1/d8/d1b/ldf 0 2024-08-01T06:56:25.497 INFO:tasks.workunit.client.0.smithi016.stdout:7/537: dread d7/db/f6f [0,4194304] 0 2024-08-01T06:56:25.500 INFO:tasks.workunit.client.0.smithi016.stdout:6/619: symlink d1/d8/d1b/d22/d36/d7a/d99/le0 0 2024-08-01T06:56:25.500 INFO:tasks.workunit.client.0.smithi016.stdout:3/466: write d9/da/df/d12/d20/d5c/d7a/f7b [1900055,62683] 0 2024-08-01T06:56:25.500 INFO:tasks.workunit.client.0.smithi016.stdout:7/538: fsync d7/db/d17/d72/d1e/f1f 0 2024-08-01T06:56:25.505 INFO:tasks.workunit.client.0.smithi016.stdout:6/620: chown d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/dbc/fc4 1483749 1 2024-08-01T06:56:25.506 INFO:tasks.workunit.client.0.smithi016.stdout:6/621: fsync d1/d41/fb6 0 2024-08-01T06:56:25.509 INFO:tasks.workunit.client.0.smithi016.stdout:3/467: dwrite d9/da/df/d12/d20/d5c/d7a/f92 [0,4194304] 0 2024-08-01T06:56:25.510 INFO:tasks.workunit.client.0.smithi016.stdout:7/539: rename d7/db/d17/d72/d1c/d1d/d5e to d7/db/dc7 0 2024-08-01T06:56:25.515 INFO:tasks.workunit.client.0.smithi016.stdout:3/468: creat d9/d3e/d80/f9f x:0 0 0 2024-08-01T06:56:25.519 INFO:tasks.workunit.client.0.smithi016.stdout:3/469: unlink d9/d1c/l32 0 2024-08-01T06:56:25.527 INFO:tasks.workunit.client.0.smithi016.stdout:7/540: getdents d7/db/d17/d72/d1c/d79/d8f/d39/d43/d53 0 2024-08-01T06:56:25.527 INFO:tasks.workunit.client.0.smithi016.stdout:7/541: stat d7/db/f6f 0 2024-08-01T06:56:25.531 INFO:tasks.workunit.client.0.smithi016.stdout:6/622: dread d1/d8/f11 [4194304,4194304] 0 2024-08-01T06:56:25.537 INFO:tasks.workunit.client.0.smithi016.stdout:6/623: mknod d1/d43/d88/ce1 0 2024-08-01T06:56:25.542 INFO:tasks.workunit.client.0.smithi016.stdout:6/624: dwrite d1/d8/d1b/d22/f29 [4194304,4194304] 0 2024-08-01T06:56:25.545 INFO:tasks.workunit.client.0.smithi016.stdout:6/625: symlink d1/d8/d1b/d22/d71/db1/le2 0 2024-08-01T06:56:25.550 INFO:tasks.workunit.client.0.smithi016.stdout:6/626: getdents d1/d8/d94 0 2024-08-01T06:56:25.562 INFO:tasks.workunit.client.0.smithi016.stdout:6/627: dwrite d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/f87 [0,4194304] 0 2024-08-01T06:56:25.563 INFO:tasks.workunit.client.0.smithi016.stdout:6/628: chown d1/d8/l59 18176195 1 2024-08-01T06:56:25.565 INFO:tasks.workunit.client.0.smithi016.stdout:6/629: write d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/f95 [1844417,108865] 0 2024-08-01T06:56:25.578 INFO:tasks.workunit.client.0.smithi016.stdout:6/630: dwrite d1/d8/f11 [8388608,4194304] 0 2024-08-01T06:56:25.580 INFO:tasks.workunit.client.0.smithi016.stdout:6/631: chown d1/d8/c73 7956652 1 2024-08-01T06:56:25.585 INFO:tasks.workunit.client.0.smithi016.stdout:6/632: rename d1/d41/dbf/fc8 to d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/fe3 0 2024-08-01T06:56:25.587 INFO:tasks.workunit.client.0.smithi016.stdout:6/633: creat d1/d41/fe4 x:0 0 0 2024-08-01T06:56:25.589 INFO:tasks.workunit.client.0.smithi016.stdout:6/634: write d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/d91/fd7 [995980,76932] 0 2024-08-01T06:56:25.602 INFO:tasks.workunit.client.0.smithi016.stdout:6/635: dread d1/d8/d1b/d22/f6a [0,4194304] 0 2024-08-01T06:56:25.604 INFO:tasks.workunit.client.0.smithi016.stdout:6/636: read d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f38 [2156905,64384] 0 2024-08-01T06:56:25.606 INFO:tasks.workunit.client.0.smithi016.stdout:6/637: write d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/f95 [61893,76107] 0 2024-08-01T06:56:25.615 INFO:tasks.workunit.client.0.smithi016.stdout:6/638: dwrite d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d93/daf/fb8 [0,4194304] 0 2024-08-01T06:56:25.618 INFO:tasks.workunit.client.0.smithi016.stdout:6/639: truncate d1/d8/f51 186725 0 2024-08-01T06:56:25.622 INFO:tasks.workunit.client.0.smithi016.stdout:6/640: mkdir d1/d43/d88/de5 0 2024-08-01T06:56:25.623 INFO:tasks.workunit.client.0.smithi016.stdout:6/641: dread - d1/d8/d1b/d22/d36/d7a/dd3/fbb zero size 2024-08-01T06:56:25.625 INFO:tasks.workunit.client.0.smithi016.stdout:6/642: symlink d1/d8/d1b/d22/le6 0 2024-08-01T06:56:25.626 INFO:tasks.workunit.client.0.smithi016.stdout:6/643: rename d1/d8 to d1/d8/d1b/d48/de7 22 2024-08-01T06:56:25.630 INFO:tasks.workunit.client.0.smithi016.stdout:6/644: rename d1/d8/d1b/f72 to d1/d8/d1b/db5/d67/d8f/dba/fe8 0 2024-08-01T06:56:25.631 INFO:tasks.workunit.client.0.smithi016.stdout:6/645: rmdir d1/d8/d1b/db5/d67/d8f/dba/dbd/d68 39 2024-08-01T06:56:25.633 INFO:tasks.workunit.client.0.smithi016.stdout:6/646: write d1/f2 [1284675,25545] 0 2024-08-01T06:56:25.636 INFO:tasks.workunit.client.0.smithi016.stdout:6/647: fsync d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f3c 0 2024-08-01T06:56:25.654 INFO:tasks.workunit.client.0.smithi016.stdout:6/648: write d1/d8/d1b/d22/d36/f9b [616572,34126] 0 2024-08-01T06:56:25.660 INFO:tasks.workunit.client.0.smithi016.stdout:6/649: mknod d1/d8/d1b/d22/d36/ce9 0 2024-08-01T06:56:25.665 INFO:tasks.workunit.client.0.smithi016.stdout:6/650: rename d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f37 to d1/d8/d1b/d22/d2d/fea 0 2024-08-01T06:56:25.667 INFO:tasks.workunit.client.0.smithi016.stdout:6/651: stat d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d93/daf 0 2024-08-01T06:56:25.668 INFO:tasks.workunit.client.0.smithi016.stdout:6/652: symlink d1/d8/d1b/d48/leb 0 2024-08-01T06:56:25.670 INFO:tasks.workunit.client.0.smithi016.stdout:6/653: mkdir d1/d8/d1b/dec 0 2024-08-01T06:56:25.681 INFO:tasks.workunit.client.0.smithi016.stdout:6/654: dwrite d1/d8/f1a [0,4194304] 0 2024-08-01T06:56:25.683 INFO:tasks.workunit.client.0.smithi016.stdout:6/655: write d1/d8/d1b/d22/d2d/fc1 [534394,116567] 0 2024-08-01T06:56:25.691 INFO:tasks.workunit.client.0.smithi016.stdout:6/656: rename d1/d8/d1b/db5/fdb to d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d8e/dcf/fed 0 2024-08-01T06:56:25.694 INFO:tasks.workunit.client.0.smithi016.stdout:6/657: truncate d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f3c 707500 0 2024-08-01T06:56:25.697 INFO:tasks.workunit.client.0.smithi016.stdout:6/658: mknod d1/d43/d88/de5/cee 0 2024-08-01T06:56:25.709 INFO:tasks.workunit.client.0.smithi016.stdout:6/659: dwrite d1/d43/f6d [0,4194304] 0 2024-08-01T06:56:25.712 INFO:tasks.workunit.client.0.smithi016.stdout:6/660: write d1/d8/d1b/db5/d67/d8f/dba/dbd/f84 [250467,5785] 0 2024-08-01T06:56:25.716 INFO:tasks.workunit.client.0.smithi016.stdout:6/661: creat d1/d8/d1b/d22/d36/d7a/d99/fef x:0 0 0 2024-08-01T06:56:25.720 INFO:tasks.workunit.client.0.smithi016.stdout:6/662: link d1/d8/d1b/f35 d1/d8/d1b/d22/d71/ff0 0 2024-08-01T06:56:25.723 INFO:tasks.workunit.client.0.smithi016.stdout:6/663: creat d1/d8/d1b/d22/d36/d7a/ff1 x:0 0 0 2024-08-01T06:56:25.725 INFO:tasks.workunit.client.0.smithi016.stdout:6/664: rename d1/d41/c69 to d1/d8/d1b/dec/cf2 0 2024-08-01T06:56:25.774 INFO:tasks.workunit.client.0.smithi016.stdout:6/665: truncate d1/d8/d1b/d22/d2d/f9a 593172 0 2024-08-01T06:56:25.778 INFO:tasks.workunit.client.0.smithi016.stdout:6/666: creat d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d93/ff3 x:0 0 0 2024-08-01T06:56:25.780 INFO:tasks.workunit.client.0.smithi016.stdout:6/667: write d1/d8/d1b/d22/d36/d7a/ff1 [105337,121481] 0 2024-08-01T06:56:25.782 INFO:tasks.workunit.client.0.smithi016.stdout:6/668: chown d1/d8/f51 93919097 1 2024-08-01T06:56:25.783 INFO:tasks.workunit.client.0.smithi016.stdout:6/669: readlink d1/d8/l92 0 2024-08-01T06:56:25.786 INFO:tasks.workunit.client.0.smithi016.stdout:6/670: creat d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/ff4 x:0 0 0 2024-08-01T06:56:25.815 INFO:tasks.workunit.client.0.smithi016.stdout:6/671: write d1/d8/d1b/d22/d36/d7a/dd3/f74 [855992,127545] 0 2024-08-01T06:56:25.820 INFO:tasks.workunit.client.0.smithi016.stdout:6/672: creat d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/da2/ff5 x:0 0 0 2024-08-01T06:56:25.822 INFO:tasks.workunit.client.0.smithi016.stdout:6/673: mkdir d1/d8/d1b/df6 0 2024-08-01T06:56:26.735 INFO:tasks.workunit.client.0.smithi016.stdout:4/485: sync 2024-08-01T06:56:26.746 INFO:tasks.workunit.client.0.smithi016.stdout:4/486: dwrite d0/d2/dc/d12/f72 [0,4194304] 0 2024-08-01T06:56:26.755 INFO:tasks.workunit.client.0.smithi016.stdout:4/487: rename d0/d17/d67 to d0/d17/d22/d26/da3 0 2024-08-01T06:56:26.756 INFO:tasks.workunit.client.0.smithi016.stdout:4/488: unlink d0/d2/d68/l89 0 2024-08-01T06:56:26.768 INFO:tasks.workunit.client.0.smithi016.stdout:4/489: write d0/d17/d22/f53 [3586810,32740] 0 2024-08-01T06:56:26.783 INFO:tasks.workunit.client.0.smithi016.stdout:4/490: dread d0/d2/d36/f9f [0,4194304] 0 2024-08-01T06:56:26.785 INFO:tasks.workunit.client.0.smithi016.stdout:1/600: sync 2024-08-01T06:56:26.785 INFO:tasks.workunit.client.0.smithi016.stdout:9/535: sync 2024-08-01T06:56:26.785 INFO:tasks.workunit.client.0.smithi016.stdout:2/737: sync 2024-08-01T06:56:26.787 INFO:tasks.workunit.client.0.smithi016.stdout:2/738: truncate d0/d8/d1b/dcc/d3b/fa4 223592 0 2024-08-01T06:56:26.787 INFO:tasks.workunit.client.0.smithi016.stdout:9/536: mkdir d3/de/dae 0 2024-08-01T06:56:26.789 INFO:tasks.workunit.client.0.smithi016.stdout:4/491: rmdir d0/d2/dc/d90/d92 0 2024-08-01T06:56:26.792 INFO:tasks.workunit.client.0.smithi016.stdout:2/739: symlink d0/d8/d31/da7/ddf/lf5 0 2024-08-01T06:56:26.793 INFO:tasks.workunit.client.0.smithi016.stdout:2/740: fsync d0/d8/d1b/d74/d90/d93/fea 0 2024-08-01T06:56:26.794 INFO:tasks.workunit.client.0.smithi016.stdout:2/741: fdatasync d0/d8/d31/d5e/fbb 0 2024-08-01T06:56:26.794 INFO:tasks.workunit.client.0.smithi016.stdout:9/537: creat d3/de/dae/faf x:0 0 0 2024-08-01T06:56:26.799 INFO:tasks.workunit.client.0.smithi016.stdout:1/601: getdents d2/de 0 2024-08-01T06:56:26.807 INFO:tasks.workunit.client.0.smithi016.stdout:4/492: dread d0/d2/fa [0,4194304] 0 2024-08-01T06:56:26.812 INFO:tasks.workunit.client.0.smithi016.stdout:4/493: mknod d0/d17/d22/d73/ca4 0 2024-08-01T06:56:26.814 INFO:tasks.workunit.client.0.smithi016.stdout:4/494: write d0/d17/d38/f7c [416947,33147] 0 2024-08-01T06:56:26.816 INFO:tasks.workunit.client.0.smithi016.stdout:9/538: dread d3/f65 [0,4194304] 0 2024-08-01T06:56:26.817 INFO:tasks.workunit.client.0.smithi016.stdout:9/539: write d3/f6a [15161,88783] 0 2024-08-01T06:56:26.827 INFO:tasks.workunit.client.0.smithi016.stdout:4/495: rename d0/d2/dc/d12/f72 to d0/d17/d22/fa5 0 2024-08-01T06:56:26.832 INFO:tasks.workunit.client.0.smithi016.stdout:4/496: write d0/d2/d36/f56 [5152689,48725] 0 2024-08-01T06:56:26.836 INFO:tasks.workunit.client.0.smithi016.stdout:4/497: creat d0/d2/dc/d12/d29/d79/fa6 x:0 0 0 2024-08-01T06:56:26.846 INFO:tasks.workunit.client.0.smithi016.stdout:1/602: dwrite d2/d3/d1a/d22/f76 [4194304,4194304] 0 2024-08-01T06:56:26.850 INFO:tasks.workunit.client.0.smithi016.stdout:1/603: mkdir d2/de/d63/dd6 0 2024-08-01T06:56:26.856 INFO:tasks.workunit.client.0.smithi016.stdout:1/604: unlink d2/d3/d41/d49/d85/fc9 0 2024-08-01T06:56:26.862 INFO:tasks.workunit.client.0.smithi016.stdout:4/498: unlink d0/d17/d22/fa5 0 2024-08-01T06:56:26.864 INFO:tasks.workunit.client.0.smithi016.stdout:9/540: dwrite d3/d9/df/d16/f62 [0,4194304] 0 2024-08-01T06:56:26.865 INFO:tasks.workunit.client.0.smithi016.stdout:4/499: readlink d0/d17/d38/l4d 0 2024-08-01T06:56:26.866 INFO:tasks.workunit.client.0.smithi016.stdout:4/500: chown d0/d17/d22/d26/d8b 54570 1 2024-08-01T06:56:26.886 INFO:tasks.workunit.client.0.smithi016.stdout:1/605: dread d2/f17 [0,4194304] 0 2024-08-01T06:56:26.888 INFO:tasks.workunit.client.0.smithi016.stdout:4/501: write d0/fb [5014796,115686] 0 2024-08-01T06:56:26.889 INFO:tasks.workunit.client.0.smithi016.stdout:9/541: dread d3/d9/d46/f4a [0,4194304] 0 2024-08-01T06:56:26.890 INFO:tasks.workunit.client.0.smithi016.stdout:1/606: fsync d2/fb2 0 2024-08-01T06:56:26.895 INFO:tasks.workunit.client.0.smithi016.stdout:1/607: stat d2/d88/l9e 0 2024-08-01T06:56:26.895 INFO:tasks.workunit.client.0.smithi016.stdout:9/542: fsync d3/d9/df/d16/f1e 0 2024-08-01T06:56:26.895 INFO:tasks.workunit.client.0.smithi016.stdout:1/608: chown d2/d3/d1f/c29 2966 1 2024-08-01T06:56:26.896 INFO:tasks.workunit.client.0.smithi016.stdout:4/502: symlink d0/d2/dc/la7 0 2024-08-01T06:56:26.900 INFO:tasks.workunit.client.0.smithi016.stdout:1/609: symlink d2/d3/d41/d49/d85/ld7 0 2024-08-01T06:56:26.903 INFO:tasks.workunit.client.0.smithi016.stdout:4/503: dwrite d0/d17/d22/d7f/d93/f96 [0,4194304] 0 2024-08-01T06:56:26.906 INFO:tasks.workunit.client.0.smithi016.stdout:4/504: write d0/d17/d22/d7f/d93/f96 [2166721,94427] 0 2024-08-01T06:56:26.910 INFO:tasks.workunit.client.0.smithi016.stdout:9/543: write d3/d32/d5c/d8a/f34 [264458,115155] 0 2024-08-01T06:56:26.915 INFO:tasks.workunit.client.0.smithi016.stdout:1/610: dread d2/f12 [0,4194304] 0 2024-08-01T06:56:26.919 INFO:tasks.workunit.client.0.smithi016.stdout:1/611: mkdir d2/d3/d41/d49/d85/dc1/dd8 0 2024-08-01T06:56:26.923 INFO:tasks.workunit.client.0.smithi016.stdout:1/612: write d2/f17 [5102192,86485] 0 2024-08-01T06:56:26.923 INFO:tasks.workunit.client.0.smithi016.stdout:4/505: dwrite d0/d2/dc/d12/d29/d3c/f55 [4194304,4194304] 0 2024-08-01T06:56:26.923 INFO:tasks.workunit.client.0.smithi016.stdout:9/544: dwrite d3/f28 [0,4194304] 0 2024-08-01T06:56:26.926 INFO:tasks.workunit.client.0.smithi016.stdout:4/506: dread - d0/d2/dc/d12/d29/f9b zero size 2024-08-01T06:56:26.931 INFO:tasks.workunit.client.0.smithi016.stdout:4/507: write d0/d2/dc/d12/d29/d3c/f5b [464613,130139] 0 2024-08-01T06:56:26.933 INFO:tasks.workunit.client.0.smithi016.stdout:4/508: fsync d0/d17/d38/f82 0 2024-08-01T06:56:26.934 INFO:tasks.workunit.client.0.smithi016.stdout:9/545: getdents d3/d9/d46/d48/d87 0 2024-08-01T06:56:26.937 INFO:tasks.workunit.client.0.smithi016.stdout:4/509: symlink d0/la8 0 2024-08-01T06:56:26.939 INFO:tasks.workunit.client.0.smithi016.stdout:4/510: fsync d0/d17/d22/f31 0 2024-08-01T06:56:26.945 INFO:tasks.workunit.client.0.smithi016.stdout:4/511: mkdir d0/d17/d22/d73/da9 0 2024-08-01T06:56:26.946 INFO:tasks.workunit.client.0.smithi016.stdout:9/546: rmdir d3/d9/df/d38/dad 0 2024-08-01T06:56:26.949 INFO:tasks.workunit.client.0.smithi016.stdout:9/547: stat d3/d9/df/c2e 0 2024-08-01T06:56:26.950 INFO:tasks.workunit.client.0.smithi016.stdout:1/613: dwrite d2/de/f37 [0,4194304] 0 2024-08-01T06:56:26.950 INFO:tasks.workunit.client.0.smithi016.stdout:9/548: stat d3/d9/df/d16/l6b 0 2024-08-01T06:56:26.951 INFO:tasks.workunit.client.0.smithi016.stdout:1/614: stat d2/de/d32 0 2024-08-01T06:56:26.952 INFO:tasks.workunit.client.0.smithi016.stdout:1/615: write d2/d3/d1c/f2e [1770000,111406] 0 2024-08-01T06:56:26.964 INFO:tasks.workunit.client.0.smithi016.stdout:4/512: getdents d0/d2/dc/d90 0 2024-08-01T06:56:26.967 INFO:tasks.workunit.client.0.smithi016.stdout:4/513: chown d0/d2/l7 44 1 2024-08-01T06:56:26.968 INFO:tasks.workunit.client.0.smithi016.stdout:8/448: sync 2024-08-01T06:56:26.968 INFO:tasks.workunit.client.0.smithi016.stdout:5/523: sync 2024-08-01T06:56:26.969 INFO:tasks.workunit.client.0.smithi016.stdout:5/524: stat d1/d2/d6/d5a/d65/c84 0 2024-08-01T06:56:26.969 INFO:tasks.workunit.client.0.smithi016.stdout:9/549: link d3/la7 d3/de/lb0 0 2024-08-01T06:56:26.971 INFO:tasks.workunit.client.0.smithi016.stdout:1/616: link d2/c25 d2/d3/d1f/cd9 0 2024-08-01T06:56:26.972 INFO:tasks.workunit.client.0.smithi016.stdout:5/525: mkdir d1/d12/d3e/db4 0 2024-08-01T06:56:26.980 INFO:tasks.workunit.client.0.smithi016.stdout:5/526: read d1/f3c [256047,39830] 0 2024-08-01T06:56:26.980 INFO:tasks.workunit.client.0.smithi016.stdout:9/550: link d3/d9/db/d3e/f99 d3/d9/df/d16/fb1 0 2024-08-01T06:56:26.981 INFO:tasks.workunit.client.0.smithi016.stdout:4/514: write d0/d2/f2a [4101573,23685] 0 2024-08-01T06:56:26.982 INFO:tasks.workunit.client.0.smithi016.stdout:1/617: write d2/de/d6e/f78 [133966,84200] 0 2024-08-01T06:56:26.984 INFO:tasks.workunit.client.0.smithi016.stdout:9/551: fsync d3/f1d 0 2024-08-01T06:56:26.985 INFO:tasks.workunit.client.0.smithi016.stdout:9/552: read - d3/d9/df/d16/f9f zero size 2024-08-01T06:56:26.988 INFO:tasks.workunit.client.0.smithi016.stdout:4/515: write d0/d17/d22/d26/da3/f77 [1296432,33021] 0 2024-08-01T06:56:26.988 INFO:tasks.workunit.client.0.smithi016.stdout:5/527: creat d1/d2/d6/d9/d49/d57/db1/fb5 x:0 0 0 2024-08-01T06:56:26.995 INFO:tasks.workunit.client.0.smithi016.stdout:9/553: dwrite d3/d9/db/dc/f42 [4194304,4194304] 0 2024-08-01T06:56:26.995 INFO:tasks.workunit.client.0.smithi016.stdout:5/528: unlink d1/d2/d6/l77 0 2024-08-01T06:56:26.996 INFO:tasks.workunit.client.0.smithi016.stdout:5/529: fdatasync d1/d12/d3e/f92 0 2024-08-01T06:56:26.998 INFO:tasks.workunit.client.0.smithi016.stdout:1/618: dread d2/f2a [4194304,4194304] 0 2024-08-01T06:56:26.998 INFO:tasks.workunit.client.0.smithi016.stdout:4/516: creat d0/d2/dc/d12/d29/d8f/faa x:0 0 0 2024-08-01T06:56:27.000 INFO:tasks.workunit.client.0.smithi016.stdout:9/554: chown d3/la7 66833 1 2024-08-01T06:56:27.000 INFO:tasks.workunit.client.0.smithi016.stdout:4/517: write d0/d2/dc/d12/d29/d8f/faa [1025158,65377] 0 2024-08-01T06:56:27.001 INFO:tasks.workunit.client.0.smithi016.stdout:5/530: fdatasync d1/d12/d3e/f62 0 2024-08-01T06:56:27.002 INFO:tasks.workunit.client.0.smithi016.stdout:1/619: fdatasync d2/d3/d1c/fa6 0 2024-08-01T06:56:27.003 INFO:tasks.workunit.client.0.smithi016.stdout:9/555: truncate d3/d9/df/d2a/f76 1077083 0 2024-08-01T06:56:27.004 INFO:tasks.workunit.client.0.smithi016.stdout:9/556: stat d3/d9/d46/d48/fab 0 2024-08-01T06:56:27.004 INFO:tasks.workunit.client.0.smithi016.stdout:9/557: readlink d3/d9/df/l1b 0 2024-08-01T06:56:27.005 INFO:tasks.workunit.client.0.smithi016.stdout:9/558: stat d3/de/d89 0 2024-08-01T06:56:27.006 INFO:tasks.workunit.client.0.smithi016.stdout:5/531: creat d1/d12/d3e/fb6 x:0 0 0 2024-08-01T06:56:27.007 INFO:tasks.workunit.client.0.smithi016.stdout:1/620: readlink d2/d3/d41/l4b 0 2024-08-01T06:56:27.007 INFO:tasks.workunit.client.0.smithi016.stdout:1/621: fsync d2/d88/fbc 0 2024-08-01T06:56:27.008 INFO:tasks.workunit.client.0.smithi016.stdout:4/518: mkdir d0/d2/dc/d12/d29/d91/dab 0 2024-08-01T06:56:27.009 INFO:tasks.workunit.client.0.smithi016.stdout:9/559: symlink d3/d9/db/d3e/d40/lb2 0 2024-08-01T06:56:27.010 INFO:tasks.workunit.client.0.smithi016.stdout:5/532: creat d1/d2/d6/d9/d49/d57/fb7 x:0 0 0 2024-08-01T06:56:27.012 INFO:tasks.workunit.client.0.smithi016.stdout:1/622: read d2/d3/d1a/d22/f6c [2742109,40986] 0 2024-08-01T06:56:27.012 INFO:tasks.workunit.client.0.smithi016.stdout:4/519: unlink d0/d2/dc/c48 0 2024-08-01T06:56:27.014 INFO:tasks.workunit.client.0.smithi016.stdout:9/560: mknod d3/d9/db/dc/d56/cb3 0 2024-08-01T06:56:27.017 INFO:tasks.workunit.client.0.smithi016.stdout:5/533: mkdir d1/d2/d20/db8 0 2024-08-01T06:56:27.020 INFO:tasks.workunit.client.0.smithi016.stdout:9/561: symlink d3/de/dae/lb4 0 2024-08-01T06:56:27.022 INFO:tasks.workunit.client.0.smithi016.stdout:4/520: link d0/d17/d22/d7f/d93/fa1 d0/d17/d22/d26/fac 0 2024-08-01T06:56:27.022 INFO:tasks.workunit.client.0.smithi016.stdout:5/534: dread - d1/d12/f9a zero size 2024-08-01T06:56:27.024 INFO:tasks.workunit.client.0.smithi016.stdout:1/623: dread d2/d3/d48/f95 [0,4194304] 0 2024-08-01T06:56:27.028 INFO:tasks.workunit.client.0.smithi016.stdout:1/624: creat d2/de/d4d/d92/fda x:0 0 0 2024-08-01T06:56:27.031 INFO:tasks.workunit.client.0.smithi016.stdout:1/625: read - d2/de/d4d/d92/fda zero size 2024-08-01T06:56:27.031 INFO:tasks.workunit.client.0.smithi016.stdout:5/535: dwrite d1/d2/d6/d9/d49/fa3 [0,4194304] 0 2024-08-01T06:56:27.041 INFO:tasks.workunit.client.0.smithi016.stdout:9/562: write d3/d9/df/f92 [714773,35906] 0 2024-08-01T06:56:27.043 INFO:tasks.workunit.client.0.smithi016.stdout:9/563: fsync d3/d9/df/d38/f4f 0 2024-08-01T06:56:27.044 INFO:tasks.workunit.client.0.smithi016.stdout:5/536: dwrite d1/d2/d6/d9/f6a [0,4194304] 0 2024-08-01T06:56:27.052 INFO:tasks.workunit.client.0.smithi016.stdout:4/521: dread d0/d2/f37 [0,4194304] 0 2024-08-01T06:56:27.053 INFO:tasks.workunit.client.0.smithi016.stdout:5/537: link d1/d12/c76 d1/d2/d20/db8/cb9 0 2024-08-01T06:56:27.054 INFO:tasks.workunit.client.0.smithi016.stdout:1/626: dwrite d2/f1b [0,4194304] 0 2024-08-01T06:56:27.055 INFO:tasks.workunit.client.0.smithi016.stdout:1/627: chown d2/d3/c16 90 1 2024-08-01T06:56:27.056 INFO:tasks.workunit.client.0.smithi016.stdout:1/628: readlink d2/de/d21/d3e/l77 0 2024-08-01T06:56:27.060 INFO:tasks.workunit.client.0.smithi016.stdout:9/564: write d3/d9/db/dc/d33/f6c [1249898,33290] 0 2024-08-01T06:56:27.061 INFO:tasks.workunit.client.0.smithi016.stdout:5/538: stat d1/f83 0 2024-08-01T06:56:27.062 INFO:tasks.workunit.client.0.smithi016.stdout:1/629: creat d2/de/d63/fdb x:0 0 0 2024-08-01T06:56:27.065 INFO:tasks.workunit.client.0.smithi016.stdout:4/522: dwrite d0/d2/dc/d12/d29/f8a [0,4194304] 0 2024-08-01T06:56:27.067 INFO:tasks.workunit.client.0.smithi016.stdout:9/565: truncate d3/d9/db/d3e/d40/f59 1161472 0 2024-08-01T06:56:27.067 INFO:tasks.workunit.client.0.smithi016.stdout:1/630: fsync d2/de/d4d/d92/fda 0 2024-08-01T06:56:27.071 INFO:tasks.workunit.client.0.smithi016.stdout:4/523: rmdir d0/d2/dc/d12/d29/d8f 39 2024-08-01T06:56:27.072 INFO:tasks.workunit.client.0.smithi016.stdout:1/631: truncate f0 2954409 0 2024-08-01T06:56:27.074 INFO:tasks.workunit.client.0.smithi016.stdout:4/524: chown d0/d17/f49 5 1 2024-08-01T06:56:27.074 INFO:tasks.workunit.client.0.smithi016.stdout:5/539: dwrite d1/d2/d6/d9/d49/d57/fb7 [0,4194304] 0 2024-08-01T06:56:27.084 INFO:tasks.workunit.client.0.smithi016.stdout:5/540: dread d1/d12/d8c/f90 [0,4194304] 0 2024-08-01T06:56:27.090 INFO:tasks.workunit.client.0.smithi016.stdout:1/632: creat d2/d3/d41/d49/d85/dc1/dd8/fdc x:0 0 0 2024-08-01T06:56:27.092 INFO:tasks.workunit.client.0.smithi016.stdout:1/633: chown d2/d2f/fb7 12 1 2024-08-01T06:56:27.094 INFO:tasks.workunit.client.0.smithi016.stdout:5/541: creat d1/fba x:0 0 0 2024-08-01T06:56:27.095 INFO:tasks.workunit.client.0.smithi016.stdout:1/634: creat d2/d3/d41/d49/d85/dc1/dd8/fdd x:0 0 0 2024-08-01T06:56:27.097 INFO:tasks.workunit.client.0.smithi016.stdout:9/566: truncate d3/de/f13 1124895 0 2024-08-01T06:56:27.097 INFO:tasks.workunit.client.0.smithi016.stdout:1/635: write d2/d3/d41/d49/d85/dc1/dd8/fdd [193265,58245] 0 2024-08-01T06:56:27.098 INFO:tasks.workunit.client.0.smithi016.stdout:5/542: mkdir d1/d2/d23/dbb 0 2024-08-01T06:56:27.099 INFO:tasks.workunit.client.0.smithi016.stdout:9/567: read d3/d9/d46/d48/f55 [656090,125115] 0 2024-08-01T06:56:27.099 INFO:tasks.workunit.client.0.smithi016.stdout:4/525: truncate d0/d2/fa 514717 0 2024-08-01T06:56:27.101 INFO:tasks.workunit.client.0.smithi016.stdout:4/526: read d0/d17/d22/f31 [5260526,48349] 0 2024-08-01T06:56:27.102 INFO:tasks.workunit.client.0.smithi016.stdout:1/636: mkdir d2/de/d63/dd6/dde 0 2024-08-01T06:56:27.104 INFO:tasks.workunit.client.0.smithi016.stdout:9/568: unlink d3/d9/db/dc/f74 0 2024-08-01T06:56:27.104 INFO:tasks.workunit.client.0.smithi016.stdout:5/543: dread d1/d2/d23/d3a/f58 [0,4194304] 0 2024-08-01T06:56:27.106 INFO:tasks.workunit.client.0.smithi016.stdout:1/637: symlink d2/d3/d1f/ldf 0 2024-08-01T06:56:27.107 INFO:tasks.workunit.client.0.smithi016.stdout:4/527: creat d0/d2/da0/fad x:0 0 0 2024-08-01T06:56:27.107 INFO:tasks.workunit.client.0.smithi016.stdout:1/638: dread - d2/de/d32/f91 zero size 2024-08-01T06:56:27.109 INFO:tasks.workunit.client.0.smithi016.stdout:9/569: symlink d3/d9/db/d3e/d40/d4e/lb5 0 2024-08-01T06:56:27.112 INFO:tasks.workunit.client.0.smithi016.stdout:5/544: creat d1/d2/d23/dbb/fbc x:0 0 0 2024-08-01T06:56:27.113 INFO:tasks.workunit.client.0.smithi016.stdout:4/528: getdents d0/d2/dc/d12/d29/d91/dab 0 2024-08-01T06:56:27.116 INFO:tasks.workunit.client.0.smithi016.stdout:5/545: read d1/d2/f80 [427384,53379] 0 2024-08-01T06:56:27.117 INFO:tasks.workunit.client.0.smithi016.stdout:9/570: dwrite d3/d9/db/dc/f2c [0,4194304] 0 2024-08-01T06:56:27.117 INFO:tasks.workunit.client.0.smithi016.stdout:4/529: getdents d0/d9d/da2 0 2024-08-01T06:56:27.119 INFO:tasks.workunit.client.0.smithi016.stdout:9/571: chown d3/de 10 1 2024-08-01T06:56:27.120 INFO:tasks.workunit.client.0.smithi016.stdout:9/572: fsync d3/d9/d46/f4a 0 2024-08-01T06:56:27.123 INFO:tasks.workunit.client.0.smithi016.stdout:9/573: creat d3/de/d89/fb6 x:0 0 0 2024-08-01T06:56:27.128 INFO:tasks.workunit.client.0.smithi016.stdout:9/574: mknod d3/d9/df/d16/d94/da5/cb7 0 2024-08-01T06:56:27.131 INFO:tasks.workunit.client.0.smithi016.stdout:1/639: write d2/de/f7f [2934432,53740] 0 2024-08-01T06:56:27.134 INFO:tasks.workunit.client.0.smithi016.stdout:1/640: fdatasync d2/de/d6e/f8a 0 2024-08-01T06:56:27.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:26 smithi089 ceph-mon[36617]: pgmap v27: 65 pgs: 65 active+clean; 2.1 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 43 MiB/s rd, 160 MiB/s wr, 383 op/s 2024-08-01T06:56:27.139 INFO:tasks.workunit.client.0.smithi016.stdout:1/641: truncate d2/de/fc6 6829425 0 2024-08-01T06:56:27.140 INFO:tasks.workunit.client.0.smithi016.stdout:6/674: sync 2024-08-01T06:56:27.140 INFO:tasks.workunit.client.0.smithi016.stdout:2/742: sync 2024-08-01T06:56:27.140 INFO:tasks.workunit.client.0.smithi016.stdout:0/481: sync 2024-08-01T06:56:27.140 INFO:tasks.workunit.client.0.smithi016.stdout:3/470: sync 2024-08-01T06:56:27.140 INFO:tasks.workunit.client.0.smithi016.stdout:7/542: sync 2024-08-01T06:56:27.141 INFO:tasks.workunit.client.0.smithi016.stdout:5/546: dread d1/d12/f16 [0,4194304] 0 2024-08-01T06:56:27.145 INFO:tasks.workunit.client.0.smithi016.stdout:1/642: rename d2/de/d32/d43/f8d to d2/d88/fe0 0 2024-08-01T06:56:27.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:26 smithi016 ceph-mon[29266]: pgmap v27: 65 pgs: 65 active+clean; 2.1 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 43 MiB/s rd, 160 MiB/s wr, 383 op/s 2024-08-01T06:56:27.149 INFO:tasks.workunit.client.0.smithi016.stdout:6/675: dwrite d1/d8/f11 [8388608,4194304] 0 2024-08-01T06:56:27.156 INFO:tasks.workunit.client.0.smithi016.stdout:9/575: dread d3/de/f13 [0,4194304] 0 2024-08-01T06:56:27.157 INFO:tasks.workunit.client.0.smithi016.stdout:9/576: chown d3/d9/db/d3e/d40/d4e 3 1 2024-08-01T06:56:27.158 INFO:tasks.workunit.client.0.smithi016.stdout:2/743: dread d0/d8/d1b/d74/d90/d93/f58 [0,4194304] 0 2024-08-01T06:56:27.159 INFO:tasks.workunit.client.0.smithi016.stdout:1/643: rmdir d2/de/d63/dd6 39 2024-08-01T06:56:27.159 INFO:tasks.workunit.client.0.smithi016.stdout:2/744: fdatasync d0/d16/f1f 0 2024-08-01T06:56:27.161 INFO:tasks.workunit.client.0.smithi016.stdout:7/543: truncate d7/db/d17/d72/d1c/d79/d8f/f2e 718480 0 2024-08-01T06:56:27.167 INFO:tasks.workunit.client.0.smithi016.stdout:2/745: dwrite d0/d8/d1b/dcc/d68/fc6 [0,4194304] 0 2024-08-01T06:56:27.168 INFO:tasks.workunit.client.0.smithi016.stdout:1/644: mkdir d2/d3/d1c/de1 0 2024-08-01T06:56:27.173 INFO:tasks.workunit.client.0.smithi016.stdout:5/547: link d1/d2/d6/d9/lb2 d1/d2/d6/d5a/lbd 0 2024-08-01T06:56:27.178 INFO:tasks.workunit.client.0.smithi016.stdout:3/471: getdents d9/da/df/d2a/d49 0 2024-08-01T06:56:27.179 INFO:tasks.workunit.client.0.smithi016.stdout:6/676: creat d1/ff7 x:0 0 0 2024-08-01T06:56:27.182 INFO:tasks.workunit.client.0.smithi016.stdout:1/645: rmdir d2/de/d63 39 2024-08-01T06:56:27.182 INFO:tasks.workunit.client.0.smithi016.stdout:2/746: fsync d0/d8/d1b/dcc/d68/fc6 0 2024-08-01T06:56:27.184 INFO:tasks.workunit.client.0.smithi016.stdout:2/747: write d0/d8/d1b/dcc/d3b/fa4 [256184,35087] 0 2024-08-01T06:56:27.188 INFO:tasks.workunit.client.0.smithi016.stdout:7/544: rename d7/db/d17/d72/d1c/d1d/c3e to d7/db/d17/d72/d22/d77/d99/cc8 0 2024-08-01T06:56:27.188 INFO:tasks.workunit.client.0.smithi016.stdout:9/577: creat d3/fb8 x:0 0 0 2024-08-01T06:56:27.190 INFO:tasks.workunit.client.0.smithi016.stdout:9/578: dread - d3/d9/d73/f9e zero size 2024-08-01T06:56:27.191 INFO:tasks.workunit.client.0.smithi016.stdout:1/646: symlink d2/d3/d41/le2 0 2024-08-01T06:56:27.191 INFO:tasks.workunit.client.0.smithi016.stdout:6/677: dread d1/d8/d1b/d22/d2d/f9a [0,4194304] 0 2024-08-01T06:56:27.192 INFO:tasks.workunit.client.0.smithi016.stdout:9/579: write d3/d32/d5c/d8a/f34 [1614848,120326] 0 2024-08-01T06:56:27.193 INFO:tasks.workunit.client.0.smithi016.stdout:9/580: fdatasync d3/d9/db/d3e/f7f 0 2024-08-01T06:56:27.193 INFO:tasks.workunit.client.0.smithi016.stdout:5/548: link d1/d12/fad d1/d12/d3e/fbe 0 2024-08-01T06:56:27.196 INFO:tasks.workunit.client.0.smithi016.stdout:3/472: truncate d9/da/df/d12/d20/d3c/f52 2406076 0 2024-08-01T06:56:27.197 INFO:tasks.workunit.client.0.smithi016.stdout:1/647: chown d2/de 1473302 1 2024-08-01T06:56:27.200 INFO:tasks.workunit.client.0.smithi016.stdout:6/678: fdatasync d1/d8/d1b/d22/d2d/f9a 0 2024-08-01T06:56:27.203 INFO:tasks.workunit.client.0.smithi016.stdout:7/545: symlink d7/db/d17/d72/d1e/d26/d63/dc0/lc9 0 2024-08-01T06:56:27.203 INFO:tasks.workunit.client.0.smithi016.stdout:3/473: dwrite d9/d3e/f36 [0,4194304] 0 2024-08-01T06:56:27.205 INFO:tasks.workunit.client.0.smithi016.stdout:5/549: unlink d1/d12/f9a 0 2024-08-01T06:56:27.211 INFO:tasks.workunit.client.0.smithi016.stdout:1/648: fsync d2/de/d6e/fd5 0 2024-08-01T06:56:27.213 INFO:tasks.workunit.client.0.smithi016.stdout:6/679: mknod d1/d8/d1b/d22/d71/cf8 0 2024-08-01T06:56:27.217 INFO:tasks.workunit.client.0.smithi016.stdout:9/581: creat d3/d9/db/dc/d56/d9b/fb9 x:0 0 0 2024-08-01T06:56:27.221 INFO:tasks.workunit.client.0.smithi016.stdout:1/649: symlink d2/d2f/dba/le3 0 2024-08-01T06:56:27.221 INFO:tasks.workunit.client.0.smithi016.stdout:3/474: mkdir d9/da/df/d12/da0 0 2024-08-01T06:56:27.222 INFO:tasks.workunit.client.0.smithi016.stdout:1/650: readlink d2/d3/d1a/d22/lc7 0 2024-08-01T06:56:27.227 INFO:tasks.workunit.client.0.smithi016.stdout:3/475: write d9/da/f47 [4654142,10481] 0 2024-08-01T06:56:27.228 INFO:tasks.workunit.client.0.smithi016.stdout:6/680: mknod d1/d8/d1b/db5/d67/d8f/dba/dbd/cf9 0 2024-08-01T06:56:27.229 INFO:tasks.workunit.client.0.smithi016.stdout:6/681: chown d1/d41/f6c 181954911 1 2024-08-01T06:56:27.229 INFO:tasks.workunit.client.0.smithi016.stdout:6/682: chown d1/d41 1 1 2024-08-01T06:56:27.229 INFO:tasks.workunit.client.0.smithi016.stdout:7/546: creat d7/db/d17/d72/d1c/d1d/fca x:0 0 0 2024-08-01T06:56:27.230 INFO:tasks.workunit.client.0.smithi016.stdout:5/550: rmdir d1/d12/d3e/db4 0 2024-08-01T06:56:27.231 INFO:tasks.workunit.client.0.smithi016.stdout:7/547: fdatasync d7/db/d17/d72/d22/db4/fbd 0 2024-08-01T06:56:27.238 INFO:tasks.workunit.client.0.smithi016.stdout:6/683: dwrite d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/f7c [0,4194304] 0 2024-08-01T06:56:27.239 INFO:tasks.workunit.client.0.smithi016.stdout:7/548: symlink d7/lcb 0 2024-08-01T06:56:27.239 INFO:tasks.workunit.client.0.smithi016.stdout:5/551: creat d1/d2/d6/d9/d49/fbf x:0 0 0 2024-08-01T06:56:27.240 INFO:tasks.workunit.client.0.smithi016.stdout:5/552: fdatasync d1/d2/d6/d9/f6a 0 2024-08-01T06:56:27.242 INFO:tasks.workunit.client.0.smithi016.stdout:5/553: stat d1/d12/d3e/l4a 0 2024-08-01T06:56:27.244 INFO:tasks.workunit.client.0.smithi016.stdout:9/582: getdents d3/d9/db/d3e/d40/d4e 0 2024-08-01T06:56:27.245 INFO:tasks.workunit.client.0.smithi016.stdout:5/554: truncate d1/d12/d3e/fbe 403838 0 2024-08-01T06:56:27.250 INFO:tasks.workunit.client.0.smithi016.stdout:6/684: mknod d1/d8/d1b/d22/cfa 0 2024-08-01T06:56:27.252 INFO:tasks.workunit.client.0.smithi016.stdout:1/651: dwrite d2/f2a [0,4194304] 0 2024-08-01T06:56:27.252 INFO:tasks.workunit.client.0.smithi016.stdout:9/583: creat d3/de/dae/fba x:0 0 0 2024-08-01T06:56:27.252 INFO:tasks.workunit.client.0.smithi016.stdout:3/476: dwrite d9/da/df/d12/d20/f35 [0,4194304] 0 2024-08-01T06:56:27.256 INFO:tasks.workunit.client.0.smithi016.stdout:3/477: truncate d9/f7c 335676 0 2024-08-01T06:56:27.261 INFO:tasks.workunit.client.0.smithi016.stdout:5/555: unlink d1/d12/d3e/la5 0 2024-08-01T06:56:27.265 INFO:tasks.workunit.client.0.smithi016.stdout:6/685: write d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/fe3 [196957,61850] 0 2024-08-01T06:56:27.291 INFO:tasks.workunit.client.0.smithi016.stdout:3/478: creat d9/da/df/d12/fa1 x:0 0 0 2024-08-01T06:56:27.291 INFO:tasks.workunit.client.0.smithi016.stdout:7/549: link d7/db/d17/d72/d22/l57 d7/db/d17/d72/d22/d77/lcc 0 2024-08-01T06:56:27.292 INFO:tasks.workunit.client.0.smithi016.stdout:1/652: link d2/de/d4d/c67 d2/d2f/d97/ce4 0 2024-08-01T06:56:27.293 INFO:tasks.workunit.client.0.smithi016.stdout:7/550: read d7/db/d17/d72/d1c/f9a [2142477,52960] 0 2024-08-01T06:56:27.297 INFO:tasks.workunit.client.0.smithi016.stdout:3/479: dwrite d9/da/d96/f9e [0,4194304] 0 2024-08-01T06:56:27.394 INFO:tasks.workunit.client.0.smithi016.stdout:1/653: creat d2/d3/d41/d49/d51/fe5 x:0 0 0 2024-08-01T06:56:27.395 INFO:tasks.workunit.client.0.smithi016.stdout:1/654: fsync d2/d3/d1c/fa6 0 2024-08-01T06:56:27.395 INFO:tasks.workunit.client.0.smithi016.stdout:1/655: stat d2/cce 0 2024-08-01T06:56:27.395 INFO:tasks.workunit.client.0.smithi016.stdout:1/656: chown d2/d3/d48 1538273 1 2024-08-01T06:56:27.427 INFO:tasks.workunit.client.0.smithi016.stdout:8/449: sync 2024-08-01T06:56:27.429 INFO:tasks.workunit.client.0.smithi016.stdout:7/551: rename d7/db/f13 to d7/db/d17/d72/d1c/d1d/d40/d58/da3/fcd 0 2024-08-01T06:56:27.431 INFO:tasks.workunit.client.0.smithi016.stdout:7/552: write d7/db/d17/d72/d22/fc2 [845507,60872] 0 2024-08-01T06:56:27.433 INFO:tasks.workunit.client.0.smithi016.stdout:1/657: symlink d2/d3/d1c/le6 0 2024-08-01T06:56:27.438 INFO:tasks.workunit.client.0.smithi016.stdout:5/556: write d1/d12/f16 [2359905,1507] 0 2024-08-01T06:56:27.440 INFO:tasks.workunit.client.0.smithi016.stdout:9/584: truncate d3/f6a 93187 0 2024-08-01T06:56:27.447 INFO:tasks.workunit.client.0.smithi016.stdout:3/480: rename d9/da/df/d12/l28 to d9/d3e/d40/d58/d59/la2 0 2024-08-01T06:56:27.447 INFO:tasks.workunit.client.0.smithi016.stdout:6/686: truncate d1/d8/d1b/db5/d67/fb3 2446704 0 2024-08-01T06:56:27.448 INFO:tasks.workunit.client.0.smithi016.stdout:1/658: dwrite d2/de/d32/fc8 [0,4194304] 0 2024-08-01T06:56:27.452 INFO:tasks.workunit.client.0.smithi016.stdout:7/553: dread d7/db/d17/d72/d1c/d1d/d40/f73 [0,4194304] 0 2024-08-01T06:56:27.452 INFO:tasks.workunit.client.0.smithi016.stdout:1/659: truncate d2/d3/d41/d49/d51/fe5 788423 0 2024-08-01T06:56:27.452 INFO:tasks.workunit.client.0.smithi016.stdout:5/557: symlink d1/d2/d20/d38/lc0 0 2024-08-01T06:56:27.454 INFO:tasks.workunit.client.0.smithi016.stdout:9/585: rmdir d3/d9/db/d3e 39 2024-08-01T06:56:27.457 INFO:tasks.workunit.client.0.smithi016.stdout:3/481: chown d9/d1c/c44 1822992282 1 2024-08-01T06:56:27.458 INFO:tasks.workunit.client.0.smithi016.stdout:9/586: fsync d3/d9/d73/f9e 0 2024-08-01T06:56:27.461 INFO:tasks.workunit.client.0.smithi016.stdout:6/687: dwrite d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/dbc/fc4 [0,4194304] 0 2024-08-01T06:56:27.461 INFO:tasks.workunit.client.0.smithi016.stdout:9/587: chown d3/d9/db/dc 71490 1 2024-08-01T06:56:27.462 INFO:tasks.workunit.client.0.smithi016.stdout:3/482: write d9/fd [3885397,48396] 0 2024-08-01T06:56:27.463 INFO:tasks.workunit.client.0.smithi016.stdout:1/660: rename d2/de/d6e/cb8 to d2/d3/d41/ce7 0 2024-08-01T06:56:27.467 INFO:tasks.workunit.client.0.smithi016.stdout:7/554: fsync d7/db/d17/d72/d1c/d79/d8f/fc5 0 2024-08-01T06:56:27.469 INFO:tasks.workunit.client.0.smithi016.stdout:8/450: write d5/d8/d1a/d24/d48/d60/d63/f91 [834257,28349] 0 2024-08-01T06:56:27.473 INFO:tasks.workunit.client.0.smithi016.stdout:3/483: symlink d9/d57/d66/la3 0 2024-08-01T06:56:27.476 INFO:tasks.workunit.client.0.smithi016.stdout:6/688: dread d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/dbc/fc4 [0,4194304] 0 2024-08-01T06:56:27.476 INFO:tasks.workunit.client.0.smithi016.stdout:9/588: dwrite d3/de/f18 [4194304,4194304] 0 2024-08-01T06:56:27.482 INFO:tasks.workunit.client.0.smithi016.stdout:7/555: rmdir d7/db/d17/d72/d1c/d1d/d40/d58/da3 39 2024-08-01T06:56:27.489 INFO:tasks.workunit.client.0.smithi016.stdout:5/558: link d1/d2/d6/d5a/l41 d1/d2/d20/d68/lc1 0 2024-08-01T06:56:27.491 INFO:tasks.workunit.client.0.smithi016.stdout:6/689: rename d1/d8/d1b/d22/c58 to d1/d8/d1b/d22/d2d/cfb 0 2024-08-01T06:56:27.492 INFO:tasks.workunit.client.0.smithi016.stdout:1/661: dwrite d2/d2f/f87 [0,4194304] 0 2024-08-01T06:56:27.497 INFO:tasks.workunit.client.0.smithi016.stdout:5/559: dread - d1/d2/d20/d72/f9b zero size 2024-08-01T06:56:27.499 INFO:tasks.workunit.client.0.smithi016.stdout:5/560: truncate d1/d12/d3e/fb6 197369 0 2024-08-01T06:56:27.499 INFO:tasks.workunit.client.0.smithi016.stdout:7/556: mknod d7/db/d17/d72/d1e/d26/cce 0 2024-08-01T06:56:27.504 INFO:tasks.workunit.client.0.smithi016.stdout:8/451: link d5/d8/d1a/d59/f5c d5/d8/d1a/d24/d48/f97 0 2024-08-01T06:56:27.508 INFO:tasks.workunit.client.0.smithi016.stdout:1/662: symlink d2/de/le8 0 2024-08-01T06:56:27.511 INFO:tasks.workunit.client.0.smithi016.stdout:8/452: write d5/dc/d3e/f73 [4218202,8538] 0 2024-08-01T06:56:27.512 INFO:tasks.workunit.client.0.smithi016.stdout:9/589: getdents d3/d9/df 0 2024-08-01T06:56:27.515 INFO:tasks.workunit.client.0.smithi016.stdout:7/557: mkdir d7/db/d17/d72/d1e/d26/d2a/db5/dcf 0 2024-08-01T06:56:27.520 INFO:tasks.workunit.client.0.smithi016.stdout:5/561: dwrite d1/f3c [0,4194304] 0 2024-08-01T06:56:27.523 INFO:tasks.workunit.client.0.smithi016.stdout:6/690: dwrite d1/d8/d1b/db5/d67/fb3 [0,4194304] 0 2024-08-01T06:56:27.525 INFO:tasks.workunit.client.0.smithi016.stdout:1/663: creat d2/d3/d41/d49/fe9 x:0 0 0 2024-08-01T06:56:27.528 INFO:tasks.workunit.client.0.smithi016.stdout:9/590: rename d3/d9/db/d3e/d40/d4e/l9d to d3/d9/d46/d48/lbb 0 2024-08-01T06:56:27.530 INFO:tasks.workunit.client.0.smithi016.stdout:5/562: creat d1/d2/d20/d68/fc2 x:0 0 0 2024-08-01T06:56:27.530 INFO:tasks.workunit.client.0.smithi016.stdout:9/591: chown d3/d9/db/dc/d56/f86 18079 1 2024-08-01T06:56:27.533 INFO:tasks.workunit.client.0.smithi016.stdout:7/558: creat d7/db3/fd0 x:0 0 0 2024-08-01T06:56:27.534 INFO:tasks.workunit.client.0.smithi016.stdout:1/664: creat d2/d3/d1a/d22/fea x:0 0 0 2024-08-01T06:56:27.537 INFO:tasks.workunit.client.0.smithi016.stdout:9/592: creat d3/d9/db/dc/fbc x:0 0 0 2024-08-01T06:56:27.540 INFO:tasks.workunit.client.0.smithi016.stdout:9/593: write d3/de/d89/f8d [2632830,32347] 0 2024-08-01T06:56:27.540 INFO:tasks.workunit.client.0.smithi016.stdout:8/453: dread d5/dc/f17 [0,4194304] 0 2024-08-01T06:56:27.541 INFO:tasks.workunit.client.0.smithi016.stdout:6/691: rmdir d1/d8/d94/ddc 0 2024-08-01T06:56:27.541 INFO:tasks.workunit.client.0.smithi016.stdout:9/594: dread - d3/d32/d5c/d8a/d57/f9a zero size 2024-08-01T06:56:27.542 INFO:tasks.workunit.client.0.smithi016.stdout:6/692: write d1/d41/f61 [1438052,3223] 0 2024-08-01T06:56:27.543 INFO:tasks.workunit.client.0.smithi016.stdout:7/559: mkdir d7/db/d17/d72/d22/d77/d99/dd1 0 2024-08-01T06:56:27.549 INFO:tasks.workunit.client.0.smithi016.stdout:1/665: link d2/d2f/f75 d2/de/d32/feb 0 2024-08-01T06:56:27.553 INFO:tasks.workunit.client.0.smithi016.stdout:5/563: link d1/d12/d52/c67 d1/d2/d6/d9/d19/d7a/cc3 0 2024-08-01T06:56:27.554 INFO:tasks.workunit.client.0.smithi016.stdout:7/560: rmdir d7/db/d17/d72/d22/db4 39 2024-08-01T06:56:27.555 INFO:tasks.workunit.client.0.smithi016.stdout:7/561: write d7/db/d17/d72/d1c/d1d/f60 [5200036,116793] 0 2024-08-01T06:56:27.557 INFO:tasks.workunit.client.0.smithi016.stdout:1/666: write d2/f12 [331372,120400] 0 2024-08-01T06:56:27.569 INFO:tasks.workunit.client.0.smithi016.stdout:7/562: mknod d7/db/d17/d72/cd2 0 2024-08-01T06:56:27.570 INFO:tasks.workunit.client.0.smithi016.stdout:1/667: symlink d2/d3/d1c/de1/lec 0 2024-08-01T06:56:27.570 INFO:tasks.workunit.client.0.smithi016.stdout:6/693: dwrite d1/f5 [0,4194304] 0 2024-08-01T06:56:27.571 INFO:tasks.workunit.client.0.smithi016.stdout:9/595: dwrite d3/d32/f36 [0,4194304] 0 2024-08-01T06:56:27.571 INFO:tasks.workunit.client.0.smithi016.stdout:5/564: link d1/d2/l35 d1/d2/d6/d5a/lc4 0 2024-08-01T06:56:27.572 INFO:tasks.workunit.client.0.smithi016.stdout:7/563: dread - d7/db3/fd0 zero size 2024-08-01T06:56:27.574 INFO:tasks.workunit.client.0.smithi016.stdout:8/454: link d5/dc/l77 d5/d8/d1a/l98 0 2024-08-01T06:56:27.575 INFO:tasks.workunit.client.0.smithi016.stdout:1/668: creat d2/d3/d48/fed x:0 0 0 2024-08-01T06:56:27.578 INFO:tasks.workunit.client.0.smithi016.stdout:1/669: write d2/d3/d1a/d22/f76 [9385250,44607] 0 2024-08-01T06:56:27.578 INFO:tasks.workunit.client.0.smithi016.stdout:9/596: symlink d3/d9/db/d3a/lbd 0 2024-08-01T06:56:27.585 INFO:tasks.workunit.client.0.smithi016.stdout:5/565: mkdir d1/d2/d6/d9/d19/d7a/dc5 0 2024-08-01T06:56:27.588 INFO:tasks.workunit.client.0.smithi016.stdout:5/566: dread d1/d2/d23/d3a/f58 [0,4194304] 0 2024-08-01T06:56:27.589 INFO:tasks.workunit.client.0.smithi016.stdout:1/670: rename d2/de/d4d/cd2 to d2/d3/d1c/de1/cee 0 2024-08-01T06:56:27.589 INFO:tasks.workunit.client.0.smithi016.stdout:4/530: sync 2024-08-01T06:56:27.590 INFO:tasks.workunit.client.0.smithi016.stdout:4/531: readlink d0/d2/dc/l10 0 2024-08-01T06:56:27.592 INFO:tasks.workunit.client.0.smithi016.stdout:9/597: creat d3/d9/db/dc/d56/d9b/fbe x:0 0 0 2024-08-01T06:56:27.593 INFO:tasks.workunit.client.0.smithi016.stdout:6/694: creat d1/d8/d1b/d48/dd9/ffc x:0 0 0 2024-08-01T06:56:27.595 INFO:tasks.workunit.client.0.smithi016.stdout:7/564: mkdir d7/db/d17/d72/d1c/d79/d8f/dd3 0 2024-08-01T06:56:27.597 INFO:tasks.workunit.client.0.smithi016.stdout:5/567: symlink d1/d2/d23/d3a/lc6 0 2024-08-01T06:56:27.598 INFO:tasks.workunit.client.0.smithi016.stdout:9/598: readlink d3/d9/df/d16/d94/lac 0 2024-08-01T06:56:27.598 INFO:tasks.workunit.client.0.smithi016.stdout:7/565: read - d7/db/d17/d72/d1c/fbf zero size 2024-08-01T06:56:27.603 INFO:tasks.workunit.client.0.smithi016.stdout:4/532: symlink d0/d17/d22/d26/d85/lae 0 2024-08-01T06:56:27.608 INFO:tasks.workunit.client.0.smithi016.stdout:8/455: dwrite d5/dc/f31 [0,4194304] 0 2024-08-01T06:56:27.613 INFO:tasks.workunit.client.0.smithi016.stdout:6/695: dwrite d1/d8/d1b/f50 [4194304,4194304] 0 2024-08-01T06:56:27.613 INFO:tasks.workunit.client.0.smithi016.stdout:7/566: write d7/db/d17/d72/d1c/d1d/d40/d7f/f90 [1070396,36423] 0 2024-08-01T06:56:27.614 INFO:tasks.workunit.client.0.smithi016.stdout:5/568: rmdir d1/d2/d6/d9/d19/d7a 39 2024-08-01T06:56:27.622 INFO:tasks.workunit.client.0.smithi016.stdout:5/569: readlink d1/d2/d6/d9/d19/d7a/l8a 0 2024-08-01T06:56:27.623 INFO:tasks.workunit.client.0.smithi016.stdout:5/570: readlink d1/d2/d6/d9/d19/l79 0 2024-08-01T06:56:27.624 INFO:tasks.workunit.client.0.smithi016.stdout:8/456: mkdir d5/d8/d1a/d24/d48/d6e/d92/d99 0 2024-08-01T06:56:27.627 INFO:tasks.workunit.client.0.smithi016.stdout:1/671: link d2/d3/d48/c55 d2/de/d21/d3e/dc3/cef 0 2024-08-01T06:56:27.627 INFO:tasks.workunit.client.0.smithi016.stdout:6/696: dread d1/d8/f2a [0,4194304] 0 2024-08-01T06:56:27.631 INFO:tasks.workunit.client.0.smithi016.stdout:8/457: unlink d5/d1c/c55 0 2024-08-01T06:56:27.633 INFO:tasks.workunit.client.0.smithi016.stdout:7/567: creat d7/fd4 x:0 0 0 2024-08-01T06:56:27.636 INFO:tasks.workunit.client.0.smithi016.stdout:6/697: mkdir d1/d43/d88/de5/dfd 0 2024-08-01T06:56:27.636 INFO:tasks.workunit.client.0.smithi016.stdout:8/458: symlink d5/dc/l9a 0 2024-08-01T06:56:27.642 INFO:tasks.workunit.client.0.smithi016.stdout:8/459: creat d5/d8/d75/f9b x:0 0 0 2024-08-01T06:56:27.645 INFO:tasks.workunit.client.0.smithi016.stdout:6/698: creat d1/d8/d1b/dec/ffe x:0 0 0 2024-08-01T06:56:27.646 INFO:tasks.workunit.client.0.smithi016.stdout:9/599: truncate d3/d9/df/d2a/f3b 2375371 0 2024-08-01T06:56:27.647 INFO:tasks.workunit.client.0.smithi016.stdout:1/672: dread d2/d3/d41/d49/f99 [0,4194304] 0 2024-08-01T06:56:27.648 INFO:tasks.workunit.client.0.smithi016.stdout:4/533: truncate d0/d2/dc/d12/d29/d3c/f55 5527229 0 2024-08-01T06:56:27.655 INFO:tasks.workunit.client.0.smithi016.stdout:1/673: rmdir d2/d2f/d97 39 2024-08-01T06:56:27.658 INFO:tasks.workunit.client.0.smithi016.stdout:4/534: chown d0/d2/dc/d12/d29/d8f 27381815 1 2024-08-01T06:56:27.661 INFO:tasks.workunit.client.0.smithi016.stdout:7/568: rename d7/db/d17/d72/d1c/d1d/d6d/fa5 to d7/db/d17/d72/fd5 0 2024-08-01T06:56:27.661 INFO:tasks.workunit.client.0.smithi016.stdout:9/600: dwrite d3/d9/db/dc/d56/d9b/fbe [0,4194304] 0 2024-08-01T06:56:27.664 INFO:tasks.workunit.client.0.smithi016.stdout:8/460: dread d5/d8/d1a/d24/f4e [0,4194304] 0 2024-08-01T06:56:27.668 INFO:tasks.workunit.client.0.smithi016.stdout:4/535: rmdir d0/d2 39 2024-08-01T06:56:27.672 INFO:tasks.workunit.client.0.smithi016.stdout:6/699: rename d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d8e/dcf/c6e to d1/d8/d1b/d48/cff 0 2024-08-01T06:56:27.672 INFO:tasks.workunit.client.0.smithi016.stdout:6/700: chown d1/d43 248063657 1 2024-08-01T06:56:27.677 INFO:tasks.workunit.client.0.smithi016.stdout:9/601: creat d3/de/d89/fbf x:0 0 0 2024-08-01T06:56:27.678 INFO:tasks.workunit.client.0.smithi016.stdout:7/569: creat d7/db/d17/d72/d1c/d97/fd6 x:0 0 0 2024-08-01T06:56:27.681 INFO:tasks.workunit.client.0.smithi016.stdout:8/461: read d5/d8/d1a/d24/f2b [893991,26705] 0 2024-08-01T06:56:27.681 INFO:tasks.workunit.client.0.smithi016.stdout:6/701: dwrite d1/d41/fb6 [0,4194304] 0 2024-08-01T06:56:27.681 INFO:tasks.workunit.client.0.smithi016.stdout:7/570: dread - d7/db/d17/d4e/f93 zero size 2024-08-01T06:56:27.685 INFO:tasks.workunit.client.0.smithi016.stdout:7/571: readlink d7/db/d17/d72/d1e/d26/d63/l84 0 2024-08-01T06:56:27.686 INFO:tasks.workunit.client.0.smithi016.stdout:7/572: fdatasync d7/db/d17/d72/d1c/d1d/fca 0 2024-08-01T06:56:27.687 INFO:tasks.workunit.client.0.smithi016.stdout:8/462: readlink d5/dc/l77 0 2024-08-01T06:56:27.689 INFO:tasks.workunit.client.0.smithi016.stdout:8/463: write d5/d8/d75/f9b [628763,41067] 0 2024-08-01T06:56:27.690 INFO:tasks.workunit.client.0.smithi016.stdout:6/702: unlink d1/d43/f6d 0 2024-08-01T06:56:27.690 INFO:tasks.workunit.client.0.smithi016.stdout:8/464: fdatasync d5/d8/d1a/d24/d48/d69/f78 0 2024-08-01T06:56:27.692 INFO:tasks.workunit.client.0.smithi016.stdout:1/674: getdents d2/de/d4d 0 2024-08-01T06:56:27.693 INFO:tasks.workunit.client.0.smithi016.stdout:1/675: readlink d2/d2f/dba/lca 0 2024-08-01T06:56:27.696 INFO:tasks.workunit.client.0.smithi016.stdout:4/536: read d0/d2/dc/f34 [406856,84617] 0 2024-08-01T06:56:27.701 INFO:tasks.workunit.client.0.smithi016.stdout:8/465: mknod d5/d8/d1a/d24/c9c 0 2024-08-01T06:56:27.704 INFO:tasks.workunit.client.0.smithi016.stdout:4/537: dwrite d0/d17/d38/f7c [0,4194304] 0 2024-08-01T06:56:27.705 INFO:tasks.workunit.client.0.smithi016.stdout:4/538: readlink d0/d17/d22/d26/d85/lae 0 2024-08-01T06:56:27.710 INFO:tasks.workunit.client.0.smithi016.stdout:7/573: rename d7/db/d17/d72/d1c/d1d/d40/d58/da3/fbb to d7/db/d17/d72/d1e/d26/d2a/db5/dcf/fd7 0 2024-08-01T06:56:27.711 INFO:tasks.workunit.client.0.smithi016.stdout:9/602: getdents d3/d9/db/dc 0 2024-08-01T06:56:27.716 INFO:tasks.workunit.client.0.smithi016.stdout:7/574: write d7/db/d17/d72/fd5 [980932,90899] 0 2024-08-01T06:56:27.721 INFO:tasks.workunit.client.0.smithi016.stdout:9/603: unlink d3/d9/db/dc/d33/l97 0 2024-08-01T06:56:27.722 INFO:tasks.workunit.client.0.smithi016.stdout:1/676: rename d2/d3/lbf to d2/de/d63/lf0 0 2024-08-01T06:56:27.725 INFO:tasks.workunit.client.0.smithi016.stdout:4/539: rename d0/d2/f25 to d0/d17/d22/d26/d8b/faf 0 2024-08-01T06:56:27.727 INFO:tasks.workunit.client.0.smithi016.stdout:8/466: write d5/d8/d1a/d24/d48/d60/d63/f71 [742058,129866] 0 2024-08-01T06:56:27.728 INFO:tasks.workunit.client.0.smithi016.stdout:1/677: mkdir d2/d3/d41/d49/d85/df1 0 2024-08-01T06:56:27.733 INFO:tasks.workunit.client.0.smithi016.stdout:9/604: rename d3/d9/db/dc/f2c to d3/d9/df/d2a/fc0 0 2024-08-01T06:56:27.734 INFO:tasks.workunit.client.0.smithi016.stdout:9/605: chown d3/d9/db/c3f 245 1 2024-08-01T06:56:27.735 INFO:tasks.workunit.client.0.smithi016.stdout:7/575: creat d7/db/d17/d72/d1c/d79/d8f/fd8 x:0 0 0 2024-08-01T06:56:27.736 INFO:tasks.workunit.client.0.smithi016.stdout:8/467: unlink d5/d8/d1a/d24/d6a/l74 0 2024-08-01T06:56:27.736 INFO:tasks.workunit.client.0.smithi016.stdout:7/576: write d7/db/d17/d72/d1c/d79/d8f/fd8 [402793,104080] 0 2024-08-01T06:56:27.739 INFO:tasks.workunit.client.0.smithi016.stdout:1/678: fsync d2/de/d4d/f8e 0 2024-08-01T06:56:27.744 INFO:tasks.workunit.client.0.smithi016.stdout:1/679: dread d2/d3/d1c/f36 [0,4194304] 0 2024-08-01T06:56:27.745 INFO:tasks.workunit.client.0.smithi016.stdout:1/680: chown d2/d2f/dba/la3 2465874 1 2024-08-01T06:56:27.747 INFO:tasks.workunit.client.0.smithi016.stdout:4/540: write d0/d2/dc/d12/d29/f6c [2484908,78791] 0 2024-08-01T06:56:27.749 INFO:tasks.workunit.client.0.smithi016.stdout:9/606: creat d3/d9/db/dc/d33/fc1 x:0 0 0 2024-08-01T06:56:27.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.748+0000 7f5beb37c640 1 -- 172.21.15.16:0/2360437911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be40ffc80 msgr2=0x7f5be4100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:27.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.748+0000 7f5beb37c640 1 --2- 172.21.15.16:0/2360437911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be40ffc80 0x7f5be4100100 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009880 tx=0x7f5bd402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:56:27.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.748+0000 7f5beb37c640 1 -- 172.21.15.16:0/2360437911 shutdown_connections 2024-08-01T06:56:27.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.748+0000 7f5beb37c640 1 --2- 172.21.15.16:0/2360437911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be40ffc80 0x7f5be4100100 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:27.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.748+0000 7f5beb37c640 1 --2- 172.21.15.16:0/2360437911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5be40fea80 0x7f5be40fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:27.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.748+0000 7f5beb37c640 1 -- 172.21.15.16:0/2360437911 >> 172.21.15.16:0/2360437911 conn(0x7f5be40fa230 msgr2=0x7f5be40fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:56:27.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.749+0000 7f5beb37c640 1 -- 172.21.15.16:0/2360437911 shutdown_connections 2024-08-01T06:56:27.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.749+0000 7f5beb37c640 1 -- 172.21.15.16:0/2360437911 wait complete. 2024-08-01T06:56:27.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.749+0000 7f5beb37c640 1 Processor -- start 2024-08-01T06:56:27.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.750+0000 7f5beb37c640 1 -- start start 2024-08-01T06:56:27.751 INFO:tasks.workunit.client.0.smithi016.stdout:7/577: readlink d7/db/d17/d72/d22/d77/lb1 0 2024-08-01T06:56:27.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.750+0000 7f5beb37c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be40fea80 0x7f5be40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:27.752 INFO:tasks.workunit.client.0.smithi016.stdout:9/607: read d3/d9/db/dc/d33/f51 [3811422,121997] 0 2024-08-01T06:56:27.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.750+0000 7f5beb37c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5be40ffc80 0x7f5be4068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:27.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.750+0000 7f5beb37c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40710d0 con 0x7f5be40fea80 2024-08-01T06:56:27.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.750+0000 7f5beb37c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be4071240 con 0x7f5be40ffc80 2024-08-01T06:56:27.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.750+0000 7f5be9118640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be40fea80 0x7f5be40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:27.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.750+0000 7f5be8917640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5be40ffc80 0x7f5be4068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:27.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.750+0000 7f5be9118640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be40fea80 0x7f5be40689c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42996/0 (socket says 172.21.15.16:42996) 2024-08-01T06:56:27.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.750+0000 7f5be8917640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5be40ffc80 0x7f5be4068f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:59904/0 (socket says 172.21.15.16:59904) 2024-08-01T06:56:27.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.750+0000 7f5be9118640 1 -- 172.21.15.16:0/2138271372 learned_addr learned my addr 172.21.15.16:0/2138271372 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:56:27.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.751+0000 7f5be9118640 1 -- 172.21.15.16:0/2138271372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5be40ffc80 msgr2=0x7f5be4068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:27.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.751+0000 7f5be9118640 1 --2- 172.21.15.16:0/2138271372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5be40ffc80 0x7f5be4068f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:27.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.751+0000 7f5be9118640 1 -- 172.21.15.16:0/2138271372 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd4009560 con 0x7f5be40fea80 2024-08-01T06:56:27.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.751+0000 7f5be8917640 1 --2- 172.21.15.16:0/2138271372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5be40ffc80 0x7f5be4068f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T06:56:27.754 INFO:tasks.workunit.client.0.smithi016.stdout:7/578: chown d7/db/dc7/fba 106 1 2024-08-01T06:56:27.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.751+0000 7f5be9118640 1 --2- 172.21.15.16:0/2138271372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be40fea80 0x7f5be40689c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5be000e940 tx=0x7f5be000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:56:27.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.752+0000 7f5bda7fc640 1 -- 172.21.15.16:0/2138271372 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5be00096e0 con 0x7f5be40fea80 2024-08-01T06:56:27.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.752+0000 7f5bda7fc640 1 -- 172.21.15.16:0/2138271372 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5be00044f0 con 0x7f5be40fea80 2024-08-01T06:56:27.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.752+0000 7f5bda7fc640 1 -- 172.21.15.16:0/2138271372 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5be0010430 con 0x7f5be40fea80 2024-08-01T06:56:27.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.752+0000 7f5beb37c640 1 -- 172.21.15.16:0/2138271372 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be40714c0 con 0x7f5be40fea80 2024-08-01T06:56:27.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.752+0000 7f5beb37c640 1 -- 172.21.15.16:0/2138271372 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be4071a60 con 0x7f5be40fea80 2024-08-01T06:56:27.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.753+0000 7f5beb37c640 1 -- 172.21.15.16:0/2138271372 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be40fee80 con 0x7f5be40fea80 2024-08-01T06:56:27.756 INFO:tasks.workunit.client.0.smithi016.stdout:8/468: creat d5/d8/d1a/d24/d48/d6e/d92/d99/f9d x:0 0 0 2024-08-01T06:56:27.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.754+0000 7f5bda7fc640 1 -- 172.21.15.16:0/2138271372 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) v1 ==== 91559+0+0 (secure 0 0 0) 0x7f5be00106a0 con 0x7f5be40fea80 2024-08-01T06:56:27.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.755+0000 7f5bda7fc640 1 --2- 172.21.15.16:0/2138271372 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f5bd006d660 0x7f5bd006fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:27.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.755+0000 7f5bda7fc640 1 -- 172.21.15.16:0/2138271372 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f5be0014070 con 0x7f5be40fea80 2024-08-01T06:56:27.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.755+0000 7f5be8917640 1 --2- 172.21.15.16:0/2138271372 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f5bd006d660 0x7f5bd006fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:27.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.756+0000 7f5be8917640 1 --2- 172.21.15.16:0/2138271372 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f5bd006d660 0x7f5bd006fb20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4000c00 tx=0x7f5bd40314e0 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:56:27.759 INFO:tasks.workunit.client.0.smithi016.stdout:1/681: creat d2/de/d63/ff2 x:0 0 0 2024-08-01T06:56:27.761 INFO:tasks.workunit.client.0.smithi016.stdout:4/541: creat d0/d17/d22/fb0 x:0 0 0 2024-08-01T06:56:27.762 INFO:tasks.workunit.client.0.smithi016.stdout:7/579: mkdir d7/db/d17/d72/d1c/d79/d8f/d39/d71/dd9 0 2024-08-01T06:56:27.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:27.765+0000 7f5bda7fc640 1 -- 172.21.15.16:0/2138271372 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f5be0056d00 con 0x7f5be40fea80 2024-08-01T06:56:27.766 INFO:tasks.workunit.client.0.smithi016.stdout:9/608: dwrite d3/de/d89/fa9 [0,4194304] 0 2024-08-01T06:56:27.768 INFO:tasks.workunit.client.0.smithi016.stdout:8/469: dwrite d5/d8/d1a/d24/d48/d60/d63/f91 [0,4194304] 0 2024-08-01T06:56:27.768 INFO:tasks.workunit.client.0.smithi016.stdout:4/542: mkdir d0/d2/dc/d12/d29/db1 0 2024-08-01T06:56:27.773 INFO:tasks.workunit.client.0.smithi016.stdout:4/543: truncate d0/d2/dc/d12/d29/d8f/faa 2131110 0 2024-08-01T06:56:27.782 INFO:tasks.workunit.client.0.smithi016.stdout:4/544: dwrite d0/d17/d22/fb0 [0,4194304] 0 2024-08-01T06:56:27.784 INFO:tasks.workunit.client.0.smithi016.stdout:0/482: sync 2024-08-01T06:56:27.792 INFO:tasks.workunit.client.0.smithi016.stdout:9/609: symlink d3/d9/df/d16/lc2 0 2024-08-01T06:56:27.796 INFO:tasks.workunit.client.0.smithi016.stdout:8/470: fsync d5/d8/f58 0 2024-08-01T06:56:27.800 INFO:tasks.workunit.client.0.smithi016.stdout:4/545: mknod d0/d17/d22/d26/da3/cb2 0 2024-08-01T06:56:27.801 INFO:tasks.workunit.client.0.smithi016.stdout:0/483: mknod d10/d11/d37/d58/c98 0 2024-08-01T06:56:27.804 INFO:tasks.workunit.client.0.smithi016.stdout:9/610: symlink d3/d9/db/dc/lc3 0 2024-08-01T06:56:27.805 INFO:tasks.workunit.client.0.smithi016.stdout:1/682: write d2/f17 [2171089,115527] 0 2024-08-01T06:56:27.809 INFO:tasks.workunit.client.0.smithi016.stdout:4/546: creat d0/d2/da0/fb3 x:0 0 0 2024-08-01T06:56:27.811 INFO:tasks.workunit.client.0.smithi016.stdout:0/484: rename d10/d11/f4d to d10/d11/d37/d50/f99 0 2024-08-01T06:56:27.815 INFO:tasks.workunit.client.0.smithi016.stdout:1/683: symlink d2/de/d21/d3e/lf3 0 2024-08-01T06:56:27.818 INFO:tasks.workunit.client.0.smithi016.stdout:0/485: dread d10/d11/d37/d53/f69 [0,4194304] 0 2024-08-01T06:56:27.818 INFO:tasks.workunit.client.0.smithi016.stdout:4/547: unlink d0/f86 0 2024-08-01T06:56:27.819 INFO:tasks.workunit.client.0.smithi016.stdout:4/548: chown d0/d17/f30 7963111 1 2024-08-01T06:56:27.821 INFO:tasks.workunit.client.0.smithi016.stdout:1/684: fdatasync d2/f72 0 2024-08-01T06:56:27.825 INFO:tasks.workunit.client.0.smithi016.stdout:4/549: symlink d0/d2/d68/lb4 0 2024-08-01T06:56:27.826 INFO:tasks.workunit.client.0.smithi016.stdout:8/471: getdents d5/d8/d1a/d24/d48/d6e 0 2024-08-01T06:56:27.829 INFO:tasks.workunit.client.0.smithi016.stdout:1/685: chown d2/de/d63/dd6 400 1 2024-08-01T06:56:27.830 INFO:tasks.workunit.client.0.smithi016.stdout:1/686: chown d2/d88/fb0 177622611 1 2024-08-01T06:56:27.831 INFO:tasks.workunit.client.0.smithi016.stdout:0/486: mkdir d10/d9a 0 2024-08-01T06:56:27.835 INFO:tasks.workunit.client.0.smithi016.stdout:8/472: truncate d5/d1c/f33 5045084 0 2024-08-01T06:56:27.835 INFO:tasks.workunit.client.0.smithi016.stdout:9/611: write d3/de/f17 [253788,41071] 0 2024-08-01T06:56:27.835 INFO:tasks.workunit.client.0.smithi016.stdout:8/473: chown d5/d8/d1a/d24/d48/f97 10248592 1 2024-08-01T06:56:27.839 INFO:tasks.workunit.client.0.smithi016.stdout:0/487: mkdir d10/d11/d37/d82/d9b 0 2024-08-01T06:56:27.841 INFO:tasks.workunit.client.0.smithi016.stdout:0/488: read d10/d11/f15 [327316,95324] 0 2024-08-01T06:56:27.842 INFO:tasks.workunit.client.0.smithi016.stdout:0/489: write d10/d11/d37/d58/f79 [248380,45125] 0 2024-08-01T06:56:27.843 INFO:tasks.workunit.client.0.smithi016.stdout:9/612: mknod d3/d9/df/d16/cc4 0 2024-08-01T06:56:27.844 INFO:tasks.workunit.client.0.smithi016.stdout:0/490: chown d10/d1c/c54 49500807 1 2024-08-01T06:56:27.845 INFO:tasks.workunit.client.0.smithi016.stdout:9/613: write d3/d9/df/d16/f1e [411147,45806] 0 2024-08-01T06:56:27.848 INFO:tasks.workunit.client.0.smithi016.stdout:8/474: symlink d5/d8/d1a/d24/d48/l9e 0 2024-08-01T06:56:27.848 INFO:tasks.workunit.client.0.smithi016.stdout:4/550: link d0/d17/d22/d26/d85/lae d0/d17/d22/d26/d8b/lb5 0 2024-08-01T06:56:27.851 INFO:tasks.workunit.client.0.smithi016.stdout:4/551: write d0/d17/d22/f53 [72762,52097] 0 2024-08-01T06:56:27.852 INFO:tasks.workunit.client.0.smithi016.stdout:9/614: rmdir d3/d9/df/d2a 39 2024-08-01T06:56:27.853 INFO:tasks.workunit.client.0.smithi016.stdout:0/491: dwrite d10/d11/d37/f55 [4194304,4194304] 0 2024-08-01T06:56:27.856 INFO:tasks.workunit.client.0.smithi016.stdout:4/552: rmdir d0/d2/dc/d90 39 2024-08-01T06:56:27.862 INFO:tasks.workunit.client.0.smithi016.stdout:4/553: creat d0/d2/dc/d12/d29/d3c/fb6 x:0 0 0 2024-08-01T06:56:27.863 INFO:tasks.workunit.client.0.smithi016.stdout:8/475: dwrite d5/d8/d1a/d24/f4a [0,4194304] 0 2024-08-01T06:56:27.865 INFO:tasks.workunit.client.0.smithi016.stdout:0/492: dwrite d10/d11/d41/f2f [0,4194304] 0 2024-08-01T06:56:27.871 INFO:tasks.workunit.client.0.smithi016.stdout:8/476: mknod d5/c9f 0 2024-08-01T06:56:27.874 INFO:tasks.workunit.client.0.smithi016.stdout:8/477: mknod d5/d8/d1a/d24/d48/d6e/d92/ca0 0 2024-08-01T06:56:27.875 INFO:tasks.workunit.client.0.smithi016.stdout:8/478: chown d5/c9f 65764 1 2024-08-01T06:56:27.876 INFO:tasks.workunit.client.0.smithi016.stdout:9/615: dread d3/d9/db/d3e/d40/f59 [0,4194304] 0 2024-08-01T06:56:27.876 INFO:tasks.workunit.client.0.smithi016.stdout:8/479: dread - d5/d1c/f89 zero size 2024-08-01T06:56:27.878 INFO:tasks.workunit.client.0.smithi016.stdout:1/687: truncate d2/d3/d41/d49/fa4 3322000 0 2024-08-01T06:56:27.881 INFO:tasks.workunit.client.0.smithi016.stdout:8/480: truncate d5/d8/f68 699468 0 2024-08-01T06:56:27.882 INFO:tasks.workunit.client.0.smithi016.stdout:9/616: truncate d3/de/d89/f8d 4401697 0 2024-08-01T06:56:27.883 INFO:tasks.workunit.client.0.smithi016.stdout:4/554: dread d0/d2/dc/f2b [0,4194304] 0 2024-08-01T06:56:27.885 INFO:tasks.workunit.client.0.smithi016.stdout:1/688: stat d2/d3/d1c/lbe 0 2024-08-01T06:56:27.886 INFO:tasks.workunit.client.0.smithi016.stdout:4/555: chown d0/d2/da0/fb3 222239 1 2024-08-01T06:56:27.887 INFO:tasks.workunit.client.0.smithi016.stdout:9/617: dread d3/d9/db/d3e/f7f [0,4194304] 0 2024-08-01T06:56:27.888 INFO:tasks.workunit.client.0.smithi016.stdout:8/481: creat d5/d8/d1a/d24/d48/d6e/d92/d99/fa1 x:0 0 0 2024-08-01T06:56:27.889 INFO:tasks.workunit.client.0.smithi016.stdout:4/556: rmdir d0/d2 39 2024-08-01T06:56:27.892 INFO:tasks.workunit.client.0.smithi016.stdout:1/689: mkdir d2/de/d21/d3e/df4 0 2024-08-01T06:56:27.894 INFO:tasks.workunit.client.0.smithi016.stdout:9/618: write d3/de/f7a [4481771,122668] 0 2024-08-01T06:56:27.897 INFO:tasks.workunit.client.0.smithi016.stdout:8/482: dwrite d5/d1c/f8e [0,4194304] 0 2024-08-01T06:56:27.900 INFO:tasks.workunit.client.0.smithi016.stdout:9/619: creat d3/d9/db/d3e/fc5 x:0 0 0 2024-08-01T06:56:27.901 INFO:tasks.workunit.client.0.smithi016.stdout:9/620: read d3/f28 [2302127,128167] 0 2024-08-01T06:56:27.904 INFO:tasks.workunit.client.0.smithi016.stdout:4/557: creat d0/d2/dc/d12/d29/d8f/fb7 x:0 0 0 2024-08-01T06:56:27.905 INFO:tasks.workunit.client.0.smithi016.stdout:1/690: symlink d2/de/d63/lf5 0 2024-08-01T06:56:27.907 INFO:tasks.workunit.client.0.smithi016.stdout:4/558: write d0/d2/dc/d12/d29/d3c/f69 [1895063,57825] 0 2024-08-01T06:56:27.917 INFO:tasks.workunit.client.0.smithi016.stdout:4/559: creat d0/d2/dc/fb8 x:0 0 0 2024-08-01T06:56:27.919 INFO:tasks.workunit.client.0.smithi016.stdout:4/560: chown d0/d17/d22/l51 184 1 2024-08-01T06:56:27.921 INFO:tasks.workunit.client.0.smithi016.stdout:4/561: chown d0/d2/l5d 1372490 1 2024-08-01T06:56:27.926 INFO:tasks.workunit.client.0.smithi016.stdout:0/493: dwrite d10/d11/f64 [0,4194304] 0 2024-08-01T06:56:27.926 INFO:tasks.workunit.client.0.smithi016.stdout:4/562: truncate d0/d2/dc/f15 4280078 0 2024-08-01T06:56:27.927 INFO:tasks.workunit.client.0.smithi016.stdout:0/494: readlink d10/d1c/l4c 0 2024-08-01T06:56:27.931 INFO:tasks.workunit.client.0.smithi016.stdout:0/495: rename d10/d11/d37/f8b to d10/d5c/d90/f9c 0 2024-08-01T06:56:27.935 INFO:tasks.workunit.client.0.smithi016.stdout:0/496: mknod d10/d1c/c9d 0 2024-08-01T06:56:27.938 INFO:tasks.workunit.client.0.smithi016.stdout:0/497: unlink d10/d1c/c66 0 2024-08-01T06:56:27.942 INFO:tasks.workunit.client.0.smithi016.stdout:0/498: mknod d10/c9e 0 2024-08-01T06:56:27.946 INFO:tasks.workunit.client.0.smithi016.stdout:0/499: creat d10/d11/d37/f9f x:0 0 0 2024-08-01T06:56:27.951 INFO:tasks.workunit.client.0.smithi016.stdout:0/500: truncate d10/f33 2918239 0 2024-08-01T06:56:27.955 INFO:tasks.workunit.client.0.smithi016.stdout:0/501: rename d10/d9a to d10/d5c/d90/da0 0 2024-08-01T06:56:27.959 INFO:tasks.workunit.client.0.smithi016.stdout:0/502: rename d10/d1c/c9d to d10/d11/d37/d82/ca1 0 2024-08-01T06:56:27.962 INFO:tasks.workunit.client.0.smithi016.stdout:0/503: dread d10/d5c/d90/f9c [0,4194304] 0 2024-08-01T06:56:27.966 INFO:tasks.workunit.client.0.smithi016.stdout:0/504: dread d10/d11/d41/f2f [0,4194304] 0 2024-08-01T06:56:27.967 INFO:tasks.workunit.client.0.smithi016.stdout:0/505: chown d10/c1f 8271809 1 2024-08-01T06:56:27.973 INFO:tasks.workunit.client.0.smithi016.stdout:1/691: write d2/d3/d1a/f4e [4771366,44081] 0 2024-08-01T06:56:27.980 INFO:tasks.workunit.client.0.smithi016.stdout:9/621: dwrite d3/d9/db/d3e/f99 [0,4194304] 0 2024-08-01T06:56:27.984 INFO:tasks.workunit.client.0.smithi016.stdout:0/506: dwrite d10/d5c/f75 [0,4194304] 0 2024-08-01T06:56:27.989 INFO:tasks.workunit.client.0.smithi016.stdout:9/622: mkdir d3/d9/db/d3e/dc6 0 2024-08-01T06:56:27.989 INFO:tasks.workunit.client.0.smithi016.stdout:0/507: dread fd [0,4194304] 0 2024-08-01T06:56:27.993 INFO:tasks.workunit.client.0.smithi016.stdout:9/623: dread - d3/de/d89/fbf zero size 2024-08-01T06:56:27.994 INFO:tasks.workunit.client.0.smithi016.stdout:0/508: chown d10/d1c/f4e 15954054 1 2024-08-01T06:56:27.996 INFO:tasks.workunit.client.0.smithi016.stdout:4/563: dwrite d0/d17/d22/d7f/d93/fa1 [0,4194304] 0 2024-08-01T06:56:27.998 INFO:tasks.workunit.client.0.smithi016.stdout:9/624: write d3/d9/d46/d48/f55 [5902682,16449] 0 2024-08-01T06:56:28.005 INFO:tasks.workunit.client.0.smithi016.stdout:9/625: fsync d3/d9/df/f2d 0 2024-08-01T06:56:28.007 INFO:tasks.workunit.client.0.smithi016.stdout:4/564: mkdir d0/db9 0 2024-08-01T06:56:28.009 INFO:tasks.workunit.client.0.smithi016.stdout:0/509: dwrite d10/f45 [0,4194304] 0 2024-08-01T06:56:28.010 INFO:tasks.workunit.client.0.smithi016.stdout:9/626: fsync d3/d9/db/dc/d33/f51 0 2024-08-01T06:56:28.010 INFO:tasks.workunit.client.0.smithi016.stdout:1/692: dread f0 [0,4194304] 0 2024-08-01T06:56:28.011 INFO:tasks.workunit.client.0.smithi016.stdout:4/565: chown d0/d17/d22/d7f/l88 8 1 2024-08-01T06:56:28.011 INFO:tasks.workunit.client.0.smithi016.stdout:4/566: readlink d0/l44 0 2024-08-01T06:56:28.017 INFO:tasks.workunit.client.0.smithi016.stdout:9/627: creat d3/de/fc7 x:0 0 0 2024-08-01T06:56:28.021 INFO:tasks.workunit.client.0.smithi016.stdout:1/693: symlink d2/de/d32/d43/lf6 0 2024-08-01T06:56:28.021 INFO:tasks.workunit.client.0.smithi016.stdout:0/510: mkdir d10/d5c/d90/da2 0 2024-08-01T06:56:28.023 INFO:tasks.workunit.client.0.smithi016.stdout:9/628: symlink d3/d9/df/d16/d94/da5/lc8 0 2024-08-01T06:56:28.026 INFO:tasks.workunit.client.0.smithi016.stdout:4/567: dwrite d0/d2/dc/d12/d29/d8f/faa [0,4194304] 0 2024-08-01T06:56:28.027 INFO:tasks.workunit.client.0.smithi016.stdout:9/629: write d3/de/f18 [1962863,63541] 0 2024-08-01T06:56:28.030 INFO:tasks.workunit.client.0.smithi016.stdout:1/694: dread - d2/d3/f84 zero size 2024-08-01T06:56:28.034 INFO:tasks.workunit.client.0.smithi016.stdout:9/630: truncate d3/d9/db/dc/d33/f54 1128438 0 2024-08-01T06:56:28.035 INFO:tasks.workunit.client.0.smithi016.stdout:4/568: mknod d0/d17/d22/d7f/cba 0 2024-08-01T06:56:28.037 INFO:tasks.workunit.client.0.smithi016.stdout:0/511: symlink d10/d11/d41/d95/la3 0 2024-08-01T06:56:28.041 INFO:tasks.workunit.client.0.smithi016.stdout:1/695: dwrite d2/de/d6e/f78 [0,4194304] 0 2024-08-01T06:56:28.044 INFO:tasks.workunit.client.0.smithi016.stdout:0/512: dread d10/d11/d37/d58/f79 [0,4194304] 0 2024-08-01T06:56:28.051 INFO:tasks.workunit.client.0.smithi016.stdout:4/569: rename d0/la8 to d0/d2/dc/d90/lbb 0 2024-08-01T06:56:28.056 INFO:tasks.workunit.client.0.smithi016.stdout:1/696: dwrite d2/f12 [0,4194304] 0 2024-08-01T06:56:28.067 INFO:tasks.workunit.client.0.smithi016.stdout:4/570: dwrite d0/d17/d22/d7f/d93/f96 [4194304,4194304] 0 2024-08-01T06:56:28.070 INFO:tasks.workunit.client.0.smithi016.stdout:4/571: stat d0/d17/d22/d7f/d93/f96 0 2024-08-01T06:56:28.073 INFO:tasks.workunit.client.0.smithi016.stdout:4/572: mknod d0/d17/cbc 0 2024-08-01T06:56:28.074 INFO:tasks.workunit.client.0.smithi016.stdout:4/573: write d0/d17/d22/d26/fac [3196811,129534] 0 2024-08-01T06:56:28.081 INFO:tasks.workunit.client.0.smithi016.stdout:4/574: mkdir d0/d2/d36/dbd 0 2024-08-01T06:56:28.083 INFO:tasks.workunit.client.0.smithi016.stdout:4/575: chown d0/d17/d22/c6a 2445 1 2024-08-01T06:56:28.084 INFO:tasks.workunit.client.0.smithi016.stdout:9/631: dread d3/de/d89/f8d [0,4194304] 0 2024-08-01T06:56:28.086 INFO:tasks.workunit.client.0.smithi016.stdout:4/576: write d0/fb [3011420,34072] 0 2024-08-01T06:56:28.089 INFO:tasks.workunit.client.0.smithi016.stdout:9/632: creat d3/d9/df/d16/d94/fc9 x:0 0 0 2024-08-01T06:56:28.089 INFO:tasks.workunit.client.0.smithi016.stdout:4/577: mknod d0/d17/d22/d26/cbe 0 2024-08-01T06:56:28.090 INFO:tasks.workunit.client.0.smithi016.stdout:0/513: truncate d10/d11/d37/f55 4332750 0 2024-08-01T06:56:28.092 INFO:tasks.workunit.client.0.smithi016.stdout:1/697: truncate d2/f5d 4382855 0 2024-08-01T06:56:28.094 INFO:tasks.workunit.client.0.smithi016.stdout:1/698: write d2/de/d63/fdb [857535,38182] 0 2024-08-01T06:56:28.103 INFO:tasks.workunit.client.0.smithi016.stdout:0/514: unlink d10/d11/d41/c2d 0 2024-08-01T06:56:28.103 INFO:tasks.workunit.client.0.smithi016.stdout:0/515: stat d10/c9e 0 2024-08-01T06:56:28.105 INFO:tasks.workunit.client.0.smithi016.stdout:9/633: link d3/d9/db/dc/d56/d9b/fbe d3/d32/d5c/d8a/fca 0 2024-08-01T06:56:28.106 INFO:tasks.workunit.client.0.smithi016.stdout:0/516: dread - d10/d11/d37/d82/f8d zero size 2024-08-01T06:56:28.114 INFO:tasks.workunit.client.0.smithi016.stdout:9/634: rmdir d3/d9/d46 39 2024-08-01T06:56:28.116 INFO:tasks.workunit.client.0.smithi016.stdout:0/517: dwrite d10/f5a [0,4194304] 0 2024-08-01T06:56:28.116 INFO:tasks.workunit.client.0.smithi016.stdout:4/578: rmdir d0/d2/dc/d12/d29/db1 0 2024-08-01T06:56:28.117 INFO:tasks.workunit.client.0.smithi016.stdout:0/518: read d10/d11/d37/f7d [2497131,86382] 0 2024-08-01T06:56:28.118 INFO:tasks.workunit.client.0.smithi016.stdout:9/635: fdatasync d3/d9/df/d16/fb1 0 2024-08-01T06:56:28.122 INFO:tasks.workunit.client.0.smithi016.stdout:9/636: truncate d3/d9/db/d3e/f66 1081262 0 2024-08-01T06:56:28.123 INFO:tasks.workunit.client.0.smithi016.stdout:9/637: readlink d3/d9/df/d38/l7b 0 2024-08-01T06:56:28.128 INFO:tasks.workunit.client.0.smithi016.stdout:1/699: dread d2/d3/d1a/d22/f76 [4194304,4194304] 0 2024-08-01T06:56:28.143 INFO:tasks.workunit.client.0.smithi016.stdout:9/638: rmdir d3/d32 39 2024-08-01T06:56:28.147 INFO:tasks.workunit.client.0.smithi016.stdout:4/579: dread d0/d2/d68/f6f [0,4194304] 0 2024-08-01T06:56:28.148 INFO:tasks.workunit.client.0.smithi016.stdout:0/519: mkdir d10/d11/d41/da4 0 2024-08-01T06:56:28.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.147+0000 7f5beb37c640 1 -- 172.21.15.16:0/2138271372 --> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5be4107810 con 0x7f5bd006d660 2024-08-01T06:56:28.149 INFO:tasks.workunit.client.0.smithi016.stdout:1/700: dread - d2/de/dc4/fcc zero size 2024-08-01T06:56:28.149 INFO:tasks.workunit.client.0.smithi016.stdout:9/639: rmdir d3/d9/db/d3e/d40/d4e 39 2024-08-01T06:56:28.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.149+0000 7f5bda7fc640 1 -- 172.21.15.16:0/2138271372 <== mgr.24423 v2:172.21.15.89:6828/2589785296 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f5be4107810 con 0x7f5bd006d660 2024-08-01T06:56:28.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.153+0000 7f5beb37c640 1 -- 172.21.15.16:0/2138271372 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f5bd006d660 msgr2=0x7f5bd006fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:28.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.154+0000 7f5beb37c640 1 --2- 172.21.15.16:0/2138271372 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f5bd006d660 0x7f5bd006fb20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4000c00 tx=0x7f5bd40314e0 comp rx=0 tx=0).stop 2024-08-01T06:56:28.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.154+0000 7f5beb37c640 1 -- 172.21.15.16:0/2138271372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be40fea80 msgr2=0x7f5be40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:28.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.154+0000 7f5beb37c640 1 --2- 172.21.15.16:0/2138271372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be40fea80 0x7f5be40689c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5be000e940 tx=0x7f5be000ee00 comp rx=0 tx=0).stop 2024-08-01T06:56:28.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.154+0000 7f5beb37c640 1 -- 172.21.15.16:0/2138271372 shutdown_connections 2024-08-01T06:56:28.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.154+0000 7f5beb37c640 1 --2- 172.21.15.16:0/2138271372 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f5bd006d660 0x7f5bd006fb20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:28.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.154+0000 7f5beb37c640 1 --2- 172.21.15.16:0/2138271372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5be40ffc80 0x7f5be4068f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:28.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.154+0000 7f5beb37c640 1 --2- 172.21.15.16:0/2138271372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be40fea80 0x7f5be40689c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:28.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.154+0000 7f5beb37c640 1 -- 172.21.15.16:0/2138271372 >> 172.21.15.16:0/2138271372 conn(0x7f5be40fa230 msgr2=0x7f5be4103300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:56:28.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.154+0000 7f5beb37c640 1 -- 172.21.15.16:0/2138271372 shutdown_connections 2024-08-01T06:56:28.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.154+0000 7f5beb37c640 1 -- 172.21.15.16:0/2138271372 wait complete. 2024-08-01T06:56:28.157 INFO:tasks.workunit.client.0.smithi016.stdout:1/701: write d2/de/d21/d3e/f8f [4231245,112836] 0 2024-08-01T06:56:28.159 INFO:tasks.workunit.client.0.smithi016.stdout:4/580: truncate d0/d2/fa 1464861 0 2024-08-01T06:56:28.161 INFO:tasks.workunit.client.0.smithi016.stdout:1/702: creat d2/d3/d1a/d22/ff7 x:0 0 0 2024-08-01T06:56:28.163 INFO:tasks.workunit.client.0.smithi016.stdout:9/640: rename d3/de/f13 to d3/d9/df/fcb 0 2024-08-01T06:56:28.166 INFO:tasks.workunit.client.0.smithi016.stdout:1/703: creat d2/de/d21/d3e/ff8 x:0 0 0 2024-08-01T06:56:28.167 INFO:tasks.workunit.client.0.smithi016.stdout:9/641: mkdir d3/de/d89/dcc 0 2024-08-01T06:56:28.168 INFO:tasks.workunit.client.0.smithi016.stdout:9/642: write d3/de/fc7 [338031,73362] 0 2024-08-01T06:56:28.171 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T06:56:28.176 INFO:tasks.workunit.client.0.smithi016.stdout:4/581: rename d0/d17/d22/d26/d85/lae to d0/d17/d22/d7f/lbf 0 2024-08-01T06:56:28.179 INFO:tasks.workunit.client.0.smithi016.stdout:0/520: write d10/d11/d37/d53/f69 [885684,101940] 0 2024-08-01T06:56:28.180 INFO:tasks.workunit.client.0.smithi016.stdout:9/643: creat d3/d9/df/d16/fcd x:0 0 0 2024-08-01T06:56:28.182 INFO:tasks.workunit.client.0.smithi016.stdout:1/704: mknod d2/d2f/d97/cf9 0 2024-08-01T06:56:28.183 INFO:tasks.workunit.client.0.smithi016.stdout:1/705: chown d2/d3/d41/fb4 64 1 2024-08-01T06:56:28.187 INFO:tasks.workunit.client.0.smithi016.stdout:0/521: mkdir d10/d5c/d90/da2/da5 0 2024-08-01T06:56:28.192 INFO:tasks.workunit.client.0.smithi016.stdout:9/644: mkdir d3/d9/d46/d48/dce 0 2024-08-01T06:56:28.193 INFO:tasks.workunit.client.0.smithi016.stdout:0/522: rmdir d10/d5c 39 2024-08-01T06:56:28.194 INFO:tasks.workunit.client.0.smithi016.stdout:1/706: creat d2/de/d21/d3e/df4/ffa x:0 0 0 2024-08-01T06:56:28.197 INFO:tasks.workunit.client.0.smithi016.stdout:9/645: symlink d3/d9/lcf 0 2024-08-01T06:56:28.198 INFO:tasks.workunit.client.0.smithi016.stdout:1/707: write d2/de/d21/d3e/ff8 [408411,42049] 0 2024-08-01T06:56:28.204 INFO:tasks.workunit.client.0.smithi016.stdout:0/523: dwrite d10/d11/f42 [0,4194304] 0 2024-08-01T06:56:28.204 INFO:tasks.workunit.client.0.smithi016.stdout:9/646: link d3/de/d89/fb6 d3/d9/db/d3e/fd0 0 2024-08-01T06:56:28.205 INFO:tasks.workunit.client.0.smithi016.stdout:4/582: dwrite d0/d2/f1c [0,4194304] 0 2024-08-01T06:56:28.207 INFO:tasks.workunit.client.0.smithi016.stdout:1/708: mkdir d2/de/d21/d3e/df4/dfb 0 2024-08-01T06:56:28.207 INFO:tasks.workunit.client.0.smithi016.stdout:0/524: write d10/d11/d41/f94 [665705,47422] 0 2024-08-01T06:56:28.210 INFO:tasks.workunit.client.0.smithi016.stdout:4/583: chown d0/d2/d68/c99 10 1 2024-08-01T06:56:28.214 INFO:tasks.workunit.client.0.smithi016.stdout:1/709: rename d2/d2f/d97/fd4 to d2/de/d21/d3e/df4/dfb/ffc 0 2024-08-01T06:56:28.215 INFO:tasks.workunit.client.0.smithi016.stdout:1/710: chown d2/d3/d48/f95 1782 1 2024-08-01T06:56:28.217 INFO:tasks.workunit.client.0.smithi016.stdout:4/584: symlink d0/d2/dc/d12/lc0 0 2024-08-01T06:56:28.223 INFO:tasks.workunit.client.0.smithi016.stdout:1/711: dwrite d2/d3/d1a/d22/fb6 [4194304,4194304] 0 2024-08-01T06:56:28.225 INFO:tasks.workunit.client.0.smithi016.stdout:0/525: rmdir d10/d11/d41/da4 0 2024-08-01T06:56:28.232 INFO:tasks.workunit.client.0.smithi016.stdout:4/585: rename d0/d2/dc/d12/d29 to d0/d17/d22/d26/d85/dc1 0 2024-08-01T06:56:28.234 INFO:tasks.workunit.client.0.smithi016.stdout:4/586: write d0/d2/da0/fad [745023,130394] 0 2024-08-01T06:56:28.238 INFO:tasks.workunit.client.0.smithi016.stdout:0/526: write d10/d1c/d7c/f8f [517590,120044] 0 2024-08-01T06:56:28.238 INFO:tasks.workunit.client.0.smithi016.stdout:9/647: dwrite d3/d32/d5c/d8a/fca [0,4194304] 0 2024-08-01T06:56:28.242 INFO:tasks.workunit.client.0.smithi016.stdout:4/587: symlink d0/d17/d38/lc2 0 2024-08-01T06:56:28.244 INFO:tasks.workunit.client.0.smithi016.stdout:1/712: creat d2/de/ffd x:0 0 0 2024-08-01T06:56:28.245 INFO:tasks.workunit.client.0.smithi016.stdout:9/648: fdatasync d3/d9/df/d2a/fc0 0 2024-08-01T06:56:28.249 INFO:tasks.workunit.client.0.smithi016.stdout:9/649: creat d3/d9/d73/fd1 x:0 0 0 2024-08-01T06:56:28.250 INFO:tasks.workunit.client.0.smithi016.stdout:4/588: dwrite d0/d17/d22/f53 [0,4194304] 0 2024-08-01T06:56:28.282 INFO:tasks.workunit.client.0.smithi016.stdout:3/484: sync 2024-08-01T06:56:28.282 INFO:tasks.workunit.client.0.smithi016.stdout:2/748: sync 2024-08-01T06:56:28.282 INFO:tasks.workunit.client.0.smithi016.stdout:5/571: sync 2024-08-01T06:56:28.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.283+0000 7f0470b92640 1 -- 172.21.15.16:0/2716614369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f046c0ffb90 msgr2=0x7f046c0fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:28.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.283+0000 7f0470b92640 1 --2- 172.21.15.16:0/2716614369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f046c0ffb90 0x7f046c0fff90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f045c009880 tx=0x7f045c02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:56:28.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.283+0000 7f0470b92640 1 -- 172.21.15.16:0/2716614369 shutdown_connections 2024-08-01T06:56:28.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.283+0000 7f0470b92640 1 --2- 172.21.15.16:0/2716614369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f046c100d90 0x7f046c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:28.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.283+0000 7f0470b92640 1 --2- 172.21.15.16:0/2716614369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f046c0ffb90 0x7f046c0fff90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:28.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.283+0000 7f0470b92640 1 -- 172.21.15.16:0/2716614369 >> 172.21.15.16:0/2716614369 conn(0x7f046c0fb360 msgr2=0x7f046c0fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:56:28.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.283+0000 7f0470b92640 1 -- 172.21.15.16:0/2716614369 shutdown_connections 2024-08-01T06:56:28.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.283+0000 7f0470b92640 1 -- 172.21.15.16:0/2716614369 wait complete. 2024-08-01T06:56:28.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.284+0000 7f0470b92640 1 Processor -- start 2024-08-01T06:56:28.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.284+0000 7f0470b92640 1 -- start start 2024-08-01T06:56:28.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.284+0000 7f0470b92640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f046c0ffb90 0x7f046c195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:28.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.284+0000 7f0470b92640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f046c100d90 0x7f046c195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:28.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.284+0000 7f0470b92640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046c1961a0 con 0x7f046c100d90 2024-08-01T06:56:28.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.284+0000 7f0470b92640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046c196310 con 0x7f046c0ffb90 2024-08-01T06:56:28.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.284+0000 7f0469d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f046c100d90 0x7f046c195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:28.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.284+0000 7f0469d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f046c100d90 0x7f046c195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43014/0 (socket says 172.21.15.16:43014) 2024-08-01T06:56:28.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.284+0000 7f0469d9b640 1 -- 172.21.15.16:0/3222595617 learned_addr learned my addr 172.21.15.16:0/3222595617 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:56:28.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.285+0000 7f046a59c640 1 --2- 172.21.15.16:0/3222595617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f046c0ffb90 0x7f046c195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:28.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.285+0000 7f0469d9b640 1 -- 172.21.15.16:0/3222595617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f046c0ffb90 msgr2=0x7f046c195690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:28.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.285+0000 7f0469d9b640 1 --2- 172.21.15.16:0/3222595617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f046c0ffb90 0x7f046c195690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:28.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.285+0000 7f0469d9b640 1 -- 172.21.15.16:0/3222595617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c009560 con 0x7f046c100d90 2024-08-01T06:56:28.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.285+0000 7f046a59c640 1 --2- 172.21.15.16:0/3222595617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f046c0ffb90 0x7f046c195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-01T06:56:28.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.285+0000 7f0469d9b640 1 --2- 172.21.15.16:0/3222595617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f046c100d90 0x7f046c195bd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f046000c920 tx=0x7f046000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:56:28.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.285+0000 7f045b7fe640 1 -- 172.21.15.16:0/3222595617 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0460007b80 con 0x7f046c100d90 2024-08-01T06:56:28.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.285+0000 7f045b7fe640 1 -- 172.21.15.16:0/3222595617 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f04600054e0 con 0x7f046c100d90 2024-08-01T06:56:28.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.285+0000 7f0470b92640 1 -- 172.21.15.16:0/3222595617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f046c19adb0 con 0x7f046c100d90 2024-08-01T06:56:28.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.285+0000 7f045b7fe640 1 -- 172.21.15.16:0/3222595617 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f046000f450 con 0x7f046c100d90 2024-08-01T06:56:28.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.285+0000 7f0470b92640 1 -- 172.21.15.16:0/3222595617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f046c19b350 con 0x7f046c100d90 2024-08-01T06:56:28.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.286+0000 7f0470b92640 1 -- 172.21.15.16:0/3222595617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f046c0fff90 con 0x7f046c100d90 2024-08-01T06:56:28.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.287+0000 7f045b7fe640 1 -- 172.21.15.16:0/3222595617 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) v1 ==== 91559+0+0 (secure 0 0 0) 0x7f0460004f60 con 0x7f046c100d90 2024-08-01T06:56:28.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.287+0000 7f045b7fe640 1 --2- 172.21.15.16:0/3222595617 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f045406d660 0x7f045406fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:28.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.287+0000 7f045b7fe640 1 -- 172.21.15.16:0/3222595617 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f046008cf10 con 0x7f046c100d90 2024-08-01T06:56:28.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.287+0000 7f046a59c640 1 --2- 172.21.15.16:0/3222595617 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f045406d660 0x7f045406fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:28.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.288+0000 7f046a59c640 1 --2- 172.21.15.16:0/3222595617 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f045406d660 0x7f045406fb20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f045c000c00 tx=0x7f045c005d50 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:56:28.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.292+0000 7f045b7fe640 1 -- 172.21.15.16:0/3222595617 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f04600566d0 con 0x7f046c100d90 2024-08-01T06:56:28.309 INFO:tasks.workunit.client.0.smithi016.stdout:4/589: symlink d0/d17/d22/d26/d8b/lc3 0 2024-08-01T06:56:28.315 INFO:tasks.workunit.client.0.smithi016.stdout:4/590: chown d0/d17/d22/d26/d85/l8e 621696 1 2024-08-01T06:56:28.315 INFO:tasks.workunit.client.0.smithi016.stdout:9/650: dwrite d3/d9/db/dc/f42 [0,4194304] 0 2024-08-01T06:56:28.316 INFO:tasks.workunit.client.0.smithi016.stdout:5/572: dread d1/d2/d23/d3a/f3b [0,4194304] 0 2024-08-01T06:56:28.319 INFO:tasks.workunit.client.0.smithi016.stdout:4/591: write d0/d17/d22/f31 [4540118,58043] 0 2024-08-01T06:56:28.321 INFO:tasks.workunit.client.0.smithi016.stdout:5/573: stat d1/d2/d6/d9/d19/l79 0 2024-08-01T06:56:28.322 INFO:tasks.workunit.client.0.smithi016.stdout:1/713: dwrite d2/d2f/fb7 [0,4194304] 0 2024-08-01T06:56:28.338 INFO:tasks.workunit.client.0.smithi016.stdout:2/749: mknod d0/d8/d31/da7/ddf/cf6 0 2024-08-01T06:56:28.338 INFO:tasks.workunit.client.0.smithi016.stdout:3/485: dread d9/d3e/f2d [4194304,4194304] 0 2024-08-01T06:56:28.344 INFO:tasks.workunit.client.0.smithi016.stdout:1/714: dread - d2/d3/d41/fb4 zero size 2024-08-01T06:56:28.345 INFO:tasks.workunit.client.0.smithi016.stdout:4/592: symlink d0/d2/dc/d90/lc4 0 2024-08-01T06:56:28.348 INFO:tasks.workunit.client.0.smithi016.stdout:5/574: mkdir d1/d2/d20/d38/dc7 0 2024-08-01T06:56:28.350 INFO:tasks.workunit.client.0.smithi016.stdout:3/486: mkdir d9/d1c/da4 0 2024-08-01T06:56:28.352 INFO:tasks.workunit.client.0.smithi016.stdout:2/750: mknod d0/d7d/d8b/cf7 0 2024-08-01T06:56:28.352 INFO:tasks.workunit.client.0.smithi016.stdout:9/651: mknod d3/d9/d46/d48/dce/cd2 0 2024-08-01T06:56:28.353 INFO:tasks.workunit.client.0.smithi016.stdout:2/751: fsync d0/d8/d22/f63 0 2024-08-01T06:56:28.354 INFO:tasks.workunit.client.0.smithi016.stdout:9/652: chown d3/d32/c5e 292614 1 2024-08-01T06:56:28.356 INFO:tasks.workunit.client.0.smithi016.stdout:5/575: creat d1/d2/d6/d5a/fc8 x:0 0 0 2024-08-01T06:56:28.359 INFO:tasks.workunit.client.0.smithi016.stdout:4/593: link d0/d2/dc/f2b d0/d17/d22/d7f/fc5 0 2024-08-01T06:56:28.362 INFO:tasks.workunit.client.0.smithi016.stdout:2/752: rename d0/d8/d1b/d74/d90/d93/f78 to d0/d7d/d8b/ff8 0 2024-08-01T06:56:28.363 INFO:tasks.workunit.client.0.smithi016.stdout:3/487: mkdir d9/da/df/d12/da0/da5 0 2024-08-01T06:56:28.364 INFO:tasks.workunit.client.0.smithi016.stdout:1/715: fsync d2/de/f31 0 2024-08-01T06:56:28.365 INFO:tasks.workunit.client.0.smithi016.stdout:9/653: symlink d3/d9/d46/d48/d8b/ld3 0 2024-08-01T06:56:28.366 INFO:tasks.workunit.client.0.smithi016.stdout:4/594: creat d0/d2/dc/d12/fc6 x:0 0 0 2024-08-01T06:56:28.368 INFO:tasks.workunit.client.0.smithi016.stdout:2/753: creat d0/d8/d31/da7/db4/ff9 x:0 0 0 2024-08-01T06:56:28.375 INFO:tasks.workunit.client.0.smithi016.stdout:4/595: mkdir d0/d2/dc/d12/dc7 0 2024-08-01T06:56:28.377 INFO:tasks.workunit.client.0.smithi016.stdout:2/754: truncate d0/d8/d31/da7/fbf 99579 0 2024-08-01T06:56:28.383 INFO:tasks.workunit.client.0.smithi016.stdout:2/755: dwrite d0/d8/d1b/d74/d90/d93/f4d [0,4194304] 0 2024-08-01T06:56:28.385 INFO:tasks.workunit.client.0.smithi016.stdout:5/576: rename d1/d2/d6/d9/f13 to d1/fc9 0 2024-08-01T06:56:28.390 INFO:tasks.workunit.client.0.smithi016.stdout:4/596: creat d0/d17/d22/fc8 x:0 0 0 2024-08-01T06:56:28.390 INFO:tasks.workunit.client.0.smithi016.stdout:4/597: stat d0/d9d 0 2024-08-01T06:56:28.393 INFO:tasks.workunit.client.0.smithi016.stdout:3/488: rename d9/da/df/c14 to d9/da/df/d12/da0/ca6 0 2024-08-01T06:56:28.393 INFO:tasks.workunit.client.0.smithi016.stdout:2/756: dwrite d0/d16/f1f [0,4194304] 0 2024-08-01T06:56:28.396 INFO:tasks.workunit.client.0.smithi016.stdout:5/577: truncate d1/d2/d20/d72/f94 1031537 0 2024-08-01T06:56:28.402 INFO:tasks.workunit.client.0.smithi016.stdout:3/489: dwrite d9/da/df/d2a/d49/f68 [0,4194304] 0 2024-08-01T06:56:28.405 INFO:tasks.workunit.client.0.smithi016.stdout:1/716: write d2/de/d21/d3e/f4a [1117584,124065] 0 2024-08-01T06:56:28.406 INFO:tasks.workunit.client.0.smithi016.stdout:2/757: creat d0/d8/d31/d5e/de4/deb/ffa x:0 0 0 2024-08-01T06:56:28.408 INFO:tasks.workunit.client.0.smithi016.stdout:4/598: creat d0/d17/fc9 x:0 0 0 2024-08-01T06:56:28.409 INFO:tasks.workunit.client.0.smithi016.stdout:2/758: fsync d0/d8/d1b/d74/f81 0 2024-08-01T06:56:28.412 INFO:tasks.workunit.client.0.smithi016.stdout:1/717: write d2/de/dc4/fcc [979075,46116] 0 2024-08-01T06:56:28.415 INFO:tasks.workunit.client.0.smithi016.stdout:9/654: dwrite d3/d9/db/f5f [0,4194304] 0 2024-08-01T06:56:28.416 INFO:tasks.workunit.client.0.smithi016.stdout:9/655: chown d3/d9/db/d3a 2841909 1 2024-08-01T06:56:28.422 INFO:tasks.workunit.client.0.smithi016.stdout:9/656: read d3/d32/d5c/d8a/f75 [740099,116780] 0 2024-08-01T06:56:28.422 INFO:tasks.workunit.client.0.smithi016.stdout:2/759: creat d0/d8/d31/dc7/ffb x:0 0 0 2024-08-01T06:56:28.425 INFO:tasks.workunit.client.0.smithi016.stdout:1/718: stat d2/d3/d1a/f3c 0 2024-08-01T06:56:28.426 INFO:tasks.workunit.client.0.smithi016.stdout:4/599: unlink d0/d17/d22/d26/l6e 0 2024-08-01T06:56:28.430 INFO:tasks.workunit.client.0.smithi016.stdout:9/657: mkdir d3/d9/db/d3e/dd4 0 2024-08-01T06:56:28.436 INFO:tasks.workunit.client.0.smithi016.stdout:4/600: rename d0/d17/c61 to d0/d17/d22/d26/d85/dc1/d8f/cca 0 2024-08-01T06:56:28.437 INFO:tasks.workunit.client.0.smithi016.stdout:5/578: dwrite d1/d2/d23/d3a/f3b [0,4194304] 0 2024-08-01T06:56:28.440 INFO:tasks.workunit.client.0.smithi016.stdout:1/719: link d2/de/d4d/d92/fcd d2/de/d21/d3e/dc3/ffe 0 2024-08-01T06:56:28.441 INFO:tasks.workunit.client.0.smithi016.stdout:4/601: read d0/d2/da0/fad [191411,74930] 0 2024-08-01T06:56:28.441 INFO:tasks.workunit.client.0.smithi016.stdout:2/760: dread d0/d8/d1b/dcc/d68/fc6 [0,4194304] 0 2024-08-01T06:56:28.442 INFO:tasks.workunit.client.0.smithi016.stdout:9/658: creat d3/de/d6d/fd5 x:0 0 0 2024-08-01T06:56:28.445 INFO:tasks.workunit.client.0.smithi016.stdout:3/490: dwrite d9/da/df/d12/f83 [0,4194304] 0 2024-08-01T06:56:28.448 INFO:tasks.workunit.client.0.smithi016.stdout:4/602: write d0/d17/d22/fc8 [472235,65850] 0 2024-08-01T06:56:28.449 INFO:tasks.workunit.client.0.smithi016.stdout:5/579: symlink d1/d12/d7d/lca 0 2024-08-01T06:56:28.451 INFO:tasks.workunit.client.0.smithi016.stdout:1/720: mkdir d2/de/d63/dd6/dff 0 2024-08-01T06:56:28.451 INFO:tasks.workunit.client.0.smithi016.stdout:9/659: read - d3/d9/db/dc/d56/d9b/fb9 zero size 2024-08-01T06:56:28.451 INFO:tasks.workunit.client.0.smithi016.stdout:2/761: rmdir d0/d16 39 2024-08-01T06:56:28.453 INFO:tasks.workunit.client.0.smithi016.stdout:4/603: rmdir d0/d2/dc/d12 39 2024-08-01T06:56:28.455 INFO:tasks.workunit.client.0.smithi016.stdout:5/580: mknod d1/d12/d7d/ccb 0 2024-08-01T06:56:28.457 INFO:tasks.workunit.client.0.smithi016.stdout:2/762: rmdir d0/d8/d31 39 2024-08-01T06:56:28.460 INFO:tasks.workunit.client.0.smithi016.stdout:9/660: unlink d3/d9/db/f5f 0 2024-08-01T06:56:28.461 INFO:tasks.workunit.client.0.smithi016.stdout:1/721: dread d2/d3/d41/d49/f99 [0,4194304] 0 2024-08-01T06:56:28.463 INFO:tasks.workunit.client.0.smithi016.stdout:5/581: chown d1/d2/d20/db8/cb9 1934056 1 2024-08-01T06:56:28.466 INFO:tasks.workunit.client.0.smithi016.stdout:4/604: rename d0/d17/d22/d26/cbe to d0/d17/d22/d26/da3/ccb 0 2024-08-01T06:56:28.470 INFO:tasks.workunit.client.0.smithi016.stdout:3/491: rmdir d9/da/df/d12/d20/d6b 0 2024-08-01T06:56:28.472 INFO:tasks.workunit.client.0.smithi016.stdout:5/582: creat d1/d2/d6/d9/d49/d57/db1/fcc x:0 0 0 2024-08-01T06:56:28.477 INFO:tasks.workunit.client.0.smithi016.stdout:9/661: dread d3/d9/db/dc/d33/f6c [0,4194304] 0 2024-08-01T06:56:28.479 INFO:tasks.workunit.client.0.smithi016.stdout:5/583: unlink d1/d2/d6/d9/d19/l5e 0 2024-08-01T06:56:28.479 INFO:tasks.workunit.client.0.smithi016.stdout:9/662: write d3/d9/db/dc/fbc [1021183,39250] 0 2024-08-01T06:56:28.479 INFO:tasks.workunit.client.0.smithi016.stdout:5/584: chown d1/d12/d7d/ccb 7544275 1 2024-08-01T06:56:28.481 INFO:tasks.workunit.client.0.smithi016.stdout:4/605: creat d0/d2/dc/fcc x:0 0 0 2024-08-01T06:56:28.482 INFO:tasks.workunit.client.0.smithi016.stdout:3/492: link d9/da/df/d2a/d49/d61/f93 d9/da/d18/fa7 0 2024-08-01T06:56:28.505 INFO:tasks.workunit.client.0.smithi016.stdout:6/703: sync 2024-08-01T06:56:28.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.563+0000 7f0470b92640 1 -- 172.21.15.16:0/3222595617 --> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f046c02c540 con 0x7f045406d660 2024-08-01T06:56:28.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.565+0000 7f045b7fe640 1 -- 172.21.15.16:0/3222595617 <== mgr.24423 v2:172.21.15.89:6828/2589785296 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f046c02c540 con 0x7f045406d660 2024-08-01T06:56:28.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.567+0000 7f0470b92640 1 -- 172.21.15.16:0/3222595617 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f045406d660 msgr2=0x7f045406fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:28.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.567+0000 7f0470b92640 1 --2- 172.21.15.16:0/3222595617 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f045406d660 0x7f045406fb20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f045c000c00 tx=0x7f045c005d50 comp rx=0 tx=0).stop 2024-08-01T06:56:28.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.567+0000 7f0470b92640 1 -- 172.21.15.16:0/3222595617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f046c100d90 msgr2=0x7f046c195bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:28.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.567+0000 7f0470b92640 1 --2- 172.21.15.16:0/3222595617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f046c100d90 0x7f046c195bd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f046000c920 tx=0x7f046000cde0 comp rx=0 tx=0).stop 2024-08-01T06:56:28.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.567+0000 7f0470b92640 1 -- 172.21.15.16:0/3222595617 shutdown_connections 2024-08-01T06:56:28.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.567+0000 7f0470b92640 1 --2- 172.21.15.16:0/3222595617 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f045406d660 0x7f045406fb20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:28.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.567+0000 7f0470b92640 1 --2- 172.21.15.16:0/3222595617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f046c100d90 0x7f046c195bd0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:28.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.567+0000 7f0470b92640 1 --2- 172.21.15.16:0/3222595617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f046c0ffb90 0x7f046c195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:28.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.567+0000 7f0470b92640 1 -- 172.21.15.16:0/3222595617 >> 172.21.15.16:0/3222595617 conn(0x7f046c0fb360 msgr2=0x7f046c104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:56:28.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.567+0000 7f0470b92640 1 -- 172.21.15.16:0/3222595617 shutdown_connections 2024-08-01T06:56:28.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.567+0000 7f0470b92640 1 -- 172.21.15.16:0/3222595617 wait complete. 2024-08-01T06:56:28.588 INFO:tasks.workunit.client.0.smithi016.stdout:5/585: creat d1/d2/d6/d9/d49/d57/db1/fcd x:0 0 0 2024-08-01T06:56:28.590 INFO:tasks.workunit.client.0.smithi016.stdout:3/493: chown d9/l21 474925 1 2024-08-01T06:56:28.590 INFO:tasks.workunit.client.0.smithi016.stdout:2/763: write d0/d8/d31/f51 [823972,75057] 0 2024-08-01T06:56:28.590 INFO:tasks.workunit.client.0.smithi016.stdout:3/494: stat d9/d3e/d80/l8f 0 2024-08-01T06:56:28.611 INFO:tasks.workunit.client.0.smithi016.stdout:1/722: truncate d2/d3/d1a/d22/f9f 2714952 0 2024-08-01T06:56:28.611 INFO:tasks.workunit.client.0.smithi016.stdout:9/663: mkdir d3/d9/dd6 0 2024-08-01T06:56:28.612 INFO:tasks.workunit.client.0.smithi016.stdout:5/586: symlink d1/d2/d6/d9/d49/lce 0 2024-08-01T06:56:28.615 INFO:tasks.workunit.client.0.smithi016.stdout:9/664: mkdir d3/de/dd7 0 2024-08-01T06:56:28.616 INFO:tasks.workunit.client.0.smithi016.stdout:5/587: mknod d1/d2/d23/dbb/ccf 0 2024-08-01T06:56:28.617 INFO:tasks.workunit.client.0.smithi016.stdout:9/665: chown d3/d9/df/fcb 18122 1 2024-08-01T06:56:28.617 INFO:tasks.workunit.client.0.smithi016.stdout:1/723: dread d2/de/f5e [0,4194304] 0 2024-08-01T06:56:28.617 INFO:tasks.workunit.client.0.smithi016.stdout:2/764: mkdir d0/d8/d1b/dd9/dfc 0 2024-08-01T06:56:28.621 INFO:tasks.workunit.client.0.smithi016.stdout:1/724: symlink d2/de/d21/l100 0 2024-08-01T06:56:28.623 INFO:tasks.workunit.client.0.smithi016.stdout:9/666: rename d3/d9/db/d3e/dc6 to d3/d9/db/d3a/dd8 0 2024-08-01T06:56:28.624 INFO:tasks.workunit.client.0.smithi016.stdout:2/765: creat d0/d8/d31/dc7/ffd x:0 0 0 2024-08-01T06:56:28.626 INFO:tasks.workunit.client.0.smithi016.stdout:5/588: truncate d1/f54 2496463 0 2024-08-01T06:56:28.638 INFO:tasks.workunit.client.0.smithi016.stdout:1/725: symlink d2/de/l101 0 2024-08-01T06:56:28.641 INFO:tasks.workunit.client.0.smithi016.stdout:2/766: mkdir d0/d8/d1b/dfe 0 2024-08-01T06:56:28.643 INFO:tasks.workunit.client.0.smithi016.stdout:5/589: mkdir d1/d2/d6/d9/d19/d7a/dc5/dd0 0 2024-08-01T06:56:28.644 INFO:tasks.workunit.client.0.smithi016.stdout:9/667: rmdir d3/d9/db/d3e 39 2024-08-01T06:56:28.646 INFO:tasks.workunit.client.0.smithi016.stdout:3/495: dwrite d9/da/df/d12/d20/d5c/f9d [0,4194304] 0 2024-08-01T06:56:28.648 INFO:tasks.workunit.client.0.smithi016.stdout:1/726: dwrite d2/f2a [0,4194304] 0 2024-08-01T06:56:28.650 INFO:tasks.workunit.client.0.smithi016.stdout:2/767: dread d0/d8/d1b/dcc/f80 [0,4194304] 0 2024-08-01T06:56:28.653 INFO:tasks.workunit.client.0.smithi016.stdout:1/727: chown d2/d2f/dba/le3 1 1 2024-08-01T06:56:28.653 INFO:tasks.workunit.client.0.smithi016.stdout:5/590: rmdir d1/d2/d6/d9/d19/d7a 39 2024-08-01T06:56:28.655 INFO:tasks.workunit.client.0.smithi016.stdout:9/668: dread d3/f6a [0,4194304] 0 2024-08-01T06:56:28.656 INFO:tasks.workunit.client.0.smithi016.stdout:2/768: readlink d0/l12 0 2024-08-01T06:56:28.657 INFO:tasks.workunit.client.0.smithi016.stdout:9/669: chown d3/d9/df/d2a/f76 171 1 2024-08-01T06:56:28.658 INFO:tasks.workunit.client.0.smithi016.stdout:3/496: mkdir d9/da/df/d2a/d49/d61/da8 0 2024-08-01T06:56:28.663 INFO:tasks.workunit.client.0.smithi016.stdout:1/728: symlink d2/d3/d41/d49/d85/l102 0 2024-08-01T06:56:28.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.671+0000 7fcd433c5640 1 -- 172.21.15.16:0/2086408668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd3c0feaf0 msgr2=0x7fcd3c0feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:28.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.671+0000 7fcd433c5640 1 --2- 172.21.15.16:0/2086408668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd3c0feaf0 0x7fcd3c0feef0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009880 tx=0x7fcd3802a4a0 comp rx=0 tx=0).stop 2024-08-01T06:56:28.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.671+0000 7fcd433c5640 1 -- 172.21.15.16:0/2086408668 shutdown_connections 2024-08-01T06:56:28.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.671+0000 7fcd433c5640 1 --2- 172.21.15.16:0/2086408668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd3c0ffcf0 0x7fcd3c100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:28.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.671+0000 7fcd433c5640 1 --2- 172.21.15.16:0/2086408668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd3c0feaf0 0x7fcd3c0feef0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:28.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.671+0000 7fcd433c5640 1 -- 172.21.15.16:0/2086408668 >> 172.21.15.16:0/2086408668 conn(0x7fcd3c0fa280 msgr2=0x7fcd3c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:56:28.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.671+0000 7fcd433c5640 1 -- 172.21.15.16:0/2086408668 shutdown_connections 2024-08-01T06:56:28.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.671+0000 7fcd433c5640 1 -- 172.21.15.16:0/2086408668 wait complete. 2024-08-01T06:56:28.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.672+0000 7fcd433c5640 1 Processor -- start 2024-08-01T06:56:28.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.672+0000 7fcd433c5640 1 -- start start 2024-08-01T06:56:28.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.672+0000 7fcd433c5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd3c0feaf0 0x7fcd3c102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:28.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.672+0000 7fcd433c5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd3c0ffcf0 0x7fcd3c1010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:28.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.672+0000 7fcd433c5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c101610 con 0x7fcd3c0ffcf0 2024-08-01T06:56:28.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.672+0000 7fcd433c5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c101780 con 0x7fcd3c0feaf0 2024-08-01T06:56:28.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.672+0000 7fcd40960640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd3c0ffcf0 0x7fcd3c1010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:28.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.672+0000 7fcd40960640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd3c0ffcf0 0x7fcd3c1010d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43030/0 (socket says 172.21.15.16:43030) 2024-08-01T06:56:28.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.672+0000 7fcd40960640 1 -- 172.21.15.16:0/603481958 learned_addr learned my addr 172.21.15.16:0/603481958 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:56:28.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.672+0000 7fcd41161640 1 --2- 172.21.15.16:0/603481958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd3c0feaf0 0x7fcd3c102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:28.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.672+0000 7fcd40960640 1 -- 172.21.15.16:0/603481958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd3c0feaf0 msgr2=0x7fcd3c102a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:28.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.672+0000 7fcd40960640 1 --2- 172.21.15.16:0/603481958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd3c0feaf0 0x7fcd3c102a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:28.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.672+0000 7fcd40960640 1 -- 172.21.15.16:0/603481958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd38009560 con 0x7fcd3c0ffcf0 2024-08-01T06:56:28.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.673+0000 7fcd40960640 1 --2- 172.21.15.16:0/603481958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd3c0ffcf0 0x7fcd3c1010d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00d6f0 tx=0x7fcd2c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:56:28.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.673+0000 7fcd327fc640 1 -- 172.21.15.16:0/603481958 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd2c009a30 con 0x7fcd3c0ffcf0 2024-08-01T06:56:28.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.673+0000 7fcd327fc640 1 -- 172.21.15.16:0/603481958 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd2c0054e0 con 0x7fcd3c0ffcf0 2024-08-01T06:56:28.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.673+0000 7fcd433c5640 1 -- 172.21.15.16:0/603481958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3c101a60 con 0x7fcd3c0ffcf0 2024-08-01T06:56:28.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.673+0000 7fcd327fc640 1 -- 172.21.15.16:0/603481958 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd2c010460 con 0x7fcd3c0ffcf0 2024-08-01T06:56:28.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.673+0000 7fcd433c5640 1 -- 172.21.15.16:0/603481958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3c19d740 con 0x7fcd3c0ffcf0 2024-08-01T06:56:28.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.674+0000 7fcd433c5640 1 -- 172.21.15.16:0/603481958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd3c0feef0 con 0x7fcd3c0ffcf0 2024-08-01T06:56:28.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.675+0000 7fcd327fc640 1 -- 172.21.15.16:0/603481958 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) v1 ==== 91559+0+0 (secure 0 0 0) 0x7fcd2c009b90 con 0x7fcd3c0ffcf0 2024-08-01T06:56:28.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.675+0000 7fcd327fc640 1 --2- 172.21.15.16:0/603481958 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fcd2806d660 0x7fcd2806fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:28.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.675+0000 7fcd327fc640 1 -- 172.21.15.16:0/603481958 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fcd2c08c870 con 0x7fcd3c0ffcf0 2024-08-01T06:56:28.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.675+0000 7fcd41161640 1 --2- 172.21.15.16:0/603481958 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fcd2806d660 0x7fcd2806fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:28.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.676+0000 7fcd41161640 1 --2- 172.21.15.16:0/603481958 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fcd2806d660 0x7fcd2806fb20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009230 tx=0x7fcd380314e0 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:56:28.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:28.684+0000 7fcd327fc640 1 -- 172.21.15.16:0/603481958 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fcd2c056180 con 0x7fcd3c0ffcf0 2024-08-01T06:56:28.702 INFO:tasks.workunit.client.0.smithi016.stdout:9/670: mkdir d3/d32/d5c/dd9 0 2024-08-01T06:56:28.704 INFO:tasks.workunit.client.0.smithi016.stdout:3/497: creat d9/da/d96/fa9 x:0 0 0 2024-08-01T06:56:28.705 INFO:tasks.workunit.client.0.smithi016.stdout:3/498: chown d9/da/df/f45 466 1 2024-08-01T06:56:28.705 INFO:tasks.workunit.client.0.smithi016.stdout:5/591: unlink d1/d2/d6/d5a/l41 0 2024-08-01T06:56:28.707 INFO:tasks.workunit.client.0.smithi016.stdout:1/729: creat d2/de/d4d/f103 x:0 0 0 2024-08-01T06:56:28.709 INFO:tasks.workunit.client.0.smithi016.stdout:9/671: mkdir d3/d9/d73/dda 0 2024-08-01T06:56:28.709 INFO:tasks.workunit.client.0.smithi016.stdout:1/730: truncate d2/d3/d1a/d22/fea 731594 0 2024-08-01T06:56:28.711 INFO:tasks.workunit.client.0.smithi016.stdout:3/499: rmdir d9/da/d18 39 2024-08-01T06:56:28.714 INFO:tasks.workunit.client.0.smithi016.stdout:9/672: creat d3/d9/d46/d48/dce/fdb x:0 0 0 2024-08-01T06:56:28.718 INFO:tasks.workunit.client.0.smithi016.stdout:5/592: mknod d1/d2/d6/d9/d19/cd1 0 2024-08-01T06:56:28.731 INFO:tasks.workunit.client.0.smithi016.stdout:5/593: dread d1/d2/d23/f32 [0,4194304] 0 2024-08-01T06:56:28.732 INFO:tasks.workunit.client.0.smithi016.stdout:3/500: rmdir d9/da/df/d2a/d49/d61/da8 0 2024-08-01T06:56:28.735 INFO:tasks.workunit.client.0.smithi016.stdout:9/673: dread d3/d32/d5c/d8a/d57/f82 [0,4194304] 0 2024-08-01T06:56:28.742 INFO:tasks.workunit.client.0.smithi016.stdout:3/501: creat d9/da/df/d12/faa x:0 0 0 2024-08-01T06:56:28.745 INFO:tasks.workunit.client.0.smithi016.stdout:5/594: rename d1/d2/d6/d9/d49/d57/db1/fb5 to d1/d2/d6/fd2 0 2024-08-01T06:56:28.747 INFO:tasks.workunit.client.0.smithi016.stdout:5/595: fsync d1/d2/f6e 0 2024-08-01T06:56:28.747 INFO:tasks.workunit.client.0.smithi016.stdout:9/674: link d3/c7 d3/d9/db/dc/d56/d9b/cdc 0 2024-08-01T06:56:28.757 INFO:tasks.workunit.client.0.smithi016.stdout:3/502: getdents d9/da/df/d2a/d49 0 2024-08-01T06:56:28.760 INFO:tasks.workunit.client.0.smithi016.stdout:9/675: mknod d3/d32/d5c/dd9/cdd 0 2024-08-01T06:56:28.760 INFO:tasks.workunit.client.0.smithi016.stdout:5/596: write d1/f83 [459753,103166] 0 2024-08-01T06:56:28.764 INFO:tasks.workunit.client.0.smithi016.stdout:9/676: mkdir d3/d9/df/d2a/dde 0 2024-08-01T06:56:28.765 INFO:tasks.workunit.client.0.smithi016.stdout:3/503: dwrite d9/da/df/d2a/d49/f68 [0,4194304] 0 2024-08-01T06:56:28.767 INFO:tasks.workunit.client.0.smithi016.stdout:5/597: mkdir d1/d2/d6/d9/d19/dd3 0 2024-08-01T06:56:28.769 INFO:tasks.workunit.client.0.smithi016.stdout:7/580: sync 2024-08-01T06:56:28.770 INFO:tasks.workunit.client.0.smithi016.stdout:9/677: getdents d3/d9/dd6 0 2024-08-01T06:56:28.771 INFO:tasks.workunit.client.0.smithi016.stdout:9/678: readlink d3/de/lb0 0 2024-08-01T06:56:28.773 INFO:tasks.workunit.client.0.smithi016.stdout:7/581: chown d7/db/d17/d72/d1e/d26/d63/l87 23 1 2024-08-01T06:56:28.775 INFO:tasks.workunit.client.0.smithi016.stdout:7/582: read d7/db/d17/d72/d1c/d1d/d40/d58/d80/fad [2946536,27807] 0 2024-08-01T06:56:28.777 INFO:tasks.workunit.client.0.smithi016.stdout:9/679: creat d3/d9/db/dc/d56/fdf x:0 0 0 2024-08-01T06:56:28.777 INFO:tasks.workunit.client.0.smithi016.stdout:5/598: mknod d1/d2/d6/d9/d19/d7a/dc5/dd0/cd4 0 2024-08-01T06:56:28.781 INFO:tasks.workunit.client.0.smithi016.stdout:5/599: fsync d1/d2/d6/d9/f6a 0 2024-08-01T06:56:28.782 INFO:tasks.workunit.client.0.smithi016.stdout:3/504: dwrite d9/da/df/f45 [0,4194304] 0 2024-08-01T06:56:28.783 INFO:tasks.workunit.client.0.smithi016.stdout:7/583: creat d7/db/d17/d72/d1c/d4f/fda x:0 0 0 2024-08-01T06:56:28.787 INFO:tasks.workunit.client.0.smithi016.stdout:5/600: read d1/d12/d3e/f66 [837900,93062] 0 2024-08-01T06:56:28.790 INFO:tasks.workunit.client.0.smithi016.stdout:3/505: symlink d9/da/df/d12/d20/d5c/d7a/lab 0 2024-08-01T06:56:28.792 INFO:tasks.workunit.client.0.smithi016.stdout:9/680: dwrite d3/d9/df/d2a/f76 [0,4194304] 0 2024-08-01T06:56:28.793 INFO:tasks.workunit.client.0.smithi016.stdout:9/681: stat d3/de/fc7 0 2024-08-01T06:56:28.798 INFO:tasks.workunit.client.0.smithi016.stdout:5/601: write d1/d2/d6/d9/d19/fb0 [51828,72088] 0 2024-08-01T06:56:28.800 INFO:tasks.workunit.client.0.smithi016.stdout:7/584: mknod d7/db/d17/d72/d1c/d1d/cdb 0 2024-08-01T06:56:28.808 INFO:tasks.workunit.client.0.smithi016.stdout:3/506: dwrite d9/d3e/f2d [8388608,4194304] 0 2024-08-01T06:56:28.811 INFO:tasks.workunit.client.0.smithi016.stdout:7/585: mkdir d7/db/d17/d72/d22/d77/d99/dd1/ddc 0 2024-08-01T06:56:28.818 INFO:tasks.workunit.client.0.smithi016.stdout:7/586: mkdir d7/db/d17/d72/d1e/d26/d63/ddd 0 2024-08-01T06:56:28.819 INFO:tasks.workunit.client.0.smithi016.stdout:7/587: chown d7/db/d17/d72/d22/d77/d99/fa4 11082 1 2024-08-01T06:56:28.821 INFO:tasks.workunit.client.0.smithi016.stdout:3/507: mknod d9/da/df/d12/d75/cac 0 2024-08-01T06:56:28.821 INFO:tasks.workunit.client.0.smithi016.stdout:3/508: readlink d9/da/l5b 0 2024-08-01T06:56:28.823 INFO:tasks.workunit.client.0.smithi016.stdout:5/602: dread d1/d12/d3e/fa9 [0,4194304] 0 2024-08-01T06:56:28.824 INFO:tasks.workunit.client.0.smithi016.stdout:5/603: chown d1/d12/d3e/f66 2008 1 2024-08-01T06:56:28.830 INFO:tasks.workunit.client.0.smithi016.stdout:7/588: unlink d7/db/d17/d72/d1e/l61 0 2024-08-01T06:56:28.831 INFO:tasks.workunit.client.0.smithi016.stdout:5/604: dread d1/d2/d6/d9/d49/d57/f64 [0,4194304] 0 2024-08-01T06:56:28.832 INFO:tasks.workunit.client.0.smithi016.stdout:9/682: dwrite d3/d9/db/dc/d56/f86 [0,4194304] 0 2024-08-01T06:56:28.834 INFO:tasks.workunit.client.0.smithi016.stdout:5/605: write d1/d2/d6/d9/d49/fbf [381192,122479] 0 2024-08-01T06:56:28.843 INFO:tasks.workunit.client.0.smithi016.stdout:3/509: link d9/d1c/c44 d9/cad 0 2024-08-01T06:56:28.844 INFO:tasks.workunit.client.0.smithi016.stdout:7/589: fdatasync d7/db/d17/d72/d1c/d79/d8f/f2e 0 2024-08-01T06:56:28.847 INFO:tasks.workunit.client.0.smithi016.stdout:5/606: readlink d1/d2/d20/d68/lc1 0 2024-08-01T06:56:28.849 INFO:tasks.workunit.client.0.smithi016.stdout:5/607: truncate d1/d2/d6/d5a/da1/fa7 795 0 2024-08-01T06:56:28.851 INFO:tasks.workunit.client.0.smithi016.stdout:3/510: creat d9/da/df/d12/d20/d5c/d76/fae x:0 0 0 2024-08-01T06:56:28.854 INFO:tasks.workunit.client.0.smithi016.stdout:9/683: getdents d3/d32/d5c/d8a/d57 0 2024-08-01T06:56:28.855 INFO:tasks.workunit.client.0.smithi016.stdout:9/684: write d3/de/d89/fbf [136566,51968] 0 2024-08-01T06:56:28.856 INFO:tasks.workunit.client.0.smithi016.stdout:5/608: creat d1/d2/d6/d9/d49/d57/db1/fd5 x:0 0 0 2024-08-01T06:56:28.860 INFO:tasks.workunit.client.0.smithi016.stdout:9/685: rmdir d3/d32/d5c 39 2024-08-01T06:56:28.863 INFO:tasks.workunit.client.0.smithi016.stdout:3/511: creat d9/da/df/d53/faf x:0 0 0 2024-08-01T06:56:28.864 INFO:tasks.workunit.client.0.smithi016.stdout:3/512: chown d9/f29 32 1 2024-08-01T06:56:28.864 INFO:tasks.workunit.client.0.smithi016.stdout:5/609: rename d1/d2/l6d to d1/d12/d7d/ld6 0 2024-08-01T06:56:28.865 INFO:tasks.workunit.client.0.smithi016.stdout:3/513: fsync d9/da/df/d12/faa 0 2024-08-01T06:56:28.866 INFO:tasks.workunit.client.0.smithi016.stdout:5/610: fdatasync d1/f5 0 2024-08-01T06:56:28.866 INFO:tasks.workunit.client.0.smithi016.stdout:3/514: readlink d9/l21 0 2024-08-01T06:56:28.867 INFO:tasks.workunit.client.0.smithi016.stdout:7/590: link d7/db/d17/d72/d1e/d26/d63/cb8 d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/cde 0 2024-08-01T06:56:28.870 INFO:tasks.workunit.client.0.smithi016.stdout:9/686: rename d3/d9/df/d16/lc2 to d3/d9/db/dc/le0 0 2024-08-01T06:56:28.871 INFO:tasks.workunit.client.0.smithi016.stdout:7/591: dread d7/db/d17/d72/fd5 [0,4194304] 0 2024-08-01T06:56:28.871 INFO:tasks.workunit.client.0.smithi016.stdout:9/687: read d3/f6a [55313,116209] 0 2024-08-01T06:56:28.880 INFO:tasks.workunit.client.0.smithi016.stdout:9/688: dwrite d3/d9/df/d16/f1e [4194304,4194304] 0 2024-08-01T06:56:28.881 INFO:tasks.workunit.client.0.smithi016.stdout:7/592: rmdir d7/db/d17/d72/d1e/d26/d63/dc0 39 2024-08-01T06:56:28.890 INFO:tasks.workunit.client.0.smithi016.stdout:7/593: dwrite d7/db/d17/d72/d22/fc2 [0,4194304] 0 2024-08-01T06:56:28.892 INFO:tasks.workunit.client.0.smithi016.stdout:7/594: write d7/db/d17/d72/d1e/f51 [2296052,62744] 0 2024-08-01T06:56:28.896 INFO:tasks.workunit.client.0.smithi016.stdout:3/515: creat d9/da/df/d12/fb0 x:0 0 0 2024-08-01T06:56:28.905 INFO:tasks.workunit.client.0.smithi016.stdout:7/595: mkdir d7/db/d17/d72/d1c/d79/d8f/ddf 0 2024-08-01T06:56:28.920 INFO:tasks.workunit.client.0.smithi016.stdout:5/611: dwrite d1/d2/d6/f6b [0,4194304] 0 2024-08-01T06:56:28.923 INFO:tasks.workunit.client.0.smithi016.stdout:9/689: dwrite d3/d9/df/f3d [0,4194304] 0 2024-08-01T06:56:28.925 INFO:tasks.workunit.client.0.smithi016.stdout:9/690: dread - d3/d9/df/d16/fcd zero size 2024-08-01T06:56:28.927 INFO:tasks.workunit.client.0.smithi016.stdout:5/612: mknod d1/d12/cd7 0 2024-08-01T06:56:28.930 INFO:tasks.workunit.client.0.smithi016.stdout:3/516: write d9/da/df/d12/f94 [860240,43037] 0 2024-08-01T06:56:28.935 INFO:tasks.workunit.client.0.smithi016.stdout:5/613: dread d1/d2/d6/d9/d19/fb0 [0,4194304] 0 2024-08-01T06:56:28.935 INFO:tasks.workunit.client.0.smithi016.stdout:3/517: creat d9/d4e/d81/fb1 x:0 0 0 2024-08-01T06:56:28.937 INFO:tasks.workunit.client.0.smithi016.stdout:9/691: dwrite d3/d9/db/d3e/f99 [0,4194304] 0 2024-08-01T06:56:28.947 INFO:tasks.workunit.client.0.smithi016.stdout:5/614: truncate d1/d12/d8c/f90 3988339 0 2024-08-01T06:56:28.949 INFO:tasks.workunit.client.0.smithi016.stdout:9/692: symlink d3/d32/d5c/d8a/le1 0 2024-08-01T06:56:28.951 INFO:tasks.workunit.client.0.smithi016.stdout:5/615: mkdir d1/d2/d6/d9/dd8 0 2024-08-01T06:56:28.960 INFO:tasks.workunit.client.0.smithi016.stdout:5/616: dwrite d1/d12/d3e/f66 [0,4194304] 0 2024-08-01T06:56:28.960 INFO:tasks.workunit.client.0.smithi016.stdout:9/693: write d3/d9/db/d3e/f68 [693831,40307] 0 2024-08-01T06:56:28.963 INFO:tasks.workunit.client.0.smithi016.stdout:5/617: creat d1/d12/d7d/fd9 x:0 0 0 2024-08-01T06:56:28.964 INFO:tasks.workunit.client.0.smithi016.stdout:5/618: chown d1/d2/d6 24575514 1 2024-08-01T06:56:28.966 INFO:tasks.workunit.client.0.smithi016.stdout:5/619: truncate d1/d2/d6/d9/d49/fbf 680654 0 2024-08-01T06:56:28.968 INFO:tasks.workunit.client.0.smithi016.stdout:9/694: mknod d3/d9/d73/dda/ce2 0 2024-08-01T06:56:28.970 INFO:tasks.workunit.client.0.smithi016.stdout:9/695: chown d3/d9/df/d16/f30 1933640049 1 2024-08-01T06:56:28.971 INFO:tasks.workunit.client.0.smithi016.stdout:5/620: mkdir d1/d2/d6/d9/d1b/dda 0 2024-08-01T06:56:28.974 INFO:tasks.workunit.client.0.smithi016.stdout:9/696: creat d3/de/dd7/fe3 x:0 0 0 2024-08-01T06:56:28.975 INFO:tasks.workunit.client.0.smithi016.stdout:9/697: stat d3/de/d89 0 2024-08-01T06:56:28.977 INFO:tasks.workunit.client.0.smithi016.stdout:5/621: getdents d1/d2 0 2024-08-01T06:56:28.978 INFO:tasks.workunit.client.0.smithi016.stdout:9/698: creat d3/d9/d46/d48/fe4 x:0 0 0 2024-08-01T06:56:28.978 INFO:tasks.workunit.client.0.smithi016.stdout:9/699: chown d3/de/d6d/fd5 987533 1 2024-08-01T06:56:28.982 INFO:tasks.workunit.client.0.smithi016.stdout:5/622: read d1/d2/f43 [1835857,8443] 0 2024-08-01T06:56:28.982 INFO:tasks.workunit.client.0.smithi016.stdout:9/700: creat d3/d32/d5c/d8a/fe5 x:0 0 0 2024-08-01T06:56:28.983 INFO:tasks.workunit.client.0.smithi016.stdout:9/701: chown d3/d9/d73/f9e 14089 1 2024-08-01T06:56:28.990 INFO:tasks.workunit.client.0.smithi016.stdout:5/623: rename d1/d2/d6/d9/d19/d7a/f8f to d1/d2/d20/d38/fdb 0 2024-08-01T06:56:28.993 INFO:tasks.workunit.client.0.smithi016.stdout:5/624: fdatasync d1/d2/f43 0 2024-08-01T06:56:28.998 INFO:tasks.workunit.client.0.smithi016.stdout:5/625: truncate d1/d2/f48 1699350 0 2024-08-01T06:56:29.003 INFO:tasks.workunit.client.0.smithi016.stdout:9/702: dread d3/de/d89/fa9 [0,4194304] 0 2024-08-01T06:56:29.003 INFO:tasks.workunit.client.0.smithi016.stdout:9/703: fdatasync d3/d9/d46/d48/f55 0 2024-08-01T06:56:29.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.007+0000 7fcd433c5640 1 -- 172.21.15.16:0/603481958 --> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd3c107700 con 0x7fcd2806d660 2024-08-01T06:56:29.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.017+0000 7fcd327fc640 1 -- 172.21.15.16:0/603481958 <== mgr.24423 v2:172.21.15.89:6828/2589785296 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fcd3c107700 con 0x7fcd2806d660 2024-08-01T06:56:29.019 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T06:56:29.019 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (7m) 37s ago 8m 25.3M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T06:56:29.019 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (8m) 37s ago 8m 7906k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T06:56:29.019 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (7m) 35s ago 7m 7818k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T06:56:29.020 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (8m) 37s ago 8m 6895k - 18.2.2-1767-ga3bbd728 d280790d1980 81c723a6ae35 2024-08-01T06:56:29.020 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (7m) 35s ago 7m 6891k - 18.2.2-1767-ga3bbd728 d280790d1980 73e7778d1e26 2024-08-01T06:56:29.020 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (6m) 37s ago 8m 86.2M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T06:56:29.020 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (3m) 37s ago 3m 92.8M - 18.2.2-1767-ga3bbd728 d280790d1980 96e46c28d16c 2024-08-01T06:56:29.020 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (3m) 37s ago 3m 151M - 18.2.2-1767-ga3bbd728 d280790d1980 4bbe1a388689 2024-08-01T06:56:29.020 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (3m) 35s ago 3m 21.5M - 18.2.2-1767-ga3bbd728 d280790d1980 65ca121a6fbb 2024-08-01T06:56:29.020 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (3m) 35s ago 3m 20.7M - 18.2.2-1767-ga3bbd728 d280790d1980 05bb46c6fe94 2024-08-01T06:56:29.020 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:9283,8765,8443 running (9m) 37s ago 9m 202M - 18.2.2-1767-ga3bbd728 d280790d1980 3cf8ca2d43c6 2024-08-01T06:56:29.020 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (61s) 35s ago 7m 476M - 19.1.0-1223-gf9911e17 93d93c74a2cc 175fc6a24b65 2024-08-01T06:56:29.020 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (9m) 37s ago 9m 53.4M 2048M 18.2.2-1767-ga3bbd728 d280790d1980 e6a2e5d7eeec 2024-08-01T06:56:29.021 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (7m) 35s ago 7m 42.9M 2048M 18.2.2-1767-ga3bbd728 d280790d1980 9ca9e3e814cb 2024-08-01T06:56:29.021 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (8m) 37s ago 8m 15.8M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T06:56:29.021 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (7m) 35s ago 7m 16.5M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T06:56:29.021 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (6m) 37s ago 6m 114M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 9b7157499583 2024-08-01T06:56:29.021 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (6m) 37s ago 6m 124M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 f3b050aed6b7 2024-08-01T06:56:29.021 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (5m) 37s ago 5m 111M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 33a72e1a5c91 2024-08-01T06:56:29.022 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (5m) 35s ago 5m 125M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 58c175e0f4eb 2024-08-01T06:56:29.023 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (5m) 35s ago 5m 123M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 15b8f910bad7 2024-08-01T06:56:29.023 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (4m) 35s ago 4m 116M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 ac887841899e 2024-08-01T06:56:29.023 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (6m) 37s ago 8m 64.5M - 2.43.0 a07b618ecd1d 2b370118fafe 2024-08-01T06:56:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.019+0000 7fcd433c5640 1 -- 172.21.15.16:0/603481958 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fcd2806d660 msgr2=0x7fcd2806fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.019+0000 7fcd433c5640 1 --2- 172.21.15.16:0/603481958 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fcd2806d660 0x7fcd2806fb20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009230 tx=0x7fcd380314e0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.019+0000 7fcd433c5640 1 -- 172.21.15.16:0/603481958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd3c0ffcf0 msgr2=0x7fcd3c1010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.019+0000 7fcd433c5640 1 --2- 172.21.15.16:0/603481958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd3c0ffcf0 0x7fcd3c1010d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00d6f0 tx=0x7fcd2c00dbb0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.019+0000 7fcd433c5640 1 -- 172.21.15.16:0/603481958 shutdown_connections 2024-08-01T06:56:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.019+0000 7fcd433c5640 1 --2- 172.21.15.16:0/603481958 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fcd2806d660 0x7fcd2806fb20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.019+0000 7fcd433c5640 1 --2- 172.21.15.16:0/603481958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd3c0ffcf0 0x7fcd3c1010d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.019+0000 7fcd433c5640 1 --2- 172.21.15.16:0/603481958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd3c0feaf0 0x7fcd3c102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.019+0000 7fcd433c5640 1 -- 172.21.15.16:0/603481958 >> 172.21.15.16:0/603481958 conn(0x7fcd3c0fa280 msgr2=0x7fcd3c067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:56:29.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.019+0000 7fcd433c5640 1 -- 172.21.15.16:0/603481958 shutdown_connections 2024-08-01T06:56:29.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.019+0000 7fcd433c5640 1 -- 172.21.15.16:0/603481958 wait complete. 2024-08-01T06:56:29.078 INFO:tasks.workunit.client.0.smithi016.stdout:8/483: sync 2024-08-01T06:56:29.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.100+0000 7f82f9255640 1 -- 172.21.15.16:0/1747219179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82f40fde80 msgr2=0x7f82f40fe280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:29.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.100+0000 7f82f9255640 1 --2- 172.21.15.16:0/1747219179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82f40fde80 0x7f82f40fe280 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009880 tx=0x7f82e402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.101+0000 7f82f9255640 1 -- 172.21.15.16:0/1747219179 shutdown_connections 2024-08-01T06:56:29.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.101+0000 7f82f9255640 1 --2- 172.21.15.16:0/1747219179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82f4100f00 0x7f82f4101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.101+0000 7f82f9255640 1 --2- 172.21.15.16:0/1747219179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82f40fde80 0x7f82f40fe280 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.101+0000 7f82f9255640 1 -- 172.21.15.16:0/1747219179 >> 172.21.15.16:0/1747219179 conn(0x7f82f40f99b0 msgr2=0x7f82f40fbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:56:29.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.101+0000 7f82f9255640 1 -- 172.21.15.16:0/1747219179 shutdown_connections 2024-08-01T06:56:29.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.101+0000 7f82f9255640 1 -- 172.21.15.16:0/1747219179 wait complete. 2024-08-01T06:56:29.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.101+0000 7f82f9255640 1 Processor -- start 2024-08-01T06:56:29.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.102+0000 7f82f9255640 1 -- start start 2024-08-01T06:56:29.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.102+0000 7f82f9255640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82f40fde80 0x7f82f4100860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:29.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.102+0000 7f82f9255640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82f4100f00 0x7f82f40feeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:29.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.102+0000 7f82f9255640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f40ff3f0 con 0x7f82f4100f00 2024-08-01T06:56:29.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.102+0000 7f82f9255640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f40ff560 con 0x7f82f40fde80 2024-08-01T06:56:29.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.102+0000 7f82f259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82f4100f00 0x7f82f40feeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:29.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.102+0000 7f82f2d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82f40fde80 0x7f82f4100860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:29.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.102+0000 7f82f259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82f4100f00 0x7f82f40feeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36414/0 (socket says 172.21.15.16:36414) 2024-08-01T06:56:29.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.102+0000 7f82f259c640 1 -- 172.21.15.16:0/916589975 learned_addr learned my addr 172.21.15.16:0/916589975 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:56:29.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.102+0000 7f82f259c640 1 -- 172.21.15.16:0/916589975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82f40fde80 msgr2=0x7f82f4100860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:29.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.102+0000 7f82f259c640 1 --2- 172.21.15.16:0/916589975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82f40fde80 0x7f82f4100860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.102+0000 7f82f259c640 1 -- 172.21.15.16:0/916589975 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e4009560 con 0x7f82f4100f00 2024-08-01T06:56:29.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.102+0000 7f82f2d9d640 1 --2- 172.21.15.16:0/916589975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82f40fde80 0x7f82f4100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T06:56:29.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.102+0000 7f82f259c640 1 --2- 172.21.15.16:0/916589975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82f4100f00 0x7f82f40feeb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00d6f0 tx=0x7f82dc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:56:29.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.103+0000 7f82ebfff640 1 -- 172.21.15.16:0/916589975 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82dc009a30 con 0x7f82f4100f00 2024-08-01T06:56:29.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.103+0000 7f82f9255640 1 -- 172.21.15.16:0/916589975 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f40ff840 con 0x7f82f4100f00 2024-08-01T06:56:29.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.103+0000 7f82ebfff640 1 -- 172.21.15.16:0/916589975 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f82dc0054e0 con 0x7f82f4100f00 2024-08-01T06:56:29.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.103+0000 7f82ebfff640 1 -- 172.21.15.16:0/916589975 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82dc010460 con 0x7f82f4100f00 2024-08-01T06:56:29.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.103+0000 7f82f9255640 1 -- 172.21.15.16:0/916589975 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f419d690 con 0x7f82f4100f00 2024-08-01T06:56:29.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.104+0000 7f82f9255640 1 -- 172.21.15.16:0/916589975 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f41087b0 con 0x7f82f4100f00 2024-08-01T06:56:29.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.104+0000 7f82ebfff640 1 -- 172.21.15.16:0/916589975 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) v1 ==== 91559+0+0 (secure 0 0 0) 0x7f82dc009b90 con 0x7f82f4100f00 2024-08-01T06:56:29.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.105+0000 7f82ebfff640 1 --2- 172.21.15.16:0/916589975 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f82e006d660 0x7f82e006fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:29.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.105+0000 7f82ebfff640 1 -- 172.21.15.16:0/916589975 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f82dc08cca0 con 0x7f82f4100f00 2024-08-01T06:56:29.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.105+0000 7f82f2d9d640 1 --2- 172.21.15.16:0/916589975 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f82e006d660 0x7f82e006fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:29.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.105+0000 7f82f2d9d640 1 --2- 172.21.15.16:0/916589975 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f82e006d660 0x7f82e006fb20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009230 tx=0x7f82e40314e0 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:56:29.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.109+0000 7f82ebfff640 1 -- 172.21.15.16:0/916589975 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f82dc091070 con 0x7f82f4100f00 2024-08-01T06:56:29.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:28 smithi089 ceph-mon[36617]: pgmap v28: 65 pgs: 65 active+clean; 2.1 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 32 MiB/s rd, 85 MiB/s wr, 255 op/s 2024-08-01T06:56:29.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:28 smithi016 ceph-mon[29266]: pgmap v28: 65 pgs: 65 active+clean; 2.1 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 32 MiB/s rd, 85 MiB/s wr, 255 op/s 2024-08-01T06:56:29.182 INFO:tasks.workunit.client.0.smithi016.stdout:9/704: rename d3/d9/db/dc/d56/d9b/cdc to d3/d9/d73/ce6 0 2024-08-01T06:56:29.187 INFO:tasks.workunit.client.0.smithi016.stdout:9/705: dread d3/d9/db/d3e/d40/f59 [0,4194304] 0 2024-08-01T06:56:29.189 INFO:tasks.workunit.client.0.smithi016.stdout:9/706: write d3/d9/df/d16/f9f [978950,117659] 0 2024-08-01T06:56:29.194 INFO:tasks.workunit.client.0.smithi016.stdout:5/626: getdents d1/d2/d20/db8 0 2024-08-01T06:56:29.195 INFO:tasks.workunit.client.0.smithi016.stdout:0/527: sync 2024-08-01T06:56:29.197 INFO:tasks.workunit.client.0.smithi016.stdout:9/707: dwrite d3/de/f17 [4194304,4194304] 0 2024-08-01T06:56:29.199 INFO:tasks.workunit.client.0.smithi016.stdout:9/708: chown d3/de/d89/fbf 4182 1 2024-08-01T06:56:29.207 INFO:tasks.workunit.client.0.smithi016.stdout:5/627: write d1/d2/d6/fd [4471556,3520] 0 2024-08-01T06:56:29.210 INFO:tasks.workunit.client.0.smithi016.stdout:5/628: truncate d1/d2/d6/d9/d19/f40 4923698 0 2024-08-01T06:56:29.263 INFO:tasks.workunit.client.0.smithi016.stdout:5/629: write d1/d2/d6/d9/d49/d57/f89 [248007,5886] 0 2024-08-01T06:56:29.267 INFO:tasks.workunit.client.0.smithi016.stdout:5/630: write d1/d2/d6/d9/d49/d57/f82 [1123601,122666] 0 2024-08-01T06:56:29.269 INFO:tasks.workunit.client.0.smithi016.stdout:0/528: dwrite d10/f17 [0,4194304] 0 2024-08-01T06:56:29.272 INFO:tasks.workunit.client.0.smithi016.stdout:5/631: chown d1/d2/d6/d9/lf 2164432 1 2024-08-01T06:56:29.273 INFO:tasks.workunit.client.0.smithi016.stdout:5/632: chown d1/d2/d6/d5a/da1/fa7 7925433 1 2024-08-01T06:56:29.275 INFO:tasks.workunit.client.0.smithi016.stdout:0/529: unlink d10/l4b 0 2024-08-01T06:56:29.276 INFO:tasks.workunit.client.0.smithi016.stdout:8/484: rmdir d5/d8/d1a 39 2024-08-01T06:56:29.278 INFO:tasks.workunit.client.0.smithi016.stdout:5/633: creat d1/d2/d6/d9/d49/fdc x:0 0 0 2024-08-01T06:56:29.281 INFO:tasks.workunit.client.0.smithi016.stdout:8/485: rename d5/f38 to d5/d8/d1a/d24/d48/d69/fa2 0 2024-08-01T06:56:29.282 INFO:tasks.workunit.client.0.smithi016.stdout:8/486: fdatasync d5/d8/d1a/d24/d48/d6e/d92/d99/f9d 0 2024-08-01T06:56:29.304 INFO:tasks.workunit.client.0.smithi016.stdout:8/487: dread d5/d8/f94 [0,4194304] 0 2024-08-01T06:56:29.313 INFO:tasks.workunit.client.0.smithi016.stdout:8/488: dread d5/d8/f58 [0,4194304] 0 2024-08-01T06:56:29.338 INFO:tasks.workunit.client.0.smithi016.stdout:8/489: chown d5/d8/d1a/f29 25 1 2024-08-01T06:56:29.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.465+0000 7f82f9255640 1 -- 172.21.15.16:0/916589975 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f82f4108940 con 0x7f82f4100f00 2024-08-01T06:56:29.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.466+0000 7f82ebfff640 1 -- 172.21.15.16:0/916589975 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f82dc056490 con 0x7f82f4100f00 2024-08-01T06:56:29.469 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:56:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T06:56:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 2 2024-08-01T06:56:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:56:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T06:56:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 1, 2024-08-01T06:56:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 1 2024-08-01T06:56:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:56:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T06:56:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 6 2024-08-01T06:56:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:56:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T06:56:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4 2024-08-01T06:56:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:56:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T06:56:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 13, 2024-08-01T06:56:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 1 2024-08-01T06:56:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T06:56:29.470 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:56:29.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.468+0000 7f82f9255640 1 -- 172.21.15.16:0/916589975 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f82e006d660 msgr2=0x7f82e006fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:29.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.468+0000 7f82f9255640 1 --2- 172.21.15.16:0/916589975 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f82e006d660 0x7f82e006fb20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009230 tx=0x7f82e40314e0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.468+0000 7f82f9255640 1 -- 172.21.15.16:0/916589975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82f4100f00 msgr2=0x7f82f40feeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:29.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.468+0000 7f82f9255640 1 --2- 172.21.15.16:0/916589975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82f4100f00 0x7f82f40feeb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00d6f0 tx=0x7f82dc00dbb0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.468+0000 7f82f9255640 1 -- 172.21.15.16:0/916589975 shutdown_connections 2024-08-01T06:56:29.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.468+0000 7f82f9255640 1 --2- 172.21.15.16:0/916589975 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f82e006d660 0x7f82e006fb20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.468+0000 7f82f9255640 1 --2- 172.21.15.16:0/916589975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82f4100f00 0x7f82f40feeb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.468+0000 7f82f9255640 1 --2- 172.21.15.16:0/916589975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82f40fde80 0x7f82f4100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.468+0000 7f82f9255640 1 -- 172.21.15.16:0/916589975 >> 172.21.15.16:0/916589975 conn(0x7f82f40f99b0 msgr2=0x7f82f4104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:56:29.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.469+0000 7f82f9255640 1 -- 172.21.15.16:0/916589975 shutdown_connections 2024-08-01T06:56:29.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.469+0000 7f82f9255640 1 -- 172.21.15.16:0/916589975 wait complete. 2024-08-01T06:56:29.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.559+0000 7ff6aa893640 1 -- 172.21.15.16:0/4096498732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6a40ffb90 msgr2=0x7ff6a40fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:29.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.559+0000 7ff6aa893640 1 --2- 172.21.15.16:0/4096498732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6a40ffb90 0x7ff6a40fff90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff6940097e0 tx=0x7ff69402a3f0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.559+0000 7ff6aa893640 1 -- 172.21.15.16:0/4096498732 shutdown_connections 2024-08-01T06:56:29.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.559+0000 7ff6aa893640 1 --2- 172.21.15.16:0/4096498732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6a4100d90 0x7ff6a4101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.559+0000 7ff6aa893640 1 --2- 172.21.15.16:0/4096498732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6a40ffb90 0x7ff6a40fff90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.559+0000 7ff6aa893640 1 -- 172.21.15.16:0/4096498732 >> 172.21.15.16:0/4096498732 conn(0x7ff6a40fb360 msgr2=0x7ff6a40fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:56:29.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.559+0000 7ff6aa893640 1 -- 172.21.15.16:0/4096498732 shutdown_connections 2024-08-01T06:56:29.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.559+0000 7ff6aa893640 1 -- 172.21.15.16:0/4096498732 wait complete. 2024-08-01T06:56:29.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.560+0000 7ff6aa893640 1 Processor -- start 2024-08-01T06:56:29.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.560+0000 7ff6aa893640 1 -- start start 2024-08-01T06:56:29.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.560+0000 7ff6aa893640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6a40ffb90 0x7ff6a41978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:29.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.560+0000 7ff6aa893640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6a4100d90 0x7ff6a4197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:29.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.560+0000 7ff6aa893640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a4198400 con 0x7ff6a40ffb90 2024-08-01T06:56:29.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.560+0000 7ff6aa893640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a4198570 con 0x7ff6a4100d90 2024-08-01T06:56:29.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.560+0000 7ff6a3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6a40ffb90 0x7ff6a41978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:29.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.560+0000 7ff6a3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6a40ffb90 0x7ff6a41978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36442/0 (socket says 172.21.15.16:36442) 2024-08-01T06:56:29.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.560+0000 7ff6a3fff640 1 -- 172.21.15.16:0/4264512493 learned_addr learned my addr 172.21.15.16:0/4264512493 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:56:29.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.561+0000 7ff6a37fe640 1 --2- 172.21.15.16:0/4264512493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6a4100d90 0x7ff6a4197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:29.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.561+0000 7ff6a3fff640 1 -- 172.21.15.16:0/4264512493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6a4100d90 msgr2=0x7ff6a4197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:29.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.561+0000 7ff6a3fff640 1 --2- 172.21.15.16:0/4264512493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6a4100d90 0x7ff6a4197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.561+0000 7ff6a3fff640 1 -- 172.21.15.16:0/4264512493 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff694009490 con 0x7ff6a40ffb90 2024-08-01T06:56:29.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.561+0000 7ff6a3fff640 1 --2- 172.21.15.16:0/4264512493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6a40ffb90 0x7ff6a41978f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff694030c30 tx=0x7ff694004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:56:29.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.561+0000 7ff6a17fa640 1 -- 172.21.15.16:0/4264512493 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6940037c0 con 0x7ff6a40ffb90 2024-08-01T06:56:29.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.561+0000 7ff6a17fa640 1 -- 172.21.15.16:0/4264512493 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff694003de0 con 0x7ff6a40ffb90 2024-08-01T06:56:29.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.561+0000 7ff6aa893640 1 -- 172.21.15.16:0/4264512493 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a419cfb0 con 0x7ff6a40ffb90 2024-08-01T06:56:29.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.561+0000 7ff6a17fa640 1 -- 172.21.15.16:0/4264512493 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff694045460 con 0x7ff6a40ffb90 2024-08-01T06:56:29.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.561+0000 7ff6aa893640 1 -- 172.21.15.16:0/4264512493 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a419d420 con 0x7ff6a40ffb90 2024-08-01T06:56:29.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.563+0000 7ff6aa893640 1 -- 172.21.15.16:0/4264512493 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a41056d0 con 0x7ff6a40ffb90 2024-08-01T06:56:29.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.563+0000 7ff6a17fa640 1 -- 172.21.15.16:0/4264512493 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) v1 ==== 91559+0+0 (secure 0 0 0) 0x7ff694031400 con 0x7ff6a40ffb90 2024-08-01T06:56:29.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.564+0000 7ff6a17fa640 1 --2- 172.21.15.16:0/4264512493 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7ff68c06d650 0x7ff68c06fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:29.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.564+0000 7ff6a17fa640 1 -- 172.21.15.16:0/4264512493 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ff6940ae7f0 con 0x7ff6a40ffb90 2024-08-01T06:56:29.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.564+0000 7ff6a37fe640 1 --2- 172.21.15.16:0/4264512493 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7ff68c06d650 0x7ff68c06fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:29.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.565+0000 7ff6a37fe640 1 --2- 172.21.15.16:0/4264512493 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7ff68c06d650 0x7ff68c06fb10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4198e10 tx=0x7ff69800b410 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:56:29.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.569+0000 7ff6a17fa640 1 -- 172.21.15.16:0/4264512493 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7ff694077f30 con 0x7ff6a40ffb90 2024-08-01T06:56:29.760 INFO:tasks.workunit.client.0.smithi016.stdout:4/606: sync 2024-08-01T06:56:29.768 INFO:tasks.workunit.client.0.smithi016.stdout:4/607: truncate d0/d2/f1c 3761295 0 2024-08-01T06:56:29.774 INFO:tasks.workunit.client.0.smithi016.stdout:4/608: getdents d0/d2/dc/d12/dc7 0 2024-08-01T06:56:29.776 INFO:tasks.workunit.client.0.smithi016.stdout:4/609: getdents d0/d2/dc/d12/dc7 0 2024-08-01T06:56:29.783 INFO:tasks.workunit.client.0.smithi016.stdout:4/610: rename d0/d17/d22/d73/da9 to d0/d2/dcd 0 2024-08-01T06:56:29.783 INFO:tasks.workunit.client.0.smithi016.stdout:4/611: fdatasync d0/d17/d22/f6b 0 2024-08-01T06:56:29.790 INFO:tasks.workunit.client.0.smithi016.stdout:4/612: creat d0/d2/d36/dbd/fce x:0 0 0 2024-08-01T06:56:29.797 INFO:tasks.workunit.client.0.smithi016.stdout:4/613: link d0/d2/dc/c76 d0/d17/d22/d26/da3/ccf 0 2024-08-01T06:56:29.802 INFO:tasks.workunit.client.0.smithi016.stdout:4/614: fsync d0/d17/f39 0 2024-08-01T06:56:29.806 INFO:tasks.workunit.client.0.smithi016.stdout:4/615: write d0/d2/d36/f9f [1265032,48208] 0 2024-08-01T06:56:29.810 INFO:tasks.workunit.client.0.smithi016.stdout:4/616: rename d0/d2/dc/d12/lc0 to d0/d2/dcd/ld0 0 2024-08-01T06:56:29.811 INFO:tasks.workunit.client.0.smithi016.stdout:4/617: stat d0/d17/d38/f82 0 2024-08-01T06:56:29.814 INFO:tasks.workunit.client.0.smithi016.stdout:4/618: mkdir d0/d9d/da2/dd1 0 2024-08-01T06:56:29.815 INFO:tasks.workunit.client.0.smithi016.stdout:4/619: mkdir d0/d2/da0/dd2 0 2024-08-01T06:56:29.823 INFO:tasks.workunit.client.0.smithi016.stdout:4/620: dread d0/d2/fa [0,4194304] 0 2024-08-01T06:56:29.826 INFO:tasks.workunit.client.0.smithi016.stdout:4/621: rename d0/d17 to d0/d2/dc/d12/dd3 0 2024-08-01T06:56:29.829 INFO:tasks.workunit.client.0.smithi016.stdout:4/622: symlink d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d79/ld4 0 2024-08-01T06:56:29.831 INFO:tasks.workunit.client.0.smithi016.stdout:4/623: dread d0/d2/d68/f6f [0,4194304] 0 2024-08-01T06:56:29.832 INFO:tasks.workunit.client.0.smithi016.stdout:4/624: stat d0/d2/dc/d12/dd3/d38/f82 0 2024-08-01T06:56:29.835 INFO:tasks.workunit.client.0.smithi016.stdout:4/625: symlink d0/d2/dc/d90/ld5 0 2024-08-01T06:56:29.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.838+0000 7ff6aa893640 1 -- 172.21.15.16:0/4264512493 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff6a402c4e0 con 0x7ff6a40ffb90 2024-08-01T06:56:29.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.838+0000 7ff6a17fa640 1 -- 172.21.15.16:0/4264512493 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1868 (secure 0 0 0) 0x7ff69407b5f0 con 0x7ff6a40ffb90 2024-08-01T06:56:29.841 INFO:teuthology.orchestra.run.smithi016.stdout:e19 2024-08-01T06:56:29.841 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T06:56:29.842 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:56:29.842 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T06:56:29.842 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:56:29.842 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T06:56:29.842 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T06:56:29.842 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 19 2024-08-01T06:56:29.842 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T06:56:29.842 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T06:56:29.843 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T06:53:32.617145+0000 2024-08-01T06:56:29.843 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T06:56:29.843 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T06:56:29.843 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T06:56:29.843 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T06:56:29.843 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T06:56:29.843 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T06:56:29.843 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T06:56:29.843 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T06:56:29.843 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 46 2024-08-01T06:56:29.843 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:56:29.843 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T06:56:29.844 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T06:56:29.844 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=14482,1=24281} 2024-08-01T06:56:29.844 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T06:56:29.844 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T06:56:29.844 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T06:56:29.844 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T06:56:29.844 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T06:56:29.844 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T06:56:29.844 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T06:56:29.844 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T06:56:29.844 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T06:56:29.844 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:56:29.844 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:24299} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:56:29.844 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{1:24281} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:56:29.845 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:24291} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:56:29.845 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:56:29.845 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:56:29.845 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-08-01T06:56:29.845 INFO:tasks.workunit.client.0.smithi016.stdout:4/626: link d0/d2/dc/f34 d0/d2/dc/d12/dd3/fd6 0 2024-08-01T06:56:29.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.840+0000 7ff6aa893640 1 -- 172.21.15.16:0/4264512493 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7ff68c06d650 msgr2=0x7ff68c06fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:29.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.840+0000 7ff6aa893640 1 --2- 172.21.15.16:0/4264512493 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7ff68c06d650 0x7ff68c06fb10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4198e10 tx=0x7ff69800b410 comp rx=0 tx=0).stop 2024-08-01T06:56:29.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.840+0000 7ff6aa893640 1 -- 172.21.15.16:0/4264512493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6a40ffb90 msgr2=0x7ff6a41978f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:29.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.840+0000 7ff6aa893640 1 --2- 172.21.15.16:0/4264512493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6a40ffb90 0x7ff6a41978f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff694030c30 tx=0x7ff694004610 comp rx=0 tx=0).stop 2024-08-01T06:56:29.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.841+0000 7ff6aa893640 1 -- 172.21.15.16:0/4264512493 shutdown_connections 2024-08-01T06:56:29.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.841+0000 7ff6aa893640 1 --2- 172.21.15.16:0/4264512493 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7ff68c06d650 0x7ff68c06fb10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.841+0000 7ff6aa893640 1 --2- 172.21.15.16:0/4264512493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6a4100d90 0x7ff6a4197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.841+0000 7ff6aa893640 1 --2- 172.21.15.16:0/4264512493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6a40ffb90 0x7ff6a41978f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.841+0000 7ff6aa893640 1 -- 172.21.15.16:0/4264512493 >> 172.21.15.16:0/4264512493 conn(0x7ff6a40fb360 msgr2=0x7ff6a4072b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:56:29.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.841+0000 7ff6aa893640 1 -- 172.21.15.16:0/4264512493 shutdown_connections 2024-08-01T06:56:29.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.841+0000 7ff6aa893640 1 -- 172.21.15.16:0/4264512493 wait complete. 2024-08-01T06:56:29.847 INFO:tasks.workunit.client.0.smithi016.stdout:4/627: mknod d0/d2/dc/d90/cd7 0 2024-08-01T06:56:29.852 INFO:tasks.workunit.client.0.smithi016.stdout:4/628: dwrite d0/d2/dc/d12/dd3/d38/f82 [0,4194304] 0 2024-08-01T06:56:29.883 INFO:tasks.workunit.client.0.smithi016.stdout:4/629: truncate d0/d2/dc/d12/dd3/d22/f31 2346150 0 2024-08-01T06:56:29.885 INFO:tasks.workunit.client.0.smithi016.stdout:4/630: readlink d0/d2/dc/d90/lbb 0 2024-08-01T06:56:29.893 INFO:tasks.workunit.client.0.smithi016.stdout:4/631: dwrite d0/d2/dc/d12/dd3/d22/d26/d85/dc1/f8a [0,4194304] 0 2024-08-01T06:56:29.897 INFO:tasks.workunit.client.0.smithi016.stdout:4/632: fsync d0/fb 0 2024-08-01T06:56:29.899 INFO:tasks.workunit.client.0.smithi016.stdout:4/633: rmdir d0/d2/dc/d90 39 2024-08-01T06:56:29.902 INFO:tasks.workunit.client.0.smithi016.stdout:4/634: fsync d0/d2/da0/fad 0 2024-08-01T06:56:29.904 INFO:tasks.workunit.client.0.smithi016.stdout:4/635: write d0/d2/dc/d12/dd3/f9c [350029,64180] 0 2024-08-01T06:56:29.914 INFO:tasks.workunit.client.0.smithi016.stdout:4/636: creat d0/d2/fd8 x:0 0 0 2024-08-01T06:56:29.922 INFO:tasks.workunit.client.0.smithi016.stdout:4/637: write d0/d2/d68/f7a [513232,54400] 0 2024-08-01T06:56:29.924 INFO:tasks.workunit.client.0.smithi016.stdout:4/638: chown d0/d2/dc/d12/dd3/d22/d7f/d93/f95 22241 1 2024-08-01T06:56:29.926 INFO:tasks.workunit.client.0.smithi016.stdout:4/639: creat d0/d2/da0/fd9 x:0 0 0 2024-08-01T06:56:29.928 INFO:tasks.workunit.client.0.smithi016.stdout:4/640: mknod d0/d2/dc/d12/dd3/d22/d26/d85/cda 0 2024-08-01T06:56:29.930 INFO:tasks.workunit.client.0.smithi016.stdout:4/641: mknod d0/d2/dc/d12/dd3/d38/cdb 0 2024-08-01T06:56:29.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.968+0000 7fad2d897640 1 -- 172.21.15.16:0/3370298955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad280ffca0 msgr2=0x7fad28100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:29.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.968+0000 7fad2d897640 1 --2- 172.21.15.16:0/3370298955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad280ffca0 0x7fad28100120 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009880 tx=0x7fad1c02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.968+0000 7fad2d897640 1 -- 172.21.15.16:0/3370298955 shutdown_connections 2024-08-01T06:56:29.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.968+0000 7fad2d897640 1 --2- 172.21.15.16:0/3370298955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad280ffca0 0x7fad28100120 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.968+0000 7fad2d897640 1 --2- 172.21.15.16:0/3370298955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad280feaa0 0x7fad280feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.968+0000 7fad2d897640 1 -- 172.21.15.16:0/3370298955 >> 172.21.15.16:0/3370298955 conn(0x7fad280fa250 msgr2=0x7fad280fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:56:29.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.968+0000 7fad2d897640 1 -- 172.21.15.16:0/3370298955 shutdown_connections 2024-08-01T06:56:29.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.968+0000 7fad2d897640 1 -- 172.21.15.16:0/3370298955 wait complete. 2024-08-01T06:56:29.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.969+0000 7fad2d897640 1 Processor -- start 2024-08-01T06:56:29.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.969+0000 7fad2d897640 1 -- start start 2024-08-01T06:56:29.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.969+0000 7fad2d897640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad280feaa0 0x7fad28102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:29.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.969+0000 7fad2d897640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad280ffca0 0x7fad28101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:29.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.969+0000 7fad2d897640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad281015c0 con 0x7fad280feaa0 2024-08-01T06:56:29.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.969+0000 7fad2d897640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad28101730 con 0x7fad280ffca0 2024-08-01T06:56:29.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.969+0000 7fad26ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad280feaa0 0x7fad28102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:29.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.969+0000 7fad26ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad280feaa0 0x7fad28102a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36470/0 (socket says 172.21.15.16:36470) 2024-08-01T06:56:29.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.969+0000 7fad26ffd640 1 -- 172.21.15.16:0/1115709731 learned_addr learned my addr 172.21.15.16:0/1115709731 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:56:29.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.969+0000 7fad267fc640 1 --2- 172.21.15.16:0/1115709731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad280ffca0 0x7fad28101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:29.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.970+0000 7fad26ffd640 1 -- 172.21.15.16:0/1115709731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad280ffca0 msgr2=0x7fad28101080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:29.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.970+0000 7fad26ffd640 1 --2- 172.21.15.16:0/1115709731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad280ffca0 0x7fad28101080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:29.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.970+0000 7fad26ffd640 1 -- 172.21.15.16:0/1115709731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c009560 con 0x7fad280feaa0 2024-08-01T06:56:29.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.970+0000 7fad26ffd640 1 --2- 172.21.15.16:0/1115709731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad280feaa0 0x7fad28102a30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fad1800eb40 tx=0x7fad1800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:56:29.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.970+0000 7fad2c895640 1 -- 172.21.15.16:0/1115709731 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad18003970 con 0x7fad280feaa0 2024-08-01T06:56:29.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.970+0000 7fad2c895640 1 -- 172.21.15.16:0/1115709731 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad18004030 con 0x7fad280feaa0 2024-08-01T06:56:29.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.970+0000 7fad2d897640 1 -- 172.21.15.16:0/1115709731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad28101a10 con 0x7fad280feaa0 2024-08-01T06:56:29.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.970+0000 7fad2c895640 1 -- 172.21.15.16:0/1115709731 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad18019760 con 0x7fad280feaa0 2024-08-01T06:56:29.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.970+0000 7fad2d897640 1 -- 172.21.15.16:0/1115709731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2819d670 con 0x7fad280feaa0 2024-08-01T06:56:29.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.971+0000 7fad2d897640 1 -- 172.21.15.16:0/1115709731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad28108060 con 0x7fad280feaa0 2024-08-01T06:56:29.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.972+0000 7fad2c895640 1 -- 172.21.15.16:0/1115709731 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) v1 ==== 91559+0+0 (secure 0 0 0) 0x7fad180041a0 con 0x7fad280feaa0 2024-08-01T06:56:29.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.972+0000 7fad2c895640 1 --2- 172.21.15.16:0/1115709731 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fad1006d660 0x7fad1006fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:29.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.973+0000 7fad2c895640 1 -- 172.21.15.16:0/1115709731 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fad18014070 con 0x7fad280feaa0 2024-08-01T06:56:29.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.973+0000 7fad267fc640 1 --2- 172.21.15.16:0/1115709731 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fad1006d660 0x7fad1006fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:29.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.973+0000 7fad267fc640 1 --2- 172.21.15.16:0/1115709731 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fad1006d660 0x7fad1006fb20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fad1c000c00 tx=0x7fad1c0314e0 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:56:29.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:29.979+0000 7fad2c895640 1 -- 172.21.15.16:0/1115709731 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fad28108060 con 0x7fad280feaa0 2024-08-01T06:56:30.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:29 smithi089 ceph-mon[36617]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:56:30.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:29 smithi089 ceph-mon[36617]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:56:30.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:29 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/916589975' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:56:30.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:29 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/4264512493' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:56:30.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:29 smithi016 ceph-mon[29266]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:56:30.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:29 smithi016 ceph-mon[29266]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:56:30.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:29 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/916589975' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:56:30.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:29 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/4264512493' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:56:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.195+0000 7fad2d897640 1 -- 172.21.15.16:0/1115709731 --> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fad28107ff0 con 0x7fad1006d660 2024-08-01T06:56:30.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.196+0000 7fad2c895640 1 -- 172.21.15.16:0/1115709731 <== mgr.24423 v2:172.21.15.89:6828/2589785296 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fad28107ff0 con 0x7fad1006d660 2024-08-01T06:56:30.199 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:56:30.199 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T06:56:30.199 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T06:56:30.199 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T06:56:30.199 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [], 2024-08-01T06:56:30.199 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "1/23 daemons upgraded", 2024-08-01T06:56:30.199 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "", 2024-08-01T06:56:30.199 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T06:56:30.199 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:56:30.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.199+0000 7fad2d897640 1 -- 172.21.15.16:0/1115709731 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fad1006d660 msgr2=0x7fad1006fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:30.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.199+0000 7fad2d897640 1 --2- 172.21.15.16:0/1115709731 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fad1006d660 0x7fad1006fb20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fad1c000c00 tx=0x7fad1c0314e0 comp rx=0 tx=0).stop 2024-08-01T06:56:30.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.199+0000 7fad2d897640 1 -- 172.21.15.16:0/1115709731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad280feaa0 msgr2=0x7fad28102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:30.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.199+0000 7fad2d897640 1 --2- 172.21.15.16:0/1115709731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad280feaa0 0x7fad28102a30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fad1800eb40 tx=0x7fad1800c2d0 comp rx=0 tx=0).stop 2024-08-01T06:56:30.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.199+0000 7fad2d897640 1 -- 172.21.15.16:0/1115709731 shutdown_connections 2024-08-01T06:56:30.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.199+0000 7fad2d897640 1 --2- 172.21.15.16:0/1115709731 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fad1006d660 0x7fad1006fb20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:30.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.199+0000 7fad2d897640 1 --2- 172.21.15.16:0/1115709731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad280ffca0 0x7fad28101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:30.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.199+0000 7fad2d897640 1 --2- 172.21.15.16:0/1115709731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad280feaa0 0x7fad28102a30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:30.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.199+0000 7fad2d897640 1 -- 172.21.15.16:0/1115709731 >> 172.21.15.16:0/1115709731 conn(0x7fad280fa250 msgr2=0x7fad28068500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:56:30.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.199+0000 7fad2d897640 1 -- 172.21.15.16:0/1115709731 shutdown_connections 2024-08-01T06:56:30.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.199+0000 7fad2d897640 1 -- 172.21.15.16:0/1115709731 wait complete. 2024-08-01T06:56:30.279 INFO:tasks.workunit.client.0.smithi016.stdout:2/769: sync 2024-08-01T06:56:30.279 INFO:tasks.workunit.client.0.smithi016.stdout:6/704: sync 2024-08-01T06:56:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.289+0000 7f7eaff75640 1 -- 172.21.15.16:0/799067171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ea81006d0 msgr2=0x7f7ea8102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.289+0000 7f7eaff75640 1 --2- 172.21.15.16:0/799067171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ea81006d0 0x7f7ea8102ac0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009880 tx=0x7f7ea402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:56:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.290+0000 7f7eaff75640 1 -- 172.21.15.16:0/799067171 shutdown_connections 2024-08-01T06:56:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.290+0000 7f7eaff75640 1 --2- 172.21.15.16:0/799067171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ea8103000 0x7f7ea81053f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.290+0000 7f7eaff75640 1 --2- 172.21.15.16:0/799067171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ea81006d0 0x7f7ea8102ac0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.290+0000 7f7eaff75640 1 -- 172.21.15.16:0/799067171 >> 172.21.15.16:0/799067171 conn(0x7f7ea80fa230 msgr2=0x7f7ea80fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:56:30.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.290+0000 7f7eaff75640 1 -- 172.21.15.16:0/799067171 shutdown_connections 2024-08-01T06:56:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.290+0000 7f7eaff75640 1 -- 172.21.15.16:0/799067171 wait complete. 2024-08-01T06:56:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.290+0000 7f7eaff75640 1 Processor -- start 2024-08-01T06:56:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.290+0000 7f7eaff75640 1 -- start start 2024-08-01T06:56:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.291+0000 7f7eaff75640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ea81006d0 0x7f7ea8195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.291+0000 7f7eaff75640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ea8103000 0x7f7ea8195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:30.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.291+0000 7f7eaff75640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea8196140 con 0x7f7ea81006d0 2024-08-01T06:56:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.291+0000 7f7eaff75640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea81962b0 con 0x7f7ea8103000 2024-08-01T06:56:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.291+0000 7f7eadd11640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ea81006d0 0x7f7ea8195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.291+0000 7f7eadd11640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ea81006d0 0x7f7ea8195630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36486/0 (socket says 172.21.15.16:36486) 2024-08-01T06:56:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.291+0000 7f7eadd11640 1 -- 172.21.15.16:0/952029737 learned_addr learned my addr 172.21.15.16:0/952029737 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:56:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.291+0000 7f7ead510640 1 --2- 172.21.15.16:0/952029737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ea8103000 0x7f7ea8195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.291+0000 7f7eadd11640 1 -- 172.21.15.16:0/952029737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ea8103000 msgr2=0x7f7ea8195b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.291+0000 7f7eadd11640 1 --2- 172.21.15.16:0/952029737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ea8103000 0x7f7ea8195b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:30.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.291+0000 7f7eadd11640 1 -- 172.21.15.16:0/952029737 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea4009560 con 0x7f7ea81006d0 2024-08-01T06:56:30.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.291+0000 7f7eadd11640 1 --2- 172.21.15.16:0/952029737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ea81006d0 0x7f7ea8195630 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4005520 tx=0x7f7ea4005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:56:30.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.291+0000 7f7e9effd640 1 -- 172.21.15.16:0/952029737 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ea4004aa0 con 0x7f7ea81006d0 2024-08-01T06:56:30.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.291+0000 7f7e9effd640 1 -- 172.21.15.16:0/952029737 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ea4004c00 con 0x7f7ea81006d0 2024-08-01T06:56:30.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.291+0000 7f7eaff75640 1 -- 172.21.15.16:0/952029737 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea819acf0 con 0x7f7ea81006d0 2024-08-01T06:56:30.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.291+0000 7f7e9effd640 1 -- 172.21.15.16:0/952029737 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ea4003b10 con 0x7f7ea81006d0 2024-08-01T06:56:30.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.292+0000 7f7eaff75640 1 -- 172.21.15.16:0/952029737 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea819b210 con 0x7f7ea81006d0 2024-08-01T06:56:30.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.292+0000 7f7eaff75640 1 -- 172.21.15.16:0/952029737 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea81087b0 con 0x7f7ea81006d0 2024-08-01T06:56:30.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.293+0000 7f7e9effd640 1 -- 172.21.15.16:0/952029737 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) v1 ==== 91559+0+0 (secure 0 0 0) 0x7f7ea4031d20 con 0x7f7ea81006d0 2024-08-01T06:56:30.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.293+0000 7f7e9effd640 1 --2- 172.21.15.16:0/952029737 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f7e9406d660 0x7f7e9406fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:56:30.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.294+0000 7f7e9effd640 1 -- 172.21.15.16:0/952029737 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f7ea40ae240 con 0x7f7ea81006d0 2024-08-01T06:56:30.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.294+0000 7f7ead510640 1 --2- 172.21.15.16:0/952029737 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f7e9406d660 0x7f7e9406fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:56:30.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.294+0000 7f7ead510640 1 --2- 172.21.15.16:0/952029737 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f7e9406d660 0x7f7e9406fb20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8196b50 tx=0x7f7e9800b390 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:56:30.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.298+0000 7f7e9effd640 1 -- 172.21.15.16:0/952029737 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f7ea4077ab0 con 0x7f7ea81006d0 2024-08-01T06:56:30.307 INFO:tasks.workunit.client.0.smithi016.stdout:2/770: fsync d0/d8/d31/da7/fd3 0 2024-08-01T06:56:30.309 INFO:tasks.workunit.client.0.smithi016.stdout:2/771: dread - d0/d8/d31/da7/ddf/fee zero size 2024-08-01T06:56:30.311 INFO:tasks.workunit.client.0.smithi016.stdout:2/772: creat d0/d8/d1b/dd9/dfc/fff x:0 0 0 2024-08-01T06:56:30.313 INFO:tasks.workunit.client.0.smithi016.stdout:2/773: chown d0/d8/d1b/d74/c7e 13 1 2024-08-01T06:56:30.454 INFO:tasks.workunit.client.0.smithi016.stdout:2/774: fsync d0/d8/d31/d5e/f75 0 2024-08-01T06:56:30.456 INFO:tasks.workunit.client.0.smithi016.stdout:2/775: write d0/d8/d31/da7/db4/fec [443782,115902] 0 2024-08-01T06:56:30.461 INFO:tasks.workunit.client.0.smithi016.stdout:2/776: symlink d0/d8/d1b/d74/l100 0 2024-08-01T06:56:30.511 INFO:tasks.workunit.client.0.smithi016.stdout:2/777: dwrite d0/d8/d31/f61 [0,4194304] 0 2024-08-01T06:56:30.515 INFO:tasks.workunit.client.0.smithi016.stdout:2/778: creat d0/d8/d31/dc1/f101 x:0 0 0 2024-08-01T06:56:30.520 INFO:tasks.workunit.client.0.smithi016.stdout:2/779: write d0/d8/d22/f8c [5154426,124406] 0 2024-08-01T06:56:30.523 INFO:tasks.workunit.client.0.smithi016.stdout:2/780: mkdir d0/d8/d31/d102 0 2024-08-01T06:56:30.524 INFO:tasks.workunit.client.0.smithi016.stdout:2/781: chown d0/d8/d1b/d74/d99 1906172 1 2024-08-01T06:56:30.526 INFO:tasks.workunit.client.0.smithi016.stdout:2/782: truncate d0/d16/f64 4712289 0 2024-08-01T06:56:30.529 INFO:tasks.workunit.client.0.smithi016.stdout:2/783: rename d0/d8/d1b/dcc/d3b/d45/c73 to d0/d16/c103 0 2024-08-01T06:56:30.532 INFO:tasks.workunit.client.0.smithi016.stdout:2/784: mkdir d0/d8/d1b/d74/d99/d104 0 2024-08-01T06:56:30.534 INFO:tasks.workunit.client.0.smithi016.stdout:2/785: symlink d0/d8/d31/d5e/l105 0 2024-08-01T06:56:30.536 INFO:tasks.workunit.client.0.smithi016.stdout:2/786: unlink d0/d8/d1b/dcc/d3b/c76 0 2024-08-01T06:56:30.539 INFO:tasks.workunit.client.0.smithi016.stdout:7/596: sync 2024-08-01T06:56:30.539 INFO:tasks.workunit.client.0.smithi016.stdout:3/518: sync 2024-08-01T06:56:30.539 INFO:tasks.workunit.client.0.smithi016.stdout:1/731: sync 2024-08-01T06:56:30.542 INFO:tasks.workunit.client.0.smithi016.stdout:1/732: rmdir d2/d2f/dba 39 2024-08-01T06:56:30.543 INFO:tasks.workunit.client.0.smithi016.stdout:2/787: write d0/d8/d22/f88 [3639099,111749] 0 2024-08-01T06:56:30.544 INFO:tasks.workunit.client.0.smithi016.stdout:7/597: mknod d7/db/d17/d72/d1c/d79/d8f/d39/ce0 0 2024-08-01T06:56:30.549 INFO:tasks.workunit.client.0.smithi016.stdout:7/598: read d7/db/d17/d72/d22/f27 [1205358,64343] 0 2024-08-01T06:56:30.550 INFO:tasks.workunit.client.0.smithi016.stdout:2/788: mknod d0/d8/d1b/dfe/c106 0 2024-08-01T06:56:30.550 INFO:tasks.workunit.client.0.smithi016.stdout:3/519: getdents d9/da/d18 0 2024-08-01T06:56:30.552 INFO:tasks.workunit.client.0.smithi016.stdout:3/520: chown d9/d4e 542093 1 2024-08-01T06:56:30.553 INFO:tasks.workunit.client.0.smithi016.stdout:2/789: dread - d0/d8/d31/da7/db4/ff9 zero size 2024-08-01T06:56:30.554 INFO:tasks.workunit.client.0.smithi016.stdout:1/733: dwrite d2/de/d6e/f8a [0,4194304] 0 2024-08-01T06:56:30.555 INFO:tasks.workunit.client.0.smithi016.stdout:1/734: fdatasync d2/de/d4d/f8e 0 2024-08-01T06:56:30.556 INFO:tasks.workunit.client.0.smithi016.stdout:7/599: rmdir d7/db/d17/d72/d1e/d26/d2a 39 2024-08-01T06:56:30.563 INFO:tasks.workunit.client.0.smithi016.stdout:7/600: chown d7/db/d17/d72/d1e/c5c 67459 1 2024-08-01T06:56:30.564 INFO:tasks.workunit.client.0.smithi016.stdout:2/790: mknod d0/d7d/dc9/c107 0 2024-08-01T06:56:30.566 INFO:tasks.workunit.client.0.smithi016.stdout:1/735: dread d2/d88/fbb [0,4194304] 0 2024-08-01T06:56:30.568 INFO:tasks.workunit.client.0.smithi016.stdout:2/791: symlink d0/d8/d1b/d74/d90/d93/l108 0 2024-08-01T06:56:30.569 INFO:tasks.workunit.client.0.smithi016.stdout:1/736: rmdir d2/d3/d41/d49/d85/dc1 39 2024-08-01T06:56:30.570 INFO:tasks.workunit.client.0.smithi016.stdout:7/601: dread d7/db/d17/d72/d1e/faa [0,4194304] 0 2024-08-01T06:56:30.571 INFO:tasks.workunit.client.0.smithi016.stdout:1/737: read d2/d2f/f87 [3029360,128600] 0 2024-08-01T06:56:30.571 INFO:tasks.workunit.client.0.smithi016.stdout:2/792: chown d0/d8/d1b/dcc/l9d 21133293 1 2024-08-01T06:56:30.573 INFO:tasks.workunit.client.0.smithi016.stdout:1/738: mknod d2/de/d32/c104 0 2024-08-01T06:56:30.577 INFO:tasks.workunit.client.0.smithi016.stdout:7/602: symlink d7/db/d17/d72/d1c/d1d/d40/d58/d80/le1 0 2024-08-01T06:56:30.581 INFO:tasks.workunit.client.0.smithi016.stdout:2/793: write d0/d8/fc0 [1201706,120120] 0 2024-08-01T06:56:30.584 INFO:tasks.workunit.client.0.smithi016.stdout:1/739: truncate d2/de/d6e/f8a 807537 0 2024-08-01T06:56:30.585 INFO:tasks.workunit.client.0.smithi016.stdout:2/794: creat d0/d8/d31/da7/ddf/f109 x:0 0 0 2024-08-01T06:56:30.590 INFO:tasks.workunit.client.0.smithi016.stdout:7/603: dwrite d7/db/d17/d72/d1c/d79/d8f/d39/d43/f91 [0,4194304] 0 2024-08-01T06:56:30.591 INFO:tasks.workunit.client.0.smithi016.stdout:1/740: creat d2/de/d63/dd6/dff/f105 x:0 0 0 2024-08-01T06:56:30.594 INFO:tasks.workunit.client.0.smithi016.stdout:7/604: mknod d7/ce2 0 2024-08-01T06:56:30.595 INFO:tasks.workunit.client.0.smithi016.stdout:2/795: write d0/d8/d1b/dcc/d3b/d45/f7b [5141597,1220] 0 2024-08-01T06:56:30.599 INFO:tasks.workunit.client.0.smithi016.stdout:1/741: mkdir d2/d3/d1c/de1/d106 0 2024-08-01T06:56:30.603 INFO:tasks.workunit.client.0.smithi016.stdout:7/605: dwrite d7/db/d17/d72/d1c/d79/d8f/d39/d43/f91 [0,4194304] 0 2024-08-01T06:56:30.604 INFO:tasks.workunit.client.0.smithi016.stdout:2/796: rename d0/f9c to d0/d8/d1b/dd9/f10a 0 2024-08-01T06:56:30.606 INFO:tasks.workunit.client.0.smithi016.stdout:1/742: creat d2/d88/f107 x:0 0 0 2024-08-01T06:56:30.609 INFO:tasks.workunit.client.0.smithi016.stdout:2/797: chown d0/d8/d1b/d74/fad 347393254 1 2024-08-01T06:56:30.615 INFO:tasks.workunit.client.0.smithi016.stdout:1/743: link d2/fb2 d2/d3/d41/d49/d85/df1/f108 0 2024-08-01T06:56:30.616 INFO:tasks.workunit.client.0.smithi016.stdout:2/798: dwrite d0/d8/d22/f63 [0,4194304] 0 2024-08-01T06:56:30.622 INFO:tasks.workunit.client.0.smithi016.stdout:1/744: write d2/de/f14 [2148109,105048] 0 2024-08-01T06:56:30.623 INFO:tasks.workunit.client.0.smithi016.stdout:2/799: mknod d0/d16/c10b 0 2024-08-01T06:56:30.623 INFO:tasks.workunit.client.0.smithi016.stdout:1/745: fsync d2/d3/d48/fed 0 2024-08-01T06:56:30.624 INFO:tasks.workunit.client.0.smithi016.stdout:2/800: creat d0/d8/d6b/f10c x:0 0 0 2024-08-01T06:56:30.624 INFO:tasks.workunit.client.0.smithi016.stdout:1/746: dread d2/d3/d1a/d22/fea [0,4194304] 0 2024-08-01T06:56:30.632 INFO:tasks.workunit.client.0.smithi016.stdout:7/606: dwrite d7/db/d17/d72/d1c/f9a [4194304,4194304] 0 2024-08-01T06:56:30.632 INFO:tasks.workunit.client.0.smithi016.stdout:1/747: mknod d2/d3/d1c/de1/d106/c109 0 2024-08-01T06:56:30.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.631+0000 7f7eaff75640 1 -- 172.21.15.16:0/952029737 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7ea8108990 con 0x7f7ea81006d0 2024-08-01T06:56:30.634 INFO:tasks.workunit.client.0.smithi016.stdout:7/607: truncate d7/db/d17/d72/d1c/d97/fd6 282087 0 2024-08-01T06:56:30.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.632+0000 7f7e9effd640 1 -- 172.21.15.16:0/952029737 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7ea407b170 con 0x7f7ea81006d0 2024-08-01T06:56:30.635 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-08-01T06:56:30.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.636+0000 7f7eaff75640 1 -- 172.21.15.16:0/952029737 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f7e9406d660 msgr2=0x7f7e9406fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:30.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.636+0000 7f7eaff75640 1 --2- 172.21.15.16:0/952029737 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f7e9406d660 0x7f7e9406fb20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8196b50 tx=0x7f7e9800b390 comp rx=0 tx=0).stop 2024-08-01T06:56:30.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.636+0000 7f7eaff75640 1 -- 172.21.15.16:0/952029737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ea81006d0 msgr2=0x7f7ea8195630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:56:30.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.636+0000 7f7eaff75640 1 --2- 172.21.15.16:0/952029737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ea81006d0 0x7f7ea8195630 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4005520 tx=0x7f7ea4005550 comp rx=0 tx=0).stop 2024-08-01T06:56:30.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.636+0000 7f7eaff75640 1 -- 172.21.15.16:0/952029737 shutdown_connections 2024-08-01T06:56:30.639 INFO:tasks.workunit.client.0.smithi016.stdout:2/801: dread d0/d8/d31/d5e/fdd [0,4194304] 0 2024-08-01T06:56:30.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.636+0000 7f7eaff75640 1 --2- 172.21.15.16:0/952029737 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f7e9406d660 0x7f7e9406fb20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:30.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.636+0000 7f7eaff75640 1 --2- 172.21.15.16:0/952029737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ea8103000 0x7f7ea8195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:30.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.636+0000 7f7eaff75640 1 --2- 172.21.15.16:0/952029737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ea81006d0 0x7f7ea8195630 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:56:30.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.636+0000 7f7eaff75640 1 -- 172.21.15.16:0/952029737 >> 172.21.15.16:0/952029737 conn(0x7f7ea80fa230 msgr2=0x7f7ea80fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:56:30.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.636+0000 7f7eaff75640 1 -- 172.21.15.16:0/952029737 shutdown_connections 2024-08-01T06:56:30.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:56:30.636+0000 7f7eaff75640 1 -- 172.21.15.16:0/952029737 wait complete. 2024-08-01T06:56:30.640 INFO:tasks.workunit.client.0.smithi016.stdout:1/748: creat d2/de/d63/f10a x:0 0 0 2024-08-01T06:56:30.643 INFO:tasks.workunit.client.0.smithi016.stdout:7/608: creat d7/db/d17/d72/d1c/d1d/d40/d7f/fe3 x:0 0 0 2024-08-01T06:56:30.643 INFO:tasks.workunit.client.0.smithi016.stdout:2/802: mkdir d0/d8/d1b/d74/d90/d10d 0 2024-08-01T06:56:30.644 INFO:tasks.workunit.client.0.smithi016.stdout:7/609: chown d7/db/d17/d72/d1c/d79/d8f/d39 10091999 1 2024-08-01T06:56:30.646 INFO:tasks.workunit.client.0.smithi016.stdout:7/610: truncate d7/db/d17/d72/d1c/d97/fd6 635343 0 2024-08-01T06:56:30.688 INFO:tasks.workunit.client.0.smithi016.stdout:9/709: sync 2024-08-01T06:56:30.688 INFO:tasks.workunit.client.0.smithi016.stdout:5/634: sync 2024-08-01T06:56:30.688 INFO:tasks.workunit.client.0.smithi016.stdout:8/490: sync 2024-08-01T06:56:30.689 INFO:tasks.workunit.client.0.smithi016.stdout:6/705: sync 2024-08-01T06:56:30.689 INFO:tasks.workunit.client.0.smithi016.stdout:0/530: sync 2024-08-01T06:56:30.689 INFO:tasks.workunit.client.0.smithi016.stdout:4/642: sync 2024-08-01T06:56:30.689 INFO:tasks.workunit.client.0.smithi016.stdout:0/531: chown c1 3792 1 2024-08-01T06:56:30.689 INFO:tasks.workunit.client.0.smithi016.stdout:8/491: readlink d5/d67/d86/l8b 0 2024-08-01T06:56:30.690 INFO:tasks.workunit.client.0.smithi016.stdout:9/710: chown d3/f65 4050 1 2024-08-01T06:56:30.706 INFO:tasks.workunit.client.0.smithi016.stdout:2/803: unlink d0/d8/d1b/d74/d99/lf2 0 2024-08-01T06:56:30.707 INFO:tasks.workunit.client.0.smithi016.stdout:7/611: symlink d7/db/d17/d72/d1c/d79/d8f/d39/le4 0 2024-08-01T06:56:30.708 INFO:tasks.workunit.client.0.smithi016.stdout:7/612: stat d7/db/d17/d72/d1c/d79/d8f/fc5 0 2024-08-01T06:56:30.708 INFO:tasks.workunit.client.0.smithi016.stdout:6/706: creat d1/d8/d94/f100 x:0 0 0 2024-08-01T06:56:30.709 INFO:tasks.workunit.client.0.smithi016.stdout:0/532: creat d10/d11/d37/fa6 x:0 0 0 2024-08-01T06:56:30.711 INFO:tasks.workunit.client.0.smithi016.stdout:9/711: fsync d3/d9/db/d3e/fd0 0 2024-08-01T06:56:30.712 INFO:tasks.workunit.client.0.smithi016.stdout:9/712: write d3/de/d6d/fd5 [768060,104589] 0 2024-08-01T06:56:30.713 INFO:tasks.workunit.client.0.smithi016.stdout:8/492: mkdir d5/d8/d1a/d24/d48/d69/da3 0 2024-08-01T06:56:30.715 INFO:tasks.workunit.client.0.smithi016.stdout:2/804: unlink d0/d8/d22/l2a 0 2024-08-01T06:56:30.716 INFO:tasks.workunit.client.0.smithi016.stdout:5/635: mkdir d1/d12/ddd 0 2024-08-01T06:56:30.719 INFO:tasks.workunit.client.0.smithi016.stdout:0/533: truncate d10/f2e 2254770 0 2024-08-01T06:56:30.723 INFO:tasks.workunit.client.0.smithi016.stdout:8/493: truncate d5/d8/d1a/d24/d48/f97 138122 0 2024-08-01T06:56:30.727 INFO:tasks.workunit.client.0.smithi016.stdout:4/643: dwrite d0/d2/fa [0,4194304] 0 2024-08-01T06:56:30.727 INFO:tasks.workunit.client.0.smithi016.stdout:7/613: symlink d7/db/d17/d72/le5 0 2024-08-01T06:56:30.732 INFO:tasks.workunit.client.0.smithi016.stdout:0/534: creat d10/d11/d37/d50/fa7 x:0 0 0 2024-08-01T06:56:30.733 INFO:tasks.workunit.client.0.smithi016.stdout:9/713: mknod d3/d32/ce7 0 2024-08-01T06:56:30.736 INFO:tasks.workunit.client.0.smithi016.stdout:8/494: fdatasync d5/dc/d3e/f6b 0 2024-08-01T06:56:30.739 INFO:tasks.workunit.client.0.smithi016.stdout:8/495: stat d5/d8/d1a/d24/d48/d60/d63/f91 0 2024-08-01T06:56:30.741 INFO:tasks.workunit.client.0.smithi016.stdout:7/614: unlink d7/db/d17/d72/d1c/d1d/d40/d58/lab 0 2024-08-01T06:56:30.743 INFO:tasks.workunit.client.0.smithi016.stdout:2/805: dwrite d0/d8/d31/dc1/fd6 [0,4194304] 0 2024-08-01T06:56:30.744 INFO:tasks.workunit.client.0.smithi016.stdout:9/714: dwrite d3/d9/d46/d48/f55 [0,4194304] 0 2024-08-01T06:56:30.746 INFO:tasks.workunit.client.0.smithi016.stdout:7/615: chown d7/db/d17/fc3 13634 1 2024-08-01T06:56:30.749 INFO:tasks.workunit.client.0.smithi016.stdout:6/707: dwrite d1/d8/d1b/d22/d71/ff0 [0,4194304] 0 2024-08-01T06:56:30.750 INFO:tasks.workunit.client.0.smithi016.stdout:7/616: write d7/db/d17/d72/d1c/d79/fb0 [7060715,111268] 0 2024-08-01T06:56:30.753 INFO:tasks.workunit.client.0.smithi016.stdout:4/644: mknod d0/d2/dc/d90/cdc 0 2024-08-01T06:56:30.757 INFO:tasks.workunit.client.0.smithi016.stdout:0/535: mknod d10/d11/d37/d82/d9b/ca8 0 2024-08-01T06:56:30.758 INFO:tasks.workunit.client.0.smithi016.stdout:0/536: fsync d10/f5a 0 2024-08-01T06:56:30.759 INFO:tasks.workunit.client.0.smithi016.stdout:2/806: mkdir d0/d8/d1b/dfe/d10e 0 2024-08-01T06:56:30.760 INFO:tasks.workunit.client.0.smithi016.stdout:9/715: dread - d3/d9/d46/d48/fab zero size 2024-08-01T06:56:30.764 INFO:tasks.workunit.client.0.smithi016.stdout:7/617: dread - d7/db3/fd0 zero size 2024-08-01T06:56:30.764 INFO:tasks.workunit.client.0.smithi016.stdout:4/645: dwrite d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d8f/faa [0,4194304] 0 2024-08-01T06:56:30.765 INFO:tasks.workunit.client.0.smithi016.stdout:8/496: creat d5/d8/d1a/d24/d8c/fa4 x:0 0 0 2024-08-01T06:56:30.772 INFO:tasks.workunit.client.0.smithi016.stdout:4/646: rmdir d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d8f 39 2024-08-01T06:56:30.773 INFO:tasks.workunit.client.0.smithi016.stdout:2/807: creat d0/d8/d1b/d74/d90/d10d/f10f x:0 0 0 2024-08-01T06:56:30.774 INFO:tasks.workunit.client.0.smithi016.stdout:6/708: rename d1/d8/d1b/d22/d36/d7a/dd3/c57 to d1/d43/c101 0 2024-08-01T06:56:30.778 INFO:tasks.workunit.client.0.smithi016.stdout:8/497: rename d5/d67/d86/f88 to d5/d8/d1a/d24/d48/d85/fa5 0 2024-08-01T06:56:30.778 INFO:tasks.workunit.client.0.smithi016.stdout:7/618: dwrite d7/db/d17/d72/d1c/f9a [4194304,4194304] 0 2024-08-01T06:56:30.781 INFO:tasks.workunit.client.0.smithi016.stdout:2/808: fsync d0/d8/d1b/dcc/d68/fae 0 2024-08-01T06:56:30.785 INFO:tasks.workunit.client.0.smithi016.stdout:4/647: creat d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d91/fdd x:0 0 0 2024-08-01T06:56:30.786 INFO:tasks.workunit.client.0.smithi016.stdout:8/498: creat d5/d67/d86/fa6 x:0 0 0 2024-08-01T06:56:30.786 INFO:tasks.workunit.client.0.smithi016.stdout:8/499: write d5/d8/d75/f9b [1223882,51188] 0 2024-08-01T06:56:30.786 INFO:tasks.workunit.client.0.smithi016.stdout:6/709: rename d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/da2/lb0 to d1/d8/d1b/l102 0 2024-08-01T06:56:30.790 INFO:tasks.workunit.client.0.smithi016.stdout:7/619: creat d7/db/d17/d72/d1c/d1d/d40/d58/da3/fe6 x:0 0 0 2024-08-01T06:56:30.791 INFO:tasks.workunit.client.0.smithi016.stdout:7/620: dread - d7/db3/fd0 zero size 2024-08-01T06:56:30.794 INFO:tasks.workunit.client.0.smithi016.stdout:9/716: write d3/d9/df/d2a/f41 [30068,111444] 0 2024-08-01T06:56:30.797 INFO:tasks.workunit.client.0.smithi016.stdout:0/537: write d10/f33 [1528198,94612] 0 2024-08-01T06:56:30.804 INFO:tasks.workunit.client.0.smithi016.stdout:7/621: dread d7/db/d17/d72/d1e/d26/d2a/f30 [0,4194304] 0 2024-08-01T06:56:30.816 INFO:tasks.workunit.client.0.smithi016.stdout:9/717: read d3/f24 [1170162,129196] 0 2024-08-01T06:56:30.816 INFO:tasks.workunit.client.0.smithi016.stdout:2/809: write d0/d16/f64 [5296778,94995] 0 2024-08-01T06:56:30.819 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-01T06:56:30.819 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-08-01T06:56:30.820 INFO:tasks.workunit.client.0.smithi016.stdout:4/648: dwrite d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/f3f [0,4194304] 0 2024-08-01T06:56:30.824 INFO:tasks.workunit.client.0.smithi016.stdout:0/538: write d10/d11/d37/d50/f84 [4642248,23296] 0 2024-08-01T06:56:30.829 INFO:tasks.workunit.client.0.smithi016.stdout:0/539: write d10/d11/d37/f9f [923077,21835] 0 2024-08-01T06:56:30.830 INFO:tasks.workunit.client.0.smithi016.stdout:7/622: write d7/db/d17/d72/d1e/faa [471538,100653] 0 2024-08-01T06:56:30.830 INFO:tasks.workunit.client.0.smithi016.stdout:8/500: dwrite d5/d8/d1a/f29 [0,4194304] 0 2024-08-01T06:56:30.834 INFO:tasks.workunit.client.0.smithi016.stdout:6/710: dwrite d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f38 [0,4194304] 0 2024-08-01T06:56:30.839 INFO:tasks.workunit.client.0.smithi016.stdout:2/810: link d0/d8/d1b/d74/cab d0/dc3/c110 0 2024-08-01T06:56:30.842 INFO:tasks.workunit.client.0.smithi016.stdout:8/501: read d5/d8/d1a/d24/f4e [3414630,112019] 0 2024-08-01T06:56:30.844 INFO:tasks.workunit.client.0.smithi016.stdout:9/718: dwrite d3/d9/df/f3d [0,4194304] 0 2024-08-01T06:56:30.847 INFO:tasks.workunit.client.0.smithi016.stdout:6/711: unlink d1/d8/d1b/c1d 0 2024-08-01T06:56:30.852 INFO:tasks.workunit.client.0.smithi016.stdout:7/623: read d7/db/d17/d72/d1e/d26/f32 [1713775,31630] 0 2024-08-01T06:56:30.853 INFO:tasks.workunit.client.0.smithi016.stdout:9/719: mknod d3/d9/df/d16/ce8 0 2024-08-01T06:56:30.854 INFO:tasks.workunit.client.0.smithi016.stdout:8/502: truncate d5/d8/d75/f96 183858 0 2024-08-01T06:56:30.855 INFO:tasks.workunit.client.0.smithi016.stdout:6/712: read - d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d93/fb9 zero size 2024-08-01T06:56:30.858 INFO:tasks.workunit.client.0.smithi016.stdout:2/811: mkdir d0/d8/d31/d111 0 2024-08-01T06:56:30.866 INFO:tasks.workunit.client.0.smithi016.stdout:6/713: creat d1/d8/d94/f103 x:0 0 0 2024-08-01T06:56:30.869 INFO:tasks.workunit.client.0.smithi016.stdout:2/812: dread - d0/d8/d1b/dcc/d68/fd8 zero size 2024-08-01T06:56:30.870 INFO:tasks.workunit.client.0.smithi016.stdout:7/624: link d7/db/f6f d7/db/d17/d72/d1c/d1d/d40/d67/d7c/fe7 0 2024-08-01T06:56:30.872 INFO:tasks.workunit.client.0.smithi016.stdout:4/649: dwrite d0/d2/d68/f6f [0,4194304] 0 2024-08-01T06:56:30.880 INFO:tasks.workunit.client.0.smithi016.stdout:0/540: dwrite d10/d11/f15 [0,4194304] 0 2024-08-01T06:56:30.883 INFO:tasks.workunit.client.0.smithi016.stdout:9/720: write d3/f1d [1178336,88480] 0 2024-08-01T06:56:30.889 INFO:tasks.workunit.client.0.smithi016.stdout:4/650: chown d0/d2/dc/d12/dd3/d22/fc8 302419013 1 2024-08-01T06:56:30.890 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:30 smithi016 ceph-mon[29266]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:56:30.891 INFO:tasks.workunit.client.0.smithi016.stdout:2/813: mknod d0/d8/d6b/c112 0 2024-08-01T06:56:30.896 INFO:tasks.workunit.client.0.smithi016.stdout:7/625: dread - d7/db/d17/d72/d1e/d26/d2a/f9f zero size 2024-08-01T06:56:30.902 INFO:tasks.workunit.client.0.smithi016.stdout:8/503: dwrite d5/d8/d1a/d59/f5a [0,4194304] 0 2024-08-01T06:56:30.902 INFO:tasks.workunit.client.0.smithi016.stdout:6/714: dwrite d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/ff4 [0,4194304] 0 2024-08-01T06:56:30.906 INFO:tasks.workunit.client.0.smithi016.stdout:0/541: dwrite d10/d1c/d7c/f8f [0,4194304] 0 2024-08-01T06:56:30.908 INFO:tasks.workunit.client.0.smithi016.stdout:4/651: dread d0/d2/d36/f70 [0,4194304] 0 2024-08-01T06:56:30.909 INFO:tasks.workunit.client.0.smithi016.stdout:2/814: rename d0/d8/d1b/d74/d90/d93/fea to d0/d8/d1b/dfe/d10e/f113 0 2024-08-01T06:56:30.915 INFO:tasks.workunit.client.0.smithi016.stdout:7/626: fsync d7/db/d17/d72/d1c/d1d/d40/d67/d7c/fe7 0 2024-08-01T06:56:30.915 INFO:tasks.workunit.client.0.smithi016.stdout:0/542: fsync d10/d11/d37/d58/f68 0 2024-08-01T06:56:30.916 INFO:tasks.workunit.client.0.smithi016.stdout:6/715: fdatasync d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/da2/fb7 0 2024-08-01T06:56:30.918 INFO:tasks.workunit.client.0.smithi016.stdout:4/652: truncate d0/d2/fd8 207168 0 2024-08-01T06:56:30.923 INFO:tasks.workunit.client.0.smithi016.stdout:0/543: write d10/d5c/f75 [4467070,76940] 0 2024-08-01T06:56:30.923 INFO:tasks.workunit.client.0.smithi016.stdout:2/815: chown d0/d8/d1b/dcc/d3b/d45/f7f 3726333 1 2024-08-01T06:56:30.925 INFO:tasks.workunit.client.0.smithi016.stdout:3/521: sync 2024-08-01T06:56:30.926 INFO:tasks.workunit.client.0.smithi016.stdout:9/721: truncate d3/d9/df/d16/f62 2997781 0 2024-08-01T06:56:30.933 INFO:tasks.workunit.client.0.smithi016.stdout:8/504: dwrite d5/d8/d1a/d24/d48/f7c [0,4194304] 0 2024-08-01T06:56:30.934 INFO:tasks.workunit.client.0.smithi016.stdout:4/653: symlink d0/d2/dc/d12/dd3/d22/d26/lde 0 2024-08-01T06:56:30.943 INFO:tasks.workunit.client.0.smithi016.stdout:7/627: write d7/db/d17/d72/d1c/d1d/d40/d58/fbc [768301,4773] 0 2024-08-01T06:56:30.947 INFO:tasks.workunit.client.0.smithi016.stdout:4/654: dread d0/d2/d68/f7a [0,4194304] 0 2024-08-01T06:56:30.951 INFO:tasks.workunit.client.0.smithi016.stdout:2/816: rename d0/d8/d31/dc7/ffb to d0/d8/d31/db6/f114 0 2024-08-01T06:56:30.954 INFO:tasks.workunit.client.0.smithi016.stdout:2/817: stat d0/d8/f26 0 2024-08-01T06:56:30.955 INFO:tasks.workunit.client.0.smithi016.stdout:0/544: dwrite d10/d1c/f20 [0,4194304] 0 2024-08-01T06:56:30.961 INFO:tasks.workunit.client.0.smithi016.stdout:6/716: dread d1/d8/d1b/d22/d36/d7a/dd3/da3/fc9 [0,4194304] 0 2024-08-01T06:56:30.964 INFO:tasks.workunit.client.0.smithi016.stdout:0/545: creat d10/d11/d37/d82/fa9 x:0 0 0 2024-08-01T06:56:30.970 INFO:tasks.workunit.client.0.smithi016.stdout:7/628: write d7/f11 [4494584,119515] 0 2024-08-01T06:56:30.970 INFO:tasks.workunit.client.0.smithi016.stdout:3/522: dwrite d9/da/df/d12/d20/d3c/f52 [0,4194304] 0 2024-08-01T06:56:30.971 INFO:tasks.workunit.client.0.smithi016.stdout:9/722: getdents d3/d9/db 0 2024-08-01T06:56:30.977 INFO:tasks.workunit.client.0.smithi016.stdout:9/723: truncate d3/d9/db/dc/fbc 1458746 0 2024-08-01T06:56:30.977 INFO:tasks.workunit.client.0.smithi016.stdout:3/523: chown d9/da/df/d12/d20/d5c/d7a 0 1 2024-08-01T06:56:30.978 INFO:tasks.workunit.client.0.smithi016.stdout:4/655: link d0/d2/f33 d0/db9/fdf 0 2024-08-01T06:56:30.980 INFO:tasks.workunit.client.0.smithi016.stdout:2/818: creat d0/d16/d20/f115 x:0 0 0 2024-08-01T06:56:30.982 INFO:tasks.workunit.client.0.smithi016.stdout:8/505: link d5/d8/d75/f96 d5/d67/d86/fa7 0 2024-08-01T06:56:30.984 INFO:tasks.workunit.client.0.smithi016.stdout:9/724: fdatasync d3/d9/d46/d48/fe4 0 2024-08-01T06:56:30.986 INFO:tasks.workunit.client.0.smithi016.stdout:7/629: dwrite d7/db/d17/d72/d1c/d79/fb0 [4194304,4194304] 0 2024-08-01T06:56:30.988 INFO:tasks.workunit.client.0.smithi016.stdout:4/656: mkdir d0/d2/dc/d12/dd3/d22/d26/de0 0 2024-08-01T06:56:30.989 INFO:tasks.workunit.client.0.smithi016.stdout:3/524: mknod d9/da/df/d12/d75/cb2 0 2024-08-01T06:56:30.990 INFO:tasks.workunit.client.0.smithi016.stdout:8/506: mkdir d5/d8/d1a/d24/d48/d85/da8 0 2024-08-01T06:56:30.992 INFO:tasks.workunit.client.0.smithi016.stdout:4/657: chown d0/d2/dc/d12/dd3/d22/d26/lde 7531774 1 2024-08-01T06:56:30.993 INFO:tasks.workunit.client.0.smithi016.stdout:9/725: mknod d3/d32/d5c/d8a/d57/ce9 0 2024-08-01T06:56:30.993 INFO:tasks.workunit.client.0.smithi016.stdout:7/630: creat d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/fe8 x:0 0 0 2024-08-01T06:56:30.994 INFO:tasks.workunit.client.0.smithi016.stdout:2/819: mknod d0/d8/d31/d111/c116 0 2024-08-01T06:56:30.997 INFO:tasks.workunit.client.0.smithi016.stdout:6/717: write d1/d8/d1b/db5/d67/d8f/dba/fe8 [1051025,113290] 0 2024-08-01T06:56:30.999 INFO:tasks.workunit.client.0.smithi016.stdout:8/507: mkdir d5/d8/d1a/da9 0 2024-08-01T06:56:30.999 INFO:tasks.workunit.client.0.smithi016.stdout:3/525: read d9/da/df/d12/f15 [841134,10158] 0 2024-08-01T06:56:30.999 INFO:tasks.workunit.client.0.smithi016.stdout:2/820: write d0/d8/d31/dc1/f101 [224867,49583] 0 2024-08-01T06:56:30.999 INFO:tasks.workunit.client.0.smithi016.stdout:4/658: mknod d0/d2/dc/d12/dd3/d22/ce1 0 2024-08-01T06:56:31.060 INFO:tasks.workunit.client.0.smithi016.stdout:5/636: sync 2024-08-01T06:56:31.061 INFO:tasks.workunit.client.0.smithi016.stdout:1/749: sync 2024-08-01T06:56:31.135 INFO:tasks.workunit.client.0.smithi016.stdout:3/526: chown d9/d3e/d80/l8f 1757130 1 2024-08-01T06:56:31.135 INFO:tasks.workunit.client.0.smithi016.stdout:2/821: unlink d0/d8/c21 0 2024-08-01T06:56:31.136 INFO:tasks.workunit.client.0.smithi016.stdout:5/637: chown d1/d2/d20/d38 3048235 1 2024-08-01T06:56:31.136 INFO:tasks.workunit.client.0.smithi016.stdout:4/659: readlink d0/d2/dc/d12/dd3/d22/l51 0 2024-08-01T06:56:31.137 INFO:tasks.workunit.client.0.smithi016.stdout:0/546: dread d10/d11/f64 [0,4194304] 0 2024-08-01T06:56:31.138 INFO:tasks.workunit.client.0.smithi016.stdout:9/726: dread d3/de/d89/fa9 [0,4194304] 0 2024-08-01T06:56:31.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:30 smithi016 ceph-mon[29266]: pgmap v29: 65 pgs: 65 active+clean; 1.8 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 53 MiB/s rd, 130 MiB/s wr, 387 op/s 2024-08-01T06:56:31.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:30 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/952029737' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:56:31.151 INFO:tasks.workunit.client.0.smithi016.stdout:1/750: creat d2/de/d21/d3e/dc3/f10b x:0 0 0 2024-08-01T06:56:31.151 INFO:tasks.workunit.client.0.smithi016.stdout:2/822: chown d0/c4 31555 1 2024-08-01T06:56:31.152 INFO:tasks.workunit.client.0.smithi016.stdout:5/638: write d1/d2/d6/d9/d49/d57/db1/fcd [768481,32944] 0 2024-08-01T06:56:31.153 INFO:tasks.workunit.client.0.smithi016.stdout:3/527: creat d9/d98/fb3 x:0 0 0 2024-08-01T06:56:31.157 INFO:tasks.workunit.client.0.smithi016.stdout:6/718: dread d1/d8/f11 [4194304,4194304] 0 2024-08-01T06:56:31.157 INFO:tasks.workunit.client.0.smithi016.stdout:9/727: mkdir d3/d9/d46/dea 0 2024-08-01T06:56:31.159 INFO:tasks.workunit.client.0.smithi016.stdout:1/751: symlink d2/de/d21/l10c 0 2024-08-01T06:56:31.160 INFO:tasks.workunit.client.0.smithi016.stdout:2/823: truncate d0/d8/d31/d5e/fa5 1012080 0 2024-08-01T06:56:31.160 INFO:tasks.workunit.client.0.smithi016.stdout:4/660: write d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d79/f84 [581552,80789] 0 2024-08-01T06:56:31.161 INFO:tasks.workunit.client.0.smithi016.stdout:3/528: stat d9/da/df/d12/d20/d5c/d76/f87 0 2024-08-01T06:56:31.162 INFO:tasks.workunit.client.0.smithi016.stdout:5/639: write d1/d2/d6/d9/d49/d57/db1/fd5 [511043,110191] 0 2024-08-01T06:56:31.164 INFO:tasks.workunit.client.0.smithi016.stdout:8/508: dwrite d5/d8/d1a/d24/f2b [0,4194304] 0 2024-08-01T06:56:31.168 INFO:tasks.workunit.client.0.smithi016.stdout:4/661: symlink d0/d9d/le2 0 2024-08-01T06:56:31.170 INFO:tasks.workunit.client.0.smithi016.stdout:9/728: write d3/d9/df/f2d [2929152,89017] 0 2024-08-01T06:56:31.172 INFO:tasks.workunit.client.0.smithi016.stdout:1/752: creat d2/d3/d41/d49/d51/f10d x:0 0 0 2024-08-01T06:56:31.173 INFO:tasks.workunit.client.0.smithi016.stdout:8/509: creat d5/d67/d86/faa x:0 0 0 2024-08-01T06:56:31.178 INFO:tasks.workunit.client.0.smithi016.stdout:9/729: mknod d3/de/dd7/ceb 0 2024-08-01T06:56:31.181 INFO:tasks.workunit.client.0.smithi016.stdout:2/824: getdents d0/d8/d1b/dcc/d68 0 2024-08-01T06:56:31.181 INFO:tasks.workunit.client.0.smithi016.stdout:0/547: dwrite f9 [0,4194304] 0 2024-08-01T06:56:31.184 INFO:tasks.workunit.client.0.smithi016.stdout:5/640: dwrite d1/d12/d3e/f92 [4194304,4194304] 0 2024-08-01T06:56:31.184 INFO:tasks.workunit.client.0.smithi016.stdout:9/730: chown d3/de/dae/faf 380082 1 2024-08-01T06:56:31.186 INFO:tasks.workunit.client.0.smithi016.stdout:5/641: chown d1/d2/d6/d9/d19/c73 118242 1 2024-08-01T06:56:31.188 INFO:tasks.workunit.client.0.smithi016.stdout:5/642: dread - d1/d2/d6/d9/d49/fdc zero size 2024-08-01T06:56:31.196 INFO:tasks.workunit.client.0.smithi016.stdout:9/731: stat d3/d9/db/dc/le0 0 2024-08-01T06:56:31.202 INFO:tasks.workunit.client.0.smithi016.stdout:4/662: link d0/d2/f11 d0/d2/d36/dbd/fe3 0 2024-08-01T06:56:31.202 INFO:tasks.workunit.client.0.smithi016.stdout:4/663: stat d0/d2/dc/d12/dd3/d22/d26/lde 0 2024-08-01T06:56:31.204 INFO:tasks.workunit.client.0.smithi016.stdout:1/753: dwrite d2/d3/d41/f47 [0,4194304] 0 2024-08-01T06:56:31.206 INFO:tasks.workunit.client.0.smithi016.stdout:9/732: creat d3/d9/db/d3a/fec x:0 0 0 2024-08-01T06:56:31.207 INFO:tasks.workunit.client.0.smithi016.stdout:8/510: link d5/d8/f58 d5/d1c/fab 0 2024-08-01T06:56:31.208 INFO:tasks.workunit.client.0.smithi016.stdout:4/664: rename d0/d2/dc/d12/dd3/d22/d26/d85 to d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d91/dab/de4 22 2024-08-01T06:56:31.208 INFO:tasks.workunit.client.0.smithi016.stdout:0/548: write d10/d11/d37/f7d [5658361,55276] 0 2024-08-01T06:56:31.209 INFO:tasks.workunit.client.0.smithi016.stdout:4/665: stat d0/d2/d36/f70 0 2024-08-01T06:56:31.210 INFO:tasks.workunit.client.0.smithi016.stdout:2/825: write d0/d8/d1b/d74/d99/fa0 [463442,57414] 0 2024-08-01T06:56:31.211 INFO:tasks.workunit.client.0.smithi016.stdout:0/549: dread - d10/d11/d37/d50/fa7 zero size 2024-08-01T06:56:31.212 INFO:tasks.workunit.client.0.smithi016.stdout:6/719: truncate d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f38 2504941 0 2024-08-01T06:56:31.212 INFO:tasks.workunit.client.0.smithi016.stdout:9/733: creat d3/d9/d73/fed x:0 0 0 2024-08-01T06:56:31.214 INFO:tasks.workunit.client.0.smithi016.stdout:1/754: symlink d2/d2f/l10e 0 2024-08-01T06:56:31.218 INFO:tasks.workunit.client.0.smithi016.stdout:9/734: dread d3/de/d89/fbf [0,4194304] 0 2024-08-01T06:56:31.218 INFO:tasks.workunit.client.0.smithi016.stdout:0/550: chown d10/d11/d37/c7e 6 1 2024-08-01T06:56:31.219 INFO:tasks.workunit.client.0.smithi016.stdout:5/643: dread d1/d2/d6/d9/d49/fa3 [0,4194304] 0 2024-08-01T06:56:31.222 INFO:tasks.workunit.client.0.smithi016.stdout:1/755: chown d2/d2f/dba 0 1 2024-08-01T06:56:31.226 INFO:tasks.workunit.client.0.smithi016.stdout:6/720: creat d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d93/daf/f104 x:0 0 0 2024-08-01T06:56:31.228 INFO:tasks.workunit.client.0.smithi016.stdout:6/721: stat d1/d8/d1b/d22/d2d 0 2024-08-01T06:56:31.228 INFO:tasks.workunit.client.0.smithi016.stdout:8/511: dwrite d5/d8/f93 [0,4194304] 0 2024-08-01T06:56:31.228 INFO:tasks.workunit.client.0.smithi016.stdout:2/826: write d0/d8/d31/dc1/dc4/fd1 [2952552,103807] 0 2024-08-01T06:56:31.229 INFO:tasks.workunit.client.0.smithi016.stdout:4/666: truncate d0/d2/dc/d12/dd3/d22/d26/d85/dc1/f5e 1246655 0 2024-08-01T06:56:31.232 INFO:tasks.workunit.client.0.smithi016.stdout:2/827: chown d0/d8/d31/dc1/de7/lbe 129 1 2024-08-01T06:56:31.233 INFO:tasks.workunit.client.0.smithi016.stdout:9/735: rename d3/d9/db/dc/d33/c69 to d3/de/d6d/cee 0 2024-08-01T06:56:31.238 INFO:tasks.workunit.client.0.smithi016.stdout:4/667: mknod d0/d9d/ce5 0 2024-08-01T06:56:31.240 INFO:tasks.workunit.client.0.smithi016.stdout:8/512: symlink d5/d8/d1a/d24/d48/d60/d63/lac 0 2024-08-01T06:56:31.241 INFO:tasks.workunit.client.0.smithi016.stdout:9/736: dwrite d3/d9/db/d3e/fc5 [0,4194304] 0 2024-08-01T06:56:31.244 INFO:tasks.workunit.client.0.smithi016.stdout:0/551: rename d10/d11/d37/l48 to d10/d5c/d90/da0/laa 0 2024-08-01T06:56:31.247 INFO:tasks.workunit.client.0.smithi016.stdout:9/737: truncate d3/d9/d73/fd1 197297 0 2024-08-01T06:56:31.249 INFO:tasks.workunit.client.0.smithi016.stdout:0/552: chown d10/d5c/d90/f9c 0 1 2024-08-01T06:56:31.250 INFO:tasks.workunit.client.0.smithi016.stdout:9/738: readlink d3/d9/db/dc/lc3 0 2024-08-01T06:56:31.252 INFO:tasks.workunit.client.0.smithi016.stdout:5/644: write d1/d2/d6/d9/f34 [1730715,61283] 0 2024-08-01T06:56:31.252 INFO:tasks.workunit.client.0.smithi016.stdout:4/668: dwrite d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d91/fdd [0,4194304] 0 2024-08-01T06:56:31.256 INFO:tasks.workunit.client.0.smithi016.stdout:4/669: read d0/d2/dc/d12/dd3/d22/f6b [742245,13247] 0 2024-08-01T06:56:31.264 INFO:tasks.workunit.client.0.smithi016.stdout:0/553: symlink d10/d11/d37/d58/lab 0 2024-08-01T06:56:31.264 INFO:tasks.workunit.client.0.smithi016.stdout:0/554: stat d10/c9e 0 2024-08-01T06:56:31.265 INFO:tasks.workunit.client.0.smithi016.stdout:9/739: symlink d3/d9/df/d2a/lef 0 2024-08-01T06:56:31.265 INFO:tasks.workunit.client.0.smithi016.stdout:2/828: truncate d0/d8/d22/f8c 3528529 0 2024-08-01T06:56:31.266 INFO:tasks.workunit.client.0.smithi016.stdout:9/740: fdatasync d3/d9/db/dc/d33/fc1 0 2024-08-01T06:56:31.267 INFO:tasks.workunit.client.0.smithi016.stdout:2/829: write d0/d8/d31/f51 [1841838,41973] 0 2024-08-01T06:56:31.267 INFO:tasks.workunit.client.0.smithi016.stdout:5/645: symlink d1/d2/d6/d9/d49/lde 0 2024-08-01T06:56:31.270 INFO:tasks.workunit.client.0.smithi016.stdout:1/756: getdents d2/d2f 0 2024-08-01T06:56:31.271 INFO:tasks.workunit.client.0.smithi016.stdout:6/722: getdents d1/d8/d94 0 2024-08-01T06:56:31.272 INFO:tasks.workunit.client.0.smithi016.stdout:0/555: symlink d10/d11/d37/d53/lac 0 2024-08-01T06:56:31.274 INFO:tasks.workunit.client.0.smithi016.stdout:5/646: unlink d1/d2/d20/d72/f9b 0 2024-08-01T06:56:31.275 INFO:tasks.workunit.client.0.smithi016.stdout:9/741: dwrite d3/d9/d73/fd1 [0,4194304] 0 2024-08-01T06:56:31.275 INFO:tasks.workunit.client.0.smithi016.stdout:8/513: rmdir d5/d8/d1a/d24/d48/d69/da3 0 2024-08-01T06:56:31.277 INFO:tasks.workunit.client.0.smithi016.stdout:9/742: rename d3/d32 to d3/d32/d5c/df0 22 2024-08-01T06:56:31.281 INFO:tasks.workunit.client.0.smithi016.stdout:1/757: mkdir d2/de/d4d/d92/d10f 0 2024-08-01T06:56:31.282 INFO:tasks.workunit.client.0.smithi016.stdout:1/758: chown d2/d2f/c61 1394 1 2024-08-01T06:56:31.282 INFO:tasks.workunit.client.0.smithi016.stdout:0/556: symlink d10/d11/d37/d82/lad 0 2024-08-01T06:56:31.282 INFO:tasks.workunit.client.0.smithi016.stdout:1/759: write d2/f17 [3030636,63939] 0 2024-08-01T06:56:31.284 INFO:tasks.workunit.client.0.smithi016.stdout:8/514: unlink d5/dc/d3e/f73 0 2024-08-01T06:56:31.285 INFO:tasks.workunit.client.0.smithi016.stdout:8/515: chown d5/d8/d1a/d24/d48/c7f 13824930 1 2024-08-01T06:56:31.286 INFO:tasks.workunit.client.0.smithi016.stdout:8/516: chown d5/d8/f93 349152691 1 2024-08-01T06:56:31.288 INFO:tasks.workunit.client.0.smithi016.stdout:4/670: link d0/d2/dc/d12/dd3/d22/d26/da3/f77 d0/d2/dc/d12/dd3/d22/fe6 0 2024-08-01T06:56:31.289 INFO:tasks.workunit.client.0.smithi016.stdout:6/723: truncate d1/d8/fa 1544192 0 2024-08-01T06:56:31.294 INFO:tasks.workunit.client.0.smithi016.stdout:9/743: mkdir d3/d9/df/df1 0 2024-08-01T06:56:31.296 INFO:tasks.workunit.client.0.smithi016.stdout:8/517: symlink d5/d8/d1a/d24/d48/lad 0 2024-08-01T06:56:31.297 INFO:tasks.workunit.client.0.smithi016.stdout:4/671: creat d0/d2/dc/d12/dd3/d38/fe7 x:0 0 0 2024-08-01T06:56:31.301 INFO:tasks.workunit.client.0.smithi016.stdout:0/557: link d10/d11/d37/c3f d10/d11/d37/d53/cae 0 2024-08-01T06:56:31.302 INFO:tasks.workunit.client.0.smithi016.stdout:9/744: symlink d3/d9/db/d3e/dd4/lf2 0 2024-08-01T06:56:31.304 INFO:tasks.workunit.client.0.smithi016.stdout:8/518: dwrite d5/d8/d1a/d24/d48/d60/d63/f71 [0,4194304] 0 2024-08-01T06:56:31.305 INFO:tasks.workunit.client.0.smithi016.stdout:1/760: getdents d2/d2f/dba 0 2024-08-01T06:56:31.307 INFO:tasks.workunit.client.0.smithi016.stdout:0/558: symlink d10/d5c/d91/laf 0 2024-08-01T06:56:31.308 INFO:tasks.workunit.client.0.smithi016.stdout:6/724: getdents d1 0 2024-08-01T06:56:31.309 INFO:tasks.workunit.client.0.smithi016.stdout:4/672: truncate d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d8f/fb7 609232 0 2024-08-01T06:56:31.311 INFO:tasks.workunit.client.0.smithi016.stdout:6/725: write d1/d8/d1b/db5/d67/d8f/dba/dbd/f84 [1126839,130138] 0 2024-08-01T06:56:31.311 INFO:tasks.workunit.client.0.smithi016.stdout:9/745: symlink d3/de/dd7/lf3 0 2024-08-01T06:56:31.314 INFO:tasks.workunit.client.0.smithi016.stdout:8/519: read d5/d8/fd [2425155,117742] 0 2024-08-01T06:56:31.316 INFO:tasks.workunit.client.0.smithi016.stdout:0/559: fsync d10/d11/f83 0 2024-08-01T06:56:31.323 INFO:tasks.workunit.client.0.smithi016.stdout:4/673: mknod d0/d2/dc/d12/dd3/d22/d7f/ce8 0 2024-08-01T06:56:31.324 INFO:tasks.workunit.client.0.smithi016.stdout:6/726: creat d1/d8/d94/f105 x:0 0 0 2024-08-01T06:56:31.326 INFO:tasks.workunit.client.0.smithi016.stdout:8/520: stat d5/d8/f68 0 2024-08-01T06:56:31.326 INFO:tasks.workunit.client.0.smithi016.stdout:1/761: dread d2/f12 [0,4194304] 0 2024-08-01T06:56:31.330 INFO:tasks.workunit.client.0.smithi016.stdout:9/746: dread d3/d9/d46/f79 [4194304,4194304] 0 2024-08-01T06:56:31.331 INFO:tasks.workunit.client.0.smithi016.stdout:9/747: stat d3/d9/db/dc/d56 0 2024-08-01T06:56:31.349 INFO:tasks.workunit.client.0.smithi016.stdout:4/674: rmdir d0/d2/da0 39 2024-08-01T06:56:31.354 INFO:tasks.workunit.client.0.smithi016.stdout:6/727: creat d1/d8/d1b/d22/d71/db1/f106 x:0 0 0 2024-08-01T06:56:31.357 INFO:tasks.workunit.client.0.smithi016.stdout:1/762: creat d2/de/d32/d43/f110 x:0 0 0 2024-08-01T06:56:31.357 INFO:tasks.workunit.client.0.smithi016.stdout:9/748: creat d3/de/d89/ff4 x:0 0 0 2024-08-01T06:56:31.358 INFO:tasks.workunit.client.0.smithi016.stdout:9/749: read d3/f1d [1042650,122768] 0 2024-08-01T06:56:31.359 INFO:tasks.workunit.client.0.smithi016.stdout:6/728: creat d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d8e/f107 x:0 0 0 2024-08-01T06:56:31.359 INFO:tasks.workunit.client.0.smithi016.stdout:9/750: write d3/d9/df/f3d [4166502,108497] 0 2024-08-01T06:56:31.361 INFO:tasks.workunit.client.0.smithi016.stdout:1/763: chown d2/d3/d1c/de1/cee 902140529 1 2024-08-01T06:56:31.362 INFO:tasks.workunit.client.0.smithi016.stdout:4/675: mkdir d0/d9d/da2/dd1/de9 0 2024-08-01T06:56:31.363 INFO:tasks.workunit.client.0.smithi016.stdout:1/764: chown d2/d3/d41/c8b 1 1 2024-08-01T06:56:31.364 INFO:tasks.workunit.client.0.smithi016.stdout:1/765: chown d2/de/d21 3 1 2024-08-01T06:56:31.366 INFO:tasks.workunit.client.0.smithi016.stdout:9/751: truncate d3/d32/d5c/d8a/f75 693568 0 2024-08-01T06:56:31.369 INFO:tasks.workunit.client.0.smithi016.stdout:9/752: mkdir d3/d32/d5c/d8a/df5 0 2024-08-01T06:56:31.371 INFO:tasks.workunit.client.0.smithi016.stdout:1/766: link d2/de/d32/feb d2/d3/d1c/de1/d106/f111 0 2024-08-01T06:56:31.371 INFO:tasks.workunit.client.0.smithi016.stdout:4/676: mkdir d0/d2/da0/dd2/dea 0 2024-08-01T06:56:31.372 INFO:tasks.workunit.client.0.smithi016.stdout:6/729: link d1/d8/d1b/d22/d36/d7a/fce d1/d8/d1b/db5/d67/f108 0 2024-08-01T06:56:31.372 INFO:tasks.workunit.client.0.smithi016.stdout:6/730: readlink d1/d8/l59 0 2024-08-01T06:56:31.373 INFO:tasks.workunit.client.0.smithi016.stdout:1/767: creat d2/de/d21/f112 x:0 0 0 2024-08-01T06:56:31.375 INFO:tasks.workunit.client.0.smithi016.stdout:9/753: mknod d3/d9/df/cf6 0 2024-08-01T06:56:31.376 INFO:tasks.workunit.client.0.smithi016.stdout:0/560: write d10/d11/d37/d58/f59 [1023240,94089] 0 2024-08-01T06:56:31.378 INFO:tasks.workunit.client.0.smithi016.stdout:1/768: chown d2/d3/d41/d49/d85/dc1/dd8/fdc 98 1 2024-08-01T06:56:31.378 INFO:tasks.workunit.client.0.smithi016.stdout:9/754: fsync d3/d9/df/d16/f2b 0 2024-08-01T06:56:31.384 INFO:tasks.workunit.client.0.smithi016.stdout:0/561: dread d10/d11/f43 [0,4194304] 0 2024-08-01T06:56:31.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:30 smithi089 ceph-mon[36617]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:56:31.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:30 smithi089 ceph-mon[36617]: pgmap v29: 65 pgs: 65 active+clean; 1.8 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 53 MiB/s rd, 130 MiB/s wr, 387 op/s 2024-08-01T06:56:31.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:30 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/952029737' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:56:31.387 INFO:tasks.workunit.client.0.smithi016.stdout:4/677: getdents d0/d2/dc/d12/dd3/d22/d7f 0 2024-08-01T06:56:31.388 INFO:tasks.workunit.client.0.smithi016.stdout:8/521: dwrite d5/d8/f68 [0,4194304] 0 2024-08-01T06:56:31.394 INFO:tasks.workunit.client.0.smithi016.stdout:6/731: dread d1/d43/f4a [0,4194304] 0 2024-08-01T06:56:31.396 INFO:tasks.workunit.client.0.smithi016.stdout:4/678: creat d0/d2/dc/d12/dd3/d22/d26/d8b/feb x:0 0 0 2024-08-01T06:56:31.398 INFO:tasks.workunit.client.0.smithi016.stdout:4/679: write d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/fb6 [737899,25314] 0 2024-08-01T06:56:31.399 INFO:tasks.workunit.client.0.smithi016.stdout:8/522: rename d5/d8/d1a/d24/f2b to d5/d8/d1a/d24/d48/d6e/d92/d99/fae 0 2024-08-01T06:56:31.406 INFO:tasks.workunit.client.0.smithi016.stdout:1/769: write d2/d3/d48/f53 [671543,38676] 0 2024-08-01T06:56:31.414 INFO:tasks.workunit.client.0.smithi016.stdout:1/770: creat d2/de/d21/d3e/df4/f113 x:0 0 0 2024-08-01T06:56:31.415 INFO:tasks.workunit.client.0.smithi016.stdout:0/562: dwrite d10/f2e [0,4194304] 0 2024-08-01T06:56:31.416 INFO:tasks.workunit.client.0.smithi016.stdout:6/732: truncate d1/d8/d1b/db5/d67/d8f/dba/dbd/f84 3158959 0 2024-08-01T06:56:31.417 INFO:tasks.workunit.client.0.smithi016.stdout:1/771: dread d2/f72 [0,4194304] 0 2024-08-01T06:56:31.418 INFO:tasks.workunit.client.0.smithi016.stdout:4/680: rmdir d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d91/dab 0 2024-08-01T06:56:31.420 INFO:tasks.workunit.client.0.smithi016.stdout:0/563: mknod d10/cb0 0 2024-08-01T06:56:31.421 INFO:tasks.workunit.client.0.smithi016.stdout:8/523: getdents d5/d8/d1a 0 2024-08-01T06:56:31.422 INFO:tasks.workunit.client.0.smithi016.stdout:8/524: stat d5/d8/d1a/d59/l65 0 2024-08-01T06:56:31.424 INFO:tasks.workunit.client.0.smithi016.stdout:0/564: mkdir d10/d11/d37/d50/db1 0 2024-08-01T06:56:31.427 INFO:tasks.workunit.client.0.smithi016.stdout:1/772: write f0 [3603365,97384] 0 2024-08-01T06:56:31.430 INFO:tasks.workunit.client.0.smithi016.stdout:1/773: creat d2/d88/f114 x:0 0 0 2024-08-01T06:56:31.431 INFO:tasks.workunit.client.0.smithi016.stdout:1/774: readlink d2/de/d21/l100 0 2024-08-01T06:56:31.433 INFO:tasks.workunit.client.0.smithi016.stdout:8/525: dread d5/d8/d1a/d24/d48/d69/fa2 [0,4194304] 0 2024-08-01T06:56:31.433 INFO:tasks.workunit.client.0.smithi016.stdout:0/565: link d10/d1c/f4e d10/d11/d37/d82/fb2 0 2024-08-01T06:56:31.437 INFO:tasks.workunit.client.0.smithi016.stdout:1/775: dread d2/d3/d41/f47 [0,4194304] 0 2024-08-01T06:56:31.438 INFO:tasks.workunit.client.0.smithi016.stdout:8/526: read d5/f61 [166562,27808] 0 2024-08-01T06:56:31.440 INFO:tasks.workunit.client.0.smithi016.stdout:1/776: stat d2/d3/d41/ce7 0 2024-08-01T06:56:31.441 INFO:tasks.workunit.client.0.smithi016.stdout:4/681: dwrite d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/f55 [4194304,4194304] 0 2024-08-01T06:56:31.445 INFO:tasks.workunit.client.0.smithi016.stdout:8/527: mkdir d5/d8/d1a/d24/d48/d85/daf 0 2024-08-01T06:56:31.447 INFO:tasks.workunit.client.0.smithi016.stdout:1/777: creat d2/d3/d1f/f115 x:0 0 0 2024-08-01T06:56:31.448 INFO:tasks.workunit.client.0.smithi016.stdout:1/778: chown d2/d3/d48/fed 47 1 2024-08-01T06:56:31.449 INFO:tasks.workunit.client.0.smithi016.stdout:1/779: read f0 [1142454,1604] 0 2024-08-01T06:56:31.450 INFO:tasks.workunit.client.0.smithi016.stdout:8/528: mkdir d5/d8/d75/db0 0 2024-08-01T06:56:31.450 INFO:tasks.workunit.client.0.smithi016.stdout:0/566: truncate d10/d11/d41/f2f 1104123 0 2024-08-01T06:56:31.451 INFO:tasks.workunit.client.0.smithi016.stdout:1/780: write d2/d3/d48/f53 [101057,106886] 0 2024-08-01T06:56:31.452 INFO:tasks.workunit.client.0.smithi016.stdout:4/682: mkdir d0/d9d/da2/dd1/de9/dec 0 2024-08-01T06:56:31.453 INFO:tasks.workunit.client.0.smithi016.stdout:8/529: rmdir d5/d8/d1a 39 2024-08-01T06:56:31.455 INFO:tasks.workunit.client.0.smithi016.stdout:1/781: creat d2/de/d21/d3e/f116 x:0 0 0 2024-08-01T06:56:31.461 INFO:tasks.workunit.client.0.smithi016.stdout:8/530: rmdir d5/d8/d1a/d24/d48/d6e 39 2024-08-01T06:56:31.462 INFO:tasks.workunit.client.0.smithi016.stdout:8/531: read - d5/dc/d3e/f6b zero size 2024-08-01T06:56:31.464 INFO:tasks.workunit.client.0.smithi016.stdout:1/782: dwrite d2/de/f14 [0,4194304] 0 2024-08-01T06:56:31.466 INFO:tasks.workunit.client.0.smithi016.stdout:1/783: chown d2/d3/d1a/f4e 1710157 1 2024-08-01T06:56:31.467 INFO:tasks.workunit.client.0.smithi016.stdout:1/784: readlink d2/de/d32/d43/l9c 0 2024-08-01T06:56:31.468 INFO:tasks.workunit.client.0.smithi016.stdout:1/785: chown d2/de/d63/dd6 9827 1 2024-08-01T06:56:31.470 INFO:tasks.workunit.client.0.smithi016.stdout:8/532: rename d5/d8/d1a/d24/l5d to d5/d8/d1a/d24/d6a/lb1 0 2024-08-01T06:56:31.473 INFO:tasks.workunit.client.0.smithi016.stdout:1/786: link d2/d3/d41/c8b d2/de/d32/c117 0 2024-08-01T06:56:31.473 INFO:tasks.workunit.client.0.smithi016.stdout:0/567: write d10/d11/d37/d50/f99 [850256,63725] 0 2024-08-01T06:56:31.474 INFO:tasks.workunit.client.0.smithi016.stdout:8/533: read d5/d1c/f33 [3054176,71349] 0 2024-08-01T06:56:31.476 INFO:tasks.workunit.client.0.smithi016.stdout:1/787: mkdir d2/d3/d118 0 2024-08-01T06:56:31.477 INFO:tasks.workunit.client.0.smithi016.stdout:0/568: creat d10/d5c/d90/fb3 x:0 0 0 2024-08-01T06:56:31.479 INFO:tasks.workunit.client.0.smithi016.stdout:8/534: creat d5/d8/d1a/d24/d8c/fb2 x:0 0 0 2024-08-01T06:56:31.482 INFO:tasks.workunit.client.0.smithi016.stdout:8/535: mknod d5/dc/d3e/d72/cb3 0 2024-08-01T06:56:31.483 INFO:tasks.workunit.client.0.smithi016.stdout:0/569: mkdir d10/d11/db4 0 2024-08-01T06:56:31.485 INFO:tasks.workunit.client.0.smithi016.stdout:1/788: creat d2/de/d63/f119 x:0 0 0 2024-08-01T06:56:31.485 INFO:tasks.workunit.client.0.smithi016.stdout:8/536: chown d5/d8/f58 378631132 1 2024-08-01T06:56:31.486 INFO:tasks.workunit.client.0.smithi016.stdout:0/570: mknod d10/d1c/cb5 0 2024-08-01T06:56:31.487 INFO:tasks.workunit.client.0.smithi016.stdout:0/571: write d10/d11/f42 [864015,128234] 0 2024-08-01T06:56:31.490 INFO:tasks.workunit.client.0.smithi016.stdout:8/537: unlink d5/dc/d3e/d72/cb3 0 2024-08-01T06:56:31.491 INFO:tasks.workunit.client.0.smithi016.stdout:8/538: truncate d5/d1c/f89 511362 0 2024-08-01T06:56:31.500 INFO:tasks.workunit.client.0.smithi016.stdout:1/789: write d2/d3/d1c/f2b [3278990,118222] 0 2024-08-01T06:56:31.502 INFO:tasks.workunit.client.0.smithi016.stdout:8/539: write d5/f12 [982608,58466] 0 2024-08-01T06:56:31.504 INFO:tasks.workunit.client.0.smithi016.stdout:8/540: dread - d5/d67/d86/faa zero size 2024-08-01T06:56:31.505 INFO:tasks.workunit.client.0.smithi016.stdout:1/790: creat d2/d3/d41/d49/d85/f11a x:0 0 0 2024-08-01T06:56:31.507 INFO:tasks.workunit.client.0.smithi016.stdout:8/541: write d5/d67/d86/fa6 [578375,93269] 0 2024-08-01T06:56:31.508 INFO:tasks.workunit.client.0.smithi016.stdout:0/572: dwrite d10/d11/d41/f60 [0,4194304] 0 2024-08-01T06:56:31.510 INFO:tasks.workunit.client.0.smithi016.stdout:1/791: truncate d2/de/d32/d43/f70 999303 0 2024-08-01T06:56:31.511 INFO:tasks.workunit.client.0.smithi016.stdout:8/542: mkdir d5/d8/d1a/d24/d48/d60/d63/db4 0 2024-08-01T06:56:31.512 INFO:tasks.workunit.client.0.smithi016.stdout:0/573: symlink d10/d11/lb6 0 2024-08-01T06:56:31.513 INFO:tasks.workunit.client.0.smithi016.stdout:1/792: chown d2/de/d21/d3e/f4a 25 1 2024-08-01T06:56:31.514 INFO:tasks.workunit.client.0.smithi016.stdout:0/574: write d10/d11/d37/d50/f99 [959988,97486] 0 2024-08-01T06:56:31.515 INFO:tasks.workunit.client.0.smithi016.stdout:1/793: fsync d2/f17 0 2024-08-01T06:56:31.517 INFO:tasks.workunit.client.0.smithi016.stdout:1/794: chown d2/de/d21/d3e/c7c 3 1 2024-08-01T06:56:31.518 INFO:tasks.workunit.client.0.smithi016.stdout:0/575: read d10/d1c/f27 [216320,8780] 0 2024-08-01T06:56:31.525 INFO:tasks.workunit.client.0.smithi016.stdout:0/576: unlink d10/d11/d37/d82/fa9 0 2024-08-01T06:56:31.532 INFO:tasks.workunit.client.0.smithi016.stdout:0/577: rmdir d10/d5c/d90 39 2024-08-01T06:56:31.534 INFO:tasks.workunit.client.0.smithi016.stdout:0/578: fdatasync d10/d5c/f75 0 2024-08-01T06:56:31.534 INFO:tasks.workunit.client.0.smithi016.stdout:8/543: dwrite d5/d1c/f4c [0,4194304] 0 2024-08-01T06:56:31.534 INFO:tasks.workunit.client.0.smithi016.stdout:1/795: getdents d2/de 0 2024-08-01T06:56:31.537 INFO:tasks.workunit.client.0.smithi016.stdout:8/544: dread d5/d1c/f89 [0,4194304] 0 2024-08-01T06:56:31.543 INFO:tasks.workunit.client.0.smithi016.stdout:0/579: fsync d10/d11/d37/d58/f68 0 2024-08-01T06:56:31.544 INFO:tasks.workunit.client.0.smithi016.stdout:0/580: truncate d10/f33 3495290 0 2024-08-01T06:56:31.549 INFO:tasks.workunit.client.0.smithi016.stdout:0/581: mknod d10/d1c/cb7 0 2024-08-01T06:56:31.552 INFO:tasks.workunit.client.0.smithi016.stdout:0/582: rename d10/d11/c5e to d10/d5c/d91/cb8 0 2024-08-01T06:56:31.554 INFO:tasks.workunit.client.0.smithi016.stdout:1/796: getdents d2/de/d63/dd6/dff 0 2024-08-01T06:56:31.555 INFO:tasks.workunit.client.0.smithi016.stdout:0/583: creat d10/d11/d37/d50/fb9 x:0 0 0 2024-08-01T06:56:31.556 INFO:tasks.workunit.client.0.smithi016.stdout:0/584: fdatasync d10/d11/d37/d53/f69 0 2024-08-01T06:56:31.559 INFO:tasks.workunit.client.0.smithi016.stdout:0/585: dread d10/d11/d37/d58/f68 [0,4194304] 0 2024-08-01T06:56:31.621 INFO:tasks.workunit.client.0.smithi016.stdout:7/631: sync 2024-08-01T06:56:31.622 INFO:tasks.workunit.client.0.smithi016.stdout:0/586: truncate d10/d11/d37/d58/f68 1404219 0 2024-08-01T06:56:31.626 INFO:tasks.workunit.client.0.smithi016.stdout:7/632: symlink d7/db/d17/d72/d1c/dc6/le9 0 2024-08-01T06:56:31.626 INFO:tasks.workunit.client.0.smithi016.stdout:1/797: dread d2/de/f37 [0,4194304] 0 2024-08-01T06:56:31.627 INFO:tasks.workunit.client.0.smithi016.stdout:7/633: stat d7/db/d17/d72/d1c/d79 0 2024-08-01T06:56:31.627 INFO:tasks.workunit.client.0.smithi016.stdout:0/587: creat d10/d5c/d90/da0/fba x:0 0 0 2024-08-01T06:56:31.629 INFO:tasks.workunit.client.0.smithi016.stdout:1/798: unlink d2/de/f37 0 2024-08-01T06:56:31.641 INFO:tasks.workunit.client.0.smithi016.stdout:1/799: mknod d2/c11b 0 2024-08-01T06:56:31.644 INFO:tasks.workunit.client.0.smithi016.stdout:1/800: read - d2/f46 zero size 2024-08-01T06:56:31.644 INFO:tasks.workunit.client.0.smithi016.stdout:0/588: dread d10/d11/f42 [0,4194304] 0 2024-08-01T06:56:31.648 INFO:tasks.workunit.client.0.smithi016.stdout:7/634: dwrite d7/db/d17/d72/d1e/d26/d2a/f30 [0,4194304] 0 2024-08-01T06:56:31.653 INFO:tasks.workunit.client.0.smithi016.stdout:0/589: mkdir d10/d11/d37/d50/db1/dbb 0 2024-08-01T06:56:31.656 INFO:tasks.workunit.client.0.smithi016.stdout:7/635: mknod d7/db/d17/d72/d1c/dc6/cea 0 2024-08-01T06:56:31.658 INFO:tasks.workunit.client.0.smithi016.stdout:1/801: creat d2/d3/d1a/f11c x:0 0 0 2024-08-01T06:56:31.659 INFO:tasks.workunit.client.0.smithi016.stdout:0/590: mkdir d10/d5c/d90/da0/dbc 0 2024-08-01T06:56:31.660 INFO:tasks.workunit.client.0.smithi016.stdout:7/636: symlink d7/db/d17/d72/d1c/d79/leb 0 2024-08-01T06:56:31.660 INFO:tasks.workunit.client.0.smithi016.stdout:0/591: readlink d10/d5c/d91/laf 0 2024-08-01T06:56:31.667 INFO:tasks.workunit.client.0.smithi016.stdout:7/637: chown d7/db/d17/d72/d1e/d26/d63/dc0/lc9 74303585 1 2024-08-01T06:56:31.667 INFO:tasks.workunit.client.0.smithi016.stdout:0/592: rmdir d10/d11 39 2024-08-01T06:56:31.668 INFO:tasks.workunit.client.0.smithi016.stdout:1/802: creat d2/de/d4d/d92/f11d x:0 0 0 2024-08-01T06:56:31.671 INFO:tasks.workunit.client.0.smithi016.stdout:7/638: fsync d7/db/d17/d72/d1e/d26/f32 0 2024-08-01T06:56:31.673 INFO:tasks.workunit.client.0.smithi016.stdout:1/803: read d2/de/f31 [629567,72517] 0 2024-08-01T06:56:31.674 INFO:tasks.workunit.client.0.smithi016.stdout:0/593: stat d10/d11/d37/c63 0 2024-08-01T06:56:31.678 INFO:tasks.workunit.client.0.smithi016.stdout:0/594: mkdir d10/d5c/d90/dbd 0 2024-08-01T06:56:31.680 INFO:tasks.workunit.client.0.smithi016.stdout:7/639: dwrite d7/db/d17/d72/d1c/d79/d8f/fd8 [0,4194304] 0 2024-08-01T06:56:31.681 INFO:tasks.workunit.client.0.smithi016.stdout:1/804: creat d2/de/d21/d3e/df4/f11e x:0 0 0 2024-08-01T06:56:31.681 INFO:tasks.workunit.client.0.smithi016.stdout:7/640: dread - d7/db/d17/d72/d1c/d1d/f52 zero size 2024-08-01T06:56:31.686 INFO:tasks.workunit.client.0.smithi016.stdout:1/805: chown d2/de/d32/c117 35 1 2024-08-01T06:56:31.689 INFO:tasks.workunit.client.0.smithi016.stdout:7/641: truncate d7/db/d17/d72/d1c/d1d/d40/d67/d7c/fe7 2525211 0 2024-08-01T06:56:31.692 INFO:tasks.workunit.client.0.smithi016.stdout:7/642: readlink d7/db/d17/d72/d1e/d26/d63/dc0/lc9 0 2024-08-01T06:56:31.693 INFO:tasks.workunit.client.0.smithi016.stdout:1/806: dwrite d2/f1b [0,4194304] 0 2024-08-01T06:56:31.703 INFO:tasks.workunit.client.0.smithi016.stdout:0/595: dwrite d10/d11/f3d [0,4194304] 0 2024-08-01T06:56:31.705 INFO:tasks.workunit.client.0.smithi016.stdout:7/643: dwrite d7/db3/fd0 [0,4194304] 0 2024-08-01T06:56:31.709 INFO:tasks.workunit.client.0.smithi016.stdout:0/596: creat d10/d11/d37/fbe x:0 0 0 2024-08-01T06:56:31.709 INFO:tasks.workunit.client.0.smithi016.stdout:7/644: truncate d7/fd4 215674 0 2024-08-01T06:56:31.711 INFO:tasks.workunit.client.0.smithi016.stdout:1/807: rename d2/d3/d1a/d22/l62 to d2/d3/d1a/l11f 0 2024-08-01T06:56:31.713 INFO:tasks.workunit.client.0.smithi016.stdout:1/808: readlink d2/de/d21/d3e/l77 0 2024-08-01T06:56:31.714 INFO:tasks.workunit.client.0.smithi016.stdout:0/597: fsync d10/d11/d37/d58/f81 0 2024-08-01T06:56:31.717 INFO:tasks.workunit.client.0.smithi016.stdout:1/809: rmdir d2/de/d32 39 2024-08-01T06:56:31.725 INFO:tasks.workunit.client.0.smithi016.stdout:7/645: link d7/db/d17/d72/d1c/d1d/d40/d7f/f90 d7/db/d17/d72/d1c/d1d/d6d/fec 0 2024-08-01T06:56:31.727 INFO:tasks.workunit.client.0.smithi016.stdout:7/646: dread - d7/db/d17/fc3 zero size 2024-08-01T06:56:31.729 INFO:tasks.workunit.client.0.smithi016.stdout:1/810: unlink d2/de/d4d/cc0 0 2024-08-01T06:56:31.730 INFO:tasks.workunit.client.0.smithi016.stdout:0/598: getdents d10/d5c 0 2024-08-01T06:56:31.731 INFO:tasks.workunit.client.0.smithi016.stdout:1/811: truncate d2/d3/d48/fed 916657 0 2024-08-01T06:56:31.731 INFO:tasks.workunit.client.0.smithi016.stdout:0/599: stat d10/d1c/d7c/f8f 0 2024-08-01T06:56:31.732 INFO:tasks.workunit.client.0.smithi016.stdout:7/647: rename d7/db/l81 to d7/db/d17/d72/d1e/d26/d63/ddd/led 0 2024-08-01T06:56:31.737 INFO:tasks.workunit.client.0.smithi016.stdout:0/600: dread d10/d1c/d7c/f8f [0,4194304] 0 2024-08-01T06:56:31.739 INFO:tasks.workunit.client.0.smithi016.stdout:7/648: creat d7/db/d17/d72/d22/d77/d99/dd1/fee x:0 0 0 2024-08-01T06:56:31.748 INFO:tasks.workunit.client.0.smithi016.stdout:7/649: dwrite d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/fe8 [0,4194304] 0 2024-08-01T06:56:31.749 INFO:tasks.workunit.client.0.smithi016.stdout:1/812: dwrite d2/d3/d1a/d22/f6c [0,4194304] 0 2024-08-01T06:56:31.751 INFO:tasks.workunit.client.0.smithi016.stdout:1/813: fdatasync d2/d88/f114 0 2024-08-01T06:56:31.752 INFO:tasks.workunit.client.0.smithi016.stdout:7/650: write d7/db/d17/d72/d1c/d4f/fda [934644,42232] 0 2024-08-01T06:56:31.753 INFO:tasks.workunit.client.0.smithi016.stdout:0/601: fdatasync d10/d11/d41/f2f 0 2024-08-01T06:56:31.762 INFO:tasks.workunit.client.0.smithi016.stdout:7/651: creat d7/db/d17/d72/d22/d77/d99/dd1/fef x:0 0 0 2024-08-01T06:56:31.764 INFO:tasks.workunit.client.0.smithi016.stdout:0/602: truncate d10/d11/d37/d82/fb2 2128935 0 2024-08-01T06:56:31.767 INFO:tasks.workunit.client.0.smithi016.stdout:7/652: dread d7/db/d17/d4e/f6c [0,4194304] 0 2024-08-01T06:56:31.767 INFO:tasks.workunit.client.0.smithi016.stdout:0/603: write d10/d5c/d90/f9c [504033,80291] 0 2024-08-01T06:56:31.770 INFO:tasks.workunit.client.0.smithi016.stdout:1/814: write d2/de/d32/feb [3895946,113034] 0 2024-08-01T06:56:31.773 INFO:tasks.workunit.client.0.smithi016.stdout:0/604: creat d10/d11/db4/fbf x:0 0 0 2024-08-01T06:56:31.774 INFO:tasks.workunit.client.0.smithi016.stdout:1/815: unlink d2/d3/d41/fb1 0 2024-08-01T06:56:31.776 INFO:tasks.workunit.client.0.smithi016.stdout:0/605: symlink d10/d11/d41/d95/lc0 0 2024-08-01T06:56:31.777 INFO:tasks.workunit.client.0.smithi016.stdout:1/816: mknod d2/d3/d48/c120 0 2024-08-01T06:56:31.779 INFO:tasks.workunit.client.0.smithi016.stdout:1/817: rmdir d2/de/d32 39 2024-08-01T06:56:31.779 INFO:tasks.workunit.client.0.smithi016.stdout:1/818: chown d2/c7e 174 1 2024-08-01T06:56:31.785 INFO:tasks.workunit.client.0.smithi016.stdout:0/606: dwrite d10/d11/f64 [4194304,4194304] 0 2024-08-01T06:56:31.789 INFO:tasks.workunit.client.0.smithi016.stdout:0/607: dread d10/d1c/d7c/f8f [0,4194304] 0 2024-08-01T06:56:31.795 INFO:tasks.workunit.client.0.smithi016.stdout:1/819: dwrite d2/d3/d41/fb4 [0,4194304] 0 2024-08-01T06:56:31.799 INFO:tasks.workunit.client.0.smithi016.stdout:1/820: creat d2/d3/d1a/f121 x:0 0 0 2024-08-01T06:56:31.801 INFO:tasks.workunit.client.0.smithi016.stdout:0/608: dwrite d10/d1c/d7c/f8f [0,4194304] 0 2024-08-01T06:56:31.802 INFO:tasks.workunit.client.0.smithi016.stdout:1/821: write d2/d88/fe0 [403854,45571] 0 2024-08-01T06:56:31.807 INFO:tasks.workunit.client.0.smithi016.stdout:1/822: symlink d2/d3/d41/d49/d85/dc1/l122 0 2024-08-01T06:56:31.808 INFO:tasks.workunit.client.0.smithi016.stdout:0/609: mkdir d10/d11/dc1 0 2024-08-01T06:56:31.817 INFO:tasks.workunit.client.0.smithi016.stdout:0/610: symlink d10/d5c/d90/da2/da5/lc2 0 2024-08-01T06:56:31.818 INFO:tasks.workunit.client.0.smithi016.stdout:0/611: readlink d10/d11/lb6 0 2024-08-01T06:56:31.824 INFO:tasks.workunit.client.0.smithi016.stdout:0/612: dwrite fd [0,4194304] 0 2024-08-01T06:56:31.828 INFO:tasks.workunit.client.0.smithi016.stdout:0/613: mknod d10/d11/d37/d53/cc3 0 2024-08-01T06:56:31.833 INFO:tasks.workunit.client.0.smithi016.stdout:1/823: dread d2/d3/d1a/f4e [4194304,4194304] 0 2024-08-01T06:56:31.834 INFO:tasks.workunit.client.0.smithi016.stdout:1/824: write d2/d3/d1a/f11c [1000844,57869] 0 2024-08-01T06:56:31.835 INFO:tasks.workunit.client.0.smithi016.stdout:1/825: chown d2/d3/d41/d49/d85/dc1/lac 3639356 1 2024-08-01T06:56:31.837 INFO:tasks.workunit.client.0.smithi016.stdout:1/826: symlink d2/d3/d1f/l123 0 2024-08-01T06:56:31.840 INFO:tasks.workunit.client.0.smithi016.stdout:1/827: mkdir d2/d3/d41/d49/d51/dc5/d124 0 2024-08-01T06:56:31.842 INFO:tasks.workunit.client.0.smithi016.stdout:1/828: fdatasync d2/d3/d1a/d22/f76 0 2024-08-01T06:56:31.844 INFO:tasks.workunit.client.0.smithi016.stdout:1/829: mknod d2/d3/d41/d49/d51/dc5/c125 0 2024-08-01T06:56:31.845 INFO:tasks.workunit.client.0.smithi016.stdout:1/830: readlink d2/d3/d41/le2 0 2024-08-01T06:56:31.852 INFO:tasks.workunit.client.0.smithi016.stdout:1/831: dwrite d2/d3/d41/d49/d85/f11a [0,4194304] 0 2024-08-01T06:56:31.857 INFO:tasks.workunit.client.0.smithi016.stdout:1/832: dread - d2/de/d21/d3e/df4/ffa zero size 2024-08-01T06:56:31.868 INFO:tasks.workunit.client.0.smithi016.stdout:1/833: dwrite d2/de/d32/fc8 [0,4194304] 0 2024-08-01T06:56:31.877 INFO:tasks.workunit.client.0.smithi016.stdout:1/834: dwrite d2/de/d21/d3e/df4/f113 [0,4194304] 0 2024-08-01T06:56:31.882 INFO:tasks.workunit.client.0.smithi016.stdout:1/835: truncate d2/de/d21/d3e/df4/f113 5058840 0 2024-08-01T06:56:31.883 INFO:tasks.workunit.client.0.smithi016.stdout:1/836: chown d2/d3/l13 788 1 2024-08-01T06:56:31.886 INFO:tasks.workunit.client.0.smithi016.stdout:1/837: getdents d2/de/d4d/d92/d10f 0 2024-08-01T06:56:31.889 INFO:tasks.workunit.client.0.smithi016.stdout:1/838: chown d2/de/d63/cad 654 1 2024-08-01T06:56:31.890 INFO:tasks.workunit.client.0.smithi016.stdout:1/839: write d2/d3/d41/fb4 [1956247,28242] 0 2024-08-01T06:56:31.899 INFO:tasks.workunit.client.0.smithi016.stdout:1/840: dwrite d2/d3/d1c/de1/d106/f111 [4194304,4194304] 0 2024-08-01T06:56:31.905 INFO:tasks.workunit.client.0.smithi016.stdout:1/841: creat d2/de/d21/d3e/df4/f126 x:0 0 0 2024-08-01T06:56:31.918 INFO:tasks.workunit.client.0.smithi016.stdout:1/842: dwrite d2/de/f5e [0,4194304] 0 2024-08-01T06:56:31.930 INFO:tasks.workunit.client.0.smithi016.stdout:1/843: link d2/de/cf d2/de/d4d/d92/c127 0 2024-08-01T06:56:32.039 INFO:tasks.workunit.client.0.smithi016.stdout:3/529: sync 2024-08-01T06:56:32.039 INFO:tasks.workunit.client.0.smithi016.stdout:3/530: chown d9/da/df/d53/f6c 13 1 2024-08-01T06:56:32.040 INFO:tasks.workunit.client.0.smithi016.stdout:3/531: read - d9/da/df/d12/d20/d5c/d76/fae zero size 2024-08-01T06:56:32.041 INFO:tasks.workunit.client.0.smithi016.stdout:3/532: write d9/fd [1980046,85773] 0 2024-08-01T06:56:32.047 INFO:tasks.workunit.client.0.smithi016.stdout:3/533: dread d9/da/df/d12/f42 [0,4194304] 0 2024-08-01T06:56:32.053 INFO:tasks.workunit.client.0.smithi016.stdout:3/534: write d9/d57/f74 [604653,89511] 0 2024-08-01T06:56:32.063 INFO:tasks.workunit.client.0.smithi016.stdout:3/535: dwrite d9/da/df/d12/f42 [0,4194304] 0 2024-08-01T06:56:32.067 INFO:tasks.workunit.client.0.smithi016.stdout:3/536: mkdir d9/da/df/d12/d75/db4 0 2024-08-01T06:56:32.071 INFO:tasks.workunit.client.0.smithi016.stdout:3/537: rename d9/da/df/d12/d20/d5c/d7a to d9/da/df/d2a/d49/db5 0 2024-08-01T06:56:32.073 INFO:tasks.workunit.client.0.smithi016.stdout:3/538: stat d9/da/df/d2a/f43 0 2024-08-01T06:56:32.074 INFO:tasks.workunit.client.0.smithi016.stdout:3/539: chown d9/da/df/d2a/d90 63 1 2024-08-01T06:56:32.074 INFO:tasks.workunit.client.0.smithi016.stdout:3/540: chown d9/f7c 3925 1 2024-08-01T06:56:32.077 INFO:tasks.workunit.client.0.smithi016.stdout:3/541: creat d9/da/fb6 x:0 0 0 2024-08-01T06:56:32.082 INFO:tasks.workunit.client.0.smithi016.stdout:3/542: write d9/f1f [2879500,66009] 0 2024-08-01T06:56:32.083 INFO:tasks.workunit.client.0.smithi016.stdout:3/543: fdatasync d9/da/df/d12/fb0 0 2024-08-01T06:56:32.310 INFO:tasks.workunit.client.0.smithi016.stdout:5/647: sync 2024-08-01T06:56:32.310 INFO:tasks.workunit.client.0.smithi016.stdout:2/830: sync 2024-08-01T06:56:32.311 INFO:tasks.workunit.client.0.smithi016.stdout:5/648: truncate d1/d12/d3e/fb6 345647 0 2024-08-01T06:56:32.312 INFO:tasks.workunit.client.0.smithi016.stdout:5/649: stat d1/d12/d7d/fd9 0 2024-08-01T06:56:32.316 INFO:tasks.workunit.client.0.smithi016.stdout:5/650: mknod d1/d12/d7d/cdf 0 2024-08-01T06:56:32.316 INFO:tasks.workunit.client.0.smithi016.stdout:5/651: stat d1/d2/d20/d38/dc7 0 2024-08-01T06:56:32.318 INFO:tasks.workunit.client.0.smithi016.stdout:2/831: write d0/d8/d1b/dcc/f46 [6094149,12110] 0 2024-08-01T06:56:32.320 INFO:tasks.workunit.client.0.smithi016.stdout:5/652: creat d1/d2/d6/d9/d19/dd3/fe0 x:0 0 0 2024-08-01T06:56:32.322 INFO:tasks.workunit.client.0.smithi016.stdout:2/832: rename d0/d8/d1b/dcc/d68/fe2 to d0/dc3/f117 0 2024-08-01T06:56:32.350 INFO:tasks.workunit.client.0.smithi016.stdout:5/653: rename d1/d2/d6/d9/d49/d57/f75 to d1/d2/d6/fe1 0 2024-08-01T06:56:32.351 INFO:tasks.workunit.client.0.smithi016.stdout:5/654: readlink d1/d12/d7d/ld6 0 2024-08-01T06:56:32.364 INFO:tasks.workunit.client.0.smithi016.stdout:2/833: write d0/d8/d6b/fe8 [783239,33260] 0 2024-08-01T06:56:32.370 INFO:tasks.workunit.client.0.smithi016.stdout:5/655: dwrite d1/d12/d52/f96 [0,4194304] 0 2024-08-01T06:56:32.373 INFO:tasks.workunit.client.0.smithi016.stdout:5/656: unlink d1/d12/fad 0 2024-08-01T06:56:32.374 INFO:tasks.workunit.client.0.smithi016.stdout:5/657: fsync d1/d2/d23/f26 0 2024-08-01T06:56:32.380 INFO:tasks.workunit.client.0.smithi016.stdout:5/658: getdents d1/d2 0 2024-08-01T06:56:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:31 smithi089 ceph-mon[36617]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:56:32.387 INFO:tasks.workunit.client.0.smithi016.stdout:5/659: dwrite d1/f3c [0,4194304] 0 2024-08-01T06:56:32.390 INFO:tasks.workunit.client.0.smithi016.stdout:5/660: chown d1/d2/d6/d9/d49/d57/f89 19 1 2024-08-01T06:56:32.391 INFO:tasks.workunit.client.0.smithi016.stdout:5/661: fdatasync d1/d2/d6/d9/d49/fdc 0 2024-08-01T06:56:32.392 INFO:tasks.workunit.client.0.smithi016.stdout:5/662: fdatasync d1/d2/f6e 0 2024-08-01T06:56:32.396 INFO:tasks.workunit.client.0.smithi016.stdout:5/663: mkdir d1/d2/d20/d68/de2 0 2024-08-01T06:56:32.396 INFO:tasks.workunit.client.0.smithi016.stdout:5/664: fsync d1/f83 0 2024-08-01T06:56:32.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:31 smithi016 ceph-mon[29266]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:56:32.404 INFO:tasks.workunit.client.0.smithi016.stdout:5/665: dwrite d1/f5 [0,4194304] 0 2024-08-01T06:56:32.408 INFO:tasks.workunit.client.0.smithi016.stdout:5/666: fdatasync d1/d12/d3e/fa9 0 2024-08-01T06:56:32.411 INFO:tasks.workunit.client.0.smithi016.stdout:5/667: symlink d1/d2/d6/d5a/d65/le3 0 2024-08-01T06:56:32.413 INFO:tasks.workunit.client.0.smithi016.stdout:5/668: write d1/d12/d7d/fd9 [415725,127470] 0 2024-08-01T06:56:32.414 INFO:tasks.workunit.client.0.smithi016.stdout:5/669: dread - d1/d2/d6/d9/d49/d57/db1/fcc zero size 2024-08-01T06:56:32.421 INFO:tasks.workunit.client.0.smithi016.stdout:5/670: dwrite d1/f3c [0,4194304] 0 2024-08-01T06:56:32.422 INFO:tasks.workunit.client.0.smithi016.stdout:5/671: chown d1/d12/d7d/ld6 31 1 2024-08-01T06:56:32.429 INFO:tasks.workunit.client.0.smithi016.stdout:5/672: dread d1/d2/d23/d3a/f58 [0,4194304] 0 2024-08-01T06:56:32.432 INFO:tasks.workunit.client.0.smithi016.stdout:5/673: symlink d1/d2/d6/d9/d19/d7a/dc5/dd0/le4 0 2024-08-01T06:56:32.434 INFO:tasks.workunit.client.0.smithi016.stdout:5/674: dread - d1/d2/d6/d9/d1b/fac zero size 2024-08-01T06:56:32.438 INFO:tasks.workunit.client.0.smithi016.stdout:5/675: creat d1/d2/d6/d9/d19/d7a/dc5/dd0/fe5 x:0 0 0 2024-08-01T06:56:32.441 INFO:tasks.workunit.client.0.smithi016.stdout:5/676: mkdir d1/d12/d7d/db3/de6 0 2024-08-01T06:56:32.443 INFO:tasks.workunit.client.0.smithi016.stdout:5/677: creat d1/d2/d6/d9/d19/dd3/fe7 x:0 0 0 2024-08-01T06:56:32.447 INFO:tasks.workunit.client.0.smithi016.stdout:5/678: dread d1/d2/d23/f81 [0,4194304] 0 2024-08-01T06:56:32.455 INFO:tasks.workunit.client.0.smithi016.stdout:5/679: getdents d1/d2/d23/dbb 0 2024-08-01T06:56:32.460 INFO:tasks.workunit.client.0.smithi016.stdout:5/680: rename d1/d2/l47 to d1/d2/d6/d9/d19/d7a/dc5/le8 0 2024-08-01T06:56:32.464 INFO:tasks.workunit.client.0.smithi016.stdout:5/681: creat d1/fe9 x:0 0 0 2024-08-01T06:56:32.466 INFO:tasks.workunit.client.0.smithi016.stdout:5/682: write d1/d2/d6/d9/f6a [4005164,127864] 0 2024-08-01T06:56:32.469 INFO:tasks.workunit.client.0.smithi016.stdout:5/683: creat d1/d2/d6/d9/d1b/dda/fea x:0 0 0 2024-08-01T06:56:32.476 INFO:tasks.workunit.client.0.smithi016.stdout:5/684: dwrite d1/d2/d6/fd2 [0,4194304] 0 2024-08-01T06:56:32.490 INFO:tasks.workunit.client.0.smithi016.stdout:5/685: dread d1/d2/d23/f26 [0,4194304] 0 2024-08-01T06:56:32.492 INFO:tasks.workunit.client.0.smithi016.stdout:5/686: truncate d1/d2/d6/d9/d1b/f59 841334 0 2024-08-01T06:56:32.494 INFO:tasks.workunit.client.0.smithi016.stdout:5/687: creat d1/d2/d23/feb x:0 0 0 2024-08-01T06:56:32.496 INFO:tasks.workunit.client.0.smithi016.stdout:5/688: write d1/d12/d3e/f92 [8962253,18503] 0 2024-08-01T06:56:32.499 INFO:tasks.workunit.client.0.smithi016.stdout:5/689: rmdir d1/d2/d6/d9/d49 39 2024-08-01T06:56:32.501 INFO:tasks.workunit.client.0.smithi016.stdout:5/690: mknod d1/d2/d20/db8/cec 0 2024-08-01T06:56:32.533 INFO:tasks.workunit.client.0.smithi016.stdout:9/755: sync 2024-08-01T06:56:32.534 INFO:tasks.workunit.client.0.smithi016.stdout:5/691: getdents d1/d2/d20/db8 0 2024-08-01T06:56:32.537 INFO:tasks.workunit.client.0.smithi016.stdout:5/692: read d1/d12/d3e/f92 [3708489,96991] 0 2024-08-01T06:56:32.540 INFO:tasks.workunit.client.0.smithi016.stdout:5/693: unlink d1/d2/d6/d5a/da1/fa7 0 2024-08-01T06:56:32.544 INFO:tasks.workunit.client.0.smithi016.stdout:9/756: dread d3/d9/df/fcb [0,4194304] 0 2024-08-01T06:56:32.547 INFO:tasks.workunit.client.0.smithi016.stdout:9/757: symlink d3/d32/d5c/dd9/lf7 0 2024-08-01T06:56:32.555 INFO:tasks.workunit.client.0.smithi016.stdout:5/694: dwrite d1/d2/d23/d3a/f58 [0,4194304] 0 2024-08-01T06:56:32.557 INFO:tasks.workunit.client.0.smithi016.stdout:5/695: fsync d1/d2/d6/d9/d1b/dda/fea 0 2024-08-01T06:56:32.562 INFO:tasks.workunit.client.0.smithi016.stdout:5/696: creat d1/d12/d8c/fed x:0 0 0 2024-08-01T06:56:32.568 INFO:tasks.workunit.client.0.smithi016.stdout:5/697: write d1/d2/f48 [406193,122118] 0 2024-08-01T06:56:32.572 INFO:tasks.workunit.client.0.smithi016.stdout:5/698: rmdir d1/d2/d20/d38/dc7 0 2024-08-01T06:56:32.576 INFO:tasks.workunit.client.0.smithi016.stdout:5/699: creat d1/d2/d6/fee x:0 0 0 2024-08-01T06:56:32.578 INFO:tasks.workunit.client.0.smithi016.stdout:5/700: mknod d1/d2/d6/d9/d49/d57/db1/cef 0 2024-08-01T06:56:32.584 INFO:tasks.workunit.client.0.smithi016.stdout:5/701: dwrite d1/d12/d52/f96 [0,4194304] 0 2024-08-01T06:56:32.596 INFO:tasks.workunit.client.0.smithi016.stdout:5/702: dread d1/d2/d6/f6b [0,4194304] 0 2024-08-01T06:56:32.601 INFO:tasks.workunit.client.0.smithi016.stdout:5/703: unlink d1/d2/d6/d9/d1b/dda/fea 0 2024-08-01T06:56:32.604 INFO:tasks.workunit.client.0.smithi016.stdout:5/704: mkdir d1/d2/d6/d9/d1b/dda/df0 0 2024-08-01T06:56:32.622 INFO:tasks.workunit.client.0.smithi016.stdout:5/705: dwrite d1/d2/d6/d9/d1b/f59 [0,4194304] 0 2024-08-01T06:56:32.624 INFO:tasks.workunit.client.0.smithi016.stdout:5/706: read d1/d2/d6/d9/f6a [929725,94255] 0 2024-08-01T06:56:32.625 INFO:tasks.workunit.client.0.smithi016.stdout:5/707: chown d1/d12/d7d/ld6 1300709 1 2024-08-01T06:56:32.629 INFO:tasks.workunit.client.0.smithi016.stdout:5/708: rename d1/d12/f91 to d1/d2/d20/ff1 0 2024-08-01T06:56:32.630 INFO:tasks.workunit.client.0.smithi016.stdout:5/709: write d1/fe9 [884018,55156] 0 2024-08-01T06:56:32.634 INFO:tasks.workunit.client.0.smithi016.stdout:5/710: rmdir d1/d2/d6/d9/d19/d7a/dc5/dd0 39 2024-08-01T06:56:32.636 INFO:tasks.workunit.client.0.smithi016.stdout:5/711: getdents d1/d2/d6/d9/dd8 0 2024-08-01T06:56:32.638 INFO:tasks.workunit.client.0.smithi016.stdout:5/712: write d1/d2/f31 [5063945,103446] 0 2024-08-01T06:56:32.640 INFO:tasks.workunit.client.0.smithi016.stdout:5/713: write d1/d2/d6/d9/d49/fdc [402186,129974] 0 2024-08-01T06:56:32.648 INFO:tasks.workunit.client.0.smithi016.stdout:5/714: dwrite d1/d2/d20/d68/fc2 [0,4194304] 0 2024-08-01T06:56:32.651 INFO:tasks.workunit.client.0.smithi016.stdout:5/715: creat d1/d12/d52/ff2 x:0 0 0 2024-08-01T06:56:32.654 INFO:tasks.workunit.client.0.smithi016.stdout:5/716: creat d1/d2/d20/db8/ff3 x:0 0 0 2024-08-01T06:56:32.656 INFO:tasks.workunit.client.0.smithi016.stdout:5/717: rename d1/d12/d7d/fd9 to d1/d2/d23/d3a/ff4 0 2024-08-01T06:56:32.663 INFO:tasks.workunit.client.0.smithi016.stdout:5/718: dwrite d1/d2/d6/d9/d49/fdc [0,4194304] 0 2024-08-01T06:56:32.669 INFO:tasks.workunit.client.0.smithi016.stdout:5/719: rename d1/d2/d23/f88 to d1/d2/d6/d9/d1b/dda/ff5 0 2024-08-01T06:56:32.674 INFO:tasks.workunit.client.0.smithi016.stdout:5/720: mkdir d1/df6 0 2024-08-01T06:56:32.674 INFO:tasks.workunit.client.0.smithi016.stdout:5/721: chown d1/d2/d20/d72 828258184 1 2024-08-01T06:56:32.675 INFO:tasks.workunit.client.0.smithi016.stdout:5/722: chown d1/d2/d20 1813 1 2024-08-01T06:56:32.675 INFO:tasks.workunit.client.0.smithi016.stdout:4/683: sync 2024-08-01T06:56:32.675 INFO:tasks.workunit.client.0.smithi016.stdout:6/733: sync 2024-08-01T06:56:32.676 INFO:tasks.workunit.client.0.smithi016.stdout:5/723: dread - d1/d2/d6/d5a/fc8 zero size 2024-08-01T06:56:32.678 INFO:tasks.workunit.client.0.smithi016.stdout:5/724: creat d1/d2/d23/ff7 x:0 0 0 2024-08-01T06:56:32.680 INFO:tasks.workunit.client.0.smithi016.stdout:4/684: creat d0/d2/da0/dd2/dea/fed x:0 0 0 2024-08-01T06:56:32.681 INFO:tasks.workunit.client.0.smithi016.stdout:6/734: dwrite d1/d8/d1b/db5/d67/fb3 [0,4194304] 0 2024-08-01T06:56:32.683 INFO:tasks.workunit.client.0.smithi016.stdout:5/725: chown d1/d2/d20/d72/f94 53772 1 2024-08-01T06:56:32.684 INFO:tasks.workunit.client.0.smithi016.stdout:5/726: fsync d1/d2/d23/d3a/ff4 0 2024-08-01T06:56:32.694 INFO:tasks.workunit.client.0.smithi016.stdout:5/727: creat d1/d2/d6/d9/ff8 x:0 0 0 2024-08-01T06:56:32.698 INFO:tasks.workunit.client.0.smithi016.stdout:5/728: mknod d1/d2/d6/d9/d19/d7a/da8/cf9 0 2024-08-01T06:56:32.699 INFO:tasks.workunit.client.0.smithi016.stdout:4/685: dwrite d0/d2/f33 [4194304,4194304] 0 2024-08-01T06:56:32.706 INFO:tasks.workunit.client.0.smithi016.stdout:6/735: dread d1/d8/d1b/db5/d67/d8f/dba/dbd/f84 [0,4194304] 0 2024-08-01T06:56:32.772 INFO:tasks.workunit.client.0.smithi016.stdout:4/686: write d0/d2/dc/d12/dd3/d38/f43 [252795,45175] 0 2024-08-01T06:56:32.774 INFO:tasks.workunit.client.0.smithi016.stdout:5/729: dwrite d1/d2/d6/d9/d19/d7a/dc5/dd0/fe5 [0,4194304] 0 2024-08-01T06:56:32.780 INFO:tasks.workunit.client.0.smithi016.stdout:5/730: creat d1/d2/d6/d9/d19/d7a/dc5/dd0/ffa x:0 0 0 2024-08-01T06:56:32.782 INFO:tasks.workunit.client.0.smithi016.stdout:6/736: link d1/d41/f6c d1/d8/d1b/db5/d67/d8f/dba/f109 0 2024-08-01T06:56:32.787 INFO:tasks.workunit.client.0.smithi016.stdout:5/731: dwrite d1/d2/d6/fd [0,4194304] 0 2024-08-01T06:56:32.794 INFO:tasks.workunit.client.0.smithi016.stdout:4/687: dread d0/d2/dc/d12/dd3/d22/fb0 [0,4194304] 0 2024-08-01T06:56:32.795 INFO:tasks.workunit.client.0.smithi016.stdout:4/688: dread - d0/d2/da0/dd2/dea/fed zero size 2024-08-01T06:56:32.806 INFO:tasks.workunit.client.0.smithi016.stdout:6/737: dwrite d1/d8/d1b/d22/d36/d7a/fce [0,4194304] 0 2024-08-01T06:56:32.811 INFO:tasks.workunit.client.0.smithi016.stdout:5/732: dread d1/d2/f43 [0,4194304] 0 2024-08-01T06:56:32.814 INFO:tasks.workunit.client.0.smithi016.stdout:4/689: dwrite d0/d2/dc/d12/dd3/d22/d26/d85/dc1/f9b [0,4194304] 0 2024-08-01T06:56:32.817 INFO:tasks.workunit.client.0.smithi016.stdout:4/690: read d0/d2/dc/d12/dd3/f39 [3918809,96980] 0 2024-08-01T06:56:32.823 INFO:tasks.workunit.client.0.smithi016.stdout:6/738: write d1/d8/d1b/d22/d36/d7a/dd3/fae [956601,3080] 0 2024-08-01T06:56:32.825 INFO:tasks.workunit.client.0.smithi016.stdout:5/733: rename d1/d2/f43 to d1/d2/d6/d9/d19/d7a/dc5/dd0/ffb 0 2024-08-01T06:56:32.827 INFO:tasks.workunit.client.0.smithi016.stdout:4/691: dwrite d0/d2/da0/dd2/dea/fed [0,4194304] 0 2024-08-01T06:56:32.828 INFO:tasks.workunit.client.0.smithi016.stdout:6/739: creat d1/d8/d1b/db5/f10a x:0 0 0 2024-08-01T06:56:32.831 INFO:tasks.workunit.client.0.smithi016.stdout:5/734: rename d1/d2/d6/d5a/da1 to d1/d2/d6/d5a/dfc 0 2024-08-01T06:56:32.832 INFO:tasks.workunit.client.0.smithi016.stdout:6/740: read d1/d41/f3e [22189,124409] 0 2024-08-01T06:56:32.834 INFO:tasks.workunit.client.0.smithi016.stdout:5/735: symlink d1/d12/d7d/db3/lfd 0 2024-08-01T06:56:32.836 INFO:tasks.workunit.client.0.smithi016.stdout:6/741: mknod d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/c10b 0 2024-08-01T06:56:32.839 INFO:tasks.workunit.client.0.smithi016.stdout:5/736: mknod d1/d2/d20/d72/cfe 0 2024-08-01T06:56:32.843 INFO:tasks.workunit.client.0.smithi016.stdout:6/742: dwrite d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/ff4 [0,4194304] 0 2024-08-01T06:56:32.843 INFO:tasks.workunit.client.0.smithi016.stdout:4/692: link d0/d2/dc/d12/dd3/d22/d26/d85/l8e d0/d2/dc/lee 0 2024-08-01T06:56:32.847 INFO:tasks.workunit.client.0.smithi016.stdout:5/737: truncate d1/d2/d6/d9/d1b/fac 766176 0 2024-08-01T06:56:32.847 INFO:tasks.workunit.client.0.smithi016.stdout:6/743: creat d1/d41/dbf/f10c x:0 0 0 2024-08-01T06:56:32.849 INFO:tasks.workunit.client.0.smithi016.stdout:6/744: truncate d1/d8/d94/f105 795554 0 2024-08-01T06:56:32.850 INFO:tasks.workunit.client.0.smithi016.stdout:4/693: mknod d0/d2/dc/d12/dd3/d38/cef 0 2024-08-01T06:56:32.861 INFO:tasks.workunit.client.0.smithi016.stdout:8/545: sync 2024-08-01T06:56:32.865 INFO:tasks.workunit.client.0.smithi016.stdout:8/546: creat d5/d8/d1a/d24/d48/d85/fb5 x:0 0 0 2024-08-01T06:56:32.866 INFO:tasks.workunit.client.0.smithi016.stdout:8/547: read d5/d1c/fab [139975,96401] 0 2024-08-01T06:56:32.869 INFO:tasks.workunit.client.0.smithi016.stdout:8/548: dread d5/d1c/f89 [0,4194304] 0 2024-08-01T06:56:32.968 INFO:tasks.workunit.client.0.smithi016.stdout:6/745: dwrite d1/d8/d1b/d22/d36/f6f [0,4194304] 0 2024-08-01T06:56:32.969 INFO:tasks.workunit.client.0.smithi016.stdout:8/549: mkdir d5/d8/d1a/da9/db6 0 2024-08-01T06:56:32.970 INFO:tasks.workunit.client.0.smithi016.stdout:5/738: dwrite d1/d2/d6/d9/d19/d7a/dc5/dd0/ffb [0,4194304] 0 2024-08-01T06:56:32.971 INFO:tasks.workunit.client.0.smithi016.stdout:8/550: readlink d5/d8/d1a/l30 0 2024-08-01T06:56:32.971 INFO:tasks.workunit.client.0.smithi016.stdout:4/694: dread d0/d2/dc/d12/dd3/d22/d26/da3/f77 [0,4194304] 0 2024-08-01T06:56:32.976 INFO:tasks.workunit.client.0.smithi016.stdout:4/695: chown d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/c66 779276174 1 2024-08-01T06:56:32.976 INFO:tasks.workunit.client.0.smithi016.stdout:5/739: creat d1/d12/d8c/fff x:0 0 0 2024-08-01T06:56:32.980 INFO:tasks.workunit.client.0.smithi016.stdout:8/551: rename d5/d1c/f33 to d5/d8/d1a/da9/db6/fb7 0 2024-08-01T06:56:32.982 INFO:tasks.workunit.client.0.smithi016.stdout:6/746: dread d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f3c [0,4194304] 0 2024-08-01T06:56:32.983 INFO:tasks.workunit.client.0.smithi016.stdout:6/747: readlink d1/d8/l6b 0 2024-08-01T06:56:32.984 INFO:tasks.workunit.client.0.smithi016.stdout:4/696: rename d0/d2/da0/dd2/dea/fed to d0/d2/dc/d12/dd3/d22/d7f/ff0 0 2024-08-01T06:56:32.986 INFO:tasks.workunit.client.0.smithi016.stdout:5/740: dwrite d1/d2/f80 [0,4194304] 0 2024-08-01T06:56:32.988 INFO:tasks.workunit.client.0.smithi016.stdout:8/552: symlink d5/d8/d1a/d24/d6a/lb8 0 2024-08-01T06:56:32.988 INFO:tasks.workunit.client.0.smithi016.stdout:5/741: fdatasync d1/d2/d6/d9/d19/d7a/dc5/dd0/ffa 0 2024-08-01T06:56:32.990 INFO:tasks.workunit.client.0.smithi016.stdout:8/553: write d5/d8/d1a/d24/d8c/fb2 [892694,25732] 0 2024-08-01T06:56:32.991 INFO:tasks.workunit.client.0.smithi016.stdout:6/748: rmdir d1/d8/d1b/d22/d2d 39 2024-08-01T06:56:32.994 INFO:tasks.workunit.client.0.smithi016.stdout:5/742: mknod d1/d2/d23/d3a/c100 0 2024-08-01T06:56:32.995 INFO:tasks.workunit.client.0.smithi016.stdout:8/554: unlink d5/d8/d1a/d59/l7b 0 2024-08-01T06:56:32.999 INFO:tasks.workunit.client.0.smithi016.stdout:6/749: creat d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/f10d x:0 0 0 2024-08-01T06:56:33.001 INFO:tasks.workunit.client.0.smithi016.stdout:6/750: write d1/d8/d1b/d22/d36/d7a/dd3/fae [1586542,118232] 0 2024-08-01T06:56:33.001 INFO:tasks.workunit.client.0.smithi016.stdout:8/555: fdatasync d5/d8/d75/f8a 0 2024-08-01T06:56:33.003 INFO:tasks.workunit.client.0.smithi016.stdout:4/697: dread d0/d2/d68/f6f [0,4194304] 0 2024-08-01T06:56:33.005 INFO:tasks.workunit.client.0.smithi016.stdout:5/743: truncate d1/d12/d3e/fbe 1447634 0 2024-08-01T06:56:33.007 INFO:tasks.workunit.client.0.smithi016.stdout:8/556: creat d5/d8/d75/fb9 x:0 0 0 2024-08-01T06:56:33.008 INFO:tasks.workunit.client.0.smithi016.stdout:4/698: mknod d0/d2/dc/d12/dd3/d38/cf1 0 2024-08-01T06:56:33.010 INFO:tasks.workunit.client.0.smithi016.stdout:5/744: dread d1/d2/d6/f6b [0,4194304] 0 2024-08-01T06:56:33.012 INFO:tasks.workunit.client.0.smithi016.stdout:8/557: mkdir d5/d8/d75/dba 0 2024-08-01T06:56:33.016 INFO:tasks.workunit.client.0.smithi016.stdout:8/558: creat d5/dc/fbb x:0 0 0 2024-08-01T06:56:33.019 INFO:tasks.workunit.client.0.smithi016.stdout:5/745: mknod d1/df6/c101 0 2024-08-01T06:56:33.020 INFO:tasks.workunit.client.0.smithi016.stdout:8/559: fdatasync d5/d8/d1a/d24/f19 0 2024-08-01T06:56:33.023 INFO:tasks.workunit.client.0.smithi016.stdout:5/746: creat d1/d12/d7d/f102 x:0 0 0 2024-08-01T06:56:33.028 INFO:tasks.workunit.client.0.smithi016.stdout:4/699: write d0/d2/dc/d12/dd3/d22/f31 [74501,49078] 0 2024-08-01T06:56:33.031 INFO:tasks.workunit.client.0.smithi016.stdout:5/747: chown d1/d2/l35 862589172 1 2024-08-01T06:56:33.031 INFO:tasks.workunit.client.0.smithi016.stdout:8/560: fdatasync d5/d8/d1a/d24/d48/d6e/d92/d99/fae 0 2024-08-01T06:56:33.033 INFO:tasks.workunit.client.0.smithi016.stdout:6/751: dwrite d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f3c [0,4194304] 0 2024-08-01T06:56:33.039 INFO:tasks.workunit.client.0.smithi016.stdout:8/561: chown d5/d8/d1a/d24/d48/d6e/d92/d99/f9d 0 1 2024-08-01T06:56:33.039 INFO:tasks.workunit.client.0.smithi016.stdout:6/752: truncate d1/d41/f3e 1124708 0 2024-08-01T06:56:33.039 INFO:tasks.workunit.client.0.smithi016.stdout:8/562: creat d5/dc/fbc x:0 0 0 2024-08-01T06:56:33.043 INFO:tasks.workunit.client.0.smithi016.stdout:0/614: sync 2024-08-01T06:56:33.043 INFO:tasks.workunit.client.0.smithi016.stdout:7/653: sync 2024-08-01T06:56:33.045 INFO:tasks.workunit.client.0.smithi016.stdout:6/753: fdatasync d1/d8/fa 0 2024-08-01T06:56:33.051 INFO:tasks.workunit.client.0.smithi016.stdout:8/563: dwrite d5/dc/f31 [4194304,4194304] 0 2024-08-01T06:56:33.052 INFO:tasks.workunit.client.0.smithi016.stdout:0/615: dread d10/d11/d37/f9f [0,4194304] 0 2024-08-01T06:56:33.053 INFO:tasks.workunit.client.0.smithi016.stdout:0/616: stat d10/d11 0 2024-08-01T06:56:33.053 INFO:tasks.workunit.client.0.smithi016.stdout:4/700: dread d0/d2/dc/d12/dd3/d22/d26/d8b/faf [0,4194304] 0 2024-08-01T06:56:33.057 INFO:tasks.workunit.client.0.smithi016.stdout:7/654: rename d7/db/d17/d72/c8a to d7/db/d17/d72/d1c/d1d/d40/d67/cf0 0 2024-08-01T06:56:33.061 INFO:tasks.workunit.client.0.smithi016.stdout:7/655: write d7/db/d17/d72/d1c/d79/fb0 [7377000,5018] 0 2024-08-01T06:56:33.062 INFO:tasks.workunit.client.0.smithi016.stdout:4/701: rmdir d0/d2/dc/d12/dd3 39 2024-08-01T06:56:33.064 INFO:tasks.workunit.client.0.smithi016.stdout:8/564: dwrite d5/d8/d1a/d59/f5a [4194304,4194304] 0 2024-08-01T06:56:33.065 INFO:tasks.workunit.client.0.smithi016.stdout:4/702: dread - d0/d2/d36/dbd/fce zero size 2024-08-01T06:56:33.065 INFO:tasks.workunit.client.0.smithi016.stdout:8/565: chown d5/dc/c41 293 1 2024-08-01T06:56:33.065 INFO:tasks.workunit.client.0.smithi016.stdout:0/617: unlink d10/d11/db4/fbf 0 2024-08-01T06:56:33.068 INFO:tasks.workunit.client.0.smithi016.stdout:0/618: chown d10/d11/d37/d58/l67 6774 1 2024-08-01T06:56:33.071 INFO:tasks.workunit.client.0.smithi016.stdout:7/656: mkdir d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/df1 0 2024-08-01T06:56:33.076 INFO:tasks.workunit.client.0.smithi016.stdout:4/703: chown d0/d2/dc/d12/dd3/d22/fc8 6553747 1 2024-08-01T06:56:33.076 INFO:tasks.workunit.client.0.smithi016.stdout:6/754: truncate d1/d8/f11 10024585 0 2024-08-01T06:56:33.079 INFO:tasks.workunit.client.0.smithi016.stdout:0/619: mknod d10/d5c/d91/cc4 0 2024-08-01T06:56:33.088 INFO:tasks.workunit.client.0.smithi016.stdout:6/755: creat d1/d43/d88/f10e x:0 0 0 2024-08-01T06:56:33.089 INFO:tasks.workunit.client.0.smithi016.stdout:7/657: write d7/db/d17/fc3 [299045,122323] 0 2024-08-01T06:56:33.093 INFO:tasks.workunit.client.0.smithi016.stdout:8/566: truncate d5/d8/f93 543807 0 2024-08-01T06:56:33.093 INFO:tasks.workunit.client.0.smithi016.stdout:8/567: chown d5/f12 13658761 1 2024-08-01T06:56:33.097 INFO:tasks.workunit.client.0.smithi016.stdout:6/756: symlink d1/d8/d1b/d22/d71/l10f 0 2024-08-01T06:56:33.100 INFO:tasks.workunit.client.0.smithi016.stdout:4/704: dwrite d0/d2/f37 [0,4194304] 0 2024-08-01T06:56:33.104 INFO:tasks.workunit.client.0.smithi016.stdout:8/568: mknod d5/d8/d1a/d24/d48/d6e/cbd 0 2024-08-01T06:56:33.107 INFO:tasks.workunit.client.0.smithi016.stdout:7/658: dread d7/db/fa6 [0,4194304] 0 2024-08-01T06:56:33.108 INFO:tasks.workunit.client.0.smithi016.stdout:4/705: creat d0/d2/d68/ff2 x:0 0 0 2024-08-01T06:56:33.109 INFO:tasks.workunit.client.0.smithi016.stdout:6/757: dwrite d1/d8/d1b/d22/d71/db1/f106 [0,4194304] 0 2024-08-01T06:56:33.114 INFO:tasks.workunit.client.0.smithi016.stdout:4/706: mkdir d0/d2/dc/d90/df3 0 2024-08-01T06:56:33.116 INFO:tasks.workunit.client.0.smithi016.stdout:0/620: truncate d10/d11/d37/d50/f99 9890 0 2024-08-01T06:56:33.121 INFO:tasks.workunit.client.0.smithi016.stdout:7/659: link d7/db3/fd0 d7/db/d17/d72/d1c/d79/d8f/dd3/ff2 0 2024-08-01T06:56:33.121 INFO:tasks.workunit.client.0.smithi016.stdout:6/758: symlink d1/d8/d1b/d22/d36/d7a/dd3/l110 0 2024-08-01T06:56:33.125 INFO:tasks.workunit.client.0.smithi016.stdout:7/660: dread - d7/db/d17/d72/d1c/d1d/f52 zero size 2024-08-01T06:56:33.126 INFO:tasks.workunit.client.0.smithi016.stdout:4/707: dwrite d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d91/fdd [4194304,4194304] 0 2024-08-01T06:56:33.130 INFO:tasks.workunit.client.0.smithi016.stdout:6/759: rename d1/d8/d1b/db5/d67/f108 to d1/d41/dbf/f111 0 2024-08-01T06:56:33.138 INFO:tasks.workunit.client.0.smithi016.stdout:8/569: dwrite d5/d8/f58 [0,4194304] 0 2024-08-01T06:56:33.139 INFO:tasks.workunit.client.0.smithi016.stdout:8/570: readlink d5/d1c/l42 0 2024-08-01T06:56:33.140 INFO:tasks.workunit.client.0.smithi016.stdout:7/661: rename d7/f11 to d7/db/d17/d72/d22/ff3 0 2024-08-01T06:56:33.143 INFO:tasks.workunit.client.0.smithi016.stdout:8/571: mkdir d5/d8/d1a/dbe 0 2024-08-01T06:56:33.144 INFO:tasks.workunit.client.0.smithi016.stdout:6/760: rename d1/d8/d1b/db5/d67/d8f/dba/dbd/cf9 to d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/c112 0 2024-08-01T06:56:33.148 INFO:tasks.workunit.client.0.smithi016.stdout:0/621: dwrite d10/d11/d41/f6f [0,4194304] 0 2024-08-01T06:56:33.149 INFO:tasks.workunit.client.0.smithi016.stdout:0/622: chown d10/d5c/d90/dbd 2442491 1 2024-08-01T06:56:33.150 INFO:tasks.workunit.client.0.smithi016.stdout:0/623: chown f9 44 1 2024-08-01T06:56:33.150 INFO:tasks.workunit.client.0.smithi016.stdout:0/624: readlink d10/d1c/l31 0 2024-08-01T06:56:33.152 INFO:tasks.workunit.client.0.smithi016.stdout:7/662: rename d7/db/d17/d72/d1c/f78 to d7/db3/ff4 0 2024-08-01T06:56:33.154 INFO:tasks.workunit.client.0.smithi016.stdout:7/663: chown d7/db/d17/d72/d22/f4a 38383113 1 2024-08-01T06:56:33.158 INFO:tasks.workunit.client.0.smithi016.stdout:0/625: mknod d10/d11/d37/d50/cc5 0 2024-08-01T06:56:33.166 INFO:tasks.workunit.client.0.smithi016.stdout:0/626: dread - d10/d11/d41/f6d zero size 2024-08-01T06:56:33.167 INFO:tasks.workunit.client.0.smithi016.stdout:0/627: write d10/d5c/d90/f9c [1498952,31214] 0 2024-08-01T06:56:33.168 INFO:tasks.workunit.client.0.smithi016.stdout:0/628: chown d10/d11/d37/d58 481 1 2024-08-01T06:56:33.170 INFO:tasks.workunit.client.0.smithi016.stdout:6/761: write d1/d8/d1b/d22/d2d/f9a [823205,123518] 0 2024-08-01T06:56:33.173 INFO:tasks.workunit.client.0.smithi016.stdout:0/629: mknod d10/d11/d37/d82/cc6 0 2024-08-01T06:56:33.176 INFO:tasks.workunit.client.0.smithi016.stdout:7/664: dwrite d7/db/d17/d72/d1e/d26/f49 [4194304,4194304] 0 2024-08-01T06:56:33.177 INFO:tasks.workunit.client.0.smithi016.stdout:8/572: link d5/d8/f68 d5/d8/d1a/d24/d6a/fbf 0 2024-08-01T06:56:33.180 INFO:tasks.workunit.client.0.smithi016.stdout:8/573: truncate d5/d8/d1a/d24/d8c/fa4 153421 0 2024-08-01T06:56:33.180 INFO:tasks.workunit.client.0.smithi016.stdout:0/630: mkdir d10/d5c/d91/dc7 0 2024-08-01T06:56:33.181 INFO:tasks.workunit.client.0.smithi016.stdout:0/631: read - d10/d11/d37/fa6 zero size 2024-08-01T06:56:33.184 INFO:tasks.workunit.client.0.smithi016.stdout:7/665: creat d7/db/d17/d4e/ff5 x:0 0 0 2024-08-01T06:56:33.184 INFO:tasks.workunit.client.0.smithi016.stdout:6/762: write d1/d8/d1b/d22/f29 [7570688,103316] 0 2024-08-01T06:56:33.188 INFO:tasks.workunit.client.0.smithi016.stdout:8/574: mkdir d5/d8/dc0 0 2024-08-01T06:56:33.190 INFO:tasks.workunit.client.0.smithi016.stdout:6/763: readlink d1/d8/d1b/l102 0 2024-08-01T06:56:33.191 INFO:tasks.workunit.client.0.smithi016.stdout:0/632: dwrite d10/d11/f64 [8388608,4194304] 0 2024-08-01T06:56:33.197 INFO:tasks.workunit.client.0.smithi016.stdout:6/764: creat d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/d91/dc0/f113 x:0 0 0 2024-08-01T06:56:33.199 INFO:tasks.workunit.client.0.smithi016.stdout:0/633: dwrite d10/d11/f15 [0,4194304] 0 2024-08-01T06:56:33.202 INFO:tasks.workunit.client.0.smithi016.stdout:7/666: truncate d7/db/d17/d72/d1c/d1d/f65 4419663 0 2024-08-01T06:56:33.203 INFO:tasks.workunit.client.0.smithi016.stdout:6/765: creat d1/d8/d1b/db5/d67/f114 x:0 0 0 2024-08-01T06:56:33.205 INFO:tasks.workunit.client.0.smithi016.stdout:0/634: symlink d10/d11/d37/d82/lc8 0 2024-08-01T06:56:33.206 INFO:tasks.workunit.client.0.smithi016.stdout:7/667: mkdir d7/db/d17/d72/d1c/d97/df6 0 2024-08-01T06:56:33.210 INFO:tasks.workunit.client.0.smithi016.stdout:0/635: truncate d10/d5c/f75 4008844 0 2024-08-01T06:56:33.215 INFO:tasks.workunit.client.0.smithi016.stdout:7/668: creat d7/db/d17/d72/d22/db4/ff7 x:0 0 0 2024-08-01T06:56:33.216 INFO:tasks.workunit.client.0.smithi016.stdout:8/575: write d5/d8/d1a/d59/f5c [866758,76210] 0 2024-08-01T06:56:33.217 INFO:tasks.workunit.client.0.smithi016.stdout:8/576: fsync d5/dc/fbb 0 2024-08-01T06:56:33.218 INFO:tasks.workunit.client.0.smithi016.stdout:8/577: readlink d5/d1c/l1f 0 2024-08-01T06:56:33.355 INFO:tasks.workunit.client.0.smithi016.stdout:1/844: sync 2024-08-01T06:56:33.361 INFO:tasks.workunit.client.0.smithi016.stdout:6/766: write d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d93/fb9 [46117,77354] 0 2024-08-01T06:56:33.364 INFO:tasks.workunit.client.0.smithi016.stdout:0/636: write d10/d11/d41/f2a [1307324,26852] 0 2024-08-01T06:56:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:32 smithi089 ceph-mon[36617]: pgmap v30: 65 pgs: 65 active+clean; 1.8 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 39 MiB/s rd, 94 MiB/s wr, 270 op/s 2024-08-01T06:56:33.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:32 smithi016 ceph-mon[29266]: pgmap v30: 65 pgs: 65 active+clean; 1.8 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 39 MiB/s rd, 94 MiB/s wr, 270 op/s 2024-08-01T06:56:33.399 INFO:tasks.workunit.client.0.smithi016.stdout:1/845: fsync d2/d3/d1c/fa6 0 2024-08-01T06:56:33.402 INFO:tasks.workunit.client.0.smithi016.stdout:0/637: chown cb 111 1 2024-08-01T06:56:33.404 INFO:tasks.workunit.client.0.smithi016.stdout:7/669: link d7/ff d7/db/d17/d72/d22/d77/d99/dd1/ddc/ff8 0 2024-08-01T06:56:33.405 INFO:tasks.workunit.client.0.smithi016.stdout:7/670: chown d7/db/d17/d4e/f6c 2472 1 2024-08-01T06:56:33.415 INFO:tasks.workunit.client.0.smithi016.stdout:0/638: dwrite d10/d11/d37/f9f [0,4194304] 0 2024-08-01T06:56:33.416 INFO:tasks.workunit.client.0.smithi016.stdout:7/671: unlink d7/db/d17/d72/d1e/d26/c47 0 2024-08-01T06:56:33.439 INFO:tasks.workunit.client.0.smithi016.stdout:0/639: truncate d10/d1c/d7c/f8f 1107701 0 2024-08-01T06:56:33.441 INFO:tasks.workunit.client.0.smithi016.stdout:6/767: dwrite d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/da2/ff5 [0,4194304] 0 2024-08-01T06:56:33.442 INFO:tasks.workunit.client.0.smithi016.stdout:1/846: dwrite d2/d3/d1a/d22/f9f [0,4194304] 0 2024-08-01T06:56:33.446 INFO:tasks.workunit.client.0.smithi016.stdout:0/640: mknod d10/d5c/d91/cc9 0 2024-08-01T06:56:33.448 INFO:tasks.workunit.client.0.smithi016.stdout:6/768: truncate d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d8e/dcf/fed 213303 0 2024-08-01T06:56:33.451 INFO:tasks.workunit.client.0.smithi016.stdout:1/847: truncate d2/de/d21/d3e/f8f 3674082 0 2024-08-01T06:56:33.453 INFO:tasks.workunit.client.0.smithi016.stdout:6/769: dread - d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/fcb zero size 2024-08-01T06:56:33.454 INFO:tasks.workunit.client.0.smithi016.stdout:6/770: chown d1/d8/d1b/db5/d67/c9c 2 1 2024-08-01T06:56:33.456 INFO:tasks.workunit.client.0.smithi016.stdout:0/641: creat d10/d5c/d90/da0/dbc/fca x:0 0 0 2024-08-01T06:56:33.459 INFO:tasks.workunit.client.0.smithi016.stdout:6/771: mkdir d1/d8/d1b/db5/d67/d8f/d115 0 2024-08-01T06:56:33.461 INFO:tasks.workunit.client.0.smithi016.stdout:1/848: dread d2/de/f38 [0,4194304] 0 2024-08-01T06:56:33.462 INFO:tasks.workunit.client.0.smithi016.stdout:6/772: rmdir d1 39 2024-08-01T06:56:33.462 INFO:tasks.workunit.client.0.smithi016.stdout:0/642: read d10/d11/d37/d58/f8c [38685,109714] 0 2024-08-01T06:56:33.462 INFO:tasks.workunit.client.0.smithi016.stdout:0/643: chown d10/d11/d41/d95/la3 24092 1 2024-08-01T06:56:33.465 INFO:tasks.workunit.client.0.smithi016.stdout:0/644: symlink d10/d5c/d91/lcb 0 2024-08-01T06:56:33.469 INFO:tasks.workunit.client.0.smithi016.stdout:1/849: dwrite d2/d88/f107 [0,4194304] 0 2024-08-01T06:56:33.478 INFO:tasks.workunit.client.0.smithi016.stdout:1/850: mknod d2/d3/d41/d49/c128 0 2024-08-01T06:56:33.482 INFO:tasks.workunit.client.0.smithi016.stdout:1/851: link d2/f17 d2/de/d63/dd6/dff/f129 0 2024-08-01T06:56:33.482 INFO:tasks.workunit.client.0.smithi016.stdout:6/773: write d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/f87 [926862,18289] 0 2024-08-01T06:56:33.489 INFO:tasks.workunit.client.0.smithi016.stdout:6/774: mknod d1/d8/d1b/db5/d67/d8f/dba/dbd/c116 0 2024-08-01T06:56:33.490 INFO:tasks.workunit.client.0.smithi016.stdout:0/645: dwrite d10/d11/d37/d58/f8c [0,4194304] 0 2024-08-01T06:56:33.492 INFO:tasks.workunit.client.0.smithi016.stdout:6/775: write d1/d8/d1b/f35 [792215,101473] 0 2024-08-01T06:56:33.495 INFO:tasks.workunit.client.0.smithi016.stdout:1/852: write d2/d3/d1a/f3c [392556,15883] 0 2024-08-01T06:56:33.502 INFO:tasks.workunit.client.0.smithi016.stdout:1/853: symlink d2/d3/d41/d49/d51/l12a 0 2024-08-01T06:56:33.502 INFO:tasks.workunit.client.0.smithi016.stdout:1/854: chown d2/de/d21/d3e/df4/f126 132955434 1 2024-08-01T06:56:33.504 INFO:tasks.workunit.client.0.smithi016.stdout:1/855: creat d2/d3/d1c/f12b x:0 0 0 2024-08-01T06:56:33.506 INFO:tasks.workunit.client.0.smithi016.stdout:1/856: symlink d2/d3/l12c 0 2024-08-01T06:56:33.508 INFO:tasks.workunit.client.0.smithi016.stdout:1/857: dread - d2/de/d32/d43/fb5 zero size 2024-08-01T06:56:33.508 INFO:tasks.workunit.client.0.smithi016.stdout:0/646: truncate d10/f33 3219261 0 2024-08-01T06:56:33.510 INFO:tasks.workunit.client.0.smithi016.stdout:1/858: rename d2 to d2/d3/d118/d12d 22 2024-08-01T06:56:33.512 INFO:tasks.workunit.client.0.smithi016.stdout:6/776: dwrite d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/d91/fd4 [0,4194304] 0 2024-08-01T06:56:33.513 INFO:tasks.workunit.client.0.smithi016.stdout:0/647: fdatasync d10/d11/d41/f94 0 2024-08-01T06:56:33.514 INFO:tasks.workunit.client.0.smithi016.stdout:0/648: write d10/d11/f3d [779605,64300] 0 2024-08-01T06:56:33.515 INFO:tasks.workunit.client.0.smithi016.stdout:1/859: mkdir d2/d3/d48/d12e 0 2024-08-01T06:56:33.522 INFO:tasks.workunit.client.0.smithi016.stdout:1/860: rmdir d2/d3/d41 39 2024-08-01T06:56:33.527 INFO:tasks.workunit.client.0.smithi016.stdout:6/777: mkdir d1/d8/d1b/db5/d67/d8f/d115/d117 0 2024-08-01T06:56:33.530 INFO:tasks.workunit.client.0.smithi016.stdout:6/778: truncate d1/d8/d1b/d22/d36/d7a/ff1 220469 0 2024-08-01T06:56:33.532 INFO:tasks.workunit.client.0.smithi016.stdout:1/861: dread d2/d3/d1a/f11c [0,4194304] 0 2024-08-01T06:56:33.532 INFO:tasks.workunit.client.0.smithi016.stdout:0/649: write d10/d11/d37/d58/f70 [680965,34048] 0 2024-08-01T06:56:33.533 INFO:tasks.workunit.client.0.smithi016.stdout:6/779: chown d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d93/daf/fb8 197474369 1 2024-08-01T06:56:33.534 INFO:tasks.workunit.client.0.smithi016.stdout:6/780: write d1/d41/dbf/f10c [559376,79652] 0 2024-08-01T06:56:33.535 INFO:tasks.workunit.client.0.smithi016.stdout:1/862: unlink d2/d3/d1c/le6 0 2024-08-01T06:56:33.540 INFO:tasks.workunit.client.0.smithi016.stdout:1/863: creat d2/de/d21/f12f x:0 0 0 2024-08-01T06:56:33.542 INFO:tasks.workunit.client.0.smithi016.stdout:6/781: rename d1/d8/d1b/d48/cad to d1/d8/d1b/df6/c118 0 2024-08-01T06:56:33.547 INFO:tasks.workunit.client.0.smithi016.stdout:0/650: write d10/d11/d37/d50/f99 [448988,55616] 0 2024-08-01T06:56:33.550 INFO:tasks.workunit.client.0.smithi016.stdout:1/864: write d2/d3/f4c [135189,43255] 0 2024-08-01T06:56:33.552 INFO:tasks.workunit.client.0.smithi016.stdout:6/782: rename d1/d8/d1b/c28 to d1/d8/d1b/d22/d36/c119 0 2024-08-01T06:56:33.554 INFO:tasks.workunit.client.0.smithi016.stdout:0/651: dwrite d10/d11/d37/d58/f70 [0,4194304] 0 2024-08-01T06:56:33.558 INFO:tasks.workunit.client.0.smithi016.stdout:1/865: truncate d2/de/d6e/f78 4909636 0 2024-08-01T06:56:33.562 INFO:tasks.workunit.client.0.smithi016.stdout:6/783: dwrite d1/d8/d1b/d22/d36/f6f [0,4194304] 0 2024-08-01T06:56:33.567 INFO:tasks.workunit.client.0.smithi016.stdout:0/652: dwrite d10/d11/d37/d50/fb9 [0,4194304] 0 2024-08-01T06:56:33.567 INFO:tasks.workunit.client.0.smithi016.stdout:1/866: rename d2/de/d32/c117 to d2/de/d21/d3e/c130 0 2024-08-01T06:56:33.571 INFO:tasks.workunit.client.0.smithi016.stdout:1/867: creat d2/de/d21/d3e/df4/dfb/f131 x:0 0 0 2024-08-01T06:56:33.571 INFO:tasks.workunit.client.0.smithi016.stdout:6/784: link d1/c6 d1/d43/d88/de5/c11a 0 2024-08-01T06:56:33.612 INFO:tasks.workunit.client.0.smithi016.stdout:3/544: sync 2024-08-01T06:56:33.613 INFO:tasks.workunit.client.0.smithi016.stdout:3/545: readlink d9/da/df/l88 0 2024-08-01T06:56:33.670 INFO:tasks.workunit.client.0.smithi016.stdout:3/546: mkdir d9/d98/db7 0 2024-08-01T06:56:33.673 INFO:tasks.workunit.client.0.smithi016.stdout:0/653: getdents d10 0 2024-08-01T06:56:33.675 INFO:tasks.workunit.client.0.smithi016.stdout:3/547: creat d9/da/df/d12/d20/fb8 x:0 0 0 2024-08-01T06:56:33.680 INFO:tasks.workunit.client.0.smithi016.stdout:0/654: dwrite d10/d11/d37/f7d [4194304,4194304] 0 2024-08-01T06:56:33.683 INFO:tasks.workunit.client.0.smithi016.stdout:1/868: link d2/de/f38 d2/de/f132 0 2024-08-01T06:56:33.684 INFO:tasks.workunit.client.0.smithi016.stdout:3/548: dwrite d9/da/df/d2a/f77 [0,4194304] 0 2024-08-01T06:56:33.687 INFO:tasks.workunit.client.0.smithi016.stdout:0/655: symlink d10/d5c/d90/da2/da5/lcc 0 2024-08-01T06:56:33.689 INFO:tasks.workunit.client.0.smithi016.stdout:0/656: read d10/d11/d41/f6f [2424102,65092] 0 2024-08-01T06:56:33.690 INFO:tasks.workunit.client.0.smithi016.stdout:6/785: dwrite d1/d8/f11 [0,4194304] 0 2024-08-01T06:56:33.693 INFO:tasks.workunit.client.0.smithi016.stdout:3/549: fdatasync d9/da/df/d12/d20/d3c/f4b 0 2024-08-01T06:56:33.695 INFO:tasks.workunit.client.0.smithi016.stdout:0/657: creat d10/d11/d37/d50/db1/fcd x:0 0 0 2024-08-01T06:56:33.697 INFO:tasks.workunit.client.0.smithi016.stdout:6/786: unlink d1/d8/d1b/d22/d71/db1/f106 0 2024-08-01T06:56:33.699 INFO:tasks.workunit.client.0.smithi016.stdout:6/787: stat d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d 0 2024-08-01T06:56:33.706 INFO:tasks.workunit.client.0.smithi016.stdout:2/834: sync 2024-08-01T06:56:33.706 INFO:tasks.workunit.client.0.smithi016.stdout:6/788: rmdir d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d8e 39 2024-08-01T06:56:33.707 INFO:tasks.workunit.client.0.smithi016.stdout:1/869: write d2/de/d21/d3e/dc3/ffe [280923,79630] 0 2024-08-01T06:56:33.708 INFO:tasks.workunit.client.0.smithi016.stdout:2/835: read d0/d8/d1b/d74/f81 [1780971,5225] 0 2024-08-01T06:56:33.711 INFO:tasks.workunit.client.0.smithi016.stdout:2/836: readlink d0/d8/le 0 2024-08-01T06:56:33.713 INFO:tasks.workunit.client.0.smithi016.stdout:1/870: rename d2/de/d32 to d2/d2f/d97/d133 0 2024-08-01T06:56:33.713 INFO:tasks.workunit.client.0.smithi016.stdout:6/789: truncate d1/d8/d1b/d22/d2d/faa 5209793 0 2024-08-01T06:56:33.714 INFO:tasks.workunit.client.0.smithi016.stdout:3/550: dread d9/da/df/d12/d20/d5c/f63 [0,4194304] 0 2024-08-01T06:56:33.718 INFO:tasks.workunit.client.0.smithi016.stdout:3/551: creat d9/d57/fb9 x:0 0 0 2024-08-01T06:56:33.720 INFO:tasks.workunit.client.0.smithi016.stdout:3/552: chown d9/da/df/f45 1 1 2024-08-01T06:56:33.721 INFO:tasks.workunit.client.0.smithi016.stdout:6/790: dwrite d1/d8/d1b/db5/f10a [0,4194304] 0 2024-08-01T06:56:33.721 INFO:tasks.workunit.client.0.smithi016.stdout:1/871: mknod d2/d3/c134 0 2024-08-01T06:56:33.724 INFO:tasks.workunit.client.0.smithi016.stdout:6/791: dread - d1/ff7 zero size 2024-08-01T06:56:33.729 INFO:tasks.workunit.client.0.smithi016.stdout:1/872: read d2/d3/d1c/de1/d106/f111 [3865300,118273] 0 2024-08-01T06:56:33.730 INFO:tasks.workunit.client.0.smithi016.stdout:0/658: dwrite d10/d1c/f4e [0,4194304] 0 2024-08-01T06:56:33.733 INFO:tasks.workunit.client.0.smithi016.stdout:2/837: getdents d0/d8/d31/d5e 0 2024-08-01T06:56:33.737 INFO:tasks.workunit.client.0.smithi016.stdout:1/873: unlink d2/d2f/l42 0 2024-08-01T06:56:33.740 INFO:tasks.workunit.client.0.smithi016.stdout:3/553: write d9/da/df/d2a/d49/d61/f93 [640122,94865] 0 2024-08-01T06:56:33.742 INFO:tasks.workunit.client.0.smithi016.stdout:3/554: readlink d9/d3e/d80/l8f 0 2024-08-01T06:56:33.742 INFO:tasks.workunit.client.0.smithi016.stdout:6/792: dread d1/d8/d1b/f25 [0,4194304] 0 2024-08-01T06:56:33.743 INFO:tasks.workunit.client.0.smithi016.stdout:2/838: mkdir d0/d8/d31/d111/d118 0 2024-08-01T06:56:33.745 INFO:tasks.workunit.client.0.smithi016.stdout:1/874: creat d2/d2f/d97/f135 x:0 0 0 2024-08-01T06:56:33.746 INFO:tasks.workunit.client.0.smithi016.stdout:0/659: mknod d10/d11/d41/cce 0 2024-08-01T06:56:33.750 INFO:tasks.workunit.client.0.smithi016.stdout:1/875: creat d2/de/d6e/f136 x:0 0 0 2024-08-01T06:56:33.751 INFO:tasks.workunit.client.0.smithi016.stdout:0/660: creat d10/d11/d37/d82/fcf x:0 0 0 2024-08-01T06:56:33.758 INFO:tasks.workunit.client.0.smithi016.stdout:1/876: rename d2/de/d21 to d2/de/d4d/d92/d10f/d137 0 2024-08-01T06:56:33.759 INFO:tasks.workunit.client.0.smithi016.stdout:0/661: truncate d10/d11/d37/d53/f93 514710 0 2024-08-01T06:56:33.760 INFO:tasks.workunit.client.0.smithi016.stdout:0/662: dread - d10/d11/d37/fbe zero size 2024-08-01T06:56:33.761 INFO:tasks.workunit.client.0.smithi016.stdout:1/877: mkdir d2/d2f/d97/d133/d138 0 2024-08-01T06:56:33.765 INFO:tasks.workunit.client.0.smithi016.stdout:1/878: truncate f0 1294685 0 2024-08-01T06:56:33.766 INFO:tasks.workunit.client.0.smithi016.stdout:2/839: dread d0/d8/d1b/dcc/f46 [4194304,4194304] 0 2024-08-01T06:56:33.772 INFO:tasks.workunit.client.0.smithi016.stdout:6/793: dwrite d1/d8/d1b/d22/d71/f7f [0,4194304] 0 2024-08-01T06:56:33.774 INFO:tasks.workunit.client.0.smithi016.stdout:0/663: dwrite d10/d11/f3d [0,4194304] 0 2024-08-01T06:56:33.774 INFO:tasks.workunit.client.0.smithi016.stdout:3/555: dwrite d9/da/df/d12/d20/d5c/f63 [0,4194304] 0 2024-08-01T06:56:33.784 INFO:tasks.workunit.client.0.smithi016.stdout:1/879: symlink d2/de/d4d/d92/d10f/d137/d3e/df4/dfb/l139 0 2024-08-01T06:56:33.786 INFO:tasks.workunit.client.0.smithi016.stdout:6/794: unlink d1/d8/lab 0 2024-08-01T06:56:33.787 INFO:tasks.workunit.client.0.smithi016.stdout:6/795: readlink d1/d8/d1b/l54 0 2024-08-01T06:56:33.790 INFO:tasks.workunit.client.0.smithi016.stdout:0/664: read d10/d11/d37/d58/f68 [1125815,48699] 0 2024-08-01T06:56:33.790 INFO:tasks.workunit.client.0.smithi016.stdout:2/840: rename d0/l47 to d0/d8/d1b/dfe/l119 0 2024-08-01T06:56:33.791 INFO:tasks.workunit.client.0.smithi016.stdout:1/880: mkdir d2/de/d4d/d92/d10f/d137/d13a 0 2024-08-01T06:56:33.791 INFO:tasks.workunit.client.0.smithi016.stdout:0/665: dread - d10/d11/d37/fbe zero size 2024-08-01T06:56:33.793 INFO:tasks.workunit.client.0.smithi016.stdout:6/796: rename d1/d8/d1b/d22/d71/db1/le2 to d1/d8/d1b/d22/d36/d7a/dd3/da3/l11b 0 2024-08-01T06:56:33.794 INFO:tasks.workunit.client.0.smithi016.stdout:2/841: creat d0/d8/d1b/d74/d99/f11a x:0 0 0 2024-08-01T06:56:33.795 INFO:tasks.workunit.client.0.smithi016.stdout:2/842: readlink d0/l12 0 2024-08-01T06:56:33.797 INFO:tasks.workunit.client.0.smithi016.stdout:6/797: mknod d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/c11c 0 2024-08-01T06:56:33.857 INFO:tasks.workunit.client.0.smithi016.stdout:5/748: sync 2024-08-01T06:56:33.857 INFO:tasks.workunit.client.0.smithi016.stdout:9/758: sync 2024-08-01T06:56:33.859 INFO:tasks.workunit.client.0.smithi016.stdout:1/881: link d2/de/d4d/d92/f11d d2/de/d4d/d92/d10f/d137/d3e/df4/dfb/f13b 0 2024-08-01T06:56:33.862 INFO:tasks.workunit.client.0.smithi016.stdout:2/843: write d0/d8/d31/da7/fd3 [332170,41263] 0 2024-08-01T06:56:33.862 INFO:tasks.workunit.client.0.smithi016.stdout:5/749: readlink d1/d2/d20/d72/l98 0 2024-08-01T06:56:33.863 INFO:tasks.workunit.client.0.smithi016.stdout:9/759: rmdir d3/d9/db 39 2024-08-01T06:56:33.865 INFO:tasks.workunit.client.0.smithi016.stdout:5/750: fsync d1/d2/d6/d5a/fc8 0 2024-08-01T06:56:33.867 INFO:tasks.workunit.client.0.smithi016.stdout:5/751: chown d1/d2/d23/dbb 0 1 2024-08-01T06:56:33.869 INFO:tasks.workunit.client.0.smithi016.stdout:2/844: rmdir d0/d8/d1b/dcc 39 2024-08-01T06:56:33.871 INFO:tasks.workunit.client.0.smithi016.stdout:9/760: rename d3/de/d6d/ca3 to d3/d32/d5c/d8a/d57/cf8 0 2024-08-01T06:56:33.873 INFO:tasks.workunit.client.0.smithi016.stdout:1/882: creat d2/de/d63/f13c x:0 0 0 2024-08-01T06:56:33.877 INFO:tasks.workunit.client.0.smithi016.stdout:2/845: rename d0/d8/d22/la8 to d0/d8/d31/dc7/l11b 0 2024-08-01T06:56:33.880 INFO:tasks.workunit.client.0.smithi016.stdout:9/761: mkdir d3/d9/d46/d48/d87/df9 0 2024-08-01T06:56:33.885 INFO:tasks.workunit.client.0.smithi016.stdout:9/762: chown d3/d9/db/dc/d33/f6c 4463 1 2024-08-01T06:56:33.887 INFO:tasks.workunit.client.0.smithi016.stdout:2/846: fsync d0/d8/d1b/dcc/f4f 0 2024-08-01T06:56:33.887 INFO:tasks.workunit.client.0.smithi016.stdout:9/763: chown d3/d9/df/d16/d94/lac 202703118 1 2024-08-01T06:56:33.891 INFO:tasks.workunit.client.0.smithi016.stdout:1/883: creat d2/d3/d41/d49/d51/dc5/d124/f13d x:0 0 0 2024-08-01T06:56:33.892 INFO:tasks.workunit.client.0.smithi016.stdout:5/752: dread d1/d2/d23/f32 [0,4194304] 0 2024-08-01T06:56:33.895 INFO:tasks.workunit.client.0.smithi016.stdout:2/847: creat d0/d8/d1b/d74/d90/d93/f11c x:0 0 0 2024-08-01T06:56:33.896 INFO:tasks.workunit.client.0.smithi016.stdout:9/764: stat d3/d9/df/d38/l88 0 2024-08-01T06:56:33.899 INFO:tasks.workunit.client.0.smithi016.stdout:9/765: readlink d3/d9/db/dc/d33/l5d 0 2024-08-01T06:56:33.904 INFO:tasks.workunit.client.0.smithi016.stdout:1/884: link d2/f2a d2/d3/d41/d49/d85/f13e 0 2024-08-01T06:56:33.905 INFO:tasks.workunit.client.0.smithi016.stdout:1/885: fdatasync d2/de/d4d/f103 0 2024-08-01T06:56:33.906 INFO:tasks.workunit.client.0.smithi016.stdout:1/886: readlink d2/d3/d41/l4b 0 2024-08-01T06:56:33.909 INFO:tasks.workunit.client.0.smithi016.stdout:2/848: link d0/d8/d6b/fe8 d0/d8/d1b/dd9/dfc/f11d 0 2024-08-01T06:56:33.911 INFO:tasks.workunit.client.0.smithi016.stdout:9/766: creat d3/d9/df/d2a/dde/ffa x:0 0 0 2024-08-01T06:56:33.936 INFO:tasks.workunit.client.0.smithi016.stdout:6/798: truncate d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/d91/fd4 229387 0 2024-08-01T06:56:33.952 INFO:tasks.workunit.client.0.smithi016.stdout:2/849: write d0/d8/d31/f53 [1323573,62248] 0 2024-08-01T06:56:33.953 INFO:tasks.workunit.client.0.smithi016.stdout:5/753: dwrite d1/d12/d3e/f42 [0,4194304] 0 2024-08-01T06:56:33.954 INFO:tasks.workunit.client.0.smithi016.stdout:9/767: write d3/d9/df/d2a/f3b [1392543,124582] 0 2024-08-01T06:56:33.961 INFO:tasks.workunit.client.0.smithi016.stdout:1/887: dwrite d2/d3/d41/d49/d51/fe5 [0,4194304] 0 2024-08-01T06:56:33.963 INFO:tasks.workunit.client.0.smithi016.stdout:6/799: dread d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f62 [0,4194304] 0 2024-08-01T06:56:33.963 INFO:tasks.workunit.client.0.smithi016.stdout:2/850: unlink d0/d8/d1b/d74/d90/d93/f4c 0 2024-08-01T06:56:33.967 INFO:tasks.workunit.client.0.smithi016.stdout:2/851: creat d0/dc3/f11e x:0 0 0 2024-08-01T06:56:33.970 INFO:tasks.workunit.client.0.smithi016.stdout:2/852: write d0/d8/d31/dc1/f101 [574982,87643] 0 2024-08-01T06:56:33.971 INFO:tasks.workunit.client.0.smithi016.stdout:6/800: unlink d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d93/daf/f104 0 2024-08-01T06:56:33.973 INFO:tasks.workunit.client.0.smithi016.stdout:5/754: dwrite d1/d2/d6/fe1 [4194304,4194304] 0 2024-08-01T06:56:33.975 INFO:tasks.workunit.client.0.smithi016.stdout:5/755: fsync d1/d2/d23/ff7 0 2024-08-01T06:56:33.983 INFO:tasks.workunit.client.0.smithi016.stdout:2/853: mknod d0/d8/d1b/d74/d99/d104/c11f 0 2024-08-01T06:56:33.983 INFO:tasks.workunit.client.0.smithi016.stdout:1/888: dwrite d2/fb2 [0,4194304] 0 2024-08-01T06:56:33.984 INFO:tasks.workunit.client.0.smithi016.stdout:5/756: getdents d1/d2/d6/d9/dd8 0 2024-08-01T06:56:33.986 INFO:tasks.workunit.client.0.smithi016.stdout:6/801: fdatasync d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d8e/dcf/fed 0 2024-08-01T06:56:33.987 INFO:tasks.workunit.client.0.smithi016.stdout:2/854: fdatasync d0/d8/f26 0 2024-08-01T06:56:33.988 INFO:tasks.workunit.client.0.smithi016.stdout:5/757: creat d1/d2/d6/d9/d19/d7a/f103 x:0 0 0 2024-08-01T06:56:33.990 INFO:tasks.workunit.client.0.smithi016.stdout:5/758: chown d1/d2/d6/d9/f34 708771 1 2024-08-01T06:56:33.991 INFO:tasks.workunit.client.0.smithi016.stdout:5/759: dread - d1/d12/d7d/f102 zero size 2024-08-01T06:56:33.994 INFO:tasks.workunit.client.0.smithi016.stdout:6/802: unlink d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/f87 0 2024-08-01T06:56:33.998 INFO:tasks.workunit.client.0.smithi016.stdout:2/855: dwrite d0/d8/d31/d5e/fa5 [0,4194304] 0 2024-08-01T06:56:33.999 INFO:tasks.workunit.client.0.smithi016.stdout:2/856: stat d0/d8/d1b/d74/d90/d93/c82 0 2024-08-01T06:56:34.000 INFO:tasks.workunit.client.0.smithi016.stdout:2/857: chown d0/d8/d31/dc1/dc4 3467 1 2024-08-01T06:56:34.002 INFO:tasks.workunit.client.0.smithi016.stdout:5/760: rename d1/d2/d6/d9/lf to d1/d2/d20/d72/l104 0 2024-08-01T06:56:34.003 INFO:tasks.workunit.client.0.smithi016.stdout:6/803: mknod d1/d8/d1b/c11d 0 2024-08-01T06:56:34.005 INFO:tasks.workunit.client.0.smithi016.stdout:1/889: link d2/de/d4d/d92/d10f/d137/f112 d2/de/dc4/f13f 0 2024-08-01T06:56:34.007 INFO:tasks.workunit.client.0.smithi016.stdout:2/858: creat d0/d8/d31/da7/f120 x:0 0 0 2024-08-01T06:56:34.007 INFO:tasks.workunit.client.0.smithi016.stdout:5/761: creat d1/d2/d6/d5a/dfc/f105 x:0 0 0 2024-08-01T06:56:34.008 INFO:tasks.workunit.client.0.smithi016.stdout:6/804: symlink d1/d41/l11e 0 2024-08-01T06:56:34.012 INFO:tasks.workunit.client.0.smithi016.stdout:2/859: unlink d0/d8/d1b/f5c 0 2024-08-01T06:56:34.014 INFO:tasks.workunit.client.0.smithi016.stdout:5/762: creat d1/d2/d6/d9/d19/d7a/f106 x:0 0 0 2024-08-01T06:56:34.015 INFO:tasks.workunit.client.0.smithi016.stdout:6/805: dread - d1/d8/d1b/db5/f97 zero size 2024-08-01T06:56:34.016 INFO:tasks.workunit.client.0.smithi016.stdout:5/763: dread d1/d2/d20/d72/f94 [0,4194304] 0 2024-08-01T06:56:34.017 INFO:tasks.workunit.client.0.smithi016.stdout:6/806: chown d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/dbc 1818577 1 2024-08-01T06:56:34.018 INFO:tasks.workunit.client.0.smithi016.stdout:2/860: creat d0/d8/d1b/dcc/d3b/f121 x:0 0 0 2024-08-01T06:56:34.019 INFO:tasks.workunit.client.0.smithi016.stdout:2/861: chown d0/d8/d1b/dcc/d3b/d45/lf4 0 1 2024-08-01T06:56:34.019 INFO:tasks.workunit.client.0.smithi016.stdout:6/807: read d1/d8/d1b/f35 [3829324,125974] 0 2024-08-01T06:56:34.026 INFO:tasks.workunit.client.0.smithi016.stdout:6/808: dread - d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f89 zero size 2024-08-01T06:56:34.027 INFO:tasks.workunit.client.0.smithi016.stdout:6/809: write d1/d8/f11 [5763751,2733] 0 2024-08-01T06:56:34.029 INFO:tasks.workunit.client.0.smithi016.stdout:1/890: dwrite d2/de/d63/fb3 [0,4194304] 0 2024-08-01T06:56:34.030 INFO:tasks.workunit.client.0.smithi016.stdout:1/891: fsync d2/de/dc4/fcc 0 2024-08-01T06:56:34.033 INFO:tasks.workunit.client.0.smithi016.stdout:6/810: rmdir d1/d8/d1b 39 2024-08-01T06:56:34.041 INFO:tasks.workunit.client.0.smithi016.stdout:2/862: dwrite d0/d8/d22/f9b [0,4194304] 0 2024-08-01T06:56:34.043 INFO:tasks.workunit.client.0.smithi016.stdout:1/892: dwrite d2/d3/d1c/f36 [0,4194304] 0 2024-08-01T06:56:34.047 INFO:tasks.workunit.client.0.smithi016.stdout:2/863: fsync d0/d16/f50 0 2024-08-01T06:56:34.047 INFO:tasks.workunit.client.0.smithi016.stdout:1/893: chown d2/de/d4d/d92/d10f/d137/f12f 14504058 1 2024-08-01T06:56:34.060 INFO:tasks.workunit.client.0.smithi016.stdout:6/811: dwrite d1/d8/d1b/d22/f6a [0,4194304] 0 2024-08-01T06:56:34.063 INFO:tasks.workunit.client.0.smithi016.stdout:6/812: rmdir d1/d8/d1b/d22/d36/d7a/dd3/da3 39 2024-08-01T06:56:34.069 INFO:tasks.workunit.client.0.smithi016.stdout:2/864: write d0/d8/f11 [687659,56714] 0 2024-08-01T06:56:34.071 INFO:tasks.workunit.client.0.smithi016.stdout:2/865: unlink d0/l1 0 2024-08-01T06:56:34.073 INFO:tasks.workunit.client.0.smithi016.stdout:2/866: stat d0/d8/d31/d5e 0 2024-08-01T06:56:34.074 INFO:tasks.workunit.client.0.smithi016.stdout:6/813: link d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f38 d1/d43/d88/f11f 0 2024-08-01T06:56:34.077 INFO:tasks.workunit.client.0.smithi016.stdout:6/814: rename d1/f5 to d1/d41/f120 0 2024-08-01T06:56:34.078 INFO:tasks.workunit.client.0.smithi016.stdout:2/867: link d0/d8/d1b/dcc/d3b/c7c d0/d8/d31/dc1/dc4/c122 0 2024-08-01T06:56:34.079 INFO:tasks.workunit.client.0.smithi016.stdout:2/868: chown d0/d8/d31/d5e/l65 24 1 2024-08-01T06:56:34.084 INFO:tasks.workunit.client.0.smithi016.stdout:2/869: dwrite d0/d8/d31/f53 [4194304,4194304] 0 2024-08-01T06:56:34.084 INFO:tasks.workunit.client.0.smithi016.stdout:2/870: chown d0/d8/d1b/dcc/d3b/d45 1 1 2024-08-01T06:56:34.122 INFO:tasks.workunit.client.0.smithi016.stdout:8/578: sync 2024-08-01T06:56:34.122 INFO:tasks.workunit.client.0.smithi016.stdout:4/708: sync 2024-08-01T06:56:34.127 INFO:tasks.workunit.client.0.smithi016.stdout:4/709: chown d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/f69 145057316 1 2024-08-01T06:56:34.182 INFO:tasks.workunit.client.0.smithi016.stdout:8/579: creat d5/dc/d3e/d72/fc1 x:0 0 0 2024-08-01T06:56:34.184 INFO:tasks.workunit.client.0.smithi016.stdout:4/710: unlink d0/d2/dc/d12/dd3/fd6 0 2024-08-01T06:56:34.185 INFO:tasks.workunit.client.0.smithi016.stdout:4/711: dread - d0/d2/dc/d12/fc6 zero size 2024-08-01T06:56:34.188 INFO:tasks.workunit.client.0.smithi016.stdout:6/815: stat d1/d8/d1b/ldf 0 2024-08-01T06:56:34.188 INFO:tasks.workunit.client.0.smithi016.stdout:2/871: stat d0/d8/d31/dc1/dc4/c122 0 2024-08-01T06:56:34.190 INFO:tasks.workunit.client.0.smithi016.stdout:6/816: read d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/ff4 [3208295,34763] 0 2024-08-01T06:56:34.191 INFO:tasks.workunit.client.0.smithi016.stdout:6/817: chown d1/d8/d94/f105 11 1 2024-08-01T06:56:34.192 INFO:tasks.workunit.client.0.smithi016.stdout:8/580: creat d5/d8/d1a/d24/d6a/fc2 x:0 0 0 2024-08-01T06:56:34.194 INFO:tasks.workunit.client.0.smithi016.stdout:4/712: unlink d0/d2/fa 0 2024-08-01T06:56:34.199 INFO:tasks.workunit.client.0.smithi016.stdout:2/872: rename d0/d8/d22/f63 to d0/d8/d1b/de5/f123 0 2024-08-01T06:56:34.201 INFO:tasks.workunit.client.0.smithi016.stdout:2/873: write d0/d8/d1b/d74/d99/fa0 [4638800,49558] 0 2024-08-01T06:56:34.202 INFO:tasks.workunit.client.0.smithi016.stdout:2/874: read - d0/d8/d6b/f10c zero size 2024-08-01T06:56:34.204 INFO:tasks.workunit.client.0.smithi016.stdout:2/875: write d0/d8/d31/dc7/ffd [292247,37212] 0 2024-08-01T06:56:34.221 INFO:tasks.workunit.client.0.smithi016.stdout:8/581: creat d5/d8/d75/dba/fc3 x:0 0 0 2024-08-01T06:56:34.223 INFO:tasks.workunit.client.0.smithi016.stdout:2/876: rename d0/d16/f1f to d0/d8/d31/d5e/de4/f124 0 2024-08-01T06:56:34.225 INFO:tasks.workunit.client.0.smithi016.stdout:2/877: read d0/d8/d22/f88 [7501134,100990] 0 2024-08-01T06:56:34.231 INFO:tasks.workunit.client.0.smithi016.stdout:2/878: mknod d0/d8/d31/d5e/c125 0 2024-08-01T06:56:34.232 INFO:tasks.workunit.client.0.smithi016.stdout:2/879: chown d0/d8 506 1 2024-08-01T06:56:34.251 INFO:tasks.workunit.client.0.smithi016.stdout:6/818: symlink d1/d43/d88/l121 0 2024-08-01T06:56:34.256 INFO:tasks.workunit.client.0.smithi016.stdout:6/819: getdents d1/d8/d1b/d22/d71 0 2024-08-01T06:56:34.262 INFO:tasks.workunit.client.0.smithi016.stdout:6/820: creat d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d8e/dcf/f122 x:0 0 0 2024-08-01T06:56:34.262 INFO:tasks.workunit.client.0.smithi016.stdout:6/821: symlink d1/d8/d1b/df6/l123 0 2024-08-01T06:56:34.264 INFO:tasks.workunit.client.0.smithi016.stdout:6/822: chown d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d8e/f107 830116770 1 2024-08-01T06:56:34.272 INFO:tasks.workunit.client.0.smithi016.stdout:4/713: write d0/d2/dc/f42 [698628,8961] 0 2024-08-01T06:56:34.286 INFO:tasks.workunit.client.0.smithi016.stdout:8/582: dwrite d5/dc/f4b [0,4194304] 0 2024-08-01T06:56:34.287 INFO:tasks.workunit.client.0.smithi016.stdout:4/714: dread d0/d2/dc/d12/dd3/d22/d26/d85/dc1/f60 [0,4194304] 0 2024-08-01T06:56:34.288 INFO:tasks.workunit.client.0.smithi016.stdout:8/583: stat d5/d8/d1a/d24/d48/d60/d63/f91 0 2024-08-01T06:56:34.290 INFO:tasks.workunit.client.0.smithi016.stdout:4/715: creat d0/d2/dcd/ff4 x:0 0 0 2024-08-01T06:56:34.294 INFO:tasks.workunit.client.0.smithi016.stdout:6/823: rmdir d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d8e/dcf 39 2024-08-01T06:56:34.296 INFO:tasks.workunit.client.0.smithi016.stdout:4/716: dread d0/d2/dc/d12/dd3/f9c [0,4194304] 0 2024-08-01T06:56:34.297 INFO:tasks.workunit.client.0.smithi016.stdout:6/824: fdatasync d1/d8/d1b/f50 0 2024-08-01T06:56:34.298 INFO:tasks.workunit.client.0.smithi016.stdout:8/584: getdents d5/dc/d3e/d72 0 2024-08-01T06:56:34.300 INFO:tasks.workunit.client.0.smithi016.stdout:8/585: fdatasync d5/d8/d1a/d24/d48/d6e/d92/d99/f9d 0 2024-08-01T06:56:34.304 INFO:tasks.workunit.client.0.smithi016.stdout:6/825: dread d1/d8/d1b/d22/d36/d7a/ff1 [0,4194304] 0 2024-08-01T06:56:34.306 INFO:tasks.workunit.client.0.smithi016.stdout:8/586: mknod d5/d8/d1a/da9/db6/cc4 0 2024-08-01T06:56:34.307 INFO:tasks.workunit.client.0.smithi016.stdout:6/826: dread - d1/d43/d88/f10e zero size 2024-08-01T06:56:34.308 INFO:tasks.workunit.client.0.smithi016.stdout:0/666: sync 2024-08-01T06:56:34.308 INFO:tasks.workunit.client.0.smithi016.stdout:3/556: sync 2024-08-01T06:56:34.308 INFO:tasks.workunit.client.0.smithi016.stdout:7/672: sync 2024-08-01T06:56:34.308 INFO:tasks.workunit.client.0.smithi016.stdout:4/717: dwrite d0/fb [0,4194304] 0 2024-08-01T06:56:34.311 INFO:tasks.workunit.client.0.smithi016.stdout:0/667: readlink d10/d11/d37/d53/l8a 0 2024-08-01T06:56:34.311 INFO:tasks.workunit.client.0.smithi016.stdout:6/827: creat d1/d8/d1b/dec/f124 x:0 0 0 2024-08-01T06:56:34.312 INFO:tasks.workunit.client.0.smithi016.stdout:0/668: stat d10/d5c/d91/cb8 0 2024-08-01T06:56:34.314 INFO:tasks.workunit.client.0.smithi016.stdout:6/828: fdatasync d1/d8/f1a 0 2024-08-01T06:56:34.318 INFO:tasks.workunit.client.0.smithi016.stdout:3/557: rmdir d9/da/df/d2a/d90 0 2024-08-01T06:56:34.322 INFO:tasks.workunit.client.0.smithi016.stdout:7/673: dwrite d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/fe8 [0,4194304] 0 2024-08-01T06:56:34.322 INFO:tasks.workunit.client.0.smithi016.stdout:8/587: dread d5/d8/d1a/d24/d48/f56 [0,4194304] 0 2024-08-01T06:56:34.326 INFO:tasks.workunit.client.0.smithi016.stdout:3/558: creat d9/d3e/d40/d58/d59/fba x:0 0 0 2024-08-01T06:56:34.329 INFO:tasks.workunit.client.0.smithi016.stdout:4/718: fdatasync d0/fb 0 2024-08-01T06:56:34.330 INFO:tasks.workunit.client.0.smithi016.stdout:3/559: write d9/da/df/f45 [2098624,124437] 0 2024-08-01T06:56:34.337 INFO:tasks.workunit.client.0.smithi016.stdout:7/674: symlink d7/db/d17/d72/d22/d77/d99/dd1/ddc/lf9 0 2024-08-01T06:56:34.338 INFO:tasks.workunit.client.0.smithi016.stdout:4/719: readlink d0/d2/dc/d12/dd3/d38/lc2 0 2024-08-01T06:56:34.340 INFO:tasks.workunit.client.0.smithi016.stdout:0/669: dread d10/f33 [0,4194304] 0 2024-08-01T06:56:34.342 INFO:tasks.workunit.client.0.smithi016.stdout:0/670: truncate d10/d11/f3d 4572378 0 2024-08-01T06:56:34.343 INFO:tasks.workunit.client.0.smithi016.stdout:4/720: truncate d0/d2/dc/d12/dd3/d38/fe7 302906 0 2024-08-01T06:56:34.343 INFO:tasks.workunit.client.0.smithi016.stdout:6/829: dread d1/d8/d1b/d22/d36/d7a/dd3/d3f/f96 [0,4194304] 0 2024-08-01T06:56:34.344 INFO:tasks.workunit.client.0.smithi016.stdout:0/671: write d10/d11/d41/f2a [4552496,123510] 0 2024-08-01T06:56:34.345 INFO:tasks.workunit.client.0.smithi016.stdout:8/588: write d5/d8/f93 [854286,49844] 0 2024-08-01T06:56:34.347 INFO:tasks.workunit.client.0.smithi016.stdout:4/721: write d0/d2/dcd/ff4 [118254,21068] 0 2024-08-01T06:56:34.371 INFO:tasks.workunit.client.0.smithi016.stdout:6/830: creat d1/d8/d1b/f125 x:0 0 0 2024-08-01T06:56:34.375 INFO:tasks.workunit.client.0.smithi016.stdout:4/722: fdatasync d0/d2/dc/d12/dd3/d22/d7f/d93/f96 0 2024-08-01T06:56:34.378 INFO:tasks.workunit.client.0.smithi016.stdout:6/831: dwrite d1/d8/d1b/dec/f124 [0,4194304] 0 2024-08-01T06:56:34.379 INFO:tasks.workunit.client.0.smithi016.stdout:6/832: chown d1/d8/f2a 750945544 1 2024-08-01T06:56:34.381 INFO:tasks.workunit.client.0.smithi016.stdout:8/589: creat d5/fc5 x:0 0 0 2024-08-01T06:56:34.382 INFO:tasks.workunit.client.0.smithi016.stdout:4/723: creat d0/d2/dcd/ff5 x:0 0 0 2024-08-01T06:56:34.382 INFO:tasks.workunit.client.0.smithi016.stdout:8/590: readlink d5/dc/le 0 2024-08-01T06:56:34.383 INFO:tasks.workunit.client.0.smithi016.stdout:6/833: creat d1/d8/d1b/d22/d2d/f126 x:0 0 0 2024-08-01T06:56:34.386 INFO:tasks.workunit.client.0.smithi016.stdout:4/724: symlink d0/d2/dc/d90/lf6 0 2024-08-01T06:56:34.388 INFO:tasks.workunit.client.0.smithi016.stdout:6/834: write d1/d8/d1b/d22/d36/d7a/fce [3615092,54319] 0 2024-08-01T06:56:34.389 INFO:tasks.workunit.client.0.smithi016.stdout:3/560: write d9/da/df/d12/d20/d5c/d76/f87 [521386,13437] 0 2024-08-01T06:56:34.390 INFO:tasks.workunit.client.0.smithi016.stdout:7/675: write d7/db/d17/d72/d1c/d79/f98 [760863,3105] 0 2024-08-01T06:56:34.394 INFO:tasks.workunit.client.0.smithi016.stdout:0/672: write d10/d11/d37/d58/f79 [79673,51038] 0 2024-08-01T06:56:34.395 INFO:tasks.workunit.client.0.smithi016.stdout:3/561: fsync d9/da/d96/fa9 0 2024-08-01T06:56:34.396 INFO:tasks.workunit.client.0.smithi016.stdout:4/725: dwrite d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/f55 [4194304,4194304] 0 2024-08-01T06:56:34.396 INFO:tasks.workunit.client.0.smithi016.stdout:8/591: link d5/d67/d86/fa7 d5/d8/d1a/d24/d48/d85/daf/fc6 0 2024-08-01T06:56:34.398 INFO:tasks.workunit.client.0.smithi016.stdout:0/673: write d10/d11/d37/d82/fcf [807090,15569] 0 2024-08-01T06:56:34.399 INFO:tasks.workunit.client.0.smithi016.stdout:8/592: chown d5/d8/d1a/d24/d48/c7f 3105 1 2024-08-01T06:56:34.405 INFO:tasks.workunit.client.0.smithi016.stdout:0/674: truncate d10/d11/d37/d50/db1/fcd 461268 0 2024-08-01T06:56:34.406 INFO:tasks.workunit.client.0.smithi016.stdout:7/676: truncate d7/db3/fd0 2083335 0 2024-08-01T06:56:34.409 INFO:tasks.workunit.client.0.smithi016.stdout:7/677: chown d7/db/d17/d72/d1c/d1d/d40/d7f/f90 767716 1 2024-08-01T06:56:34.410 INFO:tasks.workunit.client.0.smithi016.stdout:4/726: dwrite d0/d2/dc/d12/dd3/d22/d7f/fc5 [4194304,4194304] 0 2024-08-01T06:56:34.412 INFO:tasks.workunit.client.0.smithi016.stdout:0/675: creat d10/d5c/d91/fd0 x:0 0 0 2024-08-01T06:56:34.414 INFO:tasks.workunit.client.0.smithi016.stdout:8/593: fsync d5/d8/d1a/f54 0 2024-08-01T06:56:34.414 INFO:tasks.workunit.client.0.smithi016.stdout:3/562: write d9/da/df/d2a/d49/f8b [768983,60823] 0 2024-08-01T06:56:34.416 INFO:tasks.workunit.client.0.smithi016.stdout:4/727: read d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/f3f [2374354,45549] 0 2024-08-01T06:56:34.419 INFO:tasks.workunit.client.0.smithi016.stdout:8/594: chown d5/d8/d75/dba/fc3 29888809 1 2024-08-01T06:56:34.419 INFO:tasks.workunit.client.0.smithi016.stdout:0/676: dread d10/d11/d37/d58/f8c [0,4194304] 0 2024-08-01T06:56:34.420 INFO:tasks.workunit.client.0.smithi016.stdout:8/595: chown d5/d8/d1a/d24/d48/d69 2421 1 2024-08-01T06:56:34.421 INFO:tasks.workunit.client.0.smithi016.stdout:0/677: write d10/d5c/d90/fb3 [242857,13422] 0 2024-08-01T06:56:34.422 INFO:tasks.workunit.client.0.smithi016.stdout:0/678: fsync d10/d11/d37/d58/f79 0 2024-08-01T06:56:34.423 INFO:tasks.workunit.client.0.smithi016.stdout:7/678: mkdir d7/db/d17/d72/d1c/d79/d8f/dfa 0 2024-08-01T06:56:34.425 INFO:tasks.workunit.client.0.smithi016.stdout:3/563: rmdir d9/d57 39 2024-08-01T06:56:34.428 INFO:tasks.workunit.client.0.smithi016.stdout:4/728: mkdir d0/d9d/df7 0 2024-08-01T06:56:34.429 INFO:tasks.workunit.client.0.smithi016.stdout:8/596: truncate d5/dc/d3e/f6b 664432 0 2024-08-01T06:56:34.435 INFO:tasks.workunit.client.0.smithi016.stdout:3/564: rename d9/da/df/d12/f15 to d9/da/df/d12/da0/fbb 0 2024-08-01T06:56:34.435 INFO:tasks.workunit.client.0.smithi016.stdout:7/679: dread d7/db/d17/d72/f7a [0,4194304] 0 2024-08-01T06:56:34.436 INFO:tasks.workunit.client.0.smithi016.stdout:4/729: mknod d0/d2/da0/cf8 0 2024-08-01T06:56:34.436 INFO:tasks.workunit.client.0.smithi016.stdout:3/565: stat d9/da/f2e 0 2024-08-01T06:56:34.438 INFO:tasks.workunit.client.0.smithi016.stdout:0/679: dread d10/d1c/d7c/f8f [0,4194304] 0 2024-08-01T06:56:34.440 INFO:tasks.workunit.client.0.smithi016.stdout:7/680: creat d7/db/d17/d72/d1c/d79/d8f/d39/ffb x:0 0 0 2024-08-01T06:56:34.442 INFO:tasks.workunit.client.0.smithi016.stdout:4/730: creat d0/d2/dc/d12/dd3/d22/d26/da3/ff9 x:0 0 0 2024-08-01T06:56:34.442 INFO:tasks.workunit.client.0.smithi016.stdout:4/731: readlink d0/d2/l5d 0 2024-08-01T06:56:34.444 INFO:tasks.workunit.client.0.smithi016.stdout:3/566: rename d9/da/df/d12/d20/d5c/d76/f87 to d9/da/df/d12/da0/fbc 0 2024-08-01T06:56:34.445 INFO:tasks.workunit.client.0.smithi016.stdout:4/732: read d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d8f/faa [2054318,21714] 0 2024-08-01T06:56:34.447 INFO:tasks.workunit.client.0.smithi016.stdout:7/681: fsync d7/db/d17/d4e/fc1 0 2024-08-01T06:56:34.451 INFO:tasks.workunit.client.0.smithi016.stdout:3/567: fdatasync d9/da/df/d12/d20/d3c/f71 0 2024-08-01T06:56:34.458 INFO:tasks.workunit.client.0.smithi016.stdout:3/568: dwrite d9/da/df/d12/f42 [0,4194304] 0 2024-08-01T06:56:34.461 INFO:tasks.workunit.client.0.smithi016.stdout:0/680: link d10/d5c/d91/lcb d10/d5c/d90/ld1 0 2024-08-01T06:56:34.468 INFO:tasks.workunit.client.0.smithi016.stdout:4/733: truncate d0/d2/dc/d12/dd3/d22/d26/d85/dc1/f5e 1726538 0 2024-08-01T06:56:34.468 INFO:tasks.workunit.client.0.smithi016.stdout:7/682: write d7/f18 [1460784,55275] 0 2024-08-01T06:56:34.471 INFO:tasks.workunit.client.0.smithi016.stdout:3/569: mkdir d9/da/df/d12/da0/da5/dbd 0 2024-08-01T06:56:34.472 INFO:tasks.workunit.client.0.smithi016.stdout:7/683: stat d7/db/d17/d72/d22/d77/lcc 0 2024-08-01T06:56:34.473 INFO:tasks.workunit.client.0.smithi016.stdout:7/684: read - d7/db/d17/d72/d22/db4/ff7 zero size 2024-08-01T06:56:34.476 INFO:tasks.workunit.client.0.smithi016.stdout:0/681: link d10/cb0 d10/d11/d37/d53/cd2 0 2024-08-01T06:56:34.477 INFO:tasks.workunit.client.0.smithi016.stdout:7/685: creat d7/db/d17/d72/d22/d77/ffc x:0 0 0 2024-08-01T06:56:34.478 INFO:tasks.workunit.client.0.smithi016.stdout:4/734: getdents d0/d2/dc/d12/dd3/d22/d26/de0 0 2024-08-01T06:56:34.481 INFO:tasks.workunit.client.0.smithi016.stdout:7/686: readlink d7/ld 0 2024-08-01T06:56:34.482 INFO:tasks.workunit.client.0.smithi016.stdout:0/682: creat d10/d11/d37/d50/db1/dbb/fd3 x:0 0 0 2024-08-01T06:56:34.483 INFO:tasks.workunit.client.0.smithi016.stdout:4/735: mknod d0/db9/cfa 0 2024-08-01T06:56:34.486 INFO:tasks.workunit.client.0.smithi016.stdout:0/683: mknod d10/d11/d41/d95/cd4 0 2024-08-01T06:56:34.486 INFO:tasks.workunit.client.0.smithi016.stdout:3/570: dwrite d9/d4e/d81/fb1 [0,4194304] 0 2024-08-01T06:56:34.492 INFO:tasks.workunit.client.0.smithi016.stdout:0/684: dread d10/d1c/f27 [0,4194304] 0 2024-08-01T06:56:34.494 INFO:tasks.workunit.client.0.smithi016.stdout:3/571: symlink d9/da/df/lbe 0 2024-08-01T06:56:34.494 INFO:tasks.workunit.client.0.smithi016.stdout:0/685: symlink d10/d11/db4/ld5 0 2024-08-01T06:56:34.496 INFO:tasks.workunit.client.0.smithi016.stdout:4/736: dwrite d0/d2/dc/d12/dd3/d22/d26/d8b/faf [4194304,4194304] 0 2024-08-01T06:56:34.496 INFO:tasks.workunit.client.0.smithi016.stdout:0/686: chown d10/f33 862 1 2024-08-01T06:56:34.499 INFO:tasks.workunit.client.0.smithi016.stdout:3/572: mknod d9/da/df/cbf 0 2024-08-01T06:56:34.499 INFO:tasks.workunit.client.0.smithi016.stdout:0/687: creat d10/d11/d41/d95/fd6 x:0 0 0 2024-08-01T06:56:34.502 INFO:tasks.workunit.client.0.smithi016.stdout:3/573: symlink d9/da/df/d53/lc0 0 2024-08-01T06:56:34.502 INFO:tasks.workunit.client.0.smithi016.stdout:4/737: fsync d0/d2/dc/d12/dd3/d22/d26/d85/dc1/f5e 0 2024-08-01T06:56:34.504 INFO:tasks.workunit.client.0.smithi016.stdout:0/688: mknod d10/d11/d37/d53/cd7 0 2024-08-01T06:56:34.504 INFO:tasks.workunit.client.0.smithi016.stdout:4/738: fsync d0/d2/dcd/ff5 0 2024-08-01T06:56:34.505 INFO:tasks.workunit.client.0.smithi016.stdout:0/689: chown d10/d11/d37/d53/cc3 3 1 2024-08-01T06:56:34.506 INFO:tasks.workunit.client.0.smithi016.stdout:3/574: mknod d9/d4e/d81/cc1 0 2024-08-01T06:56:34.506 INFO:tasks.workunit.client.0.smithi016.stdout:0/690: chown d10/d11/d37/c7e 33334 1 2024-08-01T06:56:34.507 INFO:tasks.workunit.client.0.smithi016.stdout:3/575: chown d9/da/f2e 106 1 2024-08-01T06:56:34.508 INFO:tasks.workunit.client.0.smithi016.stdout:0/691: write d10/d5c/d90/fb3 [1076193,12533] 0 2024-08-01T06:56:34.511 INFO:tasks.workunit.client.0.smithi016.stdout:4/739: mknod d0/d2/dc/d12/dc7/cfb 0 2024-08-01T06:56:34.515 INFO:tasks.workunit.client.0.smithi016.stdout:0/692: dwrite d10/d11/d37/f9f [0,4194304] 0 2024-08-01T06:56:34.517 INFO:tasks.workunit.client.0.smithi016.stdout:0/693: write d10/f17 [2790755,11988] 0 2024-08-01T06:56:34.525 INFO:tasks.workunit.client.0.smithi016.stdout:3/576: getdents d9/da/df/d53 0 2024-08-01T06:56:34.538 INFO:tasks.workunit.client.0.smithi016.stdout:3/577: link d9/da/df/d2a/d49/db5/f7b d9/da/df/d12/d75/db4/fc2 0 2024-08-01T06:56:34.539 INFO:tasks.workunit.client.0.smithi016.stdout:4/740: truncate d0/d2/dc/d12/dd3/d22/d26/d85/dc1/f9b 2416707 0 2024-08-01T06:56:34.540 INFO:tasks.workunit.client.0.smithi016.stdout:0/694: dwrite d10/d11/d41/f2f [0,4194304] 0 2024-08-01T06:56:34.542 INFO:tasks.workunit.client.0.smithi016.stdout:0/695: dread - d10/d11/d37/fa6 zero size 2024-08-01T06:56:34.542 INFO:tasks.workunit.client.0.smithi016.stdout:3/578: mkdir d9/da/d96/dc3 0 2024-08-01T06:56:34.549 INFO:tasks.workunit.client.0.smithi016.stdout:0/696: rename d10/d11/l34 to d10/d5c/d90/dbd/ld8 0 2024-08-01T06:56:34.555 INFO:tasks.workunit.client.0.smithi016.stdout:3/579: rename d9/d1c/l39 to d9/da/df/d2a/d49/d61/lc4 0 2024-08-01T06:56:34.558 INFO:tasks.workunit.client.0.smithi016.stdout:0/697: rename d10/d11/d41/f2a to d10/d5c/d90/da0/dbc/fd9 0 2024-08-01T06:56:34.563 INFO:tasks.workunit.client.0.smithi016.stdout:0/698: creat d10/d11/d41/d95/fda x:0 0 0 2024-08-01T06:56:34.564 INFO:tasks.workunit.client.0.smithi016.stdout:4/741: dwrite d0/d2/f11 [0,4194304] 0 2024-08-01T06:56:34.564 INFO:tasks.workunit.client.0.smithi016.stdout:0/699: stat d10/d11/d37/fa6 0 2024-08-01T06:56:34.575 INFO:tasks.workunit.client.0.smithi016.stdout:3/580: dread d9/da/df/d12/d75/db4/fc2 [0,4194304] 0 2024-08-01T06:56:34.578 INFO:tasks.workunit.client.0.smithi016.stdout:3/581: mkdir d9/da/df/d2a/d49/d61/dc5 0 2024-08-01T06:56:34.584 INFO:tasks.workunit.client.0.smithi016.stdout:0/700: write d10/f33 [3094435,121544] 0 2024-08-01T06:56:34.585 INFO:tasks.workunit.client.0.smithi016.stdout:3/582: dwrite d9/da/df/d2a/d49/f8b [0,4194304] 0 2024-08-01T06:56:34.589 INFO:tasks.workunit.client.0.smithi016.stdout:0/701: getdents d10/d11/dc1 0 2024-08-01T06:56:34.592 INFO:tasks.workunit.client.0.smithi016.stdout:3/583: dread d9/da/df/d2a/d49/f68 [0,4194304] 0 2024-08-01T06:56:34.595 INFO:tasks.workunit.client.0.smithi016.stdout:0/702: dread d10/d11/d37/f9f [0,4194304] 0 2024-08-01T06:56:34.596 INFO:tasks.workunit.client.0.smithi016.stdout:3/584: unlink d9/da/df/d53/f6c 0 2024-08-01T06:56:34.598 INFO:tasks.workunit.client.0.smithi016.stdout:0/703: rename d10/d5c/d90/fb3 to d10/fdb 0 2024-08-01T06:56:34.599 INFO:tasks.workunit.client.0.smithi016.stdout:3/585: fdatasync d9/da/df/d12/d20/d3c/f71 0 2024-08-01T06:56:34.600 INFO:tasks.workunit.client.0.smithi016.stdout:3/586: stat d9/da/df/d12/d20/d5c/d76/fae 0 2024-08-01T06:56:34.606 INFO:tasks.workunit.client.0.smithi016.stdout:3/587: mknod d9/da/df/d2a/cc6 0 2024-08-01T06:56:34.609 INFO:tasks.workunit.client.0.smithi016.stdout:3/588: readlink d9/da/l99 0 2024-08-01T06:56:34.609 INFO:tasks.workunit.client.0.smithi016.stdout:3/589: chown d9/da/df/d12/d20/d3c/f52 660 1 2024-08-01T06:56:34.611 INFO:tasks.workunit.client.0.smithi016.stdout:3/590: mkdir d9/da/df/d12/d75/dc7 0 2024-08-01T06:56:34.614 INFO:tasks.workunit.client.0.smithi016.stdout:3/591: creat d9/d3e/d40/d58/fc8 x:0 0 0 2024-08-01T06:56:34.615 INFO:tasks.workunit.client.0.smithi016.stdout:3/592: dread - d9/da/f2e zero size 2024-08-01T06:56:34.617 INFO:tasks.workunit.client.0.smithi016.stdout:3/593: symlink d9/d1c/da4/lc9 0 2024-08-01T06:56:34.618 INFO:tasks.workunit.client.0.smithi016.stdout:3/594: dread - d9/da/df/d12/fb0 zero size 2024-08-01T06:56:34.622 INFO:tasks.workunit.client.0.smithi016.stdout:3/595: mkdir d9/d98/db7/dca 0 2024-08-01T06:56:34.625 INFO:tasks.workunit.client.0.smithi016.stdout:3/596: creat d9/da/df/d53/fcb x:0 0 0 2024-08-01T06:56:34.626 INFO:tasks.workunit.client.0.smithi016.stdout:0/704: symlink d10/d11/d37/d50/db1/dbb/ldc 0 2024-08-01T06:56:34.628 INFO:tasks.workunit.client.0.smithi016.stdout:3/597: rename d9/f7c to d9/da/df/d2a/d49/d61/dc5/fcc 0 2024-08-01T06:56:34.629 INFO:tasks.workunit.client.0.smithi016.stdout:0/705: write d10/f5a [3376534,128101] 0 2024-08-01T06:56:34.634 INFO:tasks.workunit.client.0.smithi016.stdout:0/706: mkdir d10/d11/ddd 0 2024-08-01T06:56:34.637 INFO:tasks.workunit.client.0.smithi016.stdout:0/707: rename f9 to d10/d11/d37/d58/fde 0 2024-08-01T06:56:34.640 INFO:tasks.workunit.client.0.smithi016.stdout:0/708: chown d10/d1c/d7c/f8f 1422 1 2024-08-01T06:56:34.645 INFO:tasks.workunit.client.0.smithi016.stdout:0/709: unlink d10/d5c/d90/f9c 0 2024-08-01T06:56:34.648 INFO:tasks.workunit.client.0.smithi016.stdout:0/710: mknod d10/d5c/d90/da2/cdf 0 2024-08-01T06:56:34.651 INFO:tasks.workunit.client.0.smithi016.stdout:0/711: creat d10/d11/d37/d82/d9b/fe0 x:0 0 0 2024-08-01T06:56:34.656 INFO:tasks.workunit.client.0.smithi016.stdout:3/598: write d9/da/f86 [679814,15280] 0 2024-08-01T06:56:34.657 INFO:tasks.workunit.client.0.smithi016.stdout:0/712: dwrite d10/d11/d37/d50/fa7 [0,4194304] 0 2024-08-01T06:56:34.664 INFO:tasks.workunit.client.0.smithi016.stdout:0/713: mknod d10/d11/d37/d82/d9b/ce1 0 2024-08-01T06:56:34.671 INFO:tasks.workunit.client.0.smithi016.stdout:0/714: dwrite d10/d11/d37/d53/f69 [0,4194304] 0 2024-08-01T06:56:34.676 INFO:tasks.workunit.client.0.smithi016.stdout:0/715: mknod d10/d11/d37/d50/db1/dbb/ce2 0 2024-08-01T06:56:34.679 INFO:tasks.workunit.client.0.smithi016.stdout:0/716: fdatasync d10/d11/d41/f94 0 2024-08-01T06:56:34.683 INFO:tasks.workunit.client.0.smithi016.stdout:0/717: fsync d10/d1c/f27 0 2024-08-01T06:56:34.684 INFO:tasks.workunit.client.0.smithi016.stdout:0/718: chown d10/d11/d37/d82/fcf 52418464 1 2024-08-01T06:56:34.686 INFO:tasks.workunit.client.0.smithi016.stdout:0/719: creat d10/d11/d37/fe3 x:0 0 0 2024-08-01T06:56:34.687 INFO:tasks.workunit.client.0.smithi016.stdout:0/720: fdatasync d10/d11/d37/fa6 0 2024-08-01T06:56:34.692 INFO:tasks.workunit.client.0.smithi016.stdout:0/721: getdents d10 0 2024-08-01T06:56:34.694 INFO:tasks.workunit.client.0.smithi016.stdout:3/599: dwrite d9/da/df/d12/f94 [0,4194304] 0 2024-08-01T06:56:34.696 INFO:tasks.workunit.client.0.smithi016.stdout:0/722: symlink d10/d1c/d7c/le4 0 2024-08-01T06:56:34.698 INFO:tasks.workunit.client.0.smithi016.stdout:3/600: creat d9/d4e/fcd x:0 0 0 2024-08-01T06:56:34.699 INFO:tasks.workunit.client.0.smithi016.stdout:0/723: creat d10/d1c/fe5 x:0 0 0 2024-08-01T06:56:34.702 INFO:tasks.workunit.client.0.smithi016.stdout:3/601: unlink d9/da/df/d2a/cc6 0 2024-08-01T06:56:34.704 INFO:tasks.workunit.client.0.smithi016.stdout:3/602: chown d9/da/df/d12 2 1 2024-08-01T06:56:34.708 INFO:tasks.workunit.client.0.smithi016.stdout:0/724: dwrite d10/d11/d37/fbe [0,4194304] 0 2024-08-01T06:56:34.718 INFO:tasks.workunit.client.0.smithi016.stdout:3/603: dwrite d9/da/df/d2a/d49/f68 [4194304,4194304] 0 2024-08-01T06:56:34.719 INFO:tasks.workunit.client.0.smithi016.stdout:3/604: chown d9/da/df/d2a/d49 5 1 2024-08-01T06:56:34.722 INFO:tasks.workunit.client.0.smithi016.stdout:0/725: rename d10/d5c/d90/da2/cdf to d10/d11/d41/ce6 0 2024-08-01T06:56:34.723 INFO:tasks.workunit.client.0.smithi016.stdout:0/726: chown d10/d11/d37/d58/c98 192 1 2024-08-01T06:56:34.725 INFO:tasks.workunit.client.0.smithi016.stdout:3/605: readlink d9/da/df/d2a/d49/d61/lc4 0 2024-08-01T06:56:34.727 INFO:tasks.workunit.client.0.smithi016.stdout:0/727: rename d10/fdb to d10/fe7 0 2024-08-01T06:56:34.735 INFO:tasks.workunit.client.0.smithi016.stdout:0/728: mkdir d10/d5c/d90/da2/da5/de8 0 2024-08-01T06:56:34.743 INFO:tasks.workunit.client.0.smithi016.stdout:9/768: sync 2024-08-01T06:56:34.745 INFO:tasks.workunit.client.0.smithi016.stdout:0/729: stat d10/d11/d37/fa6 0 2024-08-01T06:56:34.746 INFO:tasks.workunit.client.0.smithi016.stdout:9/769: mkdir d3/d9/d73/dfb 0 2024-08-01T06:56:34.749 INFO:tasks.workunit.client.0.smithi016.stdout:0/730: unlink ce 0 2024-08-01T06:56:34.754 INFO:tasks.workunit.client.0.smithi016.stdout:0/731: chown d10/d5c/d90/dbd/ld8 12183756 1 2024-08-01T06:56:34.757 INFO:tasks.workunit.client.0.smithi016.stdout:3/606: truncate d9/da/df/d12/d20/d5c/f63 2930492 0 2024-08-01T06:56:34.763 INFO:tasks.workunit.client.0.smithi016.stdout:3/607: dwrite d9/da/df/d12/f42 [4194304,4194304] 0 2024-08-01T06:56:34.765 INFO:tasks.workunit.client.0.smithi016.stdout:0/732: rename d10/d11/d37/f55 to d10/d1c/fe9 0 2024-08-01T06:56:34.767 INFO:tasks.workunit.client.0.smithi016.stdout:9/770: write d3/d32/d5c/d8a/f19 [5230629,21506] 0 2024-08-01T06:56:34.767 INFO:tasks.workunit.client.0.smithi016.stdout:3/608: symlink d9/d3e/lce 0 2024-08-01T06:56:34.768 INFO:tasks.workunit.client.0.smithi016.stdout:0/733: creat d10/d5c/d90/da2/fea x:0 0 0 2024-08-01T06:56:34.769 INFO:tasks.workunit.client.0.smithi016.stdout:3/609: write d9/da/df/d12/fb0 [511164,68238] 0 2024-08-01T06:56:34.771 INFO:tasks.workunit.client.0.smithi016.stdout:9/771: mknod d3/d9/db/cfc 0 2024-08-01T06:56:34.772 INFO:tasks.workunit.client.0.smithi016.stdout:3/610: dread - d9/d3e/d80/f9f zero size 2024-08-01T06:56:34.774 INFO:tasks.workunit.client.0.smithi016.stdout:0/734: mkdir d10/d5c/d90/da2/da5/de8/deb 0 2024-08-01T06:56:34.774 INFO:tasks.workunit.client.0.smithi016.stdout:0/735: stat d10/d11/d37 0 2024-08-01T06:56:34.775 INFO:tasks.workunit.client.0.smithi016.stdout:0/736: chown d10/d5c/d90/da2/da5/lc2 1014299890 1 2024-08-01T06:56:34.791 INFO:tasks.workunit.client.0.smithi016.stdout:9/772: write d3/f6a [489448,51970] 0 2024-08-01T06:56:34.792 INFO:tasks.workunit.client.0.smithi016.stdout:3/611: dread d9/da/df/d12/d20/d5c/f9d [0,4194304] 0 2024-08-01T06:56:34.794 INFO:tasks.workunit.client.0.smithi016.stdout:0/737: write d10/d11/f43 [729806,56138] 0 2024-08-01T06:56:34.797 INFO:tasks.workunit.client.0.smithi016.stdout:0/738: readlink d10/d11/d37/d58/l6c 0 2024-08-01T06:56:34.800 INFO:tasks.workunit.client.0.smithi016.stdout:9/773: dwrite d3/de/d89/ff4 [0,4194304] 0 2024-08-01T06:56:34.805 INFO:tasks.workunit.client.0.smithi016.stdout:9/774: unlink d3/d9/lcf 0 2024-08-01T06:56:34.808 INFO:tasks.workunit.client.0.smithi016.stdout:0/739: write d10/d1c/f27 [486152,78402] 0 2024-08-01T06:56:34.810 INFO:tasks.workunit.client.0.smithi016.stdout:9/775: creat d3/d9/d73/ffd x:0 0 0 2024-08-01T06:56:34.811 INFO:tasks.workunit.client.0.smithi016.stdout:3/612: dread d9/da/df/d2a/d49/f62 [0,4194304] 0 2024-08-01T06:56:34.813 INFO:tasks.workunit.client.0.smithi016.stdout:0/740: mkdir d10/d5c/d90/da2/da5/de8/deb/dec 0 2024-08-01T06:56:34.817 INFO:tasks.workunit.client.0.smithi016.stdout:0/741: creat d10/d11/db4/fed x:0 0 0 2024-08-01T06:56:34.819 INFO:tasks.workunit.client.0.smithi016.stdout:3/613: rename d9/d57/d66/f73 to d9/da/df/d2a/d49/db5/fcf 0 2024-08-01T06:56:34.820 INFO:tasks.workunit.client.0.smithi016.stdout:3/614: write d9/f1f [3516033,120930] 0 2024-08-01T06:56:34.825 INFO:tasks.workunit.client.0.smithi016.stdout:3/615: creat d9/da/df/d53/fd0 x:0 0 0 2024-08-01T06:56:34.828 INFO:tasks.workunit.client.0.smithi016.stdout:3/616: creat d9/d4e/d72/fd1 x:0 0 0 2024-08-01T06:56:34.831 INFO:tasks.workunit.client.0.smithi016.stdout:3/617: read - d9/da/df/d12/d20/d5c/d76/fae zero size 2024-08-01T06:56:34.833 INFO:tasks.workunit.client.0.smithi016.stdout:0/742: dwrite d10/d11/d37/d82/f8d [0,4194304] 0 2024-08-01T06:56:34.834 INFO:tasks.workunit.client.0.smithi016.stdout:9/776: dread d3/d9/db/dc/f42 [4194304,4194304] 0 2024-08-01T06:56:34.841 INFO:tasks.workunit.client.0.smithi016.stdout:3/618: dread d9/da/df/d12/f8e [0,4194304] 0 2024-08-01T06:56:34.848 INFO:tasks.workunit.client.0.smithi016.stdout:3/619: creat d9/da/d96/dc3/fd2 x:0 0 0 2024-08-01T06:56:34.852 INFO:tasks.workunit.client.0.smithi016.stdout:3/620: creat d9/d57/fd3 x:0 0 0 2024-08-01T06:56:34.853 INFO:tasks.workunit.client.0.smithi016.stdout:9/777: dread d3/d9/db/dc/d33/f51 [0,4194304] 0 2024-08-01T06:56:34.855 INFO:tasks.workunit.client.0.smithi016.stdout:3/621: symlink d9/da/df/d12/da0/da5/ld4 0 2024-08-01T06:56:34.856 INFO:tasks.workunit.client.0.smithi016.stdout:9/778: symlink d3/de/dae/lfe 0 2024-08-01T06:56:34.856 INFO:tasks.workunit.client.0.smithi016.stdout:9/779: chown d3/d9/df/d16/cc4 89821693 1 2024-08-01T06:56:34.858 INFO:tasks.workunit.client.0.smithi016.stdout:0/743: write d10/d1c/f46 [520104,93537] 0 2024-08-01T06:56:34.859 INFO:tasks.workunit.client.0.smithi016.stdout:9/780: read - d3/d9/db/dc/d56/fdf zero size 2024-08-01T06:56:34.860 INFO:tasks.workunit.client.0.smithi016.stdout:3/622: symlink d9/da/df/d12/d20/d5c/ld5 0 2024-08-01T06:56:34.862 INFO:tasks.workunit.client.0.smithi016.stdout:3/623: chown d9/da/df/d12/d20/d3c/f71 31318032 1 2024-08-01T06:56:34.862 INFO:tasks.workunit.client.0.smithi016.stdout:9/781: creat d3/d9/df/d16/d94/da5/fff x:0 0 0 2024-08-01T06:56:34.865 INFO:tasks.workunit.client.0.smithi016.stdout:0/744: rename d10/d11/d37/d50/fa7 to d10/d5c/d90/da2/da5/de8/deb/fee 0 2024-08-01T06:56:34.870 INFO:tasks.workunit.client.0.smithi016.stdout:3/624: dwrite d9/da/df/d12/d20/d3c/f52 [4194304,4194304] 0 2024-08-01T06:56:34.871 INFO:tasks.workunit.client.0.smithi016.stdout:3/625: fsync d9/da/df/d12/d20/fb8 0 2024-08-01T06:56:34.872 INFO:tasks.workunit.client.0.smithi016.stdout:3/626: chown d9/da/f47 5 1 2024-08-01T06:56:34.874 INFO:tasks.workunit.client.0.smithi016.stdout:0/745: creat d10/d11/d37/fef x:0 0 0 2024-08-01T06:56:34.876 INFO:tasks.workunit.client.0.smithi016.stdout:3/627: dread d9/da/df/d2a/d49/db5/f7b [0,4194304] 0 2024-08-01T06:56:34.882 INFO:tasks.workunit.client.0.smithi016.stdout:3/628: creat d9/da/df/d12/d75/dc7/fd6 x:0 0 0 2024-08-01T06:56:34.905 INFO:tasks.workunit.client.0.smithi016.stdout:9/782: dwrite d3/de/f15 [0,4194304] 0 2024-08-01T06:56:34.909 INFO:tasks.workunit.client.0.smithi016.stdout:9/783: fsync d3/d9/df/d16/f1e 0 2024-08-01T06:56:34.916 INFO:tasks.workunit.client.0.smithi016.stdout:0/746: dwrite d10/d11/d41/f6d [0,4194304] 0 2024-08-01T06:56:34.919 INFO:tasks.workunit.client.0.smithi016.stdout:0/747: creat d10/d5c/d90/dbd/ff0 x:0 0 0 2024-08-01T06:56:34.921 INFO:tasks.workunit.client.0.smithi016.stdout:0/748: unlink d10/d5c/d90/da0/dbc/fd9 0 2024-08-01T06:56:34.924 INFO:tasks.workunit.client.0.smithi016.stdout:3/629: write d9/da/df/d53/f56 [945137,40130] 0 2024-08-01T06:56:34.930 INFO:tasks.workunit.client.0.smithi016.stdout:3/630: dread d9/da/df/d12/f42 [4194304,4194304] 0 2024-08-01T06:56:34.935 INFO:tasks.workunit.client.0.smithi016.stdout:3/631: creat d9/da/df/d12/d20/d5c/fd7 x:0 0 0 2024-08-01T06:56:34.939 INFO:tasks.workunit.client.0.smithi016.stdout:0/749: dread d10/f17 [0,4194304] 0 2024-08-01T06:56:34.941 INFO:tasks.workunit.client.0.smithi016.stdout:3/632: creat d9/da/df/d2a/d49/d61/fd8 x:0 0 0 2024-08-01T06:56:34.942 INFO:tasks.workunit.client.0.smithi016.stdout:0/750: creat d10/d5c/d90/da2/da5/ff1 x:0 0 0 2024-08-01T06:56:34.943 INFO:tasks.workunit.client.0.smithi016.stdout:0/751: fsync d10/d11/d37/d50/f84 0 2024-08-01T06:56:34.944 INFO:tasks.workunit.client.0.smithi016.stdout:0/752: fsync d10/d1c/f4e 0 2024-08-01T06:56:34.950 INFO:tasks.workunit.client.0.smithi016.stdout:0/753: chown d10/l88 110 1 2024-08-01T06:56:34.950 INFO:tasks.workunit.client.0.smithi016.stdout:0/754: dread - d10/d1c/fe5 zero size 2024-08-01T06:56:34.954 INFO:tasks.workunit.client.0.smithi016.stdout:0/755: mkdir d10/d5c/df2 0 2024-08-01T06:56:34.954 INFO:tasks.workunit.client.0.smithi016.stdout:3/633: link d9/d3e/d40/d58/d59/la2 d9/d57/d91/ld9 0 2024-08-01T06:56:34.959 INFO:tasks.workunit.client.0.smithi016.stdout:0/756: creat d10/d5c/d90/da0/dbc/ff3 x:0 0 0 2024-08-01T06:56:34.967 INFO:tasks.workunit.client.0.smithi016.stdout:0/757: dwrite d10/d11/d37/d53/f69 [0,4194304] 0 2024-08-01T06:56:34.975 INFO:tasks.workunit.client.0.smithi016.stdout:0/758: mkdir d10/d11/d41/df4 0 2024-08-01T06:56:34.975 INFO:tasks.workunit.client.0.smithi016.stdout:9/784: dwrite d3/d9/d46/d48/fab [0,4194304] 0 2024-08-01T06:56:34.981 INFO:tasks.workunit.client.0.smithi016.stdout:0/759: unlink d10/d11/db4/ld5 0 2024-08-01T06:56:34.982 INFO:tasks.workunit.client.0.smithi016.stdout:0/760: chown d10/d11/db4 1 1 2024-08-01T06:56:34.984 INFO:tasks.workunit.client.0.smithi016.stdout:9/785: creat d3/d9/db/f100 x:0 0 0 2024-08-01T06:56:34.985 INFO:tasks.workunit.client.0.smithi016.stdout:0/761: mknod d10/d11/db4/cf5 0 2024-08-01T06:56:34.987 INFO:tasks.workunit.client.0.smithi016.stdout:0/762: write d10/d11/f3d [2418516,126194] 0 2024-08-01T06:56:34.992 INFO:tasks.workunit.client.0.smithi016.stdout:3/634: dread d9/da/f47 [0,4194304] 0 2024-08-01T06:56:34.993 INFO:tasks.workunit.client.0.smithi016.stdout:0/763: fsync d10/f2e 0 2024-08-01T06:56:34.993 INFO:tasks.workunit.client.0.smithi016.stdout:3/635: stat d9/d3e/d80/l8f 0 2024-08-01T06:56:34.999 INFO:tasks.workunit.client.0.smithi016.stdout:0/764: chown d10/d5c/l6a 197070 1 2024-08-01T06:56:35.003 INFO:tasks.workunit.client.0.smithi016.stdout:9/786: truncate d3/d32/d5c/d8a/f19 2539529 0 2024-08-01T06:56:35.010 INFO:tasks.workunit.client.0.smithi016.stdout:0/765: dwrite d10/d11/d37/d58/f68 [0,4194304] 0 2024-08-01T06:56:35.010 INFO:tasks.workunit.client.0.smithi016.stdout:9/787: symlink d3/d9/db/d3e/l101 0 2024-08-01T06:56:35.011 INFO:tasks.workunit.client.0.smithi016.stdout:9/788: fdatasync d3/de/f15 0 2024-08-01T06:56:35.030 INFO:tasks.workunit.client.0.smithi016.stdout:0/766: dread d10/d11/d37/d50/f84 [0,4194304] 0 2024-08-01T06:56:35.031 INFO:tasks.workunit.client.0.smithi016.stdout:9/789: dwrite d3/de/fc7 [0,4194304] 0 2024-08-01T06:56:35.032 INFO:tasks.workunit.client.0.smithi016.stdout:0/767: chown d10/d11/d37/d50/f77 0 1 2024-08-01T06:56:35.035 INFO:tasks.workunit.client.0.smithi016.stdout:0/768: unlink d10/d11/d37/d82/f8d 0 2024-08-01T06:56:35.038 INFO:tasks.workunit.client.0.smithi016.stdout:9/790: dwrite d3/de/d89/ff4 [4194304,4194304] 0 2024-08-01T06:56:35.045 INFO:tasks.workunit.client.0.smithi016.stdout:9/791: symlink d3/de/l102 0 2024-08-01T06:56:35.047 INFO:tasks.workunit.client.0.smithi016.stdout:0/769: truncate d10/f49 447355 0 2024-08-01T06:56:35.050 INFO:tasks.workunit.client.0.smithi016.stdout:0/770: fdatasync d10/f33 0 2024-08-01T06:56:35.052 INFO:tasks.workunit.client.0.smithi016.stdout:0/771: write d10/d11/d37/d58/f68 [699092,107625] 0 2024-08-01T06:56:35.056 INFO:tasks.workunit.client.0.smithi016.stdout:0/772: rename d10/d5c/d91 to d10/d5c/d90/da0/df6 0 2024-08-01T06:56:35.058 INFO:tasks.workunit.client.0.smithi016.stdout:0/773: rmdir d10/d11/d41/d95 39 2024-08-01T06:56:35.063 INFO:tasks.workunit.client.0.smithi016.stdout:9/792: dread d3/d9/df/d16/fb1 [0,4194304] 0 2024-08-01T06:56:35.065 INFO:tasks.workunit.client.0.smithi016.stdout:0/774: dwrite d10/d11/d41/f2f [0,4194304] 0 2024-08-01T06:56:35.070 INFO:tasks.workunit.client.0.smithi016.stdout:0/775: fdatasync d10/d11/d37/d58/f81 0 2024-08-01T06:56:35.072 INFO:tasks.workunit.client.0.smithi016.stdout:5/764: sync 2024-08-01T06:56:35.078 INFO:tasks.workunit.client.0.smithi016.stdout:0/776: dwrite d10/d11/d37/d50/db1/fcd [0,4194304] 0 2024-08-01T06:56:35.081 INFO:tasks.workunit.client.0.smithi016.stdout:0/777: write d10/d11/d37/d82/d9b/fe0 [965926,41088] 0 2024-08-01T06:56:35.082 INFO:tasks.workunit.client.0.smithi016.stdout:5/765: dread d1/d2/d6/d9/d49/fbf [0,4194304] 0 2024-08-01T06:56:35.084 INFO:tasks.workunit.client.0.smithi016.stdout:0/778: creat d10/d11/d41/d95/ff7 x:0 0 0 2024-08-01T06:56:35.084 INFO:tasks.workunit.client.0.smithi016.stdout:5/766: truncate d1/d2/d6/d9/f34 4434883 0 2024-08-01T06:56:35.086 INFO:tasks.workunit.client.0.smithi016.stdout:0/779: mknod d10/d1c/cf8 0 2024-08-01T06:56:35.092 INFO:tasks.workunit.client.0.smithi016.stdout:5/767: getdents d1/d2/d20/d72 0 2024-08-01T06:56:35.092 INFO:tasks.workunit.client.0.smithi016.stdout:0/780: link d10/d11/d41/c19 d10/d11/db4/cf9 0 2024-08-01T06:56:35.095 INFO:tasks.workunit.client.0.smithi016.stdout:5/768: symlink d1/d2/d6/d9/d19/d7a/l107 0 2024-08-01T06:56:35.096 INFO:tasks.workunit.client.0.smithi016.stdout:0/781: mknod d10/d5c/d90/da0/dbc/cfa 0 2024-08-01T06:56:35.099 INFO:tasks.workunit.client.0.smithi016.stdout:0/782: creat d10/d11/d37/d82/ffb x:0 0 0 2024-08-01T06:56:35.102 INFO:tasks.workunit.client.0.smithi016.stdout:5/769: dwrite d1/d2/d6/d9/d49/d57/db1/fcd [0,4194304] 0 2024-08-01T06:56:35.106 INFO:tasks.workunit.client.0.smithi016.stdout:5/770: mknod d1/d2/d20/c108 0 2024-08-01T06:56:35.106 INFO:tasks.workunit.client.0.smithi016.stdout:0/783: link d10/l88 d10/d5c/d90/da0/dbc/lfc 0 2024-08-01T06:56:35.107 INFO:tasks.workunit.client.0.smithi016.stdout:5/771: chown d1/d2/d23/d3a/f3b 3794 1 2024-08-01T06:56:35.113 INFO:tasks.workunit.client.0.smithi016.stdout:0/784: truncate d10/d11/d37/d50/f77 3118644 0 2024-08-01T06:56:35.114 INFO:tasks.workunit.client.0.smithi016.stdout:5/772: dwrite d1/f5 [0,4194304] 0 2024-08-01T06:56:35.118 INFO:tasks.workunit.client.0.smithi016.stdout:0/785: symlink d10/d5c/d90/da0/lfd 0 2024-08-01T06:56:35.120 INFO:tasks.workunit.client.0.smithi016.stdout:5/773: unlink d1/f3c 0 2024-08-01T06:56:35.121 INFO:tasks.workunit.client.0.smithi016.stdout:5/774: truncate d1/d2/d20/db8/ff3 154491 0 2024-08-01T06:56:35.123 INFO:tasks.workunit.client.0.smithi016.stdout:0/786: chown d10/d11/d37/d53/f93 1741102 1 2024-08-01T06:56:35.130 INFO:tasks.workunit.client.0.smithi016.stdout:0/787: rename d10/d11/d37/d53/f93 to d10/d11/d41/d95/ffe 0 2024-08-01T06:56:35.131 INFO:tasks.workunit.client.0.smithi016.stdout:0/788: fdatasync d10/d11/d37/d82/fcf 0 2024-08-01T06:56:35.134 INFO:tasks.workunit.client.0.smithi016.stdout:5/775: creat d1/d2/d6/d9/d1b/dda/df0/f109 x:0 0 0 2024-08-01T06:56:35.137 INFO:tasks.workunit.client.0.smithi016.stdout:0/789: mknod d10/d1c/cff 0 2024-08-01T06:56:35.138 INFO:tasks.workunit.client.0.smithi016.stdout:5/776: fdatasync d1/d12/d52/f69 0 2024-08-01T06:56:35.149 INFO:tasks.workunit.client.0.smithi016.stdout:0/790: mknod d10/d11/d41/df4/c100 0 2024-08-01T06:56:35.153 INFO:tasks.workunit.client.0.smithi016.stdout:0/791: fsync d10/d11/f42 0 2024-08-01T06:56:35.155 INFO:tasks.workunit.client.0.smithi016.stdout:0/792: mkdir d10/d5c/d90/da0/dbc/d101 0 2024-08-01T06:56:35.161 INFO:tasks.workunit.client.0.smithi016.stdout:0/793: dwrite d10/d11/db4/fed [0,4194304] 0 2024-08-01T06:56:35.163 INFO:tasks.workunit.client.0.smithi016.stdout:0/794: mknod d10/d5c/d90/dbd/c102 0 2024-08-01T06:56:35.166 INFO:tasks.workunit.client.0.smithi016.stdout:5/777: write d1/d12/d3e/fbe [1605822,79711] 0 2024-08-01T06:56:35.168 INFO:tasks.workunit.client.0.smithi016.stdout:0/795: truncate d10/d5c/f75 1341907 0 2024-08-01T06:56:35.174 INFO:tasks.workunit.client.0.smithi016.stdout:0/796: unlink d10/d11/d37/d58/lab 0 2024-08-01T06:56:35.183 INFO:tasks.workunit.client.0.smithi016.stdout:5/778: write d1/d2/d6/d9/d49/d57/f89 [560038,127507] 0 2024-08-01T06:56:35.184 INFO:tasks.workunit.client.0.smithi016.stdout:0/797: getdents d10/d11/d41 0 2024-08-01T06:56:35.187 INFO:tasks.workunit.client.0.smithi016.stdout:5/779: readlink d1/d2/d6/l4c 0 2024-08-01T06:56:35.189 INFO:tasks.workunit.client.0.smithi016.stdout:0/798: unlink d10/d5c/d90/da2/da5/lcc 0 2024-08-01T06:56:35.191 INFO:tasks.workunit.client.0.smithi016.stdout:5/780: mknod d1/d2/d6/d5a/dfc/c10a 0 2024-08-01T06:56:35.192 INFO:tasks.workunit.client.0.smithi016.stdout:5/781: write d1/d2/d23/ff7 [493164,37355] 0 2024-08-01T06:56:35.193 INFO:tasks.workunit.client.0.smithi016.stdout:0/799: read d10/f5a [1654298,88720] 0 2024-08-01T06:56:35.197 INFO:tasks.workunit.client.0.smithi016.stdout:5/782: fdatasync d1/d2/d20/d38/fdb 0 2024-08-01T06:56:35.199 INFO:tasks.workunit.client.0.smithi016.stdout:0/800: mknod d10/d5c/d90/da0/df6/dc7/c103 0 2024-08-01T06:56:35.213 INFO:tasks.workunit.client.0.smithi016.stdout:0/801: write d10/d11/f83 [626012,75208] 0 2024-08-01T06:56:35.220 INFO:tasks.workunit.client.0.smithi016.stdout:5/783: dwrite d1/d2/d6/d9/d1b/fac [0,4194304] 0 2024-08-01T06:56:35.221 INFO:tasks.workunit.client.0.smithi016.stdout:0/802: dwrite d10/d1c/f20 [0,4194304] 0 2024-08-01T06:56:35.230 INFO:tasks.workunit.client.0.smithi016.stdout:5/784: creat d1/d2/d6/d9/d49/d57/f10b x:0 0 0 2024-08-01T06:56:35.233 INFO:tasks.workunit.client.0.smithi016.stdout:0/803: rename d10/d1c/l8e to d10/d5c/d90/da2/da5/de8/deb/l104 0 2024-08-01T06:56:35.236 INFO:tasks.workunit.client.0.smithi016.stdout:5/785: rmdir d1/d2/d6/d9/d1b 39 2024-08-01T06:56:35.238 INFO:tasks.workunit.client.0.smithi016.stdout:5/786: read d1/d2/d20/d38/fdb [407814,49188] 0 2024-08-01T06:56:35.246 INFO:tasks.workunit.client.0.smithi016.stdout:0/804: write d10/f49 [642649,6575] 0 2024-08-01T06:56:35.247 INFO:tasks.workunit.client.0.smithi016.stdout:5/787: dread d1/d2/d6/d9/d49/d57/f64 [0,4194304] 0 2024-08-01T06:56:35.248 INFO:tasks.workunit.client.0.smithi016.stdout:0/805: write d10/d11/d37/f9f [1954860,31709] 0 2024-08-01T06:56:35.249 INFO:tasks.workunit.client.0.smithi016.stdout:5/788: write d1/d2/d6/f6b [227034,60368] 0 2024-08-01T06:56:35.250 INFO:tasks.workunit.client.0.smithi016.stdout:5/789: chown d1/f5 2 1 2024-08-01T06:56:35.252 INFO:tasks.workunit.client.0.smithi016.stdout:0/806: mknod d10/d11/d37/d58/c105 0 2024-08-01T06:56:35.259 INFO:tasks.workunit.client.0.smithi016.stdout:0/807: dwrite d10/d11/db4/fed [0,4194304] 0 2024-08-01T06:56:35.263 INFO:tasks.workunit.client.0.smithi016.stdout:0/808: rename d10/f49 to d10/d11/d37/d82/d9b/f106 0 2024-08-01T06:56:35.267 INFO:tasks.workunit.client.0.smithi016.stdout:0/809: link d10/d11/d37/d82/d9b/ca8 d10/d5c/d90/da0/dbc/c107 0 2024-08-01T06:56:35.271 INFO:tasks.workunit.client.0.smithi016.stdout:0/810: mkdir d10/d5c/d90/da2/da5/de8/deb/dec/d108 0 2024-08-01T06:56:35.273 INFO:tasks.workunit.client.0.smithi016.stdout:5/790: dread d1/d2/d6/d9/f6a [0,4194304] 0 2024-08-01T06:56:35.276 INFO:tasks.workunit.client.0.smithi016.stdout:5/791: mknod d1/c10c 0 2024-08-01T06:56:35.279 INFO:tasks.workunit.client.0.smithi016.stdout:0/811: dwrite d10/d5c/d90/da0/dbc/ff3 [0,4194304] 0 2024-08-01T06:56:35.282 INFO:tasks.workunit.client.0.smithi016.stdout:5/792: link d1/d2/f31 d1/d2/d20/d38/f10d 0 2024-08-01T06:56:35.284 INFO:tasks.workunit.client.0.smithi016.stdout:0/812: creat d10/d11/d37/d50/db1/f109 x:0 0 0 2024-08-01T06:56:35.288 INFO:tasks.workunit.client.0.smithi016.stdout:0/813: dread d10/d11/d37/f9f [0,4194304] 0 2024-08-01T06:56:35.289 INFO:tasks.workunit.client.0.smithi016.stdout:5/793: unlink d1/d2/d6/l99 0 2024-08-01T06:56:35.293 INFO:tasks.workunit.client.0.smithi016.stdout:5/794: dread d1/d2/d6/d9/d49/d57/f89 [0,4194304] 0 2024-08-01T06:56:35.297 INFO:tasks.workunit.client.0.smithi016.stdout:0/814: getdents d10/d5c/d90/da0/dbc/d101 0 2024-08-01T06:56:35.297 INFO:tasks.workunit.client.0.smithi016.stdout:0/815: read - d10/d11/d37/fe3 zero size 2024-08-01T06:56:35.299 INFO:tasks.workunit.client.0.smithi016.stdout:0/816: truncate d10/d11/d37/d82/ffb 314149 0 2024-08-01T06:56:35.300 INFO:tasks.workunit.client.0.smithi016.stdout:0/817: write d10/d11/d41/f60 [2734423,107716] 0 2024-08-01T06:56:35.303 INFO:tasks.workunit.client.0.smithi016.stdout:5/795: getdents d1/d2/d6/d5a/dfc 0 2024-08-01T06:56:35.304 INFO:tasks.workunit.client.0.smithi016.stdout:5/796: read d1/d2/d6/d9/f6a [2855102,91611] 0 2024-08-01T06:56:35.305 INFO:tasks.workunit.client.0.smithi016.stdout:0/818: rename d10/d1c/f4e to d10/d5c/f10a 0 2024-08-01T06:56:35.313 INFO:tasks.workunit.client.0.smithi016.stdout:0/819: write d10/d5c/d90/da2/da5/de8/deb/fee [1854307,27240] 0 2024-08-01T06:56:35.318 INFO:tasks.workunit.client.0.smithi016.stdout:5/797: dread d1/d2/d6/d9/d19/d7a/dc5/dd0/fe5 [0,4194304] 0 2024-08-01T06:56:35.318 INFO:tasks.workunit.client.0.smithi016.stdout:0/820: creat d10/d5c/d90/da2/da5/f10b x:0 0 0 2024-08-01T06:56:35.321 INFO:tasks.workunit.client.0.smithi016.stdout:5/798: creat d1/d2/d6/d9/d19/d7a/f10e x:0 0 0 2024-08-01T06:56:35.322 INFO:tasks.workunit.client.0.smithi016.stdout:0/821: symlink d10/d5c/d90/da0/df6/dc7/l10c 0 2024-08-01T06:56:35.323 INFO:tasks.workunit.client.0.smithi016.stdout:0/822: chown d10/d11/d37/fbe 68216966 1 2024-08-01T06:56:35.324 INFO:tasks.workunit.client.0.smithi016.stdout:0/823: fsync d10/d5c/d90/da2/da5/ff1 0 2024-08-01T06:56:35.325 INFO:tasks.workunit.client.0.smithi016.stdout:0/824: fdatasync d10/d5c/d90/da2/da5/f10b 0 2024-08-01T06:56:35.327 INFO:tasks.workunit.client.0.smithi016.stdout:5/799: symlink d1/d2/d6/d9/d19/l10f 0 2024-08-01T06:56:35.329 INFO:tasks.workunit.client.0.smithi016.stdout:5/800: chown d1/d2/d6/fe1 2348 1 2024-08-01T06:56:35.330 INFO:tasks.workunit.client.0.smithi016.stdout:5/801: truncate d1/d12/f16 5202639 0 2024-08-01T06:56:35.330 INFO:tasks.workunit.client.0.smithi016.stdout:0/825: rename d10/d11/d37/d58/f68 to d10/d1c/f10d 0 2024-08-01T06:56:35.331 INFO:tasks.workunit.client.0.smithi016.stdout:5/802: readlink d1/d12/l51 0 2024-08-01T06:56:35.332 INFO:tasks.workunit.client.0.smithi016.stdout:5/803: write d1/d2/d6/f6b [5154696,55301] 0 2024-08-01T06:56:35.336 INFO:tasks.workunit.client.0.smithi016.stdout:0/826: creat d10/d5c/f10e x:0 0 0 2024-08-01T06:56:35.341 INFO:tasks.workunit.client.0.smithi016.stdout:0/827: chown d10/l23 223043 1 2024-08-01T06:56:35.353 INFO:tasks.workunit.client.0.smithi016.stdout:0/828: truncate d10/f17 1654187 0 2024-08-01T06:56:35.354 INFO:tasks.workunit.client.0.smithi016.stdout:0/829: readlink d10/d1c/l22 0 2024-08-01T06:56:35.355 INFO:tasks.workunit.client.0.smithi016.stdout:0/830: chown d10/d5c/d90/da0/df6/c96 225033827 1 2024-08-01T06:56:35.356 INFO:tasks.workunit.client.0.smithi016.stdout:0/831: chown d10/d11/d37/d58/c76 22975 1 2024-08-01T06:56:35.361 INFO:tasks.workunit.client.0.smithi016.stdout:0/832: getdents d10/d5c/df2 0 2024-08-01T06:56:35.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:34 smithi089 ceph-mon[36617]: pgmap v31: 65 pgs: 65 active+clean; 1.8 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 39 MiB/s rd, 94 MiB/s wr, 270 op/s 2024-08-01T06:56:35.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:34 smithi016 ceph-mon[29266]: pgmap v31: 65 pgs: 65 active+clean; 1.8 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 39 MiB/s rd, 94 MiB/s wr, 270 op/s 2024-08-01T06:56:35.622 INFO:tasks.workunit.client.0.smithi016.stdout:1/894: sync 2024-08-01T06:56:35.622 INFO:tasks.workunit.client.0.smithi016.stdout:2/880: sync 2024-08-01T06:56:35.625 INFO:tasks.workunit.client.0.smithi016.stdout:2/881: symlink d0/d16/d20/l126 0 2024-08-01T06:56:35.629 INFO:tasks.workunit.client.0.smithi016.stdout:1/895: dwrite d2/d3/d41/d49/d51/dc5/d124/f13d [0,4194304] 0 2024-08-01T06:56:35.635 INFO:tasks.workunit.client.0.smithi016.stdout:2/882: dwrite d0/d8/d22/ff3 [0,4194304] 0 2024-08-01T06:56:35.644 INFO:tasks.workunit.client.0.smithi016.stdout:1/896: dwrite d2/d3/d41/d49/d85/dc1/dd8/fdc [0,4194304] 0 2024-08-01T06:56:35.645 INFO:tasks.workunit.client.0.smithi016.stdout:1/897: chown d2/d2f 1199 1 2024-08-01T06:56:35.647 INFO:tasks.workunit.client.0.smithi016.stdout:2/883: dwrite d0/d8/d1b/dfe/d10e/f113 [0,4194304] 0 2024-08-01T06:56:35.651 INFO:tasks.workunit.client.0.smithi016.stdout:2/884: creat d0/d8/d31/d5e/de4/deb/f127 x:0 0 0 2024-08-01T06:56:35.659 INFO:tasks.workunit.client.0.smithi016.stdout:2/885: getdents d0/d8/d31/d111 0 2024-08-01T06:56:35.663 INFO:tasks.workunit.client.0.smithi016.stdout:2/886: symlink d0/d8/d1b/d74/d90/d93/l128 0 2024-08-01T06:56:35.665 INFO:tasks.workunit.client.0.smithi016.stdout:2/887: write d0/d8/d31/d5e/de4/deb/f127 [104758,90391] 0 2024-08-01T06:56:35.666 INFO:tasks.workunit.client.0.smithi016.stdout:1/898: dwrite d2/d2f/d97/d133/fc8 [4194304,4194304] 0 2024-08-01T06:56:35.669 INFO:tasks.workunit.client.0.smithi016.stdout:2/888: mkdir d0/d8/d1b/dd9/dfc/d129 0 2024-08-01T06:56:35.671 INFO:tasks.workunit.client.0.smithi016.stdout:2/889: read d0/d8/d6b/fe8 [386380,87434] 0 2024-08-01T06:56:35.678 INFO:tasks.workunit.client.0.smithi016.stdout:2/890: mknod d0/d8/d1b/dcc/c12a 0 2024-08-01T06:56:35.682 INFO:tasks.workunit.client.0.smithi016.stdout:2/891: fsync d0/d8/d31/d5e/fbb 0 2024-08-01T06:56:35.682 INFO:tasks.workunit.client.0.smithi016.stdout:2/892: fsync d0/d8/d31/da7/fd3 0 2024-08-01T06:56:35.687 INFO:tasks.workunit.client.0.smithi016.stdout:2/893: write d0/d8/d22/f98 [4374067,65309] 0 2024-08-01T06:56:35.690 INFO:tasks.workunit.client.0.smithi016.stdout:2/894: creat d0/d7d/d8b/f12b x:0 0 0 2024-08-01T06:56:35.692 INFO:tasks.workunit.client.0.smithi016.stdout:2/895: mknod d0/d8/d1b/d74/d90/c12c 0 2024-08-01T06:56:35.694 INFO:tasks.workunit.client.0.smithi016.stdout:2/896: chown d0/d8/d1b/dcc/d3b/d45/ccd 163835792 1 2024-08-01T06:56:35.694 INFO:tasks.workunit.client.0.smithi016.stdout:2/897: chown d0/d16/d20/l6f 40767 1 2024-08-01T06:56:35.696 INFO:tasks.workunit.client.0.smithi016.stdout:2/898: mkdir d0/d8/d1b/dd9/dfc/d12d 0 2024-08-01T06:56:35.697 INFO:tasks.workunit.client.0.smithi016.stdout:6/835: sync 2024-08-01T06:56:35.697 INFO:tasks.workunit.client.0.smithi016.stdout:8/597: sync 2024-08-01T06:56:35.698 INFO:tasks.workunit.client.0.smithi016.stdout:2/899: readlink d0/d8/d31/l59 0 2024-08-01T06:56:35.699 INFO:tasks.workunit.client.0.smithi016.stdout:8/598: mknod d5/dc/d3e/cc7 0 2024-08-01T06:56:35.701 INFO:tasks.workunit.client.0.smithi016.stdout:6/836: unlink d1/d41/fb6 0 2024-08-01T06:56:35.703 INFO:tasks.workunit.client.0.smithi016.stdout:6/837: write d1/d8/d1b/d22/d36/d7a/fce [2705023,105465] 0 2024-08-01T06:56:35.703 INFO:tasks.workunit.client.0.smithi016.stdout:8/599: rmdir d5/d8/d75/dba 39 2024-08-01T06:56:35.704 INFO:tasks.workunit.client.0.smithi016.stdout:8/600: read - d5/dc/fbc zero size 2024-08-01T06:56:35.768 INFO:tasks.workunit.client.0.smithi016.stdout:2/900: truncate d0/d8/f52 58970 0 2024-08-01T06:56:35.769 INFO:tasks.workunit.client.0.smithi016.stdout:2/901: chown d0/d8/d31/da7/db4/fec 35330384 1 2024-08-01T06:56:35.773 INFO:tasks.workunit.client.0.smithi016.stdout:8/601: rename d5/d8/d1a/d24/d48/d6e/d92/d99/fa1 to d5/dc/d3e/d72/fc8 0 2024-08-01T06:56:35.774 INFO:tasks.workunit.client.0.smithi016.stdout:6/838: creat d1/d8/d1b/d22/d36/f127 x:0 0 0 2024-08-01T06:56:35.776 INFO:tasks.workunit.client.0.smithi016.stdout:2/902: symlink d0/d8/d1b/d74/d90/d10d/l12e 0 2024-08-01T06:56:35.778 INFO:tasks.workunit.client.0.smithi016.stdout:8/602: getdents d5/d8/d1a/d24/d48/d85/da8 0 2024-08-01T06:56:35.779 INFO:tasks.workunit.client.0.smithi016.stdout:8/603: chown d5/d8/d1a/d24/d48/d6e/d92 25 1 2024-08-01T06:56:35.779 INFO:tasks.workunit.client.0.smithi016.stdout:2/903: creat d0/dc3/f12f x:0 0 0 2024-08-01T06:56:35.781 INFO:tasks.workunit.client.0.smithi016.stdout:6/839: rename d1/d41/f120 to d1/d8/d1b/d22/d71/db1/f128 0 2024-08-01T06:56:35.782 INFO:tasks.workunit.client.0.smithi016.stdout:2/904: readlink d0/d8/d1b/d74/l8e 0 2024-08-01T06:56:35.786 INFO:tasks.workunit.client.0.smithi016.stdout:2/905: creat d0/d7d/d8b/f130 x:0 0 0 2024-08-01T06:56:35.788 INFO:tasks.workunit.client.0.smithi016.stdout:8/604: getdents d5/d8/d1a/d24/d48/d6e/d92 0 2024-08-01T06:56:35.794 INFO:tasks.workunit.client.0.smithi016.stdout:8/605: dwrite d5/d8/d1a/d24/d48/f97 [0,4194304] 0 2024-08-01T06:56:35.797 INFO:tasks.workunit.client.0.smithi016.stdout:8/606: mkdir d5/dc9 0 2024-08-01T06:56:35.803 INFO:tasks.workunit.client.0.smithi016.stdout:6/840: write d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/fcb [821701,108513] 0 2024-08-01T06:56:35.805 INFO:tasks.workunit.client.0.smithi016.stdout:6/841: chown d1/d8/d1b/d22/d36/d7a/dd3/l110 242292 1 2024-08-01T06:56:35.807 INFO:tasks.workunit.client.0.smithi016.stdout:2/906: dread d0/d8/fc0 [0,4194304] 0 2024-08-01T06:56:35.808 INFO:tasks.workunit.client.0.smithi016.stdout:2/907: chown d0 33040 1 2024-08-01T06:56:35.810 INFO:tasks.workunit.client.0.smithi016.stdout:2/908: chown d0/d8/c2b 1 1 2024-08-01T06:56:35.813 INFO:tasks.workunit.client.0.smithi016.stdout:2/909: rename d0/d8/d22/f9b to d0/d7d/d8b/f131 0 2024-08-01T06:56:35.824 INFO:tasks.workunit.client.0.smithi016.stdout:6/842: dwrite d1/d8/d1b/d22/d36/d7a/d99/fef [0,4194304] 0 2024-08-01T06:56:35.826 INFO:tasks.workunit.client.0.smithi016.stdout:2/910: dread d0/d8/d31/d5e/de4/f124 [0,4194304] 0 2024-08-01T06:56:35.827 INFO:tasks.workunit.client.0.smithi016.stdout:6/843: read - d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/f10d zero size 2024-08-01T06:56:35.828 INFO:tasks.workunit.client.0.smithi016.stdout:2/911: symlink d0/d8/d31/dc1/l132 0 2024-08-01T06:56:35.829 INFO:tasks.workunit.client.0.smithi016.stdout:2/912: stat d0/d16/d20/f115 0 2024-08-01T06:56:35.831 INFO:tasks.workunit.client.0.smithi016.stdout:6/844: mknod d1/d8/d1b/db5/d67/d8f/d115/d117/c129 0 2024-08-01T06:56:35.836 INFO:tasks.workunit.client.0.smithi016.stdout:2/913: dwrite d0/d8/d1b/d74/d99/f11a [0,4194304] 0 2024-08-01T06:56:35.838 INFO:tasks.workunit.client.0.smithi016.stdout:2/914: chown d0/d8/d1b/dcc/d3b/d45 820708 1 2024-08-01T06:56:35.845 INFO:tasks.workunit.client.0.smithi016.stdout:2/915: dwrite d0/d7d/d8b/f12b [0,4194304] 0 2024-08-01T06:56:35.889 INFO:tasks.workunit.client.0.smithi016.stdout:7/687: sync 2024-08-01T06:56:35.955 INFO:tasks.workunit.client.0.smithi016.stdout:6/845: creat d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/f12a x:0 0 0 2024-08-01T06:56:35.955 INFO:tasks.workunit.client.0.smithi016.stdout:6/846: chown d1/d8/d94/f103 481890 1 2024-08-01T06:56:35.958 INFO:tasks.workunit.client.0.smithi016.stdout:2/916: stat d0/d8/d31/da7/fbf 0 2024-08-01T06:56:35.969 INFO:tasks.workunit.client.0.smithi016.stdout:7/688: creat d7/db/d17/d72/d1c/d1d/d40/d58/ffd x:0 0 0 2024-08-01T06:56:35.972 INFO:tasks.workunit.client.0.smithi016.stdout:7/689: creat d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/ffe x:0 0 0 2024-08-01T06:56:35.973 INFO:tasks.workunit.client.0.smithi016.stdout:7/690: stat d7/db/d17/d72/d1c/d79/d8f/d39/d71/dd9 0 2024-08-01T06:56:35.975 INFO:tasks.workunit.client.0.smithi016.stdout:6/847: write d1/d8/d1b/d22/d2d/faa [4475182,22328] 0 2024-08-01T06:56:35.980 INFO:tasks.workunit.client.0.smithi016.stdout:2/917: dwrite d0/d8/d1b/dcc/d68/fc6 [4194304,4194304] 0 2024-08-01T06:56:35.983 INFO:tasks.workunit.client.0.smithi016.stdout:6/848: mkdir d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/d12b 0 2024-08-01T06:56:36.004 INFO:tasks.workunit.client.0.smithi016.stdout:6/849: write d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f62 [4738882,107243] 0 2024-08-01T06:56:36.006 INFO:tasks.workunit.client.0.smithi016.stdout:2/918: dread d0/d8/f11 [0,4194304] 0 2024-08-01T06:56:36.008 INFO:tasks.workunit.client.0.smithi016.stdout:2/919: truncate d0/d8/d31/da7/ddf/f109 878188 0 2024-08-01T06:56:36.011 INFO:tasks.workunit.client.0.smithi016.stdout:2/920: mkdir d0/d8/d1b/dd9/dfc/d129/d133 0 2024-08-01T06:56:36.011 INFO:tasks.workunit.client.0.smithi016.stdout:6/850: getdents d1/d8/d1b/d22/d36/d7a/dd3/d3f 0 2024-08-01T06:56:36.013 INFO:tasks.workunit.client.0.smithi016.stdout:2/921: creat d0/d8/d31/d111/f134 x:0 0 0 2024-08-01T06:56:36.014 INFO:tasks.workunit.client.0.smithi016.stdout:2/922: fsync d0/d8/fc0 0 2024-08-01T06:56:36.017 INFO:tasks.workunit.client.0.smithi016.stdout:2/923: creat d0/d8/d1b/dcc/f135 x:0 0 0 2024-08-01T06:56:36.018 INFO:tasks.workunit.client.0.smithi016.stdout:2/924: chown d0/d8/d1b/d74/d90/d93/f4d 199 1 2024-08-01T06:56:36.020 INFO:tasks.workunit.client.0.smithi016.stdout:2/925: truncate d0/d8/d31/dc1/f101 1488012 0 2024-08-01T06:56:36.023 INFO:tasks.workunit.client.0.smithi016.stdout:2/926: rmdir d0/d8/d1b/d74/d90/d10d 39 2024-08-01T06:56:36.188 INFO:tasks.workunit.client.0.smithi016.stdout:3/636: sync 2024-08-01T06:56:36.188 INFO:tasks.workunit.client.0.smithi016.stdout:4/742: sync 2024-08-01T06:56:36.203 INFO:tasks.workunit.client.0.smithi016.stdout:3/637: write d9/da/df/d12/f25 [3793354,20900] 0 2024-08-01T06:56:36.203 INFO:tasks.workunit.client.0.smithi016.stdout:4/743: dread d0/db9/fdf [0,4194304] 0 2024-08-01T06:56:36.205 INFO:tasks.workunit.client.0.smithi016.stdout:3/638: readlink d9/d3e/d40/d58/d59/la2 0 2024-08-01T06:56:36.209 INFO:tasks.workunit.client.0.smithi016.stdout:3/639: creat d9/da/df/d12/fda x:0 0 0 2024-08-01T06:56:36.222 INFO:tasks.workunit.client.0.smithi016.stdout:3/640: write d9/da/df/d2a/d49/d61/dc5/fcc [971799,19614] 0 2024-08-01T06:56:36.223 INFO:tasks.workunit.client.0.smithi016.stdout:3/641: dread - d9/d4e/d72/fd1 zero size 2024-08-01T06:56:36.225 INFO:tasks.workunit.client.0.smithi016.stdout:3/642: creat d9/da/df/d53/fdb x:0 0 0 2024-08-01T06:56:36.227 INFO:tasks.workunit.client.0.smithi016.stdout:3/643: truncate d9/da/df/d2a/d49/f62 3806449 0 2024-08-01T06:56:36.231 INFO:tasks.workunit.client.0.smithi016.stdout:3/644: creat d9/da/df/d12/d75/db4/fdc x:0 0 0 2024-08-01T06:56:36.235 INFO:tasks.workunit.client.0.smithi016.stdout:3/645: rename d9/da/l5b to d9/d3e/ldd 0 2024-08-01T06:56:36.238 INFO:tasks.workunit.client.0.smithi016.stdout:3/646: creat d9/da/df/d2a/d49/db5/fde x:0 0 0 2024-08-01T06:56:36.240 INFO:tasks.workunit.client.0.smithi016.stdout:3/647: symlink d9/d4e/d81/ldf 0 2024-08-01T06:56:36.243 INFO:tasks.workunit.client.0.smithi016.stdout:3/648: creat d9/da/fe0 x:0 0 0 2024-08-01T06:56:36.249 INFO:tasks.workunit.client.0.smithi016.stdout:3/649: dwrite d9/da/df/d12/f42 [0,4194304] 0 2024-08-01T06:56:36.258 INFO:tasks.workunit.client.0.smithi016.stdout:3/650: getdents d9/d4e/d81 0 2024-08-01T06:56:36.258 INFO:tasks.workunit.client.0.smithi016.stdout:9/793: sync 2024-08-01T06:56:36.266 INFO:tasks.workunit.client.0.smithi016.stdout:9/794: truncate d3/d9/db/d3e/fc5 1780134 0 2024-08-01T06:56:36.268 INFO:tasks.workunit.client.0.smithi016.stdout:9/795: chown d3/d9/df/d2a/f3b 0 1 2024-08-01T06:56:36.269 INFO:tasks.workunit.client.0.smithi016.stdout:3/651: dwrite d9/da/d96/f9e [0,4194304] 0 2024-08-01T06:56:36.279 INFO:tasks.workunit.client.0.smithi016.stdout:9/796: write d3/d9/db/dc/d33/f54 [495757,86683] 0 2024-08-01T06:56:36.284 INFO:tasks.workunit.client.0.smithi016.stdout:9/797: mkdir d3/d9/d46/d103 0 2024-08-01T06:56:36.287 INFO:tasks.workunit.client.0.smithi016.stdout:9/798: write d3/d9/df/d2a/f41 [2056044,43834] 0 2024-08-01T06:56:36.288 INFO:tasks.workunit.client.0.smithi016.stdout:3/652: dwrite d9/d4e/f64 [0,4194304] 0 2024-08-01T06:56:36.290 INFO:tasks.workunit.client.0.smithi016.stdout:3/653: write d9/da/df/d2a/f77 [2604054,124087] 0 2024-08-01T06:56:36.308 INFO:tasks.workunit.client.0.smithi016.stdout:9/799: dread d3/d9/df/d16/f2b [0,4194304] 0 2024-08-01T06:56:36.308 INFO:tasks.workunit.client.0.smithi016.stdout:3/654: write d9/da/df/d2a/d49/db5/fcf [2167807,77440] 0 2024-08-01T06:56:36.311 INFO:tasks.workunit.client.0.smithi016.stdout:3/655: mkdir d9/da/d18/de1 0 2024-08-01T06:56:36.311 INFO:tasks.workunit.client.0.smithi016.stdout:9/800: getdents d3/d9/d73/dfb 0 2024-08-01T06:56:36.312 INFO:tasks.workunit.client.0.smithi016.stdout:3/656: write d9/fd [3397404,84048] 0 2024-08-01T06:56:36.314 INFO:tasks.workunit.client.0.smithi016.stdout:3/657: dread - d9/d1c/f6f zero size 2024-08-01T06:56:36.315 INFO:tasks.workunit.client.0.smithi016.stdout:9/801: mkdir d3/d9/d46/dea/d104 0 2024-08-01T06:56:36.315 INFO:tasks.workunit.client.0.smithi016.stdout:3/658: chown d9/d57/f74 7114 1 2024-08-01T06:56:36.316 INFO:tasks.workunit.client.0.smithi016.stdout:9/802: chown d3/d9/db/laa 347925778 1 2024-08-01T06:56:36.425 INFO:tasks.workunit.client.0.smithi016.stdout:3/659: mknod d9/da/df/d12/d20/d5c/ce2 0 2024-08-01T06:56:36.480 INFO:tasks.workunit.client.0.smithi016.stdout:5/804: sync 2024-08-01T06:56:36.483 INFO:tasks.workunit.client.0.smithi016.stdout:3/660: truncate d9/da/df/d12/d75/db4/fdc 314799 0 2024-08-01T06:56:36.483 INFO:tasks.workunit.client.0.smithi016.stdout:9/803: dread - d3/d9/df/d16/fcd zero size 2024-08-01T06:56:36.486 INFO:tasks.workunit.client.0.smithi016.stdout:9/804: unlink d3/d9/d46/d48/fe4 0 2024-08-01T06:56:36.495 INFO:tasks.workunit.client.0.smithi016.stdout:5/805: getdents d1/d2/d6/d9/d19/d7a 0 2024-08-01T06:56:36.500 INFO:tasks.workunit.client.0.smithi016.stdout:3/661: write d9/da/df/d12/d20/f4c [3591096,68972] 0 2024-08-01T06:56:36.506 INFO:tasks.workunit.client.0.smithi016.stdout:5/806: getdents d1/d2/d23 0 2024-08-01T06:56:36.508 INFO:tasks.workunit.client.0.smithi016.stdout:3/662: mknod d9/da/d18/de1/ce3 0 2024-08-01T06:56:36.508 INFO:tasks.workunit.client.0.smithi016.stdout:3/663: dread - d9/da/d96/dc3/fd2 zero size 2024-08-01T06:56:36.509 INFO:tasks.workunit.client.0.smithi016.stdout:5/807: rename d1/d12/d3e to d1/d2/d6/d9/d49/d57/d110 0 2024-08-01T06:56:36.511 INFO:tasks.workunit.client.0.smithi016.stdout:3/664: creat d9/d4e/d72/fe4 x:0 0 0 2024-08-01T06:56:36.513 INFO:tasks.workunit.client.0.smithi016.stdout:5/808: rename d1/d2/d20/db8/cb9 to d1/d2/d6/d9/d49/d57/c111 0 2024-08-01T06:56:36.518 INFO:tasks.workunit.client.0.smithi016.stdout:3/665: rename d9/da/df/d12/faa to d9/da/df/d2a/d49/d61/fe5 0 2024-08-01T06:56:36.518 INFO:tasks.workunit.client.0.smithi016.stdout:5/809: creat d1/d12/d7d/db3/f112 x:0 0 0 2024-08-01T06:56:36.518 INFO:tasks.workunit.client.0.smithi016.stdout:3/666: mknod d9/da/d18/de1/ce6 0 2024-08-01T06:56:36.521 INFO:tasks.workunit.client.0.smithi016.stdout:3/667: symlink d9/da/df/d12/da0/da5/le7 0 2024-08-01T06:56:36.522 INFO:tasks.workunit.client.0.smithi016.stdout:3/668: write d9/da/df/d2a/d49/db5/fde [325118,31512] 0 2024-08-01T06:56:36.528 INFO:tasks.workunit.client.0.smithi016.stdout:3/669: creat d9/da/df/d2a/fe8 x:0 0 0 2024-08-01T06:56:36.533 INFO:tasks.workunit.client.0.smithi016.stdout:3/670: symlink d9/da/df/d12/d20/d5c/le9 0 2024-08-01T06:56:36.533 INFO:tasks.workunit.client.0.smithi016.stdout:5/810: write d1/d2/d20/d38/fdb [872474,89721] 0 2024-08-01T06:56:36.534 INFO:tasks.workunit.client.0.smithi016.stdout:5/811: readlink d1/d12/d7d/db3/lfd 0 2024-08-01T06:56:36.536 INFO:tasks.workunit.client.0.smithi016.stdout:5/812: truncate d1/d2/d23/feb 751953 0 2024-08-01T06:56:36.537 INFO:tasks.workunit.client.0.smithi016.stdout:5/813: read d1/d12/f16 [1675096,24990] 0 2024-08-01T06:56:36.538 INFO:tasks.workunit.client.0.smithi016.stdout:3/671: creat d9/da/df/d2a/d49/db5/fea x:0 0 0 2024-08-01T06:56:36.541 INFO:tasks.workunit.client.0.smithi016.stdout:3/672: creat d9/d57/d66/feb x:0 0 0 2024-08-01T06:56:36.543 INFO:tasks.workunit.client.0.smithi016.stdout:3/673: creat d9/d3e/d80/fec x:0 0 0 2024-08-01T06:56:36.544 INFO:tasks.workunit.client.0.smithi016.stdout:5/814: getdents d1/d2/d6/d9/d49 0 2024-08-01T06:56:36.547 INFO:tasks.workunit.client.0.smithi016.stdout:5/815: creat d1/d2/d6/f113 x:0 0 0 2024-08-01T06:56:36.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:36 smithi089 ceph-mon[36617]: pgmap v32: 65 pgs: 65 active+clean; 1.7 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 50 MiB/s rd, 134 MiB/s wr, 383 op/s 2024-08-01T06:56:36.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:36 smithi016 ceph-mon[29266]: pgmap v32: 65 pgs: 65 active+clean; 1.7 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 50 MiB/s rd, 134 MiB/s wr, 383 op/s 2024-08-01T06:56:36.664 INFO:tasks.workunit.client.0.smithi016.stdout:0/833: sync 2024-08-01T06:56:36.687 INFO:tasks.workunit.client.0.smithi016.stdout:0/834: rmdir d10/d5c/d90/da2/da5/de8/deb 39 2024-08-01T06:56:36.687 INFO:tasks.workunit.client.0.smithi016.stdout:5/816: symlink d1/d2/d6/d9/d1b/l114 0 2024-08-01T06:56:36.689 INFO:tasks.workunit.client.0.smithi016.stdout:0/835: write d10/d1c/f10d [3472973,6989] 0 2024-08-01T06:56:36.689 INFO:tasks.workunit.client.0.smithi016.stdout:5/817: fsync d1/d2/d6/d9/d49/d57/f64 0 2024-08-01T06:56:36.691 INFO:tasks.workunit.client.0.smithi016.stdout:5/818: fdatasync d1/d2/d6/d9/d19/dd3/fe0 0 2024-08-01T06:56:36.694 INFO:tasks.workunit.client.0.smithi016.stdout:0/836: mkdir d10/d5c/d90/da0/df6/dc7/d10f 0 2024-08-01T06:56:36.699 INFO:tasks.workunit.client.0.smithi016.stdout:0/837: mkdir d10/d5c/d90/da2/d110 0 2024-08-01T06:56:36.705 INFO:tasks.workunit.client.0.smithi016.stdout:0/838: rename d10/d11/l38 to d10/d11/d41/df4/l111 0 2024-08-01T06:56:36.705 INFO:tasks.workunit.client.0.smithi016.stdout:5/819: write d1/d2/d6/d9/d49/d57/fb7 [3539222,65193] 0 2024-08-01T06:56:36.712 INFO:tasks.workunit.client.0.smithi016.stdout:0/839: dwrite d10/d11/f3d [0,4194304] 0 2024-08-01T06:56:36.713 INFO:tasks.workunit.client.0.smithi016.stdout:5/820: dwrite d1/d2/d6/d9/d49/d57/db1/fcc [0,4194304] 0 2024-08-01T06:56:36.718 INFO:tasks.workunit.client.0.smithi016.stdout:5/821: creat d1/d2/d6/d9/d19/dd3/f115 x:0 0 0 2024-08-01T06:56:36.722 INFO:tasks.workunit.client.0.smithi016.stdout:0/840: mkdir d10/d5c/d90/da2/da5/de8/d112 0 2024-08-01T06:56:36.728 INFO:tasks.workunit.client.0.smithi016.stdout:0/841: dwrite d10/d11/db4/fed [0,4194304] 0 2024-08-01T06:56:36.732 INFO:tasks.workunit.client.0.smithi016.stdout:0/842: symlink d10/d5c/d90/da0/df6/dc7/l113 0 2024-08-01T06:56:36.732 INFO:tasks.workunit.client.0.smithi016.stdout:0/843: dread - d10/d11/d41/d95/fd6 zero size 2024-08-01T06:56:36.736 INFO:tasks.workunit.client.0.smithi016.stdout:0/844: creat d10/d11/d41/d95/f114 x:0 0 0 2024-08-01T06:56:36.743 INFO:tasks.workunit.client.0.smithi016.stdout:5/822: dwrite d1/d2/d6/d9/d1b/f1f [0,4194304] 0 2024-08-01T06:56:36.744 INFO:tasks.workunit.client.0.smithi016.stdout:0/845: link d10/d11/d41/d95/lc0 d10/d5c/df2/l115 0 2024-08-01T06:56:36.748 INFO:tasks.workunit.client.0.smithi016.stdout:5/823: creat d1/d2/d20/d72/f116 x:0 0 0 2024-08-01T06:56:36.753 INFO:tasks.workunit.client.0.smithi016.stdout:0/846: dwrite d10/d11/d37/fef [0,4194304] 0 2024-08-01T06:56:36.774 INFO:tasks.workunit.client.0.smithi016.stdout:5/824: dwrite d1/d2/d23/dbb/fbc [0,4194304] 0 2024-08-01T06:56:36.778 INFO:tasks.workunit.client.0.smithi016.stdout:5/825: dread - d1/d2/d6/d9/d1b/dda/df0/f109 zero size 2024-08-01T06:56:36.778 INFO:tasks.workunit.client.0.smithi016.stdout:0/847: dwrite d10/d11/d41/d95/ffe [0,4194304] 0 2024-08-01T06:56:36.780 INFO:tasks.workunit.client.0.smithi016.stdout:0/848: read - d10/d11/d37/fe3 zero size 2024-08-01T06:56:36.781 INFO:tasks.workunit.client.0.smithi016.stdout:0/849: chown d10/d11/c56 62740583 1 2024-08-01T06:56:36.784 INFO:tasks.workunit.client.0.smithi016.stdout:5/826: fsync d1/d12/d52/fa6 0 2024-08-01T06:56:36.788 INFO:tasks.workunit.client.0.smithi016.stdout:0/850: creat d10/d5c/d90/da0/dbc/d101/f116 x:0 0 0 2024-08-01T06:56:36.789 INFO:tasks.workunit.client.0.smithi016.stdout:2/927: sync 2024-08-01T06:56:36.789 INFO:tasks.workunit.client.0.smithi016.stdout:9/805: sync 2024-08-01T06:56:36.789 INFO:tasks.workunit.client.0.smithi016.stdout:6/851: sync 2024-08-01T06:56:36.789 INFO:tasks.workunit.client.0.smithi016.stdout:7/691: sync 2024-08-01T06:56:36.789 INFO:tasks.workunit.client.0.smithi016.stdout:1/899: sync 2024-08-01T06:56:36.789 INFO:tasks.workunit.client.0.smithi016.stdout:8/607: sync 2024-08-01T06:56:36.789 INFO:tasks.workunit.client.0.smithi016.stdout:3/674: sync 2024-08-01T06:56:36.789 INFO:tasks.workunit.client.0.smithi016.stdout:4/744: sync 2024-08-01T06:56:36.790 INFO:tasks.workunit.client.0.smithi016.stdout:5/827: creat d1/d2/d6/d9/d49/d57/db1/f117 x:0 0 0 2024-08-01T06:56:36.791 INFO:tasks.workunit.client.0.smithi016.stdout:6/852: chown d1/d8/d1b/df6 11957 1 2024-08-01T06:56:36.792 INFO:tasks.workunit.client.0.smithi016.stdout:0/851: fdatasync d10/fe7 0 2024-08-01T06:56:36.792 INFO:tasks.workunit.client.0.smithi016.stdout:9/806: stat d3/de/f18 0 2024-08-01T06:56:36.795 INFO:tasks.workunit.client.0.smithi016.stdout:2/928: rmdir d0/d8/d1b/dcc 39 2024-08-01T06:56:36.799 INFO:tasks.workunit.client.0.smithi016.stdout:4/745: creat d0/d2/da0/dd2/ffc x:0 0 0 2024-08-01T06:56:36.800 INFO:tasks.workunit.client.0.smithi016.stdout:4/746: chown d0/d2/dc/d12/dd3/d22/f6b 137408 1 2024-08-01T06:56:36.800 INFO:tasks.workunit.client.0.smithi016.stdout:5/828: symlink d1/d2/d20/d72/l118 0 2024-08-01T06:56:36.803 INFO:tasks.workunit.client.0.smithi016.stdout:0/852: dread d10/d1c/d7c/f8f [0,4194304] 0 2024-08-01T06:56:36.806 INFO:tasks.workunit.client.0.smithi016.stdout:9/807: unlink d3/d9/db/f100 0 2024-08-01T06:56:36.812 INFO:tasks.workunit.client.0.smithi016.stdout:8/608: dwrite d5/f61 [0,4194304] 0 2024-08-01T06:56:36.813 INFO:tasks.workunit.client.0.smithi016.stdout:1/900: rename d2/de/dc4/f13f to d2/d2f/d97/f140 0 2024-08-01T06:56:36.819 INFO:tasks.workunit.client.0.smithi016.stdout:2/929: fdatasync d0/d8/d1b/fb1 0 2024-08-01T06:56:36.821 INFO:tasks.workunit.client.0.smithi016.stdout:2/930: dread d0/d8/d31/da7/fbf [0,4194304] 0 2024-08-01T06:56:36.825 INFO:tasks.workunit.client.0.smithi016.stdout:6/853: write d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/f7b [1814028,72728] 0 2024-08-01T06:56:36.827 INFO:tasks.workunit.client.0.smithi016.stdout:9/808: read d3/f65 [3382889,115399] 0 2024-08-01T06:56:36.830 INFO:tasks.workunit.client.0.smithi016.stdout:9/809: read d3/d9/df/d16/f1e [8289272,60377] 0 2024-08-01T06:56:36.834 INFO:tasks.workunit.client.0.smithi016.stdout:6/854: dwrite d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f62 [0,4194304] 0 2024-08-01T06:56:36.836 INFO:tasks.workunit.client.0.smithi016.stdout:1/901: rmdir d2/d3 39 2024-08-01T06:56:36.844 INFO:tasks.workunit.client.0.smithi016.stdout:0/853: dwrite d10/f5a [0,4194304] 0 2024-08-01T06:56:36.846 INFO:tasks.workunit.client.0.smithi016.stdout:8/609: write d5/d8/f68 [2496369,115823] 0 2024-08-01T06:56:36.846 INFO:tasks.workunit.client.0.smithi016.stdout:4/747: fdatasync d0/d2/dc/f34 0 2024-08-01T06:56:36.846 INFO:tasks.workunit.client.0.smithi016.stdout:2/931: dread d0/d8/f26 [0,4194304] 0 2024-08-01T06:56:36.848 INFO:tasks.workunit.client.0.smithi016.stdout:7/692: creat d7/db/d17/d72/d1c/d97/fff x:0 0 0 2024-08-01T06:56:36.850 INFO:tasks.workunit.client.0.smithi016.stdout:4/748: dread - d0/d2/dc/d12/dd3/d22/d26/d8b/feb zero size 2024-08-01T06:56:36.853 INFO:tasks.workunit.client.0.smithi016.stdout:6/855: mkdir d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d12c 0 2024-08-01T06:56:36.853 INFO:tasks.workunit.client.0.smithi016.stdout:3/675: getdents d9/da/df/d12/d75/dc7 0 2024-08-01T06:56:36.857 INFO:tasks.workunit.client.0.smithi016.stdout:0/854: stat d10/d11/d37/d58/l74 0 2024-08-01T06:56:36.857 INFO:tasks.workunit.client.0.smithi016.stdout:8/610: unlink d5/d8/d1a/d24/d8c/fa4 0 2024-08-01T06:56:36.858 INFO:tasks.workunit.client.0.smithi016.stdout:9/810: mknod d3/d9/d46/d103/c105 0 2024-08-01T06:56:36.860 INFO:tasks.workunit.client.0.smithi016.stdout:5/829: rename d1/d2/d6/d9/d19/d7a/dc5/dd0/fe5 to d1/d2/d20/f119 0 2024-08-01T06:56:36.860 INFO:tasks.workunit.client.0.smithi016.stdout:9/811: write d3/d9/df/d16/d94/da5/fff [336272,49747] 0 2024-08-01T06:56:36.861 INFO:tasks.workunit.client.0.smithi016.stdout:1/902: symlink d2/d3/d1c/de1/l141 0 2024-08-01T06:56:36.862 INFO:tasks.workunit.client.0.smithi016.stdout:5/830: stat d1/d2/d6/d9/d19/d7a/f103 0 2024-08-01T06:56:36.865 INFO:tasks.workunit.client.0.smithi016.stdout:2/932: creat d0/d8/d1b/dfe/f136 x:0 0 0 2024-08-01T06:56:36.865 INFO:tasks.workunit.client.0.smithi016.stdout:4/749: fsync d0/d2/dc/d12/dd3/d22/fb0 0 2024-08-01T06:56:36.871 INFO:tasks.workunit.client.0.smithi016.stdout:6/856: dread d1/d8/d1b/d22/d71/fac [0,4194304] 0 2024-08-01T06:56:36.875 INFO:tasks.workunit.client.0.smithi016.stdout:5/831: creat d1/d2/d6/d9/d19/d7a/f11a x:0 0 0 2024-08-01T06:56:36.879 INFO:tasks.workunit.client.0.smithi016.stdout:2/933: creat d0/d8/d1b/d74/d99/d104/f137 x:0 0 0 2024-08-01T06:56:36.880 INFO:tasks.workunit.client.0.smithi016.stdout:3/676: dread d9/da/df/d12/f25 [0,4194304] 0 2024-08-01T06:56:36.880 INFO:tasks.workunit.client.0.smithi016.stdout:2/934: chown d0/d8/d31/dc1/de7/lbe 3729 1 2024-08-01T06:56:36.881 INFO:tasks.workunit.client.0.smithi016.stdout:4/750: creat d0/d2/dc/d12/dd3/d22/d26/d8b/ffd x:0 0 0 2024-08-01T06:56:36.885 INFO:tasks.workunit.client.0.smithi016.stdout:8/611: symlink d5/d8/dc0/lca 0 2024-08-01T06:56:36.887 INFO:tasks.workunit.client.0.smithi016.stdout:9/812: write d3/d32/d5c/d8a/fe5 [926446,125914] 0 2024-08-01T06:56:36.889 INFO:tasks.workunit.client.0.smithi016.stdout:7/693: dwrite d7/db/d17/d72/d1c/d1d/d40/d58/d80/fad [4194304,4194304] 0 2024-08-01T06:56:36.892 INFO:tasks.workunit.client.0.smithi016.stdout:6/857: write d1/d8/d1b/db5/d67/d8f/dba/fe8 [981761,82309] 0 2024-08-01T06:56:36.895 INFO:tasks.workunit.client.0.smithi016.stdout:6/858: truncate d1/d8/d94/f105 1736854 0 2024-08-01T06:56:36.895 INFO:tasks.workunit.client.0.smithi016.stdout:5/832: creat d1/d2/d6/d5a/d65/f11b x:0 0 0 2024-08-01T06:56:36.897 INFO:tasks.workunit.client.0.smithi016.stdout:7/694: dread d7/db/d17/d72/d1c/d79/f7e [0,4194304] 0 2024-08-01T06:56:36.898 INFO:tasks.workunit.client.0.smithi016.stdout:3/677: mkdir d9/da/d96/dc3/ded 0 2024-08-01T06:56:36.900 INFO:tasks.workunit.client.0.smithi016.stdout:2/935: creat d0/d8/d31/dc7/f138 x:0 0 0 2024-08-01T06:56:36.902 INFO:tasks.workunit.client.0.smithi016.stdout:0/855: dwrite fd [0,4194304] 0 2024-08-01T06:56:36.907 INFO:tasks.workunit.client.0.smithi016.stdout:9/813: unlink d3/d9/db/dc/d33/f54 0 2024-08-01T06:56:36.915 INFO:tasks.workunit.client.0.smithi016.stdout:1/903: dwrite d2/de/d4d/d92/d10f/d137/d3e/f8f [0,4194304] 0 2024-08-01T06:56:36.918 INFO:tasks.workunit.client.0.smithi016.stdout:4/751: dwrite d0/d2/dc/d12/dd3/f9c [0,4194304] 0 2024-08-01T06:56:36.933 INFO:tasks.workunit.client.0.smithi016.stdout:9/814: dread d3/d9/db/d3e/d40/f4b [4194304,4194304] 0 2024-08-01T06:56:36.933 INFO:tasks.workunit.client.0.smithi016.stdout:6/859: mknod d1/d8/d1b/d22/d36/d7a/d99/c12d 0 2024-08-01T06:56:36.935 INFO:tasks.workunit.client.0.smithi016.stdout:8/612: write d5/d8/d1a/d24/d48/f7c [3165246,90144] 0 2024-08-01T06:56:36.938 INFO:tasks.workunit.client.0.smithi016.stdout:0/856: symlink d10/d11/d41/df4/l117 0 2024-08-01T06:56:36.944 INFO:tasks.workunit.client.0.smithi016.stdout:5/833: write d1/fba [766354,18226] 0 2024-08-01T06:56:36.945 INFO:tasks.workunit.client.0.smithi016.stdout:9/815: truncate d3/d9/db/dc/f27 157614 0 2024-08-01T06:56:36.951 INFO:tasks.workunit.client.0.smithi016.stdout:0/857: creat d10/d11/d37/d53/f118 x:0 0 0 2024-08-01T06:56:36.951 INFO:tasks.workunit.client.0.smithi016.stdout:2/936: dwrite d0/d8/d1b/dcc/f46 [4194304,4194304] 0 2024-08-01T06:56:36.954 INFO:tasks.workunit.client.0.smithi016.stdout:2/937: fsync d0/d8/fc0 0 2024-08-01T06:56:36.955 INFO:tasks.workunit.client.0.smithi016.stdout:9/816: fdatasync d3/de/dd7/fe3 0 2024-08-01T06:56:36.957 INFO:tasks.workunit.client.0.smithi016.stdout:5/834: dread d1/d12/d52/f69 [0,4194304] 0 2024-08-01T06:56:36.957 INFO:tasks.workunit.client.0.smithi016.stdout:3/678: write d9/da/df/d12/d20/d3c/f4b [6176095,38382] 0 2024-08-01T06:56:36.958 INFO:tasks.workunit.client.0.smithi016.stdout:4/752: creat d0/d2/dc/d12/dd3/d22/ffe x:0 0 0 2024-08-01T06:56:36.959 INFO:tasks.workunit.client.0.smithi016.stdout:0/858: mkdir d10/d5c/d90/da0/df6/d119 0 2024-08-01T06:56:36.959 INFO:tasks.workunit.client.0.smithi016.stdout:2/938: chown d0/d8/d22/ff3 306117 1 2024-08-01T06:56:36.960 INFO:tasks.workunit.client.0.smithi016.stdout:9/817: chown d3/f28 193323 1 2024-08-01T06:56:36.961 INFO:tasks.workunit.client.0.smithi016.stdout:5/835: stat d1/d2/d23/dbb 0 2024-08-01T06:56:36.961 INFO:tasks.workunit.client.0.smithi016.stdout:3/679: dread - d9/d1c/f6f zero size 2024-08-01T06:56:36.962 INFO:tasks.workunit.client.0.smithi016.stdout:7/695: dwrite d7/db/d17/d72/d1c/fbf [0,4194304] 0 2024-08-01T06:56:36.965 INFO:tasks.workunit.client.0.smithi016.stdout:2/939: fsync d0/d8/d31/dc7/ffd 0 2024-08-01T06:56:36.970 INFO:tasks.workunit.client.0.smithi016.stdout:9/818: mkdir d3/d9/db/d3e/d106 0 2024-08-01T06:56:36.971 INFO:tasks.workunit.client.0.smithi016.stdout:6/860: write d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/da2/fb7 [1252720,19095] 0 2024-08-01T06:56:36.979 INFO:tasks.workunit.client.0.smithi016.stdout:7/696: mknod d7/db/d17/d72/d1e/d26/c100 0 2024-08-01T06:56:36.982 INFO:tasks.workunit.client.0.smithi016.stdout:8/613: write d5/d8/d1a/d24/d48/d60/d63/f71 [2806191,131026] 0 2024-08-01T06:56:36.985 INFO:tasks.workunit.client.0.smithi016.stdout:1/904: dwrite d2/d3/d41/d49/f99 [0,4194304] 0 2024-08-01T06:56:36.986 INFO:tasks.workunit.client.0.smithi016.stdout:6/861: read d1/d8/d1b/d22/d2d/f9a [185454,96069] 0 2024-08-01T06:56:36.989 INFO:tasks.workunit.client.0.smithi016.stdout:0/859: dwrite d10/d11/d37/d50/db1/f109 [0,4194304] 0 2024-08-01T06:56:36.992 INFO:tasks.workunit.client.0.smithi016.stdout:4/753: dwrite d0/d2/dc/d12/dd3/d22/d26/d8b/faf [0,4194304] 0 2024-08-01T06:56:36.992 INFO:tasks.workunit.client.0.smithi016.stdout:5/836: dread d1/d2/d6/d9/d49/d57/f82 [0,4194304] 0 2024-08-01T06:56:36.995 INFO:tasks.workunit.client.0.smithi016.stdout:1/905: fdatasync d2/f2a 0 2024-08-01T06:56:36.996 INFO:tasks.workunit.client.0.smithi016.stdout:2/940: rename d0/d8/d1b/dcc/ce3 to d0/d8/d31/dc7/c139 0 2024-08-01T06:56:36.996 INFO:tasks.workunit.client.0.smithi016.stdout:3/680: dwrite d9/da/df/d2a/d49/f60 [0,4194304] 0 2024-08-01T06:56:36.997 INFO:tasks.workunit.client.0.smithi016.stdout:5/837: chown d1/d2/d6/d9/d1b/dda 164254 1 2024-08-01T06:56:37.000 INFO:tasks.workunit.client.0.smithi016.stdout:2/941: readlink d0/d8/d1b/d74/l8e 0 2024-08-01T06:56:37.014 INFO:tasks.workunit.client.0.smithi016.stdout:6/862: dread d1/d41/f82 [0,4194304] 0 2024-08-01T06:56:37.015 INFO:tasks.workunit.client.0.smithi016.stdout:9/819: dread d3/de/f7a [4194304,4194304] 0 2024-08-01T06:56:37.017 INFO:tasks.workunit.client.0.smithi016.stdout:3/681: creat d9/da/df/d12/da0/fee x:0 0 0 2024-08-01T06:56:37.022 INFO:tasks.workunit.client.0.smithi016.stdout:2/942: dwrite d0/d8/d31/dc7/f138 [0,4194304] 0 2024-08-01T06:56:37.022 INFO:tasks.workunit.client.0.smithi016.stdout:8/614: getdents d5/dc9 0 2024-08-01T06:56:37.022 INFO:tasks.workunit.client.0.smithi016.stdout:7/697: dwrite d7/db/d17/d72/d1c/d97/fff [0,4194304] 0 2024-08-01T06:56:37.023 INFO:tasks.workunit.client.0.smithi016.stdout:5/838: dwrite d1/d2/d6/d9/d49/d57/f10b [0,4194304] 0 2024-08-01T06:56:37.024 INFO:tasks.workunit.client.0.smithi016.stdout:9/820: chown d3/d32/d5c/l9c 120762826 1 2024-08-01T06:56:37.024 INFO:tasks.workunit.client.0.smithi016.stdout:2/943: chown d0 121 1 2024-08-01T06:56:37.036 INFO:tasks.workunit.client.0.smithi016.stdout:8/615: read d5/d8/d1a/d24/d48/d60/d63/f71 [2155292,98236] 0 2024-08-01T06:56:37.036 INFO:tasks.workunit.client.0.smithi016.stdout:3/682: unlink d9/d3e/d80/l8f 0 2024-08-01T06:56:37.038 INFO:tasks.workunit.client.0.smithi016.stdout:8/616: chown d5/l6c 710904 1 2024-08-01T06:56:37.038 INFO:tasks.workunit.client.0.smithi016.stdout:1/906: link d2/d3/d41/f47 d2/de/d4d/d92/d10f/d137/d3e/f142 0 2024-08-01T06:56:37.040 INFO:tasks.workunit.client.0.smithi016.stdout:0/860: dread d10/d11/f64 [8388608,4194304] 0 2024-08-01T06:56:37.041 INFO:tasks.workunit.client.0.smithi016.stdout:7/698: unlink d7/ld 0 2024-08-01T06:56:37.046 INFO:tasks.workunit.client.0.smithi016.stdout:4/754: rename d0/d2/dc/d90/cdc to d0/d2/dc/d12/dd3/d22/d26/d85/dc1/cff 0 2024-08-01T06:56:37.047 INFO:tasks.workunit.client.0.smithi016.stdout:4/755: dread - d0/d2/dcd/ff5 zero size 2024-08-01T06:56:37.048 INFO:tasks.workunit.client.0.smithi016.stdout:5/839: symlink d1/d12/l11c 0 2024-08-01T06:56:37.049 INFO:tasks.workunit.client.0.smithi016.stdout:8/617: mkdir d5/d8/d1a/da9/db6/dcb 0 2024-08-01T06:56:37.050 INFO:tasks.workunit.client.0.smithi016.stdout:5/840: read d1/d2/d20/d72/f94 [53664,20092] 0 2024-08-01T06:56:37.052 INFO:tasks.workunit.client.0.smithi016.stdout:0/861: mknod d10/d11/d37/d58/c11a 0 2024-08-01T06:56:37.056 INFO:tasks.workunit.client.0.smithi016.stdout:7/699: symlink d7/db/d17/d72/d1c/d1d/d40/d58/da3/l101 0 2024-08-01T06:56:37.061 INFO:tasks.workunit.client.0.smithi016.stdout:9/821: truncate d3/d32/d5c/d8a/f75 1611838 0 2024-08-01T06:56:37.061 INFO:tasks.workunit.client.0.smithi016.stdout:2/944: truncate d0/d8/d22/f8c 976497 0 2024-08-01T06:56:37.061 INFO:tasks.workunit.client.0.smithi016.stdout:5/841: dwrite d1/d2/d6/d9/d19/dd3/fe7 [0,4194304] 0 2024-08-01T06:56:37.063 INFO:tasks.workunit.client.0.smithi016.stdout:4/756: fdatasync d0/d2/fd8 0 2024-08-01T06:56:37.069 INFO:tasks.workunit.client.0.smithi016.stdout:5/842: dread d1/d2/d6/d9/d49/d57/f82 [0,4194304] 0 2024-08-01T06:56:37.073 INFO:tasks.workunit.client.0.smithi016.stdout:5/843: write d1/d2/d6/f113 [477820,90009] 0 2024-08-01T06:56:37.073 INFO:tasks.workunit.client.0.smithi016.stdout:7/700: mknod d7/db/d17/d72/d1e/d26/d63/dc0/c102 0 2024-08-01T06:56:37.073 INFO:tasks.workunit.client.0.smithi016.stdout:0/862: readlink d10/l88 0 2024-08-01T06:56:37.074 INFO:tasks.workunit.client.0.smithi016.stdout:5/844: readlink d1/d2/d6/l9d 0 2024-08-01T06:56:37.076 INFO:tasks.workunit.client.0.smithi016.stdout:3/683: creat d9/da/df/fef x:0 0 0 2024-08-01T06:56:37.079 INFO:tasks.workunit.client.0.smithi016.stdout:0/863: read - d10/d11/d37/d50/db1/dbb/fd3 zero size 2024-08-01T06:56:37.080 INFO:tasks.workunit.client.0.smithi016.stdout:9/822: rename d3/de/d6d/fd5 to d3/d9/d46/d48/d8b/f107 0 2024-08-01T06:56:37.081 INFO:tasks.workunit.client.0.smithi016.stdout:8/618: symlink d5/d8/d75/dba/lcc 0 2024-08-01T06:56:37.089 INFO:tasks.workunit.client.0.smithi016.stdout:8/619: dwrite d5/d8/f68 [0,4194304] 0 2024-08-01T06:56:37.090 INFO:tasks.workunit.client.0.smithi016.stdout:2/945: symlink d0/d8/l13a 0 2024-08-01T06:56:37.095 INFO:tasks.workunit.client.0.smithi016.stdout:3/684: creat d9/d3e/d80/ff0 x:0 0 0 2024-08-01T06:56:37.097 INFO:tasks.workunit.client.0.smithi016.stdout:3/685: write d9/d3e/f2d [7466027,108873] 0 2024-08-01T06:56:37.098 INFO:tasks.workunit.client.0.smithi016.stdout:0/864: unlink d10/d11/d37/d50/cc5 0 2024-08-01T06:56:37.099 INFO:tasks.workunit.client.0.smithi016.stdout:0/865: chown d10/d11/d37/d58/f79 240343 1 2024-08-01T06:56:37.104 INFO:tasks.workunit.client.0.smithi016.stdout:4/757: rename d0/d9d/da2 to d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/d100 0 2024-08-01T06:56:37.104 INFO:tasks.workunit.client.0.smithi016.stdout:0/866: dread d10/d11/d37/d82/ffb [0,4194304] 0 2024-08-01T06:56:37.113 INFO:tasks.workunit.client.0.smithi016.stdout:8/620: write d5/d8/d1a/d24/d48/d69/f82 [58778,36238] 0 2024-08-01T06:56:37.113 INFO:tasks.workunit.client.0.smithi016.stdout:0/867: dwrite d10/d5c/d90/da0/fba [0,4194304] 0 2024-08-01T06:56:37.130 INFO:tasks.workunit.client.0.smithi016.stdout:8/621: creat d5/dc9/fcd x:0 0 0 2024-08-01T06:56:37.133 INFO:tasks.workunit.client.0.smithi016.stdout:4/758: rename d0/d2/da0/fad to d0/d2/dc/d12/dd3/f101 0 2024-08-01T06:56:37.136 INFO:tasks.workunit.client.0.smithi016.stdout:4/759: write d0/d2/dc/d12/dd3/d22/d26/d8b/feb [654933,77649] 0 2024-08-01T06:56:37.136 INFO:tasks.workunit.client.0.smithi016.stdout:3/686: getdents d9/da/df/d12/d20/d3c 0 2024-08-01T06:56:37.142 INFO:tasks.workunit.client.0.smithi016.stdout:8/622: mknod d5/d8/d1a/d24/d48/d85/da8/cce 0 2024-08-01T06:56:37.146 INFO:tasks.workunit.client.0.smithi016.stdout:2/946: dread d0/d8/d31/dc1/dc4/fd1 [0,4194304] 0 2024-08-01T06:56:37.147 INFO:tasks.workunit.client.0.smithi016.stdout:4/760: rename d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/c66 to d0/d2/dc/d12/dd3/d38/c102 0 2024-08-01T06:56:37.149 INFO:tasks.workunit.client.0.smithi016.stdout:3/687: getdents d9/da/df/d12/da0/da5/dbd 0 2024-08-01T06:56:37.153 INFO:tasks.workunit.client.0.smithi016.stdout:6/863: dwrite d1/d41/f61 [0,4194304] 0 2024-08-01T06:56:37.165 INFO:tasks.workunit.client.0.smithi016.stdout:1/907: dwrite d2/de/d63/f10a [0,4194304] 0 2024-08-01T06:56:37.165 INFO:tasks.workunit.client.0.smithi016.stdout:2/947: creat d0/d8/d1b/dd9/dfc/d129/f13b x:0 0 0 2024-08-01T06:56:37.176 INFO:tasks.workunit.client.0.smithi016.stdout:3/688: creat d9/da/df/d12/d75/ff1 x:0 0 0 2024-08-01T06:56:37.188 INFO:tasks.workunit.client.0.smithi016.stdout:1/908: rename d2/de/d4d/fbd to d2/d3/d41/d49/d85/dc1/f143 0 2024-08-01T06:56:37.190 INFO:tasks.workunit.client.0.smithi016.stdout:5/845: dwrite d1/d2/d23/f32 [0,4194304] 0 2024-08-01T06:56:37.198 INFO:tasks.workunit.client.0.smithi016.stdout:6/864: dread d1/d41/f52 [4194304,4194304] 0 2024-08-01T06:56:37.205 INFO:tasks.workunit.client.0.smithi016.stdout:7/701: dwrite d7/db/d17/d72/d1e/d26/f32 [0,4194304] 0 2024-08-01T06:56:37.206 INFO:tasks.workunit.client.0.smithi016.stdout:1/909: dwrite d2/de/d4d/d92/d10f/d137/d3e/df4/f113 [0,4194304] 0 2024-08-01T06:56:37.212 INFO:tasks.workunit.client.0.smithi016.stdout:9/823: dwrite d3/d9/db/d3e/d40/f59 [0,4194304] 0 2024-08-01T06:56:37.215 INFO:tasks.workunit.client.0.smithi016.stdout:1/910: read - d2/de/d4d/d92/d10f/d137/d3e/df4/dfb/ffc zero size 2024-08-01T06:56:37.220 INFO:tasks.workunit.client.0.smithi016.stdout:5/846: symlink d1/d12/l11d 0 2024-08-01T06:56:37.221 INFO:tasks.workunit.client.0.smithi016.stdout:8/623: write d5/d8/d1a/d24/d48/d69/fa2 [1000834,17300] 0 2024-08-01T06:56:37.223 INFO:tasks.workunit.client.0.smithi016.stdout:0/868: dwrite d10/d11/d37/d50/f84 [0,4194304] 0 2024-08-01T06:56:37.227 INFO:tasks.workunit.client.0.smithi016.stdout:9/824: dwrite d3/de/fc7 [0,4194304] 0 2024-08-01T06:56:37.227 INFO:tasks.workunit.client.0.smithi016.stdout:3/689: link d9/da/d96/fa9 d9/d98/db7/ff2 0 2024-08-01T06:56:37.231 INFO:tasks.workunit.client.0.smithi016.stdout:2/948: write d0/d8/d1b/dd9/dfc/f11d [1791905,83681] 0 2024-08-01T06:56:37.237 INFO:tasks.workunit.client.0.smithi016.stdout:1/911: symlink d2/de/d63/dd6/l144 0 2024-08-01T06:56:37.240 INFO:tasks.workunit.client.0.smithi016.stdout:5/847: creat d1/df6/f11e x:0 0 0 2024-08-01T06:56:37.241 INFO:tasks.workunit.client.0.smithi016.stdout:8/624: mkdir d5/d8/d1a/d59/dcf 0 2024-08-01T06:56:37.245 INFO:tasks.workunit.client.0.smithi016.stdout:3/690: dwrite d9/da/df/d12/f42 [8388608,4194304] 0 2024-08-01T06:56:37.247 INFO:tasks.workunit.client.0.smithi016.stdout:4/761: dwrite d0/d2/f1c [0,4194304] 0 2024-08-01T06:56:37.249 INFO:tasks.workunit.client.0.smithi016.stdout:2/949: mkdir d0/d8/d22/d13c 0 2024-08-01T06:56:37.249 INFO:tasks.workunit.client.0.smithi016.stdout:7/702: mknod d7/db/d17/d72/d1c/d79/d8f/ddf/c103 0 2024-08-01T06:56:37.250 INFO:tasks.workunit.client.0.smithi016.stdout:0/869: creat d10/d11/ddd/f11b x:0 0 0 2024-08-01T06:56:37.251 INFO:tasks.workunit.client.0.smithi016.stdout:3/691: write d9/d57/f74 [1256850,110182] 0 2024-08-01T06:56:37.253 INFO:tasks.workunit.client.0.smithi016.stdout:8/625: symlink d5/d8/d1a/d59/ld0 0 2024-08-01T06:56:37.253 INFO:tasks.workunit.client.0.smithi016.stdout:5/848: creat d1/d2/d6/d9/d49/d57/db1/f11f x:0 0 0 2024-08-01T06:56:37.255 INFO:tasks.workunit.client.0.smithi016.stdout:3/692: stat d9/da/df/d2a/d49 0 2024-08-01T06:56:37.255 INFO:tasks.workunit.client.0.smithi016.stdout:2/950: fdatasync d0/d8/d1b/dfe/f136 0 2024-08-01T06:56:37.259 INFO:tasks.workunit.client.0.smithi016.stdout:5/849: creat d1/d2/d6/d5a/d65/f120 x:0 0 0 2024-08-01T06:56:37.259 INFO:tasks.workunit.client.0.smithi016.stdout:2/951: dread - d0/d8/d1b/dcc/d68/fd8 zero size 2024-08-01T06:56:37.260 INFO:tasks.workunit.client.0.smithi016.stdout:2/952: readlink d0/d8/d6b/l92 0 2024-08-01T06:56:37.261 INFO:tasks.workunit.client.0.smithi016.stdout:3/693: symlink d9/da/lf3 0 2024-08-01T06:56:37.263 INFO:tasks.workunit.client.0.smithi016.stdout:2/953: write d0/d8/d22/ff3 [2726483,7578] 0 2024-08-01T06:56:37.263 INFO:tasks.workunit.client.0.smithi016.stdout:3/694: write d9/d4e/fcd [99218,77563] 0 2024-08-01T06:56:37.265 INFO:tasks.workunit.client.0.smithi016.stdout:8/626: rmdir d5/d8/d1a/da9/db6/dcb 0 2024-08-01T06:56:37.266 INFO:tasks.workunit.client.0.smithi016.stdout:2/954: chown d0/d8/d1b/dcc/d3b/l5a 241831724 1 2024-08-01T06:56:37.271 INFO:tasks.workunit.client.0.smithi016.stdout:6/865: truncate d1/d41/dbf/f10c 269939 0 2024-08-01T06:56:37.272 INFO:tasks.workunit.client.0.smithi016.stdout:8/627: creat d5/d8/d1a/dbe/fd1 x:0 0 0 2024-08-01T06:56:37.274 INFO:tasks.workunit.client.0.smithi016.stdout:5/850: link d1/d2/d6/d9/d49/d57/db1/fcd d1/f121 0 2024-08-01T06:56:37.276 INFO:tasks.workunit.client.0.smithi016.stdout:4/762: dread d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d91/fdd [4194304,4194304] 0 2024-08-01T06:56:37.277 INFO:tasks.workunit.client.0.smithi016.stdout:6/866: mkdir d1/d8/d1b/d22/d36/d7a/dd3/da3/d12e 0 2024-08-01T06:56:37.278 INFO:tasks.workunit.client.0.smithi016.stdout:5/851: fsync d1/d2/d23/f81 0 2024-08-01T06:56:37.280 INFO:tasks.workunit.client.0.smithi016.stdout:6/867: unlink d1/d8/d1b/d22/d36/f6f 0 2024-08-01T06:56:37.285 INFO:tasks.workunit.client.0.smithi016.stdout:6/868: rename d1/d8/d1b/d22 to d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/d12f 22 2024-08-01T06:56:37.291 INFO:tasks.workunit.client.0.smithi016.stdout:5/852: mknod d1/d12/d7d/db3/c122 0 2024-08-01T06:56:37.295 INFO:tasks.workunit.client.0.smithi016.stdout:9/825: dwrite d3/d9/df/d2a/f76 [0,4194304] 0 2024-08-01T06:56:37.299 INFO:tasks.workunit.client.0.smithi016.stdout:5/853: rename d1/d2/d23/c78 to d1/d12/d7d/c123 0 2024-08-01T06:56:37.303 INFO:tasks.workunit.client.0.smithi016.stdout:7/703: dwrite d7/db/f6f [0,4194304] 0 2024-08-01T06:56:37.305 INFO:tasks.workunit.client.0.smithi016.stdout:2/955: dread d0/d8/d22/f98 [0,4194304] 0 2024-08-01T06:56:37.306 INFO:tasks.workunit.client.0.smithi016.stdout:7/704: readlink d7/db/d17/d72/l48 0 2024-08-01T06:56:37.309 INFO:tasks.workunit.client.0.smithi016.stdout:7/705: chown d7/db/d17/d72/d1c/d1d/d6d 13 1 2024-08-01T06:56:37.310 INFO:tasks.workunit.client.0.smithi016.stdout:8/628: fsync d5/d8/d1a/dbe/fd1 0 2024-08-01T06:56:37.314 INFO:tasks.workunit.client.0.smithi016.stdout:2/956: dread - d0/d8/d1b/dd9/dfc/fff zero size 2024-08-01T06:56:37.319 INFO:tasks.workunit.client.0.smithi016.stdout:5/854: dwrite d1/d2/d6/d9/d49/d57/fb7 [0,4194304] 0 2024-08-01T06:56:37.320 INFO:tasks.workunit.client.0.smithi016.stdout:8/629: mkdir d5/d8/d1a/d24/d48/d6e/d92/d99/dd2 0 2024-08-01T06:56:37.321 INFO:tasks.workunit.client.0.smithi016.stdout:6/869: write d1/d8/d1b/d22/d71/ff0 [74591,70] 0 2024-08-01T06:56:37.325 INFO:tasks.workunit.client.0.smithi016.stdout:4/763: dwrite d0/d2/dc/fcc [0,4194304] 0 2024-08-01T06:56:37.329 INFO:tasks.workunit.client.0.smithi016.stdout:5/855: creat d1/d2/d6/d9/d49/f124 x:0 0 0 2024-08-01T06:56:37.332 INFO:tasks.workunit.client.0.smithi016.stdout:9/826: dwrite d3/d9/db/d3e/d40/f4b [4194304,4194304] 0 2024-08-01T06:56:37.332 INFO:tasks.workunit.client.0.smithi016.stdout:8/630: fsync d5/f84 0 2024-08-01T06:56:37.340 INFO:tasks.workunit.client.0.smithi016.stdout:6/870: mkdir d1/d8/d1b/db5/d67/d8f/d115/d130 0 2024-08-01T06:56:37.341 INFO:tasks.workunit.client.0.smithi016.stdout:7/706: dwrite d7/db/d17/d72/d1c/d79/d8f/fc4 [0,4194304] 0 2024-08-01T06:56:37.341 INFO:tasks.workunit.client.0.smithi016.stdout:4/764: mknod d0/d2/dc/d12/dd3/d22/d26/d85/c103 0 2024-08-01T06:56:37.343 INFO:tasks.workunit.client.0.smithi016.stdout:7/707: stat d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/ca0 0 2024-08-01T06:56:37.352 INFO:tasks.workunit.client.0.smithi016.stdout:7/708: truncate d7/db/d17/d72/d1e/d26/d2a/f8c 1307387 0 2024-08-01T06:56:37.353 INFO:tasks.workunit.client.0.smithi016.stdout:6/871: truncate d1/d8/d1b/db5/d67/d8f/dba/dbd/f84 4189189 0 2024-08-01T06:56:37.354 INFO:tasks.workunit.client.0.smithi016.stdout:4/765: mknod d0/d2/dc/d12/dd3/d22/d26/d85/c104 0 2024-08-01T06:56:37.356 INFO:tasks.workunit.client.0.smithi016.stdout:6/872: write d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f62 [647047,18661] 0 2024-08-01T06:56:37.361 INFO:tasks.workunit.client.0.smithi016.stdout:7/709: symlink d7/db/d17/d72/d22/d77/d99/dd1/l104 0 2024-08-01T06:56:37.363 INFO:tasks.workunit.client.0.smithi016.stdout:7/710: chown d7/db/d17/d72/d22/d77/d99/dd1/ddc 1780 1 2024-08-01T06:56:37.364 INFO:tasks.workunit.client.0.smithi016.stdout:7/711: chown d7/db/d17/d72/d1e/d26/d63/l84 4 1 2024-08-01T06:56:37.366 INFO:tasks.workunit.client.0.smithi016.stdout:4/766: rmdir d0/d2/dc/d12/dd3/d22/d26/d85/dc1 39 2024-08-01T06:56:37.368 INFO:tasks.workunit.client.0.smithi016.stdout:5/856: write d1/d2/d20/d72/f94 [1047554,89625] 0 2024-08-01T06:56:37.369 INFO:tasks.workunit.client.0.smithi016.stdout:6/873: mkdir d1/d8/d1b/d48/dd9/d131 0 2024-08-01T06:56:37.370 INFO:tasks.workunit.client.0.smithi016.stdout:9/827: link d3/d9/db/cd d3/d9/d46/d48/d87/df9/c108 0 2024-08-01T06:56:37.371 INFO:tasks.workunit.client.0.smithi016.stdout:8/631: write d5/d8/d1a/d59/f5c [4467140,56570] 0 2024-08-01T06:56:37.374 INFO:tasks.workunit.client.0.smithi016.stdout:8/632: write d5/d8/d1a/d24/d6a/fbf [1238696,130415] 0 2024-08-01T06:56:37.374 INFO:tasks.workunit.client.0.smithi016.stdout:7/712: unlink d7/db/d17/d72/d1c/d1d/d40/d58/da3/l101 0 2024-08-01T06:56:37.376 INFO:tasks.workunit.client.0.smithi016.stdout:5/857: chown d1/d2/d6/d9/d49/d57/d110/f62 3106686 1 2024-08-01T06:56:37.378 INFO:tasks.workunit.client.0.smithi016.stdout:6/874: mkdir d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/dbc/d132 0 2024-08-01T06:56:37.392 INFO:tasks.workunit.client.0.smithi016.stdout:9/828: rename d3/d9/db/d3e/d40/d80/ca8 to d3/d9/db/d3a/dd8/c109 0 2024-08-01T06:56:37.393 INFO:tasks.workunit.client.0.smithi016.stdout:6/875: dwrite d1/d8/d1b/db5/d67/d8f/dba/fe8 [0,4194304] 0 2024-08-01T06:56:37.401 INFO:tasks.workunit.client.0.smithi016.stdout:6/876: read - d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f89 zero size 2024-08-01T06:56:37.401 INFO:tasks.workunit.client.0.smithi016.stdout:4/767: dwrite d0/d2/dc/d12/dd3/f101 [0,4194304] 0 2024-08-01T06:56:37.427 INFO:tasks.workunit.client.0.smithi016.stdout:7/713: symlink d7/db/d17/d72/d1c/d79/d8f/d39/d71/dd9/l105 0 2024-08-01T06:56:37.428 INFO:tasks.workunit.client.0.smithi016.stdout:5/858: link d1/d2/d6/d9/d1b/f59 d1/d2/d6/d9/d49/d57/db1/f125 0 2024-08-01T06:56:37.433 INFO:tasks.workunit.client.0.smithi016.stdout:7/714: symlink d7/db3/l106 0 2024-08-01T06:56:37.477 INFO:tasks.workunit.client.0.smithi016.stdout:5/859: mknod d1/d2/d6/d9/d49/d57/db1/c126 0 2024-08-01T06:56:37.478 INFO:tasks.workunit.client.0.smithi016.stdout:8/633: creat d5/d8/fd3 x:0 0 0 2024-08-01T06:56:37.479 INFO:tasks.workunit.client.0.smithi016.stdout:4/768: mknod d0/d2/dc/d12/dd3/d22/d26/d85/c105 0 2024-08-01T06:56:37.483 INFO:tasks.workunit.client.0.smithi016.stdout:9/829: rmdir d3/d9/d46/dea/d104 0 2024-08-01T06:56:37.487 INFO:tasks.workunit.client.0.smithi016.stdout:6/877: dwrite d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d8e/dcf/f122 [0,4194304] 0 2024-08-01T06:56:37.487 INFO:tasks.workunit.client.0.smithi016.stdout:8/634: creat d5/d8/d1a/d24/d48/d6e/d83/fd4 x:0 0 0 2024-08-01T06:56:37.494 INFO:tasks.workunit.client.0.smithi016.stdout:4/769: dwrite d0/d2/dc/d12/fc6 [0,4194304] 0 2024-08-01T06:56:37.495 INFO:tasks.workunit.client.0.smithi016.stdout:6/878: write d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f62 [1997531,60277] 0 2024-08-01T06:56:37.495 INFO:tasks.workunit.client.0.smithi016.stdout:4/770: stat d0/d2/dc/d12/dd3/f49 0 2024-08-01T06:56:37.499 INFO:tasks.workunit.client.0.smithi016.stdout:5/860: link d1/d2/d6/d5a/cab d1/d2/d6/d9/d49/d57/db1/c127 0 2024-08-01T06:56:37.500 INFO:tasks.workunit.client.0.smithi016.stdout:4/771: dread d0/d2/dc/d12/dd3/d38/fe7 [0,4194304] 0 2024-08-01T06:56:37.501 INFO:tasks.workunit.client.0.smithi016.stdout:5/861: readlink d1/d12/l1a 0 2024-08-01T06:56:37.503 INFO:tasks.workunit.client.0.smithi016.stdout:9/830: creat d3/d9/df/f10a x:0 0 0 2024-08-01T06:56:37.505 INFO:tasks.workunit.client.0.smithi016.stdout:6/879: symlink d1/d8/d1b/db5/d67/d8f/d115/d117/l133 0 2024-08-01T06:56:37.506 INFO:tasks.workunit.client.0.smithi016.stdout:6/880: read d1/d8/f1a [2609748,53425] 0 2024-08-01T06:56:37.512 INFO:tasks.workunit.client.0.smithi016.stdout:4/772: chown d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d79/ld4 959 1 2024-08-01T06:56:37.515 INFO:tasks.workunit.client.0.smithi016.stdout:7/715: dwrite d7/db/d17/d72/d22/d77/d99/dd1/fef [0,4194304] 0 2024-08-01T06:56:37.517 INFO:tasks.workunit.client.0.smithi016.stdout:5/862: symlink d1/d12/ddd/l128 0 2024-08-01T06:56:37.517 INFO:tasks.workunit.client.0.smithi016.stdout:9/831: getdents d3/d9/db/d3e/d106 0 2024-08-01T06:56:37.519 INFO:tasks.workunit.client.0.smithi016.stdout:7/716: stat d7/db/d17/d72/d22/d77/d99/dd1/fee 0 2024-08-01T06:56:37.525 INFO:tasks.workunit.client.0.smithi016.stdout:9/832: symlink d3/d9/df/d16/d94/l10b 0 2024-08-01T06:56:37.526 INFO:tasks.workunit.client.0.smithi016.stdout:8/635: dwrite d5/d8/d1a/d24/f4a [0,4194304] 0 2024-08-01T06:56:37.531 INFO:tasks.workunit.client.0.smithi016.stdout:9/833: stat d3/d9/db/dc/le0 0 2024-08-01T06:56:37.532 INFO:tasks.workunit.client.0.smithi016.stdout:4/773: dwrite d0/d2/dc/d12/dd3/d22/d26/d8b/ffd [0,4194304] 0 2024-08-01T06:56:37.532 INFO:tasks.workunit.client.0.smithi016.stdout:7/717: read d7/db/d17/d72/d1e/f1f [6541875,74844] 0 2024-08-01T06:56:37.533 INFO:tasks.workunit.client.0.smithi016.stdout:9/834: chown d3/l91 4 1 2024-08-01T06:56:37.540 INFO:tasks.workunit.client.0.smithi016.stdout:8/636: dwrite d5/d8/d1a/d24/d48/f97 [0,4194304] 0 2024-08-01T06:56:37.546 INFO:tasks.workunit.client.0.smithi016.stdout:8/637: write d5/d8/d75/dba/fc3 [480991,34499] 0 2024-08-01T06:56:37.546 INFO:tasks.workunit.client.0.smithi016.stdout:5/863: rename d1/d2/d6/d9/d49/d57/d110/f92 to d1/f129 0 2024-08-01T06:56:37.546 INFO:tasks.workunit.client.0.smithi016.stdout:9/835: chown d3/d9/db/d3e/f66 103687757 1 2024-08-01T06:56:37.547 INFO:tasks.workunit.client.0.smithi016.stdout:5/864: chown d1/d2/d6/d9/d49/d57/db1/fcd 5073 1 2024-08-01T06:56:37.548 INFO:tasks.workunit.client.0.smithi016.stdout:5/865: stat d1/d2/d6/fe1 0 2024-08-01T06:56:37.549 INFO:tasks.workunit.client.0.smithi016.stdout:6/881: link d1/d41/f3e d1/d8/d1b/db5/d67/d8f/d115/d117/f134 0 2024-08-01T06:56:37.552 INFO:tasks.workunit.client.0.smithi016.stdout:9/836: truncate d3/d32/d5c/d8a/fca 3380597 0 2024-08-01T06:56:37.557 INFO:tasks.workunit.client.0.smithi016.stdout:5/866: rename d1/d12/d8c to d1/d2/d6/d9/dd8/d12a 0 2024-08-01T06:56:37.558 INFO:tasks.workunit.client.0.smithi016.stdout:5/867: dread - d1/d12/d7d/f102 zero size 2024-08-01T06:56:37.560 INFO:tasks.workunit.client.0.smithi016.stdout:8/638: dread d5/dc/f4b [0,4194304] 0 2024-08-01T06:56:37.560 INFO:tasks.workunit.client.0.smithi016.stdout:7/718: creat d7/db/d17/d72/d1e/d26/f107 x:0 0 0 2024-08-01T06:56:37.561 INFO:tasks.workunit.client.0.smithi016.stdout:4/774: link d0/d2/dc/d12/dd3/d22/d7f/cba d0/d2/dc/d12/dd3/d22/d26/da3/c106 0 2024-08-01T06:56:37.564 INFO:tasks.workunit.client.0.smithi016.stdout:5/868: truncate d1/d2/d6/d9/d19/d7a/f10e 272085 0 2024-08-01T06:56:37.569 INFO:tasks.workunit.client.0.smithi016.stdout:4/775: mknod d0/c107 0 2024-08-01T06:56:37.570 INFO:tasks.workunit.client.0.smithi016.stdout:9/837: getdents d3/d9/db/dc/d56/d9b 0 2024-08-01T06:56:37.571 INFO:tasks.workunit.client.0.smithi016.stdout:5/869: mkdir d1/df6/d12b 0 2024-08-01T06:56:37.571 INFO:tasks.workunit.client.0.smithi016.stdout:8/639: dwrite d5/dc9/fcd [0,4194304] 0 2024-08-01T06:56:37.579 INFO:tasks.workunit.client.0.smithi016.stdout:6/882: write d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/fc3 [235966,63864] 0 2024-08-01T06:56:37.581 INFO:tasks.workunit.client.0.smithi016.stdout:7/719: dread d7/db/d17/d72/d1e/f51 [0,4194304] 0 2024-08-01T06:56:37.582 INFO:tasks.workunit.client.0.smithi016.stdout:8/640: mknod d5/d8/d1a/d24/d48/d6e/d92/cd5 0 2024-08-01T06:56:37.586 INFO:tasks.workunit.client.0.smithi016.stdout:9/838: symlink d3/d9/db/l10c 0 2024-08-01T06:56:37.587 INFO:tasks.workunit.client.0.smithi016.stdout:4/776: creat d0/d2/dc/d90/df3/f108 x:0 0 0 2024-08-01T06:56:37.591 INFO:tasks.workunit.client.0.smithi016.stdout:6/883: creat d1/d8/d94/f135 x:0 0 0 2024-08-01T06:56:37.591 INFO:tasks.workunit.client.0.smithi016.stdout:8/641: read - d5/d8/d1a/d24/d48/d60/f66 zero size 2024-08-01T06:56:37.593 INFO:tasks.workunit.client.0.smithi016.stdout:7/720: creat d7/db/d17/d72/d1c/d1d/d40/d67/d7c/f108 x:0 0 0 2024-08-01T06:56:37.594 INFO:tasks.workunit.client.0.smithi016.stdout:9/839: creat d3/d9/d46/d103/f10d x:0 0 0 2024-08-01T06:56:37.598 INFO:tasks.workunit.client.0.smithi016.stdout:5/870: rmdir d1/d12/d7d/db3/de6 0 2024-08-01T06:56:37.600 INFO:tasks.workunit.client.0.smithi016.stdout:4/777: truncate d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d79/fa6 1031444 0 2024-08-01T06:56:37.600 INFO:tasks.workunit.client.0.smithi016.stdout:9/840: creat d3/de/d89/f10e x:0 0 0 2024-08-01T06:56:37.602 INFO:tasks.workunit.client.0.smithi016.stdout:7/721: truncate d7/db/d17/d4e/f6c 1425067 0 2024-08-01T06:56:37.605 INFO:tasks.workunit.client.0.smithi016.stdout:5/871: chown d1/d2/d20/d38/c63 41 1 2024-08-01T06:56:37.606 INFO:tasks.workunit.client.0.smithi016.stdout:5/872: dread - d1/d2/d6/d9/d19/d7a/f11a zero size 2024-08-01T06:56:37.608 INFO:tasks.workunit.client.0.smithi016.stdout:9/841: mkdir d3/d9/db/dc/d10f 0 2024-08-01T06:56:37.609 INFO:tasks.workunit.client.0.smithi016.stdout:9/842: stat d3/d9/db/dc/d56/d9b/fb9 0 2024-08-01T06:56:37.612 INFO:tasks.workunit.client.0.smithi016.stdout:7/722: creat d7/db/d17/d72/d1e/d26/d2a/db5/dcf/f109 x:0 0 0 2024-08-01T06:56:37.614 INFO:tasks.workunit.client.0.smithi016.stdout:8/642: rmdir d5/d8/d75/db0 0 2024-08-01T06:56:37.617 INFO:tasks.workunit.client.0.smithi016.stdout:4/778: getdents d0/d2/dc/d12/dd3/d22/d26/de0 0 2024-08-01T06:56:37.618 INFO:tasks.workunit.client.0.smithi016.stdout:9/843: fdatasync d3/d9/db/d3e/f68 0 2024-08-01T06:56:37.622 INFO:tasks.workunit.client.0.smithi016.stdout:9/844: read - d3/d9/db/dc/d56/fdf zero size 2024-08-01T06:56:37.622 INFO:tasks.workunit.client.0.smithi016.stdout:5/873: write d1/d2/d6/d9/f6a [4834836,34544] 0 2024-08-01T06:56:37.623 INFO:tasks.workunit.client.0.smithi016.stdout:7/723: symlink d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/df1/l10a 0 2024-08-01T06:56:37.624 INFO:tasks.workunit.client.0.smithi016.stdout:8/643: dwrite d5/d8/d75/fb9 [0,4194304] 0 2024-08-01T06:56:37.626 INFO:tasks.workunit.client.0.smithi016.stdout:6/884: dwrite d1/f2 [0,4194304] 0 2024-08-01T06:56:37.637 INFO:tasks.workunit.client.0.smithi016.stdout:4/779: dread d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d79/fa6 [0,4194304] 0 2024-08-01T06:56:37.639 INFO:tasks.workunit.client.0.smithi016.stdout:4/780: chown d0/d2/dc/d90/ld5 14682246 1 2024-08-01T06:56:37.641 INFO:tasks.workunit.client.0.smithi016.stdout:6/885: creat d1/d8/d1b/db5/dd6/f136 x:0 0 0 2024-08-01T06:56:37.641 INFO:tasks.workunit.client.0.smithi016.stdout:8/644: dwrite d5/d8/d1a/d24/d48/d85/fb5 [0,4194304] 0 2024-08-01T06:56:37.645 INFO:tasks.workunit.client.0.smithi016.stdout:9/845: write d3/f28 [384039,119253] 0 2024-08-01T06:56:37.646 INFO:tasks.workunit.client.0.smithi016.stdout:8/645: write d5/d8/d1a/d24/d48/f7c [1281450,42812] 0 2024-08-01T06:56:37.648 INFO:tasks.workunit.client.0.smithi016.stdout:9/846: write d3/d9/db/d3e/d40/f59 [4737728,28415] 0 2024-08-01T06:56:37.649 INFO:tasks.workunit.client.0.smithi016.stdout:4/781: mknod d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/c109 0 2024-08-01T06:56:37.650 INFO:tasks.workunit.client.0.smithi016.stdout:6/886: fdatasync d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/dbc/fc4 0 2024-08-01T06:56:37.652 INFO:tasks.workunit.client.0.smithi016.stdout:4/782: write d0/d2/dcd/ff5 [617002,40167] 0 2024-08-01T06:56:37.654 INFO:tasks.workunit.client.0.smithi016.stdout:5/874: link d1/d2/d6/d9/lb2 d1/d12/d7d/l12c 0 2024-08-01T06:56:37.658 INFO:tasks.workunit.client.0.smithi016.stdout:7/724: dread d7/db/d17/d72/d1c/d79/d8f/d39/f41 [0,4194304] 0 2024-08-01T06:56:37.659 INFO:tasks.workunit.client.0.smithi016.stdout:8/646: unlink d5/d8/dc0/lca 0 2024-08-01T06:56:37.660 INFO:tasks.workunit.client.0.smithi016.stdout:6/887: rmdir d1/d41 39 2024-08-01T06:56:37.662 INFO:tasks.workunit.client.0.smithi016.stdout:9/847: fsync d3/d9/df/d16/f2b 0 2024-08-01T06:56:37.662 INFO:tasks.workunit.client.0.smithi016.stdout:4/783: fsync d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d8f/faa 0 2024-08-01T06:56:37.665 INFO:tasks.workunit.client.0.smithi016.stdout:7/725: symlink d7/db/d17/d72/d1c/d4f/l10b 0 2024-08-01T06:56:37.667 INFO:tasks.workunit.client.0.smithi016.stdout:8/647: mkdir d5/d67/d86/dd6 0 2024-08-01T06:56:37.877 INFO:tasks.workunit.client.0.smithi016.stdout:7/726: creat d7/db/d17/d72/d22/d77/d99/f10c x:0 0 0 2024-08-01T06:56:37.877 INFO:tasks.workunit.client.0.smithi016.stdout:8/648: mkdir d5/d8/d1a/d24/d48/d85/dd7 0 2024-08-01T06:56:37.879 INFO:tasks.workunit.client.0.smithi016.stdout:7/727: chown d7/db/d17/d72/d1c/d79/d8f/ddf/c103 1755 1 2024-08-01T06:56:37.880 INFO:tasks.workunit.client.0.smithi016.stdout:9/848: mkdir d3/d9/df/d110 0 2024-08-01T06:56:37.883 INFO:tasks.workunit.client.0.smithi016.stdout:6/888: creat d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d8e/dcf/f137 x:0 0 0 2024-08-01T06:56:37.885 INFO:tasks.workunit.client.0.smithi016.stdout:8/649: rename d5/d8/d1a/d24/d48/d6e/d92/d99 to d5/dc/d3e/d72/dd8 0 2024-08-01T06:56:37.893 INFO:tasks.workunit.client.0.smithi016.stdout:8/650: link d5/d8/d75/f9b d5/d8/d1a/d24/d48/d85/da8/fd9 0 2024-08-01T06:56:37.895 INFO:tasks.workunit.client.0.smithi016.stdout:8/651: symlink d5/d8/d1a/d24/d6a/lda 0 2024-08-01T06:56:37.900 INFO:tasks.workunit.client.0.smithi016.stdout:4/784: truncate d0/d2/dc/fcc 4075691 0 2024-08-01T06:56:37.903 INFO:tasks.workunit.client.0.smithi016.stdout:7/728: write d7/db/d17/d72/d1e/d26/d2a/f30 [371595,101463] 0 2024-08-01T06:56:37.903 INFO:tasks.workunit.client.0.smithi016.stdout:4/785: truncate d0/d2/dc/d12/dd3/f30 807825 0 2024-08-01T06:56:37.904 INFO:tasks.workunit.client.0.smithi016.stdout:6/889: write d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d8e/f107 [992934,56973] 0 2024-08-01T06:56:37.922 INFO:tasks.workunit.client.0.smithi016.stdout:8/652: write d5/d8/d1a/da9/db6/fb7 [5363340,8499] 0 2024-08-01T06:56:37.923 INFO:tasks.workunit.client.0.smithi016.stdout:9/849: dwrite d3/f1d [0,4194304] 0 2024-08-01T06:56:37.924 INFO:tasks.workunit.client.0.smithi016.stdout:6/890: write d1/d8/d1b/db5/d67/fb3 [2170610,70709] 0 2024-08-01T06:56:37.927 INFO:tasks.workunit.client.0.smithi016.stdout:9/850: write d3/d9/db/d3e/d40/f59 [396603,59249] 0 2024-08-01T06:56:37.939 INFO:tasks.workunit.client.0.smithi016.stdout:4/786: unlink d0/d2/dc/d12/dd3/d22/d26/d85/dc1/f8a 0 2024-08-01T06:56:37.940 INFO:tasks.workunit.client.0.smithi016.stdout:4/787: write d0/d2/dc/d90/df3/f108 [842905,29438] 0 2024-08-01T06:56:37.940 INFO:tasks.workunit.client.0.smithi016.stdout:8/653: unlink d5/dc/d3e/d72/dd8/f9d 0 2024-08-01T06:56:37.946 INFO:tasks.workunit.client.0.smithi016.stdout:9/851: symlink d3/d9/db/d3e/l111 0 2024-08-01T06:56:37.946 INFO:tasks.workunit.client.0.smithi016.stdout:7/729: dwrite d7/db3/ff4 [0,4194304] 0 2024-08-01T06:56:37.954 INFO:tasks.workunit.client.0.smithi016.stdout:4/788: creat d0/d2/d36/dbd/f10a x:0 0 0 2024-08-01T06:56:37.956 INFO:tasks.workunit.client.0.smithi016.stdout:9/852: creat d3/d32/d5c/d8a/f112 x:0 0 0 2024-08-01T06:56:37.959 INFO:tasks.workunit.client.0.smithi016.stdout:7/730: read d7/db/d17/d72/d22/f4a [1033,15007] 0 2024-08-01T06:56:37.960 INFO:tasks.workunit.client.0.smithi016.stdout:8/654: creat d5/d8/d1a/d24/d48/d85/daf/fdb x:0 0 0 2024-08-01T06:56:37.963 INFO:tasks.workunit.client.0.smithi016.stdout:7/731: mknod d7/db/d17/d72/d1e/d26/d63/ddd/c10d 0 2024-08-01T06:56:37.964 INFO:tasks.workunit.client.0.smithi016.stdout:4/789: link d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d91/fdd d0/d2/d36/dbd/f10b 0 2024-08-01T06:56:37.968 INFO:tasks.workunit.client.0.smithi016.stdout:4/790: creat d0/d2/d36/f10c x:0 0 0 2024-08-01T06:56:37.970 INFO:tasks.workunit.client.0.smithi016.stdout:8/655: rmdir d5/d8/dc0 0 2024-08-01T06:56:37.974 INFO:tasks.workunit.client.0.smithi016.stdout:8/656: symlink d5/d8/ldc 0 2024-08-01T06:56:37.976 INFO:tasks.workunit.client.0.smithi016.stdout:8/657: read d5/d8/d1a/d24/d48/d69/fa2 [1254592,14392] 0 2024-08-01T06:56:37.977 INFO:tasks.workunit.client.0.smithi016.stdout:4/791: link d0/d2/dc/d12/dd3/d22/d26/da3/c74 d0/d9d/df7/c10d 0 2024-08-01T06:56:37.980 INFO:tasks.workunit.client.0.smithi016.stdout:8/658: fsync d5/d8/d1a/d24/d48/d60/f66 0 2024-08-01T06:56:37.998 INFO:tasks.workunit.client.0.smithi016.stdout:8/659: dread d5/d8/d1a/d24/d48/d69/fa2 [0,4194304] 0 2024-08-01T06:56:37.998 INFO:tasks.workunit.client.0.smithi016.stdout:7/732: dwrite d7/db/d17/d4e/f93 [0,4194304] 0 2024-08-01T06:56:38.005 INFO:tasks.workunit.client.0.smithi016.stdout:8/660: rename d5/d1c/f4f to d5/d8/d1a/d24/d48/d60/d63/db4/fdd 0 2024-08-01T06:56:38.009 INFO:tasks.workunit.client.0.smithi016.stdout:7/733: rename d7/db/d17/d72/d1e/d26/d2a/db5 to d7/db/d17/d72/d1c/d1d/d40/d67/d7c/d10e 0 2024-08-01T06:56:38.012 INFO:tasks.workunit.client.0.smithi016.stdout:7/734: symlink d7/db/d17/d72/d1e/d26/d63/ddd/l10f 0 2024-08-01T06:56:38.012 INFO:tasks.workunit.client.0.smithi016.stdout:8/661: mknod d5/d67/d86/dd6/cde 0 2024-08-01T06:56:38.014 INFO:tasks.workunit.client.0.smithi016.stdout:7/735: chown d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/ffe 66687902 1 2024-08-01T06:56:38.014 INFO:tasks.workunit.client.0.smithi016.stdout:8/662: rmdir d5/dc 39 2024-08-01T06:56:38.017 INFO:tasks.workunit.client.0.smithi016.stdout:7/736: chown d7/db/d17/d72/d1c/d1d/d40/d67/cf0 1478 1 2024-08-01T06:56:38.018 INFO:tasks.workunit.client.0.smithi016.stdout:4/792: write d0/d2/dc/f15 [3981177,123532] 0 2024-08-01T06:56:38.022 INFO:tasks.workunit.client.0.smithi016.stdout:8/663: link d5/d1c/l44 d5/d8/d1a/d24/d6a/ldf 0 2024-08-01T06:56:38.031 INFO:tasks.workunit.client.0.smithi016.stdout:8/664: dwrite d5/dc/f4b [0,4194304] 0 2024-08-01T06:56:38.033 INFO:tasks.workunit.client.0.smithi016.stdout:4/793: dread d0/d2/f2a [0,4194304] 0 2024-08-01T06:56:38.046 INFO:tasks.workunit.client.0.smithi016.stdout:7/737: write d7/db/d17/d4e/fc1 [677373,63903] 0 2024-08-01T06:56:38.048 INFO:tasks.workunit.client.0.smithi016.stdout:8/665: dread d5/dc/d3e/d72/dd8/fae [0,4194304] 0 2024-08-01T06:56:38.050 INFO:tasks.workunit.client.0.smithi016.stdout:7/738: symlink d7/db/d17/d72/d1e/d26/d63/ddd/l110 0 2024-08-01T06:56:38.056 INFO:tasks.workunit.client.0.smithi016.stdout:8/666: getdents d5/d8/d1a/d24/d48/d85/da8 0 2024-08-01T06:56:38.058 INFO:tasks.workunit.client.0.smithi016.stdout:8/667: write d5/d8/d1a/d24/d48/d6e/d83/fd4 [1040078,49633] 0 2024-08-01T06:56:38.063 INFO:tasks.workunit.client.0.smithi016.stdout:8/668: readlink d5/d8/d1a/d24/d6a/lb1 0 2024-08-01T06:56:38.066 INFO:tasks.workunit.client.0.smithi016.stdout:8/669: symlink d5/d8/d1a/d24/le0 0 2024-08-01T06:56:38.072 INFO:tasks.workunit.client.0.smithi016.stdout:8/670: dread d5/d67/d86/fa7 [0,4194304] 0 2024-08-01T06:56:38.074 INFO:tasks.workunit.client.0.smithi016.stdout:8/671: write d5/fc5 [294767,29434] 0 2024-08-01T06:56:38.075 INFO:tasks.workunit.client.0.smithi016.stdout:8/672: fdatasync d5/d8/f68 0 2024-08-01T06:56:38.076 INFO:tasks.workunit.client.0.smithi016.stdout:4/794: write d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/fb6 [57137,95512] 0 2024-08-01T06:56:38.078 INFO:tasks.workunit.client.0.smithi016.stdout:8/673: mkdir d5/dc/de1 0 2024-08-01T06:56:38.086 INFO:tasks.workunit.client.0.smithi016.stdout:8/674: dwrite d5/d8/d1a/dbe/fd1 [0,4194304] 0 2024-08-01T06:56:38.096 INFO:tasks.workunit.client.0.smithi016.stdout:8/675: unlink d5/d8/d1a/d24/d48/d69/f82 0 2024-08-01T06:56:38.097 INFO:tasks.workunit.client.0.smithi016.stdout:7/739: write d7/db/d17/d72/d1c/d1d/d40/d7f/fe3 [723462,66605] 0 2024-08-01T06:56:38.104 INFO:tasks.workunit.client.0.smithi016.stdout:7/740: mkdir d7/db/d17/d72/d1c/d1d/d40/d111 0 2024-08-01T06:56:38.108 INFO:tasks.workunit.client.0.smithi016.stdout:7/741: symlink d7/db/d17/d72/d1c/dc6/l112 0 2024-08-01T06:56:38.110 INFO:tasks.workunit.client.0.smithi016.stdout:7/742: fsync d7/db/d17/d72/d22/fc2 0 2024-08-01T06:56:38.111 INFO:tasks.workunit.client.0.smithi016.stdout:4/795: write d0/d2/d36/dbd/f10b [344875,33660] 0 2024-08-01T06:56:38.114 INFO:tasks.workunit.client.0.smithi016.stdout:7/743: chown d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/df1/l10a 2589515 1 2024-08-01T06:56:38.124 INFO:tasks.workunit.client.0.smithi016.stdout:8/676: dread d5/d8/d1a/d24/f4e [0,4194304] 0 2024-08-01T06:56:38.126 INFO:tasks.workunit.client.0.smithi016.stdout:8/677: truncate d5/dc9/fcd 4849217 0 2024-08-01T06:56:38.127 INFO:tasks.workunit.client.0.smithi016.stdout:8/678: chown d5/d8/d1a/f54 3862585 1 2024-08-01T06:56:38.133 INFO:tasks.workunit.client.0.smithi016.stdout:8/679: rename d5/d67/d86 to d5/dc/d3e/d72/de2 0 2024-08-01T06:56:38.135 INFO:tasks.workunit.client.0.smithi016.stdout:8/680: write d5/dc/f4b [1385897,116329] 0 2024-08-01T06:56:38.136 INFO:tasks.workunit.client.0.smithi016.stdout:8/681: stat d5/c5b 0 2024-08-01T06:56:38.142 INFO:tasks.workunit.client.0.smithi016.stdout:7/744: getdents d7/db/d17/d72/d1c 0 2024-08-01T06:56:38.142 INFO:tasks.workunit.client.0.smithi016.stdout:4/796: dwrite d0/d2/f2a [0,4194304] 0 2024-08-01T06:56:38.147 INFO:tasks.workunit.client.0.smithi016.stdout:8/682: mkdir d5/d8/d1a/d24/d48/d60/d63/de3 0 2024-08-01T06:56:38.149 INFO:tasks.workunit.client.0.smithi016.stdout:8/683: read d5/fc5 [105867,21230] 0 2024-08-01T06:56:38.154 INFO:tasks.workunit.client.0.smithi016.stdout:7/745: symlink d7/db/d17/d72/d1c/d1d/d6d/l113 0 2024-08-01T06:56:38.159 INFO:tasks.workunit.client.0.smithi016.stdout:7/746: mknod d7/db/d17/c114 0 2024-08-01T06:56:38.162 INFO:tasks.workunit.client.0.smithi016.stdout:7/747: write d7/db/d17/d72/d1e/d26/d2a/f30 [3262490,39197] 0 2024-08-01T06:56:38.166 INFO:tasks.workunit.client.0.smithi016.stdout:7/748: mkdir d7/db/d17/d72/d1e/d26/d63/dc0/d115 0 2024-08-01T06:56:38.167 INFO:tasks.workunit.client.0.smithi016.stdout:8/684: write d5/d8/d1a/d24/d48/d69/f78 [458646,86986] 0 2024-08-01T06:56:38.167 INFO:tasks.workunit.client.0.smithi016.stdout:4/797: dwrite d0/d2/d36/f9f [0,4194304] 0 2024-08-01T06:56:38.168 INFO:tasks.workunit.client.0.smithi016.stdout:7/749: chown d7/db/d17/d72/d1c/d97 15 1 2024-08-01T06:56:38.170 INFO:tasks.workunit.client.0.smithi016.stdout:7/750: chown d7/db/d17/d72/d1e/d26/c35 9 1 2024-08-01T06:56:38.172 INFO:tasks.workunit.client.0.smithi016.stdout:4/798: truncate d0/d2/dc/d12/dd3/d22/d26/d85/dc1/f6c 4402970 0 2024-08-01T06:56:38.173 INFO:tasks.workunit.client.0.smithi016.stdout:8/685: symlink d5/d8/d1a/d24/d48/d60/d63/de3/le4 0 2024-08-01T06:56:38.176 INFO:tasks.workunit.client.0.smithi016.stdout:7/751: creat d7/db/d17/d72/d1e/d26/d2a/f116 x:0 0 0 2024-08-01T06:56:38.177 INFO:tasks.workunit.client.0.smithi016.stdout:4/799: mkdir d0/d2/dc/d12/dd3/d22/d26/d10e 0 2024-08-01T06:56:38.179 INFO:tasks.workunit.client.0.smithi016.stdout:8/686: truncate d5/d8/d1a/d24/d48/d85/daf/fc6 80943 0 2024-08-01T06:56:38.180 INFO:tasks.workunit.client.0.smithi016.stdout:7/752: truncate d7/db/d17/d72/d1c/d79/d8f/fd8 3987056 0 2024-08-01T06:56:38.181 INFO:tasks.workunit.client.0.smithi016.stdout:4/800: symlink d0/d2/dc/d12/dd3/d22/d26/d8b/l10f 0 2024-08-01T06:56:38.182 INFO:tasks.workunit.client.0.smithi016.stdout:4/801: chown d0/d2/dc/d12/fc6 6888761 1 2024-08-01T06:56:38.184 INFO:tasks.workunit.client.0.smithi016.stdout:8/687: creat d5/dc/d3e/d72/dd8/fe5 x:0 0 0 2024-08-01T06:56:38.184 INFO:tasks.workunit.client.0.smithi016.stdout:7/753: mknod d7/db/d17/d72/d1c/dc6/c117 0 2024-08-01T06:56:38.190 INFO:tasks.workunit.client.0.smithi016.stdout:4/802: mkdir d0/d2/dc/d110 0 2024-08-01T06:56:38.191 INFO:tasks.workunit.client.0.smithi016.stdout:8/688: symlink d5/dc/de1/le6 0 2024-08-01T06:56:38.192 INFO:tasks.workunit.client.0.smithi016.stdout:4/803: read d0/d2/dc/d12/dd3/d22/d26/d8b/faf [3279022,44633] 0 2024-08-01T06:56:38.192 INFO:tasks.workunit.client.0.smithi016.stdout:8/689: fsync d5/dc/d3e/d72/dd8/fae 0 2024-08-01T06:56:38.194 INFO:tasks.workunit.client.0.smithi016.stdout:4/804: read d0/d2/dc/f42 [425803,16661] 0 2024-08-01T06:56:38.194 INFO:tasks.workunit.client.0.smithi016.stdout:8/690: write d5/d8/d75/dba/fc3 [1345770,6276] 0 2024-08-01T06:56:38.197 INFO:tasks.workunit.client.0.smithi016.stdout:1/912: sync 2024-08-01T06:56:38.201 INFO:tasks.workunit.client.0.smithi016.stdout:8/691: dwrite d5/dc/d3e/d72/dd8/fae [0,4194304] 0 2024-08-01T06:56:38.203 INFO:tasks.workunit.client.0.smithi016.stdout:1/913: creat d2/d3/d1c/f145 x:0 0 0 2024-08-01T06:56:38.207 INFO:tasks.workunit.client.0.smithi016.stdout:1/914: symlink d2/d2f/d97/d133/l146 0 2024-08-01T06:56:38.208 INFO:tasks.workunit.client.0.smithi016.stdout:4/805: link d0/d2/dc/d12/dd3/d22/c98 d0/d2/dc/d12/dd3/d22/d26/de0/c111 0 2024-08-01T06:56:38.216 INFO:tasks.workunit.client.0.smithi016.stdout:8/692: getdents d5/d8/d1a/d24/d8c 0 2024-08-01T06:56:38.217 INFO:tasks.workunit.client.0.smithi016.stdout:4/806: dread d0/d2/dc/d12/dd3/d22/d26/d8b/feb [0,4194304] 0 2024-08-01T06:56:38.225 INFO:tasks.workunit.client.0.smithi016.stdout:7/754: dwrite d7/db/d17/d72/d1e/faa [0,4194304] 0 2024-08-01T06:56:38.226 INFO:tasks.workunit.client.0.smithi016.stdout:4/807: creat d0/d2/dc/d90/df3/f112 x:0 0 0 2024-08-01T06:56:38.230 INFO:tasks.workunit.client.0.smithi016.stdout:8/693: dwrite d5/d8/d1a/dbe/fd1 [0,4194304] 0 2024-08-01T06:56:38.231 INFO:tasks.workunit.client.0.smithi016.stdout:4/808: chown d0/d2/dc/d12/dd3/d22/d26/d85/c104 0 1 2024-08-01T06:56:38.232 INFO:tasks.workunit.client.0.smithi016.stdout:1/915: dread d2/de/fc6 [4194304,4194304] 0 2024-08-01T06:56:38.242 INFO:tasks.workunit.client.0.smithi016.stdout:7/755: mkdir d7/db/d17/d72/d1c/d1d/d40/d58/d118 0 2024-08-01T06:56:38.242 INFO:tasks.workunit.client.0.smithi016.stdout:1/916: unlink d2/de/f14 0 2024-08-01T06:56:38.245 INFO:tasks.workunit.client.0.smithi016.stdout:1/917: mknod d2/de/d4d/d92/d10f/d137/d3e/df4/dfb/c147 0 2024-08-01T06:56:38.246 INFO:tasks.workunit.client.0.smithi016.stdout:1/918: chown d2/de/fc6 163 1 2024-08-01T06:56:38.247 INFO:tasks.workunit.client.0.smithi016.stdout:4/809: write d0/d2/dc/d12/dd3/d22/d7f/d93/f95 [971507,39847] 0 2024-08-01T06:56:38.250 INFO:tasks.workunit.client.0.smithi016.stdout:4/810: dread - d0/d2/da0/fb3 zero size 2024-08-01T06:56:38.250 INFO:tasks.workunit.client.0.smithi016.stdout:8/694: write d5/d8/d1a/d24/d48/d60/f79 [1224486,38415] 0 2024-08-01T06:56:38.342 INFO:tasks.workunit.client.0.smithi016.stdout:8/695: rename d5/dc/l77 to d5/dc/d3e/d72/dd8/le7 0 2024-08-01T06:56:38.342 INFO:tasks.workunit.client.0.smithi016.stdout:4/811: write d0/f23 [670726,27555] 0 2024-08-01T06:56:38.343 INFO:tasks.workunit.client.0.smithi016.stdout:1/919: link d2/d3/d1a/d22/ff7 d2/de/d4d/d92/d10f/d137/d3e/dc3/f148 0 2024-08-01T06:56:38.344 INFO:tasks.workunit.client.0.smithi016.stdout:4/812: chown d0/d2/d36/dbd/fe3 976106 1 2024-08-01T06:56:38.345 INFO:tasks.workunit.client.0.smithi016.stdout:8/696: symlink d5/d8/d1a/d24/d48/d6e/d92/le8 0 2024-08-01T06:56:38.349 INFO:tasks.workunit.client.0.smithi016.stdout:4/813: mknod d0/d2/dc/d12/c113 0 2024-08-01T06:56:38.350 INFO:tasks.workunit.client.0.smithi016.stdout:1/920: dwrite d2/de/d4d/d92/fcd [0,4194304] 0 2024-08-01T06:56:38.351 INFO:tasks.workunit.client.0.smithi016.stdout:8/697: creat d5/d8/d1a/fe9 x:0 0 0 2024-08-01T06:56:38.353 INFO:tasks.workunit.client.0.smithi016.stdout:4/814: readlink d0/d2/dc/d12/dd3/d22/d26/d8b/lb5 0 2024-08-01T06:56:38.355 INFO:tasks.workunit.client.0.smithi016.stdout:4/815: chown d0/d2/dc/d12/dd3/d38/lc2 98 1 2024-08-01T06:56:38.357 INFO:tasks.workunit.client.0.smithi016.stdout:1/921: mkdir d2/de/d4d/d92/d149 0 2024-08-01T06:56:38.358 INFO:tasks.workunit.client.0.smithi016.stdout:8/698: creat d5/d8/d1a/d24/d48/d6e/d83/fea x:0 0 0 2024-08-01T06:56:38.361 INFO:tasks.workunit.client.0.smithi016.stdout:8/699: mkdir d5/d8/d1a/d24/d48/d6e/deb 0 2024-08-01T06:56:38.361 INFO:tasks.workunit.client.0.smithi016.stdout:1/922: symlink d2/de/d63/dd6/dde/l14a 0 2024-08-01T06:56:38.362 INFO:tasks.workunit.client.0.smithi016.stdout:8/700: chown d5/d8/d1a/d24/d48/d85 5 1 2024-08-01T06:56:38.363 INFO:tasks.workunit.client.0.smithi016.stdout:4/816: getdents d0/d2/dc/d12/dd3/d22/d26/d85/dc1 0 2024-08-01T06:56:38.366 INFO:tasks.workunit.client.0.smithi016.stdout:1/923: read d2/d2f/d97/d133/d43/f70 [547226,30152] 0 2024-08-01T06:56:38.366 INFO:tasks.workunit.client.0.smithi016.stdout:4/817: write d0/d2/f2a [449081,8499] 0 2024-08-01T06:56:38.402 INFO:tasks.workunit.client.0.smithi016.stdout:8/701: unlink d5/dc/l5f 0 2024-08-01T06:56:38.435 INFO:tasks.workunit.client.0.smithi016.stdout:4/818: truncate d0/d2/dc/d12/dd3/f39 1892372 0 2024-08-01T06:56:38.435 INFO:tasks.workunit.client.0.smithi016.stdout:4/819: chown d0/d2/dc/d110 3 1 2024-08-01T06:56:38.436 INFO:tasks.workunit.client.0.smithi016.stdout:8/702: mkdir d5/d67/dec 0 2024-08-01T06:56:38.437 INFO:tasks.workunit.client.0.smithi016.stdout:4/820: stat d0/d2/dc/d12/dd3/f49 0 2024-08-01T06:56:38.437 INFO:tasks.workunit.client.0.smithi016.stdout:1/924: truncate d2/de/d4d/d92/d10f/d137/d3e/df4/ffa 928841 0 2024-08-01T06:56:38.439 INFO:tasks.workunit.client.0.smithi016.stdout:8/703: mknod d5/d8/d1a/d24/d8c/ced 0 2024-08-01T06:56:38.442 INFO:tasks.workunit.client.0.smithi016.stdout:8/704: rename d5/dc/f4b to d5/dc/d3e/d72/fee 0 2024-08-01T06:56:38.444 INFO:tasks.workunit.client.0.smithi016.stdout:4/821: creat d0/d2/dc/d12/f114 x:0 0 0 2024-08-01T06:56:38.447 INFO:tasks.workunit.client.0.smithi016.stdout:8/705: symlink d5/d8/d1a/d24/d48/d60/d63/db4/lef 0 2024-08-01T06:56:38.449 INFO:tasks.workunit.client.0.smithi016.stdout:8/706: read d5/dc/d3e/d72/dd8/fae [812222,44829] 0 2024-08-01T06:56:38.449 INFO:tasks.workunit.client.0.smithi016.stdout:1/925: dread d2/f2a [0,4194304] 0 2024-08-01T06:56:38.459 INFO:tasks.workunit.client.0.smithi016.stdout:8/707: truncate d5/d8/d75/f9b 164053 0 2024-08-01T06:56:38.477 INFO:tasks.workunit.client.0.smithi016.stdout:4/822: write d0/d2/dc/d12/dd3/d38/f7c [2894866,61626] 0 2024-08-01T06:56:38.485 INFO:tasks.workunit.client.0.smithi016.stdout:1/926: dwrite d2/d3/d41/d49/d85/f11a [4194304,4194304] 0 2024-08-01T06:56:38.491 INFO:tasks.workunit.client.0.smithi016.stdout:4/823: dread d0/d2/dc/d12/dd3/d22/fb0 [0,4194304] 0 2024-08-01T06:56:38.492 INFO:tasks.workunit.client.0.smithi016.stdout:1/927: creat d2/d3/d41/d49/d51/dc5/d124/f14b x:0 0 0 2024-08-01T06:56:38.495 INFO:tasks.workunit.client.0.smithi016.stdout:1/928: mkdir d2/de/d4d/d92/d10f/d137/d14c 0 2024-08-01T06:56:38.496 INFO:tasks.workunit.client.0.smithi016.stdout:1/929: write d2/f2a [3974899,16813] 0 2024-08-01T06:56:38.498 INFO:tasks.workunit.client.0.smithi016.stdout:1/930: fdatasync d2/d88/f114 0 2024-08-01T06:56:38.499 INFO:tasks.workunit.client.0.smithi016.stdout:4/824: link d0/d2/dc/d12/dd3/d22/d73/l59 d0/d2/l115 0 2024-08-01T06:56:38.501 INFO:tasks.workunit.client.0.smithi016.stdout:1/931: dread - d2/de/d6e/fd5 zero size 2024-08-01T06:56:38.503 INFO:tasks.workunit.client.0.smithi016.stdout:4/825: dread d0/d2/dcd/ff5 [0,4194304] 0 2024-08-01T06:56:38.508 INFO:tasks.workunit.client.0.smithi016.stdout:1/932: dwrite d2/d3/d41/d49/d85/dc1/dd8/fdc [0,4194304] 0 2024-08-01T06:56:38.512 INFO:tasks.workunit.client.0.smithi016.stdout:1/933: fdatasync d2/d2f/f75 0 2024-08-01T06:56:38.523 INFO:tasks.workunit.client.0.smithi016.stdout:4/826: truncate d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d91/fdd 4599095 0 2024-08-01T06:56:38.525 INFO:tasks.workunit.client.0.smithi016.stdout:4/827: mkdir d0/d2/dc/d90/df3/d116 0 2024-08-01T06:56:38.531 INFO:tasks.workunit.client.0.smithi016.stdout:1/934: dwrite d2/de/d4d/d92/d10f/d137/d3e/dc3/f148 [0,4194304] 0 2024-08-01T06:56:38.532 INFO:tasks.workunit.client.0.smithi016.stdout:4/828: link d0/d2/dc/d12/dd3/d38/cf1 d0/c117 0 2024-08-01T06:56:38.533 INFO:tasks.workunit.client.0.smithi016.stdout:4/829: dread - d0/d2/dc/d12/dd3/d22/ffe zero size 2024-08-01T06:56:38.537 INFO:tasks.workunit.client.0.smithi016.stdout:4/830: mknod d0/d2/d36/c118 0 2024-08-01T06:56:38.545 INFO:tasks.workunit.client.0.smithi016.stdout:4/831: rename d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/fb6 to d0/d2/f119 0 2024-08-01T06:56:38.547 INFO:tasks.workunit.client.0.smithi016.stdout:1/935: dwrite d2/d3/d41/d49/d51/f73 [0,4194304] 0 2024-08-01T06:56:38.551 INFO:tasks.workunit.client.0.smithi016.stdout:4/832: creat d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/f11a x:0 0 0 2024-08-01T06:56:38.552 INFO:tasks.workunit.client.0.smithi016.stdout:1/936: mkdir d2/de/d4d/d92/d10f/d137/d14c/d14d 0 2024-08-01T06:56:38.556 INFO:tasks.workunit.client.0.smithi016.stdout:1/937: unlink d2/d3/d41/l4b 0 2024-08-01T06:56:38.559 INFO:tasks.workunit.client.0.smithi016.stdout:1/938: fsync d2/f1b 0 2024-08-01T06:56:38.564 INFO:tasks.workunit.client.0.smithi016.stdout:1/939: unlink d2/d3/d41/d49/f83 0 2024-08-01T06:56:38.565 INFO:tasks.workunit.client.0.smithi016.stdout:4/833: getdents d0/d2/da0/dd2/dea 0 2024-08-01T06:56:38.568 INFO:tasks.workunit.client.0.smithi016.stdout:1/940: rename d2/de/d4d/d92/d10f/d137/f112 to d2/de/d4d/d92/d10f/d137/d3e/df4/f14e 0 2024-08-01T06:56:38.572 INFO:tasks.workunit.client.0.smithi016.stdout:1/941: truncate d2/d3/d48/f53 546141 0 2024-08-01T06:56:38.575 INFO:tasks.workunit.client.0.smithi016.stdout:1/942: fsync d2/de/d4d/d92/d10f/d137/d3e/df4/dfb/f13b 0 2024-08-01T06:56:38.579 INFO:tasks.workunit.client.0.smithi016.stdout:1/943: fsync d2/de/f45 0 2024-08-01T06:56:38.582 INFO:tasks.workunit.client.0.smithi016.stdout:1/944: write d2/d88/f107 [3720766,40115] 0 2024-08-01T06:56:38.583 INFO:tasks.workunit.client.0.smithi016.stdout:4/834: dwrite d0/d2/da0/fb3 [0,4194304] 0 2024-08-01T06:56:38.589 INFO:tasks.workunit.client.0.smithi016.stdout:1/945: creat d2/de/d63/dd6/dde/f14f x:0 0 0 2024-08-01T06:56:38.590 INFO:tasks.workunit.client.0.smithi016.stdout:1/946: chown d2/d2f/d97/d133/feb 37 1 2024-08-01T06:56:38.596 INFO:tasks.workunit.client.0.smithi016.stdout:4/835: link d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/f3f d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/d100/dd1/f11b 0 2024-08-01T06:56:38.596 INFO:tasks.workunit.client.0.smithi016.stdout:4/836: readlink d0/l1f 0 2024-08-01T06:56:38.598 INFO:tasks.workunit.client.0.smithi016.stdout:4/837: chown d0/d2/dc/d12/dd3/d22/d26/da3/ff9 154726204 1 2024-08-01T06:56:38.598 INFO:tasks.workunit.client.0.smithi016.stdout:1/947: creat d2/d3/d41/d49/d85/f150 x:0 0 0 2024-08-01T06:56:38.606 INFO:tasks.workunit.client.0.smithi016.stdout:4/838: dwrite d0/d2/dc/f15 [0,4194304] 0 2024-08-01T06:56:38.607 INFO:tasks.workunit.client.0.smithi016.stdout:1/948: dwrite d2/de/d63/f10a [0,4194304] 0 2024-08-01T06:56:38.610 INFO:tasks.workunit.client.0.smithi016.stdout:1/949: readlink d2/d3/d41/d49/d85/dc1/l122 0 2024-08-01T06:56:38.615 INFO:tasks.workunit.client.0.smithi016.stdout:1/950: unlink d2/de/d63/fdb 0 2024-08-01T06:56:38.619 INFO:tasks.workunit.client.0.smithi016.stdout:1/951: creat d2/de/dc4/f151 x:0 0 0 2024-08-01T06:56:38.625 INFO:tasks.workunit.client.0.smithi016.stdout:1/952: unlink d2/de/d6e/f8a 0 2024-08-01T06:56:38.627 INFO:tasks.workunit.client.0.smithi016.stdout:1/953: creat d2/d3/d41/f152 x:0 0 0 2024-08-01T06:56:38.640 INFO:tasks.workunit.client.0.smithi016.stdout:4/839: dread d0/d2/dc/d12/dd3/d22/d7f/fc5 [4194304,4194304] 0 2024-08-01T06:56:38.643 INFO:tasks.workunit.client.0.smithi016.stdout:4/840: fdatasync d0/d2/dc/d12/dd3/d22/f35 0 2024-08-01T06:56:38.651 INFO:tasks.workunit.client.0.smithi016.stdout:4/841: write d0/d2/d36/dbd/fce [1036761,23837] 0 2024-08-01T06:56:38.654 INFO:tasks.workunit.client.0.smithi016.stdout:1/954: dread d2/d3/d41/fb4 [0,4194304] 0 2024-08-01T06:56:38.657 INFO:tasks.workunit.client.0.smithi016.stdout:1/955: mknod d2/de/d4d/d92/c153 0 2024-08-01T06:56:38.657 INFO:tasks.workunit.client.0.smithi016.stdout:4/842: dread d0/d2/dc/d12/dd3/d22/fc8 [0,4194304] 0 2024-08-01T06:56:38.660 INFO:tasks.workunit.client.0.smithi016.stdout:1/956: rename d2/de/d63/f10a to d2/d3/d1f/f154 0 2024-08-01T06:56:38.661 INFO:tasks.workunit.client.0.smithi016.stdout:4/843: fsync d0/d2/d68/f6f 0 2024-08-01T06:56:38.667 INFO:tasks.workunit.client.0.smithi016.stdout:1/957: getdents d2/d3/d118 0 2024-08-01T06:56:38.668 INFO:tasks.workunit.client.0.smithi016.stdout:4/844: dwrite d0/d2/d36/dbd/f10a [0,4194304] 0 2024-08-01T06:56:38.669 INFO:tasks.workunit.client.0.smithi016.stdout:1/958: readlink d2/de/d4d/d92/d10f/d137/l100 0 2024-08-01T06:56:38.677 INFO:tasks.workunit.client.0.smithi016.stdout:1/959: write d2/f72 [495950,98315] 0 2024-08-01T06:56:38.690 INFO:tasks.workunit.client.0.smithi016.stdout:1/960: dread d2/d3/d41/d49/d85/dc1/f143 [0,4194304] 0 2024-08-01T06:56:38.692 INFO:tasks.workunit.client.0.smithi016.stdout:1/961: symlink d2/de/d63/dd6/dff/l155 0 2024-08-01T06:56:38.695 INFO:tasks.workunit.client.0.smithi016.stdout:1/962: rename d2/de/d4d/d92/d10f/d137/d3e/f4a to d2/de/d4d/d92/d10f/d137/d3e/dc3/f156 0 2024-08-01T06:56:38.699 INFO:tasks.workunit.client.0.smithi016.stdout:1/963: rename d2/de/d4d/d92/d10f/d137/f5b to d2/de/d4d/d92/d10f/d137/d14c/d14d/f157 0 2024-08-01T06:56:38.706 INFO:tasks.workunit.client.0.smithi016.stdout:1/964: getdents d2/d3/d41/d49/d85/df1 0 2024-08-01T06:56:38.708 INFO:tasks.workunit.client.0.smithi016.stdout:1/965: dread d2/d2f/d97/d133/d43/f70 [0,4194304] 0 2024-08-01T06:56:38.710 INFO:tasks.workunit.client.0.smithi016.stdout:1/966: symlink d2/d3/d1c/l158 0 2024-08-01T06:56:38.712 INFO:tasks.workunit.client.0.smithi016.stdout:1/967: creat d2/de/d4d/d92/d10f/d137/d14c/d14d/f159 x:0 0 0 2024-08-01T06:56:38.713 INFO:tasks.workunit.client.0.smithi016.stdout:1/968: creat d2/d3/d41/f15a x:0 0 0 2024-08-01T06:56:38.715 INFO:tasks.workunit.client.0.smithi016.stdout:1/969: unlink d2/de/d63/ff2 0 2024-08-01T06:56:38.718 INFO:tasks.workunit.client.0.smithi016.stdout:1/970: unlink d2/d3/d1a/d22/f3d 0 2024-08-01T06:56:38.730 INFO:tasks.workunit.client.0.smithi016.stdout:1/971: dwrite d2/de/d6e/fd5 [0,4194304] 0 2024-08-01T06:56:38.736 INFO:tasks.workunit.client.0.smithi016.stdout:1/972: rename d2/d3/d41/d49/d85/df1/f108 to d2/d2f/d97/d133/d43/f15b 0 2024-08-01T06:56:38.742 INFO:tasks.workunit.client.0.smithi016.stdout:1/973: mknod d2/d3/d48/d12e/c15c 0 2024-08-01T06:56:38.745 INFO:tasks.workunit.client.0.smithi016.stdout:1/974: creat d2/de/d4d/d92/d149/f15d x:0 0 0 2024-08-01T06:56:38.747 INFO:tasks.workunit.client.0.smithi016.stdout:1/975: symlink d2/d3/d41/d49/d85/dc1/dd8/l15e 0 2024-08-01T06:56:38.751 INFO:tasks.workunit.client.0.smithi016.stdout:1/976: write d2/d2f/d97/d133/d43/f15b [3792895,92489] 0 2024-08-01T06:56:38.755 INFO:tasks.workunit.client.0.smithi016.stdout:1/977: dread d2/de/d4d/d92/d10f/d137/d3e/dc3/f148 [0,4194304] 0 2024-08-01T06:56:39.136 INFO:tasks.workunit.client.0.smithi016.stdout:0/870: sync 2024-08-01T06:56:39.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:38 smithi089 ceph-mon[36617]: pgmap v33: 65 pgs: 65 active+clean; 1.7 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 31 MiB/s rd, 85 MiB/s wr, 246 op/s 2024-08-01T06:56:39.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:38 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:56:39.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:38 smithi016 ceph-mon[29266]: pgmap v33: 65 pgs: 65 active+clean; 1.7 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 31 MiB/s rd, 85 MiB/s wr, 246 op/s 2024-08-01T06:56:39.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:38 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:56:39.194 INFO:tasks.workunit.client.0.smithi016.stdout:0/871: creat d10/d5c/d90/da2/da5/de8/deb/f11c x:0 0 0 2024-08-01T06:56:39.195 INFO:tasks.workunit.client.0.smithi016.stdout:0/872: stat d10/d11/d37/l5d 0 2024-08-01T06:56:39.202 INFO:tasks.workunit.client.0.smithi016.stdout:0/873: dwrite d10/d1c/f46 [0,4194304] 0 2024-08-01T06:56:39.233 INFO:tasks.workunit.client.0.smithi016.stdout:0/874: dread d10/d11/d37/d58/fde [0,4194304] 0 2024-08-01T06:56:39.237 INFO:tasks.workunit.client.0.smithi016.stdout:0/875: mkdir d10/d11/d41/df4/d11d 0 2024-08-01T06:56:39.243 INFO:tasks.workunit.client.0.smithi016.stdout:0/876: dwrite d10/d11/ddd/f11b [0,4194304] 0 2024-08-01T06:56:39.251 INFO:tasks.workunit.client.0.smithi016.stdout:3/695: sync 2024-08-01T06:56:39.251 INFO:tasks.workunit.client.0.smithi016.stdout:2/957: sync 2024-08-01T06:56:39.251 INFO:tasks.workunit.client.0.smithi016.stdout:5/875: sync 2024-08-01T06:56:39.255 INFO:tasks.workunit.client.0.smithi016.stdout:3/696: symlink d9/d98/lf4 0 2024-08-01T06:56:39.261 INFO:tasks.workunit.client.0.smithi016.stdout:5/876: mknod d1/d2/d20/c12d 0 2024-08-01T06:56:39.266 INFO:tasks.workunit.client.0.smithi016.stdout:2/958: creat d0/d8/d31/da7/dd4/f13d x:0 0 0 2024-08-01T06:56:39.266 INFO:tasks.workunit.client.0.smithi016.stdout:2/959: readlink d0/d8/d1b/d74/l8e 0 2024-08-01T06:56:39.282 INFO:tasks.workunit.client.0.smithi016.stdout:0/877: mkdir d10/d11/d37/d50/d11e 0 2024-08-01T06:56:39.285 INFO:tasks.workunit.client.0.smithi016.stdout:5/877: dread d1/d2/d6/d9/d49/d57/d110/f66 [0,4194304] 0 2024-08-01T06:56:39.287 INFO:tasks.workunit.client.0.smithi016.stdout:9/853: sync 2024-08-01T06:56:39.287 INFO:tasks.workunit.client.0.smithi016.stdout:7/756: sync 2024-08-01T06:56:39.287 INFO:tasks.workunit.client.0.smithi016.stdout:6/891: sync 2024-08-01T06:56:39.287 INFO:tasks.workunit.client.0.smithi016.stdout:8/708: sync 2024-08-01T06:56:39.287 INFO:tasks.workunit.client.0.smithi016.stdout:1/978: sync 2024-08-01T06:56:39.288 INFO:tasks.workunit.client.0.smithi016.stdout:4/845: sync 2024-08-01T06:56:39.293 INFO:tasks.workunit.client.0.smithi016.stdout:5/878: dread d1/d2/d6/d9/d49/d57/d110/fa9 [0,4194304] 0 2024-08-01T06:56:39.294 INFO:tasks.workunit.client.0.smithi016.stdout:9/854: creat d3/d32/d5c/d8a/f113 x:0 0 0 2024-08-01T06:56:39.296 INFO:tasks.workunit.client.0.smithi016.stdout:1/979: creat d2/d3/d1c/de1/d106/f15f x:0 0 0 2024-08-01T06:56:39.304 INFO:tasks.workunit.client.0.smithi016.stdout:0/878: getdents d10/d1c/d7c 0 2024-08-01T06:56:39.306 INFO:tasks.workunit.client.0.smithi016.stdout:9/855: dread d3/d9/db/d3e/d40/f4b [0,4194304] 0 2024-08-01T06:56:39.307 INFO:tasks.workunit.client.0.smithi016.stdout:8/709: rename d5/dc/d3e/d72 to d5/d8/d1a/d24/d48/d85/daf/df0 0 2024-08-01T06:56:39.314 INFO:tasks.workunit.client.0.smithi016.stdout:9/856: dwrite d3/de/d89/f10e [0,4194304] 0 2024-08-01T06:56:39.315 INFO:tasks.workunit.client.0.smithi016.stdout:4/846: mknod d0/d9d/df7/c11c 0 2024-08-01T06:56:39.319 INFO:tasks.workunit.client.0.smithi016.stdout:6/892: symlink d1/d8/d1b/db5/d67/d8f/dba/dbd/l138 0 2024-08-01T06:56:39.326 INFO:tasks.workunit.client.0.smithi016.stdout:1/980: rename d2/d3/d1c/de1/d106/f111 to d2/de/d4d/d92/d10f/d137/d13a/f160 0 2024-08-01T06:56:39.328 INFO:tasks.workunit.client.0.smithi016.stdout:1/981: write d2/de/d4d/d92/d10f/d137/d14c/d14d/f159 [817959,76391] 0 2024-08-01T06:56:39.329 INFO:tasks.workunit.client.0.smithi016.stdout:1/982: readlink d2/d3/l13 0 2024-08-01T06:56:39.336 INFO:tasks.workunit.client.0.smithi016.stdout:1/983: dwrite d2/d3/d41/f15a [0,4194304] 0 2024-08-01T06:56:39.336 INFO:tasks.workunit.client.0.smithi016.stdout:9/857: chown d3/d32/d5c/d8a/f75 3 1 2024-08-01T06:56:39.337 INFO:tasks.workunit.client.0.smithi016.stdout:9/858: chown d3/d9/db/d3a 42868657 1 2024-08-01T06:56:39.341 INFO:tasks.workunit.client.0.smithi016.stdout:9/859: dread - d3/d9/db/dc/d56/d9b/fb9 zero size 2024-08-01T06:56:39.346 INFO:tasks.workunit.client.0.smithi016.stdout:1/984: unlink d2/de/d4d/d92/d10f/d137/f12f 0 2024-08-01T06:56:39.348 INFO:tasks.workunit.client.0.smithi016.stdout:9/860: symlink d3/d32/d5c/d8a/l114 0 2024-08-01T06:56:39.351 INFO:tasks.workunit.client.0.smithi016.stdout:1/985: mknod d2/d3/d41/d49/d85/dc1/dd8/c161 0 2024-08-01T06:56:39.352 INFO:tasks.workunit.client.0.smithi016.stdout:9/861: rmdir d3/d9/db/dc/d56 39 2024-08-01T06:56:39.353 INFO:tasks.workunit.client.0.smithi016.stdout:1/986: unlink d2/de/d63/lf5 0 2024-08-01T06:56:39.354 INFO:tasks.workunit.client.0.smithi016.stdout:9/862: rmdir d3/d9/d46/d48/d87/df9 39 2024-08-01T06:56:39.357 INFO:tasks.workunit.client.0.smithi016.stdout:5/879: creat d1/d2/d6/d9/f12e x:0 0 0 2024-08-01T06:56:39.358 INFO:tasks.workunit.client.0.smithi016.stdout:1/987: mknod d2/d3/d118/c162 0 2024-08-01T06:56:39.360 INFO:tasks.workunit.client.0.smithi016.stdout:5/880: creat d1/d2/d20/db8/f12f x:0 0 0 2024-08-01T06:56:39.360 INFO:tasks.workunit.client.0.smithi016.stdout:2/960: mknod d0/d8/c13e 0 2024-08-01T06:56:39.361 INFO:tasks.workunit.client.0.smithi016.stdout:1/988: mknod d2/d3/d41/c163 0 2024-08-01T06:56:39.363 INFO:tasks.workunit.client.0.smithi016.stdout:0/879: rename d10/d5c/d90/da2/da5/de8/deb/f11c to d10/d11/d37/f11f 0 2024-08-01T06:56:39.364 INFO:tasks.workunit.client.0.smithi016.stdout:5/881: chown d1/d2/d20/ff1 88801 1 2024-08-01T06:56:39.366 INFO:tasks.workunit.client.0.smithi016.stdout:2/961: mkdir d0/d8/d31/da7/db4/d13f 0 2024-08-01T06:56:39.367 INFO:tasks.workunit.client.0.smithi016.stdout:1/989: creat d2/d3/d41/f164 x:0 0 0 2024-08-01T06:56:39.369 INFO:tasks.workunit.client.0.smithi016.stdout:5/882: creat d1/d12/ddd/f130 x:0 0 0 2024-08-01T06:56:39.369 INFO:tasks.workunit.client.0.smithi016.stdout:0/880: dread d10/d11/d37/d82/d9b/f106 [0,4194304] 0 2024-08-01T06:56:39.369 INFO:tasks.workunit.client.0.smithi016.stdout:1/990: chown d2/de/fc6 58840988 1 2024-08-01T06:56:39.370 INFO:tasks.workunit.client.0.smithi016.stdout:9/863: dread d3/d9/df/f3d [0,4194304] 0 2024-08-01T06:56:39.370 INFO:tasks.workunit.client.0.smithi016.stdout:2/962: readlink d0/d8/d31/dc7/lef 0 2024-08-01T06:56:39.373 INFO:tasks.workunit.client.0.smithi016.stdout:1/991: dread - d2/d3/d1a/f121 zero size 2024-08-01T06:56:39.374 INFO:tasks.workunit.client.0.smithi016.stdout:9/864: creat d3/d9/db/d3a/dd8/f115 x:0 0 0 2024-08-01T06:56:39.375 INFO:tasks.workunit.client.0.smithi016.stdout:0/881: read d10/d11/d37/d50/db1/fcd [1617304,37039] 0 2024-08-01T06:56:39.378 INFO:tasks.workunit.client.0.smithi016.stdout:2/963: unlink d0/d8/d31/da7/ddf/fee 0 2024-08-01T06:56:39.378 INFO:tasks.workunit.client.0.smithi016.stdout:3/697: dwrite d9/da/df/d2a/d49/d61/f6e [0,4194304] 0 2024-08-01T06:56:39.379 INFO:tasks.workunit.client.0.smithi016.stdout:2/964: fdatasync d0/dc3/f11e 0 2024-08-01T06:56:39.379 INFO:tasks.workunit.client.0.smithi016.stdout:1/992: write d2/d3/d1f/f154 [4352917,72235] 0 2024-08-01T06:56:39.384 INFO:tasks.workunit.client.0.smithi016.stdout:9/865: dread - d3/d9/db/dc/d56/fdf zero size 2024-08-01T06:56:39.387 INFO:tasks.workunit.client.0.smithi016.stdout:3/698: dread d9/da/d18/fa7 [0,4194304] 0 2024-08-01T06:56:39.389 INFO:tasks.workunit.client.0.smithi016.stdout:9/866: rename d3/d9/df/d16/d94/da5 to d3/d9/df/d16/d94/da5/d116 22 2024-08-01T06:56:39.393 INFO:tasks.workunit.client.0.smithi016.stdout:1/993: truncate d2/d3/d41/d49/d85/dc1/f143 1480463 0 2024-08-01T06:56:39.394 INFO:tasks.workunit.client.0.smithi016.stdout:5/883: getdents d1/d2/d6/d9/d49/d57/db1 0 2024-08-01T06:56:39.395 INFO:tasks.workunit.client.0.smithi016.stdout:5/884: chown d1/d12/ddd 0 1 2024-08-01T06:56:39.396 INFO:tasks.workunit.client.0.smithi016.stdout:9/867: creat d3/d9/d73/dfb/f117 x:0 0 0 2024-08-01T06:56:39.397 INFO:tasks.workunit.client.0.smithi016.stdout:9/868: stat d3/d9/df/d16/d94/l10b 0 2024-08-01T06:56:39.398 INFO:tasks.workunit.client.0.smithi016.stdout:1/994: rename d2/d3/d1a/d22/fea to d2/d2f/d97/d133/d138/f165 0 2024-08-01T06:56:39.399 INFO:tasks.workunit.client.0.smithi016.stdout:1/995: dread - d2/d3/f34 zero size 2024-08-01T06:56:39.400 INFO:tasks.workunit.client.0.smithi016.stdout:1/996: chown d2/d2f/l69 7 1 2024-08-01T06:56:39.401 INFO:tasks.workunit.client.0.smithi016.stdout:5/885: mkdir d1/d2/d6/d131 0 2024-08-01T06:56:39.405 INFO:tasks.workunit.client.0.smithi016.stdout:9/869: rename d3/d9/d73/ce6 to d3/d9/df/d16/d94/da5/c118 0 2024-08-01T06:56:39.407 INFO:tasks.workunit.client.0.smithi016.stdout:9/870: truncate d3/d9/d46/d103/f10d 396723 0 2024-08-01T06:56:39.412 INFO:tasks.workunit.client.0.smithi016.stdout:3/699: dread d9/da/f47 [0,4194304] 0 2024-08-01T06:56:39.419 INFO:tasks.workunit.client.0.smithi016.stdout:7/757: dwrite d7/db/d17/d72/d22/d77/d99/dd1/ddc/ff8 [0,4194304] 0 2024-08-01T06:56:39.423 INFO:tasks.workunit.client.0.smithi016.stdout:3/700: dwrite d9/d3e/d80/fec [0,4194304] 0 2024-08-01T06:56:39.428 INFO:tasks.workunit.client.0.smithi016.stdout:7/758: write d7/db/d17/d72/d22/db4/ff7 [535641,34332] 0 2024-08-01T06:56:39.429 INFO:tasks.workunit.client.0.smithi016.stdout:8/710: dwrite d5/d8/d1a/d24/d48/d85/daf/df0/de2/faa [0,4194304] 0 2024-08-01T06:56:39.433 INFO:tasks.workunit.client.0.smithi016.stdout:8/711: readlink d5/d8/d1a/d24/d48/l62 0 2024-08-01T06:56:39.435 INFO:tasks.workunit.client.0.smithi016.stdout:4/847: dwrite d0/d2/dc/d12/dd3/f49 [0,4194304] 0 2024-08-01T06:56:39.437 INFO:tasks.workunit.client.0.smithi016.stdout:6/893: dwrite d1/d8/d1b/d22/d36/d7a/dd3/fbb [0,4194304] 0 2024-08-01T06:56:39.459 INFO:tasks.workunit.client.0.smithi016.stdout:0/882: dwrite d10/d1c/d7c/f8f [0,4194304] 0 2024-08-01T06:56:39.463 INFO:tasks.workunit.client.0.smithi016.stdout:2/965: dwrite d0/d8/f52 [0,4194304] 0 2024-08-01T06:56:39.487 INFO:tasks.workunit.client.0.smithi016.stdout:5/886: rmdir d1/d2/d6/d9/d19/d7a/dc5/dd0 39 2024-08-01T06:56:39.490 INFO:tasks.workunit.client.0.smithi016.stdout:1/997: rename d2/d3/d41/d49/f60 to d2/de/d4d/d92/f166 0 2024-08-01T06:56:39.492 INFO:tasks.workunit.client.0.smithi016.stdout:9/871: unlink d3/d9/d46/f4a 0 2024-08-01T06:56:39.499 INFO:tasks.workunit.client.0.smithi016.stdout:5/887: dread d1/d2/d6/f6b [0,4194304] 0 2024-08-01T06:56:39.501 INFO:tasks.workunit.client.0.smithi016.stdout:5/888: stat d1/d2/d6/d9/d19/l2c 0 2024-08-01T06:56:39.504 INFO:tasks.workunit.client.0.smithi016.stdout:0/883: fsync d10/d11/d37/d82/fb2 0 2024-08-01T06:56:39.504 INFO:tasks.workunit.client.0.smithi016.stdout:4/848: dread d0/d2/dc/d12/dd3/f30 [0,4194304] 0 2024-08-01T06:56:39.508 INFO:tasks.workunit.client.0.smithi016.stdout:1/998: dread - d2/d88/fbc zero size 2024-08-01T06:56:39.509 INFO:tasks.workunit.client.0.smithi016.stdout:9/872: mkdir d3/d9/db/dc/d56/d119 0 2024-08-01T06:56:39.511 INFO:tasks.workunit.client.0.smithi016.stdout:9/873: write d3/d32/d5c/d8a/f113 [28700,52900] 0 2024-08-01T06:56:39.512 INFO:tasks.workunit.client.0.smithi016.stdout:2/966: dwrite d0/d8/f11 [4194304,4194304] 0 2024-08-01T06:56:39.517 INFO:tasks.workunit.client.0.smithi016.stdout:5/889: mkdir d1/d2/d20/db8/d132 0 2024-08-01T06:56:39.520 INFO:tasks.workunit.client.0.smithi016.stdout:5/890: readlink d1/d2/d20/d38/lc0 0 2024-08-01T06:56:39.523 INFO:tasks.workunit.client.0.smithi016.stdout:3/701: rename d9/da/df/d12/l23 to d9/d3e/d40/d58/d59/lf5 0 2024-08-01T06:56:39.525 INFO:tasks.workunit.client.0.smithi016.stdout:2/967: truncate d0/d8/d31/f51 2848872 0 2024-08-01T06:56:39.528 INFO:tasks.workunit.client.0.smithi016.stdout:0/884: symlink d10/d5c/d90/da2/da5/de8/deb/dec/d108/l120 0 2024-08-01T06:56:39.528 INFO:tasks.workunit.client.0.smithi016.stdout:0/885: chown d10 5 1 2024-08-01T06:56:39.529 INFO:tasks.workunit.client.0.smithi016.stdout:0/886: readlink d10/d11/d37/d82/lad 0 2024-08-01T06:56:39.530 INFO:tasks.workunit.client.0.smithi016.stdout:5/891: mknod d1/d2/d20/d38/c133 0 2024-08-01T06:56:39.531 INFO:tasks.workunit.client.0.smithi016.stdout:8/712: rename d5/dc/fbc to d5/d8/d1a/d24/d8c/ff1 0 2024-08-01T06:56:39.532 INFO:tasks.workunit.client.0.smithi016.stdout:7/759: getdents d7/db/d17/d72/d1c/d1d/d40/d67/d7c/d8d 0 2024-08-01T06:56:39.534 INFO:tasks.workunit.client.0.smithi016.stdout:3/702: creat d9/da/df/d12/da0/da5/ff6 x:0 0 0 2024-08-01T06:56:39.538 INFO:tasks.workunit.client.0.smithi016.stdout:5/892: dwrite d1/d2/d23/f32 [0,4194304] 0 2024-08-01T06:56:39.544 INFO:tasks.workunit.client.0.smithi016.stdout:9/874: link d3/de/f7a d3/d9/db/d3e/d40/d80/f11a 0 2024-08-01T06:56:39.546 INFO:tasks.workunit.client.0.smithi016.stdout:0/887: dread d10/f2e [0,4194304] 0 2024-08-01T06:56:39.549 INFO:tasks.workunit.client.0.smithi016.stdout:9/875: symlink d3/d9/db/d3a/l11b 0 2024-08-01T06:56:39.554 INFO:tasks.workunit.client.0.smithi016.stdout:7/760: rename d7/db/d17/d4e to d7/db/d17/d72/d1e/d26/d63/d119 0 2024-08-01T06:56:39.554 INFO:tasks.workunit.client.0.smithi016.stdout:0/888: dwrite d10/d11/d37/d50/f77 [0,4194304] 0 2024-08-01T06:56:39.558 INFO:tasks.workunit.client.0.smithi016.stdout:3/703: rename d9/da/df/c4d to d9/da/df/cf7 0 2024-08-01T06:56:39.560 INFO:tasks.workunit.client.0.smithi016.stdout:5/893: rename d1/d2/d20/d72/l98 to d1/d2/d6/d5a/l134 0 2024-08-01T06:56:39.564 INFO:tasks.workunit.client.0.smithi016.stdout:0/889: creat d10/d1c/d7c/f121 x:0 0 0 2024-08-01T06:56:39.564 INFO:tasks.workunit.client.0.smithi016.stdout:4/849: write d0/d2/d36/f56 [1736053,121149] 0 2024-08-01T06:56:39.566 INFO:tasks.workunit.client.0.smithi016.stdout:3/704: creat d9/da/df/d2a/d49/d61/ff8 x:0 0 0 2024-08-01T06:56:39.570 INFO:tasks.workunit.client.0.smithi016.stdout:5/894: creat d1/d2/d20/d72/f135 x:0 0 0 2024-08-01T06:56:39.570 INFO:tasks.workunit.client.0.smithi016.stdout:7/761: dread d7/db/d17/d72/d1e/f69 [0,4194304] 0 2024-08-01T06:56:39.571 INFO:tasks.workunit.client.0.smithi016.stdout:6/894: dwrite d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/d91/fd4 [0,4194304] 0 2024-08-01T06:56:39.573 INFO:tasks.workunit.client.0.smithi016.stdout:7/762: chown d7/db/d17/d72/d1c/d1d/d40/d7f 1399 1 2024-08-01T06:56:39.575 INFO:tasks.workunit.client.0.smithi016.stdout:4/850: symlink d0/db9/l11d 0 2024-08-01T06:56:39.575 INFO:tasks.workunit.client.0.smithi016.stdout:6/895: chown d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/lcc 113 1 2024-08-01T06:56:39.577 INFO:tasks.workunit.client.0.smithi016.stdout:0/890: fsync d10/d11/d37/f7d 0 2024-08-01T06:56:39.580 INFO:tasks.workunit.client.0.smithi016.stdout:8/713: write d5/d8/d1a/d24/d48/d60/f66 [115791,100018] 0 2024-08-01T06:56:39.583 INFO:tasks.workunit.client.0.smithi016.stdout:5/895: dwrite d1/d2/d20/d72/f116 [0,4194304] 0 2024-08-01T06:56:39.584 INFO:tasks.workunit.client.0.smithi016.stdout:3/705: creat d9/d1c/da4/ff9 x:0 0 0 2024-08-01T06:56:39.588 INFO:tasks.workunit.client.0.smithi016.stdout:2/968: dwrite d0/d8/d1b/fb1 [0,4194304] 0 2024-08-01T06:56:39.597 INFO:tasks.workunit.client.0.smithi016.stdout:9/876: write d3/d32/d5c/d8a/d57/f82 [178500,48142] 0 2024-08-01T06:56:39.599 INFO:tasks.workunit.client.0.smithi016.stdout:6/896: fdatasync d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/f7c 0 2024-08-01T06:56:39.602 INFO:tasks.workunit.client.0.smithi016.stdout:0/891: dread d10/d1c/f20 [0,4194304] 0 2024-08-01T06:56:39.603 INFO:tasks.workunit.client.0.smithi016.stdout:0/892: stat d10/d11/d37/d58/f81 0 2024-08-01T06:56:39.607 INFO:tasks.workunit.client.0.smithi016.stdout:3/706: dread - d9/d3e/d40/d58/d59/fba zero size 2024-08-01T06:56:39.610 INFO:tasks.workunit.client.0.smithi016.stdout:5/896: dread d1/d2/d23/f26 [0,4194304] 0 2024-08-01T06:56:39.611 INFO:tasks.workunit.client.0.smithi016.stdout:3/707: dread d9/da/f47 [0,4194304] 0 2024-08-01T06:56:39.613 INFO:tasks.workunit.client.0.smithi016.stdout:4/851: write d0/d2/dc/d12/dd3/d22/d7f/d93/fa1 [1954095,764] 0 2024-08-01T06:56:39.615 INFO:tasks.workunit.client.0.smithi016.stdout:9/877: dread d3/d9/d46/d48/d8b/f107 [0,4194304] 0 2024-08-01T06:56:39.615 INFO:tasks.workunit.client.0.smithi016.stdout:8/714: rename d5/d8/d1a/l4d to d5/d8/d1a/d24/lf2 0 2024-08-01T06:56:39.618 INFO:tasks.workunit.client.0.smithi016.stdout:4/852: chown d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/d100/dd1/f11b 6702 1 2024-08-01T06:56:39.619 INFO:tasks.workunit.client.0.smithi016.stdout:5/897: symlink d1/d2/d6/d9/d19/d7a/l136 0 2024-08-01T06:56:39.620 INFO:tasks.workunit.client.0.smithi016.stdout:2/969: write d0/d8/d1b/d74/d90/d93/f4d [663432,71131] 0 2024-08-01T06:56:39.621 INFO:tasks.workunit.client.0.smithi016.stdout:3/708: symlink d9/d1c/da4/lfa 0 2024-08-01T06:56:39.623 INFO:tasks.workunit.client.0.smithi016.stdout:0/893: rename c1 to d10/d1c/c122 0 2024-08-01T06:56:39.625 INFO:tasks.workunit.client.0.smithi016.stdout:7/763: dwrite d7/db/d17/d72/d1c/d1d/f65 [4194304,4194304] 0 2024-08-01T06:56:39.625 INFO:tasks.workunit.client.0.smithi016.stdout:3/709: chown d9/da/df/d2a/d49/d61/ff8 509 1 2024-08-01T06:56:39.626 INFO:tasks.workunit.client.0.smithi016.stdout:8/715: mknod d5/d8/d1a/d24/d48/d85/da8/cf3 0 2024-08-01T06:56:39.634 INFO:tasks.workunit.client.0.smithi016.stdout:0/894: dwrite d10/f5a [0,4194304] 0 2024-08-01T06:56:39.634 INFO:tasks.workunit.client.0.smithi016.stdout:9/878: write d3/d9/df/f2d [5233672,54685] 0 2024-08-01T06:56:39.638 INFO:tasks.workunit.client.0.smithi016.stdout:5/898: mkdir d1/df6/d12b/d137 0 2024-08-01T06:56:39.641 INFO:tasks.workunit.client.0.smithi016.stdout:4/853: dwrite d0/db9/fdf [4194304,4194304] 0 2024-08-01T06:56:39.649 INFO:tasks.workunit.client.0.smithi016.stdout:5/899: truncate d1/d2/d6/d5a/dfc/f105 1030502 0 2024-08-01T06:56:39.650 INFO:tasks.workunit.client.0.smithi016.stdout:8/716: creat d5/d8/d75/ff4 x:0 0 0 2024-08-01T06:56:39.653 INFO:tasks.workunit.client.0.smithi016.stdout:2/970: dwrite d0/d8/d1b/dd9/dfc/fff [0,4194304] 0 2024-08-01T06:56:39.660 INFO:tasks.workunit.client.0.smithi016.stdout:7/764: dread d7/db/f44 [0,4194304] 0 2024-08-01T06:56:39.661 INFO:tasks.workunit.client.0.smithi016.stdout:0/895: truncate fd 204621 0 2024-08-01T06:56:39.664 INFO:tasks.workunit.client.0.smithi016.stdout:9/879: rename d3/d9/df/d38 to d3/d9/db/d3e/d40/d4e/d11c 0 2024-08-01T06:56:39.666 INFO:tasks.workunit.client.0.smithi016.stdout:2/971: dwrite d0/d8/d6b/fe8 [0,4194304] 0 2024-08-01T06:56:39.669 INFO:tasks.workunit.client.0.smithi016.stdout:8/717: mkdir d5/d8/d1a/d24/d48/d6e/d92/df5 0 2024-08-01T06:56:39.673 INFO:tasks.workunit.client.0.smithi016.stdout:7/765: dwrite d7/db3/ff4 [0,4194304] 0 2024-08-01T06:56:39.676 INFO:tasks.workunit.client.0.smithi016.stdout:3/710: getdents d9/da/df/d12/d75 0 2024-08-01T06:56:39.680 INFO:tasks.workunit.client.0.smithi016.stdout:4/854: dwrite d0/d2/dc/f34 [4194304,4194304] 0 2024-08-01T06:56:39.680 INFO:tasks.workunit.client.0.smithi016.stdout:3/711: write d9/da/df/d12/d20/d3c/f4b [109185,41732] 0 2024-08-01T06:56:39.682 INFO:tasks.workunit.client.0.smithi016.stdout:3/712: dread - d9/d57/fd3 zero size 2024-08-01T06:56:39.683 INFO:tasks.workunit.client.0.smithi016.stdout:3/713: write d9/d1c/da4/ff9 [459653,90542] 0 2024-08-01T06:56:39.683 INFO:tasks.workunit.client.0.smithi016.stdout:0/896: mkdir d10/d5c/d123 0 2024-08-01T06:56:39.685 INFO:tasks.workunit.client.0.smithi016.stdout:0/897: chown d10/d5c/l6a 2258266 1 2024-08-01T06:56:39.689 INFO:tasks.workunit.client.0.smithi016.stdout:2/972: rmdir d0/d8/d1b/dcc/d3b 39 2024-08-01T06:56:39.692 INFO:tasks.workunit.client.0.smithi016.stdout:5/900: link d1/d2/d6/d9/d1b/dda/df0/f109 d1/d2/d6/d5a/d65/f138 0 2024-08-01T06:56:39.692 INFO:tasks.workunit.client.0.smithi016.stdout:5/901: readlink d1/d12/l11d 0 2024-08-01T06:56:39.698 INFO:tasks.workunit.client.0.smithi016.stdout:3/714: rename d9/d4e to d9/da/df/d12/d20/d5c/d76/dfb 0 2024-08-01T06:56:39.701 INFO:tasks.workunit.client.0.smithi016.stdout:0/898: mknod d10/d11/d41/df4/c124 0 2024-08-01T06:56:39.702 INFO:tasks.workunit.client.0.smithi016.stdout:7/766: dwrite d7/db/d17/d72/d1c/d79/fb0 [4194304,4194304] 0 2024-08-01T06:56:39.707 INFO:tasks.workunit.client.0.smithi016.stdout:4/855: dread d0/d2/dc/d12/dd3/d22/f31 [0,4194304] 0 2024-08-01T06:56:39.710 INFO:tasks.workunit.client.0.smithi016.stdout:9/880: write d3/d32/d5c/d8a/f75 [871937,32517] 0 2024-08-01T06:56:39.712 INFO:tasks.workunit.client.0.smithi016.stdout:7/767: creat d7/db/d17/d72/d1c/f11a x:0 0 0 2024-08-01T06:56:39.716 INFO:tasks.workunit.client.0.smithi016.stdout:8/718: rmdir d5/d8/d1a/d24/d48/d85/dd7 0 2024-08-01T06:56:39.717 INFO:tasks.workunit.client.0.smithi016.stdout:8/719: chown d5/d8/d1a/d24/d8c/ff1 617484 1 2024-08-01T06:56:39.718 INFO:tasks.workunit.client.0.smithi016.stdout:4/856: creat d0/d2/dc/d12/dc7/f11e x:0 0 0 2024-08-01T06:56:39.719 INFO:tasks.workunit.client.0.smithi016.stdout:7/768: creat d7/db/d17/d72/d22/db4/f11b x:0 0 0 2024-08-01T06:56:39.720 INFO:tasks.workunit.client.0.smithi016.stdout:8/720: creat d5/d8/d75/dba/ff6 x:0 0 0 2024-08-01T06:56:39.722 INFO:tasks.workunit.client.0.smithi016.stdout:3/715: rename c8 to d9/da/df/cfc 0 2024-08-01T06:56:39.722 INFO:tasks.workunit.client.0.smithi016.stdout:9/881: symlink d3/d9/db/dc/d10f/l11d 0 2024-08-01T06:56:39.723 INFO:tasks.workunit.client.0.smithi016.stdout:7/769: mknod d7/db/dc7/c11c 0 2024-08-01T06:56:39.723 INFO:tasks.workunit.client.0.smithi016.stdout:0/899: rename d10/d11 to d10/d11/ddd/d125 22 2024-08-01T06:56:39.733 INFO:tasks.workunit.client.0.smithi016.stdout:8/721: mknod d5/d8/d1a/d24/d48/d60/d63/de3/cf7 0 2024-08-01T06:56:39.734 INFO:tasks.workunit.client.0.smithi016.stdout:5/902: write d1/d2/d6/d9/d49/fdc [3026150,62448] 0 2024-08-01T06:56:39.736 INFO:tasks.workunit.client.0.smithi016.stdout:8/722: chown d5/d8/d1a/d24/d48/d60/d63/de3 60164 1 2024-08-01T06:56:39.736 INFO:tasks.workunit.client.0.smithi016.stdout:4/857: dread d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d8f/faa [0,4194304] 0 2024-08-01T06:56:39.737 INFO:tasks.workunit.client.0.smithi016.stdout:9/882: truncate d3/d9/df/d16/f62 1252640 0 2024-08-01T06:56:39.739 INFO:tasks.workunit.client.0.smithi016.stdout:2/973: write d0/d8/d1b/d74/d90/d10d/f10f [654243,108775] 0 2024-08-01T06:56:39.741 INFO:tasks.workunit.client.0.smithi016.stdout:4/858: chown d0/d2/dc/d12/dd3/d22/f35 659769304 1 2024-08-01T06:56:39.742 INFO:tasks.workunit.client.0.smithi016.stdout:9/883: truncate d3/d9/db/d3a/dd8/f115 119549 0 2024-08-01T06:56:39.743 INFO:tasks.workunit.client.0.smithi016.stdout:9/884: dread - d3/d32/d5c/d8a/f112 zero size 2024-08-01T06:56:39.745 INFO:tasks.workunit.client.0.smithi016.stdout:5/903: symlink d1/d2/d6/d9/d49/l139 0 2024-08-01T06:56:39.748 INFO:tasks.workunit.client.0.smithi016.stdout:8/723: creat d5/d8/d1a/d24/d48/d60/d63/de3/ff8 x:0 0 0 2024-08-01T06:56:39.751 INFO:tasks.workunit.client.0.smithi016.stdout:7/770: write d7/db/d17/d72/d22/d77/d99/dd1/fee [289857,103182] 0 2024-08-01T06:56:39.751 INFO:tasks.workunit.client.0.smithi016.stdout:5/904: dread - d1/d12/d7d/f102 zero size 2024-08-01T06:56:39.753 INFO:tasks.workunit.client.0.smithi016.stdout:9/885: mknod d3/d9/d73/c11e 0 2024-08-01T06:56:39.991 INFO:tasks.workunit.client.0.smithi016.stdout:4/859: dwrite d0/f23 [4194304,4194304] 0 2024-08-01T06:56:39.995 INFO:tasks.workunit.client.0.smithi016.stdout:0/900: dread d10/d11/d41/f2f [0,4194304] 0 2024-08-01T06:56:39.995 INFO:tasks.workunit.client.0.smithi016.stdout:3/716: dwrite d9/da/d96/fa9 [0,4194304] 0 2024-08-01T06:56:39.996 INFO:tasks.workunit.client.0.smithi016.stdout:8/724: dread - d5/d8/d1a/d24/d48/d85/daf/fdb zero size 2024-08-01T06:56:40.000 INFO:tasks.workunit.client.0.smithi016.stdout:5/905: truncate d1/d2/d6/d5a/d65/f138 419868 0 2024-08-01T06:56:40.002 INFO:tasks.workunit.client.0.smithi016.stdout:5/906: dread - d1/d2/d20/d72/f135 zero size 2024-08-01T06:56:40.002 INFO:tasks.workunit.client.0.smithi016.stdout:3/717: write d9/da/df/d2a/d49/d61/ff8 [910835,85555] 0 2024-08-01T06:56:40.005 INFO:tasks.workunit.client.0.smithi016.stdout:3/718: dread d9/da/d18/fa7 [0,4194304] 0 2024-08-01T06:56:40.006 INFO:tasks.workunit.client.0.smithi016.stdout:2/974: truncate d0/d8/d31/f51 2793623 0 2024-08-01T06:56:40.014 INFO:tasks.workunit.client.0.smithi016.stdout:7/771: rename d7/db/d17/d72/d22/d77/ffc to d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/f11d 0 2024-08-01T06:56:40.019 INFO:tasks.workunit.client.0.smithi016.stdout:9/886: mkdir d3/d9/d46/d11f 0 2024-08-01T06:56:40.022 INFO:tasks.workunit.client.0.smithi016.stdout:3/719: dwrite d9/da/d18/fa7 [0,4194304] 0 2024-08-01T06:56:40.036 INFO:tasks.workunit.client.0.smithi016.stdout:7/772: dread d7/fd4 [0,4194304] 0 2024-08-01T06:56:40.039 INFO:tasks.workunit.client.0.smithi016.stdout:3/720: creat d9/da/df/d12/d20/d5c/d76/dfb/d72/ffd x:0 0 0 2024-08-01T06:56:40.039 INFO:tasks.workunit.client.0.smithi016.stdout:0/901: write d10/d11/d37/f9f [1821315,47503] 0 2024-08-01T06:56:40.041 INFO:tasks.workunit.client.0.smithi016.stdout:3/721: write d9/da/df/d12/fb0 [62532,108325] 0 2024-08-01T06:56:40.041 INFO:tasks.workunit.client.0.smithi016.stdout:5/907: rename d1/d2/d6/d9/lb2 to d1/d2/d6/d5a/l13a 0 2024-08-01T06:56:40.043 INFO:tasks.workunit.client.0.smithi016.stdout:7/773: symlink d7/db/d17/d72/d1c/d1d/d40/d58/da3/l11e 0 2024-08-01T06:56:40.045 INFO:tasks.workunit.client.0.smithi016.stdout:0/902: fdatasync d10/d11/d41/f2f 0 2024-08-01T06:56:40.047 INFO:tasks.workunit.client.0.smithi016.stdout:9/887: rename d3/d9/db/dc/c53 to d3/d9/db/dc/d56/d9b/c120 0 2024-08-01T06:56:40.051 INFO:tasks.workunit.client.0.smithi016.stdout:7/774: mknod d7/db/d17/d72/d1e/d26/d63/dc0/c11f 0 2024-08-01T06:56:40.052 INFO:tasks.workunit.client.0.smithi016.stdout:0/903: creat d10/d5c/d90/da0/df6/dc7/f126 x:0 0 0 2024-08-01T06:56:40.053 INFO:tasks.workunit.client.0.smithi016.stdout:7/775: write d7/db/d17/d72/d1c/d97/fff [954522,129489] 0 2024-08-01T06:56:40.054 INFO:tasks.workunit.client.0.smithi016.stdout:5/908: dread d1/d2/d6/d9/f6a [0,4194304] 0 2024-08-01T06:56:40.059 INFO:tasks.workunit.client.0.smithi016.stdout:3/722: dread d9/da/df/d12/d20/f4c [0,4194304] 0 2024-08-01T06:56:40.061 INFO:tasks.workunit.client.0.smithi016.stdout:4/860: truncate d0/d2/f11 158521 0 2024-08-01T06:56:40.061 INFO:tasks.workunit.client.0.smithi016.stdout:9/888: dread d3/d9/df/d16/f2b [0,4194304] 0 2024-08-01T06:56:40.061 INFO:tasks.workunit.client.0.smithi016.stdout:7/776: symlink d7/db/d17/d72/d22/d77/l120 0 2024-08-01T06:56:40.063 INFO:tasks.workunit.client.0.smithi016.stdout:0/904: creat d10/d5c/d90/da0/df6/d119/f127 x:0 0 0 2024-08-01T06:56:40.063 INFO:tasks.workunit.client.0.smithi016.stdout:2/975: dwrite d0/d8/d1b/d74/d90/d93/f2c [0,4194304] 0 2024-08-01T06:56:40.064 INFO:tasks.workunit.client.0.smithi016.stdout:5/909: rename d1/d12/d52/f69 to d1/d2/d23/dbb/f13b 0 2024-08-01T06:56:40.067 INFO:tasks.workunit.client.0.smithi016.stdout:8/725: write d5/dc/d3e/f6b [1409557,20666] 0 2024-08-01T06:56:40.070 INFO:tasks.workunit.client.0.smithi016.stdout:0/905: creat d10/d1c/d7c/f128 x:0 0 0 2024-08-01T06:56:40.077 INFO:tasks.workunit.client.0.smithi016.stdout:5/910: dread - d1/d2/d6/d9/dd8/d12a/fed zero size 2024-08-01T06:56:40.078 INFO:tasks.workunit.client.0.smithi016.stdout:8/726: creat d5/d8/d1a/d24/d6a/ff9 x:0 0 0 2024-08-01T06:56:40.081 INFO:tasks.workunit.client.0.smithi016.stdout:3/723: rename d9/da/df/d12/d20 to d9/da/d96/dfe 0 2024-08-01T06:56:40.082 INFO:tasks.workunit.client.0.smithi016.stdout:3/724: write d9/d57/d66/feb [327490,12749] 0 2024-08-01T06:56:40.087 INFO:tasks.workunit.client.0.smithi016.stdout:4/861: rename d0/d2/dc/f42 to d0/d2/dc/d90/d97/f11f 0 2024-08-01T06:56:40.090 INFO:tasks.workunit.client.0.smithi016.stdout:3/725: fdatasync d9/da/df/d12/da0/fbc 0 2024-08-01T06:56:40.095 INFO:tasks.workunit.client.0.smithi016.stdout:3/726: truncate d9/da/d96/dfe/d5c/d76/fae 458179 0 2024-08-01T06:56:40.095 INFO:tasks.workunit.client.0.smithi016.stdout:8/727: creat d5/d8/d1a/da9/db6/ffa x:0 0 0 2024-08-01T06:56:40.096 INFO:tasks.workunit.client.0.smithi016.stdout:5/911: rename d1/d2/d6/d5a/d65/f11b to d1/df6/d12b/f13c 0 2024-08-01T06:56:40.101 INFO:tasks.workunit.client.0.smithi016.stdout:8/728: creat d5/d8/d1a/d24/d48/d6e/d92/ffb x:0 0 0 2024-08-01T06:56:40.103 INFO:tasks.workunit.client.0.smithi016.stdout:4/862: dread d0/d2/dc/d12/dd3/f9c [0,4194304] 0 2024-08-01T06:56:40.103 INFO:tasks.workunit.client.0.smithi016.stdout:3/727: truncate d9/da/d96/dfe/f26 3773881 0 2024-08-01T06:56:40.104 INFO:tasks.workunit.client.0.smithi016.stdout:4/863: write d0/d2/f1c [3321101,123303] 0 2024-08-01T06:56:40.107 INFO:tasks.workunit.client.0.smithi016.stdout:4/864: chown d0/db9/cfa 20745863 1 2024-08-01T06:56:40.107 INFO:tasks.workunit.client.0.smithi016.stdout:0/906: link d10/d5c/df2/l115 d10/d11/d37/d82/l129 0 2024-08-01T06:56:40.108 INFO:tasks.workunit.client.0.smithi016.stdout:4/865: write d0/d2/dc/d12/dd3/d38/f7c [112092,89045] 0 2024-08-01T06:56:40.113 INFO:tasks.workunit.client.0.smithi016.stdout:3/728: dwrite d9/da/df/d2a/d49/d61/dc5/fcc [0,4194304] 0 2024-08-01T06:56:40.113 INFO:tasks.workunit.client.0.smithi016.stdout:5/912: symlink d1/d2/d20/l13d 0 2024-08-01T06:56:40.115 INFO:tasks.workunit.client.0.smithi016.stdout:0/907: fdatasync d10/d1c/f20 0 2024-08-01T06:56:40.116 INFO:tasks.workunit.client.0.smithi016.stdout:5/913: creat d1/df6/f13e x:0 0 0 2024-08-01T06:56:40.118 INFO:tasks.workunit.client.0.smithi016.stdout:3/729: mkdir d9/da/df/d2a/d49/d61/dc5/dff 0 2024-08-01T06:56:40.126 INFO:tasks.workunit.client.0.smithi016.stdout:3/730: dwrite d9/d3e/d80/ff0 [0,4194304] 0 2024-08-01T06:56:40.134 INFO:tasks.workunit.client.0.smithi016.stdout:0/908: dread d10/d11/d37/d50/db1/f109 [0,4194304] 0 2024-08-01T06:56:40.136 INFO:tasks.workunit.client.0.smithi016.stdout:3/731: unlink d9/da/d96/dfe/l3b 0 2024-08-01T06:56:40.138 INFO:tasks.workunit.client.0.smithi016.stdout:0/909: symlink d10/d1c/l12a 0 2024-08-01T06:56:40.140 INFO:tasks.workunit.client.0.smithi016.stdout:0/910: stat d10/d11/d37/d53 0 2024-08-01T06:56:40.145 INFO:tasks.workunit.client.0.smithi016.stdout:3/732: dwrite d9/da/fe0 [0,4194304] 0 2024-08-01T06:56:40.147 INFO:tasks.workunit.client.0.smithi016.stdout:2/976: write d0/d8/d22/f88 [2377340,62009] 0 2024-08-01T06:56:40.150 INFO:tasks.workunit.client.0.smithi016.stdout:0/911: unlink d10/d11/d37/c7e 0 2024-08-01T06:56:40.153 INFO:tasks.workunit.client.0.smithi016.stdout:7/777: dwrite d7/db/d17/d72/d1c/d1d/d40/d58/fbc [0,4194304] 0 2024-08-01T06:56:40.155 INFO:tasks.workunit.client.0.smithi016.stdout:9/889: truncate d3/de/fc7 3840091 0 2024-08-01T06:56:40.157 INFO:tasks.workunit.client.0.smithi016.stdout:9/890: chown d3/d9/df/cf6 268958650 1 2024-08-01T06:56:40.160 INFO:tasks.workunit.client.0.smithi016.stdout:0/912: fdatasync d10/d11/d37/d82/d9b/f106 0 2024-08-01T06:56:40.162 INFO:tasks.workunit.client.0.smithi016.stdout:0/913: chown d10/d11/d37/c4f 901 1 2024-08-01T06:56:40.163 INFO:tasks.workunit.client.0.smithi016.stdout:9/891: mknod d3/d9/d73/c121 0 2024-08-01T06:56:40.173 INFO:tasks.workunit.client.0.smithi016.stdout:3/733: dread d9/da/d96/dfe/d5c/f63 [0,4194304] 0 2024-08-01T06:56:40.174 INFO:tasks.workunit.client.0.smithi016.stdout:2/977: getdents d0/d8/d1b/dfe 0 2024-08-01T06:56:40.174 INFO:tasks.workunit.client.0.smithi016.stdout:7/778: getdents d7/db/d17/d72/d1c/d79/d8f/d39/d71/dd9 0 2024-08-01T06:56:40.176 INFO:tasks.workunit.client.0.smithi016.stdout:7/779: stat d7/db/d17/d72/d1c/d1d/c5a 0 2024-08-01T06:56:40.177 INFO:tasks.workunit.client.0.smithi016.stdout:7/780: fsync d7/db/fa6 0 2024-08-01T06:56:40.180 INFO:tasks.workunit.client.0.smithi016.stdout:7/781: read d7/db/f6f [2372201,88911] 0 2024-08-01T06:56:40.180 INFO:tasks.workunit.client.0.smithi016.stdout:3/734: read d9/da/df/d53/f56 [33452,102561] 0 2024-08-01T06:56:40.184 INFO:tasks.workunit.client.0.smithi016.stdout:2/978: dread d0/d8/d1b/dcc/f97 [0,4194304] 0 2024-08-01T06:56:40.189 INFO:tasks.workunit.client.0.smithi016.stdout:7/782: creat d7/db/d17/d72/d1e/d26/d63/ddd/f121 x:0 0 0 2024-08-01T06:56:40.198 INFO:tasks.workunit.client.0.smithi016.stdout:3/735: link d9/da/df/c16 d9/da/df/d53/c100 0 2024-08-01T06:56:40.201 INFO:tasks.workunit.client.0.smithi016.stdout:3/736: truncate d9/da/df/d2a/d49/d61/fd8 596406 0 2024-08-01T06:56:40.204 INFO:tasks.workunit.client.0.smithi016.stdout:8/729: write d5/d8/d1a/d24/d48/d85/daf/df0/fc8 [726796,122455] 0 2024-08-01T06:56:40.206 INFO:tasks.workunit.client.0.smithi016.stdout:2/979: link d0/d8/d1b/dcc/c36 d0/d8/d1b/dcc/d3b/c140 0 2024-08-01T06:56:40.214 INFO:tasks.workunit.client.0.smithi016.stdout:8/730: mkdir d5/d8/d1a/d24/d48/d60/dfc 0 2024-08-01T06:56:40.222 INFO:tasks.workunit.client.0.smithi016.stdout:8/731: symlink d5/d8/d1a/d24/d48/d85/daf/df0/lfd 0 2024-08-01T06:56:40.225 INFO:tasks.workunit.client.0.smithi016.stdout:2/980: creat d0/d8/d1b/dcc/f141 x:0 0 0 2024-08-01T06:56:40.230 INFO:tasks.workunit.client.0.smithi016.stdout:8/732: dwrite d5/d8/d1a/d24/f4a [0,4194304] 0 2024-08-01T06:56:40.232 INFO:tasks.workunit.client.0.smithi016.stdout:2/981: mknod d0/d8/d31/d111/c142 0 2024-08-01T06:56:40.237 INFO:tasks.workunit.client.0.smithi016.stdout:2/982: mkdir d0/d8/d1b/d74/d90/d93/d143 0 2024-08-01T06:56:40.245 INFO:tasks.workunit.client.0.smithi016.stdout:8/733: dwrite d5/d8/d1a/d59/f5c [4194304,4194304] 0 2024-08-01T06:56:40.248 INFO:tasks.workunit.client.0.smithi016.stdout:8/734: readlink d5/d8/d1a/d24/d48/lad 0 2024-08-01T06:56:40.248 INFO:tasks.workunit.client.0.smithi016.stdout:2/983: dwrite d0/d8/d1b/d74/fad [4194304,4194304] 0 2024-08-01T06:56:40.250 INFO:tasks.workunit.client.0.smithi016.stdout:8/735: chown d5/d8/d1a/d24/d48/d85/fa5 1 1 2024-08-01T06:56:40.251 INFO:tasks.workunit.client.0.smithi016.stdout:8/736: dread - d5/d8/d75/ff4 zero size 2024-08-01T06:56:40.255 INFO:tasks.workunit.client.0.smithi016.stdout:2/984: rename d0/d8/d31/dc1/l132 to d0/d8/d1b/dcc/d3b/l144 0 2024-08-01T06:56:40.258 INFO:tasks.workunit.client.0.smithi016.stdout:3/737: dwrite d9/da/d96/dfe/d3c/f71 [0,4194304] 0 2024-08-01T06:56:40.262 INFO:tasks.workunit.client.0.smithi016.stdout:2/985: unlink d0/d8/le 0 2024-08-01T06:56:40.265 INFO:tasks.workunit.client.0.smithi016.stdout:8/737: mknod d5/d8/d1a/d59/dcf/cfe 0 2024-08-01T06:56:40.265 INFO:tasks.workunit.client.0.smithi016.stdout:3/738: truncate d9/da/df/d12/f83 4713487 0 2024-08-01T06:56:40.270 INFO:tasks.workunit.client.0.smithi016.stdout:3/739: write d9/da/df/d2a/d49/f8b [1053469,9027] 0 2024-08-01T06:56:40.271 INFO:tasks.workunit.client.0.smithi016.stdout:2/986: dwrite d0/d8/d31/d5e/de4/deb/f127 [0,4194304] 0 2024-08-01T06:56:40.272 INFO:tasks.workunit.client.0.smithi016.stdout:8/738: rmdir d5/d8/d1a/d24/d48/d60/d63/de3 39 2024-08-01T06:56:40.280 INFO:tasks.workunit.client.0.smithi016.stdout:3/740: rename d9/da/d96/dfe/fb8 to d9/da/df/d12/d75/dc7/f101 0 2024-08-01T06:56:40.281 INFO:tasks.workunit.client.0.smithi016.stdout:3/741: stat d9/d3e/f2d 0 2024-08-01T06:56:40.282 INFO:tasks.workunit.client.0.smithi016.stdout:3/742: fdatasync d9/da/d96/dfe/d3c/f4b 0 2024-08-01T06:56:40.283 INFO:tasks.workunit.client.0.smithi016.stdout:3/743: chown d9/da/d96/dfe/d5c/f9d 4405664 1 2024-08-01T06:56:40.284 INFO:tasks.workunit.client.0.smithi016.stdout:2/987: mknod d0/d16/d20/c145 0 2024-08-01T06:56:40.288 INFO:tasks.workunit.client.0.smithi016.stdout:8/739: symlink d5/d8/d1a/d24/d48/d60/d63/de3/lff 0 2024-08-01T06:56:40.297 INFO:tasks.workunit.client.0.smithi016.stdout:2/988: mknod d0/d8/d22/db5/c146 0 2024-08-01T06:56:40.299 INFO:tasks.workunit.client.0.smithi016.stdout:2/989: mknod d0/d8/d31/dc1/dc4/c147 0 2024-08-01T06:56:40.300 INFO:tasks.workunit.client.0.smithi016.stdout:8/740: dread d5/f84 [0,4194304] 0 2024-08-01T06:56:40.301 INFO:tasks.workunit.client.0.smithi016.stdout:8/741: stat d5/d8/d1a/d24/d48/d69/fa2 0 2024-08-01T06:56:40.302 INFO:tasks.workunit.client.0.smithi016.stdout:8/742: write d5/d8/f68 [2827710,96362] 0 2024-08-01T06:56:40.303 INFO:tasks.workunit.client.0.smithi016.stdout:2/990: rename d0/d8/d31/dc7/f138 to d0/d8/d1b/d74/d90/d10d/f148 0 2024-08-01T06:56:40.306 INFO:tasks.workunit.client.0.smithi016.stdout:8/743: mkdir d5/d8/d1a/d24/d48/d85/daf/df0/dd8/d100 0 2024-08-01T06:56:40.307 INFO:tasks.workunit.client.0.smithi016.stdout:8/744: stat d5/d8/d1a/d24/d48/f7c 0 2024-08-01T06:56:40.309 INFO:tasks.workunit.client.0.smithi016.stdout:3/744: truncate d9/da/df/d2a/d49/f60 2093141 0 2024-08-01T06:56:40.324 INFO:tasks.workunit.client.0.smithi016.stdout:8/745: dread d5/d8/d1a/da9/db6/fb7 [0,4194304] 0 2024-08-01T06:56:40.325 INFO:tasks.workunit.client.0.smithi016.stdout:2/991: dread d0/d8/d1b/d74/f81 [0,4194304] 0 2024-08-01T06:56:40.326 INFO:tasks.workunit.client.0.smithi016.stdout:8/746: chown d5/d8/d1a/d24/d48/d85/daf/df0/de2/faa 2088448 1 2024-08-01T06:56:40.327 INFO:tasks.workunit.client.0.smithi016.stdout:8/747: stat d5/d8/d75/dba 0 2024-08-01T06:56:40.329 INFO:tasks.workunit.client.0.smithi016.stdout:3/745: dread d9/da/d96/dfe/d5c/d76/dfb/d81/fb1 [0,4194304] 0 2024-08-01T06:56:40.329 INFO:tasks.workunit.client.0.smithi016.stdout:2/992: creat d0/d8/d31/d5e/de4/f149 x:0 0 0 2024-08-01T06:56:40.330 INFO:tasks.workunit.client.0.smithi016.stdout:8/748: mkdir d5/d67/d101 0 2024-08-01T06:56:40.331 INFO:tasks.workunit.client.0.smithi016.stdout:3/746: truncate d9/da/df/d12/da0/fbc 2073474 0 2024-08-01T06:56:40.331 INFO:tasks.workunit.client.0.smithi016.stdout:8/749: fdatasync d5/d8/d1a/dbe/fd1 0 2024-08-01T06:56:40.336 INFO:tasks.workunit.client.0.smithi016.stdout:2/993: mknod d0/c14a 0 2024-08-01T06:56:40.337 INFO:tasks.workunit.client.0.smithi016.stdout:2/994: readlink d0/d16/d20/l126 0 2024-08-01T06:56:40.338 INFO:tasks.workunit.client.0.smithi016.stdout:2/995: write d0/d8/d1b/dd9/dfc/fff [871189,44254] 0 2024-08-01T06:56:40.342 INFO:tasks.workunit.client.0.smithi016.stdout:8/750: link d5/d8/d1a/d24/d48/d85/daf/fdb d5/d8/d75/dba/f102 0 2024-08-01T06:56:40.344 INFO:tasks.workunit.client.0.smithi016.stdout:3/747: rmdir d9/da/df/d2a/d49/d61/dc5/dff 0 2024-08-01T06:56:40.344 INFO:tasks.workunit.client.0.smithi016.stdout:8/751: dread - d5/d8/d75/dba/ff6 zero size 2024-08-01T06:56:40.345 INFO:tasks.workunit.client.0.smithi016.stdout:2/996: dwrite d0/d8/d1b/dd9/dfc/f11d [0,4194304] 0 2024-08-01T06:56:40.347 INFO:tasks.workunit.client.0.smithi016.stdout:3/748: chown d9/da/df/d2a/d49/db5/fea 20 1 2024-08-01T06:56:40.347 INFO:tasks.workunit.client.0.smithi016.stdout:8/752: rmdir d5/dc 39 2024-08-01T06:56:40.349 INFO:tasks.workunit.client.0.smithi016.stdout:3/749: fsync d9/da/df/fef 0 2024-08-01T06:56:40.350 INFO:tasks.workunit.client.0.smithi016.stdout:2/997: write d0/d8/d22/f98 [2122920,26750] 0 2024-08-01T06:56:40.351 INFO:tasks.workunit.client.0.smithi016.stdout:8/753: unlink d5/d8/ldc 0 2024-08-01T06:56:40.352 INFO:tasks.workunit.client.0.smithi016.stdout:2/998: chown d0/d8/d1b/dcc/d3b/fa4 8191 1 2024-08-01T06:56:40.355 INFO:tasks.workunit.client.0.smithi016.stdout:3/750: unlink d9/da/df/d2a/d49/f60 0 2024-08-01T06:56:40.357 INFO:tasks.workunit.client.0.smithi016.stdout:3/751: write d9/da/df/d2a/d49/db5/fea [534479,69606] 0 2024-08-01T06:56:40.358 INFO:tasks.workunit.client.0.smithi016.stdout:8/754: rename d5/dc9/fcd to d5/d8/d1a/d24/d48/d60/d63/db4/f103 0 2024-08-01T06:56:40.360 INFO:tasks.workunit.client.0.smithi016.stdout:2/999: getdents d0/d8/d1b/dfe 0 2024-08-01T06:56:40.361 INFO:tasks.workunit.client.0.smithi016.stdout:3/752: read d9/da/d96/dfe/d3c/f52 [6586613,23489] 0 2024-08-01T06:56:40.365 INFO:tasks.workunit.client.0.smithi016.stdout:8/755: unlink d5/d8/d1a/d24/d48/d6e/d92/le8 0 2024-08-01T06:56:40.368 INFO:tasks.workunit.client.0.smithi016.stdout:3/753: dwrite d9/da/df/d53/fcb [0,4194304] 0 2024-08-01T06:56:40.375 INFO:tasks.workunit.client.0.smithi016.stdout:3/754: mknod d9/da/d96/dc3/c102 0 2024-08-01T06:56:40.380 INFO:tasks.workunit.client.0.smithi016.stdout:3/755: rename d9/d3e/f79 to d9/d3e/d80/f103 0 2024-08-01T06:56:40.384 INFO:tasks.workunit.client.0.smithi016.stdout:8/756: write d5/d8/d1a/f54 [21965,14354] 0 2024-08-01T06:56:40.387 INFO:tasks.workunit.client.0.smithi016.stdout:8/757: unlink d5/d8/d1a/l98 0 2024-08-01T06:56:40.388 INFO:tasks.workunit.client.0.smithi016.stdout:8/758: readlink d5/d8/d75/dba/lcc 0 2024-08-01T06:56:40.391 INFO:tasks.workunit.client.0.smithi016.stdout:8/759: write d5/d8/d1a/d24/d48/d85/fa5 [8924627,121991] 0 2024-08-01T06:56:40.393 INFO:tasks.workunit.client.0.smithi016.stdout:8/760: mkdir d5/d8/d1a/d24/d48/d69/d104 0 2024-08-01T06:56:40.394 INFO:tasks.workunit.client.0.smithi016.stdout:8/761: chown d5/d8/d1a/d24/d48/d85/daf/df0/fc1 65627 1 2024-08-01T06:56:40.395 INFO:tasks.workunit.client.0.smithi016.stdout:8/762: dread - d5/d8/d1a/da9/db6/ffa zero size 2024-08-01T06:56:40.398 INFO:tasks.workunit.client.0.smithi016.stdout:8/763: rename d5/d8/d1a/d24/d48/d85/daf to d5/d67/d101/d105 0 2024-08-01T06:56:40.409 INFO:tasks.workunit.client.0.smithi016.stdout:8/764: link d5/d8/d1a/d24/d48/d60/d63/de3/cf7 d5/d8/d1a/d24/d48/d6e/d92/c106 0 2024-08-01T06:56:40.410 INFO:tasks.workunit.client.0.smithi016.stdout:8/765: fsync d5/d8/d1a/d24/d48/f7c 0 2024-08-01T06:56:40.412 INFO:tasks.workunit.client.0.smithi016.stdout:8/766: chown d5/d8/d1a/d24/d48/d60/f66 839 1 2024-08-01T06:56:40.416 INFO:tasks.workunit.client.0.smithi016.stdout:8/767: dread d5/d8/d75/dba/fc3 [0,4194304] 0 2024-08-01T06:56:40.428 INFO:tasks.workunit.client.0.smithi016.stdout:8/768: dread d5/d8/d1a/d24/d48/f7c [0,4194304] 0 2024-08-01T06:56:40.445 INFO:tasks.workunit.client.0.smithi016.stdout:8/769: dread d5/d67/d101/d105/df0/de2/fa7 [0,4194304] 0 2024-08-01T06:56:40.445 INFO:tasks.workunit.client.0.smithi016.stdout:8/770: stat d5/d8/d1a/d24/d48/l62 0 2024-08-01T06:56:40.448 INFO:tasks.workunit.client.0.smithi016.stdout:8/771: read d5/d8/d1a/d24/d48/d60/d63/db4/f103 [3129053,65308] 0 2024-08-01T06:56:40.905 INFO:tasks.workunit.client.0.smithi016.stdout:1/999: sync 2024-08-01T06:56:40.966 INFO:tasks.workunit.client.0.smithi016.stdout:9/892: sync 2024-08-01T06:56:40.967 INFO:tasks.workunit.client.0.smithi016.stdout:7/783: sync 2024-08-01T06:56:40.967 INFO:tasks.workunit.client.0.smithi016.stdout:6/897: sync 2024-08-01T06:56:40.967 INFO:tasks.workunit.client.0.smithi016.stdout:4/866: sync 2024-08-01T06:56:40.967 INFO:tasks.workunit.client.0.smithi016.stdout:5/914: sync 2024-08-01T06:56:40.967 INFO:tasks.workunit.client.0.smithi016.stdout:8/772: sync 2024-08-01T06:56:40.967 INFO:tasks.workunit.client.0.smithi016.stdout:3/756: sync 2024-08-01T06:56:40.967 INFO:tasks.workunit.client.0.smithi016.stdout:0/914: sync 2024-08-01T06:56:40.970 INFO:tasks.workunit.client.0.smithi016.stdout:9/893: chown d3/d9/db/d3e/d40/d4e/lb5 20240 1 2024-08-01T06:56:40.971 INFO:tasks.workunit.client.0.smithi016.stdout:0/915: rmdir d10/d5c/d90/da0/df6/d119 39 2024-08-01T06:56:40.974 INFO:tasks.workunit.client.0.smithi016.stdout:3/757: dread d9/da/d18/fa7 [0,4194304] 0 2024-08-01T06:56:40.981 INFO:tasks.workunit.client.0.smithi016.stdout:6/898: unlink d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/f10d 0 2024-08-01T06:56:40.983 INFO:tasks.workunit.client.0.smithi016.stdout:5/915: write d1/d2/d23/dbb/f13b [2548270,61950] 0 2024-08-01T06:56:40.985 INFO:tasks.workunit.client.0.smithi016.stdout:7/784: truncate d7/db/d17/d72/d22/f4a 526068 0 2024-08-01T06:56:40.985 INFO:tasks.workunit.client.0.smithi016.stdout:8/773: dwrite d5/d8/d1a/d24/d8c/fb2 [0,4194304] 0 2024-08-01T06:56:40.987 INFO:tasks.workunit.client.0.smithi016.stdout:6/899: chown d1/d8/d1b/d22/d36/d7a/dd3/c10 381 1 2024-08-01T06:56:40.989 INFO:tasks.workunit.client.0.smithi016.stdout:0/916: mkdir d10/d11/d37/d53/d12b 0 2024-08-01T06:56:40.993 INFO:tasks.workunit.client.0.smithi016.stdout:7/785: unlink d7/ce2 0 2024-08-01T06:56:40.994 INFO:tasks.workunit.client.0.smithi016.stdout:3/758: dread d9/da/df/d53/f56 [0,4194304] 0 2024-08-01T06:56:40.997 INFO:tasks.workunit.client.0.smithi016.stdout:8/774: dwrite d5/d8/d1a/d24/d8c/fb2 [0,4194304] 0 2024-08-01T06:56:40.997 INFO:tasks.workunit.client.0.smithi016.stdout:0/917: dread d10/d11/d37/d50/f77 [0,4194304] 0 2024-08-01T06:56:40.999 INFO:tasks.workunit.client.0.smithi016.stdout:5/916: creat d1/d2/d6/d5a/f13f x:0 0 0 2024-08-01T06:56:41.003 INFO:tasks.workunit.client.0.smithi016.stdout:7/786: unlink d7/db3/ff4 0 2024-08-01T06:56:41.007 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:40 smithi016 ceph-mon[29266]: pgmap v34: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 49 MiB/s rd, 131 MiB/s wr, 422 op/s 2024-08-01T06:56:41.013 INFO:tasks.workunit.client.0.smithi016.stdout:5/917: chown d1/c50 12068746 1 2024-08-01T06:56:41.015 INFO:tasks.workunit.client.0.smithi016.stdout:0/918: creat d10/d5c/d90/da0/dbc/d101/f12c x:0 0 0 2024-08-01T06:56:41.016 INFO:tasks.workunit.client.0.smithi016.stdout:0/919: write d10/d5c/f10a [3744186,66640] 0 2024-08-01T06:56:41.016 INFO:tasks.workunit.client.0.smithi016.stdout:9/894: rename d3/d9/df/d2a/f76 to d3/d32/f122 0 2024-08-01T06:56:41.018 INFO:tasks.workunit.client.0.smithi016.stdout:4/867: getdents d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/d100/dd1/de9 0 2024-08-01T06:56:41.020 INFO:tasks.workunit.client.0.smithi016.stdout:9/895: write d3/d32/d5c/d8a/f112 [681195,96337] 0 2024-08-01T06:56:41.024 INFO:tasks.workunit.client.0.smithi016.stdout:6/900: dwrite d1/d8/d1b/db5/f97 [0,4194304] 0 2024-08-01T06:56:41.025 INFO:tasks.workunit.client.0.smithi016.stdout:4/868: write d0/d2/dc/d12/dd3/d22/d26/d85/dc1/f6c [4644123,95342] 0 2024-08-01T06:56:41.029 INFO:tasks.workunit.client.0.smithi016.stdout:0/920: mknod d10/d5c/d90/da0/dbc/d101/c12d 0 2024-08-01T06:56:41.032 INFO:tasks.workunit.client.0.smithi016.stdout:7/787: symlink d7/db/d17/d72/d1e/d26/d63/dc0/d115/l122 0 2024-08-01T06:56:41.033 INFO:tasks.workunit.client.0.smithi016.stdout:9/896: truncate d3/d9/df/d16/fcd 596648 0 2024-08-01T06:56:41.035 INFO:tasks.workunit.client.0.smithi016.stdout:7/788: chown d7/db/d17/d72/d22/fc2 105358755 1 2024-08-01T06:56:41.036 INFO:tasks.workunit.client.0.smithi016.stdout:6/901: dwrite d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/da2/fb7 [0,4194304] 0 2024-08-01T06:56:41.038 INFO:tasks.workunit.client.0.smithi016.stdout:5/918: rename d1/d2/d6/d9/d19/d7a/f106 to d1/d2/d6/d9/d19/d7a/dc5/dd0/f140 0 2024-08-01T06:56:41.043 INFO:tasks.workunit.client.0.smithi016.stdout:9/897: mkdir d3/de/d123 0 2024-08-01T06:56:41.045 INFO:tasks.workunit.client.0.smithi016.stdout:6/902: mknod d1/d8/d1b/db5/c139 0 2024-08-01T06:56:41.046 INFO:tasks.workunit.client.0.smithi016.stdout:7/789: dread d7/db/d17/d72/d1c/d97/fd6 [0,4194304] 0 2024-08-01T06:56:41.046 INFO:tasks.workunit.client.0.smithi016.stdout:0/921: mkdir d10/d11/d12e 0 2024-08-01T06:56:41.047 INFO:tasks.workunit.client.0.smithi016.stdout:6/903: chown d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d 62 1 2024-08-01T06:56:41.051 INFO:tasks.workunit.client.0.smithi016.stdout:4/869: getdents d0/d2/dc 0 2024-08-01T06:56:41.054 INFO:tasks.workunit.client.0.smithi016.stdout:7/790: rename d7/db/d17/d72/d1c/d79/f7e to d7/db/d17/d72/d1c/dc6/f123 0 2024-08-01T06:56:41.055 INFO:tasks.workunit.client.0.smithi016.stdout:7/791: chown d7/db/d17/d72/d1c/d79/leb 143100 1 2024-08-01T06:56:41.056 INFO:tasks.workunit.client.0.smithi016.stdout:9/898: mkdir d3/d9/d46/d48/d87/d124 0 2024-08-01T06:56:41.065 INFO:tasks.workunit.client.0.smithi016.stdout:5/919: getdents d1/d2/d6/d9/dd8 0 2024-08-01T06:56:41.065 INFO:tasks.workunit.client.0.smithi016.stdout:9/899: symlink d3/d9/dd6/l125 0 2024-08-01T06:56:41.067 INFO:tasks.workunit.client.0.smithi016.stdout:6/904: link d1/d8/d1b/d22/d36/c119 d1/d8/d1b/db5/d67/d8f/d115/c13a 0 2024-08-01T06:56:41.069 INFO:tasks.workunit.client.0.smithi016.stdout:5/920: chown d1/d12/d52/c67 9933371 1 2024-08-01T06:56:41.072 INFO:tasks.workunit.client.0.smithi016.stdout:9/900: truncate d3/d9/df/d16/fb1 3960331 0 2024-08-01T06:56:41.073 INFO:tasks.workunit.client.0.smithi016.stdout:6/905: mknod d1/d8/d1b/db5/dd6/c13b 0 2024-08-01T06:56:41.074 INFO:tasks.workunit.client.0.smithi016.stdout:3/759: truncate d9/da/df/d12/fb0 482055 0 2024-08-01T06:56:41.078 INFO:tasks.workunit.client.0.smithi016.stdout:6/906: mknod d1/d8/d1b/d22/d36/d7a/dd3/d3f/c13c 0 2024-08-01T06:56:41.078 INFO:tasks.workunit.client.0.smithi016.stdout:3/760: mkdir d9/da/df/d12/d75/d104 0 2024-08-01T06:56:41.082 INFO:tasks.workunit.client.0.smithi016.stdout:6/907: write d1/d41/dbf/f111 [4546891,108559] 0 2024-08-01T06:56:41.084 INFO:tasks.workunit.client.0.smithi016.stdout:3/761: truncate d9/d57/f8a 530131 0 2024-08-01T06:56:41.085 INFO:tasks.workunit.client.0.smithi016.stdout:9/901: creat d3/d9/df/f126 x:0 0 0 2024-08-01T06:56:41.087 INFO:tasks.workunit.client.0.smithi016.stdout:0/922: write d10/d11/d37/fa6 [689406,119814] 0 2024-08-01T06:56:41.089 INFO:tasks.workunit.client.0.smithi016.stdout:6/908: read d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f3c [2200517,26747] 0 2024-08-01T06:56:41.098 INFO:tasks.workunit.client.0.smithi016.stdout:9/902: creat d3/d9/db/dc/d56/d119/f127 x:0 0 0 2024-08-01T06:56:41.101 INFO:tasks.workunit.client.0.smithi016.stdout:3/762: rmdir d9/d98/db7/dca 0 2024-08-01T06:56:41.104 INFO:tasks.workunit.client.0.smithi016.stdout:4/870: dwrite d0/d2/dc/d12/dd3/d22/f53 [0,4194304] 0 2024-08-01T06:56:41.108 INFO:tasks.workunit.client.0.smithi016.stdout:4/871: fdatasync d0/d2/dc/d12/dd3/d38/f82 0 2024-08-01T06:56:41.110 INFO:tasks.workunit.client.0.smithi016.stdout:9/903: creat d3/d9/db/f128 x:0 0 0 2024-08-01T06:56:41.128 INFO:tasks.workunit.client.0.smithi016.stdout:5/921: dwrite d1/d2/d6/d5a/d65/f138 [0,4194304] 0 2024-08-01T06:56:41.133 INFO:tasks.workunit.client.0.smithi016.stdout:4/872: dread d0/d2/d36/f9f [0,4194304] 0 2024-08-01T06:56:41.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:40 smithi089 ceph-mon[36617]: pgmap v34: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 49 MiB/s rd, 131 MiB/s wr, 422 op/s 2024-08-01T06:56:41.139 INFO:tasks.workunit.client.0.smithi016.stdout:4/873: chown d0/d2/dc/d12/dd3/d22/d26/da3/ccf 3978378 1 2024-08-01T06:56:41.142 INFO:tasks.workunit.client.0.smithi016.stdout:0/923: write d10/d11/d37/d58/f70 [4774228,56475] 0 2024-08-01T06:56:41.143 INFO:tasks.workunit.client.0.smithi016.stdout:6/909: write d1/d8/fa [1032852,113528] 0 2024-08-01T06:56:41.144 INFO:tasks.workunit.client.0.smithi016.stdout:4/874: dread d0/d2/dcd/ff4 [0,4194304] 0 2024-08-01T06:56:41.149 INFO:tasks.workunit.client.0.smithi016.stdout:4/875: symlink d0/d2/da0/dd2/l120 0 2024-08-01T06:56:41.150 INFO:tasks.workunit.client.0.smithi016.stdout:6/910: truncate d1/d8/d1b/d22/d71/fac 709877 0 2024-08-01T06:56:41.154 INFO:tasks.workunit.client.0.smithi016.stdout:4/876: symlink d0/d2/d36/dbd/l121 0 2024-08-01T06:56:41.159 INFO:tasks.workunit.client.0.smithi016.stdout:4/877: rename d0/d2/d36/f9f to d0/d2/d36/dbd/f122 0 2024-08-01T06:56:41.175 INFO:tasks.workunit.client.0.smithi016.stdout:9/904: dwrite d3/de/dae/faf [0,4194304] 0 2024-08-01T06:56:41.176 INFO:tasks.workunit.client.0.smithi016.stdout:9/905: chown d3/d9/d73 0 1 2024-08-01T06:56:41.179 INFO:tasks.workunit.client.0.smithi016.stdout:9/906: mknod d3/d9/db/dc/d56/d119/c129 0 2024-08-01T06:56:41.181 INFO:tasks.workunit.client.0.smithi016.stdout:9/907: write d3/d32/d5c/d8a/f113 [434512,1563] 0 2024-08-01T06:56:41.185 INFO:tasks.workunit.client.0.smithi016.stdout:9/908: dread - d3/d9/d46/d48/dce/fdb zero size 2024-08-01T06:56:41.194 INFO:tasks.workunit.client.0.smithi016.stdout:6/911: write d1/d8/d1b/d22/d36/f44 [4815310,84662] 0 2024-08-01T06:56:41.197 INFO:tasks.workunit.client.0.smithi016.stdout:4/878: write d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d79/f84 [661167,113695] 0 2024-08-01T06:56:41.199 INFO:tasks.workunit.client.0.smithi016.stdout:5/922: dwrite d1/d2/d6/d9/d49/d57/d110/f42 [4194304,4194304] 0 2024-08-01T06:56:41.200 INFO:tasks.workunit.client.0.smithi016.stdout:3/763: dwrite d9/d57/f8a [0,4194304] 0 2024-08-01T06:56:41.206 INFO:tasks.workunit.client.0.smithi016.stdout:0/924: dwrite d10/d1c/fe9 [0,4194304] 0 2024-08-01T06:56:41.209 INFO:tasks.workunit.client.0.smithi016.stdout:9/909: link d3/d32/d5c/d8a/l114 d3/d9/db/d3e/d40/d80/l12a 0 2024-08-01T06:56:41.211 INFO:tasks.workunit.client.0.smithi016.stdout:9/910: chown d3/d9/dd6 665 1 2024-08-01T06:56:41.217 INFO:tasks.workunit.client.0.smithi016.stdout:4/879: dwrite d0/d2/da0/dd2/ffc [0,4194304] 0 2024-08-01T06:56:41.219 INFO:tasks.workunit.client.0.smithi016.stdout:5/923: symlink d1/d2/d20/d72/l141 0 2024-08-01T06:56:41.224 INFO:tasks.workunit.client.0.smithi016.stdout:3/764: symlink d9/da/d18/de1/l105 0 2024-08-01T06:56:41.231 INFO:tasks.workunit.client.0.smithi016.stdout:9/911: symlink d3/d9/df/d16/l12b 0 2024-08-01T06:56:41.235 INFO:tasks.workunit.client.0.smithi016.stdout:4/880: truncate d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d8f/fb7 831245 0 2024-08-01T06:56:41.241 INFO:tasks.workunit.client.0.smithi016.stdout:6/912: dwrite d1/d8/d1b/d22/d2d/f126 [0,4194304] 0 2024-08-01T06:56:41.243 INFO:tasks.workunit.client.0.smithi016.stdout:4/881: mknod d0/d2/da0/dd2/dea/c123 0 2024-08-01T06:56:41.244 INFO:tasks.workunit.client.0.smithi016.stdout:3/765: creat d9/da/df/d12/da0/da5/f106 x:0 0 0 2024-08-01T06:56:41.245 INFO:tasks.workunit.client.0.smithi016.stdout:5/924: creat d1/f142 x:0 0 0 2024-08-01T06:56:41.331 INFO:tasks.workunit.client.0.smithi016.stdout:3/766: mkdir d9/d98/d107 0 2024-08-01T06:56:41.336 INFO:tasks.workunit.client.0.smithi016.stdout:0/925: dwrite d10/d1c/fe5 [0,4194304] 0 2024-08-01T06:56:41.337 INFO:tasks.workunit.client.0.smithi016.stdout:0/926: write d10/d1c/f46 [3073824,12531] 0 2024-08-01T06:56:41.347 INFO:tasks.workunit.client.0.smithi016.stdout:4/882: rename d0/d2/dc/d12/c18 to d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d91/c124 0 2024-08-01T06:56:41.350 INFO:tasks.workunit.client.0.smithi016.stdout:9/912: getdents d3/d9/d73/dda 0 2024-08-01T06:56:41.351 INFO:tasks.workunit.client.0.smithi016.stdout:5/925: creat d1/d2/d6/d131/f143 x:0 0 0 2024-08-01T06:56:41.356 INFO:tasks.workunit.client.0.smithi016.stdout:0/927: symlink d10/d5c/d90/l12f 0 2024-08-01T06:56:41.357 INFO:tasks.workunit.client.0.smithi016.stdout:4/883: fdatasync d0/d2/dc/d12/dd3/d22/f31 0 2024-08-01T06:56:41.359 INFO:tasks.workunit.client.0.smithi016.stdout:9/913: unlink d3/de/f15 0 2024-08-01T06:56:41.361 INFO:tasks.workunit.client.0.smithi016.stdout:5/926: creat d1/d2/d6/d9/d1b/dda/f144 x:0 0 0 2024-08-01T06:56:41.363 INFO:tasks.workunit.client.0.smithi016.stdout:0/928: creat d10/d5c/d90/da2/da5/de8/deb/f130 x:0 0 0 2024-08-01T06:56:41.364 INFO:tasks.workunit.client.0.smithi016.stdout:5/927: read d1/d2/d6/d9/d49/d57/fb7 [99817,124383] 0 2024-08-01T06:56:41.365 INFO:tasks.workunit.client.0.smithi016.stdout:0/929: write d10/d11/d41/d95/ffe [2850694,48460] 0 2024-08-01T06:56:41.366 INFO:tasks.workunit.client.0.smithi016.stdout:0/930: fsync d10/d11/d41/d95/fd6 0 2024-08-01T06:56:41.367 INFO:tasks.workunit.client.0.smithi016.stdout:4/884: creat d0/d2/d36/f125 x:0 0 0 2024-08-01T06:56:41.368 INFO:tasks.workunit.client.0.smithi016.stdout:0/931: write d10/d5c/d90/da0/df6/dc7/f126 [44844,53752] 0 2024-08-01T06:56:41.369 INFO:tasks.workunit.client.0.smithi016.stdout:9/914: truncate d3/d9/df/d16/d94/fc9 951352 0 2024-08-01T06:56:41.371 INFO:tasks.workunit.client.0.smithi016.stdout:0/932: stat d10/d5c/d90/da0/df6/dc7 0 2024-08-01T06:56:41.377 INFO:tasks.workunit.client.0.smithi016.stdout:6/913: dwrite d1/d41/f3e [0,4194304] 0 2024-08-01T06:56:41.377 INFO:tasks.workunit.client.0.smithi016.stdout:4/885: write d0/d2/dcd/ff5 [557755,68078] 0 2024-08-01T06:56:41.379 INFO:tasks.workunit.client.0.smithi016.stdout:3/767: dwrite d9/d3e/d40/d58/d59/fba [0,4194304] 0 2024-08-01T06:56:41.380 INFO:tasks.workunit.client.0.smithi016.stdout:3/768: chown d9/da/lf3 1359791 1 2024-08-01T06:56:41.381 INFO:tasks.workunit.client.0.smithi016.stdout:3/769: chown d9/da/d96/dfe/d3c 444198 1 2024-08-01T06:56:41.394 INFO:tasks.workunit.client.0.smithi016.stdout:5/928: dwrite d1/d2/d6/fd2 [0,4194304] 0 2024-08-01T06:56:41.395 INFO:tasks.workunit.client.0.smithi016.stdout:3/770: truncate d9/d3e/f36 3927990 0 2024-08-01T06:56:41.397 INFO:tasks.workunit.client.0.smithi016.stdout:9/915: link d3/d9/df/f10a d3/d9/d73/dfb/f12c 0 2024-08-01T06:56:41.398 INFO:tasks.workunit.client.0.smithi016.stdout:9/916: readlink d3/d9/db/dc/le0 0 2024-08-01T06:56:41.399 INFO:tasks.workunit.client.0.smithi016.stdout:9/917: chown d3/d9/df/d16 14 1 2024-08-01T06:56:41.400 INFO:tasks.workunit.client.0.smithi016.stdout:5/929: creat d1/d2/d6/d9/d1b/dda/df0/f145 x:0 0 0 2024-08-01T06:56:41.405 INFO:tasks.workunit.client.0.smithi016.stdout:6/914: mkdir d1/d43/d13d 0 2024-08-01T06:56:41.406 INFO:tasks.workunit.client.0.smithi016.stdout:4/886: dwrite d0/d2/dc/d12/dd3/d38/fe7 [0,4194304] 0 2024-08-01T06:56:41.407 INFO:tasks.workunit.client.0.smithi016.stdout:3/771: symlink d9/da/df/d12/d75/d104/l108 0 2024-08-01T06:56:41.408 INFO:tasks.workunit.client.0.smithi016.stdout:5/930: symlink d1/d2/d6/d5a/d65/l146 0 2024-08-01T06:56:41.410 INFO:tasks.workunit.client.0.smithi016.stdout:3/772: write d9/da/df/d53/fdb [289770,119180] 0 2024-08-01T06:56:41.416 INFO:tasks.workunit.client.0.smithi016.stdout:4/887: truncate d0/d2/dc/d90/df3/f112 141483 0 2024-08-01T06:56:41.417 INFO:tasks.workunit.client.0.smithi016.stdout:4/888: chown d0/d2/d68/c99 45325 1 2024-08-01T06:56:41.430 INFO:tasks.workunit.client.0.smithi016.stdout:5/931: rmdir d1/d2/d6/d5a/d65 39 2024-08-01T06:56:41.434 INFO:tasks.workunit.client.0.smithi016.stdout:9/918: truncate d3/f1d 3471237 0 2024-08-01T06:56:41.451 INFO:tasks.workunit.client.0.smithi016.stdout:6/915: mkdir d1/d8/d1b/d48/dd9/d131/d13e 0 2024-08-01T06:56:41.451 INFO:tasks.workunit.client.0.smithi016.stdout:3/773: fsync d9/fd 0 2024-08-01T06:56:41.454 INFO:tasks.workunit.client.0.smithi016.stdout:4/889: mkdir d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/d100/d126 0 2024-08-01T06:56:41.456 INFO:tasks.workunit.client.0.smithi016.stdout:5/932: dread d1/d2/d6/d9/d49/d57/d110/fb6 [0,4194304] 0 2024-08-01T06:56:41.461 INFO:tasks.workunit.client.0.smithi016.stdout:9/919: dread d3/f6a [0,4194304] 0 2024-08-01T06:56:41.462 INFO:tasks.workunit.client.0.smithi016.stdout:6/916: symlink d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/l13f 0 2024-08-01T06:56:41.464 INFO:tasks.workunit.client.0.smithi016.stdout:4/890: creat d0/d9d/df7/f127 x:0 0 0 2024-08-01T06:56:41.469 INFO:tasks.workunit.client.0.smithi016.stdout:4/891: creat d0/d2/d36/f128 x:0 0 0 2024-08-01T06:56:41.472 INFO:tasks.workunit.client.0.smithi016.stdout:9/920: symlink d3/d9/d46/d11f/l12d 0 2024-08-01T06:56:41.474 INFO:tasks.workunit.client.0.smithi016.stdout:9/921: truncate d3/d9/d73/f9e 151318 0 2024-08-01T06:56:41.479 INFO:tasks.workunit.client.0.smithi016.stdout:4/892: getdents d0/d2/dc/d12/dd3/d38 0 2024-08-01T06:56:41.480 INFO:tasks.workunit.client.0.smithi016.stdout:4/893: readlink d0/d2/dc/d90/lf6 0 2024-08-01T06:56:41.481 INFO:tasks.workunit.client.0.smithi016.stdout:6/917: rename d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/d91/fd4 to d1/d8/f140 0 2024-08-01T06:56:41.483 INFO:tasks.workunit.client.0.smithi016.stdout:3/774: dread - d9/da/df/d12/fda zero size 2024-08-01T06:56:41.484 INFO:tasks.workunit.client.0.smithi016.stdout:6/918: read - d1/d8/d1b/db5/d67/d8f/dba/f109 zero size 2024-08-01T06:56:41.486 INFO:tasks.workunit.client.0.smithi016.stdout:3/775: mknod d9/da/d96/dfe/d5c/d76/dfb/c109 0 2024-08-01T06:56:41.498 INFO:tasks.workunit.client.0.smithi016.stdout:5/933: truncate d1/d2/d23/dbb/f13b 610250 0 2024-08-01T06:56:41.499 INFO:tasks.workunit.client.0.smithi016.stdout:5/934: chown d1/d12/d7d/l93 109 1 2024-08-01T06:56:41.500 INFO:tasks.workunit.client.0.smithi016.stdout:9/922: write d3/d32/f36 [1552858,22749] 0 2024-08-01T06:56:41.500 INFO:tasks.workunit.client.0.smithi016.stdout:5/935: write d1/d2/d23/dbb/fbc [2231087,44380] 0 2024-08-01T06:56:41.506 INFO:tasks.workunit.client.0.smithi016.stdout:3/776: write d9/da/d96/dfe/d5c/fd7 [759554,82403] 0 2024-08-01T06:56:41.509 INFO:tasks.workunit.client.0.smithi016.stdout:4/894: dwrite d0/d2/dc/d12/dd3/d22/fe6 [0,4194304] 0 2024-08-01T06:56:41.511 INFO:tasks.workunit.client.0.smithi016.stdout:6/919: dwrite d1/d8/d1b/d22/f29 [0,4194304] 0 2024-08-01T06:56:41.514 INFO:tasks.workunit.client.0.smithi016.stdout:9/923: creat d3/d9/db/f12e x:0 0 0 2024-08-01T06:56:41.519 INFO:tasks.workunit.client.0.smithi016.stdout:5/936: link d1/d2/d20/d38/c63 d1/d12/ddd/c147 0 2024-08-01T06:56:41.519 INFO:tasks.workunit.client.0.smithi016.stdout:4/895: rmdir d0/d9d 39 2024-08-01T06:56:41.522 INFO:tasks.workunit.client.0.smithi016.stdout:9/924: creat d3/d9/db/dc/d56/d119/f12f x:0 0 0 2024-08-01T06:56:41.526 INFO:tasks.workunit.client.0.smithi016.stdout:5/937: dwrite d1/d2/d6/d9/d1b/dda/f144 [0,4194304] 0 2024-08-01T06:56:41.526 INFO:tasks.workunit.client.0.smithi016.stdout:3/777: creat d9/da/f10a x:0 0 0 2024-08-01T06:56:41.532 INFO:tasks.workunit.client.0.smithi016.stdout:4/896: dwrite d0/d2/dc/f2b [8388608,4194304] 0 2024-08-01T06:56:41.534 INFO:tasks.workunit.client.0.smithi016.stdout:6/920: rename d1/d8/d1b/d22/d2d/f9a to d1/d8/d1b/d22/f141 0 2024-08-01T06:56:41.535 INFO:tasks.workunit.client.0.smithi016.stdout:3/778: symlink d9/d98/db7/l10b 0 2024-08-01T06:56:41.537 INFO:tasks.workunit.client.0.smithi016.stdout:5/938: creat d1/d2/d6/d9/d1b/dda/df0/f148 x:0 0 0 2024-08-01T06:56:41.539 INFO:tasks.workunit.client.0.smithi016.stdout:4/897: mkdir d0/d2/dcd/d129 0 2024-08-01T06:56:41.542 INFO:tasks.workunit.client.0.smithi016.stdout:3/779: symlink d9/da/df/d2a/l10c 0 2024-08-01T06:56:41.543 INFO:tasks.workunit.client.0.smithi016.stdout:4/898: symlink d0/d2/dc/d12/dd3/d22/d73/l12a 0 2024-08-01T06:56:41.543 INFO:tasks.workunit.client.0.smithi016.stdout:9/925: link d3/d32/d5c/d8a/d57/cf8 d3/d9/d46/d103/c130 0 2024-08-01T06:56:41.545 INFO:tasks.workunit.client.0.smithi016.stdout:6/921: dwrite d1/f2 [0,4194304] 0 2024-08-01T06:56:41.591 INFO:tasks.workunit.client.0.smithi016.stdout:4/899: mknod d0/d2/dc/d12/dc7/c12b 0 2024-08-01T06:56:41.594 INFO:tasks.workunit.client.0.smithi016.stdout:4/900: rmdir d0/d2/da0/dd2 39 2024-08-01T06:56:41.597 INFO:tasks.workunit.client.0.smithi016.stdout:3/780: dwrite d9/da/d96/dfe/f4c [0,4194304] 0 2024-08-01T06:56:41.610 INFO:tasks.workunit.client.0.smithi016.stdout:6/922: dread d1/d8/d1b/d22/d36/d7a/dd3/fae [0,4194304] 0 2024-08-01T06:56:41.611 INFO:tasks.workunit.client.0.smithi016.stdout:3/781: truncate d9/da/df/d12/fa1 265804 0 2024-08-01T06:56:41.612 INFO:tasks.workunit.client.0.smithi016.stdout:3/782: write d9/da/d96/dfe/d3c/f4b [6389975,127996] 0 2024-08-01T06:56:41.614 INFO:tasks.workunit.client.0.smithi016.stdout:3/783: chown d9/d57/f82 474059 1 2024-08-01T06:56:41.614 INFO:tasks.workunit.client.0.smithi016.stdout:3/784: readlink d9/d1c/da4/lfa 0 2024-08-01T06:56:41.619 INFO:tasks.workunit.client.0.smithi016.stdout:4/901: write d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d91/fdd [4364291,35727] 0 2024-08-01T06:56:41.621 INFO:tasks.workunit.client.0.smithi016.stdout:6/923: rename d1/d8/d1b/d22/d36/d7a/dd3/da3/l11b to d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/dbc/d132/l142 0 2024-08-01T06:56:41.626 INFO:tasks.workunit.client.0.smithi016.stdout:3/785: write d9/da/d96/dfe/d5c/d76/dfb/f64 [4640246,111580] 0 2024-08-01T06:56:41.630 INFO:tasks.workunit.client.0.smithi016.stdout:4/902: write d0/d2/dc/d12/dd3/d22/d26/d85/dc1/f9b [346132,104529] 0 2024-08-01T06:56:41.631 INFO:tasks.workunit.client.0.smithi016.stdout:6/924: write d1/d8/d1b/d22/d2d/fc1 [1433167,115941] 0 2024-08-01T06:56:41.632 INFO:tasks.workunit.client.0.smithi016.stdout:3/786: symlink d9/da/d96/dc3/l10d 0 2024-08-01T06:56:41.635 INFO:tasks.workunit.client.0.smithi016.stdout:4/903: truncate d0/d9d/df7/f127 908965 0 2024-08-01T06:56:41.636 INFO:tasks.workunit.client.0.smithi016.stdout:6/925: chown d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/dbc/fda 251727 1 2024-08-01T06:56:41.638 INFO:tasks.workunit.client.0.smithi016.stdout:6/926: fsync d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/da2/fb7 0 2024-08-01T06:56:41.641 INFO:tasks.workunit.client.0.smithi016.stdout:6/927: dread - d1/d8/d94/f103 zero size 2024-08-01T06:56:41.646 INFO:tasks.workunit.client.0.smithi016.stdout:6/928: rename d1/d8/d1b/d22/d2d/fea to d1/d8/d1b/d22/d36/d7a/dd3/da3/d12e/f143 0 2024-08-01T06:56:41.650 INFO:tasks.workunit.client.0.smithi016.stdout:3/787: dread d9/d3e/f2d [4194304,4194304] 0 2024-08-01T06:56:41.650 INFO:tasks.workunit.client.0.smithi016.stdout:6/929: write d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/fc3 [4893669,19893] 0 2024-08-01T06:56:41.653 INFO:tasks.workunit.client.0.smithi016.stdout:4/904: write d0/d2/dc/d12/dd3/d38/f82 [4545966,45509] 0 2024-08-01T06:56:41.653 INFO:tasks.workunit.client.0.smithi016.stdout:3/788: fdatasync d9/da/df/d2a/f43 0 2024-08-01T06:56:41.660 INFO:tasks.workunit.client.0.smithi016.stdout:3/789: truncate d9/f1f 3596686 0 2024-08-01T06:56:41.661 INFO:tasks.workunit.client.0.smithi016.stdout:3/790: chown d9/da/d96/fa9 1754187 1 2024-08-01T06:56:41.662 INFO:tasks.workunit.client.0.smithi016.stdout:6/930: link d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/da2/fb7 d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/d91/dc0/f144 0 2024-08-01T06:56:41.663 INFO:tasks.workunit.client.0.smithi016.stdout:4/905: rmdir d0/d2/da0/dd2 39 2024-08-01T06:56:41.665 INFO:tasks.workunit.client.0.smithi016.stdout:3/791: mkdir d9/da/df/d2a/d49/d61/dc5/d10e 0 2024-08-01T06:56:41.666 INFO:tasks.workunit.client.0.smithi016.stdout:6/931: stat d1/d8/d1b/d22/d36/d7a/dd3/d3f/l47 0 2024-08-01T06:56:41.668 INFO:tasks.workunit.client.0.smithi016.stdout:3/792: creat d9/da/df/d12/da0/da5/f10f x:0 0 0 2024-08-01T06:56:41.673 INFO:tasks.workunit.client.0.smithi016.stdout:4/906: creat d0/d2/dc/d12/dd3/f12c x:0 0 0 2024-08-01T06:56:41.673 INFO:tasks.workunit.client.0.smithi016.stdout:6/932: dwrite d1/d8/d1b/db5/f97 [0,4194304] 0 2024-08-01T06:56:41.678 INFO:tasks.workunit.client.0.smithi016.stdout:6/933: creat d1/d43/d88/de5/f145 x:0 0 0 2024-08-01T06:56:41.680 INFO:tasks.workunit.client.0.smithi016.stdout:3/793: rename d9/da/d96/dfe/d5c/d76/dfb/c4f to d9/d3e/d40/d58/d59/c110 0 2024-08-01T06:56:41.685 INFO:tasks.workunit.client.0.smithi016.stdout:3/794: dread d9/da/fe0 [0,4194304] 0 2024-08-01T06:56:41.689 INFO:tasks.workunit.client.0.smithi016.stdout:3/795: rmdir d9/d3e 39 2024-08-01T06:56:41.689 INFO:tasks.workunit.client.0.smithi016.stdout:6/934: write d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d93/fb9 [177580,113373] 0 2024-08-01T06:56:41.694 INFO:tasks.workunit.client.0.smithi016.stdout:6/935: creat d1/d8/d1b/d22/d36/d7a/dd3/d3f/f146 x:0 0 0 2024-08-01T06:56:41.697 INFO:tasks.workunit.client.0.smithi016.stdout:3/796: getdents d9/d3e/d80 0 2024-08-01T06:56:41.699 INFO:tasks.workunit.client.0.smithi016.stdout:6/936: symlink d1/d43/d88/de5/dfd/l147 0 2024-08-01T06:56:41.703 INFO:tasks.workunit.client.0.smithi016.stdout:3/797: rename d9/d3e/d40 to d9/da/df/d12/da0/da5/d111 0 2024-08-01T06:56:41.707 INFO:tasks.workunit.client.0.smithi016.stdout:3/798: dread d9/f29 [0,4194304] 0 2024-08-01T06:56:41.712 INFO:tasks.workunit.client.0.smithi016.stdout:3/799: creat d9/da/d96/dc3/f112 x:0 0 0 2024-08-01T06:56:41.715 INFO:tasks.workunit.client.0.smithi016.stdout:3/800: creat d9/da/df/d2a/d49/d61/dc5/f113 x:0 0 0 2024-08-01T06:56:41.716 INFO:tasks.workunit.client.0.smithi016.stdout:6/937: dwrite d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f38 [0,4194304] 0 2024-08-01T06:56:41.717 INFO:tasks.workunit.client.0.smithi016.stdout:3/801: chown d9/da/fe0 780591147 1 2024-08-01T06:56:41.722 INFO:tasks.workunit.client.0.smithi016.stdout:6/938: dread d1/d41/dbf/f10c [0,4194304] 0 2024-08-01T06:56:41.727 INFO:tasks.workunit.client.0.smithi016.stdout:6/939: dread d1/d8/d1b/d22/f29 [0,4194304] 0 2024-08-01T06:56:41.730 INFO:tasks.workunit.client.0.smithi016.stdout:6/940: creat d1/d8/d1b/d48/dd9/d131/f148 x:0 0 0 2024-08-01T06:56:41.737 INFO:tasks.workunit.client.0.smithi016.stdout:3/802: dwrite d9/da/df/d12/fa1 [0,4194304] 0 2024-08-01T06:56:41.740 INFO:tasks.workunit.client.0.smithi016.stdout:6/941: truncate d1/d8/d1b/d22/d71/db1/f128 5629869 0 2024-08-01T06:56:41.741 INFO:tasks.workunit.client.0.smithi016.stdout:3/803: symlink d9/da/df/d12/da0/l114 0 2024-08-01T06:56:41.741 INFO:tasks.workunit.client.0.smithi016.stdout:6/942: stat d1/d8/d1b/d22/d36/d7a/dd3/da3/fc9 0 2024-08-01T06:56:41.744 INFO:tasks.workunit.client.0.smithi016.stdout:6/943: write d1/d8/d1b/d22/d2d/fc1 [1567645,23983] 0 2024-08-01T06:56:41.748 INFO:tasks.workunit.client.0.smithi016.stdout:6/944: mknod d1/d8/d1b/c149 0 2024-08-01T06:56:41.750 INFO:tasks.workunit.client.0.smithi016.stdout:3/804: dwrite d9/da/df/d12/da0/da5/d111/d58/d59/fba [0,4194304] 0 2024-08-01T06:56:41.752 INFO:tasks.workunit.client.0.smithi016.stdout:3/805: readlink d9/da/d96/dfe/d5c/d76/dfb/d81/ldf 0 2024-08-01T06:56:41.756 INFO:tasks.workunit.client.0.smithi016.stdout:6/945: creat d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d8e/dcf/da9/f14a x:0 0 0 2024-08-01T06:56:41.757 INFO:tasks.workunit.client.0.smithi016.stdout:3/806: creat d9/da/df/d2a/d49/f115 x:0 0 0 2024-08-01T06:56:41.761 INFO:tasks.workunit.client.0.smithi016.stdout:6/946: unlink d1/d8/d1b/d22/d36/d7a/dd3/l30 0 2024-08-01T06:56:41.763 INFO:tasks.workunit.client.0.smithi016.stdout:3/807: unlink d9/da/df/d12/da0/da5/d111/d58/d59/lf5 0 2024-08-01T06:56:41.764 INFO:tasks.workunit.client.0.smithi016.stdout:3/808: read - d9/da/d96/dc3/fd2 zero size 2024-08-01T06:56:41.765 INFO:tasks.workunit.client.0.smithi016.stdout:6/947: mkdir d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d8e/dcf/da9/d14b 0 2024-08-01T06:56:41.766 INFO:tasks.workunit.client.0.smithi016.stdout:6/948: stat d1/d8/d1b/d22/ca6 0 2024-08-01T06:56:41.775 INFO:tasks.workunit.client.0.smithi016.stdout:6/949: link d1/d8/f51 d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/da2/f14c 0 2024-08-01T06:56:41.776 INFO:tasks.workunit.client.0.smithi016.stdout:3/809: dwrite d9/d98/fb3 [0,4194304] 0 2024-08-01T06:56:41.788 INFO:tasks.workunit.client.0.smithi016.stdout:3/810: dwrite d9/da/d96/dfe/d5c/d76/dfb/d81/fb1 [0,4194304] 0 2024-08-01T06:56:41.789 INFO:tasks.workunit.client.0.smithi016.stdout:6/950: rename d1/d8/d1b to d1/d8/d1b/d22/d36/d7a/dd3/d14d 22 2024-08-01T06:56:41.793 INFO:tasks.workunit.client.0.smithi016.stdout:6/951: mkdir d1/d8/d1b/d22/d14e 0 2024-08-01T06:56:41.797 INFO:tasks.workunit.client.0.smithi016.stdout:3/811: dwrite d9/da/df/d53/f56 [0,4194304] 0 2024-08-01T06:56:41.800 INFO:tasks.workunit.client.0.smithi016.stdout:6/952: creat d1/d8/d1b/d22/f14f x:0 0 0 2024-08-01T06:56:41.804 INFO:tasks.workunit.client.0.smithi016.stdout:6/953: rename d1/d8/d1b/d22/d36/f127 to d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f150 0 2024-08-01T06:56:41.807 INFO:tasks.workunit.client.0.smithi016.stdout:6/954: truncate d1/d43/d88/f10e 305643 0 2024-08-01T06:56:41.808 INFO:tasks.workunit.client.0.smithi016.stdout:6/955: chown d1/d8/d1b/d22/f14f 7624 1 2024-08-01T06:56:41.810 INFO:tasks.workunit.client.0.smithi016.stdout:6/956: rename d1/d8/d94/f135 to d1/d43/d88/f151 0 2024-08-01T06:56:41.814 INFO:tasks.workunit.client.0.smithi016.stdout:6/957: mknod d1/d8/d1b/d48/dd9/d131/d13e/c152 0 2024-08-01T06:56:41.814 INFO:tasks.workunit.client.0.smithi016.stdout:3/812: write d9/da/d96/dfe/d5c/f9d [3614653,30522] 0 2024-08-01T06:56:41.817 INFO:tasks.workunit.client.0.smithi016.stdout:6/958: write d1/d8/d1b/d22/f29 [3118526,27112] 0 2024-08-01T06:56:41.818 INFO:tasks.workunit.client.0.smithi016.stdout:6/959: stat d1/d8/d1b/db5/c139 0 2024-08-01T06:56:41.820 INFO:tasks.workunit.client.0.smithi016.stdout:6/960: creat d1/d8/d1b/d48/dd9/f153 x:0 0 0 2024-08-01T06:56:41.822 INFO:tasks.workunit.client.0.smithi016.stdout:6/961: creat d1/d8/d1b/d48/dd9/d131/d13e/f154 x:0 0 0 2024-08-01T06:56:41.823 INFO:tasks.workunit.client.0.smithi016.stdout:6/962: readlink d1/d8/l3d 0 2024-08-01T06:56:41.825 INFO:tasks.workunit.client.0.smithi016.stdout:6/963: mkdir d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/d155 0 2024-08-01T06:56:41.827 INFO:tasks.workunit.client.0.smithi016.stdout:6/964: fsync d1/d8/d1b/d22/d36/f98 0 2024-08-01T06:56:41.834 INFO:tasks.workunit.client.0.smithi016.stdout:8/775: sync 2024-08-01T06:56:41.841 INFO:tasks.workunit.client.0.smithi016.stdout:8/776: creat d5/d8/f107 x:0 0 0 2024-08-01T06:56:41.842 INFO:tasks.workunit.client.0.smithi016.stdout:6/965: write d1/d43/d88/f10e [543316,83098] 0 2024-08-01T06:56:41.842 INFO:tasks.workunit.client.0.smithi016.stdout:8/777: creat d5/dc9/f108 x:0 0 0 2024-08-01T06:56:41.847 INFO:tasks.workunit.client.0.smithi016.stdout:8/778: mknod d5/d8/d1a/d24/d48/d60/d63/db4/c109 0 2024-08-01T06:56:41.849 INFO:tasks.workunit.client.0.smithi016.stdout:6/966: mkdir d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d93/d156 0 2024-08-01T06:56:41.851 INFO:tasks.workunit.client.0.smithi016.stdout:8/779: creat d5/d8/d1a/d24/d48/d69/d104/f10a x:0 0 0 2024-08-01T06:56:41.854 INFO:tasks.workunit.client.0.smithi016.stdout:8/780: mknod d5/d8/d1a/d24/d48/d6e/d83/c10b 0 2024-08-01T06:56:41.858 INFO:tasks.workunit.client.0.smithi016.stdout:8/781: rename d5/d8/d1a/d24/d6a to d5/d8/d1a/d24/d6a/d10c 22 2024-08-01T06:56:41.864 INFO:tasks.workunit.client.0.smithi016.stdout:6/967: dread d1/d8/d1b/d22/d36/f44 [0,4194304] 0 2024-08-01T06:56:41.865 INFO:tasks.workunit.client.0.smithi016.stdout:6/968: readlink d1/d8/d1b/d22/d71/l10f 0 2024-08-01T06:56:41.872 INFO:tasks.workunit.client.0.smithi016.stdout:6/969: dread d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/fcb [0,4194304] 0 2024-08-01T06:56:41.876 INFO:tasks.workunit.client.0.smithi016.stdout:6/970: write d1/d8/d1b/d22/d36/d7a/dd3/f74 [955739,128910] 0 2024-08-01T06:56:41.880 INFO:tasks.workunit.client.0.smithi016.stdout:6/971: rmdir d1/d8/d1b/d48/dd9 39 2024-08-01T06:56:41.884 INFO:tasks.workunit.client.0.smithi016.stdout:6/972: symlink d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/l157 0 2024-08-01T06:56:41.886 INFO:tasks.workunit.client.0.smithi016.stdout:6/973: creat d1/d8/d1b/d48/dd9/d131/f158 x:0 0 0 2024-08-01T06:56:41.893 INFO:tasks.workunit.client.0.smithi016.stdout:6/974: rename d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/d91/dc0/f144 to d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d93/d156/f159 0 2024-08-01T06:56:41.896 INFO:tasks.workunit.client.0.smithi016.stdout:6/975: mknod d1/d8/d1b/d22/c15a 0 2024-08-01T06:56:41.898 INFO:tasks.workunit.client.0.smithi016.stdout:6/976: rmdir d1/d8/d1b/d48/dd9/d131/d13e 39 2024-08-01T06:56:41.905 INFO:tasks.workunit.client.0.smithi016.stdout:6/977: dwrite d1/d43/d88/f10e [0,4194304] 0 2024-08-01T06:56:41.921 INFO:tasks.workunit.client.0.smithi016.stdout:6/978: write d1/d8/d94/f103 [27401,81249] 0 2024-08-01T06:56:41.929 INFO:tasks.workunit.client.0.smithi016.stdout:6/979: dwrite d1/d8/d1b/d22/d36/d7a/dd3/fae [0,4194304] 0 2024-08-01T06:56:41.932 INFO:tasks.workunit.client.0.smithi016.stdout:6/980: mknod d1/d8/d94/c15b 0 2024-08-01T06:56:41.936 INFO:tasks.workunit.client.0.smithi016.stdout:6/981: mkdir d1/d8/d1b/db5/d67/d15c 0 2024-08-01T06:56:41.942 INFO:tasks.workunit.client.0.smithi016.stdout:6/982: rename d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/fc3 to d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d8e/dcf/f15d 0 2024-08-01T06:56:41.944 INFO:tasks.workunit.client.0.smithi016.stdout:6/983: mkdir d1/d8/d94/d15e 0 2024-08-01T06:56:41.945 INFO:tasks.workunit.client.0.smithi016.stdout:6/984: chown d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/d12b 67720 1 2024-08-01T06:56:41.952 INFO:tasks.workunit.client.0.smithi016.stdout:6/985: link d1/d8/d1b/d48/dd9/d131/d13e/c152 d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8a/dbc/d132/c15f 0 2024-08-01T06:56:41.954 INFO:tasks.workunit.client.0.smithi016.stdout:6/986: symlink d1/d8/d94/d15e/l160 0 2024-08-01T06:56:41.959 INFO:tasks.workunit.client.0.smithi016.stdout:6/987: unlink d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d8e/f107 0 2024-08-01T06:56:41.962 INFO:tasks.workunit.client.0.smithi016.stdout:6/988: mknod d1/d8/d1b/d22/d36/d7a/dd3/d3f/d7d/d8b/d91/c161 0 2024-08-01T06:56:41.967 INFO:tasks.workunit.client.0.smithi016.stdout:6/989: mkdir d1/d8/d1b/db5/d67/d8f/dba/dbd/d162 0 2024-08-01T06:56:41.968 INFO:tasks.workunit.client.0.smithi016.stdout:6/990: truncate d1/d43/d88/f10e 4836359 0 2024-08-01T06:56:41.971 INFO:tasks.workunit.client.0.smithi016.stdout:6/991: link d1/d8/d1b/c11d d1/d8/d1b/c163 0 2024-08-01T06:56:41.977 INFO:tasks.workunit.client.0.smithi016.stdout:6/992: dwrite d1/d8/d1b/d48/dd9/d131/f148 [0,4194304] 0 2024-08-01T06:56:41.980 INFO:tasks.workunit.client.0.smithi016.stdout:6/993: write d1/d8/d1b/db5/d67/d8f/dba/dbd/d68/d79/d8e/dcf/da9/f14a [277399,129222] 0 2024-08-01T06:56:41.984 INFO:tasks.workunit.client.0.smithi016.stdout:6/994: mknod d1/d43/c164 0 2024-08-01T06:56:41.988 INFO:tasks.workunit.client.0.smithi016.stdout:6/995: creat d1/d43/d13d/f165 x:0 0 0 2024-08-01T06:56:41.990 INFO:tasks.workunit.client.0.smithi016.stdout:6/996: write d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f62 [4021222,41029] 0 2024-08-01T06:56:41.991 INFO:tasks.workunit.client.0.smithi016.stdout:7/792: sync 2024-08-01T06:56:41.999 INFO:tasks.workunit.client.0.smithi016.stdout:7/793: rename d7/db/d17/d72/d1c/d79/f98 to d7/db/d17/d72/f124 0 2024-08-01T06:56:42.007 INFO:tasks.workunit.client.0.smithi016.stdout:7/794: symlink d7/db/d17/d72/d1e/d26/l125 0 2024-08-01T06:56:42.011 INFO:tasks.workunit.client.0.smithi016.stdout:6/997: dwrite d1/d8/d1b/db5/d67/d8f/dba/dbd/da0/f150 [0,4194304] 0 2024-08-01T06:56:42.013 INFO:tasks.workunit.client.0.smithi016.stdout:6/998: fsync d1/d8/d1b/d22/d2d/fc1 0 2024-08-01T06:56:42.025 INFO:tasks.workunit.client.0.smithi016.stdout:7/795: dwrite d7/db/d17/d72/d22/ff3 [4194304,4194304] 0 2024-08-01T06:56:42.028 INFO:tasks.workunit.client.0.smithi016.stdout:6/999: dwrite d1/d8/d1b/d48/dd9/d131/d13e/f154 [0,4194304] 0 2024-08-01T06:56:42.046 INFO:tasks.workunit.client.0.smithi016.stdout:7/796: truncate d7/db/d17/d72/d1e/f1f 1594100 0 2024-08-01T06:56:42.049 INFO:tasks.workunit.client.0.smithi016.stdout:7/797: symlink d7/db/d17/d72/d1e/l126 0 2024-08-01T06:56:42.051 INFO:tasks.workunit.client.0.smithi016.stdout:7/798: stat d7/db/d17/d72/d1e/d26/d63/dc0/c102 0 2024-08-01T06:56:42.055 INFO:tasks.workunit.client.0.smithi016.stdout:7/799: creat d7/db/d17/d72/f127 x:0 0 0 2024-08-01T06:56:42.057 INFO:tasks.workunit.client.0.smithi016.stdout:7/800: fdatasync d7/db/d17/d72/d1e/d26/d63/d119/f93 0 2024-08-01T06:56:42.059 INFO:tasks.workunit.client.0.smithi016.stdout:7/801: chown d7/db/d17/d72/d1c/d1d/d40/d67/d7c/fe7 13711 1 2024-08-01T06:56:42.066 INFO:tasks.workunit.client.0.smithi016.stdout:7/802: dwrite d7/db/d17/d72/d1e/faa [0,4194304] 0 2024-08-01T06:56:42.069 INFO:tasks.workunit.client.0.smithi016.stdout:7/803: truncate f5 4935366 0 2024-08-01T06:56:42.070 INFO:tasks.workunit.client.0.smithi016.stdout:7/804: chown d7/db/d17/d72/d1c/l3b 98 1 2024-08-01T06:56:42.107 INFO:tasks.workunit.client.0.smithi016.stdout:0/933: sync 2024-08-01T06:56:42.108 INFO:tasks.workunit.client.0.smithi016.stdout:0/934: stat d10/d11/d37/d82/lc8 0 2024-08-01T06:56:42.110 INFO:tasks.workunit.client.0.smithi016.stdout:0/935: chown d10/d11/d37/c3f 4 1 2024-08-01T06:56:42.116 INFO:tasks.workunit.client.0.smithi016.stdout:0/936: symlink d10/d11/d41/l131 0 2024-08-01T06:56:42.116 INFO:tasks.workunit.client.0.smithi016.stdout:7/805: dwrite d7/db/d17/d72/d1c/d1d/d40/d7f/f90 [0,4194304] 0 2024-08-01T06:56:42.122 INFO:tasks.workunit.client.0.smithi016.stdout:7/806: unlink d7/db/d17/d72/d1c/d1d/d40/f73 0 2024-08-01T06:56:42.124 INFO:tasks.workunit.client.0.smithi016.stdout:7/807: dread - d7/db/d17/d72/d22/d77/d99/f10c zero size 2024-08-01T06:56:42.128 INFO:tasks.workunit.client.0.smithi016.stdout:7/808: creat d7/db/d17/d72/d22/d77/f128 x:0 0 0 2024-08-01T06:56:42.130 INFO:tasks.workunit.client.0.smithi016.stdout:7/809: chown d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/fb6 9424368 1 2024-08-01T06:56:42.131 INFO:tasks.workunit.client.0.smithi016.stdout:7/810: rmdir d7/db/d17/d72/d1e 39 2024-08-01T06:56:42.135 INFO:tasks.workunit.client.0.smithi016.stdout:7/811: mkdir d7/db/d17/d72/d1c/d1d/d40/d67/d7c/d8d/d129 0 2024-08-01T06:56:42.139 INFO:tasks.workunit.client.0.smithi016.stdout:7/812: mknod d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/df1/c12a 0 2024-08-01T06:56:42.149 INFO:tasks.workunit.client.0.smithi016.stdout:7/813: rename d7/db/d17/d72/d1c/d79/d8f/d39/c14 to d7/db/d17/d72/d1c/d1d/d40/c12b 0 2024-08-01T06:56:42.164 INFO:tasks.workunit.client.0.smithi016.stdout:7/814: fdatasync d7/db/d17/d72/d1e/f51 0 2024-08-01T06:56:42.177 INFO:tasks.workunit.client.0.smithi016.stdout:7/815: getdents d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/df1 0 2024-08-01T06:56:42.194 INFO:tasks.workunit.client.0.smithi016.stdout:7/816: write d7/db/d17/d72/f1b [2113790,77900] 0 2024-08-01T06:56:42.204 INFO:tasks.workunit.client.0.smithi016.stdout:7/817: creat d7/db/d17/d72/d1c/d97/df6/f12c x:0 0 0 2024-08-01T06:56:42.206 INFO:tasks.workunit.client.0.smithi016.stdout:7/818: write d7/db/d17/d72/d22/ff3 [2572650,13331] 0 2024-08-01T06:56:42.213 INFO:tasks.workunit.client.0.smithi016.stdout:7/819: fdatasync d7/db/d17/d72/d22/f4a 0 2024-08-01T06:56:42.218 INFO:tasks.workunit.client.0.smithi016.stdout:7/820: creat d7/db/d17/d72/d1c/d79/d8f/dfa/f12d x:0 0 0 2024-08-01T06:56:42.220 INFO:tasks.workunit.client.0.smithi016.stdout:7/821: chown d7/db/d17/d72/d1c/d1d/d40/d67/d7c/d10e/dcf/fd7 102541 1 2024-08-01T06:56:42.234 INFO:tasks.workunit.client.0.smithi016.stdout:7/822: getdents d7/db/d17/d72/d1c/d1d/d40 0 2024-08-01T06:56:42.245 INFO:tasks.workunit.client.0.smithi016.stdout:7/823: dwrite d7/db/d17/d72/d1c/d97/fd6 [0,4194304] 0 2024-08-01T06:56:42.249 INFO:tasks.workunit.client.0.smithi016.stdout:7/824: creat d7/db/d17/d72/d1c/d97/df6/f12e x:0 0 0 2024-08-01T06:56:42.252 INFO:tasks.workunit.client.0.smithi016.stdout:7/825: creat d7/db/d17/d72/d1c/d1d/d40/d67/d7c/f12f x:0 0 0 2024-08-01T06:56:42.254 INFO:tasks.workunit.client.0.smithi016.stdout:7/826: creat d7/db/d17/d72/d22/db4/f130 x:0 0 0 2024-08-01T06:56:42.256 INFO:tasks.workunit.client.0.smithi016.stdout:7/827: chown d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/df1/c12a 809 1 2024-08-01T06:56:42.258 INFO:tasks.workunit.client.0.smithi016.stdout:7/828: chown d7/db/d17/d72/d1e/d26/d2a/l74 60714457 1 2024-08-01T06:56:42.263 INFO:tasks.workunit.client.0.smithi016.stdout:7/829: rename d7/db/d17/d72/d1c/d1d/d40/d58/d80/fad to d7/db/d17/d72/d1c/d4f/f131 0 2024-08-01T06:56:42.268 INFO:tasks.workunit.client.0.smithi016.stdout:7/830: rename d7/db/d17/d72/d1e/faa to d7/db/d17/d72/d1c/d1d/d40/d7f/f132 0 2024-08-01T06:56:42.275 INFO:tasks.workunit.client.0.smithi016.stdout:7/831: rename d7/db/d17/d72/f10 to d7/f133 0 2024-08-01T06:56:42.279 INFO:tasks.workunit.client.0.smithi016.stdout:7/832: creat d7/db/d17/d72/d1e/d26/d63/dc0/d115/f134 x:0 0 0 2024-08-01T06:56:42.280 INFO:tasks.workunit.client.0.smithi016.stdout:7/833: write d7/db/d17/d72/d22/db4/ff7 [761105,66124] 0 2024-08-01T06:56:42.293 INFO:tasks.workunit.client.0.smithi016.stdout:7/834: dwrite d7/db/d17/d72/d22/f4a [0,4194304] 0 2024-08-01T06:56:42.295 INFO:tasks.workunit.client.0.smithi016.stdout:7/835: fsync d7/db/d17/fc3 0 2024-08-01T06:56:42.518 INFO:tasks.workunit.client.0.smithi016.stdout:5/939: sync 2024-08-01T06:56:42.525 INFO:tasks.workunit.client.0.smithi016.stdout:5/940: rename d1/d2/d23/dbb/f13b to d1/d2/d23/f149 0 2024-08-01T06:56:42.531 INFO:tasks.workunit.client.0.smithi016.stdout:5/941: getdents d1/d2/d6/d9/dd8 0 2024-08-01T06:56:42.535 INFO:tasks.workunit.client.0.smithi016.stdout:5/942: rename d1/d12/l1a to d1/d2/d6/d9/dd8/d12a/l14a 0 2024-08-01T06:56:42.541 INFO:tasks.workunit.client.0.smithi016.stdout:5/943: rename d1/d12/d7d/l9c to d1/d2/d6/d9/l14b 0 2024-08-01T06:56:42.542 INFO:tasks.workunit.client.0.smithi016.stdout:5/944: stat d1/f129 0 2024-08-01T06:56:42.870 INFO:tasks.workunit.client.0.smithi016.stdout:9/926: sync 2024-08-01T06:56:42.873 INFO:tasks.workunit.client.0.smithi016.stdout:9/927: mkdir d3/d9/db/d3a/d131 0 2024-08-01T06:56:42.876 INFO:tasks.workunit.client.0.smithi016.stdout:9/928: creat d3/d32/d5c/d8a/f132 x:0 0 0 2024-08-01T06:56:42.882 INFO:tasks.workunit.client.0.smithi016.stdout:9/929: rename d3/d9/db/dc/f27 to d3/d9/d46/d11f/f133 0 2024-08-01T06:56:42.893 INFO:tasks.workunit.client.0.smithi016.stdout:9/930: dread d3/f24 [0,4194304] 0 2024-08-01T06:56:42.897 INFO:tasks.workunit.client.0.smithi016.stdout:9/931: getdents d3/d32/d5c/d8a/df5 0 2024-08-01T06:56:42.900 INFO:tasks.workunit.client.0.smithi016.stdout:9/932: rename d3/d9/df/d16/d94/da5/fff to d3/d32/d5c/d8a/f134 0 2024-08-01T06:56:42.903 INFO:tasks.workunit.client.0.smithi016.stdout:9/933: mknod d3/d9/db/dc/c135 0 2024-08-01T06:56:42.910 INFO:tasks.workunit.client.0.smithi016.stdout:9/934: dwrite d3/d9/db/f12e [0,4194304] 0 2024-08-01T06:56:42.912 INFO:tasks.workunit.client.0.smithi016.stdout:9/935: chown d3/d32/d5c/d8a/f75 235271497 1 2024-08-01T06:56:42.925 INFO:tasks.workunit.client.0.smithi016.stdout:9/936: dread d3/d32/d5c/d8a/d57/f82 [0,4194304] 0 2024-08-01T06:56:42.926 INFO:tasks.workunit.client.0.smithi016.stdout:9/937: dread - d3/d32/d5c/d8a/f132 zero size 2024-08-01T06:56:42.933 INFO:tasks.workunit.client.0.smithi016.stdout:9/938: link d3/de/f7a d3/d9/d46/d103/f136 0 2024-08-01T06:56:42.938 INFO:tasks.workunit.client.0.smithi016.stdout:9/939: rename d3/d9/d46/d11f/f133 to d3/d9/df/f137 0 2024-08-01T06:56:42.944 INFO:tasks.workunit.client.0.smithi016.stdout:0/937: sync 2024-08-01T06:56:42.944 INFO:tasks.workunit.client.0.smithi016.stdout:3/813: sync 2024-08-01T06:56:42.944 INFO:tasks.workunit.client.0.smithi016.stdout:7/836: sync 2024-08-01T06:56:42.944 INFO:tasks.workunit.client.0.smithi016.stdout:4/907: sync 2024-08-01T06:56:42.944 INFO:tasks.workunit.client.0.smithi016.stdout:5/945: sync 2024-08-01T06:56:42.944 INFO:tasks.workunit.client.0.smithi016.stdout:8/782: sync 2024-08-01T06:56:42.947 INFO:tasks.workunit.client.0.smithi016.stdout:9/940: dwrite d3/d32/d5c/d8a/f113 [0,4194304] 0 2024-08-01T06:56:42.949 INFO:tasks.workunit.client.0.smithi016.stdout:0/938: unlink d10/c1f 0 2024-08-01T06:56:42.953 INFO:tasks.workunit.client.0.smithi016.stdout:8/783: creat d5/d8/d1a/d24/f10d x:0 0 0 2024-08-01T06:56:42.954 INFO:tasks.workunit.client.0.smithi016.stdout:7/837: creat d7/db/d17/d72/d1c/d79/d8f/d39/f135 x:0 0 0 2024-08-01T06:56:42.955 INFO:tasks.workunit.client.0.smithi016.stdout:5/946: mkdir d1/d2/d20/d68/de2/d14c 0 2024-08-01T06:56:42.955 INFO:tasks.workunit.client.0.smithi016.stdout:4/908: chown d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/d100/dd1/f11b 4 1 2024-08-01T06:56:42.958 INFO:tasks.workunit.client.0.smithi016.stdout:9/941: creat d3/d9/d46/d48/f138 x:0 0 0 2024-08-01T06:56:42.959 INFO:tasks.workunit.client.0.smithi016.stdout:0/939: mknod d10/d11/d37/d50/db1/dbb/c132 0 2024-08-01T06:56:42.960 INFO:tasks.workunit.client.0.smithi016.stdout:4/909: fdatasync d0/d2/dc/d12/dd3/f49 0 2024-08-01T06:56:42.961 INFO:tasks.workunit.client.0.smithi016.stdout:3/814: dread d9/da/df/d53/f56 [0,4194304] 0 2024-08-01T06:56:42.964 INFO:tasks.workunit.client.0.smithi016.stdout:7/838: chown d7/db/d17/d72/d1e/l126 0 1 2024-08-01T06:56:42.965 INFO:tasks.workunit.client.0.smithi016.stdout:9/942: unlink d3/d9/db/dc/d56/fdf 0 2024-08-01T06:56:42.966 INFO:tasks.workunit.client.0.smithi016.stdout:4/910: dread - d0/d2/da0/fd9 zero size 2024-08-01T06:56:42.967 INFO:tasks.workunit.client.0.smithi016.stdout:3/815: stat d9/da/d96/dfe 0 2024-08-01T06:56:42.967 INFO:tasks.workunit.client.0.smithi016.stdout:8/784: rename d5/d8/d1a/d24/d48/d60 to d5/d8/d1a/d24/d48/d69/d10e 0 2024-08-01T06:56:42.968 INFO:tasks.workunit.client.0.smithi016.stdout:9/943: read - d3/de/d89/fb6 zero size 2024-08-01T06:56:42.969 INFO:tasks.workunit.client.0.smithi016.stdout:7/839: unlink d7/db/d17/d72/d22/d77/d99/dd1/fee 0 2024-08-01T06:56:42.970 INFO:tasks.workunit.client.0.smithi016.stdout:3/816: write d9/da/df/d53/fcb [4827186,91363] 0 2024-08-01T06:56:42.972 INFO:tasks.workunit.client.0.smithi016.stdout:8/785: unlink d5/d1c/fab 0 2024-08-01T06:56:42.973 INFO:tasks.workunit.client.0.smithi016.stdout:9/944: mkdir d3/de/dd7/d139 0 2024-08-01T06:56:42.975 INFO:tasks.workunit.client.0.smithi016.stdout:9/945: chown d3/d32/c96 40520126 1 2024-08-01T06:56:42.977 INFO:tasks.workunit.client.0.smithi016.stdout:3/817: creat d9/da/d96/f116 x:0 0 0 2024-08-01T06:56:42.980 INFO:tasks.workunit.client.0.smithi016.stdout:9/946: mkdir d3/d9/d46/d48/d87/d124/d13a 0 2024-08-01T06:56:42.982 INFO:tasks.workunit.client.0.smithi016.stdout:3/818: rename d9/da/d96/dc3/ded to d9/d1c/da4/d117 0 2024-08-01T06:56:42.984 INFO:tasks.workunit.client.0.smithi016.stdout:9/947: creat d3/d9/db/d3a/f13b x:0 0 0 2024-08-01T06:56:42.990 INFO:tasks.workunit.client.0.smithi016.stdout:3/819: rename d9/da/df/d12/d75/dc7/fd6 to d9/da/df/d12/da0/da5/d111/d58/d59/f118 0 2024-08-01T06:56:42.990 INFO:tasks.workunit.client.0.smithi016.stdout:4/911: dread d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/d100/dd1/f11b [0,4194304] 0 2024-08-01T06:56:42.993 INFO:tasks.workunit.client.0.smithi016.stdout:3/820: symlink d9/da/d96/dfe/d5c/d76/dfb/l119 0 2024-08-01T06:56:42.993 INFO:tasks.workunit.client.0.smithi016.stdout:4/912: symlink d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d8f/l12d 0 2024-08-01T06:56:42.995 INFO:tasks.workunit.client.0.smithi016.stdout:4/913: read d0/d2/d36/f56 [552834,75643] 0 2024-08-01T06:56:42.998 INFO:tasks.workunit.client.0.smithi016.stdout:4/914: read d0/d2/dc/d12/dd3/d38/f82 [3906560,17757] 0 2024-08-01T06:56:43.014 INFO:tasks.workunit.client.0.smithi016.stdout:5/947: write d1/d2/d6/fd [2548719,126121] 0 2024-08-01T06:56:43.017 INFO:tasks.workunit.client.0.smithi016.stdout:5/948: readlink d1/d12/l11d 0 2024-08-01T06:56:43.020 INFO:tasks.workunit.client.0.smithi016.stdout:0/940: dwrite d10/d11/d37/f7d [4194304,4194304] 0 2024-08-01T06:56:43.025 INFO:tasks.workunit.client.0.smithi016.stdout:0/941: dread - d10/d5c/d90/da0/dbc/fca zero size 2024-08-01T06:56:43.026 INFO:tasks.workunit.client.0.smithi016.stdout:0/942: dread - d10/d1c/d7c/f121 zero size 2024-08-01T06:56:43.033 INFO:tasks.workunit.client.0.smithi016.stdout:8/786: write d5/d8/d1a/d24/d48/f56 [1108610,9397] 0 2024-08-01T06:56:43.034 INFO:tasks.workunit.client.0.smithi016.stdout:0/943: fsync d10/d11/d41/d95/fda 0 2024-08-01T06:56:43.055 INFO:tasks.workunit.client.0.smithi016.stdout:8/787: rename d5/d8/d1a/d24/d6a/ff9 to d5/d8/d1a/d24/d48/d85/f10f 0 2024-08-01T06:56:43.056 INFO:tasks.workunit.client.0.smithi016.stdout:9/948: dwrite d3/d9/db/d3e/d40/d4e/d11c/f4c [0,4194304] 0 2024-08-01T06:56:43.067 INFO:tasks.workunit.client.0.smithi016.stdout:9/949: creat d3/d9/db/d3a/dd8/f13c x:0 0 0 2024-08-01T06:56:43.067 INFO:tasks.workunit.client.0.smithi016.stdout:4/915: dwrite d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/f69 [0,4194304] 0 2024-08-01T06:56:43.069 INFO:tasks.workunit.client.0.smithi016.stdout:5/949: write d1/d2/d6/f6b [267573,113899] 0 2024-08-01T06:56:43.070 INFO:tasks.workunit.client.0.smithi016.stdout:5/950: read - d1/d12/ddd/f130 zero size 2024-08-01T06:56:43.071 INFO:tasks.workunit.client.0.smithi016.stdout:9/950: symlink d3/d9/db/d3e/d40/d80/l13d 0 2024-08-01T06:56:43.076 INFO:tasks.workunit.client.0.smithi016.stdout:5/951: rename d1/d2/d6/d5a/dfc/c10a to d1/df6/d12b/c14d 0 2024-08-01T06:56:43.079 INFO:tasks.workunit.client.0.smithi016.stdout:9/951: creat d3/de/dd7/d139/f13e x:0 0 0 2024-08-01T06:56:43.080 INFO:tasks.workunit.client.0.smithi016.stdout:0/944: write d10/d1c/f10d [3011076,29502] 0 2024-08-01T06:56:43.081 INFO:tasks.workunit.client.0.smithi016.stdout:9/952: read - d3/d9/d73/ffd zero size 2024-08-01T06:56:43.084 INFO:tasks.workunit.client.0.smithi016.stdout:9/953: fsync d3/de/d89/fa9 0 2024-08-01T06:56:43.091 INFO:tasks.workunit.client.0.smithi016.stdout:9/954: dwrite d3/d32/f36 [4194304,4194304] 0 2024-08-01T06:56:43.095 INFO:tasks.workunit.client.0.smithi016.stdout:9/955: mknod d3/d9/dd6/c13f 0 2024-08-01T06:56:43.098 INFO:tasks.workunit.client.0.smithi016.stdout:8/788: dwrite d5/d8/f93 [0,4194304] 0 2024-08-01T06:56:43.101 INFO:tasks.workunit.client.0.smithi016.stdout:9/956: mknod d3/d9/d46/d48/d87/d124/c140 0 2024-08-01T06:56:43.104 INFO:tasks.workunit.client.0.smithi016.stdout:9/957: write d3/de/dd7/d139/f13e [860660,7534] 0 2024-08-01T06:56:43.107 INFO:tasks.workunit.client.0.smithi016.stdout:8/789: rename d5/d8/d1a/d24/d48/l62 to d5/d8/d1a/d24/d48/d6e/d92/df5/l110 0 2024-08-01T06:56:43.109 INFO:tasks.workunit.client.0.smithi016.stdout:4/916: dwrite d0/d2/d36/f70 [0,4194304] 0 2024-08-01T06:56:43.114 INFO:tasks.workunit.client.0.smithi016.stdout:9/958: readlink d3/d32/la0 0 2024-08-01T06:56:43.119 INFO:tasks.workunit.client.0.smithi016.stdout:4/917: dread d0/d2/d36/dbd/fce [0,4194304] 0 2024-08-01T06:56:43.121 INFO:tasks.workunit.client.0.smithi016.stdout:8/790: rename d5/d8/d1a/d59 to d5/d8/d1a/d24/d48/d69/d10e/dfc/d111 0 2024-08-01T06:56:43.126 INFO:tasks.workunit.client.0.smithi016.stdout:4/918: creat d0/d2/dc/d12/dd3/d22/d26/da3/f12e x:0 0 0 2024-08-01T06:56:43.127 INFO:tasks.workunit.client.0.smithi016.stdout:9/959: chown d3/d9/db/dc/d33/c85 181923877 1 2024-08-01T06:56:43.133 INFO:tasks.workunit.client.0.smithi016.stdout:0/945: dwrite d10/d5c/d90/dbd/ff0 [0,4194304] 0 2024-08-01T06:56:43.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:42 smithi089 ceph-mon[36617]: pgmap v35: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 28 MiB/s rd, 87 MiB/s wr, 289 op/s 2024-08-01T06:56:43.138 INFO:tasks.workunit.client.0.smithi016.stdout:4/919: dread d0/d2/dc/d12/dd3/f30 [0,4194304] 0 2024-08-01T06:56:43.138 INFO:tasks.workunit.client.0.smithi016.stdout:8/791: dwrite d5/d8/d1a/da9/db6/fb7 [0,4194304] 0 2024-08-01T06:56:43.141 INFO:tasks.workunit.client.0.smithi016.stdout:0/946: truncate d10/d11/d41/d95/fda 324718 0 2024-08-01T06:56:43.144 INFO:tasks.workunit.client.0.smithi016.stdout:8/792: rename d5/d8/d1a/d24/d6a/lb1 to d5/d8/d1a/d24/d48/d6e/d92/df5/l112 0 2024-08-01T06:56:43.145 INFO:tasks.workunit.client.0.smithi016.stdout:4/920: truncate d0/d2/dc/d12/dd3/f101 992011 0 2024-08-01T06:56:43.147 INFO:tasks.workunit.client.0.smithi016.stdout:0/947: mkdir d10/d11/d37/d50/d133 0 2024-08-01T06:56:43.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:42 smithi016 ceph-mon[29266]: pgmap v35: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 28 MiB/s rd, 87 MiB/s wr, 289 op/s 2024-08-01T06:56:43.149 INFO:tasks.workunit.client.0.smithi016.stdout:4/921: chown d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d91/fdd 3 1 2024-08-01T06:56:43.149 INFO:tasks.workunit.client.0.smithi016.stdout:8/793: fdatasync d5/d67/d101/d105/fdb 0 2024-08-01T06:56:43.158 INFO:tasks.workunit.client.0.smithi016.stdout:8/794: dwrite d5/d8/d1a/d24/d48/d6e/d92/ffb [0,4194304] 0 2024-08-01T06:56:43.162 INFO:tasks.workunit.client.0.smithi016.stdout:8/795: mknod d5/dc/d3e/c113 0 2024-08-01T06:56:43.187 INFO:tasks.workunit.client.0.smithi016.stdout:9/960: dwrite d3/de/f7a [4194304,4194304] 0 2024-08-01T06:56:43.196 INFO:tasks.workunit.client.0.smithi016.stdout:9/961: symlink d3/d9/db/d3e/d106/l141 0 2024-08-01T06:56:43.208 INFO:tasks.workunit.client.0.smithi016.stdout:9/962: link d3/d9/d73/ffd d3/d9/df/d110/f142 0 2024-08-01T06:56:43.222 INFO:tasks.workunit.client.0.smithi016.stdout:9/963: link d3/d9/df/d16/cc4 d3/d9/d46/d48/d87/d124/c143 0 2024-08-01T06:56:43.222 INFO:tasks.workunit.client.0.smithi016.stdout:9/964: chown d3/d9/d46/d103 73 1 2024-08-01T06:56:43.223 INFO:tasks.workunit.client.0.smithi016.stdout:9/965: read - d3/d9/df/f126 zero size 2024-08-01T06:56:43.224 INFO:tasks.workunit.client.0.smithi016.stdout:9/966: chown d3/d9/db/d3e 13 1 2024-08-01T06:56:43.227 INFO:tasks.workunit.client.0.smithi016.stdout:0/948: truncate d10/d11/d37/d50/db1/f109 1264511 0 2024-08-01T06:56:43.230 INFO:tasks.workunit.client.0.smithi016.stdout:0/949: chown d10/d11/d37/d50/db1/fcd 166 1 2024-08-01T06:56:43.232 INFO:tasks.workunit.client.0.smithi016.stdout:4/922: dwrite d0/d2/dc/d12/dd3/f32 [0,4194304] 0 2024-08-01T06:56:43.235 INFO:tasks.workunit.client.0.smithi016.stdout:4/923: fsync d0/d2/dc/d12/dd3/d38/fe7 0 2024-08-01T06:56:43.239 INFO:tasks.workunit.client.0.smithi016.stdout:8/796: dwrite d5/d1c/f4c [0,4194304] 0 2024-08-01T06:56:43.242 INFO:tasks.workunit.client.0.smithi016.stdout:4/924: fsync d0/d2/dc/d12/dd3/d22/d26/d8b/feb 0 2024-08-01T06:56:43.243 INFO:tasks.workunit.client.0.smithi016.stdout:8/797: fsync d5/d8/f68 0 2024-08-01T06:56:43.251 INFO:tasks.workunit.client.0.smithi016.stdout:4/925: rmdir d0/d2/da0/dd2/dea 39 2024-08-01T06:56:43.255 INFO:tasks.workunit.client.0.smithi016.stdout:8/798: dread d5/d8/d1a/d24/d48/d69/d10e/f79 [0,4194304] 0 2024-08-01T06:56:43.255 INFO:tasks.workunit.client.0.smithi016.stdout:8/799: dread - d5/d8/f107 zero size 2024-08-01T06:56:43.258 INFO:tasks.workunit.client.0.smithi016.stdout:4/926: mknod d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d8f/c12f 0 2024-08-01T06:56:43.261 INFO:tasks.workunit.client.0.smithi016.stdout:8/800: symlink d5/d67/d101/l114 0 2024-08-01T06:56:43.270 INFO:tasks.workunit.client.0.smithi016.stdout:4/927: dwrite d0/d2/dc/d12/dd3/d22/d7f/ff0 [0,4194304] 0 2024-08-01T06:56:43.275 INFO:tasks.workunit.client.0.smithi016.stdout:0/950: write d10/d11/f42 [2114599,1230] 0 2024-08-01T06:56:43.275 INFO:tasks.workunit.client.0.smithi016.stdout:8/801: dwrite d5/d8/d1a/d24/d48/d69/d10e/d63/db4/f103 [0,4194304] 0 2024-08-01T06:56:43.275 INFO:tasks.workunit.client.0.smithi016.stdout:9/967: write d3/de/d89/fbf [795119,42033] 0 2024-08-01T06:56:43.279 INFO:tasks.workunit.client.0.smithi016.stdout:4/928: rmdir d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d91 39 2024-08-01T06:56:43.282 INFO:tasks.workunit.client.0.smithi016.stdout:4/929: truncate d0/d2/dc/d12/dc7/f11e 444123 0 2024-08-01T06:56:43.285 INFO:tasks.workunit.client.0.smithi016.stdout:8/802: rmdir d5/d8/d75/dba 39 2024-08-01T06:56:43.286 INFO:tasks.workunit.client.0.smithi016.stdout:9/968: mkdir d3/d9/d46/d48/dce/d144 0 2024-08-01T06:56:43.286 INFO:tasks.workunit.client.0.smithi016.stdout:8/803: fsync d5/d8/d1a/d24/d48/f7c 0 2024-08-01T06:56:43.288 INFO:tasks.workunit.client.0.smithi016.stdout:8/804: read - d5/d8/fd3 zero size 2024-08-01T06:56:43.294 INFO:tasks.workunit.client.0.smithi016.stdout:8/805: mknod d5/dc/d3e/c115 0 2024-08-01T06:56:43.298 INFO:tasks.workunit.client.0.smithi016.stdout:9/969: creat d3/d9/d46/d48/d87/d124/d13a/f145 x:0 0 0 2024-08-01T06:56:43.302 INFO:tasks.workunit.client.0.smithi016.stdout:4/930: dread d0/d2/dc/d12/dd3/d38/f82 [0,4194304] 0 2024-08-01T06:56:43.375 INFO:tasks.workunit.client.0.smithi016.stdout:0/951: write d10/d5c/d90/da0/dbc/fca [610897,20937] 0 2024-08-01T06:56:43.377 INFO:tasks.workunit.client.0.smithi016.stdout:8/806: rmdir d5/d8/d1a/d24/d6a 39 2024-08-01T06:56:43.386 INFO:tasks.workunit.client.0.smithi016.stdout:0/952: unlink d10/d11/d37/d58/l67 0 2024-08-01T06:56:43.387 INFO:tasks.workunit.client.0.smithi016.stdout:0/953: truncate d10/d11/d37/f11f 171689 0 2024-08-01T06:56:43.389 INFO:tasks.workunit.client.0.smithi016.stdout:8/807: creat d5/d8/d1a/d24/d48/d69/d10e/d63/de3/f116 x:0 0 0 2024-08-01T06:56:43.391 INFO:tasks.workunit.client.0.smithi016.stdout:8/808: write d5/d8/d1a/dbe/fd1 [2373090,36975] 0 2024-08-01T06:56:43.392 INFO:tasks.workunit.client.0.smithi016.stdout:9/970: symlink d3/d32/d5c/d8a/df5/l146 0 2024-08-01T06:56:43.393 INFO:tasks.workunit.client.0.smithi016.stdout:4/931: symlink d0/d2/da0/l130 0 2024-08-01T06:56:43.398 INFO:tasks.workunit.client.0.smithi016.stdout:4/932: creat d0/d2/dc/d12/dc7/f131 x:0 0 0 2024-08-01T06:56:43.399 INFO:tasks.workunit.client.0.smithi016.stdout:8/809: fsync d5/d8/d1a/f29 0 2024-08-01T06:56:43.408 INFO:tasks.workunit.client.0.smithi016.stdout:0/954: dread d10/f33 [0,4194304] 0 2024-08-01T06:56:43.408 INFO:tasks.workunit.client.0.smithi016.stdout:9/971: dread d3/d9/db/d3e/d40/f59 [0,4194304] 0 2024-08-01T06:56:43.415 INFO:tasks.workunit.client.0.smithi016.stdout:9/972: mknod d3/d9/db/d3a/d131/c147 0 2024-08-01T06:56:43.421 INFO:tasks.workunit.client.0.smithi016.stdout:9/973: dread d3/d9/db/d3e/f68 [0,4194304] 0 2024-08-01T06:56:43.426 INFO:tasks.workunit.client.0.smithi016.stdout:8/810: dwrite d5/dc/f17 [0,4194304] 0 2024-08-01T06:56:43.427 INFO:tasks.workunit.client.0.smithi016.stdout:9/974: chown d3/d9/df/f92 60542 1 2024-08-01T06:56:43.429 INFO:tasks.workunit.client.0.smithi016.stdout:0/955: dwrite d10/d11/d37/d82/ffb [0,4194304] 0 2024-08-01T06:56:43.460 INFO:tasks.workunit.client.0.smithi016.stdout:8/811: creat d5/dc/f117 x:0 0 0 2024-08-01T06:56:43.462 INFO:tasks.workunit.client.0.smithi016.stdout:9/975: symlink d3/d9/db/d3a/dd8/l148 0 2024-08-01T06:56:43.466 INFO:tasks.workunit.client.0.smithi016.stdout:0/956: read d10/d11/d37/d53/f69 [289327,102666] 0 2024-08-01T06:56:43.469 INFO:tasks.workunit.client.0.smithi016.stdout:9/976: fdatasync d3/de/d89/f8d 0 2024-08-01T06:56:43.470 INFO:tasks.workunit.client.0.smithi016.stdout:9/977: readlink d3/d9/df/d16/d94/da5/lc8 0 2024-08-01T06:56:43.475 INFO:tasks.workunit.client.0.smithi016.stdout:9/978: truncate d3/de/d89/fb6 1001965 0 2024-08-01T06:56:43.475 INFO:tasks.workunit.client.0.smithi016.stdout:9/979: stat d3/d9/df/d16/f30 0 2024-08-01T06:56:43.477 INFO:tasks.workunit.client.0.smithi016.stdout:0/957: mknod d10/d5c/d90/da2/da5/de8/c134 0 2024-08-01T06:56:43.477 INFO:tasks.workunit.client.0.smithi016.stdout:8/812: getdents d5/dc9 0 2024-08-01T06:56:43.478 INFO:tasks.workunit.client.0.smithi016.stdout:8/813: chown d5/d8/d1a 3117 1 2024-08-01T06:56:43.482 INFO:tasks.workunit.client.0.smithi016.stdout:0/958: dread d10/d11/d37/fa6 [0,4194304] 0 2024-08-01T06:56:43.484 INFO:tasks.workunit.client.0.smithi016.stdout:0/959: readlink d10/d5c/d90/da0/df6/dc7/l10c 0 2024-08-01T06:56:43.485 INFO:tasks.workunit.client.0.smithi016.stdout:9/980: dwrite d3/d9/db/d3e/d40/f4b [4194304,4194304] 0 2024-08-01T06:56:43.490 INFO:tasks.workunit.client.0.smithi016.stdout:9/981: chown d3/d9/db/dc/d56/d9b/fbe 2901 1 2024-08-01T06:56:43.498 INFO:tasks.workunit.client.0.smithi016.stdout:9/982: getdents d3/de/d6d 0 2024-08-01T06:56:43.500 INFO:tasks.workunit.client.0.smithi016.stdout:8/814: dread d5/dc/f31 [4194304,4194304] 0 2024-08-01T06:56:43.502 INFO:tasks.workunit.client.0.smithi016.stdout:9/983: rename d3/d9/db/d3e/f68 to d3/d9/df/d2a/dde/f149 0 2024-08-01T06:56:43.504 INFO:tasks.workunit.client.0.smithi016.stdout:0/960: dread d10/d11/d37/d82/fb2 [0,4194304] 0 2024-08-01T06:56:43.507 INFO:tasks.workunit.client.0.smithi016.stdout:8/815: dread d5/d8/d1a/d24/d48/f56 [0,4194304] 0 2024-08-01T06:56:43.508 INFO:tasks.workunit.client.0.smithi016.stdout:9/984: fsync d3/d9/db/dc/d56/d9b/fb9 0 2024-08-01T06:56:43.509 INFO:tasks.workunit.client.0.smithi016.stdout:0/961: dread d10/d11/d37/d58/f70 [4194304,4194304] 0 2024-08-01T06:56:43.513 INFO:tasks.workunit.client.0.smithi016.stdout:9/985: rename d3/d32/d5c/d8a/f75 to d3/d9/db/d3e/d40/d80/f14a 0 2024-08-01T06:56:43.514 INFO:tasks.workunit.client.0.smithi016.stdout:9/986: dread - d3/de/dd7/fe3 zero size 2024-08-01T06:56:43.517 INFO:tasks.workunit.client.0.smithi016.stdout:9/987: dread - d3/d9/db/d3a/fec zero size 2024-08-01T06:56:43.519 INFO:tasks.workunit.client.0.smithi016.stdout:9/988: mkdir d3/d32/d5c/dd9/d14b 0 2024-08-01T06:56:43.523 INFO:tasks.workunit.client.0.smithi016.stdout:0/962: truncate d10/d11/f42 592836 0 2024-08-01T06:56:43.533 INFO:tasks.workunit.client.0.smithi016.stdout:9/989: dread d3/d9/d46/d48/f55 [0,4194304] 0 2024-08-01T06:56:43.537 INFO:tasks.workunit.client.0.smithi016.stdout:9/990: mknod d3/d32/d5c/c14c 0 2024-08-01T06:56:43.541 INFO:tasks.workunit.client.0.smithi016.stdout:0/963: dwrite d10/d11/db4/fed [0,4194304] 0 2024-08-01T06:56:43.548 INFO:tasks.workunit.client.0.smithi016.stdout:0/964: dwrite d10/d11/ddd/f11b [0,4194304] 0 2024-08-01T06:56:43.556 INFO:tasks.workunit.client.0.smithi016.stdout:9/991: dwrite d3/de/d89/f8d [0,4194304] 0 2024-08-01T06:56:43.561 INFO:tasks.workunit.client.0.smithi016.stdout:9/992: creat d3/d9/df/d16/f14d x:0 0 0 2024-08-01T06:56:43.564 INFO:tasks.workunit.client.0.smithi016.stdout:9/993: unlink d3/d32/d5c/d8a/fca 0 2024-08-01T06:56:43.568 INFO:tasks.workunit.client.0.smithi016.stdout:9/994: symlink d3/d32/l14e 0 2024-08-01T06:56:43.570 INFO:tasks.workunit.client.0.smithi016.stdout:9/995: creat d3/d9/d46/d48/d87/df9/f14f x:0 0 0 2024-08-01T06:56:43.574 INFO:tasks.workunit.client.0.smithi016.stdout:9/996: rename d3/d9/db/d3e/d40/d80/f14a to d3/d9/d73/dfb/f150 0 2024-08-01T06:56:43.593 INFO:tasks.workunit.client.0.smithi016.stdout:7/840: sync 2024-08-01T06:56:43.593 INFO:tasks.workunit.client.0.smithi016.stdout:7/841: stat d7/db3 0 2024-08-01T06:56:43.593 INFO:tasks.workunit.client.0.smithi016.stdout:0/965: write d10/d11/d37/d58/f8c [4249832,54494] 0 2024-08-01T06:56:43.595 INFO:tasks.workunit.client.0.smithi016.stdout:0/966: chown d10/d11/d41/d95/ff7 25 1 2024-08-01T06:56:43.596 INFO:tasks.workunit.client.0.smithi016.stdout:7/842: dread - d7/db/d17/d72/d1c/d1d/d40/d58/da3/fe6 zero size 2024-08-01T06:56:43.598 INFO:tasks.workunit.client.0.smithi016.stdout:0/967: creat d10/d11/d37/d50/db1/dbb/f135 x:0 0 0 2024-08-01T06:56:43.600 INFO:tasks.workunit.client.0.smithi016.stdout:7/843: mkdir d7/db/d17/d72/d1c/d1d/d40/d58/d80/d136 0 2024-08-01T06:56:43.603 INFO:tasks.workunit.client.0.smithi016.stdout:0/968: rename d10/d5c/d90/da0/df6/dc7 to d10/d11/d37/d50/db1/dbb/d136 0 2024-08-01T06:56:43.604 INFO:tasks.workunit.client.0.smithi016.stdout:7/844: mkdir d7/db/d17/d72/d1c/d4f/d137 0 2024-08-01T06:56:43.606 INFO:tasks.workunit.client.0.smithi016.stdout:9/997: truncate d3/d9/df/d16/f1e 3538621 0 2024-08-01T06:56:43.607 INFO:tasks.workunit.client.0.smithi016.stdout:9/998: dread - d3/d9/df/f126 zero size 2024-08-01T06:56:43.607 INFO:tasks.workunit.client.0.smithi016.stdout:7/845: read d7/db/d17/d72/d1c/d1d/d40/d7f/f132 [2442436,46143] 0 2024-08-01T06:56:43.609 INFO:tasks.workunit.client.0.smithi016.stdout:7/846: chown d7/db/d17/d72/d1c/d1d/d40/d67/d7c/d10e 1272895950 1 2024-08-01T06:56:43.614 INFO:tasks.workunit.client.0.smithi016.stdout:0/969: write d10/fe7 [1169314,128522] 0 2024-08-01T06:56:43.616 INFO:tasks.workunit.client.0.smithi016.stdout:9/999: creat d3/d9/d46/d48/dce/d144/f151 x:0 0 0 2024-08-01T06:56:43.617 INFO:tasks.workunit.client.0.smithi016.stdout:0/970: write d10/d5c/d90/da2/da5/de8/deb/f130 [638801,127323] 0 2024-08-01T06:56:43.619 INFO:tasks.workunit.client.0.smithi016.stdout:7/847: rename d7/db/d17/d72/d1c/d1d/d40/d67/d7c/d8d/faf to d7/db/d17/d72/f138 0 2024-08-01T06:56:43.621 INFO:tasks.workunit.client.0.smithi016.stdout:0/971: creat d10/d1c/d7c/f137 x:0 0 0 2024-08-01T06:56:43.623 INFO:tasks.workunit.client.0.smithi016.stdout:0/972: unlink d10/d11/lb6 0 2024-08-01T06:56:43.625 INFO:tasks.workunit.client.0.smithi016.stdout:7/848: rename d7/db/d17/d72/d1c/d4f/fda to d7/db/d17/d72/d1c/d1d/d40/d67/d7c/d8d/f139 0 2024-08-01T06:56:43.626 INFO:tasks.workunit.client.0.smithi016.stdout:0/973: fsync d10/d11/d37/fef 0 2024-08-01T06:56:43.626 INFO:tasks.workunit.client.0.smithi016.stdout:7/849: stat d7/db/d17/d72/d1c/d1d/d40/d58/da3/fcd 0 2024-08-01T06:56:43.628 INFO:tasks.workunit.client.0.smithi016.stdout:0/974: dread - d10/d5c/d90/da2/fea zero size 2024-08-01T06:56:43.629 INFO:tasks.workunit.client.0.smithi016.stdout:0/975: write d10/f5a [1850250,24143] 0 2024-08-01T06:56:43.630 INFO:tasks.workunit.client.0.smithi016.stdout:7/850: read d7/db/d17/d72/d1c/f9a [455585,73179] 0 2024-08-01T06:56:43.633 INFO:tasks.workunit.client.0.smithi016.stdout:0/976: dread - d10/d5c/f10e zero size 2024-08-01T06:56:43.640 INFO:tasks.workunit.client.0.smithi016.stdout:0/977: rename d10/d5c to d10/d11/d37/d50/db1/d138 0 2024-08-01T06:56:43.644 INFO:tasks.workunit.client.0.smithi016.stdout:7/851: mkdir d7/db/d17/d72/d1c/d1d/d40/d67/d7c/d8d/d129/d13a 0 2024-08-01T06:56:43.649 INFO:tasks.workunit.client.0.smithi016.stdout:7/852: creat d7/db/d17/d72/d22/d77/d99/f13b x:0 0 0 2024-08-01T06:56:43.652 INFO:tasks.workunit.client.0.smithi016.stdout:7/853: fdatasync d7/db/d17/d72/fd5 0 2024-08-01T06:56:43.657 INFO:tasks.workunit.client.0.smithi016.stdout:7/854: mkdir d7/db/d17/d72/d22/db4/d13c 0 2024-08-01T06:56:43.659 INFO:tasks.workunit.client.0.smithi016.stdout:0/978: dwrite d10/d11/d37/d50/f77 [0,4194304] 0 2024-08-01T06:56:43.660 INFO:tasks.workunit.client.0.smithi016.stdout:7/855: write d7/db/d17/d72/d22/d77/f128 [688810,49403] 0 2024-08-01T06:56:43.663 INFO:tasks.workunit.client.0.smithi016.stdout:7/856: write d7/db/d17/d72/d22/d77/d99/f13b [363569,77148] 0 2024-08-01T06:56:43.667 INFO:tasks.workunit.client.0.smithi016.stdout:7/857: creat d7/db/d17/f13d x:0 0 0 2024-08-01T06:56:43.668 INFO:tasks.workunit.client.0.smithi016.stdout:0/979: write d10/d11/d37/d50/db1/d138/f10e [701671,120627] 0 2024-08-01T06:56:43.671 INFO:tasks.workunit.client.0.smithi016.stdout:7/858: symlink d7/db/d17/d72/d1c/dc6/l13e 0 2024-08-01T06:56:43.673 INFO:tasks.workunit.client.0.smithi016.stdout:0/980: read - d10/d11/d37/d50/db1/d138/d90/da2/da5/ff1 zero size 2024-08-01T06:56:43.674 INFO:tasks.workunit.client.0.smithi016.stdout:7/859: mkdir d7/db/d17/d13f 0 2024-08-01T06:56:43.676 INFO:tasks.workunit.client.0.smithi016.stdout:0/981: chown d10/c1b 234716 1 2024-08-01T06:56:43.681 INFO:tasks.workunit.client.0.smithi016.stdout:0/982: link d10/d11/d37/d82/lc8 d10/d1c/l139 0 2024-08-01T06:56:43.687 INFO:tasks.workunit.client.0.smithi016.stdout:0/983: dwrite d10/f5a [0,4194304] 0 2024-08-01T06:56:43.698 INFO:tasks.workunit.client.0.smithi016.stdout:0/984: link d10/d11/d41/d95/lc0 d10/d11/d37/d50/db1/dbb/d136/l13a 0 2024-08-01T06:56:43.749 INFO:tasks.workunit.client.0.smithi016.stdout:3/821: sync 2024-08-01T06:56:43.753 INFO:tasks.workunit.client.0.smithi016.stdout:3/822: rename d9/da/d96/dfe/d3c/f4b to d9/d1c/da4/d117/f11a 0 2024-08-01T06:56:43.760 INFO:tasks.workunit.client.0.smithi016.stdout:3/823: dwrite d9/d1c/da4/ff9 [0,4194304] 0 2024-08-01T06:56:43.765 INFO:tasks.workunit.client.0.smithi016.stdout:3/824: unlink d9/d3e/d80/ff0 0 2024-08-01T06:56:43.772 INFO:tasks.workunit.client.0.smithi016.stdout:3/825: creat d9/da/df/d12/f11b x:0 0 0 2024-08-01T06:56:43.772 INFO:tasks.workunit.client.0.smithi016.stdout:3/826: readlink d9/da/df/d12/da0/da5/ld4 0 2024-08-01T06:56:43.775 INFO:tasks.workunit.client.0.smithi016.stdout:3/827: creat d9/da/df/f11c x:0 0 0 2024-08-01T06:56:43.790 INFO:tasks.workunit.client.0.smithi016.stdout:3/828: write d9/da/df/d12/f42 [3866193,41195] 0 2024-08-01T06:56:43.799 INFO:tasks.workunit.client.0.smithi016.stdout:3/829: dwrite d9/da/df/d2a/d49/f62 [0,4194304] 0 2024-08-01T06:56:43.826 INFO:tasks.workunit.client.0.smithi016.stdout:3/830: dread d9/da/df/d2a/d49/db5/f7b [0,4194304] 0 2024-08-01T06:56:44.108 INFO:tasks.workunit.client.0.smithi016.stdout:5/952: sync 2024-08-01T06:56:44.112 INFO:tasks.workunit.client.0.smithi016.stdout:5/953: mkdir d1/d2/d6/d9/d19/d7a/d14e 0 2024-08-01T06:56:44.157 INFO:tasks.workunit.client.0.smithi016.stdout:8/816: sync 2024-08-01T06:56:44.157 INFO:tasks.workunit.client.0.smithi016.stdout:4/933: sync 2024-08-01T06:56:44.165 INFO:tasks.workunit.client.0.smithi016.stdout:8/817: dwrite d5/d8/f68 [0,4194304] 0 2024-08-01T06:56:44.166 INFO:tasks.workunit.client.0.smithi016.stdout:8/818: stat d5/d8/d1a/d24/f10d 0 2024-08-01T06:56:44.219 INFO:tasks.workunit.client.0.smithi016.stdout:8/819: fdatasync d5/d67/d101/d105/fdb 0 2024-08-01T06:56:44.221 INFO:tasks.workunit.client.0.smithi016.stdout:8/820: chown d5/d8/d1a/d24/d48/d85/da8/cce 302 1 2024-08-01T06:56:44.231 INFO:tasks.workunit.client.0.smithi016.stdout:5/954: write d1/df6/f11e [454057,90435] 0 2024-08-01T06:56:44.234 INFO:tasks.workunit.client.0.smithi016.stdout:4/934: creat d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/d100/dd1/de9/f132 x:0 0 0 2024-08-01T06:56:44.240 INFO:tasks.workunit.client.0.smithi016.stdout:5/955: creat d1/d2/d6/d9/d49/d57/db1/f14f x:0 0 0 2024-08-01T06:56:44.247 INFO:tasks.workunit.client.0.smithi016.stdout:4/935: getdents d0/d2/dc/d110 0 2024-08-01T06:56:44.252 INFO:tasks.workunit.client.0.smithi016.stdout:4/936: creat d0/db9/f133 x:0 0 0 2024-08-01T06:56:44.269 INFO:tasks.workunit.client.0.smithi016.stdout:7/860: sync 2024-08-01T06:56:44.270 INFO:tasks.workunit.client.0.smithi016.stdout:7/861: chown d7/db/d17/d72/d1c/d1d/d40/d58/d118 41712553 1 2024-08-01T06:56:44.313 INFO:tasks.workunit.client.0.smithi016.stdout:8/821: write d5/d8/f58 [1233440,89896] 0 2024-08-01T06:56:44.318 INFO:tasks.workunit.client.0.smithi016.stdout:8/822: read d5/d8/d1a/d24/d48/d69/d10e/f79 [190997,29246] 0 2024-08-01T06:56:44.321 INFO:tasks.workunit.client.0.smithi016.stdout:8/823: link d5/d8/d1a/d24/d48/d6e/d83/fea d5/d8/d1a/dbe/f118 0 2024-08-01T06:56:44.325 INFO:tasks.workunit.client.0.smithi016.stdout:4/937: write d0/d2/dc/d12/dd3/f2f [197603,63520] 0 2024-08-01T06:56:44.327 INFO:tasks.workunit.client.0.smithi016.stdout:4/938: write d0/d2/dc/d12/dd3/f2f [324123,39221] 0 2024-08-01T06:56:44.329 INFO:tasks.workunit.client.0.smithi016.stdout:4/939: write d0/d2/dc/d12/dd3/d22/d26/da3/f12e [1002389,36326] 0 2024-08-01T06:56:44.334 INFO:tasks.workunit.client.0.smithi016.stdout:4/940: creat d0/d2/dc/d110/f134 x:0 0 0 2024-08-01T06:56:44.338 INFO:tasks.workunit.client.0.smithi016.stdout:4/941: symlink d0/d2/dc/d90/l135 0 2024-08-01T06:56:44.339 INFO:tasks.workunit.client.0.smithi016.stdout:7/862: write d7/db/d17/d72/d1c/d1d/d40/d7f/fe3 [985355,59243] 0 2024-08-01T06:56:44.342 INFO:tasks.workunit.client.0.smithi016.stdout:4/942: rmdir d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d91 39 2024-08-01T06:56:44.344 INFO:tasks.workunit.client.0.smithi016.stdout:4/943: fdatasync d0/d2/d36/dbd/f10a 0 2024-08-01T06:56:44.344 INFO:tasks.workunit.client.0.smithi016.stdout:4/944: stat d0/d2/da0/cf8 0 2024-08-01T06:56:44.348 INFO:tasks.workunit.client.0.smithi016.stdout:4/945: creat d0/d2/dc/d90/f136 x:0 0 0 2024-08-01T06:56:44.349 INFO:tasks.workunit.client.0.smithi016.stdout:4/946: truncate d0/d2/dc/f15 4383096 0 2024-08-01T06:56:44.351 INFO:tasks.workunit.client.0.smithi016.stdout:4/947: mkdir d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/d100/dd1/d137 0 2024-08-01T06:56:44.353 INFO:tasks.workunit.client.0.smithi016.stdout:4/948: write d0/d2/d36/f125 [336406,42764] 0 2024-08-01T06:56:44.353 INFO:tasks.workunit.client.0.smithi016.stdout:4/949: readlink d0/l44 0 2024-08-01T06:56:44.354 INFO:tasks.workunit.client.0.smithi016.stdout:4/950: write d0/d2/dc/d12/dd3/d22/d26/fac [2219037,116388] 0 2024-08-01T06:56:44.356 INFO:tasks.workunit.client.0.smithi016.stdout:3/831: sync 2024-08-01T06:56:44.356 INFO:tasks.workunit.client.0.smithi016.stdout:0/985: sync 2024-08-01T06:56:44.358 INFO:tasks.workunit.client.0.smithi016.stdout:3/832: rmdir d9/d1c/da4/d117 39 2024-08-01T06:56:44.360 INFO:tasks.workunit.client.0.smithi016.stdout:4/951: symlink d0/d2/dc/d12/dd3/d22/d26/d8b/l138 0 2024-08-01T06:56:44.360 INFO:tasks.workunit.client.0.smithi016.stdout:4/952: readlink d0/d2/dc/d12/dd3/d38/l4d 0 2024-08-01T06:56:44.361 INFO:tasks.workunit.client.0.smithi016.stdout:3/833: mknod d9/da/df/d12/da0/c11d 0 2024-08-01T06:56:44.361 INFO:tasks.workunit.client.0.smithi016.stdout:4/953: write d0/db9/f133 [954907,125024] 0 2024-08-01T06:56:44.362 INFO:tasks.workunit.client.0.smithi016.stdout:8/824: truncate d5/d67/d101/d105/df0/fc8 515376 0 2024-08-01T06:56:44.364 INFO:tasks.workunit.client.0.smithi016.stdout:5/956: rename d1/fc9 to d1/d2/d6/d5a/d65/f150 0 2024-08-01T06:56:44.365 INFO:tasks.workunit.client.0.smithi016.stdout:8/825: chown d5/d8/d75/dba 1 1 2024-08-01T06:56:44.367 INFO:tasks.workunit.client.0.smithi016.stdout:3/834: symlink d9/da/df/d2a/d49/d61/dc5/l11e 0 2024-08-01T06:56:44.369 INFO:tasks.workunit.client.0.smithi016.stdout:3/835: dread - d9/d57/fd3 zero size 2024-08-01T06:56:44.369 INFO:tasks.workunit.client.0.smithi016.stdout:4/954: mknod d0/d2/dc/d12/dd3/d22/d7f/c139 0 2024-08-01T06:56:44.370 INFO:tasks.workunit.client.0.smithi016.stdout:7/863: rename d7/db/d17/d72/d22/d77/c86 to d7/db/d17/d72/d1c/c140 0 2024-08-01T06:56:44.372 INFO:tasks.workunit.client.0.smithi016.stdout:3/836: readlink d9/da/df/d2a/d49/d61/lc4 0 2024-08-01T06:56:44.372 INFO:tasks.workunit.client.0.smithi016.stdout:5/957: dwrite d1/d2/d6/d9/d49/d57/d110/f42 [0,4194304] 0 2024-08-01T06:56:44.373 INFO:tasks.workunit.client.0.smithi016.stdout:5/958: readlink d1/d12/l11c 0 2024-08-01T06:56:44.374 INFO:tasks.workunit.client.0.smithi016.stdout:3/837: dread - d9/da/d96/f116 zero size 2024-08-01T06:56:44.376 INFO:tasks.workunit.client.0.smithi016.stdout:8/826: symlink d5/d8/d1a/d24/d48/d85/da8/l119 0 2024-08-01T06:56:44.378 INFO:tasks.workunit.client.0.smithi016.stdout:5/959: rmdir d1/d12/ddd 39 2024-08-01T06:56:44.379 INFO:tasks.workunit.client.0.smithi016.stdout:7/864: read d7/db/d17/d72/d1c/d79/d8f/dd3/ff2 [400686,91467] 0 2024-08-01T06:56:44.382 INFO:tasks.workunit.client.0.smithi016.stdout:8/827: creat d5/d8/d1a/d24/d48/d69/d10e/dfc/f11a x:0 0 0 2024-08-01T06:56:44.386 INFO:tasks.workunit.client.0.smithi016.stdout:3/838: fdatasync d9/da/df/d2a/d49/db5/f9b 0 2024-08-01T06:56:44.391 INFO:tasks.workunit.client.0.smithi016.stdout:7/865: truncate d7/db/dc7/fba 636736 0 2024-08-01T06:56:44.393 INFO:tasks.workunit.client.0.smithi016.stdout:7/866: chown d7/db/d17/d72/d1c/d79/d8f/d39/f41 45 1 2024-08-01T06:56:44.394 INFO:tasks.workunit.client.0.smithi016.stdout:8/828: creat d5/d8/d1a/d24/d48/d6e/d92/f11b x:0 0 0 2024-08-01T06:56:44.397 INFO:tasks.workunit.client.0.smithi016.stdout:5/960: mknod d1/d2/d20/db8/d132/c151 0 2024-08-01T06:56:44.400 INFO:tasks.workunit.client.0.smithi016.stdout:3/839: unlink d9/da/d18/de1/ce3 0 2024-08-01T06:56:44.400 INFO:tasks.workunit.client.0.smithi016.stdout:4/955: write d0/d2/dc/d12/fc6 [4951575,10107] 0 2024-08-01T06:56:44.402 INFO:tasks.workunit.client.0.smithi016.stdout:3/840: write d9/da/df/d53/fcb [2347226,44573] 0 2024-08-01T06:56:44.404 INFO:tasks.workunit.client.0.smithi016.stdout:3/841: fdatasync d9/da/df/d12/da0/da5/f106 0 2024-08-01T06:56:44.406 INFO:tasks.workunit.client.0.smithi016.stdout:8/829: creat d5/d8/d1a/dbe/f11c x:0 0 0 2024-08-01T06:56:44.407 INFO:tasks.workunit.client.0.smithi016.stdout:8/830: chown d5/d8/d1a/d24/d48/d6e/deb 44591 1 2024-08-01T06:56:44.408 INFO:tasks.workunit.client.0.smithi016.stdout:8/831: chown d5/d1c/l1f 96874079 1 2024-08-01T06:56:44.411 INFO:tasks.workunit.client.0.smithi016.stdout:4/956: chown d0/d2/dc/d12/dd3/d38/cf1 4160422 1 2024-08-01T06:56:44.412 INFO:tasks.workunit.client.0.smithi016.stdout:4/957: chown d0/d9d 1 1 2024-08-01T06:56:44.415 INFO:tasks.workunit.client.0.smithi016.stdout:3/842: fsync d9/d57/d66/f84 0 2024-08-01T06:56:44.419 INFO:tasks.workunit.client.0.smithi016.stdout:7/867: dwrite d7/db/d17/d72/d1c/f9a [0,4194304] 0 2024-08-01T06:56:44.421 INFO:tasks.workunit.client.0.smithi016.stdout:8/832: creat d5/d8/d1a/d24/d8c/f11d x:0 0 0 2024-08-01T06:56:44.433 INFO:tasks.workunit.client.0.smithi016.stdout:5/961: dwrite d1/d2/d23/feb [0,4194304] 0 2024-08-01T06:56:44.433 INFO:tasks.workunit.client.0.smithi016.stdout:4/958: mknod d0/d2/dc/d12/dd3/d22/c13a 0 2024-08-01T06:56:44.435 INFO:tasks.workunit.client.0.smithi016.stdout:8/833: chown d5/d8/d1a/l30 1945 1 2024-08-01T06:56:44.437 INFO:tasks.workunit.client.0.smithi016.stdout:8/834: fsync d5/d8/d1a/da9/db6/fb7 0 2024-08-01T06:56:44.482 INFO:tasks.workunit.client.0.smithi016.stdout:5/962: mkdir d1/df6/d12b/d152 0 2024-08-01T06:56:44.482 INFO:tasks.workunit.client.0.smithi016.stdout:5/963: stat d1/d2/d6/d9/d49/d57/db1/f125 0 2024-08-01T06:56:44.485 INFO:tasks.workunit.client.0.smithi016.stdout:8/835: creat d5/d8/d1a/d24/d48/d6e/d83/f11e x:0 0 0 2024-08-01T06:56:44.490 INFO:tasks.workunit.client.0.smithi016.stdout:3/843: rename d9/d98/fb3 to d9/da/d96/dfe/d5c/f11f 0 2024-08-01T06:56:44.491 INFO:tasks.workunit.client.0.smithi016.stdout:7/868: creat d7/db/d17/d72/d1c/d97/f141 x:0 0 0 2024-08-01T06:56:44.497 INFO:tasks.workunit.client.0.smithi016.stdout:4/959: dread d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d8f/faa [0,4194304] 0 2024-08-01T06:56:44.498 INFO:tasks.workunit.client.0.smithi016.stdout:3/844: mkdir d9/da/d96/dc3/d120 0 2024-08-01T06:56:44.500 INFO:tasks.workunit.client.0.smithi016.stdout:7/869: truncate d7/db/d17/d72/d1e/d26/f32 2686479 0 2024-08-01T06:56:44.501 INFO:tasks.workunit.client.0.smithi016.stdout:8/836: rmdir d5/d8/d1a/d24/d6a 39 2024-08-01T06:56:44.502 INFO:tasks.workunit.client.0.smithi016.stdout:3/845: rmdir d9/d57/d91 39 2024-08-01T06:56:44.506 INFO:tasks.workunit.client.0.smithi016.stdout:7/870: mkdir d7/db/d17/d13f/d142 0 2024-08-01T06:56:44.507 INFO:tasks.workunit.client.0.smithi016.stdout:7/871: readlink d7/db/d17/d72/d1e/d26/d63/l87 0 2024-08-01T06:56:44.508 INFO:tasks.workunit.client.0.smithi016.stdout:3/846: rename d9/da/f2e to d9/da/df/d12/d75/f121 0 2024-08-01T06:56:44.508 INFO:tasks.workunit.client.0.smithi016.stdout:3/847: stat d9/f9c 0 2024-08-01T06:56:44.508 INFO:tasks.workunit.client.0.smithi016.stdout:7/872: stat d7/db/d17/d72/f7a 0 2024-08-01T06:56:44.509 INFO:tasks.workunit.client.0.smithi016.stdout:3/848: chown d9/da/d96/dc3 744290289 1 2024-08-01T06:56:44.513 INFO:tasks.workunit.client.0.smithi016.stdout:3/849: creat d9/da/df/d12/d75/d104/f122 x:0 0 0 2024-08-01T06:56:44.518 INFO:tasks.workunit.client.0.smithi016.stdout:7/873: creat d7/db/d17/d72/d1c/d4f/d137/f143 x:0 0 0 2024-08-01T06:56:44.518 INFO:tasks.workunit.client.0.smithi016.stdout:4/960: dread d0/d2/dc/d12/dd3/d22/d26/d8b/faf [4194304,4194304] 0 2024-08-01T06:56:44.518 INFO:tasks.workunit.client.0.smithi016.stdout:4/961: readlink d0/d2/dc/d12/dd3/d22/d7f/lbf 0 2024-08-01T06:56:44.521 INFO:tasks.workunit.client.0.smithi016.stdout:3/850: rename d9/da/df/d2a/d49/d61/f89 to d9/da/d96/dfe/d5c/d76/dfb/d72/f123 0 2024-08-01T06:56:44.528 INFO:tasks.workunit.client.0.smithi016.stdout:5/964: dwrite d1/d2/d20/d72/f94 [0,4194304] 0 2024-08-01T06:56:44.528 INFO:tasks.workunit.client.0.smithi016.stdout:7/874: dwrite d7/db/d17/d72/d22/db4/f11b [0,4194304] 0 2024-08-01T06:56:44.530 INFO:tasks.workunit.client.0.smithi016.stdout:5/965: readlink d1/d2/d6/d9/d49/l139 0 2024-08-01T06:56:44.530 INFO:tasks.workunit.client.0.smithi016.stdout:4/962: rename d0/d2/dc/d12/dd3/d22/d7f/l88 to d0/d2/dc/d12/dd3/d22/d7f/l13b 0 2024-08-01T06:56:44.531 INFO:tasks.workunit.client.0.smithi016.stdout:5/966: chown d1/d2/d6/d9 211713044 1 2024-08-01T06:56:44.536 INFO:tasks.workunit.client.0.smithi016.stdout:8/837: truncate d5/d8/f68 4103772 0 2024-08-01T06:56:44.539 INFO:tasks.workunit.client.0.smithi016.stdout:3/851: mkdir d9/da/df/d12/d75/dc7/d124 0 2024-08-01T06:56:44.541 INFO:tasks.workunit.client.0.smithi016.stdout:5/967: dwrite d1/d2/d20/d72/f135 [0,4194304] 0 2024-08-01T06:56:44.543 INFO:tasks.workunit.client.0.smithi016.stdout:7/875: creat d7/db/d17/d72/d1c/d1d/d40/d67/d7c/d8d/d129/f144 x:0 0 0 2024-08-01T06:56:44.549 INFO:tasks.workunit.client.0.smithi016.stdout:8/838: mkdir d5/d67/d101/d105/df0/d11f 0 2024-08-01T06:56:44.552 INFO:tasks.workunit.client.0.smithi016.stdout:5/968: unlink d1/d2/d6/d9/d19/dd3/fe7 0 2024-08-01T06:56:44.554 INFO:tasks.workunit.client.0.smithi016.stdout:4/963: rename d0/d2/dc/d12/c78 to d0/d2/dc/d12/dc7/c13c 0 2024-08-01T06:56:44.558 INFO:tasks.workunit.client.0.smithi016.stdout:8/839: symlink d5/d67/d101/d105/df0/de2/dd6/l120 0 2024-08-01T06:56:44.561 INFO:tasks.workunit.client.0.smithi016.stdout:7/876: mknod d7/db/d17/d72/c145 0 2024-08-01T06:56:44.572 INFO:tasks.workunit.client.0.smithi016.stdout:8/840: rename d5/d8/d1a/d24/d6a/c7a to d5/dc9/c121 0 2024-08-01T06:56:44.574 INFO:tasks.workunit.client.0.smithi016.stdout:3/852: getdents d9/da/d96 0 2024-08-01T06:56:44.577 INFO:tasks.workunit.client.0.smithi016.stdout:5/969: rmdir d1/df6/d12b/d137 0 2024-08-01T06:56:44.577 INFO:tasks.workunit.client.0.smithi016.stdout:7/877: dread d7/db/d17/d72/d1c/d1d/d6d/fec [0,4194304] 0 2024-08-01T06:56:44.579 INFO:tasks.workunit.client.0.smithi016.stdout:3/853: truncate d9/d57/fb9 975599 0 2024-08-01T06:56:44.579 INFO:tasks.workunit.client.0.smithi016.stdout:4/964: dread d0/d2/dc/d12/dd3/f9c [0,4194304] 0 2024-08-01T06:56:44.581 INFO:tasks.workunit.client.0.smithi016.stdout:7/878: read d7/db/d17/d72/d1e/d26/d63/d119/f6c [1345190,457] 0 2024-08-01T06:56:44.582 INFO:tasks.workunit.client.0.smithi016.stdout:7/879: chown d7/db/d17/d72/d1e/d26 3166 1 2024-08-01T06:56:44.583 INFO:tasks.workunit.client.0.smithi016.stdout:3/854: chown d9/da/df/cfc 32612539 1 2024-08-01T06:56:44.584 INFO:tasks.workunit.client.0.smithi016.stdout:3/855: chown d9/da/df/d2a/d49/d61 115576376 1 2024-08-01T06:56:44.585 INFO:tasks.workunit.client.0.smithi016.stdout:8/841: link d5/dc/de1/le6 d5/d8/d1a/da9/db6/l122 0 2024-08-01T06:56:44.587 INFO:tasks.workunit.client.0.smithi016.stdout:7/880: rmdir d7/db/d17/d72/d22/db4 39 2024-08-01T06:56:44.589 INFO:tasks.workunit.client.0.smithi016.stdout:4/965: fdatasync d0/d2/dc/d12/dd3/f101 0 2024-08-01T06:56:44.592 INFO:tasks.workunit.client.0.smithi016.stdout:3/856: read d9/da/d96/dfe/f35 [315085,44772] 0 2024-08-01T06:56:44.595 INFO:tasks.workunit.client.0.smithi016.stdout:8/842: mkdir d5/d8/d1a/d24/d48/d6e/d123 0 2024-08-01T06:56:44.596 INFO:tasks.workunit.client.0.smithi016.stdout:4/966: dread d0/d2/dc/d12/dd3/d22/d26/da3/f12e [0,4194304] 0 2024-08-01T06:56:44.606 INFO:tasks.workunit.client.0.smithi016.stdout:3/857: rmdir d9/da/df/d12/da0/da5/d111/d58 39 2024-08-01T06:56:44.606 INFO:tasks.workunit.client.0.smithi016.stdout:3/858: chown d9/da/df/d53 502312807 1 2024-08-01T06:56:44.607 INFO:tasks.workunit.client.0.smithi016.stdout:3/859: readlink d9/d98/lf4 0 2024-08-01T06:56:44.610 INFO:tasks.workunit.client.0.smithi016.stdout:5/970: link d1/d2/d6/d9/ff8 d1/d2/d6/d9/d19/d7a/dc5/f153 0 2024-08-01T06:56:44.624 INFO:tasks.workunit.client.0.smithi016.stdout:8/843: mkdir d5/d8/d124 0 2024-08-01T06:56:44.628 INFO:tasks.workunit.client.0.smithi016.stdout:4/967: symlink d0/d2/dc/d12/dd3/d22/d26/de0/l13d 0 2024-08-01T06:56:44.628 INFO:tasks.workunit.client.0.smithi016.stdout:7/881: write d7/db/d17/d72/d22/d77/d99/dd1/ddc/ff8 [2065653,89204] 0 2024-08-01T06:56:44.630 INFO:tasks.workunit.client.0.smithi016.stdout:3/860: link d9/da/df/d2a/d49/db5/fcf d9/da/df/d12/d75/d104/f125 0 2024-08-01T06:56:44.637 INFO:tasks.workunit.client.0.smithi016.stdout:4/968: symlink d0/d2/d36/dbd/l13e 0 2024-08-01T06:56:44.638 INFO:tasks.workunit.client.0.smithi016.stdout:3/861: symlink d9/da/d18/l126 0 2024-08-01T06:56:44.639 INFO:tasks.workunit.client.0.smithi016.stdout:3/862: read - d9/da/df/d12/d75/d104/f122 zero size 2024-08-01T06:56:44.642 INFO:tasks.workunit.client.0.smithi016.stdout:7/882: rename d7/db/d17/d72/d1c/d1d/d40/d58/da3/l11e to d7/db/d17/d13f/l146 0 2024-08-01T06:56:44.643 INFO:tasks.workunit.client.0.smithi016.stdout:8/844: truncate d5/d8/f68 4804462 0 2024-08-01T06:56:44.646 INFO:tasks.workunit.client.0.smithi016.stdout:4/969: chown d0/d9d/df7/c10d 969281987 1 2024-08-01T06:56:44.648 INFO:tasks.workunit.client.0.smithi016.stdout:7/883: creat d7/db/d17/d72/d1e/d26/d63/d119/f147 x:0 0 0 2024-08-01T06:56:44.648 INFO:tasks.workunit.client.0.smithi016.stdout:5/971: dwrite d1/d2/d23/f81 [0,4194304] 0 2024-08-01T06:56:44.651 INFO:tasks.workunit.client.0.smithi016.stdout:5/972: write d1/d2/d6/d9/d1b/dda/df0/f145 [685906,56044] 0 2024-08-01T06:56:44.651 INFO:tasks.workunit.client.0.smithi016.stdout:3/863: link d9/d98/db7/ff2 d9/da/d18/de1/f127 0 2024-08-01T06:56:44.657 INFO:tasks.workunit.client.0.smithi016.stdout:4/970: creat d0/d2/dc/f13f x:0 0 0 2024-08-01T06:56:44.663 INFO:tasks.workunit.client.0.smithi016.stdout:5/973: dread - d1/d12/ddd/f130 zero size 2024-08-01T06:56:44.665 INFO:tasks.workunit.client.0.smithi016.stdout:4/971: dwrite d0/d2/dc/f34 [0,4194304] 0 2024-08-01T06:56:44.665 INFO:tasks.workunit.client.0.smithi016.stdout:5/974: chown d1/d2/d6/d9/d49/d57/d110/fb6 13 1 2024-08-01T06:56:44.667 INFO:tasks.workunit.client.0.smithi016.stdout:5/975: truncate d1/f142 251404 0 2024-08-01T06:56:44.667 INFO:tasks.workunit.client.0.smithi016.stdout:3/864: mkdir d9/d1c/d128 0 2024-08-01T06:56:44.669 INFO:tasks.workunit.client.0.smithi016.stdout:3/865: fsync d9/da/df/d2a/d49/d61/fd8 0 2024-08-01T06:56:44.674 INFO:tasks.workunit.client.0.smithi016.stdout:7/884: fsync d7/db/d17/d72/d1c/d79/d8f/fd8 0 2024-08-01T06:56:44.675 INFO:tasks.workunit.client.0.smithi016.stdout:4/972: rmdir d0/d2/dc/d12/dd3/d22/d26/de0 39 2024-08-01T06:56:44.678 INFO:tasks.workunit.client.0.smithi016.stdout:7/885: dread d7/db/d17/d72/f7a [0,4194304] 0 2024-08-01T06:56:44.686 INFO:tasks.workunit.client.0.smithi016.stdout:3/866: creat d9/da/d96/dfe/d5c/d76/dfb/d72/f129 x:0 0 0 2024-08-01T06:56:44.687 INFO:tasks.workunit.client.0.smithi016.stdout:3/867: chown d9/da/d96/dfe/d5c/le9 0 1 2024-08-01T06:56:44.692 INFO:tasks.workunit.client.0.smithi016.stdout:4/973: fsync d0/d2/d36/dbd/fce 0 2024-08-01T06:56:44.694 INFO:tasks.workunit.client.0.smithi016.stdout:8/845: dwrite d5/d67/d101/d105/df0/de2/fa7 [0,4194304] 0 2024-08-01T06:56:44.695 INFO:tasks.workunit.client.0.smithi016.stdout:7/886: rename d7/db/d17/d72/d1e/d26/d63/ddd/f121 to d7/db/d17/d72/d1c/d4f/d137/f148 0 2024-08-01T06:56:44.700 INFO:tasks.workunit.client.0.smithi016.stdout:3/868: truncate d9/f29 163190 0 2024-08-01T06:56:44.702 INFO:tasks.workunit.client.0.smithi016.stdout:8/846: dwrite d5/d8/d1a/dbe/f11c [0,4194304] 0 2024-08-01T06:56:44.703 INFO:tasks.workunit.client.0.smithi016.stdout:8/847: chown d5 12717 1 2024-08-01T06:56:44.707 INFO:tasks.workunit.client.0.smithi016.stdout:5/976: link d1/d12/ddd/c147 d1/d2/d6/d9/dd8/d12a/c154 0 2024-08-01T06:56:44.728 INFO:tasks.workunit.client.0.smithi016.stdout:3/869: truncate d9/da/df/d12/da0/da5/d111/d58/d59/f118 434656 0 2024-08-01T06:56:44.729 INFO:tasks.workunit.client.0.smithi016.stdout:4/974: write d0/d2/dc/d12/dd3/d22/d26/d85/dc1/f5e [2489956,129703] 0 2024-08-01T06:56:44.729 INFO:tasks.workunit.client.0.smithi016.stdout:5/977: link d1/df6/c101 d1/d2/d6/d9/d49/c155 0 2024-08-01T06:56:44.731 INFO:tasks.workunit.client.0.smithi016.stdout:3/870: creat d9/d98/db7/f12a x:0 0 0 2024-08-01T06:56:44.732 INFO:tasks.workunit.client.0.smithi016.stdout:7/887: write d7/db/d17/d72/d1c/d1d/d40/d67/d7c/d8d/f139 [560556,115076] 0 2024-08-01T06:56:44.733 INFO:tasks.workunit.client.0.smithi016.stdout:4/975: fsync d0/d2/d68/f7a 0 2024-08-01T06:56:44.735 INFO:tasks.workunit.client.0.smithi016.stdout:5/978: creat d1/d2/d6/d9/dd8/d12a/f156 x:0 0 0 2024-08-01T06:56:44.736 INFO:tasks.workunit.client.0.smithi016.stdout:7/888: read - d7/db/d17/d72/d1c/d1d/d40/d67/d7c/d10e/dcf/fd7 zero size 2024-08-01T06:56:44.738 INFO:tasks.workunit.client.0.smithi016.stdout:7/889: write d7/db/d17/d72/d1c/d79/d8f/dfa/f12d [872511,130162] 0 2024-08-01T06:56:44.745 INFO:tasks.workunit.client.0.smithi016.stdout:7/890: symlink d7/db/d17/d72/d1c/d79/d8f/d39/l149 0 2024-08-01T06:56:44.746 INFO:tasks.workunit.client.0.smithi016.stdout:4/976: write d0/d2/dc/d12/dd3/d22/f35 [4491921,66710] 0 2024-08-01T06:56:44.747 INFO:tasks.workunit.client.0.smithi016.stdout:5/979: write d1/d2/d6/d9/d19/dd3/f115 [821974,34693] 0 2024-08-01T06:56:44.749 INFO:tasks.workunit.client.0.smithi016.stdout:7/891: chown d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/df1/l10a 1613080716 1 2024-08-01T06:56:44.751 INFO:tasks.workunit.client.0.smithi016.stdout:7/892: write d7/db/d17/d72/d22/d77/f128 [568043,9023] 0 2024-08-01T06:56:44.752 INFO:tasks.workunit.client.0.smithi016.stdout:5/980: read - d1/d2/d6/d9/dd8/d12a/fff zero size 2024-08-01T06:56:44.755 INFO:tasks.workunit.client.0.smithi016.stdout:7/893: dread - d7/db/d17/d72/d1e/d26/d63/d119/ff5 zero size 2024-08-01T06:56:44.755 INFO:tasks.workunit.client.0.smithi016.stdout:3/871: dread d9/da/df/d2a/d49/d61/f6e [0,4194304] 0 2024-08-01T06:56:44.759 INFO:tasks.workunit.client.0.smithi016.stdout:4/977: write d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d8f/faa [4561514,96585] 0 2024-08-01T06:56:44.761 INFO:tasks.workunit.client.0.smithi016.stdout:3/872: symlink d9/da/df/d12/da0/da5/d111/d58/l12b 0 2024-08-01T06:56:44.762 INFO:tasks.workunit.client.0.smithi016.stdout:7/894: write d7/db/d17/d72/d1c/d97/fd6 [2324586,94842] 0 2024-08-01T06:56:44.763 INFO:tasks.workunit.client.0.smithi016.stdout:3/873: dread - d9/da/df/d12/f11b zero size 2024-08-01T06:56:44.765 INFO:tasks.workunit.client.0.smithi016.stdout:3/874: dread - d9/da/df/d2a/d49/d61/dc5/f113 zero size 2024-08-01T06:56:44.767 INFO:tasks.workunit.client.0.smithi016.stdout:7/895: dread d7/db/d17/d72/d22/d77/d99/f13b [0,4194304] 0 2024-08-01T06:56:44.770 INFO:tasks.workunit.client.0.smithi016.stdout:3/875: symlink d9/da/d96/dfe/l12c 0 2024-08-01T06:56:44.772 INFO:tasks.workunit.client.0.smithi016.stdout:4/978: getdents d0/d2/dc/d12/dd3/d22/d7f/d93 0 2024-08-01T06:56:44.773 INFO:tasks.workunit.client.0.smithi016.stdout:5/981: dread d1/d2/d6/d9/d1b/dda/df0/f109 [0,4194304] 0 2024-08-01T06:56:44.774 INFO:tasks.workunit.client.0.smithi016.stdout:4/979: write d0/d2/dc/d12/dd3/d22/d7f/ff0 [3723267,1443] 0 2024-08-01T06:56:44.783 INFO:tasks.workunit.client.0.smithi016.stdout:5/982: rename d1/d2/d6/d5a to d1/d2/d6/d9/d49/d57/d110/d157 0 2024-08-01T06:56:44.784 INFO:tasks.workunit.client.0.smithi016.stdout:5/983: fdatasync d1/d2/d20/ff1 0 2024-08-01T06:56:44.787 INFO:tasks.workunit.client.0.smithi016.stdout:5/984: creat d1/d2/d6/d9/d49/d57/f158 x:0 0 0 2024-08-01T06:56:44.790 INFO:tasks.workunit.client.0.smithi016.stdout:5/985: mkdir d1/d2/d20/d38/d159 0 2024-08-01T06:56:44.791 INFO:tasks.workunit.client.0.smithi016.stdout:3/876: truncate d9/d1c/da4/ff9 2269431 0 2024-08-01T06:56:44.793 INFO:tasks.workunit.client.0.smithi016.stdout:4/980: write d0/d2/dc/fb8 [936313,69084] 0 2024-08-01T06:56:44.793 INFO:tasks.workunit.client.0.smithi016.stdout:3/877: creat d9/da/d96/dc3/f12d x:0 0 0 2024-08-01T06:56:44.796 INFO:tasks.workunit.client.0.smithi016.stdout:5/986: dread d1/d2/d6/d9/d49/d57/d110/fa9 [4194304,4194304] 0 2024-08-01T06:56:44.797 INFO:tasks.workunit.client.0.smithi016.stdout:5/987: dread - d1/df6/d12b/f13c zero size 2024-08-01T06:56:44.798 INFO:tasks.workunit.client.0.smithi016.stdout:3/878: truncate d9/d57/f95 540097 0 2024-08-01T06:56:44.803 INFO:tasks.workunit.client.0.smithi016.stdout:4/981: link d0/c28 d0/d2/dc/d12/dd3/d38/c140 0 2024-08-01T06:56:44.807 INFO:tasks.workunit.client.0.smithi016.stdout:3/879: mknod d9/d1c/da4/d117/c12e 0 2024-08-01T06:56:44.809 INFO:tasks.workunit.client.0.smithi016.stdout:4/982: mkdir d0/d2/dc/d12/dd3/d22/d7f/d93/d141 0 2024-08-01T06:56:44.813 INFO:tasks.workunit.client.0.smithi016.stdout:3/880: rename d9/d98/db7/l10b to d9/da/df/d12/da0/da5/d111/d58/l12f 0 2024-08-01T06:56:44.815 INFO:tasks.workunit.client.0.smithi016.stdout:5/988: write d1/d2/d6/d9/f12e [429768,80253] 0 2024-08-01T06:56:44.818 INFO:tasks.workunit.client.0.smithi016.stdout:3/881: truncate d9/da/d96/dfe/d3c/f52 1737859 0 2024-08-01T06:56:44.820 INFO:tasks.workunit.client.0.smithi016.stdout:3/882: truncate d9/da/d96/dc3/f112 709563 0 2024-08-01T06:56:44.822 INFO:tasks.workunit.client.0.smithi016.stdout:4/983: dread d0/d2/d68/f6f [0,4194304] 0 2024-08-01T06:56:44.831 INFO:tasks.workunit.client.0.smithi016.stdout:3/883: getdents d9/da/d96/dfe/d5c/d76/dfb/d81 0 2024-08-01T06:56:44.834 INFO:tasks.workunit.client.0.smithi016.stdout:4/984: fsync d0/d2/d36/dbd/fe3 0 2024-08-01T06:56:44.836 INFO:tasks.workunit.client.0.smithi016.stdout:5/989: dwrite d1/d2/f31 [0,4194304] 0 2024-08-01T06:56:44.836 INFO:tasks.workunit.client.0.smithi016.stdout:4/985: chown d0/db9/f133 2195776 1 2024-08-01T06:56:44.844 INFO:tasks.workunit.client.0.smithi016.stdout:4/986: dwrite d0/db9/f133 [0,4194304] 0 2024-08-01T06:56:44.845 INFO:tasks.workunit.client.0.smithi016.stdout:4/987: readlink d0/l44 0 2024-08-01T06:56:44.851 INFO:tasks.workunit.client.0.smithi016.stdout:5/990: dread d1/d2/d6/fd [0,4194304] 0 2024-08-01T06:56:44.853 INFO:tasks.workunit.client.0.smithi016.stdout:4/988: unlink d0/d2/f37 0 2024-08-01T06:56:44.854 INFO:tasks.workunit.client.0.smithi016.stdout:3/884: link d9/d3e/f2d d9/da/d96/dfe/d5c/d76/dfb/d72/f130 0 2024-08-01T06:56:44.855 INFO:tasks.workunit.client.0.smithi016.stdout:3/885: write d9/da/d96/dc3/f12d [566037,32160] 0 2024-08-01T06:56:44.858 INFO:tasks.workunit.client.0.smithi016.stdout:4/989: truncate d0/d2/d68/f6f 2787154 0 2024-08-01T06:56:44.862 INFO:tasks.workunit.client.0.smithi016.stdout:4/990: dread - d0/d2/dc/d12/dd3/d22/d26/d85/dc1/d3c/f11a zero size 2024-08-01T06:56:44.865 INFO:tasks.workunit.client.0.smithi016.stdout:3/886: rename d9/da/df/d53/fdb to d9/da/d96/dfe/d5c/d76/dfb/d81/f131 0 2024-08-01T06:56:44.872 INFO:tasks.workunit.client.0.smithi016.stdout:3/887: mknod d9/d57/c132 0 2024-08-01T06:56:44.873 INFO:tasks.workunit.client.0.smithi016.stdout:4/991: creat d0/d2/dc/d12/dd3/d22/d26/f142 x:0 0 0 2024-08-01T06:56:44.875 INFO:tasks.workunit.client.0.smithi016.stdout:3/888: mknod d9/da/d96/dfe/d5c/c133 0 2024-08-01T06:56:44.876 INFO:tasks.workunit.client.0.smithi016.stdout:5/991: write d1/f129 [8813928,86745] 0 2024-08-01T06:56:44.879 INFO:tasks.workunit.client.0.smithi016.stdout:5/992: chown d1/d2/d6/d9/d19/d7a/dc5/dd0/ffa 61624 1 2024-08-01T06:56:44.882 INFO:tasks.workunit.client.0.smithi016.stdout:3/889: dread d9/da/df/d2a/d49/db5/fde [0,4194304] 0 2024-08-01T06:56:44.884 INFO:tasks.workunit.client.0.smithi016.stdout:5/993: mkdir d1/d2/d20/d68/de2/d14c/d15a 0 2024-08-01T06:56:44.885 INFO:tasks.workunit.client.0.smithi016.stdout:5/994: chown d1/d12/d7d/ccb 604 1 2024-08-01T06:56:44.887 INFO:tasks.workunit.client.0.smithi016.stdout:3/890: rmdir d9/da/d96/dfe/d5c/d76/dfb/d72 39 2024-08-01T06:56:44.890 INFO:tasks.workunit.client.0.smithi016.stdout:4/992: dread d0/d2/dc/d12/dd3/d22/d26/d85/dc1/f60 [0,4194304] 0 2024-08-01T06:56:44.890 INFO:tasks.workunit.client.0.smithi016.stdout:5/995: truncate d1/d2/d6/d9/d49/fa3 430095 0 2024-08-01T06:56:44.891 INFO:tasks.workunit.client.0.smithi016.stdout:5/996: chown d1/d12/l11c 543640 1 2024-08-01T06:56:44.892 INFO:tasks.workunit.client.0.smithi016.stdout:4/993: dread d0/d2/dc/d12/dc7/f11e [0,4194304] 0 2024-08-01T06:56:44.898 INFO:tasks.workunit.client.0.smithi016.stdout:5/997: unlink d1/d2/d6/d9/d49/d57/db1/f125 0 2024-08-01T06:56:44.898 INFO:tasks.workunit.client.0.smithi016.stdout:5/998: write d1/d2/d6/d9/f12e [865773,65377] 0 2024-08-01T06:56:44.898 INFO:tasks.workunit.client.0.smithi016.stdout:4/994: mkdir d0/d2/dc/d90/df3/d143 0 2024-08-01T06:56:44.899 INFO:tasks.workunit.client.0.smithi016.stdout:4/995: fsync d0/d2/dc/d12/dd3/d22/d26/fac 0 2024-08-01T06:56:44.902 INFO:tasks.workunit.client.0.smithi016.stdout:5/999: creat d1/d2/d20/db8/f15b x:0 0 0 2024-08-01T06:56:44.905 INFO:tasks.workunit.client.0.smithi016.stdout:3/891: write d9/da/df/d2a/d49/d61/fe5 [615355,119138] 0 2024-08-01T06:56:44.909 INFO:tasks.workunit.client.0.smithi016.stdout:4/996: creat d0/d2/dc/d12/dd3/d22/d26/f144 x:0 0 0 2024-08-01T06:56:44.910 INFO:tasks.workunit.client.0.smithi016.stdout:3/892: mknod d9/da/df/c134 0 2024-08-01T06:56:44.911 INFO:tasks.workunit.client.0.smithi016.stdout:3/893: stat d9/da/d96/dc3/d120 0 2024-08-01T06:56:44.912 INFO:tasks.workunit.client.0.smithi016.stdout:4/997: creat d0/d2/dc/d12/dd3/d22/d26/da3/f145 x:0 0 0 2024-08-01T06:56:44.915 INFO:tasks.workunit.client.0.smithi016.stdout:4/998: fsync d0/d2/dc/d12/dd3/d22/fb0 0 2024-08-01T06:56:44.921 INFO:tasks.workunit.client.0.smithi016.stdout:3/894: getdents d9/da/df/d12/da0/da5/d111/d58/d59 0 2024-08-01T06:56:44.930 INFO:tasks.workunit.client.0.smithi016.stdout:3/895: write d9/da/d18/de1/f127 [2326543,105433] 0 2024-08-01T06:56:44.932 INFO:tasks.workunit.client.0.smithi016.stdout:4/999: dread d0/d2/d36/dbd/f122 [0,4194304] 0 2024-08-01T06:56:44.944 INFO:tasks.workunit.client.0.smithi016.stdout:3/896: dread d9/da/df/d2a/d49/f8b [0,4194304] 0 2024-08-01T06:56:44.946 INFO:tasks.workunit.client.0.smithi016.stdout:3/897: creat d9/d57/d91/f135 x:0 0 0 2024-08-01T06:56:45.008 INFO:tasks.workunit.client.0.smithi016.stdout:0/986: sync 2024-08-01T06:56:45.032 INFO:tasks.workunit.client.0.smithi016.stdout:3/898: truncate d9/f29 84606 0 2024-08-01T06:56:45.033 INFO:tasks.workunit.client.0.smithi016.stdout:3/899: truncate d9/da/d96/dfe/d5c/d76/fae 1417865 0 2024-08-01T06:56:45.035 INFO:tasks.workunit.client.0.smithi016.stdout:0/987: getdents d10/d11/d37/d50/db1/d138/d90/da2/da5/de8/deb/dec 0 2024-08-01T06:56:45.037 INFO:tasks.workunit.client.0.smithi016.stdout:3/900: truncate d9/da/d96/dfe/d5c/d76/dfb/d72/fe4 757650 0 2024-08-01T06:56:45.040 INFO:tasks.workunit.client.0.smithi016.stdout:3/901: creat d9/da/df/d2a/d49/d61/dc5/f136 x:0 0 0 2024-08-01T06:56:45.054 INFO:tasks.workunit.client.0.smithi016.stdout:0/988: dread d10/d11/d37/d58/fde [0,4194304] 0 2024-08-01T06:56:45.056 INFO:tasks.workunit.client.0.smithi016.stdout:0/989: mkdir d10/d11/d37/d50/d13b 0 2024-08-01T06:56:45.058 INFO:tasks.workunit.client.0.smithi016.stdout:0/990: truncate d10/d11/ddd/f11b 4280409 0 2024-08-01T06:56:45.058 INFO:tasks.workunit.client.0.smithi016.stdout:3/902: dread d9/da/d18/de1/f127 [0,4194304] 0 2024-08-01T06:56:45.061 INFO:tasks.workunit.client.0.smithi016.stdout:3/903: creat d9/da/d96/f137 x:0 0 0 2024-08-01T06:56:45.069 INFO:tasks.workunit.client.0.smithi016.stdout:0/991: mknod d10/d11/d37/d53/d12b/c13c 0 2024-08-01T06:56:45.071 INFO:tasks.workunit.client.0.smithi016.stdout:3/904: read d9/d3e/f2d [8906291,127171] 0 2024-08-01T06:56:45.073 INFO:tasks.workunit.client.0.smithi016.stdout:0/992: dread d10/f5a [0,4194304] 0 2024-08-01T06:56:45.074 INFO:tasks.workunit.client.0.smithi016.stdout:0/993: readlink d10/d1c/l44 0 2024-08-01T06:56:45.081 INFO:tasks.workunit.client.0.smithi016.stdout:0/994: mknod d10/d11/d37/d50/db1/dbb/d136/d10f/c13d 0 2024-08-01T06:56:45.084 INFO:tasks.workunit.client.0.smithi016.stdout:3/905: dread d9/d57/f8a [0,4194304] 0 2024-08-01T06:56:45.085 INFO:tasks.workunit.client.0.smithi016.stdout:0/995: dread d10/d1c/f35 [0,4194304] 0 2024-08-01T06:56:45.087 INFO:tasks.workunit.client.0.smithi016.stdout:0/996: unlink d10/d11/c56 0 2024-08-01T06:56:45.104 INFO:tasks.workunit.client.0.smithi016.stdout:0/997: dread d10/d11/d37/d50/db1/fcd [0,4194304] 0 2024-08-01T06:56:45.107 INFO:tasks.workunit.client.0.smithi016.stdout:3/906: truncate d9/d1c/da4/d117/f11a 1337559 0 2024-08-01T06:56:45.111 INFO:tasks.workunit.client.0.smithi016.stdout:3/907: creat d9/da/d96/dfe/d5c/f138 x:0 0 0 2024-08-01T06:56:45.116 INFO:tasks.workunit.client.0.smithi016.stdout:3/908: creat d9/da/d96/dfe/d5c/f139 x:0 0 0 2024-08-01T06:56:45.121 INFO:tasks.workunit.client.0.smithi016.stdout:3/909: symlink d9/da/d96/dfe/d5c/d76/dfb/l13a 0 2024-08-01T06:56:45.122 INFO:tasks.workunit.client.0.smithi016.stdout:3/910: chown d9/da/df/d2a/d49/d61/lc4 33716 1 2024-08-01T06:56:45.122 INFO:tasks.workunit.client.0.smithi016.stdout:3/911: chown d9/da 3 1 2024-08-01T06:56:45.126 INFO:tasks.workunit.client.0.smithi016.stdout:3/912: symlink d9/da/df/d2a/d49/d61/dc5/d10e/l13b 0 2024-08-01T06:56:45.134 INFO:tasks.workunit.client.0.smithi016.stdout:8/848: sync 2024-08-01T06:56:45.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:44 smithi089 ceph-mon[36617]: pgmap v36: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 28 MiB/s rd, 87 MiB/s wr, 289 op/s 2024-08-01T06:56:45.138 INFO:tasks.workunit.client.0.smithi016.stdout:0/998: fsync d10/d11/d41/f2f 0 2024-08-01T06:56:45.139 INFO:tasks.workunit.client.0.smithi016.stdout:0/999: chown d10/d11/d41/d95/fd6 1714 1 2024-08-01T06:56:45.141 INFO:tasks.workunit.client.0.smithi016.stdout:8/849: mkdir d5/d8/d1a/d24/d48/d69/d10e/d125 0 2024-08-01T06:56:45.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:44 smithi016 ceph-mon[29266]: pgmap v36: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 28 MiB/s rd, 87 MiB/s wr, 289 op/s 2024-08-01T06:56:45.155 INFO:tasks.workunit.client.0.smithi016.stdout:3/913: rmdir d9/da/d96 39 2024-08-01T06:56:45.158 INFO:tasks.workunit.client.0.smithi016.stdout:3/914: mkdir d9/da/df/d12/d75/d13c 0 2024-08-01T06:56:45.160 INFO:tasks.workunit.client.0.smithi016.stdout:3/915: fdatasync d9/f29 0 2024-08-01T06:56:45.161 INFO:tasks.workunit.client.0.smithi016.stdout:3/916: chown d9/da/df/d12/f42 26121039 1 2024-08-01T06:56:45.165 INFO:tasks.workunit.client.0.smithi016.stdout:3/917: symlink d9/da/d96/dfe/d5c/d76/dfb/d72/l13d 0 2024-08-01T06:56:45.166 INFO:tasks.workunit.client.0.smithi016.stdout:3/918: readlink d9/da/df/d12/da0/da5/d111/d58/l12f 0 2024-08-01T06:56:45.168 INFO:tasks.workunit.client.0.smithi016.stdout:3/919: mknod d9/da/df/d2a/d49/db5/c13e 0 2024-08-01T06:56:45.260 INFO:tasks.workunit.client.0.smithi016.stdout:3/920: creat d9/d1c/da4/f13f x:0 0 0 2024-08-01T06:56:45.265 INFO:tasks.workunit.client.0.smithi016.stdout:3/921: mkdir d9/da/df/d12/da0/d140 0 2024-08-01T06:56:45.269 INFO:tasks.workunit.client.0.smithi016.stdout:3/922: symlink d9/da/d96/dfe/d3c/l141 0 2024-08-01T06:56:45.272 INFO:tasks.workunit.client.0.smithi016.stdout:3/923: mkdir d9/da/df/d53/d142 0 2024-08-01T06:56:45.274 INFO:tasks.workunit.client.0.smithi016.stdout:3/924: dread - d9/d57/f82 zero size 2024-08-01T06:56:45.276 INFO:tasks.workunit.client.0.smithi016.stdout:3/925: read d9/d98/db7/ff2 [2433775,127235] 0 2024-08-01T06:56:45.279 INFO:tasks.workunit.client.0.smithi016.stdout:3/926: creat d9/d1c/da4/d117/f143 x:0 0 0 2024-08-01T06:56:45.282 INFO:tasks.workunit.client.0.smithi016.stdout:3/927: symlink d9/da/d96/dc3/l144 0 2024-08-01T06:56:45.307 INFO:tasks.workunit.client.0.smithi016.stdout:3/928: dread d9/da/df/d12/fa1 [0,4194304] 0 2024-08-01T06:56:45.321 INFO:tasks.workunit.client.0.smithi016.stdout:3/929: write d9/d57/f74 [736791,81068] 0 2024-08-01T06:56:45.326 INFO:tasks.workunit.client.0.smithi016.stdout:3/930: creat d9/da/df/f145 x:0 0 0 2024-08-01T06:56:45.329 INFO:tasks.workunit.client.0.smithi016.stdout:3/931: truncate d9/da/df/d12/f25 3818919 0 2024-08-01T06:56:45.332 INFO:tasks.workunit.client.0.smithi016.stdout:3/932: fsync d9/da/df/d12/f94 0 2024-08-01T06:56:45.338 INFO:tasks.workunit.client.0.smithi016.stdout:3/933: mknod d9/da/d96/dc3/d120/c146 0 2024-08-01T06:56:45.340 INFO:tasks.workunit.client.0.smithi016.stdout:3/934: creat d9/d1c/da4/d117/f147 x:0 0 0 2024-08-01T06:56:45.344 INFO:tasks.workunit.client.0.smithi016.stdout:3/935: creat d9/d98/d107/f148 x:0 0 0 2024-08-01T06:56:45.347 INFO:tasks.workunit.client.0.smithi016.stdout:3/936: creat d9/d1c/f149 x:0 0 0 2024-08-01T06:56:45.350 INFO:tasks.workunit.client.0.smithi016.stdout:3/937: readlink d9/d3e/ldd 0 2024-08-01T06:56:45.363 INFO:tasks.workunit.client.0.smithi016.stdout:3/938: write d9/da/df/d2a/d49/db5/f92 [4856864,118003] 0 2024-08-01T06:56:45.365 INFO:tasks.workunit.client.0.smithi016.stdout:3/939: write d9/da/df/d53/f56 [4776154,98699] 0 2024-08-01T06:56:45.369 INFO:tasks.workunit.client.0.smithi016.stdout:3/940: write d9/d3e/f36 [1909549,108544] 0 2024-08-01T06:56:45.371 INFO:tasks.workunit.client.0.smithi016.stdout:3/941: write d9/da/df/d2a/d49/d61/fe5 [1214283,98398] 0 2024-08-01T06:56:45.375 INFO:tasks.workunit.client.0.smithi016.stdout:3/942: rename d9/da/d96/dc3/d120/c146 to d9/da/df/d12/da0/da5/d111/d58/c14a 0 2024-08-01T06:56:45.378 INFO:tasks.workunit.client.0.smithi016.stdout:3/943: symlink d9/da/df/d12/d75/d13c/l14b 0 2024-08-01T06:56:45.381 INFO:tasks.workunit.client.0.smithi016.stdout:3/944: dread d9/d1c/da4/ff9 [0,4194304] 0 2024-08-01T06:56:45.384 INFO:tasks.workunit.client.0.smithi016.stdout:3/945: rmdir d9/da/df/d12/da0/da5/d111/d58/d59 39 2024-08-01T06:56:45.394 INFO:tasks.workunit.client.0.smithi016.stdout:3/946: write d9/da/df/d2a/d49/db5/fde [890841,78657] 0 2024-08-01T06:56:45.395 INFO:tasks.workunit.client.0.smithi016.stdout:3/947: write d9/da/d96/dc3/f12d [636106,83209] 0 2024-08-01T06:56:45.398 INFO:tasks.workunit.client.0.smithi016.stdout:3/948: mknod d9/da/df/d2a/d49/d61/dc5/d10e/c14c 0 2024-08-01T06:56:45.399 INFO:tasks.workunit.client.0.smithi016.stdout:3/949: mkdir d9/da/df/d2a/d49/d61/d14d 0 2024-08-01T06:56:45.408 INFO:tasks.workunit.client.0.smithi016.stdout:3/950: write d9/da/d96/dfe/d5c/d76/dfb/d72/f123 [840195,79367] 0 2024-08-01T06:56:45.409 INFO:tasks.workunit.client.0.smithi016.stdout:3/951: stat d9/da/d18/de1/l105 0 2024-08-01T06:56:45.409 INFO:tasks.workunit.client.0.smithi016.stdout:3/952: chown d9/d3e 0 1 2024-08-01T06:56:45.445 INFO:tasks.workunit.client.0.smithi016.stdout:7/896: sync 2024-08-01T06:56:45.478 INFO:tasks.workunit.client.0.smithi016.stdout:7/897: rmdir d7/db/d17/d72/d1c/d1d/d40/d67/d7c/d8d 39 2024-08-01T06:56:45.483 INFO:tasks.workunit.client.0.smithi016.stdout:7/898: link d7/db/d17/d72/d22/fc2 d7/db/d17/d72/d22/db4/f14a 0 2024-08-01T06:56:45.484 INFO:tasks.workunit.client.0.smithi016.stdout:7/899: dread - d7/db/d17/d72/d1e/d26/d63/d119/ff5 zero size 2024-08-01T06:56:45.486 INFO:tasks.workunit.client.0.smithi016.stdout:7/900: symlink d7/db/d17/d72/d1c/d79/d8f/dd3/l14b 0 2024-08-01T06:56:45.488 INFO:tasks.workunit.client.0.smithi016.stdout:7/901: symlink d7/db/d17/d72/d1c/l14c 0 2024-08-01T06:56:45.490 INFO:tasks.workunit.client.0.smithi016.stdout:7/902: creat d7/db/d17/d72/d1c/dc6/f14d x:0 0 0 2024-08-01T06:56:45.493 INFO:tasks.workunit.client.0.smithi016.stdout:7/903: fsync d7/db/d17/d72/d1e/d26/d2a/f116 0 2024-08-01T06:56:45.498 INFO:tasks.workunit.client.0.smithi016.stdout:7/904: rename d7/db/d17/d72/f124 to d7/db/d17/d72/d22/db4/f14e 0 2024-08-01T06:56:45.513 INFO:tasks.workunit.client.0.smithi016.stdout:7/905: dwrite d7/db/d17/d72/f7a [0,4194304] 0 2024-08-01T06:56:45.516 INFO:tasks.workunit.client.0.smithi016.stdout:7/906: unlink d7/db/d17/d72/d1c/d79/d8f/d39/f135 0 2024-08-01T06:56:45.575 INFO:tasks.workunit.client.0.smithi016.stdout:7/907: rename d7/db/d17/d72/f1b to d7/db/d17/d72/d1c/d4f/d137/f14f 0 2024-08-01T06:56:45.585 INFO:tasks.workunit.client.0.smithi016.stdout:7/908: truncate d7/db/d17/d72/d1c/d79/d8f/fd8 2337187 0 2024-08-01T06:56:45.587 INFO:tasks.workunit.client.0.smithi016.stdout:7/909: mknod d7/db/d17/d72/d1e/d26/d63/dc0/c150 0 2024-08-01T06:56:45.589 INFO:tasks.workunit.client.0.smithi016.stdout:7/910: dread - d7/db/d17/d72/d22/d77/d99/fa4 zero size 2024-08-01T06:56:45.591 INFO:tasks.workunit.client.0.smithi016.stdout:7/911: creat d7/db/d17/d72/d22/f151 x:0 0 0 2024-08-01T06:56:45.591 INFO:tasks.workunit.client.0.smithi016.stdout:7/912: readlink d7/db/d17/d72/d1c/l14c 0 2024-08-01T06:56:45.602 INFO:tasks.workunit.client.0.smithi016.stdout:7/913: dwrite d7/db/d17/d72/fd5 [0,4194304] 0 2024-08-01T06:56:45.617 INFO:tasks.workunit.client.0.smithi016.stdout:7/914: dwrite d7/db/d17/d72/d1c/d79/d8f/d39/ffb [0,4194304] 0 2024-08-01T06:56:45.621 INFO:tasks.workunit.client.0.smithi016.stdout:7/915: read - d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/f11d zero size 2024-08-01T06:56:45.624 INFO:tasks.workunit.client.0.smithi016.stdout:7/916: fdatasync d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/f11d 0 2024-08-01T06:56:45.628 INFO:tasks.workunit.client.0.smithi016.stdout:7/917: creat d7/db/d17/d72/d1e/d26/d63/dc0/d115/f152 x:0 0 0 2024-08-01T06:56:45.630 INFO:tasks.workunit.client.0.smithi016.stdout:7/918: fdatasync d7/db/d17/d72/d22/d77/f128 0 2024-08-01T06:56:45.634 INFO:tasks.workunit.client.0.smithi016.stdout:7/919: truncate d7/db/d17/d72/d1c/d79/d8f/fc5 911351 0 2024-08-01T06:56:45.649 INFO:tasks.workunit.client.0.smithi016.stdout:7/920: dread d7/db/d17/d72/d1c/d97/fd6 [0,4194304] 0 2024-08-01T06:56:45.652 INFO:tasks.workunit.client.0.smithi016.stdout:7/921: unlink d7/db/d17/d72/d1c/d1d/d40/d58/ffd 0 2024-08-01T06:56:45.655 INFO:tasks.workunit.client.0.smithi016.stdout:7/922: rename d7/db/d17/d72/f7a to d7/db/d17/d72/d1c/d1d/d40/d58/d80/f153 0 2024-08-01T06:56:45.684 INFO:tasks.workunit.client.0.smithi016.stdout:7/923: write d7/db/d17/d72/d1e/d26/d2a/f7b [1410414,119424] 0 2024-08-01T06:56:45.687 INFO:tasks.workunit.client.0.smithi016.stdout:7/924: write d7/db/d17/d72/d1c/d1d/d40/d58/d80/f153 [1598946,32759] 0 2024-08-01T06:56:45.688 INFO:tasks.workunit.client.0.smithi016.stdout:7/925: chown d7/db/d17/d72/d1c/dc6 410 1 2024-08-01T06:56:45.690 INFO:tasks.workunit.client.0.smithi016.stdout:7/926: fdatasync d7/db/d17/d72/d1c/d1d/d40/d7f/f132 0 2024-08-01T06:56:45.695 INFO:tasks.workunit.client.0.smithi016.stdout:7/927: rename d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/fe8 to d7/db/d17/d72/d1c/d79/d8f/d39/d43/d53/f154 0 2024-08-01T06:56:45.708 INFO:tasks.workunit.client.0.smithi016.stdout:7/928: dread d7/db/d17/d72/d1c/d1d/d40/d67/d7c/fe7 [0,4194304] 0 2024-08-01T06:56:45.713 INFO:tasks.workunit.client.0.smithi016.stdout:7/929: rename d7/db/d17/d72/d1c/d97/f141 to d7/db/d17/d72/d1c/d1d/d40/d58/f155 0 2024-08-01T06:56:45.716 INFO:tasks.workunit.client.0.smithi016.stdout:7/930: fsync d7/db/d17/d72/d1c/d1d/d40/d58/da3/fcd 0 2024-08-01T06:56:45.717 INFO:tasks.workunit.client.0.smithi016.stdout:7/931: chown d7/db/d17/d72/d1c/c140 265424 1 2024-08-01T06:56:45.720 INFO:tasks.workunit.client.0.smithi016.stdout:7/932: mknod d7/db/d17/d72/d1c/d79/d8f/c156 0 2024-08-01T06:56:45.723 INFO:tasks.workunit.client.0.smithi016.stdout:7/933: mkdir d7/db/d17/d72/d1e/d26/d63/d119/d157 0 2024-08-01T06:56:45.724 INFO:tasks.workunit.client.0.smithi016.stdout:7/934: stat d7/db/d17/d72/d1e/d26/d63/dc0/d115/f152 0 2024-08-01T06:56:45.784 INFO:tasks.workunit.client.0.smithi016.stdout:7/935: write d7/db/f28 [2164407,47626] 0 2024-08-01T06:56:45.835 INFO:tasks.workunit.client.0.smithi016.stdout:7/936: dwrite d7/db/d17/d72/d1c/d79/d8f/d39/d43/f91 [0,4194304] 0 2024-08-01T06:56:45.837 INFO:tasks.workunit.client.0.smithi016.stdout:3/953: sync 2024-08-01T06:56:45.837 INFO:tasks.workunit.client.0.smithi016.stdout:8/850: sync 2024-08-01T06:56:45.844 INFO:tasks.workunit.client.0.smithi016.stdout:8/851: rename d5/d8/l43 to d5/d67/d101/d105/df0/de2/l126 0 2024-08-01T06:56:45.851 INFO:tasks.workunit.client.0.smithi016.stdout:8/852: creat d5/d67/d101/d105/df0/dd8/dd2/f127 x:0 0 0 2024-08-01T06:56:45.877 INFO:tasks.workunit.client.0.smithi016.stdout:3/954: dwrite d9/d57/d66/f84 [0,4194304] 0 2024-08-01T06:56:45.879 INFO:tasks.workunit.client.0.smithi016.stdout:8/853: dread d5/d8/d1a/d24/d48/d69/d10e/dfc/d111/f5c [0,4194304] 0 2024-08-01T06:56:45.880 INFO:tasks.workunit.client.0.smithi016.stdout:3/955: symlink d9/d3e/l14e 0 2024-08-01T06:56:45.884 INFO:tasks.workunit.client.0.smithi016.stdout:8/854: unlink d5/d8/d1a/d24/d48/f56 0 2024-08-01T06:56:45.894 INFO:tasks.workunit.client.0.smithi016.stdout:3/956: getdents d9/da/d96 0 2024-08-01T06:56:45.901 INFO:tasks.workunit.client.0.smithi016.stdout:3/957: dwrite d9/da/d18/de1/f127 [0,4194304] 0 2024-08-01T06:56:45.905 INFO:tasks.workunit.client.0.smithi016.stdout:3/958: mkdir d9/da/d96/dc3/d120/d14f 0 2024-08-01T06:56:45.918 INFO:tasks.workunit.client.0.smithi016.stdout:3/959: getdents d9/da/d96/dfe/d5c 0 2024-08-01T06:56:45.919 INFO:tasks.workunit.client.0.smithi016.stdout:3/960: readlink d9/da/d18/l126 0 2024-08-01T06:56:45.920 INFO:tasks.workunit.client.0.smithi016.stdout:8/855: dwrite d5/d8/d1a/d24/d48/d69/d10e/d63/f91 [0,4194304] 0 2024-08-01T06:56:45.924 INFO:tasks.workunit.client.0.smithi016.stdout:8/856: dread d5/f84 [0,4194304] 0 2024-08-01T06:56:45.930 INFO:tasks.workunit.client.0.smithi016.stdout:3/961: rename d9/da/df/fef to d9/da/d96/dfe/d5c/d76/dfb/f150 0 2024-08-01T06:56:45.936 INFO:tasks.workunit.client.0.smithi016.stdout:3/962: rmdir d9/da/df/d12/d75/dc7/d124 0 2024-08-01T06:56:45.936 INFO:tasks.workunit.client.0.smithi016.stdout:3/963: dread - d9/d98/d107/f148 zero size 2024-08-01T06:56:45.937 INFO:tasks.workunit.client.0.smithi016.stdout:3/964: fsync d9/da/df/d53/fcb 0 2024-08-01T06:56:45.944 INFO:tasks.workunit.client.0.smithi016.stdout:3/965: truncate d9/d1c/da4/d117/f11a 1767727 0 2024-08-01T06:56:45.947 INFO:tasks.workunit.client.0.smithi016.stdout:3/966: write d9/da/d96/dfe/d5c/d76/dfb/d81/f131 [35273,37528] 0 2024-08-01T06:56:45.950 INFO:tasks.workunit.client.0.smithi016.stdout:3/967: write d9/d57/f8a [2259999,48245] 0 2024-08-01T06:56:45.953 INFO:tasks.workunit.client.0.smithi016.stdout:3/968: fdatasync d9/da/df/d12/fda 0 2024-08-01T06:56:45.959 INFO:tasks.workunit.client.0.smithi016.stdout:8/857: write d5/d67/d101/d105/df0/de2/fa6 [955275,8832] 0 2024-08-01T06:56:45.967 INFO:tasks.workunit.client.0.smithi016.stdout:8/858: dread d5/d8/fd [0,4194304] 0 2024-08-01T06:56:45.971 INFO:tasks.workunit.client.0.smithi016.stdout:8/859: mkdir d5/d67/dec/d128 0 2024-08-01T06:56:45.976 INFO:tasks.workunit.client.0.smithi016.stdout:8/860: creat d5/d8/d1a/d24/d48/d6e/d123/f129 x:0 0 0 2024-08-01T06:56:45.978 INFO:tasks.workunit.client.0.smithi016.stdout:3/969: write d9/da/df/d2a/d49/d61/f6e [1301086,82901] 0 2024-08-01T06:56:45.984 INFO:tasks.workunit.client.0.smithi016.stdout:3/970: creat d9/da/df/d12/da0/da5/d111/d58/f151 x:0 0 0 2024-08-01T06:56:45.990 INFO:tasks.workunit.client.0.smithi016.stdout:3/971: dwrite d9/d57/d91/f135 [0,4194304] 0 2024-08-01T06:56:46.000 INFO:tasks.workunit.client.0.smithi016.stdout:8/861: write d5/d8/d1a/f54 [2318706,50583] 0 2024-08-01T06:56:46.011 INFO:tasks.workunit.client.0.smithi016.stdout:8/862: rename d5/d8/d1a/d24/d48/d6e/cbd to d5/d8/d1a/d24/d48/d69/d10e/c12a 0 2024-08-01T06:56:46.013 INFO:tasks.workunit.client.0.smithi016.stdout:3/972: write d9/d57/fb9 [1870758,56384] 0 2024-08-01T06:56:46.013 INFO:tasks.workunit.client.0.smithi016.stdout:8/863: mknod d5/d1c/c12b 0 2024-08-01T06:56:46.020 INFO:tasks.workunit.client.0.smithi016.stdout:3/973: dwrite d9/da/df/d2a/d49/f62 [0,4194304] 0 2024-08-01T06:56:46.026 INFO:tasks.workunit.client.0.smithi016.stdout:3/974: truncate d9/da/df/d12/f94 2936064 0 2024-08-01T06:56:46.029 INFO:tasks.workunit.client.0.smithi016.stdout:8/864: dread d5/f61 [0,4194304] 0 2024-08-01T06:56:46.031 INFO:tasks.workunit.client.0.smithi016.stdout:3/975: rename d9/da/d18/de1 to d9/da/df/d12/d75/d104/d152 0 2024-08-01T06:56:46.036 INFO:tasks.workunit.client.0.smithi016.stdout:3/976: creat d9/d3e/f153 x:0 0 0 2024-08-01T06:56:46.037 INFO:tasks.workunit.client.0.smithi016.stdout:3/977: fsync d9/da/df/d12/d75/f121 0 2024-08-01T06:56:46.042 INFO:tasks.workunit.client.0.smithi016.stdout:3/978: truncate d9/da/df/d2a/d49/f68 6397548 0 2024-08-01T06:56:46.047 INFO:tasks.workunit.client.0.smithi016.stdout:3/979: creat d9/da/df/d12/d75/f154 x:0 0 0 2024-08-01T06:56:46.050 INFO:tasks.workunit.client.0.smithi016.stdout:3/980: truncate d9/da/d96/dfe/d5c/f63 2131686 0 2024-08-01T06:56:46.052 INFO:tasks.workunit.client.0.smithi016.stdout:3/981: write d9/da/df/d2a/d49/f115 [974238,98889] 0 2024-08-01T06:56:46.054 INFO:tasks.workunit.client.0.smithi016.stdout:8/865: dwrite d5/d8/d1a/d24/d6a/fc2 [0,4194304] 0 2024-08-01T06:56:46.056 INFO:tasks.workunit.client.0.smithi016.stdout:3/982: mknod d9/da/df/d2a/d49/c155 0 2024-08-01T06:56:46.058 INFO:tasks.workunit.client.0.smithi016.stdout:8/866: mkdir d5/d8/d1a/d24/d6a/d12c 0 2024-08-01T06:56:46.068 INFO:tasks.workunit.client.0.smithi016.stdout:3/983: link d9/d57/fb9 d9/da/df/d53/f156 0 2024-08-01T06:56:46.070 INFO:tasks.workunit.client.0.smithi016.stdout:3/984: chown d9/da/d96/dfe/d5c/d76/dfb/d72/f123 82843 1 2024-08-01T06:56:46.095 INFO:tasks.workunit.client.0.smithi016.stdout:8/867: dwrite d5/d8/d1a/d24/d48/d69/d10e/f66 [0,4194304] 0 2024-08-01T06:56:46.103 INFO:tasks.workunit.client.0.smithi016.stdout:3/985: truncate d9/da/d96/dfe/f4c 3406504 0 2024-08-01T06:56:46.105 INFO:tasks.workunit.client.0.smithi016.stdout:3/986: write d9/da/df/d2a/d49/d61/dc5/f113 [145411,82359] 0 2024-08-01T06:56:46.108 INFO:tasks.workunit.client.0.smithi016.stdout:3/987: mknod d9/da/d96/dfe/d5c/d76/dfb/d72/c157 0 2024-08-01T06:56:46.109 INFO:tasks.workunit.client.0.smithi016.stdout:3/988: readlink d9/da/df/d12/d75/d104/l108 0 2024-08-01T06:56:46.110 INFO:tasks.workunit.client.0.smithi016.stdout:3/989: chown d9/da/df/d12/d75/d13c 1863288031 1 2024-08-01T06:56:46.116 INFO:tasks.workunit.client.0.smithi016.stdout:3/990: dwrite d9/d98/d107/f148 [0,4194304] 0 2024-08-01T06:56:46.120 INFO:tasks.workunit.client.0.smithi016.stdout:7/937: sync 2024-08-01T06:56:46.121 INFO:tasks.workunit.client.0.smithi016.stdout:3/991: write d9/da/df/d2a/d49/d61/f93 [2341119,4692] 0 2024-08-01T06:56:46.126 INFO:tasks.workunit.client.0.smithi016.stdout:3/992: creat d9/da/d96/dfe/d5c/d76/dfb/d81/f158 x:0 0 0 2024-08-01T06:56:46.132 INFO:tasks.workunit.client.0.smithi016.stdout:7/938: link d7/db/d17/d72/d1c/d4f/f131 d7/db/d17/d72/d1c/dc6/f158 0 2024-08-01T06:56:46.134 INFO:tasks.workunit.client.0.smithi016.stdout:8/868: write d5/d8/d75/dba/ff6 [864776,40112] 0 2024-08-01T06:56:46.136 INFO:tasks.workunit.client.0.smithi016.stdout:8/869: truncate d5/d8/d1a/dbe/fd1 4677904 0 2024-08-01T06:56:46.140 INFO:tasks.workunit.client.0.smithi016.stdout:7/939: getdents d7/db/d17/d72/d1c/d1d/d40/d58/d80 0 2024-08-01T06:56:46.141 INFO:tasks.workunit.client.0.smithi016.stdout:7/940: chown d7/db/d17/d72/d1c/dc6/le9 1 1 2024-08-01T06:56:46.145 INFO:tasks.workunit.client.0.smithi016.stdout:7/941: creat d7/db/d17/d72/d1c/d79/d8f/d39/d71/dd9/f159 x:0 0 0 2024-08-01T06:56:46.149 INFO:tasks.workunit.client.0.smithi016.stdout:7/942: creat d7/db/d17/d72/d1c/d1d/d40/d67/d7c/d10e/dcf/f15a x:0 0 0 2024-08-01T06:56:46.174 INFO:tasks.workunit.client.0.smithi016.stdout:3/993: dwrite d9/da/df/d2a/d49/db5/f9b [0,4194304] 0 2024-08-01T06:56:46.198 INFO:tasks.workunit.client.0.smithi016.stdout:3/994: dread d9/da/d96/dfe/d5c/d76/dfb/d81/fb1 [0,4194304] 0 2024-08-01T06:56:46.209 INFO:tasks.workunit.client.0.smithi016.stdout:7/943: dwrite d7/f5b [0,4194304] 0 2024-08-01T06:56:46.219 INFO:tasks.workunit.client.0.smithi016.stdout:7/944: dread d7/db/d17/d72/d22/db4/f14e [0,4194304] 0 2024-08-01T06:56:46.220 INFO:tasks.workunit.client.0.smithi016.stdout:7/945: dread - d7/db/d17/d72/d22/d77/d99/f10c zero size 2024-08-01T06:56:46.225 INFO:tasks.workunit.client.0.smithi016.stdout:7/946: rename d7/db/d17/d72/d1c/d79/d8f/d39/d43/c62 to d7/db/d17/d72/d1c/d1d/d40/d58/da3/c15b 0 2024-08-01T06:56:46.229 INFO:tasks.workunit.client.0.smithi016.stdout:7/947: mkdir d7/db/d17/d72/d15c 0 2024-08-01T06:56:46.234 INFO:tasks.workunit.client.0.smithi016.stdout:7/948: dread d7/db/d17/d72/d1c/d79/d8f/dfa/f12d [0,4194304] 0 2024-08-01T06:56:46.238 INFO:tasks.workunit.client.0.smithi016.stdout:7/949: rmdir d7/db/d17/d72/d1c/d79/d8f/d39/d43/d53 39 2024-08-01T06:56:46.240 INFO:tasks.workunit.client.0.smithi016.stdout:7/950: unlink d7/db/d17/d72/d1c/dc6/f14d 0 2024-08-01T06:56:46.245 INFO:tasks.workunit.client.0.smithi016.stdout:7/951: symlink d7/db/d17/d72/d1c/d1d/d40/d58/da3/l15d 0 2024-08-01T06:56:46.256 INFO:tasks.workunit.client.0.smithi016.stdout:7/952: rename d7/db/d17/d72/d1c/d1d/d40/d67/d7c/d10e to d7/db/d17/d72/d1c/d1d/d15e 0 2024-08-01T06:56:46.264 INFO:tasks.workunit.client.0.smithi016.stdout:7/953: creat d7/db/d17/d72/d1c/d1d/d40/d58/d80/f15f x:0 0 0 2024-08-01T06:56:46.266 INFO:tasks.workunit.client.0.smithi016.stdout:7/954: chown d7/db/d17/d72/d1c/d1d/d40/d58/fbc 113008985 1 2024-08-01T06:56:46.294 INFO:tasks.workunit.client.0.smithi016.stdout:3/995: dwrite d9/da/df/d2a/d49/d61/dc5/fcc [4194304,4194304] 0 2024-08-01T06:56:46.295 INFO:tasks.workunit.client.0.smithi016.stdout:7/955: dread d7/db/d17/d72/d1c/d97/fff [0,4194304] 0 2024-08-01T06:56:46.299 INFO:tasks.workunit.client.0.smithi016.stdout:3/996: creat d9/d98/f159 x:0 0 0 2024-08-01T06:56:46.307 INFO:tasks.workunit.client.0.smithi016.stdout:3/997: rmdir d9/da/df/d12/d75/dc7 39 2024-08-01T06:56:46.311 INFO:tasks.workunit.client.0.smithi016.stdout:3/998: mknod d9/da/d96/dfe/d5c/d76/dfb/d72/c15a 0 2024-08-01T06:56:46.351 INFO:tasks.workunit.client.0.smithi016.stdout:7/956: write d7/db/d17/d72/d1e/f51 [2002540,69339] 0 2024-08-01T06:56:46.372 INFO:tasks.workunit.client.0.smithi016.stdout:7/957: write d7/db/d17/d72/d1e/d26/d2a/f30 [1373295,82822] 0 2024-08-01T06:56:46.439 INFO:tasks.workunit.client.0.smithi016.stdout:7/958: write d7/db/d17/d72/d1c/f3f [1606239,20290] 0 2024-08-01T06:56:46.454 INFO:tasks.workunit.client.0.smithi016.stdout:7/959: dread d7/db/d17/d72/d1c/d1d/d40/d7f/f132 [0,4194304] 0 2024-08-01T06:56:46.460 INFO:tasks.workunit.client.0.smithi016.stdout:7/960: truncate d7/db/d17/d72/d1c/fbf 1703779 0 2024-08-01T06:56:46.465 INFO:tasks.workunit.client.0.smithi016.stdout:7/961: rename d7/db/d17/d72/d1c/d79/d8f/f2e to d7/db/d17/d72/d1c/d1d/f160 0 2024-08-01T06:56:46.528 INFO:tasks.workunit.client.0.smithi016.stdout:7/962: dwrite d7/db/d17/d72/d1c/d1d/d40/d58/d80/d94/ffe [0,4194304] 0 2024-08-01T06:56:46.530 INFO:tasks.workunit.client.0.smithi016.stdout:7/963: chown d7/db/d17/d72/d1e/d26/cce 74991767 1 2024-08-01T06:56:46.533 INFO:tasks.workunit.client.0.smithi016.stdout:7/964: fdatasync d7/db/d17/d72/d1c/d1d/d40/d67/d7c/d8d/f139 0 2024-08-01T06:56:46.541 INFO:tasks.workunit.client.0.smithi016.stdout:7/965: rename d7/db/d17/d72/d1c/d1d to d7/db/d17/d72/d1e/d26/d63/dc0/d115/d161 0 2024-08-01T06:56:46.543 INFO:tasks.workunit.client.0.smithi016.stdout:7/966: read - d7/db/d17/d72/d1e/d26/d63/dc0/d115/d161/d40/d58/da3/fe6 zero size 2024-08-01T06:56:46.548 INFO:tasks.workunit.client.0.smithi016.stdout:7/967: mkdir d7/db/d17/d72/d162 0 2024-08-01T06:56:46.552 INFO:tasks.workunit.client.0.smithi016.stdout:7/968: rename d7/db/d17/d72/d1c/dc6/le9 to d7/db/d17/d72/d1c/d79/d8f/d39/d71/l163 0 2024-08-01T06:56:46.552 INFO:tasks.workunit.client.0.smithi016.stdout:7/969: chown d7/db/d17/d72/d1c/d97 59196 1 2024-08-01T06:56:46.553 INFO:tasks.workunit.client.0.smithi016.stdout:7/970: write d7/db/d17/f13d [205717,69775] 0 2024-08-01T06:56:46.557 INFO:tasks.workunit.client.0.smithi016.stdout:7/971: mkdir d7/db/d17/d72/d1e/d26/d63/dc0/d115/d161/d15e/d164 0 2024-08-01T06:56:46.562 INFO:tasks.workunit.client.0.smithi016.stdout:7/972: truncate d7/db/d17/d72/d22/db4/f14a 114527 0 2024-08-01T06:56:46.565 INFO:tasks.workunit.client.0.smithi016.stdout:7/973: chown d7/db/d17/d72/fd5 3803126 1 2024-08-01T06:56:46.566 INFO:tasks.workunit.client.0.smithi016.stdout:7/974: read - d7/db/d17/d72/d22/db4/f130 zero size 2024-08-01T06:56:46.569 INFO:tasks.workunit.client.0.smithi016.stdout:7/975: creat d7/db/d17/d13f/d142/f165 x:0 0 0 2024-08-01T06:56:46.571 INFO:tasks.workunit.client.0.smithi016.stdout:7/976: mkdir d7/db/d17/d72/d22/d77/d99/d166 0 2024-08-01T06:56:46.572 INFO:tasks.workunit.client.0.smithi016.stdout:7/977: write d7/db/d17/d72/d22/d77/d99/f10c [552704,12768] 0 2024-08-01T06:56:46.576 INFO:tasks.workunit.client.0.smithi016.stdout:7/978: creat d7/db/d17/d72/d1e/d26/d63/dc0/d115/f167 x:0 0 0 2024-08-01T06:56:46.578 INFO:tasks.workunit.client.0.smithi016.stdout:7/979: stat d7/db/d17/d72/d1c/d79/d8f/fc5 0 2024-08-01T06:56:46.613 INFO:tasks.workunit.client.0.smithi016.stdout:7/980: write d7/db/d17/d72/d1c/d97/fff [2796499,94348] 0 2024-08-01T06:56:46.614 INFO:tasks.workunit.client.0.smithi016.stdout:7/981: chown d7/db/dc7/c11c 215204893 1 2024-08-01T06:56:46.615 INFO:tasks.workunit.client.0.smithi016.stdout:7/982: truncate d7/f5b 4383731 0 2024-08-01T06:56:46.619 INFO:tasks.workunit.client.0.smithi016.stdout:7/983: mknod d7/db/d17/d72/d1e/d26/d63/dc0/d115/d161/d40/d58/da3/c168 0 2024-08-01T06:56:46.619 INFO:tasks.workunit.client.0.smithi016.stdout:7/984: chown d7/db/d17/d72/d162 239413149 1 2024-08-01T06:56:46.623 INFO:tasks.workunit.client.0.smithi016.stdout:7/985: dread d7/db/d17/d72/d1c/d79/d8f/d39/d43/f91 [0,4194304] 0 2024-08-01T06:56:46.632 INFO:tasks.workunit.client.0.smithi016.stdout:7/986: dread d7/db/d17/d72/d22/db4/f14a [0,4194304] 0 2024-08-01T06:56:46.640 INFO:tasks.workunit.client.0.smithi016.stdout:7/987: dread d7/db/fa6 [0,4194304] 0 2024-08-01T06:56:46.651 INFO:tasks.workunit.client.0.smithi016.stdout:7/988: getdents d7 0 2024-08-01T06:56:46.654 INFO:tasks.workunit.client.0.smithi016.stdout:7/989: mkdir d7/db/d17/d72/d1e/d26/d63/dc0/d115/d161/d15e/d169 0 2024-08-01T06:56:46.654 INFO:tasks.workunit.client.0.smithi016.stdout:7/990: chown d7/db/d17/d72/cd2 75079 1 2024-08-01T06:56:46.659 INFO:tasks.workunit.client.0.smithi016.stdout:7/991: rename d7/db/d17/d72/d1e/d26/d63/dc0/d115/d161/c5a to d7/db/d17/d72/d1e/d26/d63/dc0/d115/d161/c16a 0 2024-08-01T06:56:46.660 INFO:tasks.workunit.client.0.smithi016.stdout:7/992: chown d7/db/d17/d72/d22/d77/d99/lb2 1330407116 1 2024-08-01T06:56:46.664 INFO:tasks.workunit.client.0.smithi016.stdout:7/993: symlink d7/db/d17/d72/d1e/d26/d63/dc0/d115/d161/d40/d58/d80/l16b 0 2024-08-01T06:56:46.666 INFO:tasks.workunit.client.0.smithi016.stdout:7/994: truncate d7/db/d17/d72/d22/fc2 915457 0 2024-08-01T06:56:46.666 INFO:tasks.workunit.client.0.smithi016.stdout:7/995: readlink d7/lcb 0 2024-08-01T06:56:46.669 INFO:tasks.workunit.client.0.smithi016.stdout:7/996: symlink d7/db/d17/d72/d1e/d26/d63/dc0/d115/d161/d40/d67/l16c 0 2024-08-01T06:56:46.684 INFO:tasks.workunit.client.0.smithi016.stdout:7/997: dread d7/db/d17/d72/d22/f4a [0,4194304] 0 2024-08-01T06:56:46.688 INFO:tasks.workunit.client.0.smithi016.stdout:7/998: creat d7/db/d17/d72/d1e/d26/d63/dc0/d115/d161/d40/d58/d80/d94/df1/f16d x:0 0 0 2024-08-01T06:56:46.691 INFO:tasks.workunit.client.0.smithi016.stdout:7/999: mknod d7/db/c16e 0 2024-08-01T06:56:46.730 INFO:tasks.workunit.client.0.smithi016.stdout:8/870: sync 2024-08-01T06:56:46.730 INFO:tasks.workunit.client.0.smithi016.stdout:3/999: sync 2024-08-01T06:56:46.733 INFO:tasks.workunit.client.0.smithi016.stdout:8/871: creat d5/d67/d101/d105/df0/dd8/dd2/f12d x:0 0 0 2024-08-01T06:56:46.735 INFO:tasks.workunit.client.0.smithi016.stdout:8/872: readlink d5/d8/d1a/d24/lf2 0 2024-08-01T06:56:46.737 INFO:tasks.workunit.client.0.smithi016.stdout:8/873: write d5/d8/d1a/d24/d48/d69/d10e/d63/db4/f103 [1645833,24782] 0 2024-08-01T06:56:46.742 INFO:tasks.workunit.client.0.smithi016.stdout:8/874: getdents d5/d8/d1a/d24 0 2024-08-01T06:56:46.743 INFO:tasks.workunit.client.0.smithi016.stdout:8/875: read - d5/d8/d1a/d24/d48/d6e/d83/fea zero size 2024-08-01T06:56:46.801 INFO:tasks.workunit.client.0.smithi016.stdout:8/876: rename d5/d67/d101/d105 to d5/d8/d1a/d24/d48/d6e/d123/d12e 0 2024-08-01T06:56:46.804 INFO:tasks.workunit.client.0.smithi016.stdout:8/877: mkdir d5/d8/d1a/d24/d48/d69/d10e/d125/d12f 0 2024-08-01T06:56:46.811 INFO:tasks.workunit.client.0.smithi016.stdout:8/878: rename d5/dc9/c121 to d5/d8/d124/c130 0 2024-08-01T06:56:46.817 INFO:tasks.workunit.client.0.smithi016.stdout:8/879: getdents d5/d8/d1a/d24/d48/d69/d10e/d63 0 2024-08-01T06:56:46.820 INFO:tasks.workunit.client.0.smithi016.stdout:8/880: rename d5/dc/l9a to d5/dc/l131 0 2024-08-01T06:56:46.821 INFO:tasks.workunit.client.0.smithi016.stdout:8/881: mkdir d5/dc/d3e/d132 0 2024-08-01T06:56:46.824 INFO:tasks.workunit.client.0.smithi016.stdout:8/882: creat d5/d8/d1a/d24/d48/d6e/d123/d12e/df0/dd8/d100/f133 x:0 0 0 2024-08-01T06:56:46.826 INFO:tasks.workunit.client.0.smithi016.stdout:8/883: creat d5/d8/d1a/d24/d48/d6e/deb/f134 x:0 0 0 2024-08-01T06:56:46.828 INFO:tasks.workunit.client.0.smithi016.stdout:8/884: fsync d5/d8/d1a/d24/d48/d69/d10e/f66 0 2024-08-01T06:56:46.832 INFO:tasks.workunit.client.0.smithi016.stdout:8/885: mkdir d5/d8/d1a/da9/d135 0 2024-08-01T06:56:46.842 INFO:tasks.workunit.client.0.smithi016.stdout:8/886: getdents d5/d8/d1a/d24 0 2024-08-01T06:56:46.844 INFO:tasks.workunit.client.0.smithi016.stdout:8/887: creat d5/d8/d1a/d24/d48/d6e/d92/f136 x:0 0 0 2024-08-01T06:56:46.845 INFO:tasks.workunit.client.0.smithi016.stdout:8/888: read d5/d8/d1a/d24/d48/d69/d10e/f79 [252667,51317] 0 2024-08-01T06:56:46.847 INFO:tasks.workunit.client.0.smithi016.stdout:8/889: rmdir d5/dc9 39 2024-08-01T06:56:46.849 INFO:tasks.workunit.client.0.smithi016.stdout:8/890: write d5/d8/d1a/dbe/f11c [5608,85016] 0 2024-08-01T06:56:46.849 INFO:tasks.workunit.client.0.smithi016.stdout:8/891: stat d5/d8/f94 0 2024-08-01T06:56:46.853 INFO:tasks.workunit.client.0.smithi016.stdout:8/892: symlink d5/d8/d1a/d24/d48/d6e/d123/d12e/df0/dd8/dd2/l137 0 2024-08-01T06:56:46.860 INFO:tasks.workunit.client.0.smithi016.stdout:8/893: dwrite d5/d8/d1a/d24/d48/d6e/d92/f11b [0,4194304] 0 2024-08-01T06:56:46.880 INFO:tasks.workunit.client.0.smithi016.stdout:8/894: dread d5/d8/f68 [0,4194304] 0 2024-08-01T06:56:46.905 INFO:tasks.workunit.client.0.smithi016.stdout:8/895: write d5/d8/d1a/d24/d48/d6e/d123/d12e/df0/fc8 [507300,111429] 0 2024-08-01T06:56:46.905 INFO:tasks.workunit.client.0.smithi016.stdout:8/896: stat d5/dc/c41 0 2024-08-01T06:56:46.914 INFO:tasks.workunit.client.0.smithi016.stdout:8/897: dwrite d5/d8/d1a/d24/d48/d6e/deb/f134 [0,4194304] 0 2024-08-01T06:56:46.918 INFO:tasks.workunit.client.0.smithi016.stdout:8/898: creat d5/dc9/f138 x:0 0 0 2024-08-01T06:56:46.932 INFO:tasks.workunit.client.0.smithi016.stdout:8/899: dread d5/d1c/f4c [0,4194304] 0 2024-08-01T06:56:46.933 INFO:tasks.workunit.client.0.smithi016.stdout:8/900: read d5/d8/d1a/d24/f4e [3158079,118790] 0 2024-08-01T06:56:46.941 INFO:tasks.workunit.client.0.smithi016.stdout:8/901: dwrite d5/d8/d1a/d24/d48/d69/d104/f10a [0,4194304] 0 2024-08-01T06:56:46.944 INFO:tasks.workunit.client.0.smithi016.stdout:8/902: mkdir d5/d8/d1a/da9/d135/d139 0 2024-08-01T06:56:46.957 INFO:tasks.workunit.client.0.smithi016.stdout:8/903: rename d5/d8/d1a/d24/d48/d6e/d123/d12e/df0/dd8/dd2/l137 to d5/l13a 0 2024-08-01T06:56:47.091 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:46 smithi016 ceph-mon[29266]: pgmap v37: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 43 MiB/s rd, 123 MiB/s wr, 455 op/s 2024-08-01T06:56:47.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:46 smithi089 ceph-mon[36617]: pgmap v37: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 43 MiB/s rd, 123 MiB/s wr, 455 op/s 2024-08-01T06:56:47.468 INFO:tasks.workunit.client.0.smithi016.stdout:8/904: sync 2024-08-01T06:56:47.482 INFO:tasks.workunit.client.0.smithi016.stdout:8/905: link d5/d8/d1a/fe9 d5/dc/d3e/d132/f13b 0 2024-08-01T06:56:47.500 INFO:tasks.workunit.client.0.smithi016.stdout:8/906: dwrite d5/d8/d1a/d24/f19 [0,4194304] 0 2024-08-01T06:56:47.503 INFO:tasks.workunit.client.0.smithi016.stdout:8/907: mknod d5/d67/c13c 0 2024-08-01T06:56:47.505 INFO:tasks.workunit.client.0.smithi016.stdout:8/908: chown d5/d8/d1a/d24/d48/d69/d10e/c12a 332280639 1 2024-08-01T06:56:47.510 INFO:tasks.workunit.client.0.smithi016.stdout:8/909: getdents d5/d8/d1a/d24/d48/d69/d10e/d63 0 2024-08-01T06:56:47.511 INFO:tasks.workunit.client.0.smithi016.stdout:8/910: fsync d5/d8/d1a/dbe/fd1 0 2024-08-01T06:56:47.514 INFO:tasks.workunit.client.0.smithi016.stdout:8/911: mknod d5/d8/d1a/d24/d48/d6e/d123/d12e/df0/dd8/c13d 0 2024-08-01T06:56:47.520 INFO:tasks.workunit.client.0.smithi016.stdout:8/912: dwrite d5/d8/d1a/d24/d48/d6e/d123/d12e/fc6 [0,4194304] 0 2024-08-01T06:56:47.537 INFO:tasks.workunit.client.0.smithi016.stdout:8/913: dread d5/d8/d1a/d24/d48/d69/d10e/d63/db4/f103 [0,4194304] 0 2024-08-01T06:56:47.538 INFO:tasks.workunit.client.0.smithi016.stdout:8/914: chown d5/d1c/l39 25417 1 2024-08-01T06:56:47.540 INFO:tasks.workunit.client.0.smithi016.stdout:8/915: mkdir d5/d67/d101/d13e 0 2024-08-01T06:56:47.542 INFO:tasks.workunit.client.0.smithi016.stdout:8/916: creat d5/d8/d1a/d24/d48/d69/d10e/d63/de3/f13f x:0 0 0 2024-08-01T06:56:47.543 INFO:tasks.workunit.client.0.smithi016.stdout:8/917: dread - d5/d8/d1a/d24/d8c/f11d zero size 2024-08-01T06:56:47.544 INFO:tasks.workunit.client.0.smithi016.stdout:8/918: stat d5/d8/d1a/da9/db6/cc4 0 2024-08-01T06:56:47.547 INFO:tasks.workunit.client.0.smithi016.stdout:8/919: read d5/fc5 [250449,92043] 0 2024-08-01T06:56:47.549 INFO:tasks.workunit.client.0.smithi016.stdout:8/920: creat d5/d67/d101/d13e/f140 x:0 0 0 2024-08-01T06:56:47.550 INFO:tasks.workunit.client.0.smithi016.stdout:8/921: rmdir d5/d8/d1a/d24/d48/d69/d10e/d63/db4 39 2024-08-01T06:56:47.552 INFO:tasks.workunit.client.0.smithi016.stdout:8/922: symlink d5/d8/d1a/d24/d8c/l141 0 2024-08-01T06:56:47.554 INFO:tasks.workunit.client.0.smithi016.stdout:8/923: mkdir d5/d8/d1a/dbe/d142 0 2024-08-01T06:56:47.558 INFO:tasks.workunit.client.0.smithi016.stdout:8/924: mkdir d5/d8/d1a/da9/d135/d139/d143 0 2024-08-01T06:56:47.561 INFO:tasks.workunit.client.0.smithi016.stdout:8/925: rename d5/d8/d1a/d24/d48/f97 to d5/d8/d1a/dbe/d142/f144 0 2024-08-01T06:56:47.564 INFO:tasks.workunit.client.0.smithi016.stdout:8/926: symlink d5/d8/d1a/d24/d48/d69/d10e/dfc/d111/l145 0 2024-08-01T06:56:47.566 INFO:tasks.workunit.client.0.smithi016.stdout:8/927: read d5/d8/d75/fb9 [1567868,70082] 0 2024-08-01T06:56:47.568 INFO:tasks.workunit.client.0.smithi016.stdout:8/928: creat d5/d8/d1a/d24/d48/d69/d10e/d125/f146 x:0 0 0 2024-08-01T06:56:47.570 INFO:tasks.workunit.client.0.smithi016.stdout:8/929: getdents d5/d8/d1a/d24/d6a/d12c 0 2024-08-01T06:56:47.572 INFO:tasks.workunit.client.0.smithi016.stdout:8/930: dread - d5/d8/d75/ff4 zero size 2024-08-01T06:56:47.573 INFO:tasks.workunit.client.0.smithi016.stdout:8/931: read d5/dc/d3e/f6b [745388,59857] 0 2024-08-01T06:56:47.590 INFO:tasks.workunit.client.0.smithi016.stdout:8/932: dread d5/d8/d1a/d24/d48/d85/fa5 [4194304,4194304] 0 2024-08-01T06:56:47.590 INFO:tasks.workunit.client.0.smithi016.stdout:8/933: creat d5/d8/d1a/dbe/d142/f147 x:0 0 0 2024-08-01T06:56:47.595 INFO:tasks.workunit.client.0.smithi016.stdout:8/934: write d5/d8/d1a/d24/d48/d6e/d83/fd4 [2108281,68253] 0 2024-08-01T06:56:47.600 INFO:tasks.workunit.client.0.smithi016.stdout:8/935: creat d5/d8/d1a/d24/d48/d6e/d123/d12e/df0/dd8/d100/f148 x:0 0 0 2024-08-01T06:56:47.607 INFO:tasks.workunit.client.0.smithi016.stdout:8/936: dwrite d5/d8/d1a/d24/d48/d6e/d123/d12e/df0/fee [0,4194304] 0 2024-08-01T06:56:47.608 INFO:tasks.workunit.client.0.smithi016.stdout:8/937: stat d5/d8/d1a/dbe/d142 0 2024-08-01T06:56:47.917 INFO:tasks.workunit.client.0.smithi016.stdout:8/938: sync 2024-08-01T06:56:47.927 INFO:tasks.workunit.client.0.smithi016.stdout:8/939: write d5/dc/d3e/d132/f13b [372339,8717] 0 2024-08-01T06:56:47.930 INFO:tasks.workunit.client.0.smithi016.stdout:8/940: mknod d5/d8/d1a/da9/db6/c149 0 2024-08-01T06:56:47.931 INFO:tasks.workunit.client.0.smithi016.stdout:8/941: dread - d5/d8/d1a/dbe/d142/f147 zero size 2024-08-01T06:56:47.933 INFO:tasks.workunit.client.0.smithi016.stdout:8/942: mkdir d5/d8/d1a/d24/d48/d69/d14a 0 2024-08-01T06:56:47.940 INFO:tasks.workunit.client.0.smithi016.stdout:8/943: dwrite d5/d8/d1a/d24/d48/d6e/d123/d12e/df0/de2/fa6 [0,4194304] 0 2024-08-01T06:56:47.943 INFO:tasks.workunit.client.0.smithi016.stdout:8/944: truncate d5/dc/f31 3993354 0 2024-08-01T06:56:47.946 INFO:tasks.workunit.client.0.smithi016.stdout:8/945: symlink d5/d8/d75/dba/l14b 0 2024-08-01T06:56:47.952 INFO:tasks.workunit.client.0.smithi016.stdout:8/946: creat d5/d8/d1a/d24/d48/d69/d10e/d63/f14c x:0 0 0 2024-08-01T06:56:47.954 INFO:tasks.workunit.client.0.smithi016.stdout:8/947: read - d5/d8/d1a/d24/d48/d6e/d123/d12e/df0/dd8/fe5 zero size 2024-08-01T06:56:47.956 INFO:tasks.workunit.client.0.smithi016.stdout:8/948: fdatasync d5/d1c/f8e 0 2024-08-01T06:56:47.959 INFO:tasks.workunit.client.0.smithi016.stdout:8/949: mknod d5/dc/d3e/c14d 0 2024-08-01T06:56:47.963 INFO:tasks.workunit.client.0.smithi016.stdout:8/950: fsync d5/d8/d1a/d24/d48/d6e/d123/d12e/df0/fc1 0 2024-08-01T06:56:47.971 INFO:tasks.workunit.client.0.smithi016.stdout:8/951: dwrite d5/d8/d1a/dbe/f11c [4194304,4194304] 0 2024-08-01T06:56:47.972 INFO:tasks.workunit.client.0.smithi016.stdout:8/952: chown d5/d8/d1a/dbe/f118 33845140 1 2024-08-01T06:56:47.977 INFO:tasks.workunit.client.0.smithi016.stdout:8/953: getdents d5/d8/d1a/d24/d48/d6e/d83 0 2024-08-01T06:56:47.980 INFO:tasks.workunit.client.0.smithi016.stdout:8/954: rename d5/dc/l131 to d5/dc/l14e 0 2024-08-01T06:56:47.983 INFO:tasks.workunit.client.0.smithi016.stdout:8/955: mkdir d5/d67/dec/d14f 0 2024-08-01T06:56:47.987 INFO:tasks.workunit.client.0.smithi016.stdout:8/956: rename d5/d8/d1a/d24/d48/d6e/d123/d12e/df0/fc1 to d5/d8/d1a/d24/d48/d6e/d123/f150 0 2024-08-01T06:56:47.989 INFO:tasks.workunit.client.0.smithi016.stdout:8/957: write d5/d8/d1a/d24/d48/d6e/d83/f11e [246097,60797] 0 2024-08-01T06:56:48.312 INFO:tasks.workunit.client.0.smithi016.stdout:8/958: sync 2024-08-01T06:56:48.316 INFO:tasks.workunit.client.0.smithi016.stdout:8/959: mkdir d5/d8/d1a/d24/d48/d69/d14a/d151 0 2024-08-01T06:56:48.317 INFO:tasks.workunit.client.0.smithi016.stdout:8/960: dread - d5/d8/d1a/d24/d48/d6e/d123/d12e/df0/dd8/d100/f148 zero size 2024-08-01T06:56:48.320 INFO:tasks.workunit.client.0.smithi016.stdout:8/961: fdatasync d5/d8/d1a/d24/d8c/fb2 0 2024-08-01T06:56:48.322 INFO:tasks.workunit.client.0.smithi016.stdout:8/962: readlink d5/d8/d1a/d24/d48/d69/d10e/dfc/d111/l145 0 2024-08-01T06:56:48.330 INFO:tasks.workunit.client.0.smithi016.stdout:8/963: rename d5/d8/d1a/da9/d135 to d5/d8/d1a/d152 0 2024-08-01T06:56:48.343 INFO:tasks.workunit.client.0.smithi016.stdout:8/964: write d5/d8/d1a/d24/d48/d6e/d123/f150 [27341,9866] 0 2024-08-01T06:56:48.345 INFO:tasks.workunit.client.0.smithi016.stdout:8/965: dread d5/d8/d1a/d24/d48/d6e/d123/f150 [0,4194304] 0 2024-08-01T06:56:48.349 INFO:tasks.workunit.client.0.smithi016.stdout:8/966: truncate d5/d8/d1a/d24/d48/d85/da8/fd9 359912 0 2024-08-01T06:56:48.350 INFO:tasks.workunit.client.0.smithi016.stdout:8/967: truncate d5/f61 2893337 0 2024-08-01T06:56:48.364 INFO:tasks.workunit.client.0.smithi016.stdout:8/968: dwrite d5/f12 [0,4194304] 0 2024-08-01T06:56:48.372 INFO:tasks.workunit.client.0.smithi016.stdout:8/969: mkdir d5/d8/d1a/d24/d48/d69/d10e/d63/d153 0 2024-08-01T06:56:48.374 INFO:tasks.workunit.client.0.smithi016.stdout:8/970: rmdir d5/d1c 39 2024-08-01T06:56:48.375 INFO:tasks.workunit.client.0.smithi016.stdout:8/971: fsync d5/d8/d1a/f54 0 2024-08-01T06:56:48.378 INFO:tasks.workunit.client.0.smithi016.stdout:8/972: rename d5/d8/d1a/d24/d48/d6e/d92/f11b to d5/d67/d101/d13e/f154 0 2024-08-01T06:56:48.380 INFO:tasks.workunit.client.0.smithi016.stdout:8/973: fdatasync d5/d8/d75/dba/fc3 0 2024-08-01T06:56:48.385 INFO:tasks.workunit.client.0.smithi016.stdout:8/974: dread d5/d8/d1a/d24/d48/d69/d10e/dfc/d111/f5c [4194304,4194304] 0 2024-08-01T06:56:48.388 INFO:tasks.workunit.client.0.smithi016.stdout:8/975: creat d5/d8/d1a/d24/d48/d6e/d92/df5/f155 x:0 0 0 2024-08-01T06:56:48.390 INFO:tasks.workunit.client.0.smithi016.stdout:8/976: mkdir d5/d156 0 2024-08-01T06:56:48.391 INFO:tasks.workunit.client.0.smithi016.stdout:8/977: readlink d5/l2c 0 2024-08-01T06:56:48.392 INFO:tasks.workunit.client.0.smithi016.stdout:8/978: write d5/d8/f58 [1325707,103219] 0 2024-08-01T06:56:48.395 INFO:tasks.workunit.client.0.smithi016.stdout:8/979: unlink d5/d8/d1a/d24/d48/d6e/d123/d12e/df0/dd8/d100/f148 0 2024-08-01T06:56:48.401 INFO:tasks.workunit.client.0.smithi016.stdout:8/980: dwrite d5/d1c/f4c [0,4194304] 0 2024-08-01T06:56:48.402 INFO:tasks.workunit.client.0.smithi016.stdout:8/981: dread - d5/d8/d1a/d24/d48/d6e/d83/fea zero size 2024-08-01T06:56:48.403 INFO:tasks.workunit.client.0.smithi016.stdout:8/982: chown d5/d8/d75/dba 21035274 1 2024-08-01T06:56:48.405 INFO:tasks.workunit.client.0.smithi016.stdout:8/983: write d5/d8/d75/dba/ff6 [1905130,110535] 0 2024-08-01T06:56:48.410 INFO:tasks.workunit.client.0.smithi016.stdout:8/984: truncate d5/d8/d1a/d24/d48/d6e/d123/d12e/df0/de2/faa 1796784 0 2024-08-01T06:56:48.413 INFO:tasks.workunit.client.0.smithi016.stdout:8/985: mknod d5/d8/d1a/d152/d139/c157 0 2024-08-01T06:56:48.416 INFO:tasks.workunit.client.0.smithi016.stdout:8/986: mknod d5/d8/d1a/dbe/c158 0 2024-08-01T06:56:48.421 INFO:tasks.workunit.client.0.smithi016.stdout:8/987: mkdir d5/d8/d1a/d24/d48/d69/d10e/d125/d159 0 2024-08-01T06:56:48.425 INFO:tasks.workunit.client.0.smithi016.stdout:8/988: rmdir d5/d8/d1a/d24 39 2024-08-01T06:56:48.426 INFO:tasks.workunit.client.0.smithi016.stdout:8/989: chown d5/f1b 4180583 1 2024-08-01T06:56:48.433 INFO:tasks.workunit.client.0.smithi016.stdout:8/990: truncate d5/d8/d1a/da9/db6/ffa 378622 0 2024-08-01T06:56:48.436 INFO:tasks.workunit.client.0.smithi016.stdout:8/991: dread - d5/d8/d1a/d24/d48/d69/d10e/d63/de3/f116 zero size 2024-08-01T06:56:48.437 INFO:tasks.workunit.client.0.smithi016.stdout:8/992: readlink d5/d8/d1a/l51 0 2024-08-01T06:56:48.440 INFO:tasks.workunit.client.0.smithi016.stdout:8/993: creat d5/d8/d1a/d24/d48/d6e/deb/f15a x:0 0 0 2024-08-01T06:56:48.485 INFO:tasks.workunit.client.0.smithi016.stdout:8/994: link d5/d8/d1a/d24/d48/lad d5/d8/d1a/d24/d48/d69/d10e/dfc/d111/dcf/l15b 0 2024-08-01T06:56:48.487 INFO:tasks.workunit.client.0.smithi016.stdout:8/995: unlink d5/d8/d75/dba/f102 0 2024-08-01T06:56:48.500 INFO:tasks.workunit.client.0.smithi016.stdout:8/996: rmdir d5/d8/d1a/d24/d48/d69/d10e/dfc 39 2024-08-01T06:56:48.500 INFO:tasks.workunit.client.0.smithi016.stdout:8/997: write d5/d8/d1a/d24/d6a/fc2 [3596980,1705] 0 2024-08-01T06:56:48.502 INFO:tasks.workunit.client.0.smithi016.stdout:8/998: stat d5/d1c/c49 0 2024-08-01T06:56:48.503 INFO:tasks.workunit.client.0.smithi016.stdout:8/999: rmdir d5/d8/d1a/d24/d6a 39 2024-08-01T06:56:48.507 INFO:tasks.workunit.client.0.smithi016.stderr:+ rm -rf -- ./tmp.HGsD6EgeC9 2024-08-01T06:56:48.678 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:48 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:48.679 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:48 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:48.679 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:48 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-01T06:56:48.679 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:48 smithi016 ceph-mon[29266]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-01T06:56:48.679 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:48 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:56:48.679 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:48 smithi016 ceph-mon[29266]: Upgrade: Need to upgrade myself (mgr.smithi089.hfgnsr) 2024-08-01T06:56:48.679 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:48 smithi016 ceph-mon[29266]: Upgrade: Need to upgrade myself (mgr.smithi089.hfgnsr) 2024-08-01T06:56:48.679 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:48 smithi016 ceph-mon[29266]: pgmap v38: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 33 MiB/s rd, 83 MiB/s wr, 341 op/s 2024-08-01T06:56:48.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:48 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:48.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:48 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:48.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:48 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-01T06:56:48.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:48 smithi089 ceph-mon[36617]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-01T06:56:48.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:48 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:56:48.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:48 smithi089 ceph-mon[36617]: Upgrade: Need to upgrade myself (mgr.smithi089.hfgnsr) 2024-08-01T06:56:48.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:48 smithi089 ceph-mon[36617]: Upgrade: Need to upgrade myself (mgr.smithi089.hfgnsr) 2024-08-01T06:56:48.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:48 smithi089 ceph-mon[36617]: pgmap v38: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 33 MiB/s rd, 83 MiB/s wr, 341 op/s 2024-08-01T06:56:50.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:50 smithi089 ceph-mon[36617]: Upgrade: Updating mgr.smithi016.whigbo 2024-08-01T06:56:50.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:50 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:50.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:50 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi016.whigbo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-01T06:56:50.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:50 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi016.whigbo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-01T06:56:50.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:50 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-01T06:56:50.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:50 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:56:50.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:50 smithi089 ceph-mon[36617]: Deploying daemon mgr.smithi016.whigbo on smithi016 2024-08-01T06:56:50.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:50 smithi089 ceph-mon[36617]: pgmap v39: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 44 MiB/s rd, 97 MiB/s wr, 510 op/s 2024-08-01T06:56:50.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:50 smithi016 ceph-mon[29266]: Upgrade: Updating mgr.smithi016.whigbo 2024-08-01T06:56:50.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:50 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:50.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:50 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi016.whigbo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-01T06:56:50.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:50 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi016.whigbo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-01T06:56:50.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:50 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-01T06:56:50.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:50 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:56:50.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:50 smithi016 ceph-mon[29266]: Deploying daemon mgr.smithi016.whigbo on smithi016 2024-08-01T06:56:50.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:50 smithi016 ceph-mon[29266]: pgmap v39: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 44 MiB/s rd, 97 MiB/s wr, 510 op/s 2024-08-01T06:56:53.086 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:52 smithi016 ceph-mon[29266]: pgmap v40: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 27 MiB/s rd, 51 MiB/s wr, 334 op/s 2024-08-01T06:56:53.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:52 smithi089 ceph-mon[36617]: pgmap v40: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 27 MiB/s rd, 51 MiB/s wr, 334 op/s 2024-08-01T06:56:54.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:53 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:56:54.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:53 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:54.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:53 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:54.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:53 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:56:54.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:53 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:56:54.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:53 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:54.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:53 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:56:54.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:53 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:56:55.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:54 smithi089 ceph-mon[36617]: pgmap v41: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 27 MiB/s rd, 51 MiB/s wr, 334 op/s 2024-08-01T06:56:55.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:54 smithi016 ceph-mon[29266]: pgmap v41: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 27 MiB/s rd, 51 MiB/s wr, 334 op/s 2024-08-01T06:56:57.006 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:56 smithi016 ceph-mon[29266]: pgmap v42: 65 pgs: 65 active+clean; 1.9 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 27 MiB/s rd, 51 MiB/s wr, 478 op/s 2024-08-01T06:56:57.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:56 smithi089 ceph-mon[36617]: pgmap v42: 65 pgs: 65 active+clean; 1.9 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 27 MiB/s rd, 51 MiB/s wr, 478 op/s 2024-08-01T06:56:59.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:56:58 smithi089 ceph-mon[36617]: pgmap v43: 65 pgs: 65 active+clean; 1.9 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 12 MiB/s rd, 15 MiB/s wr, 313 op/s 2024-08-01T06:56:59.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:56:58 smithi016 ceph-mon[29266]: pgmap v43: 65 pgs: 65 active+clean; 1.9 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 12 MiB/s rd, 15 MiB/s wr, 313 op/s 2024-08-01T06:57:00.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:00 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:57:00.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:00 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:57:00.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:00 smithi089 ceph-mon[36617]: pgmap v44: 65 pgs: 65 active+clean; 1.5 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 13 MiB/s rd, 15 MiB/s wr, 471 op/s 2024-08-01T06:57:00.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:00 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:57:00.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:00 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:57:00.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:00 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:57:00.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:00 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:57:00.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:00 smithi016 ceph-mon[29266]: pgmap v44: 65 pgs: 65 active+clean; 1.5 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 13 MiB/s rd, 15 MiB/s wr, 471 op/s 2024-08-01T06:57:00.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:00 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:57:00.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:00 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:57:00.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.759+0000 7f9dc1857640 1 -- 172.21.15.16:0/137978690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dbc102f90 msgr2=0x7f9dbc103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:00.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.759+0000 7f9dc1857640 1 --2- 172.21.15.16:0/137978690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dbc102f90 0x7f9dbc103410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009880 tx=0x7f9db002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:57:00.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.759+0000 7f9dc1857640 1 -- 172.21.15.16:0/137978690 shutdown_connections 2024-08-01T06:57:00.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.759+0000 7f9dc1857640 1 --2- 172.21.15.16:0/137978690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dbc102f90 0x7f9dbc103410 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:00.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.759+0000 7f9dc1857640 1 --2- 172.21.15.16:0/137978690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dbc101d90 0x7f9dbc102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:00.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.759+0000 7f9dc1857640 1 -- 172.21.15.16:0/137978690 >> 172.21.15.16:0/137978690 conn(0x7f9dbc0fd540 msgr2=0x7f9dbc0ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:00.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.759+0000 7f9dc1857640 1 -- 172.21.15.16:0/137978690 shutdown_connections 2024-08-01T06:57:00.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.759+0000 7f9dc1857640 1 -- 172.21.15.16:0/137978690 wait complete. 2024-08-01T06:57:00.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.760+0000 7f9dc1857640 1 Processor -- start 2024-08-01T06:57:00.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.760+0000 7f9dc1857640 1 -- start start 2024-08-01T06:57:00.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.760+0000 7f9dc1857640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dbc101d90 0x7f9dbc078260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:00.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.761+0000 7f9dc1857640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dbc102f90 0x7f9dbc0787a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:00.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.761+0000 7f9dc1857640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc074d50 con 0x7f9dbc102f90 2024-08-01T06:57:00.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.761+0000 7f9dc1857640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc074ec0 con 0x7f9dbc101d90 2024-08-01T06:57:00.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.761+0000 7f9dbaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dbc101d90 0x7f9dbc078260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:00.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.761+0000 7f9dbaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dbc101d90 0x7f9dbc078260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:49410/0 (socket says 172.21.15.16:49410) 2024-08-01T06:57:00.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.761+0000 7f9dbaffd640 1 -- 172.21.15.16:0/3775047098 learned_addr learned my addr 172.21.15.16:0/3775047098 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:57:00.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.761+0000 7f9dba7fc640 1 --2- 172.21.15.16:0/3775047098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dbc102f90 0x7f9dbc0787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:00.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.761+0000 7f9dbaffd640 1 -- 172.21.15.16:0/3775047098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dbc102f90 msgr2=0x7f9dbc0787a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:00.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.761+0000 7f9dbaffd640 1 --2- 172.21.15.16:0/3775047098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dbc102f90 0x7f9dbc0787a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:00.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.761+0000 7f9dbaffd640 1 -- 172.21.15.16:0/3775047098 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db0009560 con 0x7f9dbc101d90 2024-08-01T06:57:00.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.761+0000 7f9dba7fc640 1 --2- 172.21.15.16:0/3775047098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dbc102f90 0x7f9dbc0787a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T06:57:00.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.761+0000 7f9dbaffd640 1 --2- 172.21.15.16:0/3775047098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dbc101d90 0x7f9dbc078260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00e940 tx=0x7f9dac00ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:00.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.761+0000 7f9dc0855640 1 -- 172.21.15.16:0/3775047098 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dac009700 con 0x7f9dbc101d90 2024-08-01T06:57:00.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.762+0000 7f9dc0855640 1 -- 172.21.15.16:0/3775047098 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9dac00cc90 con 0x7f9dbc101d90 2024-08-01T06:57:00.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.762+0000 7f9dc0855640 1 -- 172.21.15.16:0/3775047098 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dac010430 con 0x7f9dbc101d90 2024-08-01T06:57:00.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.762+0000 7f9dc1857640 1 -- 172.21.15.16:0/3775047098 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dbc0751a0 con 0x7f9dbc101d90 2024-08-01T06:57:00.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.762+0000 7f9dc1857640 1 -- 172.21.15.16:0/3775047098 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dbc075740 con 0x7f9dbc101d90 2024-08-01T06:57:00.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.763+0000 7f9dc1857640 1 -- 172.21.15.16:0/3775047098 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dbc102190 con 0x7f9dbc101d90 2024-08-01T06:57:00.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.765+0000 7f9dc0855640 1 -- 172.21.15.16:0/3775047098 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 24) v1 ==== 91559+0+0 (secure 0 0 0) 0x7f9dac003fa0 con 0x7f9dbc101d90 2024-08-01T06:57:00.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.766+0000 7f9dc0855640 1 --2- 172.21.15.16:0/3775047098 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f9da406d650 0x7f9da406fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:00.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.766+0000 7f9dc0855640 1 -- 172.21.15.16:0/3775047098 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f9dac014070 con 0x7f9dbc101d90 2024-08-01T06:57:00.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.766+0000 7f9dba7fc640 1 --2- 172.21.15.16:0/3775047098 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f9da406d650 0x7f9da406fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:00.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.766+0000 7f9dba7fc640 1 --2- 172.21.15.16:0/3775047098 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f9da406d650 0x7f9da406fb10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9db0000c00 tx=0x7f9db0005a20 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:00.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:00.769+0000 7f9dc0855640 1 -- 172.21.15.16:0/3775047098 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f9dac056fa0 con 0x7f9dbc101d90 2024-08-01T06:57:01.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.053+0000 7f9dc1857640 1 -- 172.21.15.16:0/3775047098 --> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9dbc02c480 con 0x7f9da406d650 2024-08-01T06:57:01.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.054+0000 7f9dc0855640 1 -- 172.21.15.16:0/3775047098 <== mgr.24423 v2:172.21.15.89:6828/2589785296 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f9dbc02c480 con 0x7f9da406d650 2024-08-01T06:57:01.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.057+0000 7f9dc1857640 1 -- 172.21.15.16:0/3775047098 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f9da406d650 msgr2=0x7f9da406fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:01.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.057+0000 7f9dc1857640 1 --2- 172.21.15.16:0/3775047098 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f9da406d650 0x7f9da406fb10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9db0000c00 tx=0x7f9db0005a20 comp rx=0 tx=0).stop 2024-08-01T06:57:01.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.057+0000 7f9dc1857640 1 -- 172.21.15.16:0/3775047098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dbc101d90 msgr2=0x7f9dbc078260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:01.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.057+0000 7f9dc1857640 1 --2- 172.21.15.16:0/3775047098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dbc101d90 0x7f9dbc078260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00e940 tx=0x7f9dac00ee00 comp rx=0 tx=0).stop 2024-08-01T06:57:01.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.057+0000 7f9dc1857640 1 -- 172.21.15.16:0/3775047098 shutdown_connections 2024-08-01T06:57:01.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.057+0000 7f9dc1857640 1 --2- 172.21.15.16:0/3775047098 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f9da406d650 0x7f9da406fb10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.057+0000 7f9dc1857640 1 --2- 172.21.15.16:0/3775047098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dbc102f90 0x7f9dbc0787a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.057+0000 7f9dc1857640 1 --2- 172.21.15.16:0/3775047098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dbc101d90 0x7f9dbc078260 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.057+0000 7f9dc1857640 1 -- 172.21.15.16:0/3775047098 >> 172.21.15.16:0/3775047098 conn(0x7f9dbc0fd540 msgr2=0x7f9dbc106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:01.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.057+0000 7f9dc1857640 1 -- 172.21.15.16:0/3775047098 shutdown_connections 2024-08-01T06:57:01.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.057+0000 7f9dc1857640 1 -- 172.21.15.16:0/3775047098 wait complete. 2024-08-01T06:57:01.069 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T06:57:01.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.172+0000 7ffa5094d640 1 -- 172.21.15.16:0/3441349088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa4c100d90 msgr2=0x7ffa4c101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:01.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.172+0000 7ffa5094d640 1 --2- 172.21.15.16:0/3441349088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa4c100d90 0x7ffa4c101210 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009880 tx=0x7ffa4002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.173+0000 7ffa5094d640 1 -- 172.21.15.16:0/3441349088 shutdown_connections 2024-08-01T06:57:01.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.173+0000 7ffa5094d640 1 --2- 172.21.15.16:0/3441349088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa4c100d90 0x7ffa4c101210 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.173+0000 7ffa5094d640 1 --2- 172.21.15.16:0/3441349088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa4c0ffb90 0x7ffa4c0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.173+0000 7ffa5094d640 1 -- 172.21.15.16:0/3441349088 >> 172.21.15.16:0/3441349088 conn(0x7ffa4c0fb360 msgr2=0x7ffa4c0fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:01.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.173+0000 7ffa5094d640 1 -- 172.21.15.16:0/3441349088 shutdown_connections 2024-08-01T06:57:01.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.173+0000 7ffa5094d640 1 -- 172.21.15.16:0/3441349088 wait complete. 2024-08-01T06:57:01.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.174+0000 7ffa5094d640 1 Processor -- start 2024-08-01T06:57:01.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.174+0000 7ffa5094d640 1 -- start start 2024-08-01T06:57:01.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.174+0000 7ffa5094d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa4c0ffb90 0x7ffa4c074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:01.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.174+0000 7ffa5094d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa4c100d90 0x7ffa4c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:01.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.174+0000 7ffa5094d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c072de0 con 0x7ffa4c0ffb90 2024-08-01T06:57:01.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.174+0000 7ffa5094d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c072f50 con 0x7ffa4c100d90 2024-08-01T06:57:01.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.174+0000 7ffa4a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa4c0ffb90 0x7ffa4c074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:01.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.174+0000 7ffa4a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa4c0ffb90 0x7ffa4c074200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57480/0 (socket says 172.21.15.16:57480) 2024-08-01T06:57:01.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.174+0000 7ffa4a59c640 1 -- 172.21.15.16:0/717557185 learned_addr learned my addr 172.21.15.16:0/717557185 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:57:01.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.174+0000 7ffa49d9b640 1 --2- 172.21.15.16:0/717557185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa4c100d90 0x7ffa4c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:01.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.175+0000 7ffa4a59c640 1 -- 172.21.15.16:0/717557185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa4c100d90 msgr2=0x7ffa4c0728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:01.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.175+0000 7ffa4a59c640 1 --2- 172.21.15.16:0/717557185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa4c100d90 0x7ffa4c0728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.175+0000 7ffa4a59c640 1 -- 172.21.15.16:0/717557185 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c009490 con 0x7ffa4c0ffb90 2024-08-01T06:57:01.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.175+0000 7ffa4a59c640 1 --2- 172.21.15.16:0/717557185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa4c0ffb90 0x7ffa4c074200 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c00e940 tx=0x7ffa3c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:01.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.175+0000 7ffa3b7fe640 1 -- 172.21.15.16:0/717557185 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa3c00cd50 con 0x7ffa4c0ffb90 2024-08-01T06:57:01.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.175+0000 7ffa3b7fe640 1 -- 172.21.15.16:0/717557185 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa3c0108f0 con 0x7ffa4c0ffb90 2024-08-01T06:57:01.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.175+0000 7ffa3b7fe640 1 -- 172.21.15.16:0/717557185 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa3c018940 con 0x7ffa4c0ffb90 2024-08-01T06:57:01.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.175+0000 7ffa5094d640 1 -- 172.21.15.16:0/717557185 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa40009560 con 0x7ffa4c0ffb90 2024-08-01T06:57:01.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.175+0000 7ffa5094d640 1 -- 172.21.15.16:0/717557185 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4c073640 con 0x7ffa4c0ffb90 2024-08-01T06:57:01.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.177+0000 7ffa5094d640 1 -- 172.21.15.16:0/717557185 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa4c073170 con 0x7ffa4c0ffb90 2024-08-01T06:57:01.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.177+0000 7ffa3b7fe640 1 -- 172.21.15.16:0/717557185 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) v1 ==== 91559+0+0 (secure 0 0 0) 0x7ffa3c018b80 con 0x7ffa4c0ffb90 2024-08-01T06:57:01.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.178+0000 7ffa3b7fe640 1 --2- 172.21.15.16:0/717557185 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7ffa3406d660 0x7ffa3406fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:01.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.178+0000 7ffa3b7fe640 1 -- 172.21.15.16:0/717557185 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ffa3c014070 con 0x7ffa4c0ffb90 2024-08-01T06:57:01.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.178+0000 7ffa49d9b640 1 --2- 172.21.15.16:0/717557185 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7ffa3406d660 0x7ffa3406fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:01.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.179+0000 7ffa49d9b640 1 --2- 172.21.15.16:0/717557185 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7ffa3406d660 0x7ffa3406fb20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffa40000c00 tx=0x7ffa400314e0 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:01.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.188+0000 7ffa3b7fe640 1 -- 172.21.15.16:0/717557185 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7ffa3c056fb0 con 0x7ffa4c0ffb90 2024-08-01T06:57:01.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.413+0000 7ffa3b7fe640 1 -- 172.21.15.16:0/717557185 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mgrmap(e 25) v1 ==== 92166+0+0 (secure 0 0 0) 0x7ffa3c08bd20 con 0x7ffa4c0ffb90 2024-08-01T06:57:01.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.514+0000 7ffa5094d640 1 -- 172.21.15.16:0/717557185 --> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa4c0608f0 con 0x7ffa3406d660 2024-08-01T06:57:01.516 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:01 smithi016 ceph-mon[29266]: Standby manager daemon smithi016.whigbo restarted 2024-08-01T06:57:01.516 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:01 smithi016 ceph-mon[29266]: Standby manager daemon smithi016.whigbo started 2024-08-01T06:57:01.516 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:01 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi016.whigbo/crt"}]: dispatch 2024-08-01T06:57:01.516 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:01 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-01T06:57:01.516 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:01 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi016.whigbo/key"}]: dispatch 2024-08-01T06:57:01.516 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:01 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-01T06:57:01.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.515+0000 7ffa3b7fe640 1 -- 172.21.15.16:0/717557185 <== mgr.24423 v2:172.21.15.89:6828/2589785296 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7ffa4c0608f0 con 0x7ffa3406d660 2024-08-01T06:57:01.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.520+0000 7ffa5094d640 1 -- 172.21.15.16:0/717557185 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7ffa3406d660 msgr2=0x7ffa3406fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:01.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.520+0000 7ffa5094d640 1 --2- 172.21.15.16:0/717557185 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7ffa3406d660 0x7ffa3406fb20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffa40000c00 tx=0x7ffa400314e0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.520+0000 7ffa5094d640 1 -- 172.21.15.16:0/717557185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa4c0ffb90 msgr2=0x7ffa4c074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:01.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.520+0000 7ffa5094d640 1 --2- 172.21.15.16:0/717557185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa4c0ffb90 0x7ffa4c074200 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c00e940 tx=0x7ffa3c00ee00 comp rx=0 tx=0).stop 2024-08-01T06:57:01.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.520+0000 7ffa5094d640 1 -- 172.21.15.16:0/717557185 shutdown_connections 2024-08-01T06:57:01.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.520+0000 7ffa5094d640 1 --2- 172.21.15.16:0/717557185 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7ffa3406d660 0x7ffa3406fb20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.520+0000 7ffa5094d640 1 --2- 172.21.15.16:0/717557185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa4c100d90 0x7ffa4c0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.520+0000 7ffa5094d640 1 --2- 172.21.15.16:0/717557185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa4c0ffb90 0x7ffa4c074200 secure :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c00e940 tx=0x7ffa3c00ee00 comp rx=0 tx=0).stop 2024-08-01T06:57:01.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.520+0000 7ffa5094d640 1 -- 172.21.15.16:0/717557185 >> 172.21.15.16:0/717557185 conn(0x7ffa4c0fb360 msgr2=0x7ffa4c104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:01.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.521+0000 7ffa5094d640 1 -- 172.21.15.16:0/717557185 shutdown_connections 2024-08-01T06:57:01.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.521+0000 7ffa5094d640 1 -- 172.21.15.16:0/717557185 wait complete. 2024-08-01T06:57:01.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.628+0000 7fd6a4af3640 1 -- 172.21.15.16:0/1432108260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6a00ffb90 msgr2=0x7fd6a00fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:01.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.628+0000 7fd6a4af3640 1 --2- 172.21.15.16:0/1432108260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6a00ffb90 0x7fd6a00fff90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd690009880 tx=0x7fd69002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.628+0000 7fd6a4af3640 1 -- 172.21.15.16:0/1432108260 shutdown_connections 2024-08-01T06:57:01.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.628+0000 7fd6a4af3640 1 --2- 172.21.15.16:0/1432108260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6a0100d90 0x7fd6a0101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.628+0000 7fd6a4af3640 1 --2- 172.21.15.16:0/1432108260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6a00ffb90 0x7fd6a00fff90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.628+0000 7fd6a4af3640 1 -- 172.21.15.16:0/1432108260 >> 172.21.15.16:0/1432108260 conn(0x7fd6a00fb360 msgr2=0x7fd6a00fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:01.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.628+0000 7fd6a4af3640 1 -- 172.21.15.16:0/1432108260 shutdown_connections 2024-08-01T06:57:01.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.628+0000 7fd6a4af3640 1 -- 172.21.15.16:0/1432108260 wait complete. 2024-08-01T06:57:01.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.629+0000 7fd6a4af3640 1 Processor -- start 2024-08-01T06:57:01.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.629+0000 7fd6a4af3640 1 -- start start 2024-08-01T06:57:01.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.630+0000 7fd6a4af3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6a00ffb90 0x7fd6a0195410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:01.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.630+0000 7fd6a4af3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6a0100d90 0x7fd6a0195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:01.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.630+0000 7fd6a4af3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a0195f20 con 0x7fd6a00ffb90 2024-08-01T06:57:01.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.630+0000 7fd6a4af3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a0196090 con 0x7fd6a0100d90 2024-08-01T06:57:01.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.630+0000 7fd69e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6a00ffb90 0x7fd6a0195410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:01.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.630+0000 7fd69e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6a00ffb90 0x7fd6a0195410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57496/0 (socket says 172.21.15.16:57496) 2024-08-01T06:57:01.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.630+0000 7fd69e59c640 1 -- 172.21.15.16:0/3515417644 learned_addr learned my addr 172.21.15.16:0/3515417644 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:57:01.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.630+0000 7fd69dd9b640 1 --2- 172.21.15.16:0/3515417644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6a0100d90 0x7fd6a0195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:01.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.630+0000 7fd69dd9b640 1 -- 172.21.15.16:0/3515417644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6a00ffb90 msgr2=0x7fd6a0195410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:01.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.630+0000 7fd69dd9b640 1 --2- 172.21.15.16:0/3515417644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6a00ffb90 0x7fd6a0195410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.630+0000 7fd69dd9b640 1 -- 172.21.15.16:0/3515417644 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd690009560 con 0x7fd6a0100d90 2024-08-01T06:57:01.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.630+0000 7fd69e59c640 1 --2- 172.21.15.16:0/3515417644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6a00ffb90 0x7fd6a0195410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T06:57:01.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.631+0000 7fd69dd9b640 1 --2- 172.21.15.16:0/3515417644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6a0100d90 0x7fd6a0195950 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd69400e970 tx=0x7fd69400ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:01.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.631+0000 7fd68f7fe640 1 -- 172.21.15.16:0/3515417644 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd694009620 con 0x7fd6a0100d90 2024-08-01T06:57:01.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.631+0000 7fd68f7fe640 1 -- 172.21.15.16:0/3515417644 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6940044f0 con 0x7fd6a0100d90 2024-08-01T06:57:01.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.631+0000 7fd68f7fe640 1 -- 172.21.15.16:0/3515417644 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6940049d0 con 0x7fd6a0100d90 2024-08-01T06:57:01.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.631+0000 7fd6a4af3640 1 -- 172.21.15.16:0/3515417644 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a019ab30 con 0x7fd6a0100d90 2024-08-01T06:57:01.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.631+0000 7fd6a4af3640 1 -- 172.21.15.16:0/3515417644 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a019b0a0 con 0x7fd6a0100d90 2024-08-01T06:57:01.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.632+0000 7fd68d7fa640 1 -- 172.21.15.16:0/3515417644 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd684005250 con 0x7fd6a0100d90 2024-08-01T06:57:01.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.633+0000 7fd68f7fe640 1 -- 172.21.15.16:0/3515417644 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 92166+0+0 (secure 0 0 0) 0x7fd69400cc90 con 0x7fd6a0100d90 2024-08-01T06:57:01.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.633+0000 7fd68f7fe640 1 --2- 172.21.15.16:0/3515417644 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fd68806df30 0x7fd6880703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:01.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.633+0000 7fd68f7fe640 1 -- 172.21.15.16:0/3515417644 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd694014070 con 0x7fd6a0100d90 2024-08-01T06:57:01.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.633+0000 7fd69e59c640 1 --2- 172.21.15.16:0/3515417644 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fd68806df30 0x7fd6880703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:01.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.634+0000 7fd69e59c640 1 --2- 172.21.15.16:0/3515417644 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fd68806df30 0x7fd6880703f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd690009230 tx=0x7fd69000b040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:01.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.638+0000 7fd68f7fe640 1 -- 172.21.15.16:0/3515417644 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fd694057730 con 0x7fd6a0100d90 2024-08-01T06:57:01.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.872+0000 7fd68d7fa640 1 -- 172.21.15.16:0/3515417644 --> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd684000bc0 con 0x7fd68806df30 2024-08-01T06:57:01.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.882+0000 7fd68f7fe640 1 -- 172.21.15.16:0/3515417644 <== mgr.24423 v2:172.21.15.89:6828/2589785296 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd684000bc0 con 0x7fd68806df30 2024-08-01T06:57:01.883 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T06:57:01.883 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (7m) 2s ago 9m 25.4M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T06:57:01.884 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (9m) 2s ago 9m 8032k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T06:57:01.884 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (8m) 68s ago 8m 7818k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T06:57:01.884 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (9m) 2s ago 9m 6895k - 18.2.2-1767-ga3bbd728 d280790d1980 81c723a6ae35 2024-08-01T06:57:01.884 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (8m) 68s ago 8m 6891k - 18.2.2-1767-ga3bbd728 d280790d1980 73e7778d1e26 2024-08-01T06:57:01.884 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (7m) 2s ago 8m 84.7M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T06:57:01.884 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (3m) 2s ago 3m 140M - 18.2.2-1767-ga3bbd728 d280790d1980 96e46c28d16c 2024-08-01T06:57:01.884 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (3m) 2s ago 3m 210M - 18.2.2-1767-ga3bbd728 d280790d1980 4bbe1a388689 2024-08-01T06:57:01.884 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (3m) 68s ago 3m 21.5M - 18.2.2-1767-ga3bbd728 d280790d1980 65ca121a6fbb 2024-08-01T06:57:01.884 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (3m) 68s ago 3m 20.7M - 18.2.2-1767-ga3bbd728 d280790d1980 05bb46c6fe94 2024-08-01T06:57:01.884 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:8443,9283,8765 running (8s) 2s ago 10m 56.0M - 19.1.0-1223-gf9911e17 93d93c74a2cc 8701e6315593 2024-08-01T06:57:01.884 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (94s) 68s ago 8m 476M - 19.1.0-1223-gf9911e17 93d93c74a2cc 175fc6a24b65 2024-08-01T06:57:01.884 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (10m) 2s ago 10m 54.9M 2048M 18.2.2-1767-ga3bbd728 d280790d1980 e6a2e5d7eeec 2024-08-01T06:57:01.884 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (8m) 68s ago 8m 42.9M 2048M 18.2.2-1767-ga3bbd728 d280790d1980 9ca9e3e814cb 2024-08-01T06:57:01.884 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (9m) 2s ago 9m 16.0M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T06:57:01.884 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (8m) 68s ago 8m 16.5M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T06:57:01.885 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (7m) 2s ago 7m 208M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 9b7157499583 2024-08-01T06:57:01.885 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (6m) 2s ago 6m 214M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 f3b050aed6b7 2024-08-01T06:57:01.885 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (6m) 2s ago 6m 183M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 33a72e1a5c91 2024-08-01T06:57:01.885 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (6m) 68s ago 6m 125M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 58c175e0f4eb 2024-08-01T06:57:01.885 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (5m) 68s ago 5m 123M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 15b8f910bad7 2024-08-01T06:57:01.885 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (5m) 68s ago 5m 116M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 ac887841899e 2024-08-01T06:57:01.885 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (17s) 2s ago 8m 38.3M - 2.43.0 a07b618ecd1d 10b16eee965a 2024-08-01T06:57:01.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.884+0000 7fd68d7fa640 1 -- 172.21.15.16:0/3515417644 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fd68806df30 msgr2=0x7fd6880703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:01.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.884+0000 7fd68d7fa640 1 --2- 172.21.15.16:0/3515417644 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fd68806df30 0x7fd6880703f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd690009230 tx=0x7fd69000b040 comp rx=0 tx=0).stop 2024-08-01T06:57:01.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.884+0000 7fd68d7fa640 1 -- 172.21.15.16:0/3515417644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6a0100d90 msgr2=0x7fd6a0195950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:01.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.884+0000 7fd68d7fa640 1 --2- 172.21.15.16:0/3515417644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6a0100d90 0x7fd6a0195950 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd69400e970 tx=0x7fd69400ee30 comp rx=0 tx=0).stop 2024-08-01T06:57:01.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.884+0000 7fd68d7fa640 1 -- 172.21.15.16:0/3515417644 shutdown_connections 2024-08-01T06:57:01.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.884+0000 7fd68d7fa640 1 --2- 172.21.15.16:0/3515417644 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fd68806df30 0x7fd6880703f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.884+0000 7fd68d7fa640 1 --2- 172.21.15.16:0/3515417644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6a0100d90 0x7fd6a0195950 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.884+0000 7fd68d7fa640 1 --2- 172.21.15.16:0/3515417644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6a00ffb90 0x7fd6a0195410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.884+0000 7fd68d7fa640 1 -- 172.21.15.16:0/3515417644 >> 172.21.15.16:0/3515417644 conn(0x7fd6a00fb360 msgr2=0x7fd6a00fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:01.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.884+0000 7fd68d7fa640 1 -- 172.21.15.16:0/3515417644 shutdown_connections 2024-08-01T06:57:01.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.884+0000 7fd68d7fa640 1 -- 172.21.15.16:0/3515417644 wait complete. 2024-08-01T06:57:01.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:01 smithi089 ceph-mon[36617]: Standby manager daemon smithi016.whigbo restarted 2024-08-01T06:57:01.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:01 smithi089 ceph-mon[36617]: Standby manager daemon smithi016.whigbo started 2024-08-01T06:57:01.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:01 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi016.whigbo/crt"}]: dispatch 2024-08-01T06:57:01.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:01 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-01T06:57:01.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:01 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi016.whigbo/key"}]: dispatch 2024-08-01T06:57:01.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:01 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-01T06:57:01.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.977+0000 7efdd85b5640 1 -- 172.21.15.16:0/120666635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdd0100680 msgr2=0x7efdd0102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:01.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.977+0000 7efdd85b5640 1 --2- 172.21.15.16:0/120666635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdd0100680 0x7efdd0102a70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0098b0 tx=0x7efdcc02a4d0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.977+0000 7efdd85b5640 1 -- 172.21.15.16:0/120666635 shutdown_connections 2024-08-01T06:57:01.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.977+0000 7efdd85b5640 1 --2- 172.21.15.16:0/120666635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdd0102fb0 0x7efdd01053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.977+0000 7efdd85b5640 1 --2- 172.21.15.16:0/120666635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdd0100680 0x7efdd0102a70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.977+0000 7efdd85b5640 1 -- 172.21.15.16:0/120666635 >> 172.21.15.16:0/120666635 conn(0x7efdd00fa280 msgr2=0x7efdd00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:01.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.977+0000 7efdd85b5640 1 -- 172.21.15.16:0/120666635 shutdown_connections 2024-08-01T06:57:01.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.977+0000 7efdd85b5640 1 -- 172.21.15.16:0/120666635 wait complete. 2024-08-01T06:57:01.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.978+0000 7efdd85b5640 1 Processor -- start 2024-08-01T06:57:01.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.978+0000 7efdd85b5640 1 -- start start 2024-08-01T06:57:01.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.978+0000 7efdd85b5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdd0100680 0x7efdd01956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:01.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.978+0000 7efdd85b5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdd0102fb0 0x7efdd0195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:01.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.978+0000 7efdd85b5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd0196200 con 0x7efdd0100680 2024-08-01T06:57:01.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.978+0000 7efdd85b5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd0196370 con 0x7efdd0102fb0 2024-08-01T06:57:01.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.978+0000 7efdd6351640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdd0100680 0x7efdd01956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:01.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.978+0000 7efdd6351640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdd0100680 0x7efdd01956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57508/0 (socket says 172.21.15.16:57508) 2024-08-01T06:57:01.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.979+0000 7efdd6351640 1 -- 172.21.15.16:0/1754317144 learned_addr learned my addr 172.21.15.16:0/1754317144 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:57:01.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.979+0000 7efdd5b50640 1 --2- 172.21.15.16:0/1754317144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdd0102fb0 0x7efdd0195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:01.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.979+0000 7efdd6351640 1 -- 172.21.15.16:0/1754317144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdd0102fb0 msgr2=0x7efdd0195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:01.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.979+0000 7efdd6351640 1 --2- 172.21.15.16:0/1754317144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdd0102fb0 0x7efdd0195c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:01.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.979+0000 7efdd6351640 1 -- 172.21.15.16:0/1754317144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc009560 con 0x7efdd0100680 2024-08-01T06:57:01.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.979+0000 7efdd6351640 1 --2- 172.21.15.16:0/1754317144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdd0100680 0x7efdd01956f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0054f0 tx=0x7efdcc005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:01.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.979+0000 7efdc77fe640 1 -- 172.21.15.16:0/1754317144 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdcc004aa0 con 0x7efdd0100680 2024-08-01T06:57:01.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.979+0000 7efdc77fe640 1 -- 172.21.15.16:0/1754317144 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efdcc004c00 con 0x7efdd0100680 2024-08-01T06:57:01.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.979+0000 7efdd85b5640 1 -- 172.21.15.16:0/1754317144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd019adb0 con 0x7efdd0100680 2024-08-01T06:57:01.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.979+0000 7efdc77fe640 1 -- 172.21.15.16:0/1754317144 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdcc003b10 con 0x7efdd0100680 2024-08-01T06:57:01.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.979+0000 7efdd85b5640 1 -- 172.21.15.16:0/1754317144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd019b240 con 0x7efdd0100680 2024-08-01T06:57:01.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.981+0000 7efdd85b5640 1 -- 172.21.15.16:0/1754317144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd0108810 con 0x7efdd0100680 2024-08-01T06:57:01.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.982+0000 7efdc77fe640 1 -- 172.21.15.16:0/1754317144 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) v1 ==== 92166+0+0 (secure 0 0 0) 0x7efdcc003d80 con 0x7efdd0100680 2024-08-01T06:57:01.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.982+0000 7efdc77fe640 1 --2- 172.21.15.16:0/1754317144 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7efdbc06df30 0x7efdbc0703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:01.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.982+0000 7efdc77fe640 1 -- 172.21.15.16:0/1754317144 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7efdcc0aed30 con 0x7efdd0100680 2024-08-01T06:57:01.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.983+0000 7efdd5b50640 1 --2- 172.21.15.16:0/1754317144 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7efdbc06df30 0x7efdbc0703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:01.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.983+0000 7efdd5b50640 1 --2- 172.21.15.16:0/1754317144 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7efdbc06df30 0x7efdbc0703f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efdd0196c10 tx=0x7efdc000b390 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:01.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:01.988+0000 7efdc77fe640 1 -- 172.21.15.16:0/1754317144 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7efdcc0785a0 con 0x7efdd0100680 2024-08-01T06:57:02.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.306+0000 7efdd85b5640 1 -- 172.21.15.16:0/1754317144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efdd019b820 con 0x7efdd0100680 2024-08-01T06:57:02.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.307+0000 7efdc77fe640 1 -- 172.21.15.16:0/1754317144 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7efdcc0402f0 con 0x7efdd0100680 2024-08-01T06:57:02.309 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:57:02.309 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T06:57:02.309 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 2 2024-08-01T06:57:02.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:57:02.309 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T06:57:02.309 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T06:57:02.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:57:02.309 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T06:57:02.309 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 6 2024-08-01T06:57:02.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:57:02.309 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T06:57:02.309 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4 2024-08-01T06:57:02.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:57:02.310 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T06:57:02.310 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 12, 2024-08-01T06:57:02.310 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T06:57:02.310 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T06:57:02.310 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:57:02.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.309+0000 7efdd85b5640 1 -- 172.21.15.16:0/1754317144 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7efdbc06df30 msgr2=0x7efdbc0703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:02.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.309+0000 7efdd85b5640 1 --2- 172.21.15.16:0/1754317144 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7efdbc06df30 0x7efdbc0703f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efdd0196c10 tx=0x7efdc000b390 comp rx=0 tx=0).stop 2024-08-01T06:57:02.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.309+0000 7efdd85b5640 1 -- 172.21.15.16:0/1754317144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdd0100680 msgr2=0x7efdd01956f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:02.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.309+0000 7efdd85b5640 1 --2- 172.21.15.16:0/1754317144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdd0100680 0x7efdd01956f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0054f0 tx=0x7efdcc005520 comp rx=0 tx=0).stop 2024-08-01T06:57:02.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.309+0000 7efdd85b5640 1 -- 172.21.15.16:0/1754317144 shutdown_connections 2024-08-01T06:57:02.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.309+0000 7efdd85b5640 1 --2- 172.21.15.16:0/1754317144 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7efdbc06df30 0x7efdbc0703f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:02.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.309+0000 7efdd85b5640 1 --2- 172.21.15.16:0/1754317144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdd0102fb0 0x7efdd0195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:02.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.309+0000 7efdd85b5640 1 --2- 172.21.15.16:0/1754317144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdd0100680 0x7efdd01956f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:02.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.309+0000 7efdd85b5640 1 -- 172.21.15.16:0/1754317144 >> 172.21.15.16:0/1754317144 conn(0x7efdd00fa280 msgr2=0x7efdd00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:02.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.309+0000 7efdd85b5640 1 -- 172.21.15.16:0/1754317144 shutdown_connections 2024-08-01T06:57:02.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.309+0000 7efdd85b5640 1 -- 172.21.15.16:0/1754317144 wait complete. 2024-08-01T06:57:02.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.410+0000 7fb28b882640 1 -- 172.21.15.16:0/2130106606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2840feaf0 msgr2=0x7fb2840feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:02.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.410+0000 7fb28b882640 1 --2- 172.21.15.16:0/2130106606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2840feaf0 0x7fb2840feef0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb280009880 tx=0x7fb28002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:57:02.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.410+0000 7fb28b882640 1 -- 172.21.15.16:0/2130106606 shutdown_connections 2024-08-01T06:57:02.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.410+0000 7fb28b882640 1 --2- 172.21.15.16:0/2130106606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2840ffcf0 0x7fb284100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:02.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.410+0000 7fb28b882640 1 --2- 172.21.15.16:0/2130106606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2840feaf0 0x7fb2840feef0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:02.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.410+0000 7fb28b882640 1 -- 172.21.15.16:0/2130106606 >> 172.21.15.16:0/2130106606 conn(0x7fb2840fa280 msgr2=0x7fb2840fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:02.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.411+0000 7fb28b882640 1 -- 172.21.15.16:0/2130106606 shutdown_connections 2024-08-01T06:57:02.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.411+0000 7fb28b882640 1 -- 172.21.15.16:0/2130106606 wait complete. 2024-08-01T06:57:02.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.412+0000 7fb28b882640 1 Processor -- start 2024-08-01T06:57:02.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.412+0000 7fb28b882640 1 -- start start 2024-08-01T06:57:02.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.412+0000 7fb28b882640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2840feaf0 0x7fb2840687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:02.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.412+0000 7fb28b882640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2840ffcf0 0x7fb28419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:02.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.412+0000 7fb28b882640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28419a950 con 0x7fb2840feaf0 2024-08-01T06:57:02.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.412+0000 7fb28b882640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28419aac0 con 0x7fb2840ffcf0 2024-08-01T06:57:02.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.412+0000 7fb28961e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2840feaf0 0x7fb2840687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:02.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.412+0000 7fb28961e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2840feaf0 0x7fb2840687d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57526/0 (socket says 172.21.15.16:57526) 2024-08-01T06:57:02.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.412+0000 7fb28961e640 1 -- 172.21.15.16:0/149427790 learned_addr learned my addr 172.21.15.16:0/149427790 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:57:02.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.412+0000 7fb288e1d640 1 --2- 172.21.15.16:0/149427790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2840ffcf0 0x7fb28419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:02.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.412+0000 7fb28961e640 1 -- 172.21.15.16:0/149427790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2840ffcf0 msgr2=0x7fb28419a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:02.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.413+0000 7fb28961e640 1 --2- 172.21.15.16:0/149427790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2840ffcf0 0x7fb28419a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:02.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.413+0000 7fb28961e640 1 -- 172.21.15.16:0/149427790 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb274009490 con 0x7fb2840feaf0 2024-08-01T06:57:02.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.413+0000 7fb288e1d640 1 --2- 172.21.15.16:0/149427790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2840ffcf0 0x7fb28419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T06:57:02.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.413+0000 7fb28961e640 1 --2- 172.21.15.16:0/149427790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2840feaf0 0x7fb2840687d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb28002a9c0 tx=0x7fb2800055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:02.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.413+0000 7fb27a7fc640 1 -- 172.21.15.16:0/149427790 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb280004aa0 con 0x7fb2840feaf0 2024-08-01T06:57:02.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.413+0000 7fb27a7fc640 1 -- 172.21.15.16:0/149427790 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb280005d50 con 0x7fb2840feaf0 2024-08-01T06:57:02.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.413+0000 7fb28b882640 1 -- 172.21.15.16:0/149427790 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb280009560 con 0x7fb2840feaf0 2024-08-01T06:57:02.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.413+0000 7fb27a7fc640 1 -- 172.21.15.16:0/149427790 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2800039e0 con 0x7fb2840feaf0 2024-08-01T06:57:02.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.413+0000 7fb28b882640 1 -- 172.21.15.16:0/149427790 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28419b0a0 con 0x7fb2840feaf0 2024-08-01T06:57:02.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.414+0000 7fb28b882640 1 -- 172.21.15.16:0/149427790 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb28418e670 con 0x7fb2840feaf0 2024-08-01T06:57:02.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.415+0000 7fb27a7fc640 1 -- 172.21.15.16:0/149427790 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) v1 ==== 92166+0+0 (secure 0 0 0) 0x7fb280031c00 con 0x7fb2840feaf0 2024-08-01T06:57:02.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.416+0000 7fb27a7fc640 1 --2- 172.21.15.16:0/149427790 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fb27006df30 0x7fb2700703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:02.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.416+0000 7fb27a7fc640 1 -- 172.21.15.16:0/149427790 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb2800aed80 con 0x7fb2840feaf0 2024-08-01T06:57:02.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.416+0000 7fb288e1d640 1 --2- 172.21.15.16:0/149427790 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fb27006df30 0x7fb2700703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:02.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.417+0000 7fb288e1d640 1 --2- 172.21.15.16:0/149427790 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fb27006df30 0x7fb2700703f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb284068550 tx=0x7fb274005f90 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:02.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.421+0000 7fb27a7fc640 1 -- 172.21.15.16:0/149427790 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fb280078570 con 0x7fb2840feaf0 2024-08-01T06:57:02.527 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:02 smithi016 ceph-mon[29266]: from='client.24505 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:57:02.527 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:02 smithi016 ceph-mon[29266]: mgrmap e25: smithi089.hfgnsr(active, since 83s), standbys: smithi016.whigbo 2024-08-01T06:57:02.527 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:02 smithi016 ceph-mon[29266]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:57:02.527 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:02 smithi016 ceph-mon[29266]: pgmap v45: 65 pgs: 65 active+clean; 1.5 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 302 op/s 2024-08-01T06:57:02.527 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:02 smithi016 ceph-mon[29266]: from='client.24513 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:57:02.528 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:02 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/1754317144' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:57:02.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.772+0000 7fb28b882640 1 -- 172.21.15.16:0/149427790 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb2841078a0 con 0x7fb2840feaf0 2024-08-01T06:57:02.774 INFO:teuthology.orchestra.run.smithi016.stdout:e19 2024-08-01T06:57:02.774 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T06:57:02.774 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:57:02.774 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T06:57:02.774 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:57:02.774 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T06:57:02.775 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T06:57:02.775 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 19 2024-08-01T06:57:02.775 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T06:57:02.775 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T06:57:02.775 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T06:53:32.617145+0000 2024-08-01T06:57:02.775 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T06:57:02.775 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T06:57:02.775 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T06:57:02.775 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T06:57:02.775 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T06:57:02.775 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T06:57:02.775 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T06:57:02.775 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T06:57:02.776 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 46 2024-08-01T06:57:02.776 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:57:02.776 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T06:57:02.776 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T06:57:02.776 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=14482,1=24281} 2024-08-01T06:57:02.776 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T06:57:02.776 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T06:57:02.776 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T06:57:02.776 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T06:57:02.776 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T06:57:02.776 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T06:57:02.776 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T06:57:02.776 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T06:57:02.777 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T06:57:02.777 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:57:02.777 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:24299} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:57:02.777 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{1:24281} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:57:02.777 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:24291} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:57:02.777 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:57:02.777 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:57:02.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.772+0000 7fb27a7fc640 1 -- 172.21.15.16:0/149427790 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1868 (secure 0 0 0) 0x7fb28007bc30 con 0x7fb2840feaf0 2024-08-01T06:57:02.778 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-08-01T06:57:02.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.775+0000 7fb28b882640 1 -- 172.21.15.16:0/149427790 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fb27006df30 msgr2=0x7fb2700703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:02.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.775+0000 7fb28b882640 1 --2- 172.21.15.16:0/149427790 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fb27006df30 0x7fb2700703f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb284068550 tx=0x7fb274005f90 comp rx=0 tx=0).stop 2024-08-01T06:57:02.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.776+0000 7fb28b882640 1 -- 172.21.15.16:0/149427790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2840feaf0 msgr2=0x7fb2840687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:02.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.776+0000 7fb28b882640 1 --2- 172.21.15.16:0/149427790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2840feaf0 0x7fb2840687d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb28002a9c0 tx=0x7fb2800055a0 comp rx=0 tx=0).stop 2024-08-01T06:57:02.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.776+0000 7fb28b882640 1 -- 172.21.15.16:0/149427790 shutdown_connections 2024-08-01T06:57:02.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.776+0000 7fb28b882640 1 --2- 172.21.15.16:0/149427790 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7fb27006df30 0x7fb2700703f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:02.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.776+0000 7fb28b882640 1 --2- 172.21.15.16:0/149427790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2840ffcf0 0x7fb28419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:02.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.776+0000 7fb28b882640 1 --2- 172.21.15.16:0/149427790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2840feaf0 0x7fb2840687d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:02.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.776+0000 7fb28b882640 1 -- 172.21.15.16:0/149427790 >> 172.21.15.16:0/149427790 conn(0x7fb2840fa280 msgr2=0x7fb284103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:02.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.776+0000 7fb28b882640 1 -- 172.21.15.16:0/149427790 shutdown_connections 2024-08-01T06:57:02.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.776+0000 7fb28b882640 1 -- 172.21.15.16:0/149427790 wait complete. 2024-08-01T06:57:02.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:02 smithi089 ceph-mon[36617]: from='client.24505 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:57:02.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:02 smithi089 ceph-mon[36617]: mgrmap e25: smithi089.hfgnsr(active, since 83s), standbys: smithi016.whigbo 2024-08-01T06:57:02.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:02 smithi089 ceph-mon[36617]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:57:02.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:02 smithi089 ceph-mon[36617]: pgmap v45: 65 pgs: 65 active+clean; 1.5 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 302 op/s 2024-08-01T06:57:02.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:02 smithi089 ceph-mon[36617]: from='client.24513 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:57:02.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:02 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/1754317144' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:57:02.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.893+0000 7f9ed4947640 1 -- 172.21.15.16:0/2648962327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ed00fee10 msgr2=0x7f9ed00ff270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:02.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.893+0000 7f9ed4947640 1 --2- 172.21.15.16:0/2648962327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ed00fee10 0x7f9ed00ff270 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40097e0 tx=0x7f9ec402a3f0 comp rx=0 tx=0).stop 2024-08-01T06:57:02.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.894+0000 7f9ed4947640 1 -- 172.21.15.16:0/2648962327 shutdown_connections 2024-08-01T06:57:02.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.894+0000 7f9ed4947640 1 --2- 172.21.15.16:0/2648962327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ed00fee10 0x7f9ed00ff270 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:02.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.894+0000 7f9ed4947640 1 --2- 172.21.15.16:0/2648962327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ed00fe4d0 0x7f9ed00fe8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:02.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.894+0000 7f9ed4947640 1 -- 172.21.15.16:0/2648962327 >> 172.21.15.16:0/2648962327 conn(0x7f9ed00fa280 msgr2=0x7f9ed00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:02.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.894+0000 7f9ed4947640 1 -- 172.21.15.16:0/2648962327 shutdown_connections 2024-08-01T06:57:02.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.894+0000 7f9ed4947640 1 -- 172.21.15.16:0/2648962327 wait complete. 2024-08-01T06:57:02.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.895+0000 7f9ed4947640 1 Processor -- start 2024-08-01T06:57:02.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.895+0000 7f9ed4947640 1 -- start start 2024-08-01T06:57:02.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.895+0000 7f9ed4947640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ed00fe4d0 0x7f9ed0197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:02.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.895+0000 7f9ed4947640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ed00fee10 0x7f9ed0197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:02.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.895+0000 7f9ed4947640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed0198390 con 0x7f9ed00fee10 2024-08-01T06:57:02.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.895+0000 7f9ed4947640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed0198500 con 0x7f9ed00fe4d0 2024-08-01T06:57:02.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.895+0000 7f9ece59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ed00fe4d0 0x7f9ed0197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:02.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.895+0000 7f9ecdd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ed00fee10 0x7f9ed0197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:02.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.895+0000 7f9ece59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ed00fe4d0 0x7f9ed0197880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:49496/0 (socket says 172.21.15.16:49496) 2024-08-01T06:57:02.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.895+0000 7f9ecdd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ed00fee10 0x7f9ed0197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57538/0 (socket says 172.21.15.16:57538) 2024-08-01T06:57:02.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.896+0000 7f9ece59c640 1 -- 172.21.15.16:0/2713735189 learned_addr learned my addr 172.21.15.16:0/2713735189 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:57:02.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.896+0000 7f9ece59c640 1 -- 172.21.15.16:0/2713735189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ed00fee10 msgr2=0x7f9ed0197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:02.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.896+0000 7f9ece59c640 1 --2- 172.21.15.16:0/2713735189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ed00fee10 0x7f9ed0197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:02.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.896+0000 7f9ece59c640 1 -- 172.21.15.16:0/2713735189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec0009560 con 0x7f9ed00fe4d0 2024-08-01T06:57:02.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.896+0000 7f9ece59c640 1 --2- 172.21.15.16:0/2713735189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ed00fe4d0 0x7f9ed0197880 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000e940 tx=0x7f9ec000ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:02.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.896+0000 7f9ebf7fe640 1 -- 172.21.15.16:0/2713735189 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ec000cd50 con 0x7f9ed00fe4d0 2024-08-01T06:57:02.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.896+0000 7f9ed4947640 1 -- 172.21.15.16:0/2713735189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec4009490 con 0x7f9ed00fe4d0 2024-08-01T06:57:02.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.896+0000 7f9ed4947640 1 -- 172.21.15.16:0/2713735189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed019d290 con 0x7f9ed00fe4d0 2024-08-01T06:57:02.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.897+0000 7f9ebf7fe640 1 -- 172.21.15.16:0/2713735189 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ec00188f0 con 0x7f9ed00fe4d0 2024-08-01T06:57:02.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.897+0000 7f9ebf7fe640 1 -- 172.21.15.16:0/2713735189 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ec0021800 con 0x7f9ed00fe4d0 2024-08-01T06:57:02.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.898+0000 7f9ed4947640 1 -- 172.21.15.16:0/2713735189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb0005280 con 0x7f9ed00fe4d0 2024-08-01T06:57:02.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.899+0000 7f9ebf7fe640 1 -- 172.21.15.16:0/2713735189 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 92166+0+0 (secure 0 0 0) 0x7f9ec0021960 con 0x7f9ed00fe4d0 2024-08-01T06:57:02.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.899+0000 7f9ebf7fe640 1 --2- 172.21.15.16:0/2713735189 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f9eb806df30 0x7f9eb80703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:02.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.899+0000 7f9ebf7fe640 1 -- 172.21.15.16:0/2713735189 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f9ec0014070 con 0x7f9ed00fe4d0 2024-08-01T06:57:02.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.899+0000 7f9ecdd9b640 1 --2- 172.21.15.16:0/2713735189 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f9eb806df30 0x7f9eb80703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:02.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.900+0000 7f9ecdd9b640 1 --2- 172.21.15.16:0/2713735189 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f9eb806df30 0x7f9eb80703f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0198d50 tx=0x7f9ec4030870 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:02.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:02.904+0000 7f9ebf7fe640 1 -- 172.21.15.16:0/2713735189 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f9ec005afe0 con 0x7f9ed00fe4d0 2024-08-01T06:57:03.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.157+0000 7f9ed4947640 1 -- 172.21.15.16:0/2713735189 --> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9eb0000bf0 con 0x7f9eb806df30 2024-08-01T06:57:03.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.158+0000 7f9ebf7fe640 1 -- 172.21.15.16:0/2713735189 <== mgr.24423 v2:172.21.15.89:6828/2589785296 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f9eb0000bf0 con 0x7f9eb806df30 2024-08-01T06:57:03.159 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:57:03.159 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T06:57:03.159 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T06:57:03.160 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T06:57:03.160 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-08-01T06:57:03.160 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-08-01T06:57:03.160 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-08-01T06:57:03.160 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "2/23 daemons upgraded", 2024-08-01T06:57:03.160 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading mgr daemons", 2024-08-01T06:57:03.160 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T06:57:03.160 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:57:03.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.160+0000 7f9ed4947640 1 -- 172.21.15.16:0/2713735189 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f9eb806df30 msgr2=0x7f9eb80703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:03.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.160+0000 7f9ed4947640 1 --2- 172.21.15.16:0/2713735189 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f9eb806df30 0x7f9eb80703f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0198d50 tx=0x7f9ec4030870 comp rx=0 tx=0).stop 2024-08-01T06:57:03.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.160+0000 7f9ed4947640 1 -- 172.21.15.16:0/2713735189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ed00fe4d0 msgr2=0x7f9ed0197880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:03.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.160+0000 7f9ed4947640 1 --2- 172.21.15.16:0/2713735189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ed00fe4d0 0x7f9ed0197880 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000e940 tx=0x7f9ec000ee00 comp rx=0 tx=0).stop 2024-08-01T06:57:03.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.160+0000 7f9ed4947640 1 -- 172.21.15.16:0/2713735189 shutdown_connections 2024-08-01T06:57:03.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.160+0000 7f9ed4947640 1 --2- 172.21.15.16:0/2713735189 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f9eb806df30 0x7f9eb80703f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:03.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.160+0000 7f9ed4947640 1 --2- 172.21.15.16:0/2713735189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ed00fee10 0x7f9ed0197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:03.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.160+0000 7f9ed4947640 1 --2- 172.21.15.16:0/2713735189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ed00fe4d0 0x7f9ed0197880 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:03.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.160+0000 7f9ed4947640 1 -- 172.21.15.16:0/2713735189 >> 172.21.15.16:0/2713735189 conn(0x7f9ed00fa280 msgr2=0x7f9ed0106fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:03.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.161+0000 7f9ed4947640 1 -- 172.21.15.16:0/2713735189 shutdown_connections 2024-08-01T06:57:03.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.161+0000 7f9ed4947640 1 -- 172.21.15.16:0/2713735189 wait complete. 2024-08-01T06:57:03.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.265+0000 7f96bb300640 1 -- 172.21.15.16:0/3608228917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96b4102fb0 msgr2=0x7f96b41053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:03.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.265+0000 7f96bb300640 1 --2- 172.21.15.16:0/3608228917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96b4102fb0 0x7f96b41053a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f96a40098b0 tx=0x7f96a402a4d0 comp rx=0 tx=0).stop 2024-08-01T06:57:03.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.265+0000 7f96bb300640 1 -- 172.21.15.16:0/3608228917 shutdown_connections 2024-08-01T06:57:03.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.265+0000 7f96bb300640 1 --2- 172.21.15.16:0/3608228917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96b4102fb0 0x7f96b41053a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:03.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.265+0000 7f96bb300640 1 --2- 172.21.15.16:0/3608228917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b4100680 0x7f96b4102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:03.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.265+0000 7f96bb300640 1 -- 172.21.15.16:0/3608228917 >> 172.21.15.16:0/3608228917 conn(0x7f96b40fa280 msgr2=0x7f96b40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:03.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.265+0000 7f96bb300640 1 -- 172.21.15.16:0/3608228917 shutdown_connections 2024-08-01T06:57:03.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.265+0000 7f96bb300640 1 -- 172.21.15.16:0/3608228917 wait complete. 2024-08-01T06:57:03.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.265+0000 7f96bb300640 1 Processor -- start 2024-08-01T06:57:03.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.265+0000 7f96bb300640 1 -- start start 2024-08-01T06:57:03.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.266+0000 7f96bb300640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b4100680 0x7f96b40fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:03.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.266+0000 7f96bb300640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96b4102fb0 0x7f96b40fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:03.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.266+0000 7f96bb300640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b40feb70 con 0x7f96b4102fb0 2024-08-01T06:57:03.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.266+0000 7f96bb300640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b40fece0 con 0x7f96b4100680 2024-08-01T06:57:03.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.266+0000 7f96b909c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b4100680 0x7f96b40fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:03.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.266+0000 7f96b889b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96b4102fb0 0x7f96b40fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:03.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.266+0000 7f96b909c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b4100680 0x7f96b40fffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:49510/0 (socket says 172.21.15.16:49510) 2024-08-01T06:57:03.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.266+0000 7f96b909c640 1 -- 172.21.15.16:0/630363012 learned_addr learned my addr 172.21.15.16:0/630363012 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:57:03.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.266+0000 7f96b909c640 1 -- 172.21.15.16:0/630363012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96b4102fb0 msgr2=0x7f96b40fe630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:03.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.266+0000 7f96b909c640 1 --2- 172.21.15.16:0/630363012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96b4102fb0 0x7f96b40fe630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:03.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.266+0000 7f96b909c640 1 -- 172.21.15.16:0/630363012 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a4009560 con 0x7f96b4100680 2024-08-01T06:57:03.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.266+0000 7f96b909c640 1 --2- 172.21.15.16:0/630363012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b4100680 0x7f96b40fffe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f96b000e970 tx=0x7f96b000ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:03.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.267+0000 7f96aa7fc640 1 -- 172.21.15.16:0/630363012 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96b000cc90 con 0x7f96b4100680 2024-08-01T06:57:03.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.267+0000 7f96bb300640 1 -- 172.21.15.16:0/630363012 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b40fefc0 con 0x7f96b4100680 2024-08-01T06:57:03.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.267+0000 7f96aa7fc640 1 -- 172.21.15.16:0/630363012 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f96b000cdf0 con 0x7f96b4100680 2024-08-01T06:57:03.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.267+0000 7f96aa7fc640 1 -- 172.21.15.16:0/630363012 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96b0010430 con 0x7f96b4100680 2024-08-01T06:57:03.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.267+0000 7f96bb300640 1 -- 172.21.15.16:0/630363012 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b419d780 con 0x7f96b4100680 2024-08-01T06:57:03.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.268+0000 7f96bb300640 1 -- 172.21.15.16:0/630363012 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b4109160 con 0x7f96b4100680 2024-08-01T06:57:03.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.269+0000 7f96aa7fc640 1 -- 172.21.15.16:0/630363012 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 92166+0+0 (secure 0 0 0) 0x7f96b0004f70 con 0x7f96b4100680 2024-08-01T06:57:03.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.269+0000 7f96aa7fc640 1 --2- 172.21.15.16:0/630363012 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f96a006df30 0x7f96a00703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:03.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.269+0000 7f96aa7fc640 1 -- 172.21.15.16:0/630363012 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f96b0014070 con 0x7f96b4100680 2024-08-01T06:57:03.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.269+0000 7f96b889b640 1 --2- 172.21.15.16:0/630363012 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f96a006df30 0x7f96a00703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:03.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.270+0000 7f96b889b640 1 --2- 172.21.15.16:0/630363012 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f96a006df30 0x7f96a00703f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f96a4009880 tx=0x7f96a40314e0 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:03.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.274+0000 7f96aa7fc640 1 -- 172.21.15.16:0/630363012 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f96b00579b0 con 0x7f96b4100680 2024-08-01T06:57:03.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:03 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/149427790' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:57:03.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.719+0000 7f96bb300640 1 -- 172.21.15.16:0/630363012 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f96b4108850 con 0x7f96b4100680 2024-08-01T06:57:03.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.719+0000 7f96aa7fc640 1 -- 172.21.15.16:0/630363012 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f96b005b070 con 0x7f96b4100680 2024-08-01T06:57:03.721 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-08-01T06:57:03.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.722+0000 7f96bb300640 1 -- 172.21.15.16:0/630363012 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f96a006df30 msgr2=0x7f96a00703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:03.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.722+0000 7f96bb300640 1 --2- 172.21.15.16:0/630363012 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f96a006df30 0x7f96a00703f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f96a4009880 tx=0x7f96a40314e0 comp rx=0 tx=0).stop 2024-08-01T06:57:03.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.722+0000 7f96bb300640 1 -- 172.21.15.16:0/630363012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b4100680 msgr2=0x7f96b40fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:03.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.722+0000 7f96bb300640 1 --2- 172.21.15.16:0/630363012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b4100680 0x7f96b40fffe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f96b000e970 tx=0x7f96b000ed70 comp rx=0 tx=0).stop 2024-08-01T06:57:03.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.723+0000 7f96bb300640 1 -- 172.21.15.16:0/630363012 shutdown_connections 2024-08-01T06:57:03.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.723+0000 7f96bb300640 1 --2- 172.21.15.16:0/630363012 >> [v2:172.21.15.89:6828/2589785296,v1:172.21.15.89:6829/2589785296] conn(0x7f96a006df30 0x7f96a00703f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:03.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.723+0000 7f96bb300640 1 --2- 172.21.15.16:0/630363012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96b4102fb0 0x7f96b40fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:03.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.723+0000 7f96bb300640 1 --2- 172.21.15.16:0/630363012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b4100680 0x7f96b40fffe0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:03.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.723+0000 7f96bb300640 1 -- 172.21.15.16:0/630363012 >> 172.21.15.16:0/630363012 conn(0x7f96b40fa280 msgr2=0x7f96b40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:03.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.723+0000 7f96bb300640 1 -- 172.21.15.16:0/630363012 shutdown_connections 2024-08-01T06:57:03.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:03.723+0000 7f96bb300640 1 -- 172.21.15.16:0/630363012 wait complete. 2024-08-01T06:57:03.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:03 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/149427790' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:57:04.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:04 smithi016 ceph-mon[29266]: from='client.24525 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:57:04.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:04 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/630363012' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:57:04.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:04 smithi016 ceph-mon[29266]: pgmap v46: 65 pgs: 65 active+clean; 1.5 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 302 op/s 2024-08-01T06:57:04.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:04 smithi089 ceph-mon[36617]: from='client.24525 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:57:04.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:04 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/630363012' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:57:04.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:04 smithi089 ceph-mon[36617]: pgmap v46: 65 pgs: 65 active+clean; 1.5 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 302 op/s 2024-08-01T06:57:05.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:57:05.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:57:05.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:57:05.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:57:05.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:57:05.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:57:05.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mgr fail", "who": "smithi089.hfgnsr"}]: dispatch 2024-08-01T06:57:05.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mgr fail", "who": "smithi089.hfgnsr"}]: dispatch 2024-08-01T06:57:05.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: Activating manager daemon smithi016.whigbo 2024-08-01T06:57:05.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: osdmap e48: 6 total, 6 up, 6 in 2024-08-01T06:57:05.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd='[{"prefix": "mgr fail", "who": "smithi089.hfgnsr"}]': finished 2024-08-01T06:57:05.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: mgrmap e26: smithi016.whigbo(active, starting, since 0.00638207s) 2024-08-01T06:57:05.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:57:05.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:57:05.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.fziqod"}]: dispatch 2024-08-01T06:57:05.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.jhouje"}]: dispatch 2024-08-01T06:57:05.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.xanuld"}]: dispatch 2024-08-01T06:57:05.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.bgqkxu"}]: dispatch 2024-08-01T06:57:05.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr metadata", "who": "smithi016.whigbo", "id": "smithi016.whigbo"}]: dispatch 2024-08-01T06:57:05.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:57:05.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-01T06:57:05.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T06:57:05.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-01T06:57:05.901 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T06:57:05.901 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T06:57:05.901 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-01T06:57:05.901 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-01T06:57:05.901 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-01T06:57:05.901 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: Manager daemon smithi016.whigbo is now available 2024-08-01T06:57:05.901 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:57:05.901 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:57:05.901 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi016.whigbo/mirror_snapshot_schedule"}]: dispatch 2024-08-01T06:57:05.901 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi016.whigbo/trash_purge_schedule"}]: dispatch 2024-08-01T06:57:05.986 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:57:05.986 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:57:05.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:57:05.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:57:05.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' 2024-08-01T06:57:05.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:57:05.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.24423 172.21.15.89:0/158763444' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mgr fail", "who": "smithi089.hfgnsr"}]: dispatch 2024-08-01T06:57:05.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "mgr fail", "who": "smithi089.hfgnsr"}]: dispatch 2024-08-01T06:57:05.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: Activating manager daemon smithi016.whigbo 2024-08-01T06:57:05.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: osdmap e48: 6 total, 6 up, 6 in 2024-08-01T06:57:05.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.24423 ' entity='mgr.smithi089.hfgnsr' cmd='[{"prefix": "mgr fail", "who": "smithi089.hfgnsr"}]': finished 2024-08-01T06:57:05.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: mgrmap e26: smithi016.whigbo(active, starting, since 0.00638207s) 2024-08-01T06:57:05.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:57:05.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:57:05.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.fziqod"}]: dispatch 2024-08-01T06:57:05.988 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.jhouje"}]: dispatch 2024-08-01T06:57:05.988 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.xanuld"}]: dispatch 2024-08-01T06:57:05.988 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.bgqkxu"}]: dispatch 2024-08-01T06:57:05.988 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr metadata", "who": "smithi016.whigbo", "id": "smithi016.whigbo"}]: dispatch 2024-08-01T06:57:05.988 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:57:05.988 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-01T06:57:05.988 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T06:57:05.988 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-01T06:57:05.988 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T06:57:05.988 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T06:57:05.988 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-01T06:57:05.988 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-01T06:57:05.988 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-01T06:57:05.988 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: Manager daemon smithi016.whigbo is now available 2024-08-01T06:57:05.988 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:57:05.989 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:57:05.989 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi016.whigbo/mirror_snapshot_schedule"}]: dispatch 2024-08-01T06:57:05.989 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi016.whigbo/trash_purge_schedule"}]: dispatch 2024-08-01T06:57:07.031 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:06 smithi089 ceph-mon[36617]: mgrmap e27: smithi016.whigbo(active, since 1.01009s) 2024-08-01T06:57:07.032 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:06 smithi089 ceph-mon[36617]: pgmap v3: 65 pgs: 65 active+clean; 975 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2024-08-01T06:57:07.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:06 smithi016 ceph-mon[29266]: mgrmap e27: smithi016.whigbo(active, since 1.01009s) 2024-08-01T06:57:07.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:06 smithi016 ceph-mon[29266]: pgmap v3: 65 pgs: 65 active+clean; 975 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2024-08-01T06:57:08.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:07 smithi089 ceph-mon[36617]: mgrmap e28: smithi016.whigbo(active, since 2s) 2024-08-01T06:57:08.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:07 smithi089 ceph-mon[36617]: pgmap v4: 65 pgs: 65 active+clean; 975 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2024-08-01T06:57:08.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:07 smithi016 ceph-mon[29266]: mgrmap e28: smithi016.whigbo(active, since 2s) 2024-08-01T06:57:08.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:07 smithi016 ceph-mon[29266]: pgmap v4: 65 pgs: 65 active+clean; 975 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2024-08-01T06:57:08.870 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-01T06:57:08.873 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-01T06:57:10.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:09 smithi089 ceph-mon[36617]: [01/Aug/2024:06:57:08] ENGINE Bus STARTING 2024-08-01T06:57:10.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:09 smithi089 ceph-mon[36617]: [01/Aug/2024:06:57:08] ENGINE Serving on http://172.21.15.16:8765 2024-08-01T06:57:10.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:09 smithi089 ceph-mon[36617]: [01/Aug/2024:06:57:08] ENGINE Serving on https://172.21.15.16:7150 2024-08-01T06:57:10.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:09 smithi089 ceph-mon[36617]: [01/Aug/2024:06:57:08] ENGINE Bus STARTED 2024-08-01T06:57:10.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:09 smithi089 ceph-mon[36617]: [01/Aug/2024:06:57:08] ENGINE Error in HTTPServer.serve 2024-08-01T06:57:10.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Traceback (most recent call last): 2024-08-01T06:57:10.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-01T06:57:10.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-08-01T06:57:10.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-01T06:57:10.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._run(expiration_interval) 2024-08-01T06:57:10.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-01T06:57:10.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-01T06:57:10.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-01T06:57:10.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-01T06:57:10.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-01T06:57:10.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s = self.context.wrap_socket( 2024-08-01T06:57:10.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-01T06:57:10.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: return self.sslsocket_class._create( 2024-08-01T06:57:10.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-01T06:57:10.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self.do_handshake() 2024-08-01T06:57:10.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-01T06:57:10.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._sslobj.do_handshake() 2024-08-01T06:57:10.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-01T06:57:10.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:09 smithi089 ceph-mon[36617]: pgmap v5: 65 pgs: 65 active+clean; 975 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2024-08-01T06:57:10.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:09 smithi089 ceph-mon[36617]: mgrmap e29: smithi016.whigbo(active, since 4s) 2024-08-01T06:57:10.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:09 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:10.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:09 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:10.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:09 smithi016 ceph-mon[29266]: [01/Aug/2024:06:57:08] ENGINE Bus STARTING 2024-08-01T06:57:10.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:09 smithi016 ceph-mon[29266]: [01/Aug/2024:06:57:08] ENGINE Serving on http://172.21.15.16:8765 2024-08-01T06:57:10.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:09 smithi016 ceph-mon[29266]: [01/Aug/2024:06:57:08] ENGINE Serving on https://172.21.15.16:7150 2024-08-01T06:57:10.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:09 smithi016 ceph-mon[29266]: [01/Aug/2024:06:57:08] ENGINE Bus STARTED 2024-08-01T06:57:10.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:09 smithi016 ceph-mon[29266]: [01/Aug/2024:06:57:08] ENGINE Error in HTTPServer.serve 2024-08-01T06:57:10.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Traceback (most recent call last): 2024-08-01T06:57:10.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-01T06:57:10.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self._connections.run(self.expiration_interval) 2024-08-01T06:57:10.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-01T06:57:10.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self._run(expiration_interval) 2024-08-01T06:57:10.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-01T06:57:10.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-01T06:57:10.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-01T06:57:10.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-01T06:57:10.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-01T06:57:10.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: s = self.context.wrap_socket( 2024-08-01T06:57:10.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-01T06:57:10.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: return self.sslsocket_class._create( 2024-08-01T06:57:10.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-01T06:57:10.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self.do_handshake() 2024-08-01T06:57:10.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-01T06:57:10.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self._sslobj.do_handshake() 2024-08-01T06:57:10.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-01T06:57:10.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:09 smithi016 ceph-mon[29266]: pgmap v5: 65 pgs: 65 active+clean; 975 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2024-08-01T06:57:10.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:09 smithi016 ceph-mon[29266]: mgrmap e29: smithi016.whigbo(active, since 4s) 2024-08-01T06:57:10.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:09 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:10.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:09 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:11.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:11 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:11.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:11 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:11.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:11 smithi089 ceph-mon[36617]: Standby manager daemon smithi089.hfgnsr started 2024-08-01T06:57:11.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:11 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/4175384913' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/crt"}]: dispatch 2024-08-01T06:57:11.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:11 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/4175384913' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-01T06:57:11.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:11 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/4175384913' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/key"}]: dispatch 2024-08-01T06:57:11.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:11 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/4175384913' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-01T06:57:11.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:11 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:11.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:11 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:11.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:11 smithi016 ceph-mon[29266]: Standby manager daemon smithi089.hfgnsr started 2024-08-01T06:57:11.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:11 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.89:0/4175384913' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/crt"}]: dispatch 2024-08-01T06:57:11.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:11 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.89:0/4175384913' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-01T06:57:11.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:11 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.89:0/4175384913' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/key"}]: dispatch 2024-08-01T06:57:11.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:11 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.89:0/4175384913' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-01T06:57:12.441 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:12 smithi089 ceph-mon[36617]: pgmap v6: 65 pgs: 65 active+clean; 975 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2024-08-01T06:57:12.441 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:12 smithi089 ceph-mon[36617]: mgrmap e30: smithi016.whigbo(active, since 6s), standbys: smithi089.hfgnsr 2024-08-01T06:57:12.441 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:12 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr metadata", "who": "smithi089.hfgnsr", "id": "smithi089.hfgnsr"}]: dispatch 2024-08-01T06:57:12.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:12 smithi016 ceph-mon[29266]: pgmap v6: 65 pgs: 65 active+clean; 975 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail 2024-08-01T06:57:12.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:12 smithi016 ceph-mon[29266]: mgrmap e30: smithi016.whigbo(active, since 6s), standbys: smithi089.hfgnsr 2024-08-01T06:57:12.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:12 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr metadata", "who": "smithi089.hfgnsr", "id": "smithi089.hfgnsr"}]: dispatch 2024-08-01T06:57:14.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:14 smithi016 ceph-mon[29266]: pgmap v7: 65 pgs: 65 active+clean; 348 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1007 KiB/s rd, 963 KiB/s wr, 198 op/s 2024-08-01T06:57:14.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:14 smithi089 ceph-mon[36617]: pgmap v7: 65 pgs: 65 active+clean; 348 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1007 KiB/s rd, 963 KiB/s wr, 198 op/s 2024-08-01T06:57:16.504 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:16 smithi016 ceph-mon[29266]: pgmap v8: 65 pgs: 65 active+clean; 348 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 783 KiB/s rd, 749 KiB/s wr, 154 op/s 2024-08-01T06:57:16.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:16 smithi089 ceph-mon[36617]: pgmap v8: 65 pgs: 65 active+clean; 348 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 783 KiB/s rd, 749 KiB/s wr, 154 op/s 2024-08-01T06:57:18.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:18 smithi016 ceph-mon[29266]: pgmap v9: 65 pgs: 65 active+clean; 278 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 281 op/s 2024-08-01T06:57:18.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:18 smithi089 ceph-mon[36617]: pgmap v9: 65 pgs: 65 active+clean; 278 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 281 op/s 2024-08-01T06:57:20.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:20 smithi089 ceph-mon[36617]: pgmap v10: 65 pgs: 65 active+clean; 278 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 257 op/s 2024-08-01T06:57:20.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:20 smithi016 ceph-mon[29266]: pgmap v10: 65 pgs: 65 active+clean; 278 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 257 op/s 2024-08-01T06:57:21.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:21 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:57:21.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:21 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:57:22.505 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:22 smithi089 ceph-mon[36617]: pgmap v11: 65 pgs: 65 active+clean; 277 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 272 op/s 2024-08-01T06:57:22.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:22 smithi016 ceph-mon[29266]: pgmap v11: 65 pgs: 65 active+clean; 277 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 272 op/s 2024-08-01T06:57:24.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:24 smithi089 ceph-mon[36617]: pgmap v12: 65 pgs: 65 active+clean; 280 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 432 op/s 2024-08-01T06:57:24.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:24 smithi016 ceph-mon[29266]: pgmap v12: 65 pgs: 65 active+clean; 280 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 432 op/s 2024-08-01T06:57:26.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:26 smithi089 ceph-mon[36617]: pgmap v13: 65 pgs: 65 active+clean; 280 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 316 op/s 2024-08-01T06:57:26.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:26 smithi016 ceph-mon[29266]: pgmap v13: 65 pgs: 65 active+clean; 280 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 316 op/s 2024-08-01T06:57:28.616 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:28 smithi016 ceph-mon[29266]: pgmap v14: 65 pgs: 65 active+clean; 271 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 451 op/s 2024-08-01T06:57:28.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:28 smithi089 ceph-mon[36617]: pgmap v14: 65 pgs: 65 active+clean; 271 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 451 op/s 2024-08-01T06:57:30.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:30 smithi089 ceph-mon[36617]: pgmap v15: 65 pgs: 65 active+clean; 271 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1019 KiB/s rd, 1.1 MiB/s wr, 309 op/s 2024-08-01T06:57:30.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:30 smithi016 ceph-mon[29266]: pgmap v15: 65 pgs: 65 active+clean; 271 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1019 KiB/s rd, 1.1 MiB/s wr, 309 op/s 2024-08-01T06:57:32.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:32 smithi089 ceph-mon[36617]: pgmap v16: 65 pgs: 65 active+clean; 275 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 488 op/s 2024-08-01T06:57:32.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:32 smithi016 ceph-mon[29266]: pgmap v16: 65 pgs: 65 active+clean; 275 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 488 op/s 2024-08-01T06:57:33.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.841+0000 7f79dfbdc640 1 -- 172.21.15.16:0/1585867446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79d8100680 msgr2=0x7f79d8102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:33.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.841+0000 7f79dfbdc640 1 --2- 172.21.15.16:0/1585867446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79d8100680 0x7f79d8102a70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f79d40098b0 tx=0x7f79d402a4d0 comp rx=0 tx=0).stop 2024-08-01T06:57:33.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.841+0000 7f79dfbdc640 1 -- 172.21.15.16:0/1585867446 shutdown_connections 2024-08-01T06:57:33.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.841+0000 7f79dfbdc640 1 --2- 172.21.15.16:0/1585867446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d8102fb0 0x7f79d81053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:33.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.841+0000 7f79dfbdc640 1 --2- 172.21.15.16:0/1585867446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79d8100680 0x7f79d8102a70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:33.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.841+0000 7f79dfbdc640 1 -- 172.21.15.16:0/1585867446 >> 172.21.15.16:0/1585867446 conn(0x7f79d80fa280 msgr2=0x7f79d80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:33.843 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:33 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:33.843 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:33 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:33.844 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:33 smithi016 ceph-mon[29266]: pgmap v17: 65 pgs: 65 active+clean; 274 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 539 op/s 2024-08-01T06:57:33.844 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:33 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:33.844 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:33 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:33.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.842+0000 7f79dfbdc640 1 -- 172.21.15.16:0/1585867446 shutdown_connections 2024-08-01T06:57:33.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.842+0000 7f79dfbdc640 1 -- 172.21.15.16:0/1585867446 wait complete. 2024-08-01T06:57:33.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.842+0000 7f79dfbdc640 1 Processor -- start 2024-08-01T06:57:33.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.842+0000 7f79dfbdc640 1 -- start start 2024-08-01T06:57:33.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.843+0000 7f79dfbdc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79d8100680 0x7f79d80fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:33.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.843+0000 7f79dfbdc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d8102fb0 0x7f79d80fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:33.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.843+0000 7f79dfbdc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d80feb70 con 0x7f79d8100680 2024-08-01T06:57:33.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.843+0000 7f79dfbdc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d80fece0 con 0x7f79d8102fb0 2024-08-01T06:57:33.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.843+0000 7f79dd978640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79d8100680 0x7f79d80fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:33.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.843+0000 7f79dd978640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79d8100680 0x7f79d80fffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59854/0 (socket says 172.21.15.16:59854) 2024-08-01T06:57:33.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.843+0000 7f79dd978640 1 -- 172.21.15.16:0/1964883001 learned_addr learned my addr 172.21.15.16:0/1964883001 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:57:33.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.843+0000 7f79dd177640 1 --2- 172.21.15.16:0/1964883001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d8102fb0 0x7f79d80fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:33.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.843+0000 7f79dd177640 1 -- 172.21.15.16:0/1964883001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79d8100680 msgr2=0x7f79d80fffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:33.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.843+0000 7f79dd177640 1 --2- 172.21.15.16:0/1964883001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79d8100680 0x7f79d80fffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:33.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.843+0000 7f79dd177640 1 -- 172.21.15.16:0/1964883001 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d4009560 con 0x7f79d8102fb0 2024-08-01T06:57:33.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.844+0000 7f79dd177640 1 --2- 172.21.15.16:0/1964883001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d8102fb0 0x7f79d80fe630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f79c800e940 tx=0x7f79c800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:33.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.844+0000 7f79ceffd640 1 -- 172.21.15.16:0/1964883001 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79c8009640 con 0x7f79d8102fb0 2024-08-01T06:57:33.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.844+0000 7f79dfbdc640 1 -- 172.21.15.16:0/1964883001 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d80fefc0 con 0x7f79d8102fb0 2024-08-01T06:57:33.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.844+0000 7f79dfbdc640 1 -- 172.21.15.16:0/1964883001 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d819d750 con 0x7f79d8102fb0 2024-08-01T06:57:33.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.844+0000 7f79ceffd640 1 -- 172.21.15.16:0/1964883001 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f79c800cc90 con 0x7f79d8102fb0 2024-08-01T06:57:33.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.844+0000 7f79ceffd640 1 -- 172.21.15.16:0/1964883001 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79c8018810 con 0x7f79d8102fb0 2024-08-01T06:57:33.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.845+0000 7f79dfbdc640 1 -- 172.21.15.16:0/1964883001 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79bc005280 con 0x7f79d8102fb0 2024-08-01T06:57:33.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.846+0000 7f79ceffd640 1 -- 172.21.15.16:0/1964883001 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 30) v1 ==== 92166+0+0 (secure 0 0 0) 0x7f79c8018970 con 0x7f79d8102fb0 2024-08-01T06:57:33.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.847+0000 7f79ceffd640 1 --2- 172.21.15.16:0/1964883001 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f79c406df30 0x7f79c40703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:33.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.847+0000 7f79ceffd640 1 -- 172.21.15.16:0/1964883001 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f79c8014070 con 0x7f79d8102fb0 2024-08-01T06:57:33.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.847+0000 7f79dd978640 1 --2- 172.21.15.16:0/1964883001 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f79c406df30 0x7f79c40703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:33.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.848+0000 7f79dd978640 1 --2- 172.21.15.16:0/1964883001 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f79c406df30 0x7f79c40703f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f79d4000c00 tx=0x7f79d40314e0 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:33.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:33.851+0000 7f79ceffd640 1 -- 172.21.15.16:0/1964883001 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f79c80578e0 con 0x7f79d8102fb0 2024-08-01T06:57:33.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:33 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:33.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:33 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:33.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:33 smithi089 ceph-mon[36617]: pgmap v17: 65 pgs: 65 active+clean; 274 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 539 op/s 2024-08-01T06:57:33.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:33 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:33.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:33 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:34.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.138+0000 7f79dfbdc640 1 -- 172.21.15.16:0/1964883001 --> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f79bc000bf0 con 0x7f79c406df30 2024-08-01T06:57:34.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.142+0000 7f79ceffd640 1 -- 172.21.15.16:0/1964883001 <== mgr.14720 v2:172.21.15.16:6800/4143462722 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f79bc000bf0 con 0x7f79c406df30 2024-08-01T06:57:34.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.145+0000 7f79dfbdc640 1 -- 172.21.15.16:0/1964883001 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f79c406df30 msgr2=0x7f79c40703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:34.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.146+0000 7f79dfbdc640 1 --2- 172.21.15.16:0/1964883001 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f79c406df30 0x7f79c40703f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f79d4000c00 tx=0x7f79d40314e0 comp rx=0 tx=0).stop 2024-08-01T06:57:34.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.146+0000 7f79dfbdc640 1 -- 172.21.15.16:0/1964883001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d8102fb0 msgr2=0x7f79d80fe630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:34.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.146+0000 7f79dfbdc640 1 --2- 172.21.15.16:0/1964883001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d8102fb0 0x7f79d80fe630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f79c800e940 tx=0x7f79c800ee00 comp rx=0 tx=0).stop 2024-08-01T06:57:34.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.146+0000 7f79dfbdc640 1 -- 172.21.15.16:0/1964883001 shutdown_connections 2024-08-01T06:57:34.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.146+0000 7f79dfbdc640 1 --2- 172.21.15.16:0/1964883001 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f79c406df30 0x7f79c40703f0 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f79d4000c00 tx=0x7f79d40314e0 comp rx=0 tx=0).stop 2024-08-01T06:57:34.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.146+0000 7f79dfbdc640 1 --2- 172.21.15.16:0/1964883001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d8102fb0 0x7f79d80fe630 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:34.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.146+0000 7f79dfbdc640 1 --2- 172.21.15.16:0/1964883001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79d8100680 0x7f79d80fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:34.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.146+0000 7f79dfbdc640 1 -- 172.21.15.16:0/1964883001 >> 172.21.15.16:0/1964883001 conn(0x7f79d80fa280 msgr2=0x7f79d80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:34.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.146+0000 7f79dfbdc640 1 -- 172.21.15.16:0/1964883001 shutdown_connections 2024-08-01T06:57:34.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.148+0000 7f79dfbdc640 1 -- 172.21.15.16:0/1964883001 wait complete. 2024-08-01T06:57:34.163 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T06:57:34.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.301+0000 7f54ff031640 1 -- 172.21.15.16:0/3422079363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54f80711f0 msgr2=0x7f54f80715f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:34.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.301+0000 7f54ff031640 1 --2- 172.21.15.16:0/3422079363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54f80711f0 0x7f54f80715f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009880 tx=0x7f54f402a4b0 comp rx=0 tx=0).stop 2024-08-01T06:57:34.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.301+0000 7f54ff031640 1 -- 172.21.15.16:0/3422079363 shutdown_connections 2024-08-01T06:57:34.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.301+0000 7f54ff031640 1 --2- 172.21.15.16:0/3422079363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54f8071bc0 0x7f54f810b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:34.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.301+0000 7f54ff031640 1 --2- 172.21.15.16:0/3422079363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54f80711f0 0x7f54f80715f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:34.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.301+0000 7f54ff031640 1 -- 172.21.15.16:0/3422079363 >> 172.21.15.16:0/3422079363 conn(0x7f54f806c9f0 msgr2=0x7f54f806ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:34.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.308+0000 7f54ff031640 1 -- 172.21.15.16:0/3422079363 shutdown_connections 2024-08-01T06:57:34.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.309+0000 7f54ff031640 1 -- 172.21.15.16:0/3422079363 wait complete. 2024-08-01T06:57:34.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.309+0000 7f54ff031640 1 Processor -- start 2024-08-01T06:57:34.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.310+0000 7f54ff031640 1 -- start start 2024-08-01T06:57:34.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.310+0000 7f54ff031640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54f80711f0 0x7f54f81161a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:34.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.310+0000 7f54ff031640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54f8071bc0 0x7f54f81166e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:34.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.310+0000 7f54ff031640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f8116ce0 con 0x7f54f80711f0 2024-08-01T06:57:34.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.310+0000 7f54ff031640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f8116e50 con 0x7f54f8071bc0 2024-08-01T06:57:34.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.310+0000 7f54fe02f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54f80711f0 0x7f54f81161a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:34.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.310+0000 7f54fe02f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54f80711f0 0x7f54f81161a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59884/0 (socket says 172.21.15.16:59884) 2024-08-01T06:57:34.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.310+0000 7f54fe02f640 1 -- 172.21.15.16:0/1217416892 learned_addr learned my addr 172.21.15.16:0/1217416892 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:57:34.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.310+0000 7f54fd82e640 1 --2- 172.21.15.16:0/1217416892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54f8071bc0 0x7f54f81166e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:34.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.311+0000 7f54fe02f640 1 -- 172.21.15.16:0/1217416892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54f8071bc0 msgr2=0x7f54f81166e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:34.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.311+0000 7f54fe02f640 1 --2- 172.21.15.16:0/1217416892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54f8071bc0 0x7f54f81166e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:34.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.311+0000 7f54fe02f640 1 -- 172.21.15.16:0/1217416892 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f4009560 con 0x7f54f80711f0 2024-08-01T06:57:34.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.311+0000 7f54fe02f640 1 --2- 172.21.15.16:0/1217416892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54f80711f0 0x7f54f81161a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f54f402aaa0 tx=0x7f54f40055c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:34.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.312+0000 7f54ef7fe640 1 -- 172.21.15.16:0/1217416892 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54f4004b60 con 0x7f54f80711f0 2024-08-01T06:57:34.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.312+0000 7f54ff031640 1 -- 172.21.15.16:0/1217416892 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f81a0e20 con 0x7f54f80711f0 2024-08-01T06:57:34.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.312+0000 7f54ff031640 1 -- 172.21.15.16:0/1217416892 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f81a1390 con 0x7f54f80711f0 2024-08-01T06:57:34.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.314+0000 7f54ef7fe640 1 -- 172.21.15.16:0/1217416892 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f54f4004cc0 con 0x7f54f80711f0 2024-08-01T06:57:34.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.315+0000 7f54ef7fe640 1 -- 172.21.15.16:0/1217416892 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54f4003a90 con 0x7f54f80711f0 2024-08-01T06:57:34.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.315+0000 7f54ff031640 1 -- 172.21.15.16:0/1217416892 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54dc005280 con 0x7f54f80711f0 2024-08-01T06:57:34.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.321+0000 7f54ef7fe640 1 -- 172.21.15.16:0/1217416892 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 30) v1 ==== 92166+0+0 (secure 0 0 0) 0x7f54f4003bf0 con 0x7f54f80711f0 2024-08-01T06:57:34.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.321+0000 7f54ef7fe640 1 --2- 172.21.15.16:0/1217416892 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f54e406ddf0 0x7f54e40702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:34.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.322+0000 7f54ef7fe640 1 -- 172.21.15.16:0/1217416892 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f54f40af450 con 0x7f54f80711f0 2024-08-01T06:57:34.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.328+0000 7f54fd82e640 1 --2- 172.21.15.16:0/1217416892 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f54e406ddf0 0x7f54e40702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:34.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.331+0000 7f54ef7fe640 1 -- 172.21.15.16:0/1217416892 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f54f4078bc0 con 0x7f54f80711f0 2024-08-01T06:57:34.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.347+0000 7f54fd82e640 1 --2- 172.21.15.16:0/1217416892 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f54e406ddf0 0x7f54e40702b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f54e8005fd0 tx=0x7f54e8005850 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:34.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.731+0000 7f54ff031640 1 -- 172.21.15.16:0/1217416892 --> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f54dc000bf0 con 0x7f54e406ddf0 2024-08-01T06:57:34.734 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:34 smithi016 ceph-mon[29266]: from='client.24557 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:57:34.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.733+0000 7f54ef7fe640 1 -- 172.21.15.16:0/1217416892 <== mgr.14720 v2:172.21.15.16:6800/4143462722 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f54dc000bf0 con 0x7f54e406ddf0 2024-08-01T06:57:34.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.736+0000 7f54ff031640 1 -- 172.21.15.16:0/1217416892 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f54e406ddf0 msgr2=0x7f54e40702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:34.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.736+0000 7f54ff031640 1 --2- 172.21.15.16:0/1217416892 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f54e406ddf0 0x7f54e40702b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f54e8005fd0 tx=0x7f54e8005850 comp rx=0 tx=0).stop 2024-08-01T06:57:34.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.736+0000 7f54ff031640 1 -- 172.21.15.16:0/1217416892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54f80711f0 msgr2=0x7f54f81161a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:34.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.736+0000 7f54ff031640 1 --2- 172.21.15.16:0/1217416892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54f80711f0 0x7f54f81161a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f54f402aaa0 tx=0x7f54f40055c0 comp rx=0 tx=0).stop 2024-08-01T06:57:34.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.736+0000 7f54ff031640 1 -- 172.21.15.16:0/1217416892 shutdown_connections 2024-08-01T06:57:34.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.736+0000 7f54ff031640 1 --2- 172.21.15.16:0/1217416892 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f54e406ddf0 0x7f54e40702b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:34.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.736+0000 7f54ff031640 1 --2- 172.21.15.16:0/1217416892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54f8071bc0 0x7f54f81166e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:34.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.736+0000 7f54ff031640 1 --2- 172.21.15.16:0/1217416892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54f80711f0 0x7f54f81161a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:34.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.736+0000 7f54ff031640 1 -- 172.21.15.16:0/1217416892 >> 172.21.15.16:0/1217416892 conn(0x7f54f806c9f0 msgr2=0x7f54f8109910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:34.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.737+0000 7f54ff031640 1 -- 172.21.15.16:0/1217416892 shutdown_connections 2024-08-01T06:57:34.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.737+0000 7f54ff031640 1 -- 172.21.15.16:0/1217416892 wait complete. 2024-08-01T06:57:34.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.832+0000 7fb3703a7640 1 -- 172.21.15.16:0/4192715839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb368100680 msgr2=0x7fb368102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:34.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.832+0000 7fb3703a7640 1 --2- 172.21.15.16:0/4192715839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb368100680 0x7fb368102a70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb3640098b0 tx=0x7fb36402a4d0 comp rx=0 tx=0).stop 2024-08-01T06:57:34.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.832+0000 7fb3703a7640 1 -- 172.21.15.16:0/4192715839 shutdown_connections 2024-08-01T06:57:34.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.832+0000 7fb3703a7640 1 --2- 172.21.15.16:0/4192715839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb368102fb0 0x7fb3681053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:34.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.832+0000 7fb3703a7640 1 --2- 172.21.15.16:0/4192715839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb368100680 0x7fb368102a70 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:34.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.832+0000 7fb3703a7640 1 -- 172.21.15.16:0/4192715839 >> 172.21.15.16:0/4192715839 conn(0x7fb3680fa280 msgr2=0x7fb3680fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:34.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.832+0000 7fb3703a7640 1 -- 172.21.15.16:0/4192715839 shutdown_connections 2024-08-01T06:57:34.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.832+0000 7fb3703a7640 1 -- 172.21.15.16:0/4192715839 wait complete. 2024-08-01T06:57:34.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.833+0000 7fb3703a7640 1 Processor -- start 2024-08-01T06:57:34.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.833+0000 7fb3703a7640 1 -- start start 2024-08-01T06:57:34.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.833+0000 7fb3703a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb368100680 0x7fb3680fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:34.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.833+0000 7fb3703a7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb368102fb0 0x7fb3680fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:34.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.833+0000 7fb3703a7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680feb70 con 0x7fb368100680 2024-08-01T06:57:34.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.833+0000 7fb3703a7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680fece0 con 0x7fb368102fb0 2024-08-01T06:57:34.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.833+0000 7fb36e143640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb368100680 0x7fb3680fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:34.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.833+0000 7fb36e143640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb368100680 0x7fb3680fffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59906/0 (socket says 172.21.15.16:59906) 2024-08-01T06:57:34.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.833+0000 7fb36e143640 1 -- 172.21.15.16:0/2957928457 learned_addr learned my addr 172.21.15.16:0/2957928457 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:57:34.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.834+0000 7fb36d942640 1 --2- 172.21.15.16:0/2957928457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb368102fb0 0x7fb3680fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:34.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.834+0000 7fb36e143640 1 -- 172.21.15.16:0/2957928457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb368102fb0 msgr2=0x7fb3680fe630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:34.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.834+0000 7fb36e143640 1 --2- 172.21.15.16:0/2957928457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb368102fb0 0x7fb3680fe630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:34.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.834+0000 7fb36e143640 1 -- 172.21.15.16:0/2957928457 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb364009560 con 0x7fb368100680 2024-08-01T06:57:34.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.834+0000 7fb36d942640 1 --2- 172.21.15.16:0/2957928457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb368102fb0 0x7fb3680fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T06:57:34.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.834+0000 7fb36e143640 1 --2- 172.21.15.16:0/2957928457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb368100680 0x7fb3680fffe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb364006010 tx=0x7fb3640055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:34.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.834+0000 7fb35f7fe640 1 -- 172.21.15.16:0/2957928457 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb364004aa0 con 0x7fb368100680 2024-08-01T06:57:34.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.835+0000 7fb3703a7640 1 -- 172.21.15.16:0/2957928457 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3680fef60 con 0x7fb368100680 2024-08-01T06:57:34.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.834+0000 7fb35f7fe640 1 -- 172.21.15.16:0/2957928457 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb364005d50 con 0x7fb368100680 2024-08-01T06:57:34.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.835+0000 7fb35f7fe640 1 -- 172.21.15.16:0/2957928457 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb364003a20 con 0x7fb368100680 2024-08-01T06:57:34.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.835+0000 7fb3703a7640 1 -- 172.21.15.16:0/2957928457 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3680ff450 con 0x7fb368100680 2024-08-01T06:57:34.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.836+0000 7fb3703a7640 1 -- 172.21.15.16:0/2957928457 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb368108810 con 0x7fb368100680 2024-08-01T06:57:34.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.836+0000 7fb35f7fe640 1 -- 172.21.15.16:0/2957928457 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 30) v1 ==== 92166+0+0 (secure 0 0 0) 0x7fb364031c00 con 0x7fb368100680 2024-08-01T06:57:34.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.837+0000 7fb35f7fe640 1 --2- 172.21.15.16:0/2957928457 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fb35406df30 0x7fb3540703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:34.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.837+0000 7fb35f7fe640 1 -- 172.21.15.16:0/2957928457 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb3640aee50 con 0x7fb368100680 2024-08-01T06:57:34.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.837+0000 7fb36d942640 1 --2- 172.21.15.16:0/2957928457 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fb35406df30 0x7fb3540703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:34.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.838+0000 7fb36d942640 1 --2- 172.21.15.16:0/2957928457 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fb35406df30 0x7fb3540703f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb3680ffd60 tx=0x7fb358005f90 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:34.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:34.845+0000 7fb35f7fe640 1 -- 172.21.15.16:0/2957928457 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fb364078510 con 0x7fb368100680 2024-08-01T06:57:34.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:34 smithi089 ceph-mon[36617]: from='client.24557 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:57:35.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.160+0000 7fb3703a7640 1 -- 172.21.15.16:0/2957928457 --> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3681039d0 con 0x7fb35406df30 2024-08-01T06:57:35.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.171+0000 7fb35f7fe640 1 -- 172.21.15.16:0/2957928457 <== mgr.14720 v2:172.21.15.16:6800/4143462722 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fb3681039d0 con 0x7fb35406df30 2024-08-01T06:57:35.174 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T06:57:35.174 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (8m) 2s ago 9m 25.4M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T06:57:35.174 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (9m) 2s ago 9m 8044k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T06:57:35.174 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (8m) 25s ago 8m 7931k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T06:57:35.174 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (9m) 2s ago 9m 6895k - 18.2.2-1767-ga3bbd728 d280790d1980 81c723a6ae35 2024-08-01T06:57:35.174 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (8m) 25s ago 8m 6891k - 18.2.2-1767-ga3bbd728 d280790d1980 73e7778d1e26 2024-08-01T06:57:35.175 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (8m) 2s ago 9m 85.2M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T06:57:35.175 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (4m) 2s ago 4m 142M - 18.2.2-1767-ga3bbd728 d280790d1980 96e46c28d16c 2024-08-01T06:57:35.175 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (4m) 2s ago 4m 208M - 18.2.2-1767-ga3bbd728 d280790d1980 4bbe1a388689 2024-08-01T06:57:35.175 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (4m) 25s ago 4m 24.7M - 18.2.2-1767-ga3bbd728 d280790d1980 65ca121a6fbb 2024-08-01T06:57:35.175 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (4m) 25s ago 4m 25.1M - 18.2.2-1767-ga3bbd728 d280790d1980 05bb46c6fe94 2024-08-01T06:57:35.175 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:8443,9283,8765 running (42s) 2s ago 10m 470M - 19.1.0-1223-gf9911e17 93d93c74a2cc 8701e6315593 2024-08-01T06:57:35.175 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (2m) 25s ago 8m 133M - 19.1.0-1223-gf9911e17 93d93c74a2cc 175fc6a24b65 2024-08-01T06:57:35.175 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (10m) 2s ago 11m 57.2M 2048M 18.2.2-1767-ga3bbd728 d280790d1980 e6a2e5d7eeec 2024-08-01T06:57:35.175 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (8m) 25s ago 8m 42.5M 2048M 18.2.2-1767-ga3bbd728 d280790d1980 9ca9e3e814cb 2024-08-01T06:57:35.175 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (9m) 2s ago 9m 15.7M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T06:57:35.175 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (8m) 25s ago 8m 16.4M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T06:57:35.175 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (7m) 2s ago 7m 209M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 9b7157499583 2024-08-01T06:57:35.175 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (7m) 2s ago 7m 212M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 f3b050aed6b7 2024-08-01T06:57:35.176 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (6m) 2s ago 6m 191M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 33a72e1a5c91 2024-08-01T06:57:35.176 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (6m) 25s ago 6m 238M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 58c175e0f4eb 2024-08-01T06:57:35.176 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (6m) 25s ago 6m 230M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 15b8f910bad7 2024-08-01T06:57:35.176 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (5m) 25s ago 5m 206M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 ac887841899e 2024-08-01T06:57:35.176 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (50s) 2s ago 9m 49.3M - 2.43.0 a07b618ecd1d 10b16eee965a 2024-08-01T06:57:35.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.174+0000 7fb3703a7640 1 -- 172.21.15.16:0/2957928457 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fb35406df30 msgr2=0x7fb3540703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:35.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.174+0000 7fb3703a7640 1 --2- 172.21.15.16:0/2957928457 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fb35406df30 0x7fb3540703f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb3680ffd60 tx=0x7fb358005f90 comp rx=0 tx=0).stop 2024-08-01T06:57:35.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.174+0000 7fb3703a7640 1 -- 172.21.15.16:0/2957928457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb368100680 msgr2=0x7fb3680fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:35.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.174+0000 7fb3703a7640 1 --2- 172.21.15.16:0/2957928457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb368100680 0x7fb3680fffe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb364006010 tx=0x7fb3640055a0 comp rx=0 tx=0).stop 2024-08-01T06:57:35.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.175+0000 7fb3703a7640 1 -- 172.21.15.16:0/2957928457 shutdown_connections 2024-08-01T06:57:35.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.175+0000 7fb3703a7640 1 --2- 172.21.15.16:0/2957928457 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fb35406df30 0x7fb3540703f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:35.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.175+0000 7fb3703a7640 1 --2- 172.21.15.16:0/2957928457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb368102fb0 0x7fb3680fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:35.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.175+0000 7fb3703a7640 1 --2- 172.21.15.16:0/2957928457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb368100680 0x7fb3680fffe0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:35.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.175+0000 7fb3703a7640 1 -- 172.21.15.16:0/2957928457 >> 172.21.15.16:0/2957928457 conn(0x7fb3680fa280 msgr2=0x7fb3680fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:35.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.175+0000 7fb3703a7640 1 -- 172.21.15.16:0/2957928457 shutdown_connections 2024-08-01T06:57:35.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.175+0000 7fb3703a7640 1 -- 172.21.15.16:0/2957928457 wait complete. 2024-08-01T06:57:35.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.294+0000 7fb4895ea640 1 -- 172.21.15.16:0/869784205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb484071bc0 msgr2=0x7fb48410b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:35.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.294+0000 7fb4895ea640 1 --2- 172.21.15.16:0/869784205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb484071bc0 0x7fb48410b560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb4740097e0 tx=0x7fb47402a3f0 comp rx=0 tx=0).stop 2024-08-01T06:57:35.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.294+0000 7fb4895ea640 1 -- 172.21.15.16:0/869784205 shutdown_connections 2024-08-01T06:57:35.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.294+0000 7fb4895ea640 1 --2- 172.21.15.16:0/869784205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb484071bc0 0x7fb48410b560 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:35.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.294+0000 7fb4895ea640 1 --2- 172.21.15.16:0/869784205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4840711f0 0x7fb4840715f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:35.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.294+0000 7fb4895ea640 1 -- 172.21.15.16:0/869784205 >> 172.21.15.16:0/869784205 conn(0x7fb48406c9f0 msgr2=0x7fb48406ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:35.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.294+0000 7fb4895ea640 1 -- 172.21.15.16:0/869784205 shutdown_connections 2024-08-01T06:57:35.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.295+0000 7fb4895ea640 1 -- 172.21.15.16:0/869784205 wait complete. 2024-08-01T06:57:35.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.295+0000 7fb4895ea640 1 Processor -- start 2024-08-01T06:57:35.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.296+0000 7fb4895ea640 1 -- start start 2024-08-01T06:57:35.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.296+0000 7fb4895ea640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4840711f0 0x7fb4841a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:35.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.297+0000 7fb4895ea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb484071bc0 0x7fb4841a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:35.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.297+0000 7fb4895ea640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4841a4d10 con 0x7fb4840711f0 2024-08-01T06:57:35.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.297+0000 7fb4895ea640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4841a4e80 con 0x7fb484071bc0 2024-08-01T06:57:35.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.297+0000 7fb4837fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb484071bc0 0x7fb4841a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:35.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.297+0000 7fb4837fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb484071bc0 0x7fb4841a4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:46680/0 (socket says 172.21.15.16:46680) 2024-08-01T06:57:35.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.297+0000 7fb4837fe640 1 -- 172.21.15.16:0/1510906176 learned_addr learned my addr 172.21.15.16:0/1510906176 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:57:35.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.297+0000 7fb483fff640 1 --2- 172.21.15.16:0/1510906176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4840711f0 0x7fb4841a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:35.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.297+0000 7fb4837fe640 1 -- 172.21.15.16:0/1510906176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4840711f0 msgr2=0x7fb4841a4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:35.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.297+0000 7fb4837fe640 1 --2- 172.21.15.16:0/1510906176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4840711f0 0x7fb4841a4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:35.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.297+0000 7fb4837fe640 1 -- 172.21.15.16:0/1510906176 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb474009490 con 0x7fb484071bc0 2024-08-01T06:57:35.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.298+0000 7fb4837fe640 1 --2- 172.21.15.16:0/1510906176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb484071bc0 0x7fb4841a4740 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb4740035f0 tx=0x7fb474003620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:35.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.298+0000 7fb4817fa640 1 -- 172.21.15.16:0/1510906176 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb474003c60 con 0x7fb484071bc0 2024-08-01T06:57:35.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.299+0000 7fb4895ea640 1 -- 172.21.15.16:0/1510906176 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4841a98c0 con 0x7fb484071bc0 2024-08-01T06:57:35.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.299+0000 7fb4895ea640 1 -- 172.21.15.16:0/1510906176 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4841a9db0 con 0x7fb484071bc0 2024-08-01T06:57:35.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.299+0000 7fb4817fa640 1 -- 172.21.15.16:0/1510906176 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb474003dc0 con 0x7fb484071bc0 2024-08-01T06:57:35.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.300+0000 7fb4817fa640 1 -- 172.21.15.16:0/1510906176 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4740457f0 con 0x7fb484071bc0 2024-08-01T06:57:35.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.301+0000 7fb4895ea640 1 -- 172.21.15.16:0/1510906176 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb470005280 con 0x7fb484071bc0 2024-08-01T06:57:35.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.301+0000 7fb4817fa640 1 -- 172.21.15.16:0/1510906176 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 30) v1 ==== 92166+0+0 (secure 0 0 0) 0x7fb474031400 con 0x7fb484071bc0 2024-08-01T06:57:35.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.302+0000 7fb4817fa640 1 --2- 172.21.15.16:0/1510906176 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fb46c06ddb0 0x7fb46c070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:35.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.302+0000 7fb4817fa640 1 -- 172.21.15.16:0/1510906176 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb4740af5c0 con 0x7fb484071bc0 2024-08-01T06:57:35.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.303+0000 7fb483fff640 1 --2- 172.21.15.16:0/1510906176 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fb46c06ddb0 0x7fb46c070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:35.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.304+0000 7fb483fff640 1 --2- 172.21.15.16:0/1510906176 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fb46c06ddb0 0x7fb46c070270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb478005fd0 tx=0x7fb47800b590 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:35.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.311+0000 7fb4817fa640 1 -- 172.21.15.16:0/1510906176 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fb474078c40 con 0x7fb484071bc0 2024-08-01T06:57:35.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:35 smithi089 ceph-mon[36617]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:57:35.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:35 smithi089 ceph-mon[36617]: pgmap v18: 65 pgs: 65 active+clean; 274 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 380 op/s 2024-08-01T06:57:35.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:35 smithi089 ceph-mon[36617]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:57:35.718 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:35 smithi016 ceph-mon[29266]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:57:35.718 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:35 smithi016 ceph-mon[29266]: pgmap v18: 65 pgs: 65 active+clean; 274 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 380 op/s 2024-08-01T06:57:35.718 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:35 smithi016 ceph-mon[29266]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:57:35.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.715+0000 7fb4895ea640 1 -- 172.21.15.16:0/1510906176 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb470005800 con 0x7fb484071bc0 2024-08-01T06:57:35.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.715+0000 7fb4817fa640 1 -- 172.21.15.16:0/1510906176 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7fb47407c300 con 0x7fb484071bc0 2024-08-01T06:57:35.719 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:57:35.719 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T06:57:35.719 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 2 2024-08-01T06:57:35.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:57:35.719 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T06:57:35.719 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T06:57:35.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:57:35.719 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T06:57:35.719 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 6 2024-08-01T06:57:35.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:57:35.720 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T06:57:35.720 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4 2024-08-01T06:57:35.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:57:35.720 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T06:57:35.720 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 12, 2024-08-01T06:57:35.720 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T06:57:35.720 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T06:57:35.720 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:57:35.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.718+0000 7fb4895ea640 1 -- 172.21.15.16:0/1510906176 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fb46c06ddb0 msgr2=0x7fb46c070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:35.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.718+0000 7fb4895ea640 1 --2- 172.21.15.16:0/1510906176 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fb46c06ddb0 0x7fb46c070270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb478005fd0 tx=0x7fb47800b590 comp rx=0 tx=0).stop 2024-08-01T06:57:35.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.718+0000 7fb4895ea640 1 -- 172.21.15.16:0/1510906176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb484071bc0 msgr2=0x7fb4841a4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:35.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.718+0000 7fb4895ea640 1 --2- 172.21.15.16:0/1510906176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb484071bc0 0x7fb4841a4740 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb4740035f0 tx=0x7fb474003620 comp rx=0 tx=0).stop 2024-08-01T06:57:35.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.718+0000 7fb4895ea640 1 -- 172.21.15.16:0/1510906176 shutdown_connections 2024-08-01T06:57:35.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.718+0000 7fb4895ea640 1 --2- 172.21.15.16:0/1510906176 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fb46c06ddb0 0x7fb46c070270 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:35.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.718+0000 7fb4895ea640 1 --2- 172.21.15.16:0/1510906176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb484071bc0 0x7fb4841a4740 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:35.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.718+0000 7fb4895ea640 1 --2- 172.21.15.16:0/1510906176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4840711f0 0x7fb4841a4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:35.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.718+0000 7fb4895ea640 1 -- 172.21.15.16:0/1510906176 >> 172.21.15.16:0/1510906176 conn(0x7fb48406c9f0 msgr2=0x7fb484109930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:35.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.718+0000 7fb4895ea640 1 -- 172.21.15.16:0/1510906176 shutdown_connections 2024-08-01T06:57:35.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.719+0000 7fb4895ea640 1 -- 172.21.15.16:0/1510906176 wait complete. 2024-08-01T06:57:35.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.827+0000 7f621cb9f640 1 -- 172.21.15.16:0/121136444 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62180feaf0 msgr2=0x7f62180feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:35.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.827+0000 7f621cb9f640 1 --2- 172.21.15.16:0/121136444 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62180feaf0 0x7f62180feef0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6208009880 tx=0x7f620802a4a0 comp rx=0 tx=0).stop 2024-08-01T06:57:35.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.827+0000 7f621cb9f640 1 -- 172.21.15.16:0/121136444 shutdown_connections 2024-08-01T06:57:35.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.827+0000 7f621cb9f640 1 --2- 172.21.15.16:0/121136444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62180ffcf0 0x7f6218100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:35.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.827+0000 7f621cb9f640 1 --2- 172.21.15.16:0/121136444 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62180feaf0 0x7f62180feef0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:35.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.827+0000 7f621cb9f640 1 -- 172.21.15.16:0/121136444 >> 172.21.15.16:0/121136444 conn(0x7f62180fa280 msgr2=0x7f62180fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:35.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.827+0000 7f621cb9f640 1 -- 172.21.15.16:0/121136444 shutdown_connections 2024-08-01T06:57:35.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.827+0000 7f621cb9f640 1 -- 172.21.15.16:0/121136444 wait complete. 2024-08-01T06:57:35.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.828+0000 7f621cb9f640 1 Processor -- start 2024-08-01T06:57:35.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.828+0000 7f621cb9f640 1 -- start start 2024-08-01T06:57:35.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.828+0000 7f621cb9f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62180feaf0 0x7f6218102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:35.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.828+0000 7f621cb9f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62180ffcf0 0x7f62181010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:35.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.828+0000 7f621cb9f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6218102fc0 con 0x7f62180feaf0 2024-08-01T06:57:35.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.828+0000 7f621cb9f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6218101640 con 0x7f62180ffcf0 2024-08-01T06:57:35.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.828+0000 7f621659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62180feaf0 0x7f6218102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:35.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.828+0000 7f621659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62180feaf0 0x7f6218102a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59946/0 (socket says 172.21.15.16:59946) 2024-08-01T06:57:35.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.828+0000 7f621659c640 1 -- 172.21.15.16:0/2190764010 learned_addr learned my addr 172.21.15.16:0/2190764010 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:57:35.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.828+0000 7f6215d9b640 1 --2- 172.21.15.16:0/2190764010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62180ffcf0 0x7f62181010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:35.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.829+0000 7f6215d9b640 1 -- 172.21.15.16:0/2190764010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62180feaf0 msgr2=0x7f6218102a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:35.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.829+0000 7f6215d9b640 1 --2- 172.21.15.16:0/2190764010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62180feaf0 0x7f6218102a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:35.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.829+0000 7f6215d9b640 1 -- 172.21.15.16:0/2190764010 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6208009560 con 0x7f62180ffcf0 2024-08-01T06:57:35.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.829+0000 7f621659c640 1 --2- 172.21.15.16:0/2190764010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62180feaf0 0x7f6218102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T06:57:35.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.829+0000 7f6215d9b640 1 --2- 172.21.15.16:0/2190764010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62180ffcf0 0x7f62181010d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f620c00c8f0 tx=0x7f620c00cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:35.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.829+0000 7f62077fe640 1 -- 172.21.15.16:0/2190764010 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f620c007b80 con 0x7f62180ffcf0 2024-08-01T06:57:35.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.829+0000 7f62077fe640 1 -- 172.21.15.16:0/2190764010 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f620c007ce0 con 0x7f62180ffcf0 2024-08-01T06:57:35.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.829+0000 7f62077fe640 1 -- 172.21.15.16:0/2190764010 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f620c018830 con 0x7f62180ffcf0 2024-08-01T06:57:35.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.829+0000 7f621cb9f640 1 -- 172.21.15.16:0/2190764010 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6218101920 con 0x7f62180ffcf0 2024-08-01T06:57:35.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.830+0000 7f621cb9f640 1 -- 172.21.15.16:0/2190764010 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6218101e20 con 0x7f62180ffcf0 2024-08-01T06:57:35.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.831+0000 7f62077fe640 1 -- 172.21.15.16:0/2190764010 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 30) v1 ==== 92166+0+0 (secure 0 0 0) 0x7f620c018aa0 con 0x7f62180ffcf0 2024-08-01T06:57:35.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.831+0000 7f621cb9f640 1 -- 172.21.15.16:0/2190764010 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62181076e0 con 0x7f62180ffcf0 2024-08-01T06:57:35.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.832+0000 7f62077fe640 1 --2- 172.21.15.16:0/2190764010 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f620006df20 0x7f62000703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:35.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.832+0000 7f62077fe640 1 -- 172.21.15.16:0/2190764010 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f620c08df30 con 0x7f62180ffcf0 2024-08-01T06:57:35.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.832+0000 7f621659c640 1 --2- 172.21.15.16:0/2190764010 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f620006df20 0x7f62000703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:35.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.832+0000 7f621659c640 1 --2- 172.21.15.16:0/2190764010 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f620006df20 0x7f62000703e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6208005c40 tx=0x7f6208005bd0 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:35.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:35.836+0000 7f62077fe640 1 -- 172.21.15.16:0/2190764010 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f620c057480 con 0x7f62180ffcf0 2024-08-01T06:57:36.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.181+0000 7f621cb9f640 1 -- 172.21.15.16:0/2190764010 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6218107870 con 0x7f62180ffcf0 2024-08-01T06:57:36.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.182+0000 7f62077fe640 1 -- 172.21.15.16:0/2190764010 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1868 (secure 0 0 0) 0x7f620c05ab40 con 0x7f62180ffcf0 2024-08-01T06:57:36.185 INFO:teuthology.orchestra.run.smithi016.stdout:e19 2024-08-01T06:57:36.185 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T06:57:36.185 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:57:36.186 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T06:57:36.186 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:57:36.186 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T06:57:36.186 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T06:57:36.186 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 19 2024-08-01T06:57:36.186 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T06:57:36.186 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T06:57:36.186 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T06:53:32.617145+0000 2024-08-01T06:57:36.186 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T06:57:36.186 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T06:57:36.186 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T06:57:36.186 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T06:57:36.186 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T06:57:36.187 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T06:57:36.187 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T06:57:36.187 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T06:57:36.187 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 46 2024-08-01T06:57:36.187 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:57:36.187 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T06:57:36.187 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T06:57:36.187 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=14482,1=24281} 2024-08-01T06:57:36.187 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T06:57:36.187 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T06:57:36.187 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T06:57:36.187 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T06:57:36.187 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T06:57:36.188 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T06:57:36.188 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T06:57:36.188 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T06:57:36.188 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T06:57:36.188 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:57:36.188 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:24299} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:57:36.188 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{1:24281} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:57:36.188 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:24291} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:57:36.188 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:57:36.188 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:57:36.188 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-08-01T06:57:36.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.188+0000 7f621cb9f640 1 -- 172.21.15.16:0/2190764010 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f620006df20 msgr2=0x7f62000703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:36.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.188+0000 7f621cb9f640 1 --2- 172.21.15.16:0/2190764010 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f620006df20 0x7f62000703e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6208005c40 tx=0x7f6208005bd0 comp rx=0 tx=0).stop 2024-08-01T06:57:36.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.188+0000 7f621cb9f640 1 -- 172.21.15.16:0/2190764010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62180ffcf0 msgr2=0x7f62181010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:36.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.188+0000 7f621cb9f640 1 --2- 172.21.15.16:0/2190764010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62180ffcf0 0x7f62181010d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f620c00c8f0 tx=0x7f620c00cdb0 comp rx=0 tx=0).stop 2024-08-01T06:57:36.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.188+0000 7f621cb9f640 1 -- 172.21.15.16:0/2190764010 shutdown_connections 2024-08-01T06:57:36.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.188+0000 7f621cb9f640 1 --2- 172.21.15.16:0/2190764010 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f620006df20 0x7f62000703e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:36.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.188+0000 7f621cb9f640 1 --2- 172.21.15.16:0/2190764010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62180ffcf0 0x7f62181010d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:36.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.188+0000 7f621cb9f640 1 --2- 172.21.15.16:0/2190764010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62180feaf0 0x7f6218102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:36.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.188+0000 7f621cb9f640 1 -- 172.21.15.16:0/2190764010 >> 172.21.15.16:0/2190764010 conn(0x7f62180fa280 msgr2=0x7f6218067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:36.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.189+0000 7f621cb9f640 1 -- 172.21.15.16:0/2190764010 shutdown_connections 2024-08-01T06:57:36.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.189+0000 7f621cb9f640 1 -- 172.21.15.16:0/2190764010 wait complete. 2024-08-01T06:57:36.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.337+0000 7faadd472640 1 -- 172.21.15.16:0/3605902286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faad80ffc80 msgr2=0x7faad8100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:36.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.337+0000 7faadd472640 1 --2- 172.21.15.16:0/3605902286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faad80ffc80 0x7faad8100100 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7faac8009b60 tx=0x7faac802a770 comp rx=0 tx=0).stop 2024-08-01T06:57:36.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.338+0000 7faadd472640 1 -- 172.21.15.16:0/3605902286 shutdown_connections 2024-08-01T06:57:36.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.338+0000 7faadd472640 1 --2- 172.21.15.16:0/3605902286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faad80ffc80 0x7faad8100100 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:36.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.338+0000 7faadd472640 1 --2- 172.21.15.16:0/3605902286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faad80fea80 0x7faad80fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:36.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.338+0000 7faadd472640 1 -- 172.21.15.16:0/3605902286 >> 172.21.15.16:0/3605902286 conn(0x7faad80fa230 msgr2=0x7faad80fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:36.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.338+0000 7faadd472640 1 -- 172.21.15.16:0/3605902286 shutdown_connections 2024-08-01T06:57:36.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.338+0000 7faadd472640 1 -- 172.21.15.16:0/3605902286 wait complete. 2024-08-01T06:57:36.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.338+0000 7faadd472640 1 Processor -- start 2024-08-01T06:57:36.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.338+0000 7faadd472640 1 -- start start 2024-08-01T06:57:36.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.339+0000 7faadd472640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faad80fea80 0x7faad8102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:36.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.339+0000 7faadd472640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faad80ffc80 0x7faad8101060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:36.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.339+0000 7faadd472640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad81015a0 con 0x7faad80ffc80 2024-08-01T06:57:36.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.339+0000 7faadd472640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad8101710 con 0x7faad80fea80 2024-08-01T06:57:36.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.339+0000 7faacffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faad80ffc80 0x7faad8101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:36.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.339+0000 7faacffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faad80ffc80 0x7faad8101060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59964/0 (socket says 172.21.15.16:59964) 2024-08-01T06:57:36.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.339+0000 7faacffff640 1 -- 172.21.15.16:0/3279533302 learned_addr learned my addr 172.21.15.16:0/3279533302 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:57:36.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.339+0000 7faad6ffd640 1 --2- 172.21.15.16:0/3279533302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faad80fea80 0x7faad8102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:36.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.339+0000 7faacffff640 1 -- 172.21.15.16:0/3279533302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faad80fea80 msgr2=0x7faad8102a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:36.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.339+0000 7faacffff640 1 --2- 172.21.15.16:0/3279533302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faad80fea80 0x7faad8102a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:36.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.339+0000 7faacffff640 1 -- 172.21.15.16:0/3279533302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac0009560 con 0x7faad80ffc80 2024-08-01T06:57:36.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.340+0000 7faacffff640 1 --2- 172.21.15.16:0/3279533302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faad80ffc80 0x7faad8101060 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7faac8030950 tx=0x7faac8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:36.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.340+0000 7faad4ff9640 1 -- 172.21.15.16:0/3279533302 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faac8031610 con 0x7faad80ffc80 2024-08-01T06:57:36.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.340+0000 7faadd472640 1 -- 172.21.15.16:0/3279533302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac8009840 con 0x7faad80ffc80 2024-08-01T06:57:36.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.340+0000 7faad4ff9640 1 -- 172.21.15.16:0/3279533302 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faac8031c30 con 0x7faad80ffc80 2024-08-01T06:57:36.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.340+0000 7faadd472640 1 -- 172.21.15.16:0/3279533302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad8101d70 con 0x7faad80ffc80 2024-08-01T06:57:36.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.340+0000 7faad4ff9640 1 -- 172.21.15.16:0/3279533302 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faac80047e0 con 0x7faad80ffc80 2024-08-01T06:57:36.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.341+0000 7faadd472640 1 -- 172.21.15.16:0/3279533302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab8005280 con 0x7faad80ffc80 2024-08-01T06:57:36.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.342+0000 7faad4ff9640 1 -- 172.21.15.16:0/3279533302 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 30) v1 ==== 92166+0+0 (secure 0 0 0) 0x7faac8038070 con 0x7faad80ffc80 2024-08-01T06:57:36.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.342+0000 7faad4ff9640 1 --2- 172.21.15.16:0/3279533302 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7faac406df30 0x7faac40703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:36.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.343+0000 7faad4ff9640 1 -- 172.21.15.16:0/3279533302 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7faac80ae6b0 con 0x7faad80ffc80 2024-08-01T06:57:36.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.343+0000 7faad6ffd640 1 --2- 172.21.15.16:0/3279533302 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7faac406df30 0x7faac40703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:36.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.343+0000 7faad6ffd640 1 --2- 172.21.15.16:0/3279533302 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7faac406df30 0x7faac40703f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faac0009530 tx=0x7faac0009260 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:36.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.347+0000 7faad4ff9640 1 -- 172.21.15.16:0/3279533302 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7faac8077dd0 con 0x7faad80ffc80 2024-08-01T06:57:36.435 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:36 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:57:36.435 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:36 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/1510906176' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:57:36.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.664+0000 7faadd472640 1 -- 172.21.15.16:0/3279533302 --> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faab8000bf0 con 0x7faac406df30 2024-08-01T06:57:36.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.665+0000 7faad4ff9640 1 -- 172.21.15.16:0/3279533302 <== mgr.14720 v2:172.21.15.16:6800/4143462722 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7faab8000bf0 con 0x7faac406df30 2024-08-01T06:57:36.668 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:57:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T06:57:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T06:57:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T06:57:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-08-01T06:57:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-08-01T06:57:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-08-01T06:57:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "2/23 daemons upgraded", 2024-08-01T06:57:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "", 2024-08-01T06:57:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T06:57:36.669 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:57:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.668+0000 7faadd472640 1 -- 172.21.15.16:0/3279533302 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7faac406df30 msgr2=0x7faac40703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.668+0000 7faadd472640 1 --2- 172.21.15.16:0/3279533302 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7faac406df30 0x7faac40703f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faac0009530 tx=0x7faac0009260 comp rx=0 tx=0).stop 2024-08-01T06:57:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.668+0000 7faadd472640 1 -- 172.21.15.16:0/3279533302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faad80ffc80 msgr2=0x7faad8101060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.668+0000 7faadd472640 1 --2- 172.21.15.16:0/3279533302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faad80ffc80 0x7faad8101060 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7faac8030950 tx=0x7faac8003ba0 comp rx=0 tx=0).stop 2024-08-01T06:57:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.668+0000 7faadd472640 1 -- 172.21.15.16:0/3279533302 shutdown_connections 2024-08-01T06:57:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.668+0000 7faadd472640 1 --2- 172.21.15.16:0/3279533302 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7faac406df30 0x7faac40703f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.668+0000 7faadd472640 1 --2- 172.21.15.16:0/3279533302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faad80ffc80 0x7faad8101060 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.668+0000 7faadd472640 1 --2- 172.21.15.16:0/3279533302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faad80fea80 0x7faad8102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.668+0000 7faadd472640 1 -- 172.21.15.16:0/3279533302 >> 172.21.15.16:0/3279533302 conn(0x7faad80fa230 msgr2=0x7faad8068480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.668+0000 7faadd472640 1 -- 172.21.15.16:0/3279533302 shutdown_connections 2024-08-01T06:57:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.668+0000 7faadd472640 1 -- 172.21.15.16:0/3279533302 wait complete. 2024-08-01T06:57:36.697 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:36 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/2190764010' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:57:36.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.790+0000 7f331dc3e640 1 -- 172.21.15.16:0/3794944773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33180ffb90 msgr2=0x7f33180fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:36.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.790+0000 7f331dc3e640 1 --2- 172.21.15.16:0/3794944773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33180ffb90 0x7f33180fff90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3308009880 tx=0x7f330802a4a0 comp rx=0 tx=0).stop 2024-08-01T06:57:36.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.791+0000 7f331dc3e640 1 -- 172.21.15.16:0/3794944773 shutdown_connections 2024-08-01T06:57:36.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.791+0000 7f331dc3e640 1 --2- 172.21.15.16:0/3794944773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3318100d90 0x7f3318101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:36.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.791+0000 7f331dc3e640 1 --2- 172.21.15.16:0/3794944773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33180ffb90 0x7f33180fff90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:36.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.791+0000 7f331dc3e640 1 -- 172.21.15.16:0/3794944773 >> 172.21.15.16:0/3794944773 conn(0x7f33180fb320 msgr2=0x7f33180fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:36.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.791+0000 7f331dc3e640 1 -- 172.21.15.16:0/3794944773 shutdown_connections 2024-08-01T06:57:36.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.791+0000 7f331dc3e640 1 -- 172.21.15.16:0/3794944773 wait complete. 2024-08-01T06:57:36.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.791+0000 7f331dc3e640 1 Processor -- start 2024-08-01T06:57:36.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.792+0000 7f331dc3e640 1 -- start start 2024-08-01T06:57:36.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.792+0000 7f331dc3e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33180ffb90 0x7f33181955f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:36.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.792+0000 7f331dc3e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3318100d90 0x7f3318195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:36.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.792+0000 7f331dc3e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3318196100 con 0x7f33180ffb90 2024-08-01T06:57:36.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.792+0000 7f331dc3e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3318196270 con 0x7f3318100d90 2024-08-01T06:57:36.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.792+0000 7f33177fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33180ffb90 0x7f33181955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:36.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.792+0000 7f33177fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33180ffb90 0x7f33181955f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59978/0 (socket says 172.21.15.16:59978) 2024-08-01T06:57:36.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.792+0000 7f33177fe640 1 -- 172.21.15.16:0/243934760 learned_addr learned my addr 172.21.15.16:0/243934760 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:57:36.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.792+0000 7f3316ffd640 1 --2- 172.21.15.16:0/243934760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3318100d90 0x7f3318195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:36.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.793+0000 7f3316ffd640 1 -- 172.21.15.16:0/243934760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33180ffb90 msgr2=0x7f33181955f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:36.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.793+0000 7f3316ffd640 1 --2- 172.21.15.16:0/243934760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33180ffb90 0x7f33181955f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:36.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.793+0000 7f3316ffd640 1 -- 172.21.15.16:0/243934760 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3308009560 con 0x7f3318100d90 2024-08-01T06:57:36.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.793+0000 7f33177fe640 1 --2- 172.21.15.16:0/243934760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33180ffb90 0x7f33181955f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T06:57:36.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.793+0000 7f3316ffd640 1 --2- 172.21.15.16:0/243934760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3318100d90 0x7f3318195b30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f330c00d6d0 tx=0x7f330c00db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:36.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.793+0000 7f3314ff9640 1 -- 172.21.15.16:0/243934760 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f330c0051f0 con 0x7f3318100d90 2024-08-01T06:57:36.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.793+0000 7f3314ff9640 1 -- 172.21.15.16:0/243934760 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f330c004c60 con 0x7f3318100d90 2024-08-01T06:57:36.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.793+0000 7f3314ff9640 1 -- 172.21.15.16:0/243934760 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f330c009d30 con 0x7f3318100d90 2024-08-01T06:57:36.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.793+0000 7f331dc3e640 1 -- 172.21.15.16:0/243934760 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33180726e0 con 0x7f3318100d90 2024-08-01T06:57:36.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.793+0000 7f331dc3e640 1 -- 172.21.15.16:0/243934760 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3318072c60 con 0x7f3318100d90 2024-08-01T06:57:36.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.795+0000 7f331dc3e640 1 -- 172.21.15.16:0/243934760 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f331818f710 con 0x7f3318100d90 2024-08-01T06:57:36.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.796+0000 7f3314ff9640 1 -- 172.21.15.16:0/243934760 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 30) v1 ==== 92166+0+0 (secure 0 0 0) 0x7f330c0046c0 con 0x7f3318100d90 2024-08-01T06:57:36.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.796+0000 7f3314ff9640 1 --2- 172.21.15.16:0/243934760 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f330006df20 0x7f33000703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:57:36.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.796+0000 7f3314ff9640 1 -- 172.21.15.16:0/243934760 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f330c08ddf0 con 0x7f3318100d90 2024-08-01T06:57:36.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.797+0000 7f33177fe640 1 --2- 172.21.15.16:0/243934760 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f330006df20 0x7f33000703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:57:36.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.797+0000 7f33177fe640 1 --2- 172.21.15.16:0/243934760 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f330006df20 0x7f33000703e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3308000c00 tx=0x7f33080314e0 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:57:36.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:36.799+0000 7f3314ff9640 1 -- 172.21.15.16:0/243934760 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f330c0574f0 con 0x7f3318100d90 2024-08-01T06:57:36.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:36 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:57:36.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:36 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/1510906176' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:57:36.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:36 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/2190764010' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:57:37.196 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-08-01T06:57:37.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:37.192+0000 7f331dc3e640 1 -- 172.21.15.16:0/243934760 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3318108780 con 0x7f3318100d90 2024-08-01T06:57:37.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:37.193+0000 7f3314ff9640 1 -- 172.21.15.16:0/243934760 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f330c017090 con 0x7f3318100d90 2024-08-01T06:57:37.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:37.196+0000 7f331dc3e640 1 -- 172.21.15.16:0/243934760 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f330006df20 msgr2=0x7f33000703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:37.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:37.197+0000 7f331dc3e640 1 --2- 172.21.15.16:0/243934760 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f330006df20 0x7f33000703e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3308000c00 tx=0x7f33080314e0 comp rx=0 tx=0).stop 2024-08-01T06:57:37.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:37.197+0000 7f331dc3e640 1 -- 172.21.15.16:0/243934760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3318100d90 msgr2=0x7f3318195b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:57:37.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:37.197+0000 7f331dc3e640 1 --2- 172.21.15.16:0/243934760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3318100d90 0x7f3318195b30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f330c00d6d0 tx=0x7f330c00db90 comp rx=0 tx=0).stop 2024-08-01T06:57:37.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:37.198+0000 7f331dc3e640 1 -- 172.21.15.16:0/243934760 shutdown_connections 2024-08-01T06:57:37.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:37.198+0000 7f331dc3e640 1 --2- 172.21.15.16:0/243934760 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f330006df20 0x7f33000703e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:37.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:37.198+0000 7f331dc3e640 1 --2- 172.21.15.16:0/243934760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3318100d90 0x7f3318195b30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:37.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:37.198+0000 7f331dc3e640 1 --2- 172.21.15.16:0/243934760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33180ffb90 0x7f33181955f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:57:37.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:37.198+0000 7f331dc3e640 1 -- 172.21.15.16:0/243934760 >> 172.21.15.16:0/243934760 conn(0x7f33180fb320 msgr2=0x7f3318104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:57:37.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:37.198+0000 7f331dc3e640 1 -- 172.21.15.16:0/243934760 shutdown_connections 2024-08-01T06:57:37.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:57:37.199+0000 7f331dc3e640 1 -- 172.21.15.16:0/243934760 wait complete. 2024-08-01T06:57:37.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:37 smithi089 ceph-mon[36617]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:57:37.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:37 smithi089 ceph-mon[36617]: pgmap v19: 65 pgs: 65 active+clean; 258 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 765 op/s 2024-08-01T06:57:37.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:37 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/243934760' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:57:37.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:37 smithi016 ceph-mon[29266]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:57:37.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:37 smithi016 ceph-mon[29266]: pgmap v19: 65 pgs: 65 active+clean; 258 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 765 op/s 2024-08-01T06:57:37.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:37 smithi016 ceph-mon[29266]: from='client.? 172.21.15.16:0/243934760' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:57:38.724 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-08-01T06:57:38.724 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-08-01T06:57:39.011 DEBUG:teuthology.parallel:result is None 2024-08-01T06:57:40.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:40 smithi089 ceph-mon[36617]: pgmap v20: 65 pgs: 65 active+clean; 258 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 630 op/s 2024-08-01T06:57:40.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:40 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:40.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:40 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:40.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:40 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:57:40.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:40 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:57:40.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:40 smithi016 ceph-mon[29266]: pgmap v20: 65 pgs: 65 active+clean; 258 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 630 op/s 2024-08-01T06:57:40.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:40 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:40.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:40 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:40.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:40 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:57:40.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:40 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:57:41.307 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:41 smithi016 ceph-mon[29266]: Updating smithi016:/etc/ceph/ceph.conf 2024-08-01T06:57:41.308 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:41 smithi016 ceph-mon[29266]: Updating smithi089:/etc/ceph/ceph.conf 2024-08-01T06:57:41.308 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:41 smithi016 ceph-mon[29266]: Updating smithi089:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:57:41.308 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:41 smithi016 ceph-mon[29266]: Updating smithi016:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:57:41.308 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:41 smithi016 ceph-mon[29266]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-08-01T06:57:41.308 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:41 smithi016 ceph-mon[29266]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-08-01T06:57:41.308 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:41 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:41.308 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:41 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:41.308 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:41 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:41.308 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:41 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:41.308 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:41 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:41.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:41 smithi089 ceph-mon[36617]: Updating smithi016:/etc/ceph/ceph.conf 2024-08-01T06:57:41.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:41 smithi089 ceph-mon[36617]: Updating smithi089:/etc/ceph/ceph.conf 2024-08-01T06:57:41.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:41 smithi089 ceph-mon[36617]: Updating smithi089:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:57:41.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:41 smithi089 ceph-mon[36617]: Updating smithi016:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:57:41.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:41 smithi089 ceph-mon[36617]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-08-01T06:57:41.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:41 smithi089 ceph-mon[36617]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-08-01T06:57:41.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:41 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:41.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:41 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:41.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:41 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:41.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:41 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:41.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:41 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:42.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:42 smithi016 ceph-mon[29266]: Updating smithi089:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-01T06:57:42.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:42 smithi016 ceph-mon[29266]: Updating smithi016:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-01T06:57:42.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:42 smithi016 ceph-mon[29266]: pgmap v21: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 859 op/s 2024-08-01T06:57:42.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:42 smithi016 ceph-mon[29266]: Reconfiguring prometheus.smithi016 (dependencies changed)... 2024-08-01T06:57:42.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:42 smithi016 ceph-mon[29266]: Reconfiguring daemon prometheus.smithi016 on smithi016 2024-08-01T06:57:42.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:42 smithi089 ceph-mon[36617]: Updating smithi089:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-01T06:57:42.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:42 smithi089 ceph-mon[36617]: Updating smithi016:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-01T06:57:42.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:42 smithi089 ceph-mon[36617]: pgmap v21: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 859 op/s 2024-08-01T06:57:42.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:42 smithi089 ceph-mon[36617]: Reconfiguring prometheus.smithi016 (dependencies changed)... 2024-08-01T06:57:42.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:42 smithi089 ceph-mon[36617]: Reconfiguring daemon prometheus.smithi016 on smithi016 2024-08-01T06:57:44.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:44 smithi089 ceph-mon[36617]: pgmap v22: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 680 op/s 2024-08-01T06:57:44.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:44 smithi016 ceph-mon[29266]: pgmap v22: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 680 op/s 2024-08-01T06:57:46.330 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:46 smithi016 ceph-mon[29266]: pgmap v23: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 614 op/s 2024-08-01T06:57:46.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:46 smithi089 ceph-mon[36617]: pgmap v23: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 614 op/s 2024-08-01T06:57:48.369 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:48 smithi016 ceph-mon[29266]: pgmap v24: 65 pgs: 65 active+clean; 242 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 754 op/s 2024-08-01T06:57:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:48 smithi089 ceph-mon[36617]: pgmap v24: 65 pgs: 65 active+clean; 242 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 754 op/s 2024-08-01T06:57:50.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:50 smithi089 ceph-mon[36617]: pgmap v25: 65 pgs: 65 active+clean; 242 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1008 KiB/s wr, 369 op/s 2024-08-01T06:57:50.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:50 smithi016 ceph-mon[29266]: pgmap v25: 65 pgs: 65 active+clean; 242 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1008 KiB/s wr, 369 op/s 2024-08-01T06:57:51.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:51 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:51.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:51 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:51.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:51 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-01T06:57:51.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:51 smithi089 ceph-mon[36617]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-01T06:57:51.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:51 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:57:51.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:51 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:57:51.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:51 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:51.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:51 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:51.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:51 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-01T06:57:51.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:51 smithi016 ceph-mon[29266]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-01T06:57:51.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:51 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:57:51.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:51 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:57:52.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:52 smithi089 ceph-mon[36617]: pgmap v26: 65 pgs: 65 active+clean; 239 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 516 op/s 2024-08-01T06:57:52.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:52 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.hfgnsr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-01T06:57:52.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:52 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-01T06:57:52.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:52 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:57:52.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:52 smithi016 ceph-mon[29266]: pgmap v26: 65 pgs: 65 active+clean; 239 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 516 op/s 2024-08-01T06:57:52.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:52 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.hfgnsr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-01T06:57:52.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:52 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-01T06:57:52.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:52 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:57:53.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:53 smithi089 ceph-mon[36617]: Upgrade: Updating mgr.smithi089.hfgnsr 2024-08-01T06:57:53.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:53 smithi089 ceph-mon[36617]: Deploying daemon mgr.smithi089.hfgnsr on smithi089 2024-08-01T06:57:53.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:53 smithi016 ceph-mon[29266]: Upgrade: Updating mgr.smithi089.hfgnsr 2024-08-01T06:57:53.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:53 smithi016 ceph-mon[29266]: Deploying daemon mgr.smithi089.hfgnsr on smithi089 2024-08-01T06:57:54.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:54 smithi089 ceph-mon[36617]: pgmap v27: 65 pgs: 65 active+clean; 239 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 865 KiB/s rd, 940 KiB/s wr, 287 op/s 2024-08-01T06:57:54.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:54 smithi016 ceph-mon[29266]: pgmap v27: 65 pgs: 65 active+clean; 239 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 865 KiB/s rd, 940 KiB/s wr, 287 op/s 2024-08-01T06:57:56.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:56 smithi089 ceph-mon[36617]: pgmap v28: 65 pgs: 65 active+clean; 239 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 865 KiB/s rd, 940 KiB/s wr, 287 op/s 2024-08-01T06:57:56.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:56 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:56.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:56 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:56.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:56 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:57:56.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:56 smithi016 ceph-mon[29266]: pgmap v28: 65 pgs: 65 active+clean; 239 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 865 KiB/s rd, 940 KiB/s wr, 287 op/s 2024-08-01T06:57:56.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:56 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:56.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:56 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:56.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:56 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:57:57.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:57 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:57.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:57 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:57.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:57:57 smithi089 ceph-mon[36617]: pgmap v29: 65 pgs: 65 active+clean; 231 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 433 op/s 2024-08-01T06:57:57.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:57 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:57.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:57 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:57:57.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:57:57 smithi016 ceph-mon[29266]: pgmap v29: 65 pgs: 65 active+clean; 231 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 433 op/s 2024-08-01T06:57:59.659 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-08-01T06:57:59.660 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-01T06:57:59.986 DEBUG:teuthology.parallel:result is None 2024-08-01T06:57:59.987 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-01T06:58:00.021 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-01T06:58:00.021 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-08-01T06:58:00.056 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-08-01T06:58:00.057 DEBUG:teuthology.parallel:result is None 2024-08-01T06:58:00.564 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:00 smithi089 ceph-mon[36617]: pgmap v30: 65 pgs: 65 active+clean; 231 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 905 KiB/s rd, 971 KiB/s wr, 293 op/s 2024-08-01T06:58:00.564 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:00 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:00.564 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:00 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:00.565 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:00 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:00.565 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:00 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:00.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:00 smithi016 ceph-mon[29266]: pgmap v30: 65 pgs: 65 active+clean; 231 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 905 KiB/s rd, 971 KiB/s wr, 293 op/s 2024-08-01T06:58:00.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:00 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:00.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:00 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:00.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:00 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:00.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:00 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:02.552 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:02 smithi016 ceph-mon[29266]: pgmap v31: 65 pgs: 65 active+clean; 214 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 415 op/s 2024-08-01T06:58:02.552 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:02 smithi016 ceph-mon[29266]: Standby manager daemon smithi089.hfgnsr restarted 2024-08-01T06:58:02.552 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:02 smithi016 ceph-mon[29266]: Standby manager daemon smithi089.hfgnsr started 2024-08-01T06:58:02.552 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:02 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.89:0/2464839221' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/crt"}]: dispatch 2024-08-01T06:58:02.552 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:02 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.89:0/2464839221' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-01T06:58:02.552 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:02 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.89:0/2464839221' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/key"}]: dispatch 2024-08-01T06:58:02.552 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:02 smithi016 ceph-mon[29266]: from='mgr.? 172.21.15.89:0/2464839221' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-01T06:58:02.687 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:02 smithi089 ceph-mon[36617]: pgmap v31: 65 pgs: 65 active+clean; 214 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 415 op/s 2024-08-01T06:58:02.688 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:02 smithi089 ceph-mon[36617]: Standby manager daemon smithi089.hfgnsr restarted 2024-08-01T06:58:02.688 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:02 smithi089 ceph-mon[36617]: Standby manager daemon smithi089.hfgnsr started 2024-08-01T06:58:02.688 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:02 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/2464839221' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/crt"}]: dispatch 2024-08-01T06:58:02.688 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:02 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/2464839221' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-01T06:58:02.688 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:02 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/2464839221' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/key"}]: dispatch 2024-08-01T06:58:02.688 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:02 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/2464839221' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-01T06:58:03.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:03 smithi016 ceph-mon[29266]: mgrmap e31: smithi016.whigbo(active, since 57s), standbys: smithi089.hfgnsr 2024-08-01T06:58:03.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:03 smithi089 ceph-mon[36617]: mgrmap e31: smithi016.whigbo(active, since 57s), standbys: smithi089.hfgnsr 2024-08-01T06:58:04.523 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:04 smithi016 ceph-mon[29266]: pgmap v32: 65 pgs: 65 active+clean; 214 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 846 KiB/s rd, 818 KiB/s wr, 268 op/s 2024-08-01T06:58:04.523 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:04 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:04.523 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:04 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:04.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:04 smithi089 ceph-mon[36617]: pgmap v32: 65 pgs: 65 active+clean; 214 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 846 KiB/s rd, 818 KiB/s wr, 268 op/s 2024-08-01T06:58:04.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:04 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:04.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:04 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:05.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:05.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:05.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:05.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:58:05.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:05.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:58:05.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:58:05.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:05 smithi016 ceph-mon[29266]: Upgrade: Setting container_image for all mgr 2024-08-01T06:58:05.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:05.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi016.whigbo"}]: dispatch 2024-08-01T06:58:05.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi016.whigbo"}]': finished 2024-08-01T06:58:05.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi089.hfgnsr"}]: dispatch 2024-08-01T06:58:05.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi089.hfgnsr"}]': finished 2024-08-01T06:58:05.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-08-01T06:58:05.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:05 smithi016 ceph-mon[29266]: pgmap v33: 65 pgs: 65 active+clean; 214 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 846 KiB/s rd, 818 KiB/s wr, 268 op/s 2024-08-01T06:58:05.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:05 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:58:05.834 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:05.834 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:05.834 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:05.834 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:58:05.834 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:05.835 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:58:05.835 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:58:05.835 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:05 smithi089 ceph-mon[36617]: Upgrade: Setting container_image for all mgr 2024-08-01T06:58:05.835 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:05.835 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi016.whigbo"}]: dispatch 2024-08-01T06:58:05.835 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi016.whigbo"}]': finished 2024-08-01T06:58:05.835 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi089.hfgnsr"}]: dispatch 2024-08-01T06:58:05.835 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi089.hfgnsr"}]': finished 2024-08-01T06:58:05.835 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-08-01T06:58:05.835 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:05 smithi089 ceph-mon[36617]: pgmap v33: 65 pgs: 65 active+clean; 214 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 846 KiB/s rd, 818 KiB/s wr, 268 op/s 2024-08-01T06:58:05.835 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:05 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:58:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.295+0000 7fae84dc3640 1 -- 172.21.15.16:0/3763704052 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae800ffb90 msgr2=0x7fae800fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.295+0000 7fae84dc3640 1 --2- 172.21.15.16:0/3763704052 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae800ffb90 0x7fae800fff90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fae70009880 tx=0x7fae7002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.295+0000 7fae84dc3640 1 -- 172.21.15.16:0/3763704052 shutdown_connections 2024-08-01T06:58:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.295+0000 7fae84dc3640 1 --2- 172.21.15.16:0/3763704052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae80100d90 0x7fae80101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.295+0000 7fae84dc3640 1 --2- 172.21.15.16:0/3763704052 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae800ffb90 0x7fae800fff90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.295+0000 7fae84dc3640 1 -- 172.21.15.16:0/3763704052 >> 172.21.15.16:0/3763704052 conn(0x7fae800fb320 msgr2=0x7fae800fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.295+0000 7fae84dc3640 1 -- 172.21.15.16:0/3763704052 shutdown_connections 2024-08-01T06:58:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.295+0000 7fae84dc3640 1 -- 172.21.15.16:0/3763704052 wait complete. 2024-08-01T06:58:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.295+0000 7fae84dc3640 1 Processor -- start 2024-08-01T06:58:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.295+0000 7fae84dc3640 1 -- start start 2024-08-01T06:58:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.296+0000 7fae84dc3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae800ffb90 0x7fae80195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:07.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.296+0000 7fae84dc3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae80100d90 0x7fae80195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:07.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.296+0000 7fae84dc3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae80196180 con 0x7fae80100d90 2024-08-01T06:58:07.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.296+0000 7fae84dc3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae801962f0 con 0x7fae800ffb90 2024-08-01T06:58:07.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.296+0000 7fae7dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae80100d90 0x7fae80195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:07.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.296+0000 7fae7dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae80100d90 0x7fae80195bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59610/0 (socket says 172.21.15.16:59610) 2024-08-01T06:58:07.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.296+0000 7fae7dd9b640 1 -- 172.21.15.16:0/1173714811 learned_addr learned my addr 172.21.15.16:0/1173714811 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:58:07.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.296+0000 7fae7e59c640 1 --2- 172.21.15.16:0/1173714811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae800ffb90 0x7fae80195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:07.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.296+0000 7fae7dd9b640 1 -- 172.21.15.16:0/1173714811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae800ffb90 msgr2=0x7fae80195670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:07.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.296+0000 7fae7dd9b640 1 --2- 172.21.15.16:0/1173714811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae800ffb90 0x7fae80195670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.296+0000 7fae7dd9b640 1 -- 172.21.15.16:0/1173714811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae70009560 con 0x7fae80100d90 2024-08-01T06:58:07.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.296+0000 7fae7dd9b640 1 --2- 172.21.15.16:0/1173714811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae80100d90 0x7fae80195bb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fae7400c840 tx=0x7fae7400cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:07.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.297+0000 7fae6f7fe640 1 -- 172.21.15.16:0/1173714811 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae740041f0 con 0x7fae80100d90 2024-08-01T06:58:07.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.297+0000 7fae6f7fe640 1 -- 172.21.15.16:0/1173714811 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae74007e70 con 0x7fae80100d90 2024-08-01T06:58:07.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.297+0000 7fae84dc3640 1 -- 172.21.15.16:0/1173714811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8019ad20 con 0x7fae80100d90 2024-08-01T06:58:07.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.297+0000 7fae6f7fe640 1 -- 172.21.15.16:0/1173714811 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae740049d0 con 0x7fae80100d90 2024-08-01T06:58:07.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.297+0000 7fae84dc3640 1 -- 172.21.15.16:0/1173714811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8019b2f0 con 0x7fae80100d90 2024-08-01T06:58:07.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.298+0000 7fae84dc3640 1 -- 172.21.15.16:0/1173714811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae8018f710 con 0x7fae80100d90 2024-08-01T06:58:07.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.298+0000 7fae6f7fe640 1 -- 172.21.15.16:0/1173714811 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 31) v1 ==== 92166+0+0 (secure 0 0 0) 0x7fae740079b0 con 0x7fae80100d90 2024-08-01T06:58:07.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.299+0000 7fae6f7fe640 1 --2- 172.21.15.16:0/1173714811 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fae6806df30 0x7fae680703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:07.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.299+0000 7fae6f7fe640 1 -- 172.21.15.16:0/1173714811 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fae7408db30 con 0x7fae80100d90 2024-08-01T06:58:07.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.299+0000 7fae7e59c640 1 --2- 172.21.15.16:0/1173714811 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fae6806df30 0x7fae680703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:07.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.299+0000 7fae7e59c640 1 --2- 172.21.15.16:0/1173714811 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fae6806df30 0x7fae680703f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fae70005940 tx=0x7fae700058d0 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:07.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.304+0000 7fae6f7fe640 1 -- 172.21.15.16:0/1173714811 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fae74057250 con 0x7fae80100d90 2024-08-01T06:58:07.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.497+0000 7fae84dc3640 1 -- 172.21.15.16:0/1173714811 --> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae8002c4f0 con 0x7fae6806df30 2024-08-01T06:58:07.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.499+0000 7fae6f7fe640 1 -- 172.21.15.16:0/1173714811 <== mgr.14720 v2:172.21.15.16:6800/4143462722 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fae8002c4f0 con 0x7fae6806df30 2024-08-01T06:58:07.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.501+0000 7fae84dc3640 1 -- 172.21.15.16:0/1173714811 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fae6806df30 msgr2=0x7fae680703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:07.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.501+0000 7fae84dc3640 1 --2- 172.21.15.16:0/1173714811 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fae6806df30 0x7fae680703f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fae70005940 tx=0x7fae700058d0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.501+0000 7fae84dc3640 1 -- 172.21.15.16:0/1173714811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae80100d90 msgr2=0x7fae80195bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.501+0000 7fae84dc3640 1 --2- 172.21.15.16:0/1173714811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae80100d90 0x7fae80195bb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fae7400c840 tx=0x7fae7400cd00 comp rx=0 tx=0).stop 2024-08-01T06:58:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.501+0000 7fae84dc3640 1 -- 172.21.15.16:0/1173714811 shutdown_connections 2024-08-01T06:58:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.501+0000 7fae84dc3640 1 --2- 172.21.15.16:0/1173714811 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fae6806df30 0x7fae680703f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.501+0000 7fae84dc3640 1 --2- 172.21.15.16:0/1173714811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae80100d90 0x7fae80195bb0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.501+0000 7fae84dc3640 1 --2- 172.21.15.16:0/1173714811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae800ffb90 0x7fae80195670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.501+0000 7fae84dc3640 1 -- 172.21.15.16:0/1173714811 >> 172.21.15.16:0/1173714811 conn(0x7fae800fb320 msgr2=0x7fae80104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.501+0000 7fae84dc3640 1 -- 172.21.15.16:0/1173714811 shutdown_connections 2024-08-01T06:58:07.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.501+0000 7fae84dc3640 1 -- 172.21.15.16:0/1173714811 wait complete. 2024-08-01T06:58:07.511 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T06:58:07.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.585+0000 7fc974d42640 1 -- 172.21.15.16:0/2024174012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc970100d90 msgr2=0x7fc970101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:07.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.585+0000 7fc974d42640 1 --2- 172.21.15.16:0/2024174012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc970100d90 0x7fc970101210 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc958009880 tx=0x7fc95802a4a0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.585+0000 7fc974d42640 1 -- 172.21.15.16:0/2024174012 shutdown_connections 2024-08-01T06:58:07.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.585+0000 7fc974d42640 1 --2- 172.21.15.16:0/2024174012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc970100d90 0x7fc970101210 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.585+0000 7fc974d42640 1 --2- 172.21.15.16:0/2024174012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9700ffb90 0x7fc9700fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.585+0000 7fc974d42640 1 -- 172.21.15.16:0/2024174012 >> 172.21.15.16:0/2024174012 conn(0x7fc9700fb320 msgr2=0x7fc9700fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:07.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.585+0000 7fc974d42640 1 -- 172.21.15.16:0/2024174012 shutdown_connections 2024-08-01T06:58:07.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.585+0000 7fc974d42640 1 -- 172.21.15.16:0/2024174012 wait complete. 2024-08-01T06:58:07.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.586+0000 7fc974d42640 1 Processor -- start 2024-08-01T06:58:07.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.586+0000 7fc974d42640 1 -- start start 2024-08-01T06:58:07.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.586+0000 7fc974d42640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9700ffb90 0x7fc970195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:07.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.586+0000 7fc974d42640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc970100d90 0x7fc970195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:07.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.586+0000 7fc974d42640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc970196140 con 0x7fc9700ffb90 2024-08-01T06:58:07.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.586+0000 7fc974d42640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9701962b0 con 0x7fc970100d90 2024-08-01T06:58:07.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.587+0000 7fc96e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9700ffb90 0x7fc970195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:07.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.587+0000 7fc96e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9700ffb90 0x7fc970195630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59624/0 (socket says 172.21.15.16:59624) 2024-08-01T06:58:07.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.587+0000 7fc96e59c640 1 -- 172.21.15.16:0/2061626904 learned_addr learned my addr 172.21.15.16:0/2061626904 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:58:07.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.587+0000 7fc965d9b640 1 --2- 172.21.15.16:0/2061626904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc970100d90 0x7fc970195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:07.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.587+0000 7fc96e59c640 1 -- 172.21.15.16:0/2061626904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc970100d90 msgr2=0x7fc970195b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:07.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.587+0000 7fc96e59c640 1 --2- 172.21.15.16:0/2061626904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc970100d90 0x7fc970195b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.587+0000 7fc96e59c640 1 -- 172.21.15.16:0/2061626904 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc958009560 con 0x7fc9700ffb90 2024-08-01T06:58:07.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.587+0000 7fc96e59c640 1 --2- 172.21.15.16:0/2061626904 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9700ffb90 0x7fc970195630 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc96000c920 tx=0x7fc96000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:07.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.587+0000 7fc967fff640 1 -- 172.21.15.16:0/2061626904 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9600041f0 con 0x7fc9700ffb90 2024-08-01T06:58:07.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.587+0000 7fc974d42640 1 -- 172.21.15.16:0/2061626904 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97019ad50 con 0x7fc9700ffb90 2024-08-01T06:58:07.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.587+0000 7fc967fff640 1 -- 172.21.15.16:0/2061626904 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc960007e70 con 0x7fc9700ffb90 2024-08-01T06:58:07.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.587+0000 7fc967fff640 1 -- 172.21.15.16:0/2061626904 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9600049d0 con 0x7fc9700ffb90 2024-08-01T06:58:07.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.587+0000 7fc974d42640 1 -- 172.21.15.16:0/2061626904 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97019b290 con 0x7fc9700ffb90 2024-08-01T06:58:07.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.588+0000 7fc974d42640 1 -- 172.21.15.16:0/2061626904 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97018f730 con 0x7fc9700ffb90 2024-08-01T06:58:07.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.589+0000 7fc967fff640 1 -- 172.21.15.16:0/2061626904 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 31) v1 ==== 92166+0+0 (secure 0 0 0) 0x7fc960004350 con 0x7fc9700ffb90 2024-08-01T06:58:07.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.589+0000 7fc967fff640 1 --2- 172.21.15.16:0/2061626904 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fc95c06df30 0x7fc95c0703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:07.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.590+0000 7fc967fff640 1 -- 172.21.15.16:0/2061626904 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc96008db80 con 0x7fc9700ffb90 2024-08-01T06:58:07.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.590+0000 7fc965d9b640 1 --2- 172.21.15.16:0/2061626904 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fc95c06df30 0x7fc95c0703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:07.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.590+0000 7fc965d9b640 1 --2- 172.21.15.16:0/2061626904 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fc95c06df30 0x7fc95c0703f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc958000c00 tx=0x7fc9580314e0 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:07.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.594+0000 7fc967fff640 1 -- 172.21.15.16:0/2061626904 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fc960057220 con 0x7fc9700ffb90 2024-08-01T06:58:07.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.785+0000 7fc974d42640 1 -- 172.21.15.16:0/2061626904 --> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc97002c560 con 0x7fc95c06df30 2024-08-01T06:58:07.787 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:07 smithi016 ceph-mon[29266]: Upgrade: Updating mon.smithi016 2024-08-01T06:58:07.787 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:07 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:07.787 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:07 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-01T06:58:07.787 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:07 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-01T06:58:07.787 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:07 smithi016 ceph-mon[29266]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:07.787 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:07 smithi016 ceph-mon[29266]: Deploying daemon mon.smithi016 on smithi016 2024-08-01T06:58:07.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.786+0000 7fc967fff640 1 -- 172.21.15.16:0/2061626904 <== mgr.14720 v2:172.21.15.16:6800/4143462722 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fc97002c560 con 0x7fc95c06df30 2024-08-01T06:58:07.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.788+0000 7fc974d42640 1 -- 172.21.15.16:0/2061626904 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fc95c06df30 msgr2=0x7fc95c0703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:07.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.788+0000 7fc974d42640 1 --2- 172.21.15.16:0/2061626904 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fc95c06df30 0x7fc95c0703f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc958000c00 tx=0x7fc9580314e0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.788+0000 7fc974d42640 1 -- 172.21.15.16:0/2061626904 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9700ffb90 msgr2=0x7fc970195630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:07.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.788+0000 7fc974d42640 1 --2- 172.21.15.16:0/2061626904 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9700ffb90 0x7fc970195630 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc96000c920 tx=0x7fc96000cde0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.788+0000 7fc974d42640 1 -- 172.21.15.16:0/2061626904 shutdown_connections 2024-08-01T06:58:07.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.788+0000 7fc974d42640 1 --2- 172.21.15.16:0/2061626904 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fc95c06df30 0x7fc95c0703f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.788+0000 7fc974d42640 1 --2- 172.21.15.16:0/2061626904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc970100d90 0x7fc970195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.788+0000 7fc974d42640 1 --2- 172.21.15.16:0/2061626904 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9700ffb90 0x7fc970195630 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.788+0000 7fc974d42640 1 -- 172.21.15.16:0/2061626904 >> 172.21.15.16:0/2061626904 conn(0x7fc9700fb320 msgr2=0x7fc970104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:07.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.788+0000 7fc974d42640 1 -- 172.21.15.16:0/2061626904 shutdown_connections 2024-08-01T06:58:07.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.788+0000 7fc974d42640 1 -- 172.21.15.16:0/2061626904 wait complete. 2024-08-01T06:58:07.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.872+0000 7f218af0c640 1 -- 172.21.15.16:0/4211069388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21840ffcf0 msgr2=0x7f2184100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:07.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.872+0000 7f218af0c640 1 --2- 172.21.15.16:0/4211069388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21840ffcf0 0x7f2184100170 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2174009880 tx=0x7f217402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.872+0000 7f218af0c640 1 -- 172.21.15.16:0/4211069388 shutdown_connections 2024-08-01T06:58:07.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.872+0000 7f218af0c640 1 --2- 172.21.15.16:0/4211069388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21840ffcf0 0x7f2184100170 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.872+0000 7f218af0c640 1 --2- 172.21.15.16:0/4211069388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21840feaf0 0x7f21840feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.872+0000 7f218af0c640 1 -- 172.21.15.16:0/4211069388 >> 172.21.15.16:0/4211069388 conn(0x7f21840fa280 msgr2=0x7f21840fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:07.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.873+0000 7f218af0c640 1 -- 172.21.15.16:0/4211069388 shutdown_connections 2024-08-01T06:58:07.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.873+0000 7f218af0c640 1 -- 172.21.15.16:0/4211069388 wait complete. 2024-08-01T06:58:07.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.873+0000 7f218af0c640 1 Processor -- start 2024-08-01T06:58:07.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.873+0000 7f218af0c640 1 -- start start 2024-08-01T06:58:07.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.873+0000 7f218af0c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21840feaf0 0x7f21841956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:07.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.873+0000 7f218af0c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21840ffcf0 0x7f2184195c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:07.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.873+0000 7f218af0c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2184196140 con 0x7f21840feaf0 2024-08-01T06:58:07.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.873+0000 7f218af0c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21841962b0 con 0x7f21840ffcf0 2024-08-01T06:58:07.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.874+0000 7f2188ca8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21840feaf0 0x7f21841956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:07.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.874+0000 7f2188ca8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21840feaf0 0x7f21841956c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59650/0 (socket says 172.21.15.16:59650) 2024-08-01T06:58:07.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.874+0000 7f2188ca8640 1 -- 172.21.15.16:0/2434336458 learned_addr learned my addr 172.21.15.16:0/2434336458 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:58:07.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.874+0000 7f217bfff640 1 --2- 172.21.15.16:0/2434336458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21840ffcf0 0x7f2184195c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:07.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.874+0000 7f2188ca8640 1 -- 172.21.15.16:0/2434336458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21840ffcf0 msgr2=0x7f2184195c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:07.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.874+0000 7f2188ca8640 1 --2- 172.21.15.16:0/2434336458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21840ffcf0 0x7f2184195c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:07.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.874+0000 7f2188ca8640 1 -- 172.21.15.16:0/2434336458 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2174009560 con 0x7f21840feaf0 2024-08-01T06:58:07.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.874+0000 7f217bfff640 1 --2- 172.21.15.16:0/2434336458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21840ffcf0 0x7f2184195c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T06:58:07.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.874+0000 7f2188ca8640 1 --2- 172.21.15.16:0/2434336458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21840feaf0 0x7f21841956c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f218000c8f0 tx=0x7f218000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:07.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.874+0000 7f2179ffb640 1 -- 172.21.15.16:0/2434336458 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21800041f0 con 0x7f21840feaf0 2024-08-01T06:58:07.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.874+0000 7f2179ffb640 1 -- 172.21.15.16:0/2434336458 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2180007e10 con 0x7f21840feaf0 2024-08-01T06:58:07.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.874+0000 7f2179ffb640 1 -- 172.21.15.16:0/2434336458 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f218000f450 con 0x7f21840feaf0 2024-08-01T06:58:07.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.874+0000 7f218af0c640 1 -- 172.21.15.16:0/2434336458 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f218419ad90 con 0x7f21840feaf0 2024-08-01T06:58:07.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.875+0000 7f218af0c640 1 -- 172.21.15.16:0/2434336458 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f218419b200 con 0x7f21840feaf0 2024-08-01T06:58:07.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.876+0000 7f218af0c640 1 -- 172.21.15.16:0/2434336458 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21841076e0 con 0x7f21840feaf0 2024-08-01T06:58:07.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.876+0000 7f2179ffb640 1 -- 172.21.15.16:0/2434336458 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 31) v1 ==== 92166+0+0 (secure 0 0 0) 0x7f2180007950 con 0x7f21840feaf0 2024-08-01T06:58:07.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.877+0000 7f2179ffb640 1 --2- 172.21.15.16:0/2434336458 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f216c06df30 0x7f216c0703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:07.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.877+0000 7f2179ffb640 1 -- 172.21.15.16:0/2434336458 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f2180013070 con 0x7f21840feaf0 2024-08-01T06:58:07.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.877+0000 7f217bfff640 1 --2- 172.21.15.16:0/2434336458 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f216c06df30 0x7f216c0703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:07.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.877+0000 7f217bfff640 1 --2- 172.21.15.16:0/2434336458 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f216c06df30 0x7f216c0703f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2174000c00 tx=0x7f21740314e0 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:07.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:07.881+0000 7f2179ffb640 1 -- 172.21.15.16:0/2434336458 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f2180057590 con 0x7f21840feaf0 2024-08-01T06:58:07.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:07 smithi089 ceph-mon[36617]: Upgrade: Updating mon.smithi016 2024-08-01T06:58:07.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:07 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:07.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:07 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-01T06:58:07.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:07 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-01T06:58:07.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:07 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:07.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:07 smithi089 ceph-mon[36617]: Deploying daemon mon.smithi016 on smithi016 2024-08-01T06:58:08.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.066+0000 7f218af0c640 1 -- 172.21.15.16:0/2434336458 --> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f218419b4a0 con 0x7f216c06df30 2024-08-01T06:58:08.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.076+0000 7f2179ffb640 1 -- 172.21.15.16:0/2434336458 <== mgr.14720 v2:172.21.15.16:6800/4143462722 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f218419b4a0 con 0x7f216c06df30 2024-08-01T06:58:08.077 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T06:58:08.077 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (8m) 3s ago 10m 25.4M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T06:58:08.077 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (10m) 3s ago 10m 8112k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T06:58:08.078 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (9m) 8s ago 9m 7998k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T06:58:08.078 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (10m) 3s ago 10m 6895k - 18.2.2-1767-ga3bbd728 d280790d1980 81c723a6ae35 2024-08-01T06:58:08.078 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (9m) 8s ago 9m 6891k - 18.2.2-1767-ga3bbd728 d280790d1980 73e7778d1e26 2024-08-01T06:58:08.078 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (8m) 3s ago 9m 85.8M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T06:58:08.078 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (4m) 3s ago 4m 99.5M - 18.2.2-1767-ga3bbd728 d280790d1980 96e46c28d16c 2024-08-01T06:58:08.078 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (4m) 3s ago 4m 168M - 18.2.2-1767-ga3bbd728 d280790d1980 4bbe1a388689 2024-08-01T06:58:08.078 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (4m) 8s ago 4m 26.5M - 18.2.2-1767-ga3bbd728 d280790d1980 65ca121a6fbb 2024-08-01T06:58:08.078 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (4m) 8s ago 4m 25.2M - 18.2.2-1767-ga3bbd728 d280790d1980 05bb46c6fe94 2024-08-01T06:58:08.078 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:8443,9283,8765 running (75s) 3s ago 11m 489M - 19.1.0-1223-gf9911e17 93d93c74a2cc 8701e6315593 2024-08-01T06:58:08.078 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (12s) 8s ago 9m 54.2M - 19.1.0-1223-gf9911e17 93d93c74a2cc c6caa21f436f 2024-08-01T06:58:08.078 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (11m) 3s ago 11m 59.6M 2048M 18.2.2-1767-ga3bbd728 d280790d1980 e6a2e5d7eeec 2024-08-01T06:58:08.078 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (9m) 8s ago 9m 44.4M 2048M 18.2.2-1767-ga3bbd728 d280790d1980 9ca9e3e814cb 2024-08-01T06:58:08.078 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (10m) 3s ago 10m 15.9M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T06:58:08.079 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (9m) 8s ago 9m 16.4M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T06:58:08.079 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (8m) 3s ago 8m 237M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 9b7157499583 2024-08-01T06:58:08.079 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (7m) 3s ago 7m 241M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 f3b050aed6b7 2024-08-01T06:58:08.079 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (7m) 3s ago 7m 225M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 33a72e1a5c91 2024-08-01T06:58:08.079 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (7m) 8s ago 7m 274M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 58c175e0f4eb 2024-08-01T06:58:08.079 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (6m) 8s ago 6m 260M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 15b8f910bad7 2024-08-01T06:58:08.079 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (6m) 8s ago 6m 235M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 ac887841899e 2024-08-01T06:58:08.079 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (18s) 3s ago 9m 46.7M - 2.43.0 a07b618ecd1d 45d23c96382e 2024-08-01T06:58:08.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.078+0000 7f218af0c640 1 -- 172.21.15.16:0/2434336458 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f216c06df30 msgr2=0x7f216c0703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:08.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.078+0000 7f218af0c640 1 --2- 172.21.15.16:0/2434336458 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f216c06df30 0x7f216c0703f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2174000c00 tx=0x7f21740314e0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.078+0000 7f218af0c640 1 -- 172.21.15.16:0/2434336458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21840feaf0 msgr2=0x7f21841956c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:08.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.078+0000 7f218af0c640 1 --2- 172.21.15.16:0/2434336458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21840feaf0 0x7f21841956c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f218000c8f0 tx=0x7f218000cdb0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.078+0000 7f218af0c640 1 -- 172.21.15.16:0/2434336458 shutdown_connections 2024-08-01T06:58:08.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.078+0000 7f218af0c640 1 --2- 172.21.15.16:0/2434336458 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f216c06df30 0x7f216c0703f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.078+0000 7f218af0c640 1 --2- 172.21.15.16:0/2434336458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21840ffcf0 0x7f2184195c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.078+0000 7f218af0c640 1 --2- 172.21.15.16:0/2434336458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21840feaf0 0x7f21841956c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.078+0000 7f218af0c640 1 -- 172.21.15.16:0/2434336458 >> 172.21.15.16:0/2434336458 conn(0x7f21840fa280 msgr2=0x7f2184067d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:08.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.078+0000 7f218af0c640 1 -- 172.21.15.16:0/2434336458 shutdown_connections 2024-08-01T06:58:08.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.078+0000 7f218af0c640 1 -- 172.21.15.16:0/2434336458 wait complete. 2024-08-01T06:58:08.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.161+0000 7fab6a29b640 1 -- 172.21.15.16:0/2722224550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab64100d90 msgr2=0x7fab64101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.161+0000 7fab6a29b640 1 --2- 172.21.15.16:0/2722224550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab64100d90 0x7fab64101210 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fab58009880 tx=0x7fab5802a4a0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.161+0000 7fab6a29b640 1 -- 172.21.15.16:0/2722224550 shutdown_connections 2024-08-01T06:58:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.161+0000 7fab6a29b640 1 --2- 172.21.15.16:0/2722224550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab64100d90 0x7fab64101210 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.161+0000 7fab6a29b640 1 --2- 172.21.15.16:0/2722224550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab640ffb90 0x7fab640fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.161+0000 7fab6a29b640 1 -- 172.21.15.16:0/2722224550 >> 172.21.15.16:0/2722224550 conn(0x7fab640fb320 msgr2=0x7fab640fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.161+0000 7fab6a29b640 1 -- 172.21.15.16:0/2722224550 shutdown_connections 2024-08-01T06:58:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.161+0000 7fab6a29b640 1 -- 172.21.15.16:0/2722224550 wait complete. 2024-08-01T06:58:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.161+0000 7fab6a29b640 1 Processor -- start 2024-08-01T06:58:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.161+0000 7fab6a29b640 1 -- start start 2024-08-01T06:58:08.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.162+0000 7fab6a29b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab640ffb90 0x7fab641978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:08.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.162+0000 7fab6a29b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab64100d90 0x7fab64197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:08.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.162+0000 7fab6a29b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab641983c0 con 0x7fab64100d90 2024-08-01T06:58:08.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.162+0000 7fab6a29b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab64198530 con 0x7fab640ffb90 2024-08-01T06:58:08.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.162+0000 7fab637fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab64100d90 0x7fab64197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:08.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.162+0000 7fab637fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab64100d90 0x7fab64197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59662/0 (socket says 172.21.15.16:59662) 2024-08-01T06:58:08.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.162+0000 7fab637fe640 1 -- 172.21.15.16:0/1118374726 learned_addr learned my addr 172.21.15.16:0/1118374726 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:58:08.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.162+0000 7fab63fff640 1 --2- 172.21.15.16:0/1118374726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab640ffb90 0x7fab641978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:08.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.162+0000 7fab637fe640 1 -- 172.21.15.16:0/1118374726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab640ffb90 msgr2=0x7fab641978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:08.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.162+0000 7fab637fe640 1 --2- 172.21.15.16:0/1118374726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab640ffb90 0x7fab641978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.162+0000 7fab637fe640 1 -- 172.21.15.16:0/1118374726 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab58009560 con 0x7fab64100d90 2024-08-01T06:58:08.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.162+0000 7fab637fe640 1 --2- 172.21.15.16:0/1118374726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab64100d90 0x7fab64197df0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fab58005520 tx=0x7fab58005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:08.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.162+0000 7fab617fa640 1 -- 172.21.15.16:0/1118374726 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab58004aa0 con 0x7fab64100d90 2024-08-01T06:58:08.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.162+0000 7fab617fa640 1 -- 172.21.15.16:0/1118374726 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab58004c00 con 0x7fab64100d90 2024-08-01T06:58:08.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.162+0000 7fab6a29b640 1 -- 172.21.15.16:0/1118374726 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6419cf20 con 0x7fab64100d90 2024-08-01T06:58:08.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.163+0000 7fab617fa640 1 -- 172.21.15.16:0/1118374726 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab58003b10 con 0x7fab64100d90 2024-08-01T06:58:08.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.163+0000 7fab6a29b640 1 -- 172.21.15.16:0/1118374726 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6419d460 con 0x7fab64100d90 2024-08-01T06:58:08.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.164+0000 7fab6a29b640 1 -- 172.21.15.16:0/1118374726 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab641056d0 con 0x7fab64100d90 2024-08-01T06:58:08.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.164+0000 7fab617fa640 1 -- 172.21.15.16:0/1118374726 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 31) v1 ==== 92166+0+0 (secure 0 0 0) 0x7fab58003d40 con 0x7fab64100d90 2024-08-01T06:58:08.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.165+0000 7fab617fa640 1 --2- 172.21.15.16:0/1118374726 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fab4c06df30 0x7fab4c0703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:08.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.165+0000 7fab617fa640 1 -- 172.21.15.16:0/1118374726 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fab580aef60 con 0x7fab64100d90 2024-08-01T06:58:08.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.165+0000 7fab63fff640 1 --2- 172.21.15.16:0/1118374726 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fab4c06df30 0x7fab4c0703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:08.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.165+0000 7fab63fff640 1 --2- 172.21.15.16:0/1118374726 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fab4c06df30 0x7fab4c0703f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fab54005fd0 tx=0x7fab5400b390 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:08.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.170+0000 7fab617fa640 1 -- 172.21.15.16:0/1118374726 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fab580e3d10 con 0x7fab64100d90 2024-08-01T06:58:08.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.425+0000 7fab6a29b640 1 -- 172.21.15.16:0/1118374726 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fab64108a30 con 0x7fab64100d90 2024-08-01T06:58:08.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.426+0000 7fab617fa640 1 -- 172.21.15.16:0/1118374726 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7fab5809ae60 con 0x7fab64100d90 2024-08-01T06:58:08.427 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:58:08.428 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T06:58:08.428 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 2 2024-08-01T06:58:08.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:58:08.428 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T06:58:08.428 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T06:58:08.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:58:08.428 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T06:58:08.428 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 6 2024-08-01T06:58:08.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:58:08.428 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T06:58:08.428 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4 2024-08-01T06:58:08.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:58:08.429 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T06:58:08.429 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 12, 2024-08-01T06:58:08.429 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T06:58:08.429 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T06:58:08.429 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:58:08.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.428+0000 7fab6a29b640 1 -- 172.21.15.16:0/1118374726 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fab4c06df30 msgr2=0x7fab4c0703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:08.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.428+0000 7fab6a29b640 1 --2- 172.21.15.16:0/1118374726 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fab4c06df30 0x7fab4c0703f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fab54005fd0 tx=0x7fab5400b390 comp rx=0 tx=0).stop 2024-08-01T06:58:08.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.428+0000 7fab6a29b640 1 -- 172.21.15.16:0/1118374726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab64100d90 msgr2=0x7fab64197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:08.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.428+0000 7fab6a29b640 1 --2- 172.21.15.16:0/1118374726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab64100d90 0x7fab64197df0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fab58005520 tx=0x7fab58005550 comp rx=0 tx=0).stop 2024-08-01T06:58:08.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.428+0000 7fab6a29b640 1 -- 172.21.15.16:0/1118374726 shutdown_connections 2024-08-01T06:58:08.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.428+0000 7fab6a29b640 1 --2- 172.21.15.16:0/1118374726 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fab4c06df30 0x7fab4c0703f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.428+0000 7fab6a29b640 1 --2- 172.21.15.16:0/1118374726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab64100d90 0x7fab64197df0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.428+0000 7fab6a29b640 1 --2- 172.21.15.16:0/1118374726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab640ffb90 0x7fab641978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.428+0000 7fab6a29b640 1 -- 172.21.15.16:0/1118374726 >> 172.21.15.16:0/1118374726 conn(0x7fab640fb320 msgr2=0x7fab64072b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:08.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.428+0000 7fab6a29b640 1 -- 172.21.15.16:0/1118374726 shutdown_connections 2024-08-01T06:58:08.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.428+0000 7fab6a29b640 1 -- 172.21.15.16:0/1118374726 wait complete. 2024-08-01T06:58:08.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.514+0000 7f3f16f5c640 1 -- 172.21.15.16:0/706268321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f10102fb0 msgr2=0x7f3f101053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:08.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.514+0000 7f3f16f5c640 1 --2- 172.21.15.16:0/706268321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f10102fb0 0x7f3f101053a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0098b0 tx=0x7f3efc02a4d0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.514+0000 7f3f16f5c640 1 -- 172.21.15.16:0/706268321 shutdown_connections 2024-08-01T06:58:08.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.514+0000 7f3f16f5c640 1 --2- 172.21.15.16:0/706268321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f10102fb0 0x7f3f101053a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.514+0000 7f3f16f5c640 1 --2- 172.21.15.16:0/706268321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f10100680 0x7f3f10102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.514+0000 7f3f16f5c640 1 -- 172.21.15.16:0/706268321 >> 172.21.15.16:0/706268321 conn(0x7f3f100fa280 msgr2=0x7f3f100fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:08.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.514+0000 7f3f16f5c640 1 -- 172.21.15.16:0/706268321 shutdown_connections 2024-08-01T06:58:08.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.514+0000 7f3f16f5c640 1 -- 172.21.15.16:0/706268321 wait complete. 2024-08-01T06:58:08.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.515+0000 7f3f16f5c640 1 Processor -- start 2024-08-01T06:58:08.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.515+0000 7f3f16f5c640 1 -- start start 2024-08-01T06:58:08.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.515+0000 7f3f16f5c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f10100680 0x7f3f1019bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:08.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.515+0000 7f3f16f5c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f10102fb0 0x7f3f1019c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:08.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.515+0000 7f3f16f5c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1019c8c0 con 0x7f3f10100680 2024-08-01T06:58:08.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.515+0000 7f3f16f5c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1019ca30 con 0x7f3f10102fb0 2024-08-01T06:58:08.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.516+0000 7f3f14cf8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f10100680 0x7f3f1019bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:08.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.516+0000 7f3f14cf8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f10100680 0x7f3f1019bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59668/0 (socket says 172.21.15.16:59668) 2024-08-01T06:58:08.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.516+0000 7f3f14cf8640 1 -- 172.21.15.16:0/3724036237 learned_addr learned my addr 172.21.15.16:0/3724036237 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:58:08.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.516+0000 7f3f0ffff640 1 --2- 172.21.15.16:0/3724036237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f10102fb0 0x7f3f1019c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:08.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.516+0000 7f3f14cf8640 1 -- 172.21.15.16:0/3724036237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f10102fb0 msgr2=0x7f3f1019c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:08.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.516+0000 7f3f14cf8640 1 --2- 172.21.15.16:0/3724036237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f10102fb0 0x7f3f1019c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.516+0000 7f3f14cf8640 1 -- 172.21.15.16:0/3724036237 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc009560 con 0x7f3f10100680 2024-08-01T06:58:08.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.516+0000 7f3f14cf8640 1 --2- 172.21.15.16:0/3724036237 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f10100680 0x7f3f1019bdb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400b420 tx=0x7f3f0400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:08.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.516+0000 7f3f0dffb640 1 -- 172.21.15.16:0/3724036237 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f04011800 con 0x7f3f10100680 2024-08-01T06:58:08.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.516+0000 7f3f0dffb640 1 -- 172.21.15.16:0/3724036237 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f04011e20 con 0x7f3f10100680 2024-08-01T06:58:08.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.516+0000 7f3f0dffb640 1 -- 172.21.15.16:0/3724036237 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f0400f2e0 con 0x7f3f10100680 2024-08-01T06:58:08.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.516+0000 7f3f16f5c640 1 -- 172.21.15.16:0/3724036237 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f101a14c0 con 0x7f3f10100680 2024-08-01T06:58:08.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.517+0000 7f3f16f5c640 1 -- 172.21.15.16:0/3724036237 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f101a1a90 con 0x7f3f10100680 2024-08-01T06:58:08.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.518+0000 7f3f16f5c640 1 -- 172.21.15.16:0/3724036237 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f100fbdc0 con 0x7f3f10100680 2024-08-01T06:58:08.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.518+0000 7f3f0dffb640 1 -- 172.21.15.16:0/3724036237 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 31) v1 ==== 92166+0+0 (secure 0 0 0) 0x7f3f04010380 con 0x7f3f10100680 2024-08-01T06:58:08.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.519+0000 7f3f0dffb640 1 --2- 172.21.15.16:0/3724036237 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f3f0006df20 0x7f3f000703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:08.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.519+0000 7f3f0dffb640 1 -- 172.21.15.16:0/3724036237 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3f0408d610 con 0x7f3f10100680 2024-08-01T06:58:08.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.519+0000 7f3f0ffff640 1 --2- 172.21.15.16:0/3724036237 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f3f0006df20 0x7f3f000703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:08.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.520+0000 7f3f0ffff640 1 --2- 172.21.15.16:0/3724036237 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f3f0006df20 0x7f3f000703e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3efc009880 tx=0x7f3efc000bc0 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:08.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.524+0000 7f3f0dffb640 1 -- 172.21.15.16:0/3724036237 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f3f04056d90 con 0x7f3f10100680 2024-08-01T06:58:08.717 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:08 smithi089 ceph-mon[36617]: pgmap v34: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 878 KiB/s rd, 849 KiB/s wr, 292 op/s 2024-08-01T06:58:08.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.775+0000 7f3f16f5c640 1 -- 172.21.15.16:0/3724036237 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3f1002c3e0 con 0x7f3f10100680 2024-08-01T06:58:08.777 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:08 smithi016 ceph-mon[29266]: pgmap v34: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 878 KiB/s rd, 849 KiB/s wr, 292 op/s 2024-08-01T06:58:08.777 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:08 smithi016 systemd[1]: Stopping Ceph mon.smithi016 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T06:58:08.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.775+0000 7f3f0dffb640 1 -- 172.21.15.16:0/3724036237 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1868 (secure 0 0 0) 0x7f3f0405a450 con 0x7f3f10100680 2024-08-01T06:58:08.777 INFO:teuthology.orchestra.run.smithi016.stdout:e19 2024-08-01T06:58:08.777 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T06:58:08.777 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:58:08.778 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T06:58:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:58:08.778 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T06:58:08.778 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T06:58:08.778 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 19 2024-08-01T06:58:08.778 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T06:58:08.778 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T06:58:08.778 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T06:53:32.617145+0000 2024-08-01T06:58:08.778 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T06:58:08.778 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T06:58:08.778 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T06:58:08.778 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T06:58:08.778 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T06:58:08.779 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T06:58:08.779 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T06:58:08.779 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T06:58:08.779 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 46 2024-08-01T06:58:08.779 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:58:08.779 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T06:58:08.779 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T06:58:08.779 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=14482,1=24281} 2024-08-01T06:58:08.779 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T06:58:08.779 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T06:58:08.779 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T06:58:08.779 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T06:58:08.779 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T06:58:08.779 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T06:58:08.780 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T06:58:08.780 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T06:58:08.780 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T06:58:08.780 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:58:08.780 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:24299} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:58:08.780 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{1:24281} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:58:08.780 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:24291} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:58:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:58:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:58:08.781 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-08-01T06:58:08.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.777+0000 7f3f16f5c640 1 -- 172.21.15.16:0/3724036237 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f3f0006df20 msgr2=0x7f3f000703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:08.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.777+0000 7f3f16f5c640 1 --2- 172.21.15.16:0/3724036237 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f3f0006df20 0x7f3f000703e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3efc009880 tx=0x7f3efc000bc0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.778+0000 7f3f16f5c640 1 -- 172.21.15.16:0/3724036237 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f10100680 msgr2=0x7f3f1019bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:08.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.778+0000 7f3f16f5c640 1 --2- 172.21.15.16:0/3724036237 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f10100680 0x7f3f1019bdb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400b420 tx=0x7f3f0400b8e0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.778+0000 7f3f16f5c640 1 -- 172.21.15.16:0/3724036237 shutdown_connections 2024-08-01T06:58:08.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.778+0000 7f3f16f5c640 1 --2- 172.21.15.16:0/3724036237 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f3f0006df20 0x7f3f000703e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.778+0000 7f3f16f5c640 1 --2- 172.21.15.16:0/3724036237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f10102fb0 0x7f3f1019c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.778+0000 7f3f16f5c640 1 --2- 172.21.15.16:0/3724036237 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f10100680 0x7f3f1019bdb0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.778+0000 7f3f16f5c640 1 -- 172.21.15.16:0/3724036237 >> 172.21.15.16:0/3724036237 conn(0x7f3f100fa280 msgr2=0x7f3f101039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:08.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.778+0000 7f3f16f5c640 1 -- 172.21.15.16:0/3724036237 shutdown_connections 2024-08-01T06:58:08.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.778+0000 7f3f16f5c640 1 -- 172.21.15.16:0/3724036237 wait complete. 2024-08-01T06:58:08.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.868+0000 7fd33731f640 1 -- 172.21.15.16:0/2791669613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd330100d90 msgr2=0x7fd330101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:08.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.868+0000 7fd33731f640 1 --2- 172.21.15.16:0/2791669613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd330100d90 0x7fd330101210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd320009880 tx=0x7fd32002a4d0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.868+0000 7fd33731f640 1 -- 172.21.15.16:0/2791669613 shutdown_connections 2024-08-01T06:58:08.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.868+0000 7fd33731f640 1 --2- 172.21.15.16:0/2791669613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd330100d90 0x7fd330101210 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.869+0000 7fd33731f640 1 --2- 172.21.15.16:0/2791669613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3300ffb90 0x7fd3300fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.869+0000 7fd33731f640 1 -- 172.21.15.16:0/2791669613 >> 172.21.15.16:0/2791669613 conn(0x7fd3300fb320 msgr2=0x7fd3300fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:08.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.869+0000 7fd33731f640 1 -- 172.21.15.16:0/2791669613 shutdown_connections 2024-08-01T06:58:08.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.869+0000 7fd33731f640 1 -- 172.21.15.16:0/2791669613 wait complete. 2024-08-01T06:58:08.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.869+0000 7fd33731f640 1 Processor -- start 2024-08-01T06:58:08.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.869+0000 7fd33731f640 1 -- start start 2024-08-01T06:58:08.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.870+0000 7fd33731f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3300ffb90 0x7fd330195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:08.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.870+0000 7fd33731f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd330100d90 0x7fd330195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:08.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.870+0000 7fd33731f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd330196220 con 0x7fd3300ffb90 2024-08-01T06:58:08.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.870+0000 7fd33731f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd330196390 con 0x7fd330100d90 2024-08-01T06:58:08.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.870+0000 7fd3350bb640 1 -- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3300ffb90 msgr2=0x7fd330195710 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.16:3300/0 2024-08-01T06:58:08.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.870+0000 7fd3350bb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3300ffb90 0x7fd330195710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-01T06:58:08.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.870+0000 7fd3348ba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd330100d90 0x7fd330195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:08.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.870+0000 7fd3348ba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd330100d90 0x7fd330195c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:44720/0 (socket says 172.21.15.16:44720) 2024-08-01T06:58:08.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.870+0000 7fd3348ba640 1 -- 172.21.15.16:0/222718681 learned_addr learned my addr 172.21.15.16:0/222718681 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:58:08.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.870+0000 7fd3348ba640 1 -- 172.21.15.16:0/222718681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3300ffb90 msgr2=0x7fd330195710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-01T06:58:08.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.870+0000 7fd3348ba640 1 --2- 172.21.15.16:0/222718681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3300ffb90 0x7fd330195710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:08.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.870+0000 7fd3348ba640 1 -- 172.21.15.16:0/222718681 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd320009560 con 0x7fd330100d90 2024-08-01T06:58:08.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.870+0000 7fd3348ba640 1 --2- 172.21.15.16:0/222718681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd330100d90 0x7fd330195c50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd320031540 tx=0x7fd3200056c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:08.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.871+0000 7fd3267fc640 1 -- 172.21.15.16:0/222718681 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd320004c60 con 0x7fd330100d90 2024-08-01T06:58:08.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.871+0000 7fd3267fc640 1 -- 172.21.15.16:0/222718681 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd320004dc0 con 0x7fd330100d90 2024-08-01T06:58:08.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.871+0000 7fd33731f640 1 -- 172.21.15.16:0/222718681 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33019add0 con 0x7fd330100d90 2024-08-01T06:58:08.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.871+0000 7fd3267fc640 1 -- 172.21.15.16:0/222718681 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd320031b80 con 0x7fd330100d90 2024-08-01T06:58:08.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.871+0000 7fd33731f640 1 -- 172.21.15.16:0/222718681 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33019b340 con 0x7fd330100d90 2024-08-01T06:58:08.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.872+0000 7fd33731f640 1 -- 172.21.15.16:0/222718681 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd330108820 con 0x7fd330100d90 2024-08-01T06:58:08.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.872+0000 7fd3267fc640 1 -- 172.21.15.16:0/222718681 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 31) v1 ==== 92166+0+0 (secure 0 0 0) 0x7fd3200035f0 con 0x7fd330100d90 2024-08-01T06:58:08.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.873+0000 7fd3267fc640 1 --2- 172.21.15.16:0/222718681 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fd31c06de70 0x7fd31c070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:08.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.873+0000 7fd3267fc640 1 -- 172.21.15.16:0/222718681 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd3200af130 con 0x7fd330100d90 2024-08-01T06:58:08.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.873+0000 7fd3350bb640 1 --2- 172.21.15.16:0/222718681 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fd31c06de70 0x7fd31c070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:08.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.873+0000 7fd3350bb640 1 --2- 172.21.15.16:0/222718681 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fd31c06de70 0x7fd31c070330 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd32c000f20 tx=0x7fd32c006d70 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:08.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:08.877+0000 7fd3267fc640 1 -- 172.21.15.16:0/222718681 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fd320078720 con 0x7fd330100d90 2024-08-01T06:58:09.029 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:08 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016[29262]: 2024-08-01T06:58:08.797+0000 7f2baa534640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi016 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-01T06:58:09.030 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:08 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016[29262]: 2024-08-01T06:58:08.797+0000 7f2baa534640 -1 mon.smithi016@0(leader) e2 *** Got Signal Terminated *** 2024-08-01T06:58:09.030 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:08 smithi016 podman[93425]: 2024-08-01 06:58:08.879565666 +0000 UTC m=+0.208515476 container died e6a2e5d7eeecf90eb4155f077ee3ce88c7453ddc3ea99c8e8875a7cd074f5034 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, RELEASE=reef-a3bbd72) 2024-08-01T06:58:09.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.074+0000 7fd33731f640 1 -- 172.21.15.16:0/222718681 --> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd33019b530 con 0x7fd31c06de70 2024-08-01T06:58:09.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.075+0000 7fd3267fc640 1 -- 172.21.15.16:0/222718681 <== mgr.14720 v2:172.21.15.16:6800/4143462722 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fd33019b530 con 0x7fd31c06de70 2024-08-01T06:58:09.077 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:58:09.077 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T06:58:09.077 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T06:58:09.077 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T06:58:09.077 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-08-01T06:58:09.077 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-08-01T06:58:09.077 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-08-01T06:58:09.078 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "2/23 daemons upgraded", 2024-08-01T06:58:09.078 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading mon daemons", 2024-08-01T06:58:09.078 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T06:58:09.078 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:58:09.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.077+0000 7fd33731f640 1 -- 172.21.15.16:0/222718681 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fd31c06de70 msgr2=0x7fd31c070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:09.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.077+0000 7fd33731f640 1 --2- 172.21.15.16:0/222718681 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fd31c06de70 0x7fd31c070330 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd32c000f20 tx=0x7fd32c006d70 comp rx=0 tx=0).stop 2024-08-01T06:58:09.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.077+0000 7fd33731f640 1 -- 172.21.15.16:0/222718681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd330100d90 msgr2=0x7fd330195c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:09.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.077+0000 7fd33731f640 1 --2- 172.21.15.16:0/222718681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd330100d90 0x7fd330195c50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd320031540 tx=0x7fd3200056c0 comp rx=0 tx=0).stop 2024-08-01T06:58:09.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.078+0000 7fd33731f640 1 -- 172.21.15.16:0/222718681 shutdown_connections 2024-08-01T06:58:09.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.078+0000 7fd33731f640 1 --2- 172.21.15.16:0/222718681 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7fd31c06de70 0x7fd31c070330 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:09.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.078+0000 7fd33731f640 1 --2- 172.21.15.16:0/222718681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd330100d90 0x7fd330195c50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:09.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.078+0000 7fd33731f640 1 --2- 172.21.15.16:0/222718681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3300ffb90 0x7fd330195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:09.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.078+0000 7fd33731f640 1 -- 172.21.15.16:0/222718681 >> 172.21.15.16:0/222718681 conn(0x7fd3300fb320 msgr2=0x7fd330103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:09.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.078+0000 7fd33731f640 1 -- 172.21.15.16:0/222718681 shutdown_connections 2024-08-01T06:58:09.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.078+0000 7fd33731f640 1 -- 172.21.15.16:0/222718681 wait complete. 2024-08-01T06:58:09.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.163+0000 7f42664fd640 1 -- 172.21.15.16:0/409459435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42600ffb90 msgr2=0x7f42600fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:09.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.163+0000 7f42664fd640 1 --2- 172.21.15.16:0/409459435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42600ffb90 0x7f42600fff90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4250009880 tx=0x7f425002a4d0 comp rx=0 tx=0).stop 2024-08-01T06:58:09.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.163+0000 7f42664fd640 1 -- 172.21.15.16:0/409459435 shutdown_connections 2024-08-01T06:58:09.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.163+0000 7f42664fd640 1 --2- 172.21.15.16:0/409459435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4260100d90 0x7f4260101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:09.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.163+0000 7f42664fd640 1 --2- 172.21.15.16:0/409459435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42600ffb90 0x7f42600fff90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:09.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.163+0000 7f42664fd640 1 -- 172.21.15.16:0/409459435 >> 172.21.15.16:0/409459435 conn(0x7f42600fb320 msgr2=0x7f42600fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:09.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.163+0000 7f42664fd640 1 -- 172.21.15.16:0/409459435 shutdown_connections 2024-08-01T06:58:09.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.163+0000 7f42664fd640 1 -- 172.21.15.16:0/409459435 wait complete. 2024-08-01T06:58:09.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.164+0000 7f42664fd640 1 Processor -- start 2024-08-01T06:58:09.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.164+0000 7f42664fd640 1 -- start start 2024-08-01T06:58:09.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.164+0000 7f42664fd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42600ffb90 0x7f4260195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:09.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.164+0000 7f42664fd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4260100d90 0x7f4260195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:09.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.164+0000 7f42664fd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4260196220 con 0x7f42600ffb90 2024-08-01T06:58:09.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.164+0000 7f42664fd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4260196390 con 0x7f4260100d90 2024-08-01T06:58:09.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.164+0000 7f425ffff640 1 -- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42600ffb90 msgr2=0x7f4260195710 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.16:3300/0 2024-08-01T06:58:09.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.164+0000 7f425ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42600ffb90 0x7f4260195710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-01T06:58:09.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.165+0000 7f425f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4260100d90 0x7f4260195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:09.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.165+0000 7f425f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4260100d90 0x7f4260195c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:44740/0 (socket says 172.21.15.16:44740) 2024-08-01T06:58:09.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.165+0000 7f425f7fe640 1 -- 172.21.15.16:0/1665028547 learned_addr learned my addr 172.21.15.16:0/1665028547 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:58:09.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.165+0000 7f425f7fe640 1 -- 172.21.15.16:0/1665028547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42600ffb90 msgr2=0x7f4260195710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-01T06:58:09.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.165+0000 7f425f7fe640 1 --2- 172.21.15.16:0/1665028547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42600ffb90 0x7f4260195710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:09.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.165+0000 7f425f7fe640 1 -- 172.21.15.16:0/1665028547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4250009560 con 0x7f4260100d90 2024-08-01T06:58:09.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.165+0000 7f425f7fe640 1 --2- 172.21.15.16:0/1665028547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4260100d90 0x7f4260195c50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f425400b420 tx=0x7f425400b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:09.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.166+0000 7f425d7fa640 1 -- 172.21.15.16:0/1665028547 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4254011800 con 0x7f4260100d90 2024-08-01T06:58:09.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.166+0000 7f42664fd640 1 -- 172.21.15.16:0/1665028547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426019ae30 con 0x7f4260100d90 2024-08-01T06:58:09.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.166+0000 7f425d7fa640 1 -- 172.21.15.16:0/1665028547 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4254011e20 con 0x7f4260100d90 2024-08-01T06:58:09.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.166+0000 7f425d7fa640 1 -- 172.21.15.16:0/1665028547 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f425400f510 con 0x7f4260100d90 2024-08-01T06:58:09.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.166+0000 7f42664fd640 1 -- 172.21.15.16:0/1665028547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426019b370 con 0x7f4260100d90 2024-08-01T06:58:09.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.167+0000 7f42664fd640 1 -- 172.21.15.16:0/1665028547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4260108820 con 0x7f4260100d90 2024-08-01T06:58:09.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.167+0000 7f425d7fa640 1 -- 172.21.15.16:0/1665028547 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 31) v1 ==== 92166+0+0 (secure 0 0 0) 0x7f4254010380 con 0x7f4260100d90 2024-08-01T06:58:09.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.168+0000 7f425d7fa640 1 --2- 172.21.15.16:0/1665028547 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f424806ded0 0x7f4248070390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:09.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.168+0000 7f425d7fa640 1 -- 172.21.15.16:0/1665028547 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f425408d750 con 0x7f4260100d90 2024-08-01T06:58:09.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.168+0000 7f425ffff640 1 --2- 172.21.15.16:0/1665028547 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f424806ded0 0x7f4248070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:09.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.168+0000 7f425ffff640 1 --2- 172.21.15.16:0/1665028547 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f424806ded0 0x7f4248070390 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4250005790 tx=0x7f4250000bc0 comp rx=0 tx=0).ready entity=mgr.14720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:09.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.172+0000 7f425d7fa640 1 -- 172.21.15.16:0/1665028547 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f4254056e30 con 0x7f4260100d90 2024-08-01T06:58:09.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.433+0000 7f42664fd640 1 -- 172.21.15.16:0/1665028547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4260108a30 con 0x7f4260100d90 2024-08-01T06:58:09.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.433+0000 7f425d7fa640 1 -- 172.21.15.16:0/1665028547 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f425405a4f0 con 0x7f4260100d90 2024-08-01T06:58:09.435 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-08-01T06:58:09.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.435+0000 7f42664fd640 1 -- 172.21.15.16:0/1665028547 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f424806ded0 msgr2=0x7f4248070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:09.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.436+0000 7f42664fd640 1 --2- 172.21.15.16:0/1665028547 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f424806ded0 0x7f4248070390 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4250005790 tx=0x7f4250000bc0 comp rx=0 tx=0).stop 2024-08-01T06:58:09.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.436+0000 7f42664fd640 1 -- 172.21.15.16:0/1665028547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4260100d90 msgr2=0x7f4260195c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:09.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.436+0000 7f42664fd640 1 --2- 172.21.15.16:0/1665028547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4260100d90 0x7f4260195c50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f425400b420 tx=0x7f425400b8e0 comp rx=0 tx=0).stop 2024-08-01T06:58:09.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.436+0000 7f42664fd640 1 -- 172.21.15.16:0/1665028547 shutdown_connections 2024-08-01T06:58:09.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.436+0000 7f42664fd640 1 --2- 172.21.15.16:0/1665028547 >> [v2:172.21.15.16:6800/4143462722,v1:172.21.15.16:6801/4143462722] conn(0x7f424806ded0 0x7f4248070390 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:09.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.436+0000 7f42664fd640 1 --2- 172.21.15.16:0/1665028547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4260100d90 0x7f4260195c50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:09.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.436+0000 7f42664fd640 1 --2- 172.21.15.16:0/1665028547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42600ffb90 0x7f4260195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:09.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.436+0000 7f42664fd640 1 -- 172.21.15.16:0/1665028547 >> 172.21.15.16:0/1665028547 conn(0x7f42600fb320 msgr2=0x7f4260103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:09.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.436+0000 7f42664fd640 1 -- 172.21.15.16:0/1665028547 shutdown_connections 2024-08-01T06:58:09.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:09.436+0000 7f42664fd640 1 -- 172.21.15.16:0/1665028547 wait complete. 2024-08-01T06:58:09.634 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:09 smithi016 podman[93425]: 2024-08-01 06:58:09.356638041 +0000 UTC m=+0.685587850 container cleanup e6a2e5d7eeecf90eb4155f077ee3ce88c7453ddc3ea99c8e8875a7cd074f5034 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016, GIT_BRANCH=HEAD, org.label-schema.build-date=20240716, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=reef-a3bbd72, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-01T06:58:09.634 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:09 smithi016 bash[93425]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016 2024-08-01T06:58:09.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:09 smithi016 podman[93459]: 2024-08-01 06:58:09.633397902 +0000 UTC m=+0.747875464 container remove e6a2e5d7eeecf90eb4155f077ee3ce88c7453ddc3ea99c8e8875a7cd074f5034 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-a3bbd72, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.build-date=20240716, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-01T06:58:09.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:09 smithi016 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mon.smithi016.service: Deactivated successfully. 2024-08-01T06:58:09.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:09 smithi016 systemd[1]: Stopped Ceph mon.smithi016 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T06:58:09.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:09 smithi016 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mon.smithi016.service: Consumed 12.548s CPU time. 2024-08-01T06:58:10.363 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 systemd[1]: Starting Ceph mon.smithi016 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T06:58:10.364 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 podman[93626]: 2024-08-01 06:58:10.243332064 +0000 UTC m=+0.110716145 container create 48e94d076e6f3843438402bc47874c7db338d79e1acc4bfbd770192fbb72d75a (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=squid-f9911e1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-08-01T06:58:10.364 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 podman[93626]: 2024-08-01 06:58:10.150685755 +0000 UTC m=+0.018069857 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T06:58:10.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 podman[93626]: 2024-08-01 06:58:10.471139712 +0000 UTC m=+0.338523793 container init 48e94d076e6f3843438402bc47874c7db338d79e1acc4bfbd770192fbb72d75a (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016, org.label-schema.build-date=20240724, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-f9911e1) 2024-08-01T06:58:10.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 podman[93626]: 2024-08-01 06:58:10.474714703 +0000 UTC m=+0.342098785 container start 48e94d076e6f3843438402bc47874c7db338d79e1acc4bfbd770192fbb72d75a (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016, CEPH_POINT_RELEASE=, RELEASE=squid-f9911e1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-01T06:58:10.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: set uid:gid to 167:167 (ceph:ceph) 2024-08-01T06:58:10.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc), process ceph-mon, pid 2 2024-08-01T06:58:10.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: pidfile_write: ignore empty --pid-file 2024-08-01T06:58:10.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: load: jerasure load: lrc 2024-08-01T06:58:10.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: RocksDB version: 7.9.2 2024-08-01T06:58:10.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Git sha 0 2024-08-01T06:58:10.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Compile date 2024-07-30 20:41:45 2024-08-01T06:58:10.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: DB SUMMARY 2024-08-01T06:58:10.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: DB Session ID: F2WJBC4VX69OT1VOZRYT 2024-08-01T06:58:10.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: CURRENT file: CURRENT 2024-08-01T06:58:10.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: IDENTITY file: IDENTITY 2024-08-01T06:58:10.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1259 Bytes 2024-08-01T06:58:10.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi016/store.db dir, Total Num: 1, files: 000029.sst 2024-08-01T06:58:10.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi016/store.db: 000027.log size: 2935555 ; 2024-08-01T06:58:10.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.error_if_exists: 0 2024-08-01T06:58:10.651 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.create_if_missing: 0 2024-08-01T06:58:10.651 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.paranoid_checks: 1 2024-08-01T06:58:10.651 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-01T06:58:10.651 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-01T06:58:10.651 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-01T06:58:10.651 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.env: 0x563e56e787a0 2024-08-01T06:58:10.651 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.fs: PosixFileSystem 2024-08-01T06:58:10.651 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.info_log: 0x563e581cd6e0 2024-08-01T06:58:10.651 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_file_opening_threads: 16 2024-08-01T06:58:10.651 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.statistics: (nil) 2024-08-01T06:58:10.651 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.use_fsync: 0 2024-08-01T06:58:10.651 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_log_file_size: 0 2024-08-01T06:58:10.652 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-01T06:58:10.652 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-01T06:58:10.652 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.keep_log_file_num: 1000 2024-08-01T06:58:10.652 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.recycle_log_file_num: 0 2024-08-01T06:58:10.652 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.allow_fallocate: 1 2024-08-01T06:58:10.652 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.allow_mmap_reads: 0 2024-08-01T06:58:10.652 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.allow_mmap_writes: 0 2024-08-01T06:58:10.652 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.use_direct_reads: 0 2024-08-01T06:58:10.652 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-01T06:58:10.652 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.create_missing_column_families: 0 2024-08-01T06:58:10.652 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.db_log_dir: 2024-08-01T06:58:10.652 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.wal_dir: 2024-08-01T06:58:10.652 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-01T06:58:10.652 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-01T06:58:10.653 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-01T06:58:10.653 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-01T06:58:10.653 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-01T06:58:10.653 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-01T06:58:10.653 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.advise_random_on_open: 1 2024-08-01T06:58:10.653 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.db_write_buffer_size: 0 2024-08-01T06:58:10.653 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.write_buffer_manager: 0x563e581dcdc0 2024-08-01T06:58:10.653 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-01T06:58:10.653 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-01T06:58:10.653 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-01T06:58:10.653 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.rate_limiter: (nil) 2024-08-01T06:58:10.653 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-01T06:58:10.653 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.wal_recovery_mode: 2 2024-08-01T06:58:10.654 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.enable_thread_tracking: 0 2024-08-01T06:58:10.654 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.enable_pipelined_write: 0 2024-08-01T06:58:10.654 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.unordered_write: 0 2024-08-01T06:58:10.654 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-01T06:58:10.654 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-01T06:58:10.654 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-01T06:58:10.654 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-01T06:58:10.654 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.row_cache: None 2024-08-01T06:58:10.654 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.wal_filter: None 2024-08-01T06:58:10.656 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-01T06:58:10.656 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.allow_ingest_behind: 0 2024-08-01T06:58:10.656 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.two_write_queues: 0 2024-08-01T06:58:10.656 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.manual_wal_flush: 0 2024-08-01T06:58:10.656 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.wal_compression: 0 2024-08-01T06:58:10.656 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.atomic_flush: 0 2024-08-01T06:58:10.656 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-01T06:58:10.656 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-01T06:58:10.656 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-01T06:58:10.656 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.log_readahead_size: 0 2024-08-01T06:58:10.657 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-01T06:58:10.657 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.best_efforts_recovery: 0 2024-08-01T06:58:10.657 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-01T06:58:10.657 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-01T06:58:10.657 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.allow_data_in_errors: 0 2024-08-01T06:58:10.657 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.db_host_id: __hostname__ 2024-08-01T06:58:10.657 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-01T06:58:10.657 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_background_jobs: 2 2024-08-01T06:58:10.657 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_background_compactions: -1 2024-08-01T06:58:10.657 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_subcompactions: 1 2024-08-01T06:58:10.657 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-01T06:58:10.657 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-01T06:58:10.657 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-01T06:58:10.657 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_total_wal_size: 0 2024-08-01T06:58:10.658 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-01T06:58:10.658 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-01T06:58:10.658 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-01T06:58:10.658 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-01T06:58:10.658 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_open_files: -1 2024-08-01T06:58:10.658 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.bytes_per_sync: 0 2024-08-01T06:58:10.658 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-01T06:58:10.659 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-01T06:58:10.659 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compaction_readahead_size: 0 2024-08-01T06:58:10.659 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_background_flushes: -1 2024-08-01T06:58:10.659 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Compression algorithms supported: 2024-08-01T06:58:10.659 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: kZSTD supported: 0 2024-08-01T06:58:10.659 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: kXpressCompression supported: 0 2024-08-01T06:58:10.659 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: kBZip2Compression supported: 0 2024-08-01T06:58:10.659 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-01T06:58:10.659 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: kLZ4Compression supported: 1 2024-08-01T06:58:10.659 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: kZlibCompression supported: 1 2024-08-01T06:58:10.659 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: kLZ4HCCompression supported: 1 2024-08-01T06:58:10.659 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: kSnappyCompression supported: 1 2024-08-01T06:58:10.660 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-01T06:58:10.660 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-01T06:58:10.660 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi016/store.db/MANIFEST-000015 2024-08-01T06:58:10.660 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-01T06:58:10.660 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-01T06:58:10.660 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.merge_operator: 2024-08-01T06:58:10.660 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compaction_filter: None 2024-08-01T06:58:10.660 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compaction_filter_factory: None 2024-08-01T06:58:10.660 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.sst_partitioner_factory: None 2024-08-01T06:58:10.660 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-01T06:58:10.660 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-01T06:58:10.660 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563e581cd320) 2024-08-01T06:58:10.660 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: cache_index_and_filter_blocks: 1 2024-08-01T06:58:10.660 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-01T06:58:10.661 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-01T06:58:10.661 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: pin_top_level_index_and_filter: 1 2024-08-01T06:58:10.661 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: index_type: 0 2024-08-01T06:58:10.661 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: data_block_index_type: 0 2024-08-01T06:58:10.661 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: index_shortening: 1 2024-08-01T06:58:10.661 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-01T06:58:10.661 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: checksum: 4 2024-08-01T06:58:10.661 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: no_block_cache: 0 2024-08-01T06:58:10.661 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: block_cache: 0x563e581c1090 2024-08-01T06:58:10.661 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: block_cache_name: BinnedLRUCache 2024-08-01T06:58:10.661 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: block_cache_options: 2024-08-01T06:58:10.662 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: capacity : 536870912 2024-08-01T06:58:10.662 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: num_shard_bits : 4 2024-08-01T06:58:10.662 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: strict_capacity_limit : 0 2024-08-01T06:58:10.662 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: high_pri_pool_ratio: 0.000 2024-08-01T06:58:10.662 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: block_cache_compressed: (nil) 2024-08-01T06:58:10.662 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: persistent_cache: (nil) 2024-08-01T06:58:10.662 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: block_size: 4096 2024-08-01T06:58:10.662 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: block_size_deviation: 10 2024-08-01T06:58:10.662 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: block_restart_interval: 16 2024-08-01T06:58:10.663 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: index_block_restart_interval: 1 2024-08-01T06:58:10.663 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: metadata_block_size: 4096 2024-08-01T06:58:10.663 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: partition_filters: 0 2024-08-01T06:58:10.663 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: use_delta_encoding: 1 2024-08-01T06:58:10.663 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: filter_policy: bloomfilter 2024-08-01T06:58:10.663 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: whole_key_filtering: 1 2024-08-01T06:58:10.663 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: verify_compression: 0 2024-08-01T06:58:10.663 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: read_amp_bytes_per_bit: 0 2024-08-01T06:58:10.663 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: format_version: 5 2024-08-01T06:58:10.663 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: enable_index_compression: 1 2024-08-01T06:58:10.663 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: block_align: 0 2024-08-01T06:58:10.663 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: max_auto_readahead_size: 262144 2024-08-01T06:58:10.663 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: prepopulate_block_cache: 0 2024-08-01T06:58:10.663 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: initial_auto_readahead_size: 8192 2024-08-01T06:58:10.664 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: num_file_reads_for_auto_readahead: 2 2024-08-01T06:58:10.664 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.write_buffer_size: 33554432 2024-08-01T06:58:10.664 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_write_buffer_number: 2 2024-08-01T06:58:10.664 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compression: NoCompression 2024-08-01T06:58:10.664 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.bottommost_compression: Disabled 2024-08-01T06:58:10.664 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.prefix_extractor: nullptr 2024-08-01T06:58:10.664 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-01T06:58:10.664 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.num_levels: 7 2024-08-01T06:58:10.664 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-01T06:58:10.664 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-01T06:58:10.664 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-01T06:58:10.664 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-01T06:58:10.664 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-01T06:58:10.665 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-01T06:58:10.665 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-01T06:58:10.665 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-01T06:58:10.665 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-01T06:58:10.665 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-01T06:58:10.665 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-01T06:58:10.665 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-01T06:58:10.665 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-01T06:58:10.665 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compression_opts.level: 32767 2024-08-01T06:58:10.665 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compression_opts.strategy: 0 2024-08-01T06:58:10.665 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-01T06:58:10.665 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-01T06:58:10.665 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-01T06:58:10.665 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-01T06:58:10.666 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compression_opts.enabled: false 2024-08-01T06:58:10.666 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-01T06:58:10.666 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-01T06:58:10.666 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-01T06:58:10.666 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-01T06:58:10.666 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.target_file_size_base: 67108864 2024-08-01T06:58:10.666 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-01T06:58:10.666 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-01T06:58:10.666 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-01T06:58:10.666 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-01T06:58:10.667 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-01T06:58:10.667 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-01T06:58:10.667 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-01T06:58:10.667 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-01T06:58:10.667 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-01T06:58:10.667 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-01T06:58:10.667 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-01T06:58:10.667 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-01T06:58:10.667 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-01T06:58:10.668 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-01T06:58:10.668 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.arena_block_size: 1048576 2024-08-01T06:58:10.668 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-01T06:58:10.668 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-01T06:58:10.668 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.disable_auto_compactions: 0 2024-08-01T06:58:10.668 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-01T06:58:10.668 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-01T06:58:10.668 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-01T06:58:10.668 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-01T06:58:10.668 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-01T06:58:10.668 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-01T06:58:10.668 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-01T06:58:10.669 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-01T06:58:10.669 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-01T06:58:10.669 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-01T06:58:10.669 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-01T06:58:10.669 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.inplace_update_support: 0 2024-08-01T06:58:10.669 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-01T06:58:10.669 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-01T06:58:10.669 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-01T06:58:10.669 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-01T06:58:10.669 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.bloom_locality: 0 2024-08-01T06:58:10.669 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.max_successive_merges: 0 2024-08-01T06:58:10.669 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-01T06:58:10.669 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.paranoid_file_checks: 0 2024-08-01T06:58:10.670 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.force_consistency_checks: 1 2024-08-01T06:58:10.670 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.report_bg_io_stats: 0 2024-08-01T06:58:10.670 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.ttl: 2592000 2024-08-01T06:58:10.670 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-01T06:58:10.670 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-01T06:58:10.670 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-01T06:58:10.670 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.enable_blob_files: false 2024-08-01T06:58:10.671 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.min_blob_size: 0 2024-08-01T06:58:10.671 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.blob_file_size: 268435456 2024-08-01T06:58:10.671 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-01T06:58:10.671 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-01T06:58:10.671 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-01T06:58:10.671 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-01T06:58:10.671 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-01T06:58:10.671 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.blob_file_starting_level: 0 2024-08-01T06:58:10.671 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-01T06:58:10.671 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-08-01T06:58:10.671 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi016/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 31, last_sequence is 10307, log_number is 27,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 27 2024-08-01T06:58:10.672 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 27 2024-08-01T06:58:10.672 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 168c465c-f25c-4d36-86b1-acf937d77f8f 2024-08-01T06:58:10.672 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: EVENT_LOG_v1 {"time_micros": 1722495490502140, "job": 1, "event": "recovery_started", "wal_files": [27]} 2024-08-01T06:58:10.672 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #27 mode 2 2024-08-01T06:58:10.672 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: EVENT_LOG_v1 {"time_micros": 1722495490513466, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 32, "file_size": 2674668, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10309, "largest_seqno": 11626, "table_properties": {"data_size": 2667682, "index_size": 4469, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1477, "raw_key_size": 13203, "raw_average_key_size": 22, "raw_value_size": 2654771, "raw_average_value_size": 4585, "num_data_blocks": 204, "num_entries": 579, "num_filter_entries": 579, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1722495490, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "168c465c-f25c-4d36-86b1-acf937d77f8f", "db_session_id": "F2WJBC4VX69OT1VOZRYT", "orig_file_number": 32, "seqno_to_time_mapping": "N/A"}} 2024-08-01T06:58:10.672 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: EVENT_LOG_v1 {"time_micros": 1722495490513611, "job": 1, "event": "recovery_finished"} 2024-08-01T06:58:10.672 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: [db/version_set.cc:5047] Creating manifest 34 2024-08-01T06:58:10.672 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-08-01T06:58:10.672 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi016/store.db/000027.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-01T06:58:10.672 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563e581eee00 2024-08-01T06:58:10.673 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: DB pointer 0x563e582e8000 2024-08-01T06:58:10.673 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-01T06:58:10.673 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-01T06:58:10.673 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: ** DB Stats ** 2024-08-01T06:58:10.673 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-01T06:58:10.674 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-01T06:58:10.674 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-01T06:58:10.674 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-01T06:58:10.674 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-01T06:58:10.674 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-01T06:58:10.675 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-01T06:58:10.675 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: 2024-08-01T06:58:10.675 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: ** Compaction Stats [default] ** 2024-08-01T06:58:10.675 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-01T06:58:10.676 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-01T06:58:10.676 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: L0 1/0 2.55 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 578.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-08-01T06:58:10.676 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: L6 1/0 5.00 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-08-01T06:58:10.676 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Sum 2/0 7.55 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 578.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-08-01T06:58:10.676 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 578.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-08-01T06:58:10.676 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: 2024-08-01T06:58:10.676 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: ** Compaction Stats [default] ** 2024-08-01T06:58:10.677 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-01T06:58:10.677 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-01T06:58:10.677 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 578.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-08-01T06:58:10.677 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: 2024-08-01T06:58:10.677 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-01T06:58:10.677 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: 2024-08-01T06:58:10.678 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-01T06:58:10.678 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-08-01T06:58:10.678 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-01T06:58:10.678 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-01T06:58:10.678 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-01T06:58:10.679 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-01T06:58:10.679 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Cumulative compaction: 0.00 GB write, 176.92 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-01T06:58:10.679 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Interval compaction: 0.00 GB write, 176.92 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-01T06:58:10.679 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-01T06:58:10.679 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Block cache BinnedLRUCache@0x563e581c1090#2 capacity: 512.00 MB usage: 6.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-08-01T06:58:10.679 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.53 KB,0.000292063%) IndexBlock(1,4.58 KB,0.000873208%) Misc(1,0.00 KB,0%) 2024-08-01T06:58:10.680 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: 2024-08-01T06:58:10.680 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-01T06:58:10.680 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: starting mon.smithi016 rank 0 at public addrs [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] at bind addrs [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi016 fsid a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:58:10.680 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: mon.smithi016@-1(???) e2 preinit fsid a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:58:10.680 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: mon.smithi016@-1(???).mds e19 new map 2024-08-01T06:58:10.680 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: mon.smithi016@-1(???).mds e19 print_map 2024-08-01T06:58:10.680 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: e19 2024-08-01T06:58:10.680 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-08-01T06:58:10.680 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T06:58:10.680 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:58:10.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: legacy client fscid: 1 2024-08-01T06:58:10.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: 2024-08-01T06:58:10.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Filesystem 'cephfs' (1) 2024-08-01T06:58:10.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: fs_name cephfs 2024-08-01T06:58:10.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: epoch 19 2024-08-01T06:58:10.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T06:58:10.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: created 2024-08-01T06:53:13.411160+0000 2024-08-01T06:58:10.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: modified 2024-08-01T06:53:32.617145+0000 2024-08-01T06:58:10.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: tableserver 0 2024-08-01T06:58:10.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: root 0 2024-08-01T06:58:10.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: session_timeout 60 2024-08-01T06:58:10.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: session_autoclose 300 2024-08-01T06:58:10.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: max_file_size 1099511627776 2024-08-01T06:58:10.681 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: max_xattr_size 65536 2024-08-01T06:58:10.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: required_client_features {} 2024-08-01T06:58:10.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: last_failure 0 2024-08-01T06:58:10.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: last_failure_osd_epoch 46 2024-08-01T06:58:10.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:58:10.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: max_mds 2 2024-08-01T06:58:10.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: in 0,1 2024-08-01T06:58:10.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: up {0=14482,1=24281} 2024-08-01T06:58:10.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: failed 2024-08-01T06:58:10.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: damaged 2024-08-01T06:58:10.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: stopped 2024-08-01T06:58:10.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: data_pools [3] 2024-08-01T06:58:10.682 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: metadata_pool 2 2024-08-01T06:58:10.683 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: inline_data disabled 2024-08-01T06:58:10.683 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: balancer 2024-08-01T06:58:10.683 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: bal_rank_mask -1 2024-08-01T06:58:10.683 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: standby_count_wanted 1 2024-08-01T06:58:10.683 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: qdb_cluster leader: 0 members: 2024-08-01T06:58:10.683 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: [mds.cephfs.smithi016.fziqod{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:58:10.683 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: [mds.cephfs.smithi016.bgqkxu{0:24299} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:58:10.683 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: [mds.cephfs.smithi089.jhouje{1:24281} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:58:10.683 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: [mds.cephfs.smithi089.xanuld{1:24291} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:58:10.683 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: 2024-08-01T06:58:10.683 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: 2024-08-01T06:58:10.683 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: mon.smithi016@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-08-01T06:58:10.683 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: mon.smithi016@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-08-01T06:58:10.684 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: mon.smithi016@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-08-01T06:58:10.684 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: mon.smithi016@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-08-01T06:58:10.684 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 ceph-mon[93645]: mon.smithi016@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-08-01T06:58:10.684 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 bash[93626]: 48e94d076e6f3843438402bc47874c7db338d79e1acc4bfbd770192fbb72d75a 2024-08-01T06:58:10.684 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:10 smithi016 systemd[1]: Started Ceph mon.smithi016 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T06:58:12.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:58:12.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:58:12.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: pgmap v35: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 407 KiB/s rd, 389 KiB/s wr, 146 op/s 2024-08-01T06:58:12.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: from='client.24597 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:58:12.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: from='client.? 172.21.15.16:0/1665028547' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:58:12.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: pgmap v36: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 408 KiB/s rd, 389 KiB/s wr, 148 op/s 2024-08-01T06:58:12.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: mon.smithi016 calling monitor election 2024-08-01T06:58:12.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: mon.smithi016 is new leader, mons smithi016,smithi089 in quorum (ranks 0,1) 2024-08-01T06:58:12.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: monmap epoch 2 2024-08-01T06:58:12.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: fsid a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:58:12.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: last_changed 2024-08-01T06:49:00.990417+0000 2024-08-01T06:58:12.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: created 2024-08-01T06:46:30.398884+0000 2024-08-01T06:58:12.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: min_mon_release 18 (reef) 2024-08-01T06:58:12.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: election_strategy: 1 2024-08-01T06:58:12.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.smithi016 2024-08-01T06:58:12.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: 1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.smithi089 2024-08-01T06:58:12.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: fsmap cephfs:2 {0=cephfs.smithi016.fziqod=up:active,1=cephfs.smithi089.jhouje=up:active} 2 up:standby-replay 2024-08-01T06:58:12.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: osdmap e48: 6 total, 6 up, 6 in 2024-08-01T06:58:12.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: mgrmap e31: smithi016.whigbo(active, since 66s), standbys: smithi089.hfgnsr 2024-08-01T06:58:12.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: overall HEALTH_OK 2024-08-01T06:58:12.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: from='mgr.14720 ' entity='' 2024-08-01T06:58:12.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:11 smithi089 ceph-mon[36617]: mgrmap e32: smithi016.whigbo(active, since 66s), standbys: smithi089.hfgnsr 2024-08-01T06:58:12.257 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:58:12.258 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: from='mgr.14720 172.21.15.16:0/1942761746' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:58:12.258 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: pgmap v35: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 407 KiB/s rd, 389 KiB/s wr, 146 op/s 2024-08-01T06:58:12.258 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: from='client.24597 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:58:12.258 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/1665028547' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:58:12.258 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: pgmap v36: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 408 KiB/s rd, 389 KiB/s wr, 148 op/s 2024-08-01T06:58:12.259 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: mon.smithi016 calling monitor election 2024-08-01T06:58:12.259 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: mon.smithi016 is new leader, mons smithi016,smithi089 in quorum (ranks 0,1) 2024-08-01T06:58:12.259 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: monmap epoch 2 2024-08-01T06:58:12.259 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: fsid a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:58:12.259 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: last_changed 2024-08-01T06:49:00.990417+0000 2024-08-01T06:58:12.260 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: created 2024-08-01T06:46:30.398884+0000 2024-08-01T06:58:12.260 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: min_mon_release 18 (reef) 2024-08-01T06:58:12.260 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: election_strategy: 1 2024-08-01T06:58:12.260 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.smithi016 2024-08-01T06:58:12.260 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: 1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.smithi089 2024-08-01T06:58:12.260 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: fsmap cephfs:2 {0=cephfs.smithi016.fziqod=up:active,1=cephfs.smithi089.jhouje=up:active} 2 up:standby-replay 2024-08-01T06:58:12.260 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: osdmap e48: 6 total, 6 up, 6 in 2024-08-01T06:58:12.260 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: mgrmap e31: smithi016.whigbo(active, since 66s), standbys: smithi089.hfgnsr 2024-08-01T06:58:12.261 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: overall HEALTH_OK 2024-08-01T06:58:12.261 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: from='mgr.14720 ' entity='' 2024-08-01T06:58:12.261 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:11 smithi016 ceph-mon[93645]: mgrmap e32: smithi016.whigbo(active, since 66s), standbys: smithi089.hfgnsr 2024-08-01T06:58:16.794 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:16 smithi089 ceph-mon[36617]: Standby manager daemon smithi089.hfgnsr restarted 2024-08-01T06:58:16.794 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:16 smithi089 ceph-mon[36617]: Standby manager daemon smithi089.hfgnsr started 2024-08-01T06:58:16.794 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:16 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/688715876' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/crt"}]: dispatch 2024-08-01T06:58:16.795 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:16 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/688715876' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-01T06:58:16.795 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:16 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/688715876' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/key"}]: dispatch 2024-08-01T06:58:16.795 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:16 smithi089 ceph-mon[36617]: from='mgr.? 172.21.15.89:0/688715876' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-01T06:58:17.031 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:16 smithi016 ceph-mon[93645]: Standby manager daemon smithi089.hfgnsr restarted 2024-08-01T06:58:17.031 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:16 smithi016 ceph-mon[93645]: Standby manager daemon smithi089.hfgnsr started 2024-08-01T06:58:17.031 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:16 smithi016 ceph-mon[93645]: from='mgr.? 172.21.15.89:0/688715876' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/crt"}]: dispatch 2024-08-01T06:58:17.031 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:16 smithi016 ceph-mon[93645]: from='mgr.? 172.21.15.89:0/688715876' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-01T06:58:17.031 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:16 smithi016 ceph-mon[93645]: from='mgr.? 172.21.15.89:0/688715876' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.hfgnsr/key"}]: dispatch 2024-08-01T06:58:17.031 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:16 smithi016 ceph-mon[93645]: from='mgr.? 172.21.15.89:0/688715876' entity='mgr.smithi089.hfgnsr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-01T06:58:18.043 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: mgrmap e33: smithi016.whigbo(active, since 71s), standbys: smithi089.hfgnsr 2024-08-01T06:58:18.043 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: Active manager daemon smithi016.whigbo restarted 2024-08-01T06:58:18.043 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: Activating manager daemon smithi016.whigbo 2024-08-01T06:58:18.043 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: osdmap e49: 6 total, 6 up, 6 in 2024-08-01T06:58:18.043 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: mgrmap e34: smithi016.whigbo(active, starting, since 0.00557523s), standbys: smithi089.hfgnsr 2024-08-01T06:58:18.044 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:58:18.044 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:58:18.044 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.fziqod"}]: dispatch 2024-08-01T06:58:18.044 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.jhouje"}]: dispatch 2024-08-01T06:58:18.044 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.xanuld"}]: dispatch 2024-08-01T06:58:18.044 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.bgqkxu"}]: dispatch 2024-08-01T06:58:18.044 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr metadata", "who": "smithi016.whigbo", "id": "smithi016.whigbo"}]: dispatch 2024-08-01T06:58:18.044 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr metadata", "who": "smithi089.hfgnsr", "id": "smithi089.hfgnsr"}]: dispatch 2024-08-01T06:58:18.044 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:58:18.044 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-01T06:58:18.044 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T06:58:18.044 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-01T06:58:18.044 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T06:58:18.045 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T06:58:18.045 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-01T06:58:18.045 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-01T06:58:18.045 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-01T06:58:18.045 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: Manager daemon smithi016.whigbo is now available 2024-08-01T06:58:18.045 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:58:18.045 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:58:18.045 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi016.whigbo/mirror_snapshot_schedule"}]: dispatch 2024-08-01T06:58:18.045 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi016.whigbo/trash_purge_schedule"}]: dispatch 2024-08-01T06:58:18.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: mgrmap e33: smithi016.whigbo(active, since 71s), standbys: smithi089.hfgnsr 2024-08-01T06:58:18.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: Active manager daemon smithi016.whigbo restarted 2024-08-01T06:58:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: Activating manager daemon smithi016.whigbo 2024-08-01T06:58:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: osdmap e49: 6 total, 6 up, 6 in 2024-08-01T06:58:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: mgrmap e34: smithi016.whigbo(active, starting, since 0.00557523s), standbys: smithi089.hfgnsr 2024-08-01T06:58:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:58:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:58:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.fziqod"}]: dispatch 2024-08-01T06:58:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.jhouje"}]: dispatch 2024-08-01T06:58:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.xanuld"}]: dispatch 2024-08-01T06:58:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.bgqkxu"}]: dispatch 2024-08-01T06:58:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr metadata", "who": "smithi016.whigbo", "id": "smithi016.whigbo"}]: dispatch 2024-08-01T06:58:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr metadata", "who": "smithi089.hfgnsr", "id": "smithi089.hfgnsr"}]: dispatch 2024-08-01T06:58:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:58:18.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-01T06:58:18.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T06:58:18.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-01T06:58:18.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T06:58:18.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T06:58:18.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-01T06:58:18.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-01T06:58:18.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-01T06:58:18.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: Manager daemon smithi016.whigbo is now available 2024-08-01T06:58:18.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:58:18.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:58:18.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi016.whigbo/mirror_snapshot_schedule"}]: dispatch 2024-08-01T06:58:18.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:17 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi016.whigbo/trash_purge_schedule"}]: dispatch 2024-08-01T06:58:19.168 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:19 smithi089 ceph-mon[36617]: mgrmap e35: smithi016.whigbo(active, since 1.00932s), standbys: smithi089.hfgnsr 2024-08-01T06:58:19.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:19 smithi089 ceph-mon[36617]: pgmap v3: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-08-01T06:58:19.298 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:19 smithi016 ceph-mon[93645]: mgrmap e35: smithi016.whigbo(active, since 1.00932s), standbys: smithi089.hfgnsr 2024-08-01T06:58:19.298 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:19 smithi016 ceph-mon[93645]: pgmap v3: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-08-01T06:58:20.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:20 smithi089 ceph-mon[36617]: mgrmap e36: smithi016.whigbo(active, since 2s), standbys: smithi089.hfgnsr 2024-08-01T06:58:20.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:20 smithi089 ceph-mon[36617]: [01/Aug/2024:06:58:19] ENGINE Bus STARTING 2024-08-01T06:58:20.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:20 smithi089 ceph-mon[36617]: [01/Aug/2024:06:58:19] ENGINE Serving on http://172.21.15.16:8765 2024-08-01T06:58:20.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:20 smithi089 ceph-mon[36617]: [01/Aug/2024:06:58:19] ENGINE Serving on https://172.21.15.16:7150 2024-08-01T06:58:20.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:20 smithi089 ceph-mon[36617]: [01/Aug/2024:06:58:19] ENGINE Bus STARTED 2024-08-01T06:58:20.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:20 smithi089 ceph-mon[36617]: [01/Aug/2024:06:58:19] ENGINE Error in HTTPServer.serve 2024-08-01T06:58:20.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Traceback (most recent call last): 2024-08-01T06:58:20.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-01T06:58:20.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-08-01T06:58:20.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-01T06:58:20.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._run(expiration_interval) 2024-08-01T06:58:20.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-01T06:58:20.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-01T06:58:20.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-01T06:58:20.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-01T06:58:20.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-01T06:58:20.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s = self.context.wrap_socket( 2024-08-01T06:58:20.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-01T06:58:20.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: return self.sslsocket_class._create( 2024-08-01T06:58:20.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-01T06:58:20.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self.do_handshake() 2024-08-01T06:58:20.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-01T06:58:20.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._sslobj.do_handshake() 2024-08-01T06:58:20.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-01T06:58:20.395 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:20 smithi016 ceph-mon[93645]: mgrmap e36: smithi016.whigbo(active, since 2s), standbys: smithi089.hfgnsr 2024-08-01T06:58:20.395 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:20 smithi016 ceph-mon[93645]: [01/Aug/2024:06:58:19] ENGINE Bus STARTING 2024-08-01T06:58:20.395 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:20 smithi016 ceph-mon[93645]: [01/Aug/2024:06:58:19] ENGINE Serving on http://172.21.15.16:8765 2024-08-01T06:58:20.395 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:20 smithi016 ceph-mon[93645]: [01/Aug/2024:06:58:19] ENGINE Serving on https://172.21.15.16:7150 2024-08-01T06:58:20.395 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:20 smithi016 ceph-mon[93645]: [01/Aug/2024:06:58:19] ENGINE Bus STARTED 2024-08-01T06:58:20.395 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:20 smithi016 ceph-mon[93645]: [01/Aug/2024:06:58:19] ENGINE Error in HTTPServer.serve 2024-08-01T06:58:20.395 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: Traceback (most recent call last): 2024-08-01T06:58:20.395 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-01T06:58:20.395 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self._connections.run(self.expiration_interval) 2024-08-01T06:58:20.396 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-01T06:58:20.396 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self._run(expiration_interval) 2024-08-01T06:58:20.396 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-01T06:58:20.396 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-01T06:58:20.396 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-01T06:58:20.396 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-01T06:58:20.396 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-01T06:58:20.396 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: s = self.context.wrap_socket( 2024-08-01T06:58:20.396 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-01T06:58:20.396 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: return self.sslsocket_class._create( 2024-08-01T06:58:20.396 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-01T06:58:20.396 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self.do_handshake() 2024-08-01T06:58:20.396 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-01T06:58:20.396 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: self._sslobj.do_handshake() 2024-08-01T06:58:20.396 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-01T06:58:21.374 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:21 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:21.374 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:21 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:21.374 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:21 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:21.374 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:21 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:21.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:21 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:21.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:21 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:21.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:21 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:21.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:21 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:23.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:22 smithi089 ceph-mon[36617]: pgmap v5: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-08-01T06:58:23.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:22 smithi089 ceph-mon[36617]: mgrmap e37: smithi016.whigbo(active, since 4s), standbys: smithi089.hfgnsr 2024-08-01T06:58:23.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:22 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:23.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:22 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:23.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:22 smithi016 ceph-mon[93645]: pgmap v5: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-08-01T06:58:23.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:22 smithi016 ceph-mon[93645]: mgrmap e37: smithi016.whigbo(active, since 4s), standbys: smithi089.hfgnsr 2024-08-01T06:58:23.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:23.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:24.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:24 smithi089 ceph-mon[36617]: pgmap v6: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-08-01T06:58:24.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:24 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:24.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:24 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:24.581 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:24 smithi016 ceph-mon[93645]: pgmap v6: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-08-01T06:58:24.581 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:24 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:24.581 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:24 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:25.881 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:25 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:25.881 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:25 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:25.881 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:25 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:25.881 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:25 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:58:25.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:25 smithi089 ceph-mon[36617]: Updating smithi016:/etc/ceph/ceph.conf 2024-08-01T06:58:25.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:25 smithi089 ceph-mon[36617]: Updating smithi089:/etc/ceph/ceph.conf 2024-08-01T06:58:25.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:25 smithi089 ceph-mon[36617]: Updating smithi089:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:58:25.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:25 smithi089 ceph-mon[36617]: Updating smithi016:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:58:25.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:25 smithi089 ceph-mon[36617]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-08-01T06:58:25.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:25 smithi089 ceph-mon[36617]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-08-01T06:58:25.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:25 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:25.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:25 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:25.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:25 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:25.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:25 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:25.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:25 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:25.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:25 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:25.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:25 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:25.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:25 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:25.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:25 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:58:25.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:25 smithi016 ceph-mon[93645]: Updating smithi016:/etc/ceph/ceph.conf 2024-08-01T06:58:25.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:25 smithi016 ceph-mon[93645]: Updating smithi089:/etc/ceph/ceph.conf 2024-08-01T06:58:25.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:25 smithi016 ceph-mon[93645]: Updating smithi089:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:58:25.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:25 smithi016 ceph-mon[93645]: Updating smithi016:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-01T06:58:25.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:25 smithi016 ceph-mon[93645]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-08-01T06:58:25.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:25 smithi016 ceph-mon[93645]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-08-01T06:58:25.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:25 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:25.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:25 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:25.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:25 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:25.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:25 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:25.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:25 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:26.740 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:26 smithi089 ceph-mon[36617]: pgmap v7: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-08-01T06:58:26.740 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:26 smithi089 ceph-mon[36617]: Updating smithi089:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-01T06:58:26.740 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:26 smithi089 ceph-mon[36617]: Updating smithi016:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-01T06:58:26.740 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:26 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:58:26.740 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:26 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:58:26.740 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:26 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-08-01T06:58:26.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:26 smithi016 ceph-mon[93645]: pgmap v7: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-08-01T06:58:26.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:26 smithi016 ceph-mon[93645]: Updating smithi089:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-01T06:58:26.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:26 smithi016 ceph-mon[93645]: Updating smithi016:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-01T06:58:26.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:26 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:58:26.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:26 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:58:26.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:26 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-08-01T06:58:28.038 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:27 smithi089 ceph-mon[36617]: Upgrade: Updating mon.smithi089 2024-08-01T06:58:28.039 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:27 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:28.039 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:27 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-01T06:58:28.039 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:27 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-01T06:58:28.039 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:27 smithi089 ceph-mon[36617]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:28.039 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:27 smithi089 ceph-mon[36617]: Deploying daemon mon.smithi089 on smithi089 2024-08-01T06:58:28.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:27 smithi016 ceph-mon[93645]: Upgrade: Updating mon.smithi089 2024-08-01T06:58:28.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:27 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:28.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:27 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-01T06:58:28.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:27 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-01T06:58:28.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:27 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:28.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:27 smithi016 ceph-mon[93645]: Deploying daemon mon.smithi089 on smithi089 2024-08-01T06:58:28.635 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:28 smithi089 systemd[1]: Stopping Ceph mon.smithi089 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T06:58:28.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:28 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi089[36592]: 2024-08-01T06:58:28.632+0000 7f73bbeef640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi089 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-01T06:58:28.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:28 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi089[36592]: 2024-08-01T06:58:28.633+0000 7f73bbeef640 -1 mon.smithi089@1(peon) e2 *** Got Signal Terminated *** 2024-08-01T06:58:28.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:28 smithi089 podman[82058]: 2024-08-01 06:58:28.725256986 +0000 UTC m=+0.196598733 container died 9ca9e3e814cbc4e47b2413d4670b82a8daa4539f8780d3ab5c9638624fed9676 (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi089, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=reef-a3bbd72, org.label-schema.build-date=20240716, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-01T06:58:29.352 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:29 smithi089 podman[82058]: 2024-08-01 06:58:29.108145199 +0000 UTC m=+0.579486935 container cleanup 9ca9e3e814cbc4e47b2413d4670b82a8daa4539f8780d3ab5c9638624fed9676 (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi089, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240716, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-a3bbd72, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-08-01T06:58:29.352 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:29 smithi089 bash[82058]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi089 2024-08-01T06:58:29.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:29 smithi089 podman[82069]: 2024-08-01 06:58:29.351227365 +0000 UTC m=+0.621927009 container remove 9ca9e3e814cbc4e47b2413d4670b82a8daa4539f8780d3ab5c9638624fed9676 (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi089, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240716, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-a3bbd72, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-08-01T06:58:29.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:29 smithi089 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mon.smithi089.service: Deactivated successfully. 2024-08-01T06:58:29.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:29 smithi089 systemd[1]: Stopped Ceph mon.smithi089 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T06:58:29.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:29 smithi089 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mon.smithi089.service: Consumed 6.248s CPU time. 2024-08-01T06:58:29.936 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:29 smithi089 systemd[1]: Starting Ceph mon.smithi089 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T06:58:29.937 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:29 smithi089 podman[82199]: 2024-08-01 06:58:29.793664194 +0000 UTC m=+0.017216025 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T06:58:29.937 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:29 smithi089 podman[82199]: 2024-08-01 06:58:29.935998198 +0000 UTC m=+0.159550026 container create c4b83b46ff15614fdd6c5c3aecde6a009aa23cde74f6233017609eb0d18b923f (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi089, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, RELEASE=squid-f9911e1, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0) 2024-08-01T06:58:30.209 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 podman[82199]: 2024-08-01 06:58:30.132435818 +0000 UTC m=+0.355987641 container init c4b83b46ff15614fdd6c5c3aecde6a009aa23cde74f6233017609eb0d18b923f (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi089, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-f9911e1, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0) 2024-08-01T06:58:30.209 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 podman[82199]: 2024-08-01 06:58:30.135605584 +0000 UTC m=+0.359157415 container start c4b83b46ff15614fdd6c5c3aecde6a009aa23cde74f6233017609eb0d18b923f (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi089, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, RELEASE=squid-f9911e1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.36.0) 2024-08-01T06:58:30.209 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: set uid:gid to 167:167 (ceph:ceph) 2024-08-01T06:58:30.210 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc), process ceph-mon, pid 2 2024-08-01T06:58:30.210 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: pidfile_write: ignore empty --pid-file 2024-08-01T06:58:30.210 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: load: jerasure load: lrc 2024-08-01T06:58:30.210 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: RocksDB version: 7.9.2 2024-08-01T06:58:30.210 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Git sha 0 2024-08-01T06:58:30.211 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Compile date 2024-07-30 20:41:45 2024-08-01T06:58:30.211 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: DB SUMMARY 2024-08-01T06:58:30.211 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: DB Session ID: PH0GDKCZCA1VQ7L588Q9 2024-08-01T06:58:30.211 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: CURRENT file: CURRENT 2024-08-01T06:58:30.211 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: IDENTITY file: IDENTITY 2024-08-01T06:58:30.211 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1391 Bytes 2024-08-01T06:58:30.212 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi089/store.db dir, Total Num: 1, files: 000027.sst 2024-08-01T06:58:30.212 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi089/store.db: 000025.log size: 892116 ; 2024-08-01T06:58:30.212 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.error_if_exists: 0 2024-08-01T06:58:30.212 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.create_if_missing: 0 2024-08-01T06:58:30.212 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.paranoid_checks: 1 2024-08-01T06:58:30.213 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-01T06:58:30.213 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-01T06:58:30.213 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-01T06:58:30.213 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.env: 0x557045d457a0 2024-08-01T06:58:30.213 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.fs: PosixFileSystem 2024-08-01T06:58:30.214 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.info_log: 0x557046bcb6e0 2024-08-01T06:58:30.214 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_file_opening_threads: 16 2024-08-01T06:58:30.217 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.statistics: (nil) 2024-08-01T06:58:30.217 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.use_fsync: 0 2024-08-01T06:58:30.217 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_log_file_size: 0 2024-08-01T06:58:30.217 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-01T06:58:30.217 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-01T06:58:30.218 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.keep_log_file_num: 1000 2024-08-01T06:58:30.218 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.recycle_log_file_num: 0 2024-08-01T06:58:30.218 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.allow_fallocate: 1 2024-08-01T06:58:30.218 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.allow_mmap_reads: 0 2024-08-01T06:58:30.218 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.allow_mmap_writes: 0 2024-08-01T06:58:30.219 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.use_direct_reads: 0 2024-08-01T06:58:30.219 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-01T06:58:30.219 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.create_missing_column_families: 0 2024-08-01T06:58:30.219 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.db_log_dir: 2024-08-01T06:58:30.219 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.wal_dir: 2024-08-01T06:58:30.220 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-01T06:58:30.220 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-01T06:58:30.220 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-01T06:58:30.220 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-01T06:58:30.220 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-01T06:58:30.221 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-01T06:58:30.221 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.advise_random_on_open: 1 2024-08-01T06:58:30.221 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.db_write_buffer_size: 0 2024-08-01T06:58:30.221 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.write_buffer_manager: 0x557046bdadc0 2024-08-01T06:58:30.221 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-01T06:58:30.221 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-01T06:58:30.222 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-01T06:58:30.222 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.rate_limiter: (nil) 2024-08-01T06:58:30.222 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-01T06:58:30.222 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.wal_recovery_mode: 2 2024-08-01T06:58:30.222 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.enable_thread_tracking: 0 2024-08-01T06:58:30.222 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.enable_pipelined_write: 0 2024-08-01T06:58:30.223 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.unordered_write: 0 2024-08-01T06:58:30.223 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-01T06:58:30.223 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-01T06:58:30.223 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-01T06:58:30.223 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-01T06:58:30.223 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.row_cache: None 2024-08-01T06:58:30.223 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.wal_filter: None 2024-08-01T06:58:30.223 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-01T06:58:30.223 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.allow_ingest_behind: 0 2024-08-01T06:58:30.223 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.two_write_queues: 0 2024-08-01T06:58:30.223 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.manual_wal_flush: 0 2024-08-01T06:58:30.223 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.wal_compression: 0 2024-08-01T06:58:30.223 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.atomic_flush: 0 2024-08-01T06:58:30.224 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-01T06:58:30.224 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-01T06:58:30.224 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-01T06:58:30.224 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.log_readahead_size: 0 2024-08-01T06:58:30.224 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-01T06:58:30.224 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.best_efforts_recovery: 0 2024-08-01T06:58:30.224 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-01T06:58:30.224 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-01T06:58:30.225 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.allow_data_in_errors: 0 2024-08-01T06:58:30.225 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.db_host_id: __hostname__ 2024-08-01T06:58:30.225 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-01T06:58:30.225 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_background_jobs: 2 2024-08-01T06:58:30.225 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_background_compactions: -1 2024-08-01T06:58:30.225 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_subcompactions: 1 2024-08-01T06:58:30.225 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-01T06:58:30.225 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-01T06:58:30.225 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-01T06:58:30.225 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_total_wal_size: 0 2024-08-01T06:58:30.226 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-01T06:58:30.226 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-01T06:58:30.226 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-01T06:58:30.226 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-01T06:58:30.226 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_open_files: -1 2024-08-01T06:58:30.226 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.bytes_per_sync: 0 2024-08-01T06:58:30.226 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-01T06:58:30.226 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-01T06:58:30.226 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compaction_readahead_size: 0 2024-08-01T06:58:30.226 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_background_flushes: -1 2024-08-01T06:58:30.226 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Compression algorithms supported: 2024-08-01T06:58:30.226 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: kZSTD supported: 0 2024-08-01T06:58:30.226 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: kXpressCompression supported: 0 2024-08-01T06:58:30.226 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: kBZip2Compression supported: 0 2024-08-01T06:58:30.227 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-01T06:58:30.227 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: kLZ4Compression supported: 1 2024-08-01T06:58:30.227 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: kZlibCompression supported: 1 2024-08-01T06:58:30.227 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: kLZ4HCCompression supported: 1 2024-08-01T06:58:30.227 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: kSnappyCompression supported: 1 2024-08-01T06:58:30.227 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-01T06:58:30.227 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-01T06:58:30.227 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi089/store.db/MANIFEST-000010 2024-08-01T06:58:30.227 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-01T06:58:30.227 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-01T06:58:30.227 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.merge_operator: 2024-08-01T06:58:30.227 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compaction_filter: None 2024-08-01T06:58:30.227 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compaction_filter_factory: None 2024-08-01T06:58:30.228 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.sst_partitioner_factory: None 2024-08-01T06:58:30.228 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-01T06:58:30.228 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-01T06:58:30.228 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557046bcb320) 2024-08-01T06:58:30.228 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: cache_index_and_filter_blocks: 1 2024-08-01T06:58:30.228 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-01T06:58:30.228 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-01T06:58:30.228 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: pin_top_level_index_and_filter: 1 2024-08-01T06:58:30.228 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: index_type: 0 2024-08-01T06:58:30.228 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: data_block_index_type: 0 2024-08-01T06:58:30.228 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: index_shortening: 1 2024-08-01T06:58:30.228 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-01T06:58:30.229 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: checksum: 4 2024-08-01T06:58:30.229 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: no_block_cache: 0 2024-08-01T06:58:30.229 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache: 0x557046bbf090 2024-08-01T06:58:30.229 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache_name: BinnedLRUCache 2024-08-01T06:58:30.229 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache_options: 2024-08-01T06:58:30.229 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: capacity : 536870912 2024-08-01T06:58:30.229 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: num_shard_bits : 4 2024-08-01T06:58:30.229 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: strict_capacity_limit : 0 2024-08-01T06:58:30.229 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: high_pri_pool_ratio: 0.000 2024-08-01T06:58:30.229 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache_compressed: (nil) 2024-08-01T06:58:30.229 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: persistent_cache: (nil) 2024-08-01T06:58:30.229 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_size: 4096 2024-08-01T06:58:30.230 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_size_deviation: 10 2024-08-01T06:58:30.230 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_restart_interval: 16 2024-08-01T06:58:30.230 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: index_block_restart_interval: 1 2024-08-01T06:58:30.230 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: metadata_block_size: 4096 2024-08-01T06:58:30.230 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: partition_filters: 0 2024-08-01T06:58:30.230 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: use_delta_encoding: 1 2024-08-01T06:58:30.230 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: filter_policy: bloomfilter 2024-08-01T06:58:30.230 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: whole_key_filtering: 1 2024-08-01T06:58:30.230 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: verify_compression: 0 2024-08-01T06:58:30.230 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: read_amp_bytes_per_bit: 0 2024-08-01T06:58:30.230 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: format_version: 5 2024-08-01T06:58:30.230 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: enable_index_compression: 1 2024-08-01T06:58:30.230 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_align: 0 2024-08-01T06:58:30.231 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: max_auto_readahead_size: 262144 2024-08-01T06:58:30.231 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: prepopulate_block_cache: 0 2024-08-01T06:58:30.231 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: initial_auto_readahead_size: 8192 2024-08-01T06:58:30.231 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: num_file_reads_for_auto_readahead: 2 2024-08-01T06:58:30.231 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.write_buffer_size: 33554432 2024-08-01T06:58:30.231 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_write_buffer_number: 2 2024-08-01T06:58:30.231 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compression: NoCompression 2024-08-01T06:58:30.231 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.bottommost_compression: Disabled 2024-08-01T06:58:30.231 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.prefix_extractor: nullptr 2024-08-01T06:58:30.232 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-01T06:58:30.232 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.num_levels: 7 2024-08-01T06:58:30.232 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-01T06:58:30.232 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-01T06:58:30.232 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-01T06:58:30.232 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-01T06:58:30.232 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-01T06:58:30.232 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-01T06:58:30.233 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-01T06:58:30.233 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-01T06:58:30.233 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-01T06:58:30.233 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-01T06:58:30.233 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-01T06:58:30.233 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-01T06:58:30.233 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-01T06:58:30.234 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compression_opts.level: 32767 2024-08-01T06:58:30.234 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compression_opts.strategy: 0 2024-08-01T06:58:30.234 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-01T06:58:30.234 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-01T06:58:30.234 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-01T06:58:30.234 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-01T06:58:30.234 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compression_opts.enabled: false 2024-08-01T06:58:30.234 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-01T06:58:30.234 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-01T06:58:30.234 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-01T06:58:30.234 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-01T06:58:30.234 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.target_file_size_base: 67108864 2024-08-01T06:58:30.234 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-01T06:58:30.235 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-01T06:58:30.235 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-01T06:58:30.235 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-01T06:58:30.235 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-01T06:58:30.235 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-01T06:58:30.235 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-01T06:58:30.235 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-01T06:58:30.235 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-01T06:58:30.235 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-01T06:58:30.235 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-01T06:58:30.235 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-01T06:58:30.236 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-01T06:58:30.236 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-01T06:58:30.236 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.arena_block_size: 1048576 2024-08-01T06:58:30.236 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-01T06:58:30.236 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-01T06:58:30.236 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.disable_auto_compactions: 0 2024-08-01T06:58:30.236 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-01T06:58:30.236 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-01T06:58:30.236 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-01T06:58:30.236 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-01T06:58:30.236 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-01T06:58:30.236 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-01T06:58:30.236 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-01T06:58:30.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-01T06:58:30.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-01T06:58:30.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-01T06:58:30.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-01T06:58:30.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.inplace_update_support: 0 2024-08-01T06:58:30.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-01T06:58:30.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-01T06:58:30.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-01T06:58:30.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-01T06:58:30.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.bloom_locality: 0 2024-08-01T06:58:30.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.max_successive_merges: 0 2024-08-01T06:58:30.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-01T06:58:30.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.paranoid_file_checks: 0 2024-08-01T06:58:30.237 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.force_consistency_checks: 1 2024-08-01T06:58:30.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.report_bg_io_stats: 0 2024-08-01T06:58:30.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.ttl: 2592000 2024-08-01T06:58:30.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-01T06:58:30.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-01T06:58:30.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-01T06:58:30.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.enable_blob_files: false 2024-08-01T06:58:30.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.min_blob_size: 0 2024-08-01T06:58:30.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.blob_file_size: 268435456 2024-08-01T06:58:30.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-01T06:58:30.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-01T06:58:30.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-01T06:58:30.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-01T06:58:30.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-01T06:58:30.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.blob_file_starting_level: 0 2024-08-01T06:58:30.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-01T06:58:30.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-08-01T06:58:30.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi089/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12241, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-08-01T06:58:30.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-08-01T06:58:30.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ddb0290b-fd1a-43b6-b1e1-863e3c47d530 2024-08-01T06:58:30.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: EVENT_LOG_v1 {"time_micros": 1722495510161552, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-08-01T06:58:30.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-08-01T06:58:30.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: EVENT_LOG_v1 {"time_micros": 1722495510164561, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 539618, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12246, "largest_seqno": 12470, "table_properties": {"data_size": 537448, "index_size": 812, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 325, "raw_key_size": 2610, "raw_average_key_size": 24, "raw_value_size": 534852, "raw_average_value_size": 5045, "num_data_blocks": 36, "num_entries": 106, "num_filter_entries": 106, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1722495510, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ddb0290b-fd1a-43b6-b1e1-863e3c47d530", "db_session_id": "PH0GDKCZCA1VQ7L588Q9", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-08-01T06:58:30.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: EVENT_LOG_v1 {"time_micros": 1722495510164662, "job": 1, "event": "recovery_finished"} 2024-08-01T06:58:30.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-08-01T06:58:30.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-08-01T06:58:30.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi089/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-01T06:58:30.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557046bece00 2024-08-01T06:58:30.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: DB pointer 0x557046ce6000 2024-08-01T06:58:30.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-01T06:58:30.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-01T06:58:30.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** DB Stats ** 2024-08-01T06:58:30.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-01T06:58:30.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-01T06:58:30.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-01T06:58:30.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-01T06:58:30.240 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-01T06:58:30.241 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-01T06:58:30.241 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-01T06:58:30.241 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-08-01T06:58:30.241 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** Compaction Stats [default] ** 2024-08-01T06:58:30.241 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-01T06:58:30.241 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-01T06:58:30.241 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: L0 1/0 526.97 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 323.9 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-08-01T06:58:30.241 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: L6 1/0 7.79 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-08-01T06:58:30.241 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Sum 2/0 8.30 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 323.9 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-08-01T06:58:30.242 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 323.9 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-08-01T06:58:30.242 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-08-01T06:58:30.242 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** Compaction Stats [default] ** 2024-08-01T06:58:30.242 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-01T06:58:30.242 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-01T06:58:30.242 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 323.9 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-08-01T06:58:30.242 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-08-01T06:58:30.242 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-01T06:58:30.242 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-08-01T06:58:30.242 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-01T06:58:30.242 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-08-01T06:58:30.242 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-01T06:58:30.242 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-01T06:58:30.243 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-01T06:58:30.243 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-01T06:58:30.243 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative compaction: 0.00 GB write, 98.32 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-01T06:58:30.243 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval compaction: 0.00 GB write, 98.32 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-01T06:58:30.243 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-01T06:58:30.243 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Block cache BinnedLRUCache@0x557046bbf090#2 capacity: 512.00 MB usage: 1.33 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-08-01T06:58:30.243 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.38 KB,7.15256e-05%) IndexBlock(1,0.95 KB,0.000181794%) Misc(1,0.00 KB,0%) 2024-08-01T06:58:30.243 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-08-01T06:58:30.243 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-01T06:58:30.243 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: starting mon.smithi089 rank 1 at public addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] at bind addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi089 fsid a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:58:30.243 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: mon.smithi089@-1(???) e2 preinit fsid a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:58:30.244 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: mon.smithi089@-1(???).mds e19 new map 2024-08-01T06:58:30.244 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: mon.smithi089@-1(???).mds e19 print_map 2024-08-01T06:58:30.244 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: e19 2024-08-01T06:58:30.244 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-08-01T06:58:30.244 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T06:58:30.244 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:58:30.244 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: legacy client fscid: 1 2024-08-01T06:58:30.244 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-08-01T06:58:30.244 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Filesystem 'cephfs' (1) 2024-08-01T06:58:30.244 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: fs_name cephfs 2024-08-01T06:58:30.245 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: epoch 19 2024-08-01T06:58:30.245 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T06:58:30.245 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: created 2024-08-01T06:53:13.411160+0000 2024-08-01T06:58:30.245 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: modified 2024-08-01T06:53:32.617145+0000 2024-08-01T06:58:30.245 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: tableserver 0 2024-08-01T06:58:30.245 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: root 0 2024-08-01T06:58:30.245 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: session_timeout 60 2024-08-01T06:58:30.245 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: session_autoclose 300 2024-08-01T06:58:30.245 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: max_file_size 1099511627776 2024-08-01T06:58:30.245 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: max_xattr_size 65536 2024-08-01T06:58:30.245 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: required_client_features {} 2024-08-01T06:58:30.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: last_failure 0 2024-08-01T06:58:30.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: last_failure_osd_epoch 46 2024-08-01T06:58:30.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:58:30.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: max_mds 2 2024-08-01T06:58:30.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: in 0,1 2024-08-01T06:58:30.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: up {0=14482,1=24281} 2024-08-01T06:58:30.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: failed 2024-08-01T06:58:30.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: damaged 2024-08-01T06:58:30.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: stopped 2024-08-01T06:58:30.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: data_pools [3] 2024-08-01T06:58:30.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: metadata_pool 2 2024-08-01T06:58:30.246 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: inline_data disabled 2024-08-01T06:58:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: balancer 2024-08-01T06:58:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: bal_rank_mask -1 2024-08-01T06:58:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: standby_count_wanted 1 2024-08-01T06:58:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: qdb_cluster leader: 0 members: 2024-08-01T06:58:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: [mds.cephfs.smithi016.fziqod{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:58:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: [mds.cephfs.smithi016.bgqkxu{0:24299} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:58:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: [mds.cephfs.smithi089.jhouje{1:24281} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:58:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: [mds.cephfs.smithi089.xanuld{1:24291} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:58:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-08-01T06:58:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-08-01T06:58:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: mon.smithi089@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-08-01T06:58:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: mon.smithi089@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-08-01T06:58:30.247 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: mon.smithi089@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-08-01T06:58:30.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: mon.smithi089@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-08-01T06:58:30.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: mon.smithi089@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-08-01T06:58:30.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 ceph-mon[82218]: pgmap v8: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-08-01T06:58:30.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 bash[82199]: c4b83b46ff15614fdd6c5c3aecde6a009aa23cde74f6233017609eb0d18b923f 2024-08-01T06:58:30.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:30 smithi089 systemd[1]: Started Ceph mon.smithi089 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T06:58:30.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:30 smithi016 ceph-mon[93645]: pgmap v8: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-08-01T06:58:31.602 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: osdmap e49: 6 total, 6 up, 6 in 2024-08-01T06:58:31.602 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: mgrmap e37: smithi016.whigbo(active, since 13s), standbys: smithi089.hfgnsr 2024-08-01T06:58:31.602 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: overall HEALTH_OK 2024-08-01T06:58:31.602 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: mon.smithi089 calling monitor election 2024-08-01T06:58:31.602 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: mon.smithi016 calling monitor election 2024-08-01T06:58:31.603 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:58:31.603 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: mon.smithi016 is new leader, mons smithi016,smithi089 in quorum (ranks 0,1) 2024-08-01T06:58:31.603 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:58:31.603 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: monmap epoch 3 2024-08-01T06:58:31.603 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: fsid a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:58:31.603 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: last_changed 2024-08-01T06:58:30.184006+0000 2024-08-01T06:58:31.603 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: created 2024-08-01T06:46:30.398884+0000 2024-08-01T06:58:31.603 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: min_mon_release 19 (squid) 2024-08-01T06:58:31.603 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: election_strategy: 1 2024-08-01T06:58:31.603 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.smithi016 2024-08-01T06:58:31.603 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: 1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.smithi089 2024-08-01T06:58:31.603 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: fsmap cephfs:2 {0=cephfs.smithi016.fziqod=up:active,1=cephfs.smithi089.jhouje=up:active} 2 up:standby-replay 2024-08-01T06:58:31.603 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: osdmap e49: 6 total, 6 up, 6 in 2024-08-01T06:58:31.603 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: mgrmap e37: smithi016.whigbo(active, since 13s), standbys: smithi089.hfgnsr 2024-08-01T06:58:31.604 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: overall HEALTH_OK 2024-08-01T06:58:31.604 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:31.604 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:31.604 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:58:31.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: osdmap e49: 6 total, 6 up, 6 in 2024-08-01T06:58:31.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: mgrmap e37: smithi016.whigbo(active, since 13s), standbys: smithi089.hfgnsr 2024-08-01T06:58:31.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: overall HEALTH_OK 2024-08-01T06:58:31.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: mon.smithi089 calling monitor election 2024-08-01T06:58:31.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: mon.smithi016 calling monitor election 2024-08-01T06:58:31.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi016"}]: dispatch 2024-08-01T06:58:31.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: mon.smithi016 is new leader, mons smithi016,smithi089 in quorum (ranks 0,1) 2024-08-01T06:58:31.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-08-01T06:58:31.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: monmap epoch 3 2024-08-01T06:58:31.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: fsid a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T06:58:31.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: last_changed 2024-08-01T06:58:30.184006+0000 2024-08-01T06:58:31.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: created 2024-08-01T06:46:30.398884+0000 2024-08-01T06:58:31.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: min_mon_release 19 (squid) 2024-08-01T06:58:31.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: election_strategy: 1 2024-08-01T06:58:31.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: 0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.smithi016 2024-08-01T06:58:31.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: 1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.smithi089 2024-08-01T06:58:31.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: fsmap cephfs:2 {0=cephfs.smithi016.fziqod=up:active,1=cephfs.smithi089.jhouje=up:active} 2 up:standby-replay 2024-08-01T06:58:31.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: osdmap e49: 6 total, 6 up, 6 in 2024-08-01T06:58:31.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: mgrmap e37: smithi016.whigbo(active, since 13s), standbys: smithi089.hfgnsr 2024-08-01T06:58:31.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: overall HEALTH_OK 2024-08-01T06:58:31.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:31.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:31.651 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:58:32.568 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:32 smithi089 ceph-mon[82218]: pgmap v10: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-08-01T06:58:32.568 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:58:32.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:32 smithi016 ceph-mon[93645]: pgmap v10: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-08-01T06:58:32.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:58:34.331 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:34 smithi089 ceph-mon[82218]: pgmap v11: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-08-01T06:58:34.331 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:34 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:34.331 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:34 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:34.331 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:34 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:34.331 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:34 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:34.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:34 smithi016 ceph-mon[93645]: pgmap v11: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-08-01T06:58:34.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:34 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:34.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:34 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:34.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:34 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:34.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:34 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:36.373 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:36 smithi089 ceph-mon[82218]: pgmap v12: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-08-01T06:58:36.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:36 smithi016 ceph-mon[93645]: pgmap v12: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-08-01T06:58:37.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:37 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:37.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:37 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:37.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:37 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:37.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:37 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:58:37.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:37 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:37.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:37 smithi016 ceph-mon[93645]: Reconfiguring mon.smithi016 (monmap changed)... 2024-08-01T06:58:37.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:37 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-01T06:58:37.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:37 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-01T06:58:37.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:37 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:37.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:37 smithi016 ceph-mon[93645]: Reconfiguring daemon mon.smithi016 on smithi016 2024-08-01T06:58:38.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:37 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:38.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:37 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:38.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:37 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:38.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:37 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:58:38.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:37 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:38.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:37 smithi089 ceph-mon[82218]: Reconfiguring mon.smithi016 (monmap changed)... 2024-08-01T06:58:38.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:37 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-01T06:58:38.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:37 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-01T06:58:38.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:37 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:38.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:37 smithi089 ceph-mon[82218]: Reconfiguring daemon mon.smithi016 on smithi016 2024-08-01T06:58:39.052 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:38 smithi016 ceph-mon[93645]: pgmap v13: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:58:39.052 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:38 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:39.052 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:38 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:39.053 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:38 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi016.whigbo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-01T06:58:39.053 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:38 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-01T06:58:39.053 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:38 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:39.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:38 smithi089 ceph-mon[82218]: pgmap v13: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:58:39.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:38 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:39.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:38 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:39.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:38 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi016.whigbo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-01T06:58:39.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:38 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-01T06:58:39.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:38 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:39.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.529+0000 7f50c6fb8640 1 -- 172.21.15.16:0/3955997932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50c0102fc0 msgr2=0x7f50c01053b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:39.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.529+0000 7f50c6fb8640 1 --2- 172.21.15.16:0/3955997932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50c0102fc0 0x7f50c01053b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f50ac009880 tx=0x7f50ac02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:58:39.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.529+0000 7f50c6fb8640 1 -- 172.21.15.16:0/3955997932 shutdown_connections 2024-08-01T06:58:39.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.529+0000 7f50c6fb8640 1 --2- 172.21.15.16:0/3955997932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50c0102fc0 0x7f50c01053b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:39.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.529+0000 7f50c6fb8640 1 --2- 172.21.15.16:0/3955997932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50c0100690 0x7f50c0102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:39.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.529+0000 7f50c6fb8640 1 -- 172.21.15.16:0/3955997932 >> 172.21.15.16:0/3955997932 conn(0x7f50c00fa250 msgr2=0x7f50c00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:39.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.529+0000 7f50c6fb8640 1 -- 172.21.15.16:0/3955997932 shutdown_connections 2024-08-01T06:58:39.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.529+0000 7f50c6fb8640 1 -- 172.21.15.16:0/3955997932 wait complete. 2024-08-01T06:58:39.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.530+0000 7f50c6fb8640 1 Processor -- start 2024-08-01T06:58:39.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.530+0000 7f50c6fb8640 1 -- start start 2024-08-01T06:58:39.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.530+0000 7f50c6fb8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50c0100690 0x7f50c0197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:39.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.530+0000 7f50c6fb8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50c0102fc0 0x7f50c0197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:39.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.530+0000 7f50c6fb8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c0198330 con 0x7f50c0100690 2024-08-01T06:58:39.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.530+0000 7f50c6fb8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c01984a0 con 0x7f50c0102fc0 2024-08-01T06:58:39.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.530+0000 7f50c4d54640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50c0100690 0x7f50c0197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:39.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.530+0000 7f50c4d54640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50c0100690 0x7f50c0197820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49554/0 (socket says 172.21.15.16:49554) 2024-08-01T06:58:39.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.530+0000 7f50c4d54640 1 -- 172.21.15.16:0/3954790340 learned_addr learned my addr 172.21.15.16:0/3954790340 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:58:39.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.531+0000 7f50bffff640 1 --2- 172.21.15.16:0/3954790340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50c0102fc0 0x7f50c0197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:39.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.531+0000 7f50c4d54640 1 -- 172.21.15.16:0/3954790340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50c0102fc0 msgr2=0x7f50c0197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:39.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.531+0000 7f50c4d54640 1 --2- 172.21.15.16:0/3954790340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50c0102fc0 0x7f50c0197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:39.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.531+0000 7f50c4d54640 1 -- 172.21.15.16:0/3954790340 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ac009560 con 0x7f50c0100690 2024-08-01T06:58:39.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.531+0000 7f50c4d54640 1 --2- 172.21.15.16:0/3954790340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50c0100690 0x7f50c0197820 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f50b400d720 tx=0x7f50b400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:39.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.531+0000 7f50bdffb640 1 -- 172.21.15.16:0/3954790340 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50b40051f0 con 0x7f50c0100690 2024-08-01T06:58:39.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.531+0000 7f50bdffb640 1 -- 172.21.15.16:0/3954790340 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f50b4009ce0 con 0x7f50c0100690 2024-08-01T06:58:39.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.531+0000 7f50c6fb8640 1 -- 172.21.15.16:0/3954790340 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c019cf40 con 0x7f50c0100690 2024-08-01T06:58:39.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.531+0000 7f50bdffb640 1 -- 172.21.15.16:0/3954790340 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50b4010460 con 0x7f50c0100690 2024-08-01T06:58:39.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.532+0000 7f50c6fb8640 1 -- 172.21.15.16:0/3954790340 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c019d480 con 0x7f50c0100690 2024-08-01T06:58:39.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.533+0000 7f50c6fb8640 1 -- 172.21.15.16:0/3954790340 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c0100a70 con 0x7f50c0100690 2024-08-01T06:58:39.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.533+0000 7f50bdffb640 1 -- 172.21.15.16:0/3954790340 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f50b4005350 con 0x7f50c0100690 2024-08-01T06:58:39.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.533+0000 7f50bdffb640 1 --2- 172.21.15.16:0/3954790340 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f50b006e2b0 0x7f50b0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:39.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.533+0000 7f50bdffb640 1 -- 172.21.15.16:0/3954790340 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f50b408deb0 con 0x7f50c0100690 2024-08-01T06:58:39.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.534+0000 7f50bffff640 1 --2- 172.21.15.16:0/3954790340 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f50b006e2b0 0x7f50b0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:39.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.534+0000 7f50bffff640 1 --2- 172.21.15.16:0/3954790340 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f50b006e2b0 0x7f50b0070770 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f50ac009230 tx=0x7f50ac005d50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:39.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.538+0000 7f50bdffb640 1 -- 172.21.15.16:0/3954790340 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f50b4057040 con 0x7f50c0100690 2024-08-01T06:58:39.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.734+0000 7f50c6fb8640 1 -- 172.21.15.16:0/3954790340 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f50c00ffca0 con 0x7f50b006e2b0 2024-08-01T06:58:39.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.735+0000 7f50bdffb640 1 -- 172.21.15.16:0/3954790340 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f50c00ffca0 con 0x7f50b006e2b0 2024-08-01T06:58:39.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.737+0000 7f50c6fb8640 1 -- 172.21.15.16:0/3954790340 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f50b006e2b0 msgr2=0x7f50b0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:39.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.737+0000 7f50c6fb8640 1 --2- 172.21.15.16:0/3954790340 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f50b006e2b0 0x7f50b0070770 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f50ac009230 tx=0x7f50ac005d50 comp rx=0 tx=0).stop 2024-08-01T06:58:39.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.737+0000 7f50c6fb8640 1 -- 172.21.15.16:0/3954790340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50c0100690 msgr2=0x7f50c0197820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:39.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.737+0000 7f50c6fb8640 1 --2- 172.21.15.16:0/3954790340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50c0100690 0x7f50c0197820 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f50b400d720 tx=0x7f50b400dbe0 comp rx=0 tx=0).stop 2024-08-01T06:58:39.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.737+0000 7f50c6fb8640 1 -- 172.21.15.16:0/3954790340 shutdown_connections 2024-08-01T06:58:39.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.737+0000 7f50c6fb8640 1 --2- 172.21.15.16:0/3954790340 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f50b006e2b0 0x7f50b0070770 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:39.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.737+0000 7f50c6fb8640 1 --2- 172.21.15.16:0/3954790340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50c0102fc0 0x7f50c0197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:39.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.737+0000 7f50c6fb8640 1 --2- 172.21.15.16:0/3954790340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50c0100690 0x7f50c0197820 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:39.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.737+0000 7f50c6fb8640 1 -- 172.21.15.16:0/3954790340 >> 172.21.15.16:0/3954790340 conn(0x7f50c00fa250 msgr2=0x7f50c00ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:39.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.737+0000 7f50c6fb8640 1 -- 172.21.15.16:0/3954790340 shutdown_connections 2024-08-01T06:58:39.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.737+0000 7f50c6fb8640 1 -- 172.21.15.16:0/3954790340 wait complete. 2024-08-01T06:58:39.750 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T06:58:39.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.825+0000 7ff109d17640 1 -- 172.21.15.16:0/1067707434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1040ffcf0 msgr2=0x7ff104100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:39.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.825+0000 7ff109d17640 1 --2- 172.21.15.16:0/1067707434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1040ffcf0 0x7ff104100170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8009880 tx=0x7ff0f802a4a0 comp rx=0 tx=0).stop 2024-08-01T06:58:39.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.825+0000 7ff109d17640 1 -- 172.21.15.16:0/1067707434 shutdown_connections 2024-08-01T06:58:39.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.825+0000 7ff109d17640 1 --2- 172.21.15.16:0/1067707434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1040ffcf0 0x7ff104100170 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:39.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.825+0000 7ff109d17640 1 --2- 172.21.15.16:0/1067707434 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1040feaf0 0x7ff1040feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:39.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.825+0000 7ff109d17640 1 -- 172.21.15.16:0/1067707434 >> 172.21.15.16:0/1067707434 conn(0x7ff1040fa280 msgr2=0x7ff1040fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:39.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.825+0000 7ff109d17640 1 -- 172.21.15.16:0/1067707434 shutdown_connections 2024-08-01T06:58:39.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.825+0000 7ff109d17640 1 -- 172.21.15.16:0/1067707434 wait complete. 2024-08-01T06:58:39.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.826+0000 7ff109d17640 1 Processor -- start 2024-08-01T06:58:39.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.826+0000 7ff109d17640 1 -- start start 2024-08-01T06:58:39.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.826+0000 7ff109d17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1040feaf0 0x7ff104195760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:39.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.826+0000 7ff109d17640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1040ffcf0 0x7ff104195ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:39.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.826+0000 7ff109d17640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff104196270 con 0x7ff1040ffcf0 2024-08-01T06:58:39.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.826+0000 7ff109d17640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1041963e0 con 0x7ff1040feaf0 2024-08-01T06:58:39.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.827+0000 7ff102ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1040ffcf0 0x7ff104195ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:39.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.827+0000 7ff102ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1040ffcf0 0x7ff104195ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49570/0 (socket says 172.21.15.16:49570) 2024-08-01T06:58:39.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.827+0000 7ff102ffd640 1 -- 172.21.15.16:0/2456657402 learned_addr learned my addr 172.21.15.16:0/2456657402 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:58:39.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.827+0000 7ff1037fe640 1 --2- 172.21.15.16:0/2456657402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1040feaf0 0x7ff104195760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:39.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.827+0000 7ff102ffd640 1 -- 172.21.15.16:0/2456657402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1040feaf0 msgr2=0x7ff104195760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:39.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.827+0000 7ff102ffd640 1 --2- 172.21.15.16:0/2456657402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1040feaf0 0x7ff104195760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:39.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.827+0000 7ff102ffd640 1 -- 172.21.15.16:0/2456657402 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f8009560 con 0x7ff1040ffcf0 2024-08-01T06:58:39.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.827+0000 7ff102ffd640 1 --2- 172.21.15.16:0/2456657402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1040ffcf0 0x7ff104195ca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80055f0 tx=0x7ff0f8005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:39.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.827+0000 7ff100ff9640 1 -- 172.21.15.16:0/2456657402 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0f8004b20 con 0x7ff1040ffcf0 2024-08-01T06:58:39.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.827+0000 7ff109d17640 1 -- 172.21.15.16:0/2456657402 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10419ae20 con 0x7ff1040ffcf0 2024-08-01T06:58:39.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.827+0000 7ff100ff9640 1 -- 172.21.15.16:0/2456657402 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff0f8004c80 con 0x7ff1040ffcf0 2024-08-01T06:58:39.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.828+0000 7ff100ff9640 1 -- 172.21.15.16:0/2456657402 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0f8003b50 con 0x7ff1040ffcf0 2024-08-01T06:58:39.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.828+0000 7ff109d17640 1 -- 172.21.15.16:0/2456657402 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10419b360 con 0x7ff1040ffcf0 2024-08-01T06:58:39.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.829+0000 7ff109d17640 1 -- 172.21.15.16:0/2456657402 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1040feed0 con 0x7ff1040ffcf0 2024-08-01T06:58:39.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.829+0000 7ff100ff9640 1 -- 172.21.15.16:0/2456657402 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7ff0f8031640 con 0x7ff1040ffcf0 2024-08-01T06:58:39.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.830+0000 7ff100ff9640 1 --2- 172.21.15.16:0/2456657402 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff0ec06e2a0 0x7ff0ec070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:39.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.830+0000 7ff100ff9640 1 -- 172.21.15.16:0/2456657402 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff0f80af630 con 0x7ff1040ffcf0 2024-08-01T06:58:39.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.830+0000 7ff1037fe640 1 --2- 172.21.15.16:0/2456657402 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff0ec06e2a0 0x7ff0ec070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:39.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.831+0000 7ff1037fe640 1 --2- 172.21.15.16:0/2456657402 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff0ec06e2a0 0x7ff0ec070760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff1040ffb50 tx=0x7ff0f4009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:39.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:39.834+0000 7ff100ff9640 1 -- 172.21.15.16:0/2456657402 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff0f8078740 con 0x7ff1040ffcf0 2024-08-01T06:58:40.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.058+0000 7ff109d17640 1 -- 172.21.15.16:0/2456657402 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1040683f0 con 0x7ff0ec06e2a0 2024-08-01T06:58:40.061 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:39 smithi016 ceph-mon[93645]: Reconfiguring mgr.smithi016.whigbo (monmap changed)... 2024-08-01T06:58:40.061 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:39 smithi016 ceph-mon[93645]: Reconfiguring daemon mgr.smithi016.whigbo on smithi016 2024-08-01T06:58:40.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.059+0000 7ff100ff9640 1 -- 172.21.15.16:0/2456657402 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7ff1040683f0 con 0x7ff0ec06e2a0 2024-08-01T06:58:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.061+0000 7ff109d17640 1 -- 172.21.15.16:0/2456657402 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff0ec06e2a0 msgr2=0x7ff0ec070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.061+0000 7ff109d17640 1 --2- 172.21.15.16:0/2456657402 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff0ec06e2a0 0x7ff0ec070760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff1040ffb50 tx=0x7ff0f4009110 comp rx=0 tx=0).stop 2024-08-01T06:58:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.061+0000 7ff109d17640 1 -- 172.21.15.16:0/2456657402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1040ffcf0 msgr2=0x7ff104195ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.061+0000 7ff109d17640 1 --2- 172.21.15.16:0/2456657402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1040ffcf0 0x7ff104195ca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80055f0 tx=0x7ff0f8005620 comp rx=0 tx=0).stop 2024-08-01T06:58:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.062+0000 7ff109d17640 1 -- 172.21.15.16:0/2456657402 shutdown_connections 2024-08-01T06:58:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.062+0000 7ff109d17640 1 --2- 172.21.15.16:0/2456657402 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff0ec06e2a0 0x7ff0ec070760 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.062+0000 7ff109d17640 1 --2- 172.21.15.16:0/2456657402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1040ffcf0 0x7ff104195ca0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.062+0000 7ff109d17640 1 --2- 172.21.15.16:0/2456657402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1040feaf0 0x7ff104195760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.062+0000 7ff109d17640 1 -- 172.21.15.16:0/2456657402 >> 172.21.15.16:0/2456657402 conn(0x7ff1040fa280 msgr2=0x7ff104067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:40.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.062+0000 7ff109d17640 1 -- 172.21.15.16:0/2456657402 shutdown_connections 2024-08-01T06:58:40.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.062+0000 7ff109d17640 1 -- 172.21.15.16:0/2456657402 wait complete. 2024-08-01T06:58:40.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:39 smithi089 ceph-mon[82218]: Reconfiguring mgr.smithi016.whigbo (monmap changed)... 2024-08-01T06:58:40.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:39 smithi089 ceph-mon[82218]: Reconfiguring daemon mgr.smithi016.whigbo on smithi016 2024-08-01T06:58:40.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.149+0000 7f7f2ed6c640 1 -- 172.21.15.16:0/750468495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f280feaa0 msgr2=0x7f7f280feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:40.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.149+0000 7f7f2ed6c640 1 --2- 172.21.15.16:0/750468495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f280feaa0 0x7f7f280feea0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7f10009880 tx=0x7f7f1002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.150+0000 7f7f2ed6c640 1 -- 172.21.15.16:0/750468495 shutdown_connections 2024-08-01T06:58:40.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.150+0000 7f7f2ed6c640 1 --2- 172.21.15.16:0/750468495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f280ffca0 0x7f7f28100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.150+0000 7f7f2ed6c640 1 --2- 172.21.15.16:0/750468495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f280feaa0 0x7f7f280feea0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.150+0000 7f7f2ed6c640 1 -- 172.21.15.16:0/750468495 >> 172.21.15.16:0/750468495 conn(0x7f7f280fa250 msgr2=0x7f7f280fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:40.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.150+0000 7f7f2ed6c640 1 -- 172.21.15.16:0/750468495 shutdown_connections 2024-08-01T06:58:40.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.150+0000 7f7f2ed6c640 1 -- 172.21.15.16:0/750468495 wait complete. 2024-08-01T06:58:40.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.150+0000 7f7f2ed6c640 1 Processor -- start 2024-08-01T06:58:40.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.150+0000 7f7f2ed6c640 1 -- start start 2024-08-01T06:58:40.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.151+0000 7f7f2ed6c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f280feaa0 0x7f7f28195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:40.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.151+0000 7f7f2ed6c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f280ffca0 0x7f7f28195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:40.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.151+0000 7f7f2ed6c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f281960f0 con 0x7f7f280feaa0 2024-08-01T06:58:40.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.151+0000 7f7f2ed6c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f28196260 con 0x7f7f280ffca0 2024-08-01T06:58:40.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.151+0000 7f7f2cb08640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f280feaa0 0x7f7f28195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:40.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.151+0000 7f7f27fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f280ffca0 0x7f7f28195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:40.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.151+0000 7f7f2cb08640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f280feaa0 0x7f7f28195670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49598/0 (socket says 172.21.15.16:49598) 2024-08-01T06:58:40.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.151+0000 7f7f2cb08640 1 -- 172.21.15.16:0/3066745708 learned_addr learned my addr 172.21.15.16:0/3066745708 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:58:40.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.151+0000 7f7f2cb08640 1 -- 172.21.15.16:0/3066745708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f280ffca0 msgr2=0x7f7f28195bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:40.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.151+0000 7f7f2cb08640 1 --2- 172.21.15.16:0/3066745708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f280ffca0 0x7f7f28195bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.151+0000 7f7f2cb08640 1 -- 172.21.15.16:0/3066745708 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f10009560 con 0x7f7f280feaa0 2024-08-01T06:58:40.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.151+0000 7f7f2cb08640 1 --2- 172.21.15.16:0/3066745708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f280feaa0 0x7f7f28195670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7f1002a9c0 tx=0x7f7f10005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:40.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.152+0000 7f7f25ffb640 1 -- 172.21.15.16:0/3066745708 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f10004b20 con 0x7f7f280feaa0 2024-08-01T06:58:40.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.152+0000 7f7f2ed6c640 1 -- 172.21.15.16:0/3066745708 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2819ace0 con 0x7f7f280feaa0 2024-08-01T06:58:40.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.152+0000 7f7f25ffb640 1 -- 172.21.15.16:0/3066745708 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f10004c80 con 0x7f7f280feaa0 2024-08-01T06:58:40.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.152+0000 7f7f25ffb640 1 -- 172.21.15.16:0/3066745708 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f10003b80 con 0x7f7f280feaa0 2024-08-01T06:58:40.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.152+0000 7f7f2ed6c640 1 -- 172.21.15.16:0/3066745708 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2819b180 con 0x7f7f280feaa0 2024-08-01T06:58:40.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.153+0000 7f7f2ed6c640 1 -- 172.21.15.16:0/3066745708 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f28107690 con 0x7f7f280feaa0 2024-08-01T06:58:40.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.154+0000 7f7f25ffb640 1 -- 172.21.15.16:0/3066745708 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f7f10031640 con 0x7f7f280feaa0 2024-08-01T06:58:40.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.154+0000 7f7f25ffb640 1 --2- 172.21.15.16:0/3066745708 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7f1406e2b0 0x7f7f14070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:40.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.154+0000 7f7f25ffb640 1 -- 172.21.15.16:0/3066745708 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f7f100af570 con 0x7f7f280feaa0 2024-08-01T06:58:40.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.154+0000 7f7f27fff640 1 --2- 172.21.15.16:0/3066745708 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7f1406e2b0 0x7f7f14070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:40.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.155+0000 7f7f27fff640 1 --2- 172.21.15.16:0/3066745708 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7f1406e2b0 0x7f7f14070770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7f28196b90 tx=0x7f7f200075b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:40.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.159+0000 7f7f25ffb640 1 -- 172.21.15.16:0/3066745708 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7f10078730 con 0x7f7f280feaa0 2024-08-01T06:58:40.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.347+0000 7f7f2ed6c640 1 -- 172.21.15.16:0/3066745708 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f28068c30 con 0x7f7f1406e2b0 2024-08-01T06:58:40.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.357+0000 7f7f25ffb640 1 -- 172.21.15.16:0/3066745708 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f7f28068c30 con 0x7f7f1406e2b0 2024-08-01T06:58:40.359 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T06:58:40.359 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (9m) 17s ago 10m 25.4M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T06:58:40.359 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (10m) 17s ago 10m 8136k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T06:58:40.359 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (9m) 7s ago 9m 8036k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T06:58:40.360 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (10m) 17s ago 10m 6895k - 18.2.2-1767-ga3bbd728 d280790d1980 81c723a6ae35 2024-08-01T06:58:40.360 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (9m) 7s ago 9m 6891k - 18.2.2-1767-ga3bbd728 d280790d1980 73e7778d1e26 2024-08-01T06:58:40.360 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (9m) 17s ago 10m 85.8M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T06:58:40.360 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (5m) 17s ago 5m 89.2M - 18.2.2-1767-ga3bbd728 d280790d1980 96e46c28d16c 2024-08-01T06:58:40.360 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (5m) 17s ago 5m 149M - 18.2.2-1767-ga3bbd728 d280790d1980 4bbe1a388689 2024-08-01T06:58:40.360 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (5m) 7s ago 5m 26.8M - 18.2.2-1767-ga3bbd728 d280790d1980 65ca121a6fbb 2024-08-01T06:58:40.360 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (5m) 7s ago 5m 25.5M - 18.2.2-1767-ga3bbd728 d280790d1980 05bb46c6fe94 2024-08-01T06:58:40.360 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:8443,9283,8765 running (107s) 17s ago 11m 472M - 19.1.0-1223-gf9911e17 93d93c74a2cc 8701e6315593 2024-08-01T06:58:40.360 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (44s) 7s ago 9m 437M - 19.1.0-1223-gf9911e17 93d93c74a2cc c6caa21f436f 2024-08-01T06:58:40.360 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (30s) 17s ago 12m 28.5M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc 48e94d076e6f 2024-08-01T06:58:40.360 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (10s) 7s ago 9m 19.3M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc c4b83b46ff15 2024-08-01T06:58:40.360 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (10m) 17s ago 10m 16.0M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T06:58:40.360 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (9m) 7s ago 9m 17.1M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T06:58:40.361 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (8m) 17s ago 8m 240M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 9b7157499583 2024-08-01T06:58:40.361 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (8m) 17s ago 8m 241M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 f3b050aed6b7 2024-08-01T06:58:40.361 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (8m) 17s ago 8m 228M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 33a72e1a5c91 2024-08-01T06:58:40.361 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (7m) 7s ago 7m 276M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 58c175e0f4eb 2024-08-01T06:58:40.361 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (7m) 7s ago 7m 260M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 15b8f910bad7 2024-08-01T06:58:40.361 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (6m) 7s ago 6m 235M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 ac887841899e 2024-08-01T06:58:40.361 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (51s) 17s ago 10m 46.9M - 2.43.0 a07b618ecd1d 45d23c96382e 2024-08-01T06:58:40.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.359+0000 7f7f2ed6c640 1 -- 172.21.15.16:0/3066745708 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7f1406e2b0 msgr2=0x7f7f14070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:40.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.359+0000 7f7f2ed6c640 1 --2- 172.21.15.16:0/3066745708 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7f1406e2b0 0x7f7f14070770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7f28196b90 tx=0x7f7f200075b0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.359+0000 7f7f2ed6c640 1 -- 172.21.15.16:0/3066745708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f280feaa0 msgr2=0x7f7f28195670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:40.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.359+0000 7f7f2ed6c640 1 --2- 172.21.15.16:0/3066745708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f280feaa0 0x7f7f28195670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7f1002a9c0 tx=0x7f7f10005610 comp rx=0 tx=0).stop 2024-08-01T06:58:40.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.359+0000 7f7f2ed6c640 1 -- 172.21.15.16:0/3066745708 shutdown_connections 2024-08-01T06:58:40.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.359+0000 7f7f2ed6c640 1 --2- 172.21.15.16:0/3066745708 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7f1406e2b0 0x7f7f14070770 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.359+0000 7f7f2ed6c640 1 --2- 172.21.15.16:0/3066745708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f280ffca0 0x7f7f28195bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.359+0000 7f7f2ed6c640 1 --2- 172.21.15.16:0/3066745708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f280feaa0 0x7f7f28195670 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.359+0000 7f7f2ed6c640 1 -- 172.21.15.16:0/3066745708 >> 172.21.15.16:0/3066745708 conn(0x7f7f280fa250 msgr2=0x7f7f28068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:40.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.359+0000 7f7f2ed6c640 1 -- 172.21.15.16:0/3066745708 shutdown_connections 2024-08-01T06:58:40.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.359+0000 7f7f2ed6c640 1 -- 172.21.15.16:0/3066745708 wait complete. 2024-08-01T06:58:40.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.444+0000 7f06799a2640 1 -- 172.21.15.16:0/3027881955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0674100630 msgr2=0x7f0674102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:40.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.444+0000 7f06799a2640 1 --2- 172.21.15.16:0/3027881955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0674100630 0x7f0674102a20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0664009c50 tx=0x7f066402a9a0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.444+0000 7f06799a2640 1 -- 172.21.15.16:0/3027881955 shutdown_connections 2024-08-01T06:58:40.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.444+0000 7f06799a2640 1 --2- 172.21.15.16:0/3027881955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0674102f60 0x7f0674105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.444+0000 7f06799a2640 1 --2- 172.21.15.16:0/3027881955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0674100630 0x7f0674102a20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.444+0000 7f06799a2640 1 -- 172.21.15.16:0/3027881955 >> 172.21.15.16:0/3027881955 conn(0x7f06740fa250 msgr2=0x7f06740fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:40.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.444+0000 7f06799a2640 1 -- 172.21.15.16:0/3027881955 shutdown_connections 2024-08-01T06:58:40.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.444+0000 7f06799a2640 1 -- 172.21.15.16:0/3027881955 wait complete. 2024-08-01T06:58:40.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.444+0000 7f06799a2640 1 Processor -- start 2024-08-01T06:58:40.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.445+0000 7f06799a2640 1 -- start start 2024-08-01T06:58:40.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.445+0000 7f06799a2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0674100630 0x7f0674195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:40.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.445+0000 7f06799a2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0674102f60 0x7f0674195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:40.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.445+0000 7f06799a2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0674196150 con 0x7f0674100630 2024-08-01T06:58:40.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.445+0000 7f06799a2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06741962c0 con 0x7f0674102f60 2024-08-01T06:58:40.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.445+0000 7f0672ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0674100630 0x7f0674195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:40.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.445+0000 7f0672ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0674100630 0x7f0674195640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49616/0 (socket says 172.21.15.16:49616) 2024-08-01T06:58:40.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.445+0000 7f0672ffd640 1 -- 172.21.15.16:0/4100590248 learned_addr learned my addr 172.21.15.16:0/4100590248 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:58:40.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.445+0000 7f06727fc640 1 --2- 172.21.15.16:0/4100590248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0674102f60 0x7f0674195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:40.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.445+0000 7f0672ffd640 1 -- 172.21.15.16:0/4100590248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0674102f60 msgr2=0x7f0674195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:40.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.445+0000 7f0672ffd640 1 --2- 172.21.15.16:0/4100590248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0674102f60 0x7f0674195b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.445+0000 7f0672ffd640 1 -- 172.21.15.16:0/4100590248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0664009900 con 0x7f0674100630 2024-08-01T06:58:40.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.446+0000 7f0672ffd640 1 --2- 172.21.15.16:0/4100590248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0674100630 0x7f0674195640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f066402aec0 tx=0x7f0664030890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:40.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.446+0000 7f06789a0640 1 -- 172.21.15.16:0/4100590248 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0664003970 con 0x7f0674100630 2024-08-01T06:58:40.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.446+0000 7f06799a2640 1 -- 172.21.15.16:0/4100590248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f067419ad00 con 0x7f0674100630 2024-08-01T06:58:40.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.446+0000 7f06789a0640 1 -- 172.21.15.16:0/4100590248 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0664004050 con 0x7f0674100630 2024-08-01T06:58:40.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.446+0000 7f06789a0640 1 -- 172.21.15.16:0/4100590248 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0664044670 con 0x7f0674100630 2024-08-01T06:58:40.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.446+0000 7f06799a2640 1 -- 172.21.15.16:0/4100590248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067419b220 con 0x7f0674100630 2024-08-01T06:58:40.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.447+0000 7f06799a2640 1 -- 172.21.15.16:0/4100590248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06741087c0 con 0x7f0674100630 2024-08-01T06:58:40.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.447+0000 7f06789a0640 1 -- 172.21.15.16:0/4100590248 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f066400a040 con 0x7f0674100630 2024-08-01T06:58:40.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.448+0000 7f06789a0640 1 --2- 172.21.15.16:0/4100590248 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f065c06e2a0 0x7f065c070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:40.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.448+0000 7f06789a0640 1 -- 172.21.15.16:0/4100590248 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f06640af7e0 con 0x7f0674100630 2024-08-01T06:58:40.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.448+0000 7f06727fc640 1 --2- 172.21.15.16:0/4100590248 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f065c06e2a0 0x7f065c070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:40.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.449+0000 7f06727fc640 1 --2- 172.21.15.16:0/4100590248 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f065c06e2a0 0x7f065c070760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0674196b60 tx=0x7f0668005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:40.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.452+0000 7f06789a0640 1 -- 172.21.15.16:0/4100590248 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f06640788f0 con 0x7f0674100630 2024-08-01T06:58:40.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.705+0000 7f06799a2640 1 -- 172.21.15.16:0/4100590248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f067419b410 con 0x7f0674100630 2024-08-01T06:58:40.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.705+0000 7f06789a0640 1 -- 172.21.15.16:0/4100590248 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+730 (secure 0 0 0) 0x7f066407bfb0 con 0x7f0674100630 2024-08-01T06:58:40.708 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:58:40.708 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T06:58:40.708 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T06:58:40.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:58:40.708 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T06:58:40.708 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T06:58:40.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:58:40.709 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T06:58:40.709 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 6 2024-08-01T06:58:40.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:58:40.709 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T06:58:40.709 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4 2024-08-01T06:58:40.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:58:40.709 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T06:58:40.709 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 10, 2024-08-01T06:58:40.709 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 4 2024-08-01T06:58:40.709 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T06:58:40.709 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:58:40.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.708+0000 7f06799a2640 1 -- 172.21.15.16:0/4100590248 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f065c06e2a0 msgr2=0x7f065c070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:40.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.708+0000 7f06799a2640 1 --2- 172.21.15.16:0/4100590248 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f065c06e2a0 0x7f065c070760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0674196b60 tx=0x7f0668005f90 comp rx=0 tx=0).stop 2024-08-01T06:58:40.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.708+0000 7f06799a2640 1 -- 172.21.15.16:0/4100590248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0674100630 msgr2=0x7f0674195640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:40.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.708+0000 7f06799a2640 1 --2- 172.21.15.16:0/4100590248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0674100630 0x7f0674195640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f066402aec0 tx=0x7f0664030890 comp rx=0 tx=0).stop 2024-08-01T06:58:40.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.708+0000 7f06799a2640 1 -- 172.21.15.16:0/4100590248 shutdown_connections 2024-08-01T06:58:40.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.708+0000 7f06799a2640 1 --2- 172.21.15.16:0/4100590248 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f065c06e2a0 0x7f065c070760 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.708+0000 7f06799a2640 1 --2- 172.21.15.16:0/4100590248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0674102f60 0x7f0674195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.708+0000 7f06799a2640 1 --2- 172.21.15.16:0/4100590248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0674100630 0x7f0674195640 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.708+0000 7f06799a2640 1 -- 172.21.15.16:0/4100590248 >> 172.21.15.16:0/4100590248 conn(0x7f06740fa250 msgr2=0x7f06740fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:40.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.708+0000 7f06799a2640 1 -- 172.21.15.16:0/4100590248 shutdown_connections 2024-08-01T06:58:40.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.708+0000 7f06799a2640 1 -- 172.21.15.16:0/4100590248 wait complete. 2024-08-01T06:58:40.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.792+0000 7f374abc0640 1 -- 172.21.15.16:0/3282339155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37440ffb90 msgr2=0x7f37440fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:40.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.792+0000 7f374abc0640 1 --2- 172.21.15.16:0/3282339155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37440ffb90 0x7f37440fff90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3738009880 tx=0x7f373802a4a0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.792+0000 7f374abc0640 1 -- 172.21.15.16:0/3282339155 shutdown_connections 2024-08-01T06:58:40.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.792+0000 7f374abc0640 1 --2- 172.21.15.16:0/3282339155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3744100d90 0x7f3744101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.792+0000 7f374abc0640 1 --2- 172.21.15.16:0/3282339155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37440ffb90 0x7f37440fff90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.792+0000 7f374abc0640 1 -- 172.21.15.16:0/3282339155 >> 172.21.15.16:0/3282339155 conn(0x7f37440fb320 msgr2=0x7f37440fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.792+0000 7f374abc0640 1 -- 172.21.15.16:0/3282339155 shutdown_connections 2024-08-01T06:58:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.792+0000 7f374abc0640 1 -- 172.21.15.16:0/3282339155 wait complete. 2024-08-01T06:58:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.792+0000 7f374abc0640 1 Processor -- start 2024-08-01T06:58:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.793+0000 7f374abc0640 1 -- start start 2024-08-01T06:58:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.793+0000 7f374abc0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37440ffb90 0x7f37440741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.793+0000 7f374abc0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3744100d90 0x7f37440728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.793+0000 7f374abc0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37440747b0 con 0x7f3744100d90 2024-08-01T06:58:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.793+0000 7f374abc0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3744072e10 con 0x7f37440ffb90 2024-08-01T06:58:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.793+0000 7f3743fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3744100d90 0x7f37440728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.793+0000 7f3743fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3744100d90 0x7f37440728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49636/0 (socket says 172.21.15.16:49636) 2024-08-01T06:58:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.793+0000 7f3743fff640 1 -- 172.21.15.16:0/978156401 learned_addr learned my addr 172.21.15.16:0/978156401 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:58:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.793+0000 7f374895c640 1 --2- 172.21.15.16:0/978156401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37440ffb90 0x7f37440741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:40.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.793+0000 7f3743fff640 1 -- 172.21.15.16:0/978156401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37440ffb90 msgr2=0x7f37440741e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:40.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.793+0000 7f3743fff640 1 --2- 172.21.15.16:0/978156401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37440ffb90 0x7f37440741e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:40.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.793+0000 7f3743fff640 1 -- 172.21.15.16:0/978156401 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3738009560 con 0x7f3744100d90 2024-08-01T06:58:40.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.793+0000 7f3743fff640 1 --2- 172.21.15.16:0/978156401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3744100d90 0x7f37440728a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f373000d8d0 tx=0x7f373000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:40.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.794+0000 7f3741ffb640 1 -- 172.21.15.16:0/978156401 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3730009c00 con 0x7f3744100d90 2024-08-01T06:58:40.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.794+0000 7f3741ffb640 1 -- 172.21.15.16:0/978156401 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3730009d60 con 0x7f3744100d90 2024-08-01T06:58:40.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.794+0000 7f374abc0640 1 -- 172.21.15.16:0/978156401 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37440730f0 con 0x7f3744100d90 2024-08-01T06:58:40.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.794+0000 7f3741ffb640 1 -- 172.21.15.16:0/978156401 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37300049d0 con 0x7f3744100d90 2024-08-01T06:58:40.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.794+0000 7f374abc0640 1 -- 172.21.15.16:0/978156401 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3744073640 con 0x7f3744100d90 2024-08-01T06:58:40.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.795+0000 7f374abc0640 1 -- 172.21.15.16:0/978156401 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f374418f710 con 0x7f3744100d90 2024-08-01T06:58:40.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.795+0000 7f3741ffb640 1 -- 172.21.15.16:0/978156401 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f3730004c90 con 0x7f3744100d90 2024-08-01T06:58:40.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.796+0000 7f3741ffb640 1 --2- 172.21.15.16:0/978156401 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f373406e2b0 0x7f3734070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:40.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.796+0000 7f3741ffb640 1 -- 172.21.15.16:0/978156401 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f373008e0d0 con 0x7f3744100d90 2024-08-01T06:58:40.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.796+0000 7f374895c640 1 --2- 172.21.15.16:0/978156401 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f373406e2b0 0x7f3734070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:40.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.797+0000 7f374895c640 1 --2- 172.21.15.16:0/978156401 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f373406e2b0 0x7f3734070770 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3738005940 tx=0x7f37380058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:40.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:40.800+0000 7f3741ffb640 1 -- 172.21.15.16:0/978156401 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f37300571e0 con 0x7f3744100d90 2024-08-01T06:58:40.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:40 smithi016 ceph-mon[93645]: pgmap v14: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:58:40.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:40 smithi016 ceph-mon[93645]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:58:40.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:40 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:40.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:40 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:40.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:40 smithi016 ceph-mon[93645]: Reconfiguring ceph-exporter.smithi016 (monmap changed)... 2024-08-01T06:58:40.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:40 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi016", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-01T06:58:40.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:40 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi016", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-01T06:58:40.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:40 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi016", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-08-01T06:58:40.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:40 smithi016 ceph-mon[93645]: Unable to update caps for client.ceph-exporter.smithi016 2024-08-01T06:58:40.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:40 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi016"}]: dispatch 2024-08-01T06:58:40.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:40 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:40.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:40 smithi016 ceph-mon[93645]: Reconfiguring daemon ceph-exporter.smithi016 on smithi016 2024-08-01T06:58:40.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:40 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/4100590248' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:58:41.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.015+0000 7f374abc0640 1 -- 172.21.15.16:0/978156401 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3744108780 con 0x7f3744100d90 2024-08-01T06:58:41.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.016+0000 7f3741ffb640 1 -- 172.21.15.16:0/978156401 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1938 (secure 0 0 0) 0x7f373005a8a0 con 0x7f3744100d90 2024-08-01T06:58:41.019 INFO:teuthology.orchestra.run.smithi016.stdout:e19 2024-08-01T06:58:41.019 INFO:teuthology.orchestra.run.smithi016.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-08-01T06:58:41.019 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T06:58:41.019 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:58:41.019 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T06:58:41.019 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:58:41.019 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T06:58:41.020 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T06:58:41.020 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 19 2024-08-01T06:58:41.020 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T06:58:41.020 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T06:58:41.020 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T06:53:32.617145+0000 2024-08-01T06:58:41.020 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T06:58:41.020 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T06:58:41.020 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T06:58:41.020 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T06:58:41.020 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T06:58:41.020 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T06:58:41.021 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T06:58:41.021 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T06:58:41.021 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 46 2024-08-01T06:58:41.021 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:58:41.021 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T06:58:41.021 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T06:58:41.021 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=14482,1=24281} 2024-08-01T06:58:41.021 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T06:58:41.021 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T06:58:41.021 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T06:58:41.022 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T06:58:41.022 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T06:58:41.022 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T06:58:41.022 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T06:58:41.022 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T06:58:41.022 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T06:58:41.022 INFO:teuthology.orchestra.run.smithi016.stdout:qdb_cluster leader: 0 members: 2024-08-01T06:58:41.022 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:58:41.022 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:24299} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:58:41.022 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{1:24281} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:58:41.022 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:24291} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:58:41.022 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:58:41.022 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:58:41.023 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-08-01T06:58:41.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.018+0000 7f374abc0640 1 -- 172.21.15.16:0/978156401 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f373406e2b0 msgr2=0x7f3734070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:41.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.018+0000 7f374abc0640 1 --2- 172.21.15.16:0/978156401 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f373406e2b0 0x7f3734070770 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3738005940 tx=0x7f37380058d0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.018+0000 7f374abc0640 1 -- 172.21.15.16:0/978156401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3744100d90 msgr2=0x7f37440728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:41.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.018+0000 7f374abc0640 1 --2- 172.21.15.16:0/978156401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3744100d90 0x7f37440728a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f373000d8d0 tx=0x7f373000dd90 comp rx=0 tx=0).stop 2024-08-01T06:58:41.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.018+0000 7f374abc0640 1 -- 172.21.15.16:0/978156401 shutdown_connections 2024-08-01T06:58:41.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.018+0000 7f374abc0640 1 --2- 172.21.15.16:0/978156401 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f373406e2b0 0x7f3734070770 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.018+0000 7f374abc0640 1 --2- 172.21.15.16:0/978156401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3744100d90 0x7f37440728a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.018+0000 7f374abc0640 1 --2- 172.21.15.16:0/978156401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37440ffb90 0x7f37440741e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.018+0000 7f374abc0640 1 -- 172.21.15.16:0/978156401 >> 172.21.15.16:0/978156401 conn(0x7f37440fb320 msgr2=0x7f3744104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:41.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.018+0000 7f374abc0640 1 -- 172.21.15.16:0/978156401 shutdown_connections 2024-08-01T06:58:41.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.018+0000 7f374abc0640 1 -- 172.21.15.16:0/978156401 wait complete. 2024-08-01T06:58:41.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.103+0000 7fc2c73b3640 1 -- 172.21.15.16:0/3356852197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2c00feaf0 msgr2=0x7fc2c00feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:41.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.103+0000 7fc2c73b3640 1 --2- 172.21.15.16:0/3356852197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2c00feaf0 0x7fc2c00feef0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc009880 tx=0x7fc2bc02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.103+0000 7fc2c73b3640 1 -- 172.21.15.16:0/3356852197 shutdown_connections 2024-08-01T06:58:41.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.103+0000 7fc2c73b3640 1 --2- 172.21.15.16:0/3356852197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2c00ffcf0 0x7fc2c0100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.103+0000 7fc2c73b3640 1 --2- 172.21.15.16:0/3356852197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2c00feaf0 0x7fc2c00feef0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.103+0000 7fc2c73b3640 1 -- 172.21.15.16:0/3356852197 >> 172.21.15.16:0/3356852197 conn(0x7fc2c00fa280 msgr2=0x7fc2c00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:41.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.103+0000 7fc2c73b3640 1 -- 172.21.15.16:0/3356852197 shutdown_connections 2024-08-01T06:58:41.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.103+0000 7fc2c73b3640 1 -- 172.21.15.16:0/3356852197 wait complete. 2024-08-01T06:58:41.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.103+0000 7fc2c73b3640 1 Processor -- start 2024-08-01T06:58:41.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.103+0000 7fc2c73b3640 1 -- start start 2024-08-01T06:58:41.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.104+0000 7fc2c73b3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2c00feaf0 0x7fc2c0068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:41.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.104+0000 7fc2c73b3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2c00ffcf0 0x7fc2c019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:41.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.104+0000 7fc2c73b3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c019aa50 con 0x7fc2c00ffcf0 2024-08-01T06:58:41.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.104+0000 7fc2c73b3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c019ab90 con 0x7fc2c00feaf0 2024-08-01T06:58:41.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.104+0000 7fc2c494e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2c00ffcf0 0x7fc2c019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:41.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.104+0000 7fc2c494e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2c00ffcf0 0x7fc2c019a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49650/0 (socket says 172.21.15.16:49650) 2024-08-01T06:58:41.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.104+0000 7fc2c494e640 1 -- 172.21.15.16:0/3834557540 learned_addr learned my addr 172.21.15.16:0/3834557540 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:58:41.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.104+0000 7fc2c514f640 1 --2- 172.21.15.16:0/3834557540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2c00feaf0 0x7fc2c0068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:41.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.104+0000 7fc2c494e640 1 -- 172.21.15.16:0/3834557540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2c00feaf0 msgr2=0x7fc2c0068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:41.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.104+0000 7fc2c494e640 1 --2- 172.21.15.16:0/3834557540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2c00feaf0 0x7fc2c0068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.104+0000 7fc2c494e640 1 -- 172.21.15.16:0/3834557540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2bc009560 con 0x7fc2c00ffcf0 2024-08-01T06:58:41.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.104+0000 7fc2c494e640 1 --2- 172.21.15.16:0/3834557540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2c00ffcf0 0x7fc2c019a480 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000b420 tx=0x7fc2b000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:41.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.105+0000 7fc2b67fc640 1 -- 172.21.15.16:0/3834557540 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2b0011800 con 0x7fc2c00ffcf0 2024-08-01T06:58:41.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.105+0000 7fc2b67fc640 1 -- 172.21.15.16:0/3834557540 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2b0011e20 con 0x7fc2c00ffcf0 2024-08-01T06:58:41.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.105+0000 7fc2c73b3640 1 -- 172.21.15.16:0/3834557540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c019ae20 con 0x7fc2c00ffcf0 2024-08-01T06:58:41.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.105+0000 7fc2b67fc640 1 -- 172.21.15.16:0/3834557540 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2b000f2e0 con 0x7fc2c00ffcf0 2024-08-01T06:58:41.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.105+0000 7fc2c73b3640 1 -- 172.21.15.16:0/3834557540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c019b3c0 con 0x7fc2c00ffcf0 2024-08-01T06:58:41.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.106+0000 7fc2c73b3640 1 -- 172.21.15.16:0/3834557540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c00feef0 con 0x7fc2c00ffcf0 2024-08-01T06:58:41.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.106+0000 7fc2b67fc640 1 -- 172.21.15.16:0/3834557540 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fc2b0010380 con 0x7fc2c00ffcf0 2024-08-01T06:58:41.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.107+0000 7fc2b67fc640 1 --2- 172.21.15.16:0/3834557540 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc2ac06e2b0 0x7fc2ac070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:41.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.107+0000 7fc2b67fc640 1 -- 172.21.15.16:0/3834557540 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fc2b008dac0 con 0x7fc2c00ffcf0 2024-08-01T06:58:41.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.107+0000 7fc2c514f640 1 --2- 172.21.15.16:0/3834557540 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc2ac06e2b0 0x7fc2ac070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:41.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.108+0000 7fc2c514f640 1 --2- 172.21.15.16:0/3834557540 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc2ac06e2b0 0x7fc2ac070770 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc009230 tx=0x7fc2bc0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:41.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.111+0000 7fc2b67fc640 1 -- 172.21.15.16:0/3834557540 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc2b0056d60 con 0x7fc2c00ffcf0 2024-08-01T06:58:41.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:40 smithi089 ceph-mon[82218]: pgmap v14: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:58:41.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:40 smithi089 ceph-mon[82218]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:58:41.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:40 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:41.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:40 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:41.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:40 smithi089 ceph-mon[82218]: Reconfiguring ceph-exporter.smithi016 (monmap changed)... 2024-08-01T06:58:41.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:40 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi016", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-01T06:58:41.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:40 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi016", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-01T06:58:41.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:40 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi016", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-08-01T06:58:41.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:40 smithi089 ceph-mon[82218]: Unable to update caps for client.ceph-exporter.smithi016 2024-08-01T06:58:41.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:40 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi016"}]: dispatch 2024-08-01T06:58:41.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:40 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:41.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:40 smithi089 ceph-mon[82218]: Reconfiguring daemon ceph-exporter.smithi016 on smithi016 2024-08-01T06:58:41.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:40 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/4100590248' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:58:41.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.308+0000 7fc2c73b3640 1 -- 172.21.15.16:0/3834557540 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2c002c540 con 0x7fc2ac06e2b0 2024-08-01T06:58:41.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.309+0000 7fc2b67fc640 1 -- 172.21.15.16:0/3834557540 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fc2c002c540 con 0x7fc2ac06e2b0 2024-08-01T06:58:41.312 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:58:41.312 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T06:58:41.312 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T06:58:41.312 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T06:58:41.312 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-08-01T06:58:41.312 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-08-01T06:58:41.313 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-08-01T06:58:41.313 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-08-01T06:58:41.313 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "4/23 daemons upgraded", 2024-08-01T06:58:41.313 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading mon daemons", 2024-08-01T06:58:41.313 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T06:58:41.313 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:58:41.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.312+0000 7fc2c73b3640 1 -- 172.21.15.16:0/3834557540 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc2ac06e2b0 msgr2=0x7fc2ac070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:41.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.312+0000 7fc2c73b3640 1 --2- 172.21.15.16:0/3834557540 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc2ac06e2b0 0x7fc2ac070770 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc009230 tx=0x7fc2bc0314e0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.312+0000 7fc2c73b3640 1 -- 172.21.15.16:0/3834557540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2c00ffcf0 msgr2=0x7fc2c019a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:41.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.312+0000 7fc2c73b3640 1 --2- 172.21.15.16:0/3834557540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2c00ffcf0 0x7fc2c019a480 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000b420 tx=0x7fc2b000b8e0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.312+0000 7fc2c73b3640 1 -- 172.21.15.16:0/3834557540 shutdown_connections 2024-08-01T06:58:41.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.312+0000 7fc2c73b3640 1 --2- 172.21.15.16:0/3834557540 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc2ac06e2b0 0x7fc2ac070770 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.312+0000 7fc2c73b3640 1 --2- 172.21.15.16:0/3834557540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2c00ffcf0 0x7fc2c019a480 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.312+0000 7fc2c73b3640 1 --2- 172.21.15.16:0/3834557540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2c00feaf0 0x7fc2c0068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.312+0000 7fc2c73b3640 1 -- 172.21.15.16:0/3834557540 >> 172.21.15.16:0/3834557540 conn(0x7fc2c00fa280 msgr2=0x7fc2c0103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:41.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.312+0000 7fc2c73b3640 1 -- 172.21.15.16:0/3834557540 shutdown_connections 2024-08-01T06:58:41.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.312+0000 7fc2c73b3640 1 -- 172.21.15.16:0/3834557540 wait complete. 2024-08-01T06:58:41.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.398+0000 7fc92c021640 1 -- 172.21.15.16:0/430711675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9240fea80 msgr2=0x7fc9240fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:41.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.398+0000 7fc92c021640 1 --2- 172.21.15.16:0/430711675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9240fea80 0x7fc9240fee80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc920009880 tx=0x7fc92002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.398+0000 7fc92c021640 1 -- 172.21.15.16:0/430711675 shutdown_connections 2024-08-01T06:58:41.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.398+0000 7fc92c021640 1 --2- 172.21.15.16:0/430711675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9240ffc80 0x7fc924100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.398+0000 7fc92c021640 1 --2- 172.21.15.16:0/430711675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9240fea80 0x7fc9240fee80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.398+0000 7fc92c021640 1 -- 172.21.15.16:0/430711675 >> 172.21.15.16:0/430711675 conn(0x7fc9240fa230 msgr2=0x7fc9240fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:41.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.399+0000 7fc92c021640 1 -- 172.21.15.16:0/430711675 shutdown_connections 2024-08-01T06:58:41.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.399+0000 7fc92c021640 1 -- 172.21.15.16:0/430711675 wait complete. 2024-08-01T06:58:41.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.399+0000 7fc92c021640 1 Processor -- start 2024-08-01T06:58:41.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.399+0000 7fc92c021640 1 -- start start 2024-08-01T06:58:41.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.399+0000 7fc92c021640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9240fea80 0x7fc924068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:41.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.399+0000 7fc92c021640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9240ffc80 0x7fc92419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:41.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.399+0000 7fc92c021640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92419aa30 con 0x7fc9240fea80 2024-08-01T06:58:41.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.399+0000 7fc92c021640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92419ab70 con 0x7fc9240ffc80 2024-08-01T06:58:41.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.400+0000 7fc929dbd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9240fea80 0x7fc924068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:41.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.400+0000 7fc929dbd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9240fea80 0x7fc924068fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49676/0 (socket says 172.21.15.16:49676) 2024-08-01T06:58:41.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.400+0000 7fc929dbd640 1 -- 172.21.15.16:0/2910665514 learned_addr learned my addr 172.21.15.16:0/2910665514 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:58:41.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.400+0000 7fc9295bc640 1 --2- 172.21.15.16:0/2910665514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9240ffc80 0x7fc92419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:41.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.400+0000 7fc929dbd640 1 -- 172.21.15.16:0/2910665514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9240ffc80 msgr2=0x7fc92419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:41.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.400+0000 7fc929dbd640 1 --2- 172.21.15.16:0/2910665514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9240ffc80 0x7fc92419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.400+0000 7fc929dbd640 1 -- 172.21.15.16:0/2910665514 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc920009560 con 0x7fc9240fea80 2024-08-01T06:58:41.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.400+0000 7fc929dbd640 1 --2- 172.21.15.16:0/2910665514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9240fea80 0x7fc924068fb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc92002a9c0 tx=0x7fc920005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:41.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.400+0000 7fc91affd640 1 -- 172.21.15.16:0/2910665514 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc920004b20 con 0x7fc9240fea80 2024-08-01T06:58:41.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.400+0000 7fc92c021640 1 -- 172.21.15.16:0/2910665514 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92419adc0 con 0x7fc9240fea80 2024-08-01T06:58:41.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.400+0000 7fc91affd640 1 -- 172.21.15.16:0/2910665514 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc920004c80 con 0x7fc9240fea80 2024-08-01T06:58:41.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.400+0000 7fc91affd640 1 -- 172.21.15.16:0/2910665514 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc920003b50 con 0x7fc9240fea80 2024-08-01T06:58:41.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.401+0000 7fc92c021640 1 -- 172.21.15.16:0/2910665514 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92419b330 con 0x7fc9240fea80 2024-08-01T06:58:41.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.401+0000 7fc92c021640 1 -- 172.21.15.16:0/2910665514 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9241076f0 con 0x7fc9240fea80 2024-08-01T06:58:41.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.402+0000 7fc91affd640 1 -- 172.21.15.16:0/2910665514 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fc920031d00 con 0x7fc9240fea80 2024-08-01T06:58:41.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.402+0000 7fc91affd640 1 --2- 172.21.15.16:0/2910665514 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc91006e2a0 0x7fc910070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:58:41.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.403+0000 7fc91affd640 1 -- 172.21.15.16:0/2910665514 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fc9200af640 con 0x7fc9240fea80 2024-08-01T06:58:41.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.403+0000 7fc9295bc640 1 --2- 172.21.15.16:0/2910665514 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc91006e2a0 0x7fc910070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:58:41.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.403+0000 7fc9295bc640 1 --2- 172.21.15.16:0/2910665514 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc91006e2a0 0x7fc910070760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc924069530 tx=0x7fc914009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:58:41.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.407+0000 7fc91affd640 1 -- 172.21.15.16:0/2910665514 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc920078750 con 0x7fc9240fea80 2024-08-01T06:58:41.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.679+0000 7fc92c021640 1 -- 172.21.15.16:0/2910665514 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc924107880 con 0x7fc9240fea80 2024-08-01T06:58:41.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.679+0000 7fc91affd640 1 -- 172.21.15.16:0/2910665514 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc92007be10 con 0x7fc9240fea80 2024-08-01T06:58:41.682 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-08-01T06:58:41.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.681+0000 7fc92c021640 1 -- 172.21.15.16:0/2910665514 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc91006e2a0 msgr2=0x7fc910070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:41.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.681+0000 7fc92c021640 1 --2- 172.21.15.16:0/2910665514 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc91006e2a0 0x7fc910070760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc924069530 tx=0x7fc914009110 comp rx=0 tx=0).stop 2024-08-01T06:58:41.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.681+0000 7fc92c021640 1 -- 172.21.15.16:0/2910665514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9240fea80 msgr2=0x7fc924068fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:58:41.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.681+0000 7fc92c021640 1 --2- 172.21.15.16:0/2910665514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9240fea80 0x7fc924068fb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc92002a9c0 tx=0x7fc920005610 comp rx=0 tx=0).stop 2024-08-01T06:58:41.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.681+0000 7fc92c021640 1 -- 172.21.15.16:0/2910665514 shutdown_connections 2024-08-01T06:58:41.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.681+0000 7fc92c021640 1 --2- 172.21.15.16:0/2910665514 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc91006e2a0 0x7fc910070760 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.681+0000 7fc92c021640 1 --2- 172.21.15.16:0/2910665514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9240ffc80 0x7fc92419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.681+0000 7fc92c021640 1 --2- 172.21.15.16:0/2910665514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9240fea80 0x7fc924068fb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:58:41.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.681+0000 7fc92c021640 1 -- 172.21.15.16:0/2910665514 >> 172.21.15.16:0/2910665514 conn(0x7fc9240fa230 msgr2=0x7fc924102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:58:41.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.681+0000 7fc92c021640 1 -- 172.21.15.16:0/2910665514 shutdown_connections 2024-08-01T06:58:41.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:58:41.682+0000 7fc92c021640 1 -- 172.21.15.16:0/2910665514 wait complete. 2024-08-01T06:58:41.971 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:41 smithi016 ceph-mon[93645]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:58:41.972 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:41 smithi016 ceph-mon[93645]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:58:41.972 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:41 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/978156401' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:58:41.972 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:41.972 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:41.972 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi016", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-01T06:58:41.972 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:41.972 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:41 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2910665514' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:58:42.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:41 smithi089 ceph-mon[82218]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:58:42.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:41 smithi089 ceph-mon[82218]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:58:42.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:41 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/978156401' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:58:42.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:42.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:42.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi016", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-01T06:58:42.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:42.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:41 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2910665514' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:58:43.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:42 smithi089 ceph-mon[82218]: pgmap v15: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:58:43.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:42 smithi089 ceph-mon[82218]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:58:43.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:42 smithi089 ceph-mon[82218]: Reconfiguring crash.smithi016 (monmap changed)... 2024-08-01T06:58:43.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:42 smithi089 ceph-mon[82218]: Reconfiguring daemon crash.smithi016 on smithi016 2024-08-01T06:58:43.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:42 smithi016 ceph-mon[93645]: pgmap v15: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:58:43.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:42 smithi016 ceph-mon[93645]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:58:43.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:42 smithi016 ceph-mon[93645]: Reconfiguring crash.smithi016 (monmap changed)... 2024-08-01T06:58:43.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:42 smithi016 ceph-mon[93645]: Reconfiguring daemon crash.smithi016 on smithi016 2024-08-01T06:58:44.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:43 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:44.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:43 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:44.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:43 smithi089 ceph-mon[82218]: Reconfiguring osd.0 (monmap changed)... 2024-08-01T06:58:44.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:43 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-01T06:58:44.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:43 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:44.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:43 smithi089 ceph-mon[82218]: Reconfiguring daemon osd.0 on smithi016 2024-08-01T06:58:44.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:43 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:44.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:43 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:44.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:43 smithi016 ceph-mon[93645]: Reconfiguring osd.0 (monmap changed)... 2024-08-01T06:58:44.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:43 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-01T06:58:44.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:43 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:44.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:43 smithi016 ceph-mon[93645]: Reconfiguring daemon osd.0 on smithi016 2024-08-01T06:58:44.977 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:44 smithi016 ceph-mon[93645]: pgmap v16: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T06:58:44.977 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:44 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:44.977 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:44 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:44.977 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:44 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-01T06:58:44.977 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:44 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:45.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:44 smithi089 ceph-mon[82218]: pgmap v16: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T06:58:45.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:44 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:45.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:44 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:45.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:44 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-01T06:58:45.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:44 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:46.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:45 smithi016 ceph-mon[93645]: Reconfiguring osd.1 (monmap changed)... 2024-08-01T06:58:46.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:45 smithi016 ceph-mon[93645]: Reconfiguring daemon osd.1 on smithi016 2024-08-01T06:58:46.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:45 smithi089 ceph-mon[82218]: Reconfiguring osd.1 (monmap changed)... 2024-08-01T06:58:46.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:45 smithi089 ceph-mon[82218]: Reconfiguring daemon osd.1 on smithi016 2024-08-01T06:58:47.306 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:46 smithi016 ceph-mon[93645]: pgmap v17: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:58:47.306 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:46 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:47.306 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:46 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:47.306 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:46 smithi016 ceph-mon[93645]: Reconfiguring osd.2 (monmap changed)... 2024-08-01T06:58:47.306 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:46 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-01T06:58:47.306 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:46 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:47.307 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:46 smithi016 ceph-mon[93645]: Reconfiguring daemon osd.2 on smithi016 2024-08-01T06:58:47.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:46 smithi089 ceph-mon[82218]: pgmap v17: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:58:47.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:46 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:47.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:46 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:47.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:46 smithi089 ceph-mon[82218]: Reconfiguring osd.2 (monmap changed)... 2024-08-01T06:58:47.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:46 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-01T06:58:47.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:46 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:47.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:46 smithi089 ceph-mon[82218]: Reconfiguring daemon osd.2 on smithi016 2024-08-01T06:58:48.118 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:58:48.118 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:48.118 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:48.118 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi016.bgqkxu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T06:58:48.119 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:58:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:48.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi016.bgqkxu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T06:58:48.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:49.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:48 smithi016 ceph-mon[93645]: pgmap v18: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:58:49.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:48 smithi016 ceph-mon[93645]: Reconfiguring mds.cephfs.smithi016.bgqkxu (monmap changed)... 2024-08-01T06:58:49.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:48 smithi016 ceph-mon[93645]: Reconfiguring daemon mds.cephfs.smithi016.bgqkxu on smithi016 2024-08-01T06:58:49.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:49.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:49.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi016.fziqod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T06:58:49.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:49.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:48 smithi089 ceph-mon[82218]: pgmap v18: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:58:49.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:48 smithi089 ceph-mon[82218]: Reconfiguring mds.cephfs.smithi016.bgqkxu (monmap changed)... 2024-08-01T06:58:49.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:48 smithi089 ceph-mon[82218]: Reconfiguring daemon mds.cephfs.smithi016.bgqkxu on smithi016 2024-08-01T06:58:49.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:49.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:49.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi016.fziqod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T06:58:49.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:50.297 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:49 smithi016 ceph-mon[93645]: Reconfiguring mds.cephfs.smithi016.fziqod (monmap changed)... 2024-08-01T06:58:50.298 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:49 smithi016 ceph-mon[93645]: Reconfiguring daemon mds.cephfs.smithi016.fziqod on smithi016 2024-08-01T06:58:50.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:49 smithi089 ceph-mon[82218]: Reconfiguring mds.cephfs.smithi016.fziqod (monmap changed)... 2024-08-01T06:58:50.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:49 smithi089 ceph-mon[82218]: Reconfiguring daemon mds.cephfs.smithi016.fziqod on smithi016 2024-08-01T06:58:50.983 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:50 smithi089 ceph-mon[82218]: pgmap v19: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:58:50.984 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:50 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:50.984 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:50 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:50.984 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:50 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-01T06:58:50.984 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:50 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-01T06:58:50.984 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:50 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-08-01T06:58:50.984 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:50 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi089"}]: dispatch 2024-08-01T06:58:50.984 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:50 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:51.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:50 smithi016 ceph-mon[93645]: pgmap v19: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:58:51.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:50 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:51.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:50 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:51.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:50 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-01T06:58:51.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:50 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-01T06:58:51.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:50 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-08-01T06:58:51.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:50 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi089"}]: dispatch 2024-08-01T06:58:51.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:50 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:52.216 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:51 smithi089 ceph-mon[82218]: Reconfiguring ceph-exporter.smithi089 (monmap changed)... 2024-08-01T06:58:52.217 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:51 smithi089 ceph-mon[82218]: Unable to update caps for client.ceph-exporter.smithi089 2024-08-01T06:58:52.217 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:51 smithi089 ceph-mon[82218]: Reconfiguring daemon ceph-exporter.smithi089 on smithi089 2024-08-01T06:58:52.217 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:51 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:52.217 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:51 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:52.217 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:51 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-01T06:58:52.217 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:51 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:52.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:51 smithi016 ceph-mon[93645]: Reconfiguring ceph-exporter.smithi089 (monmap changed)... 2024-08-01T06:58:52.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:51 smithi016 ceph-mon[93645]: Unable to update caps for client.ceph-exporter.smithi089 2024-08-01T06:58:52.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:51 smithi016 ceph-mon[93645]: Reconfiguring daemon ceph-exporter.smithi089 on smithi089 2024-08-01T06:58:52.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:51 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:52.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:51 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:52.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:51 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-01T06:58:52.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:51 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:53.275 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:52 smithi089 ceph-mon[82218]: pgmap v20: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:58:53.275 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:52 smithi089 ceph-mon[82218]: Reconfiguring crash.smithi089 (monmap changed)... 2024-08-01T06:58:53.275 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:52 smithi089 ceph-mon[82218]: Reconfiguring daemon crash.smithi089 on smithi089 2024-08-01T06:58:53.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:52 smithi016 ceph-mon[93645]: pgmap v20: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:58:53.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:52 smithi016 ceph-mon[93645]: Reconfiguring crash.smithi089 (monmap changed)... 2024-08-01T06:58:53.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:52 smithi016 ceph-mon[93645]: Reconfiguring daemon crash.smithi089 on smithi089 2024-08-01T06:58:54.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:54 smithi016 ceph-mon[93645]: pgmap v21: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:58:54.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:54 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:54.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:54 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:54.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:54 smithi016 ceph-mon[93645]: Reconfiguring mgr.smithi089.hfgnsr (monmap changed)... 2024-08-01T06:58:54.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:54 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.hfgnsr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-01T06:58:54.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:54 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-01T06:58:54.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:54 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:54.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:54 smithi016 ceph-mon[93645]: Reconfiguring daemon mgr.smithi089.hfgnsr on smithi089 2024-08-01T06:58:54.632 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:54 smithi089 ceph-mon[82218]: pgmap v21: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:58:54.632 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:54 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:54.632 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:54 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:54.632 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:54 smithi089 ceph-mon[82218]: Reconfiguring mgr.smithi089.hfgnsr (monmap changed)... 2024-08-01T06:58:54.632 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:54 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.hfgnsr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-01T06:58:54.632 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:54 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-01T06:58:54.632 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:54 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:54.632 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:54 smithi089 ceph-mon[82218]: Reconfiguring daemon mgr.smithi089.hfgnsr on smithi089 2024-08-01T06:58:56.094 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:55 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:56.094 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:55 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:56.094 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:55 smithi089 ceph-mon[82218]: Reconfiguring mon.smithi089 (monmap changed)... 2024-08-01T06:58:56.094 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:55 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-01T06:58:56.094 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:55 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-01T06:58:56.094 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:55 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:56.094 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:55 smithi089 ceph-mon[82218]: Reconfiguring daemon mon.smithi089 on smithi089 2024-08-01T06:58:56.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:55 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:56.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:55 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:56.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:55 smithi016 ceph-mon[93645]: Reconfiguring mon.smithi089 (monmap changed)... 2024-08-01T06:58:56.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:55 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-01T06:58:56.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:55 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-01T06:58:56.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:55 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:56.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:55 smithi016 ceph-mon[93645]: Reconfiguring daemon mon.smithi089 on smithi089 2024-08-01T06:58:56.851 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:56 smithi089 ceph-mon[82218]: pgmap v22: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T06:58:56.851 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:56 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:56.851 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:56 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:56.851 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:56 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-01T06:58:56.851 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:56 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:57.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:56 smithi016 ceph-mon[93645]: pgmap v22: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T06:58:57.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:56 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:57.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:56 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:57.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:56 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-01T06:58:57.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:56 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:58.016 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:57 smithi089 ceph-mon[82218]: Reconfiguring osd.3 (monmap changed)... 2024-08-01T06:58:58.017 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:57 smithi089 ceph-mon[82218]: Reconfiguring daemon osd.3 on smithi089 2024-08-01T06:58:58.017 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:57 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:58.017 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:57 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:58.017 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:57 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-01T06:58:58.017 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:57 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:58.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:57 smithi016 ceph-mon[93645]: Reconfiguring osd.3 (monmap changed)... 2024-08-01T06:58:58.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:57 smithi016 ceph-mon[93645]: Reconfiguring daemon osd.3 on smithi089 2024-08-01T06:58:58.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:57 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:58.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:57 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:58:58.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:57 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-01T06:58:58.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:57 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:58:58.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:58 smithi089 ceph-mon[82218]: pgmap v23: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:58:58.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:58 smithi089 ceph-mon[82218]: Reconfiguring osd.4 (monmap changed)... 2024-08-01T06:58:58.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:58 smithi089 ceph-mon[82218]: Reconfiguring daemon osd.4 on smithi089 2024-08-01T06:58:59.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:58 smithi016 ceph-mon[93645]: pgmap v23: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:58:59.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:58 smithi016 ceph-mon[93645]: Reconfiguring osd.4 (monmap changed)... 2024-08-01T06:58:59.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:58 smithi016 ceph-mon[93645]: Reconfiguring daemon osd.4 on smithi089 2024-08-01T06:59:00.265 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:59 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:00.265 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:59 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:00.265 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:59 smithi016 ceph-mon[93645]: Reconfiguring osd.5 (monmap changed)... 2024-08-01T06:59:00.265 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:59 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-01T06:59:00.265 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:59 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:59:00.265 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:58:59 smithi016 ceph-mon[93645]: Reconfiguring daemon osd.5 on smithi089 2024-08-01T06:59:00.327 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:59 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:00.327 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:59 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:00.327 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:59 smithi089 ceph-mon[82218]: Reconfiguring osd.5 (monmap changed)... 2024-08-01T06:59:00.327 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:59 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-01T06:59:00.327 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:59 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:59:00.327 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:58:59 smithi089 ceph-mon[82218]: Reconfiguring daemon osd.5 on smithi089 2024-08-01T06:59:01.042 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:00 smithi089 ceph-mon[82218]: pgmap v24: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:59:01.042 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:00 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:01.042 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:00 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:01.042 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:00 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.jhouje", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T06:59:01.042 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:00 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:59:01.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:00 smithi016 ceph-mon[93645]: pgmap v24: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:59:01.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:00 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:01.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:00 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:01.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:00 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.jhouje", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T06:59:01.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:00 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:59:02.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:01 smithi089 ceph-mon[82218]: Reconfiguring mds.cephfs.smithi089.jhouje (monmap changed)... 2024-08-01T06:59:02.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:01 smithi089 ceph-mon[82218]: Reconfiguring daemon mds.cephfs.smithi089.jhouje on smithi089 2024-08-01T06:59:02.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:01 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:02.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:01 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:02.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:01 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.xanuld", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T06:59:02.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:01 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:59:02.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:01 smithi016 ceph-mon[93645]: Reconfiguring mds.cephfs.smithi089.jhouje (monmap changed)... 2024-08-01T06:59:02.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:01 smithi016 ceph-mon[93645]: Reconfiguring daemon mds.cephfs.smithi089.jhouje on smithi089 2024-08-01T06:59:02.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:01 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:02.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:01 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:02.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:01 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.xanuld", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T06:59:02.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:01 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:59:03.150 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:02 smithi089 ceph-mon[82218]: pgmap v25: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:59:03.150 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:02 smithi089 ceph-mon[82218]: Reconfiguring mds.cephfs.smithi089.xanuld (monmap changed)... 2024-08-01T06:59:03.150 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:02 smithi089 ceph-mon[82218]: Reconfiguring daemon mds.cephfs.smithi089.xanuld on smithi089 2024-08-01T06:59:03.150 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:59:03.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:02 smithi016 ceph-mon[93645]: pgmap v25: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:59:03.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:02 smithi016 ceph-mon[93645]: Reconfiguring mds.cephfs.smithi089.xanuld (monmap changed)... 2024-08-01T06:59:03.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:02 smithi016 ceph-mon[93645]: Reconfiguring daemon mds.cephfs.smithi089.xanuld on smithi089 2024-08-01T06:59:03.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:59:04.523 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:04 smithi016 ceph-mon[93645]: pgmap v26: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:59:04.523 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:04 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:04.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:04 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:04.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:04 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:59:04.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:04 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:04.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:04 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:04.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:04 smithi016 ceph-mon[93645]: Upgrade: Setting container_image for all mon 2024-08-01T06:59:04.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:04 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:04.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:04 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi016"}]: dispatch 2024-08-01T06:59:04.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:04 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi016"}]': finished 2024-08-01T06:59:04.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:04 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi089"}]: dispatch 2024-08-01T06:59:04.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:04 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi089"}]': finished 2024-08-01T06:59:04.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:04 smithi089 ceph-mon[82218]: pgmap v26: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:59:04.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:04 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:04.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:04 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:04.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:04 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:59:04.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:04 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:04.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:04 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:04.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:04 smithi089 ceph-mon[82218]: Upgrade: Setting container_image for all mon 2024-08-01T06:59:04.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:04 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:04.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:04 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi016"}]: dispatch 2024-08-01T06:59:04.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:04 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi016"}]': finished 2024-08-01T06:59:04.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:04 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi089"}]: dispatch 2024-08-01T06:59:04.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:04 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi089"}]': finished 2024-08-01T06:59:06.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:05 smithi089 ceph-mon[82218]: Upgrade: Updating crash.smithi016 (1/2) 2024-08-01T06:59:06.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:05 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:06.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:05 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi016", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-01T06:59:06.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:05 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:59:06.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:05 smithi089 ceph-mon[82218]: Deploying daemon crash.smithi016 on smithi016 2024-08-01T06:59:06.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:05 smithi016 ceph-mon[93645]: Upgrade: Updating crash.smithi016 (1/2) 2024-08-01T06:59:06.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:05 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:06.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:05 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi016", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-01T06:59:06.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:05 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:59:06.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:05 smithi016 ceph-mon[93645]: Deploying daemon crash.smithi016 on smithi016 2024-08-01T06:59:06.986 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:06 smithi016 ceph-mon[93645]: pgmap v27: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T06:59:07.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:06 smithi089 ceph-mon[82218]: pgmap v27: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T06:59:08.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:08 smithi016 ceph-mon[93645]: pgmap v28: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:59:08.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:08 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:08.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:08 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:09.058 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:08 smithi089 ceph-mon[82218]: pgmap v28: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:59:09.058 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:08 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:09.058 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:08 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:11.122 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:10 smithi016 ceph-mon[93645]: pgmap v29: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:59:11.122 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:11.122 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-01T06:59:11.123 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:59:11.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:10 smithi089 ceph-mon[82218]: pgmap v29: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:59:11.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:11.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-01T06:59:11.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:59:11.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.773+0000 7fd50f8a2640 1 -- 172.21.15.16:0/4036573149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5080ffcf0 msgr2=0x7fd508100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.773+0000 7fd50f8a2640 1 --2- 172.21.15.16:0/4036573149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5080ffcf0 0x7fd508100170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009880 tx=0x7fd4f802a4a0 comp rx=0 tx=0).stop 2024-08-01T06:59:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.773+0000 7fd50f8a2640 1 -- 172.21.15.16:0/4036573149 shutdown_connections 2024-08-01T06:59:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.773+0000 7fd50f8a2640 1 --2- 172.21.15.16:0/4036573149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5080ffcf0 0x7fd508100170 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.773+0000 7fd50f8a2640 1 --2- 172.21.15.16:0/4036573149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5080feaf0 0x7fd5080feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.773+0000 7fd50f8a2640 1 -- 172.21.15.16:0/4036573149 >> 172.21.15.16:0/4036573149 conn(0x7fd5080fa280 msgr2=0x7fd5080fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.773+0000 7fd50f8a2640 1 -- 172.21.15.16:0/4036573149 shutdown_connections 2024-08-01T06:59:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.773+0000 7fd50f8a2640 1 -- 172.21.15.16:0/4036573149 wait complete. 2024-08-01T06:59:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.773+0000 7fd50f8a2640 1 Processor -- start 2024-08-01T06:59:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.773+0000 7fd50f8a2640 1 -- start start 2024-08-01T06:59:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.774+0000 7fd50f8a2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5080feaf0 0x7fd508068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.774+0000 7fd50f8a2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5080ffcf0 0x7fd50819c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.774+0000 7fd50f8a2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd508196240 con 0x7fd5080ffcf0 2024-08-01T06:59:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.774+0000 7fd50f8a2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50819cd10 con 0x7fd5080feaf0 2024-08-01T06:59:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.774+0000 7fd50ce3d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5080ffcf0 0x7fd50819c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.774+0000 7fd50ce3d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5080ffcf0 0x7fd50819c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41136/0 (socket says 172.21.15.16:41136) 2024-08-01T06:59:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.774+0000 7fd50ce3d640 1 -- 172.21.15.16:0/1651677540 learned_addr learned my addr 172.21.15.16:0/1651677540 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:59:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.774+0000 7fd50d63e640 1 --2- 172.21.15.16:0/1651677540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5080feaf0 0x7fd508068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.774+0000 7fd50ce3d640 1 -- 172.21.15.16:0/1651677540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5080feaf0 msgr2=0x7fd508068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.774+0000 7fd50ce3d640 1 --2- 172.21.15.16:0/1651677540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5080feaf0 0x7fd508068790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.774+0000 7fd50ce3d640 1 -- 172.21.15.16:0/1651677540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f8009560 con 0x7fd5080ffcf0 2024-08-01T06:59:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.774+0000 7fd50ce3d640 1 --2- 172.21.15.16:0/1651677540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5080ffcf0 0x7fd50819c7d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80054f0 tx=0x7fd4f8005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.775+0000 7fd4fe7fc640 1 -- 172.21.15.16:0/1651677540 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4f8004aa0 con 0x7fd5080ffcf0 2024-08-01T06:59:11.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.775+0000 7fd4fe7fc640 1 -- 172.21.15.16:0/1651677540 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4f8004c00 con 0x7fd5080ffcf0 2024-08-01T06:59:11.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.775+0000 7fd50f8a2640 1 -- 172.21.15.16:0/1651677540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50819cf40 con 0x7fd5080ffcf0 2024-08-01T06:59:11.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.775+0000 7fd4fe7fc640 1 -- 172.21.15.16:0/1651677540 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4f8003b50 con 0x7fd5080ffcf0 2024-08-01T06:59:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.775+0000 7fd50f8a2640 1 -- 172.21.15.16:0/1651677540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50819d3a0 con 0x7fd5080ffcf0 2024-08-01T06:59:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.776+0000 7fd50f8a2640 1 -- 172.21.15.16:0/1651677540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd50818e670 con 0x7fd5080ffcf0 2024-08-01T06:59:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.776+0000 7fd4fe7fc640 1 -- 172.21.15.16:0/1651677540 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fd4f8031640 con 0x7fd5080ffcf0 2024-08-01T06:59:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.777+0000 7fd4fe7fc640 1 --2- 172.21.15.16:0/1651677540 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd4f406e2b0 0x7fd4f4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.777+0000 7fd4fe7fc640 1 -- 172.21.15.16:0/1651677540 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd4f80af540 con 0x7fd5080ffcf0 2024-08-01T06:59:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.777+0000 7fd50d63e640 1 --2- 172.21.15.16:0/1651677540 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd4f406e2b0 0x7fd4f4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.778+0000 7fd50d63e640 1 --2- 172.21.15.16:0/1651677540 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd4f406e2b0 0x7fd4f4070770 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd5080ffb50 tx=0x7fd50400b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:11.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:11.782+0000 7fd4fe7fc640 1 -- 172.21.15.16:0/1651677540 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd4f8078780 con 0x7fd5080ffcf0 2024-08-01T06:59:11.951 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:11 smithi089 ceph-mon[82218]: Upgrade: Updating crash.smithi089 (2/2) 2024-08-01T06:59:11.951 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:11 smithi089 ceph-mon[82218]: Deploying daemon crash.smithi089 on smithi089 2024-08-01T06:59:12.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.007+0000 7fd50f8a2640 1 -- 172.21.15.16:0/1651677540 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd50802c4f0 con 0x7fd4f406e2b0 2024-08-01T06:59:12.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.008+0000 7fd4fe7fc640 1 -- 172.21.15.16:0/1651677540 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fd50802c4f0 con 0x7fd4f406e2b0 2024-08-01T06:59:12.009 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:11 smithi016 ceph-mon[93645]: Upgrade: Updating crash.smithi089 (2/2) 2024-08-01T06:59:12.009 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:11 smithi016 ceph-mon[93645]: Deploying daemon crash.smithi089 on smithi089 2024-08-01T06:59:12.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.011+0000 7fd50f8a2640 1 -- 172.21.15.16:0/1651677540 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd4f406e2b0 msgr2=0x7fd4f4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:12.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.011+0000 7fd50f8a2640 1 --2- 172.21.15.16:0/1651677540 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd4f406e2b0 0x7fd4f4070770 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd5080ffb50 tx=0x7fd50400b390 comp rx=0 tx=0).stop 2024-08-01T06:59:12.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.011+0000 7fd50f8a2640 1 -- 172.21.15.16:0/1651677540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5080ffcf0 msgr2=0x7fd50819c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:12.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.011+0000 7fd50f8a2640 1 --2- 172.21.15.16:0/1651677540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5080ffcf0 0x7fd50819c7d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80054f0 tx=0x7fd4f8005520 comp rx=0 tx=0).stop 2024-08-01T06:59:12.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.011+0000 7fd50f8a2640 1 -- 172.21.15.16:0/1651677540 shutdown_connections 2024-08-01T06:59:12.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.011+0000 7fd50f8a2640 1 --2- 172.21.15.16:0/1651677540 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd4f406e2b0 0x7fd4f4070770 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.012+0000 7fd50f8a2640 1 --2- 172.21.15.16:0/1651677540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5080ffcf0 0x7fd50819c7d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.012+0000 7fd50f8a2640 1 --2- 172.21.15.16:0/1651677540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5080feaf0 0x7fd508068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.012+0000 7fd50f8a2640 1 -- 172.21.15.16:0/1651677540 >> 172.21.15.16:0/1651677540 conn(0x7fd5080fa280 msgr2=0x7fd5081033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:12.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.012+0000 7fd50f8a2640 1 -- 172.21.15.16:0/1651677540 shutdown_connections 2024-08-01T06:59:12.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.012+0000 7fd50f8a2640 1 -- 172.21.15.16:0/1651677540 wait complete. 2024-08-01T06:59:12.023 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T06:59:12.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.098+0000 7f038bc29640 1 -- 172.21.15.16:0/711172491 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0384102f90 msgr2=0x7f0384103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:12.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.098+0000 7f038bc29640 1 --2- 172.21.15.16:0/711172491 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0384102f90 0x7f0384103410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0374009880 tx=0x7f037402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.098+0000 7f038bc29640 1 -- 172.21.15.16:0/711172491 shutdown_connections 2024-08-01T06:59:12.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.098+0000 7f038bc29640 1 --2- 172.21.15.16:0/711172491 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0384102f90 0x7f0384103410 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.098+0000 7f038bc29640 1 --2- 172.21.15.16:0/711172491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0384101d90 0x7f0384102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.098+0000 7f038bc29640 1 -- 172.21.15.16:0/711172491 >> 172.21.15.16:0/711172491 conn(0x7f03840fd520 msgr2=0x7f03840ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:12.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.098+0000 7f038bc29640 1 -- 172.21.15.16:0/711172491 shutdown_connections 2024-08-01T06:59:12.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.098+0000 7f038bc29640 1 -- 172.21.15.16:0/711172491 wait complete. 2024-08-01T06:59:12.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.099+0000 7f038bc29640 1 Processor -- start 2024-08-01T06:59:12.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.099+0000 7f038bc29640 1 -- start start 2024-08-01T06:59:12.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.099+0000 7f038bc29640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0384101d90 0x7f0384197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:12.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.099+0000 7f038bc29640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0384102f90 0x7f0384197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:12.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.099+0000 7f038bc29640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0384198350 con 0x7f0384102f90 2024-08-01T06:59:12.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.099+0000 7f038bc29640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03841984c0 con 0x7f0384101d90 2024-08-01T06:59:12.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.099+0000 7f03891c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0384102f90 0x7f0384197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:12.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.099+0000 7f03891c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0384102f90 0x7f0384197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41144/0 (socket says 172.21.15.16:41144) 2024-08-01T06:59:12.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.099+0000 7f03891c4640 1 -- 172.21.15.16:0/1331063758 learned_addr learned my addr 172.21.15.16:0/1331063758 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:59:12.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.099+0000 7f03899c5640 1 --2- 172.21.15.16:0/1331063758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0384101d90 0x7f0384197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:12.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.099+0000 7f03891c4640 1 -- 172.21.15.16:0/1331063758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0384101d90 msgr2=0x7f0384197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:12.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.099+0000 7f03891c4640 1 --2- 172.21.15.16:0/1331063758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0384101d90 0x7f0384197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.099+0000 7f03891c4640 1 -- 172.21.15.16:0/1331063758 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0374009560 con 0x7f0384102f90 2024-08-01T06:59:12.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.099+0000 7f03899c5640 1 --2- 172.21.15.16:0/1331063758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0384101d90 0x7f0384197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T06:59:12.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.100+0000 7f03891c4640 1 --2- 172.21.15.16:0/1331063758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0384102f90 0x7f0384197d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f03740055a0 tx=0x7f03740055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:12.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.100+0000 7f037affd640 1 -- 172.21.15.16:0/1331063758 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0374004aa0 con 0x7f0384102f90 2024-08-01T06:59:12.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.100+0000 7f037affd640 1 -- 172.21.15.16:0/1331063758 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0374004c00 con 0x7f0384102f90 2024-08-01T06:59:12.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.100+0000 7f038bc29640 1 -- 172.21.15.16:0/1331063758 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038419ceb0 con 0x7f0384102f90 2024-08-01T06:59:12.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.100+0000 7f037affd640 1 -- 172.21.15.16:0/1331063758 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0374003b10 con 0x7f0384102f90 2024-08-01T06:59:12.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.100+0000 7f038bc29640 1 -- 172.21.15.16:0/1331063758 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038419d3f0 con 0x7f0384102f90 2024-08-01T06:59:12.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.101+0000 7f038bc29640 1 -- 172.21.15.16:0/1331063758 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0384102190 con 0x7f0384102f90 2024-08-01T06:59:12.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.102+0000 7f037affd640 1 -- 172.21.15.16:0/1331063758 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f0374003d40 con 0x7f0384102f90 2024-08-01T06:59:12.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.102+0000 7f037affd640 1 --2- 172.21.15.16:0/1331063758 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f037006e2b0 0x7f0370070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:12.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.102+0000 7f037affd640 1 -- 172.21.15.16:0/1331063758 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f03740af410 con 0x7f0384102f90 2024-08-01T06:59:12.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.102+0000 7f03899c5640 1 --2- 172.21.15.16:0/1331063758 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f037006e2b0 0x7f0370070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:12.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.103+0000 7f03899c5640 1 --2- 172.21.15.16:0/1331063758 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f037006e2b0 0x7f0370070770 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0384102df0 tx=0x7f0380009500 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:12.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.107+0000 7f037affd640 1 -- 172.21.15.16:0/1331063758 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0374078690 con 0x7f0384102f90 2024-08-01T06:59:12.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.298+0000 7f038bc29640 1 -- 172.21.15.16:0/1331063758 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f038402c540 con 0x7f037006e2b0 2024-08-01T06:59:12.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.300+0000 7f037affd640 1 -- 172.21.15.16:0/1331063758 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f038402c540 con 0x7f037006e2b0 2024-08-01T06:59:12.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.302+0000 7f038bc29640 1 -- 172.21.15.16:0/1331063758 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f037006e2b0 msgr2=0x7f0370070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:12.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.302+0000 7f038bc29640 1 --2- 172.21.15.16:0/1331063758 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f037006e2b0 0x7f0370070770 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0384102df0 tx=0x7f0380009500 comp rx=0 tx=0).stop 2024-08-01T06:59:12.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.302+0000 7f038bc29640 1 -- 172.21.15.16:0/1331063758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0384102f90 msgr2=0x7f0384197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:12.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.302+0000 7f038bc29640 1 --2- 172.21.15.16:0/1331063758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0384102f90 0x7f0384197d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f03740055a0 tx=0x7f03740055d0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.302+0000 7f038bc29640 1 -- 172.21.15.16:0/1331063758 shutdown_connections 2024-08-01T06:59:12.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.302+0000 7f038bc29640 1 --2- 172.21.15.16:0/1331063758 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f037006e2b0 0x7f0370070770 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.302+0000 7f038bc29640 1 --2- 172.21.15.16:0/1331063758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0384102f90 0x7f0384197d80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.302+0000 7f038bc29640 1 --2- 172.21.15.16:0/1331063758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0384101d90 0x7f0384197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.302+0000 7f038bc29640 1 -- 172.21.15.16:0/1331063758 >> 172.21.15.16:0/1331063758 conn(0x7f03840fd520 msgr2=0x7f0384106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:12.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.302+0000 7f038bc29640 1 -- 172.21.15.16:0/1331063758 shutdown_connections 2024-08-01T06:59:12.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.302+0000 7f038bc29640 1 -- 172.21.15.16:0/1331063758 wait complete. 2024-08-01T06:59:12.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.385+0000 7f6026a15640 1 -- 172.21.15.16:0/1166082938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6020103020 msgr2=0x7f6020105410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:12.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.385+0000 7f6026a15640 1 --2- 172.21.15.16:0/1166082938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6020103020 0x7f6020105410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6014009880 tx=0x7f601402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.385+0000 7f6026a15640 1 -- 172.21.15.16:0/1166082938 shutdown_connections 2024-08-01T06:59:12.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.385+0000 7f6026a15640 1 --2- 172.21.15.16:0/1166082938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6020103020 0x7f6020105410 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.385+0000 7f6026a15640 1 --2- 172.21.15.16:0/1166082938 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60201006f0 0x7f6020102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.385+0000 7f6026a15640 1 -- 172.21.15.16:0/1166082938 >> 172.21.15.16:0/1166082938 conn(0x7f60200fa250 msgr2=0x7f60200fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:12.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.385+0000 7f6026a15640 1 -- 172.21.15.16:0/1166082938 shutdown_connections 2024-08-01T06:59:12.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.385+0000 7f6026a15640 1 -- 172.21.15.16:0/1166082938 wait complete. 2024-08-01T06:59:12.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.386+0000 7f6026a15640 1 Processor -- start 2024-08-01T06:59:12.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.386+0000 7f6026a15640 1 -- start start 2024-08-01T06:59:12.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.386+0000 7f6026a15640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60201006f0 0x7f6020195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:12.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.386+0000 7f6026a15640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6020103020 0x7f6020195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:12.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.386+0000 7f6026a15640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6020196150 con 0x7f60201006f0 2024-08-01T06:59:12.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.386+0000 7f6026a15640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60201962c0 con 0x7f6020103020 2024-08-01T06:59:12.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.386+0000 7f601ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60201006f0 0x7f6020195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:12.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.386+0000 7f601ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60201006f0 0x7f6020195640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41164/0 (socket says 172.21.15.16:41164) 2024-08-01T06:59:12.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.386+0000 7f601ffff640 1 -- 172.21.15.16:0/3258951896 learned_addr learned my addr 172.21.15.16:0/3258951896 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:59:12.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.386+0000 7f601f7fe640 1 --2- 172.21.15.16:0/3258951896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6020103020 0x7f6020195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:12.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.386+0000 7f601ffff640 1 -- 172.21.15.16:0/3258951896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6020103020 msgr2=0x7f6020195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:12.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.386+0000 7f601ffff640 1 --2- 172.21.15.16:0/3258951896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6020103020 0x7f6020195b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.387+0000 7f601ffff640 1 -- 172.21.15.16:0/3258951896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6014009560 con 0x7f60201006f0 2024-08-01T06:59:12.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.387+0000 7f601ffff640 1 --2- 172.21.15.16:0/3258951896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60201006f0 0x7f6020195640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f601000d900 tx=0x7f601000ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:12.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.387+0000 7f601d7fa640 1 -- 172.21.15.16:0/3258951896 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6010009c00 con 0x7f60201006f0 2024-08-01T06:59:12.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.387+0000 7f601d7fa640 1 -- 172.21.15.16:0/3258951896 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6010009d60 con 0x7f60201006f0 2024-08-01T06:59:12.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.387+0000 7f6026a15640 1 -- 172.21.15.16:0/3258951896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602019ad60 con 0x7f60201006f0 2024-08-01T06:59:12.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.387+0000 7f601d7fa640 1 -- 172.21.15.16:0/3258951896 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60100049d0 con 0x7f60201006f0 2024-08-01T06:59:12.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.387+0000 7f6026a15640 1 -- 172.21.15.16:0/3258951896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602019b220 con 0x7f60201006f0 2024-08-01T06:59:12.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.388+0000 7f6026a15640 1 -- 172.21.15.16:0/3258951896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6020108790 con 0x7f60201006f0 2024-08-01T06:59:12.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.389+0000 7f601d7fa640 1 -- 172.21.15.16:0/3258951896 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f6010004020 con 0x7f60201006f0 2024-08-01T06:59:12.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.389+0000 7f601d7fa640 1 --2- 172.21.15.16:0/3258951896 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f600806e2b0 0x7f6008070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:12.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.389+0000 7f601d7fa640 1 -- 172.21.15.16:0/3258951896 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f601008e000 con 0x7f60201006f0 2024-08-01T06:59:12.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.389+0000 7f601f7fe640 1 --2- 172.21.15.16:0/3258951896 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f600806e2b0 0x7f6008070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:12.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.390+0000 7f601f7fe640 1 --2- 172.21.15.16:0/3258951896 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f600806e2b0 0x7f6008070770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6014000c00 tx=0x7f60140314a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:12.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.393+0000 7f601d7fa640 1 -- 172.21.15.16:0/3258951896 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6010057190 con 0x7f60201006f0 2024-08-01T06:59:12.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.578+0000 7f6026a15640 1 -- 172.21.15.16:0/3258951896 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f602019b4f0 con 0x7f600806e2b0 2024-08-01T06:59:12.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.587+0000 7f601d7fa640 1 -- 172.21.15.16:0/3258951896 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f602019b4f0 con 0x7f600806e2b0 2024-08-01T06:59:12.589 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T06:59:12.589 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (9m) 49s ago 11m 25.4M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T06:59:12.589 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (11m) 49s ago 11m 8136k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T06:59:12.589 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (10m) 39s ago 10m 8036k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T06:59:12.589 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 starting - - - - 2024-08-01T06:59:12.589 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (10m) 39s ago 10m 6891k - 18.2.2-1767-ga3bbd728 d280790d1980 73e7778d1e26 2024-08-01T06:59:12.589 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (9m) 49s ago 10m 85.8M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T06:59:12.589 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (5m) 49s ago 5m 89.2M - 18.2.2-1767-ga3bbd728 d280790d1980 96e46c28d16c 2024-08-01T06:59:12.590 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (5m) 49s ago 5m 149M - 18.2.2-1767-ga3bbd728 d280790d1980 4bbe1a388689 2024-08-01T06:59:12.590 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (5m) 39s ago 5m 26.8M - 18.2.2-1767-ga3bbd728 d280790d1980 65ca121a6fbb 2024-08-01T06:59:12.590 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (5m) 39s ago 5m 25.5M - 18.2.2-1767-ga3bbd728 d280790d1980 05bb46c6fe94 2024-08-01T06:59:12.590 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:8443,9283,8765 running (2m) 49s ago 12m 472M - 19.1.0-1223-gf9911e17 93d93c74a2cc 8701e6315593 2024-08-01T06:59:12.590 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (76s) 39s ago 10m 437M - 19.1.0-1223-gf9911e17 93d93c74a2cc c6caa21f436f 2024-08-01T06:59:12.590 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (62s) 49s ago 12m 28.5M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc 48e94d076e6f 2024-08-01T06:59:12.590 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (42s) 39s ago 10m 19.3M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc c4b83b46ff15 2024-08-01T06:59:12.590 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (11m) 49s ago 11m 16.0M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T06:59:12.590 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (10m) 39s ago 10m 17.1M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T06:59:12.591 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (9m) 49s ago 9m 240M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 9b7157499583 2024-08-01T06:59:12.591 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (9m) 49s ago 9m 241M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 f3b050aed6b7 2024-08-01T06:59:12.591 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (8m) 49s ago 8m 228M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 33a72e1a5c91 2024-08-01T06:59:12.591 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (8m) 39s ago 8m 276M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 58c175e0f4eb 2024-08-01T06:59:12.591 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (7m) 39s ago 7m 260M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 15b8f910bad7 2024-08-01T06:59:12.591 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (7m) 39s ago 7m 235M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 ac887841899e 2024-08-01T06:59:12.591 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (83s) 49s ago 10m 46.9M - 2.43.0 a07b618ecd1d 45d23c96382e 2024-08-01T06:59:12.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.589+0000 7f6026a15640 1 -- 172.21.15.16:0/3258951896 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f600806e2b0 msgr2=0x7f6008070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:12.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.589+0000 7f6026a15640 1 --2- 172.21.15.16:0/3258951896 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f600806e2b0 0x7f6008070770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6014000c00 tx=0x7f60140314a0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.589+0000 7f6026a15640 1 -- 172.21.15.16:0/3258951896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60201006f0 msgr2=0x7f6020195640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:12.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.589+0000 7f6026a15640 1 --2- 172.21.15.16:0/3258951896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60201006f0 0x7f6020195640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f601000d900 tx=0x7f601000ddc0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.589+0000 7f6026a15640 1 -- 172.21.15.16:0/3258951896 shutdown_connections 2024-08-01T06:59:12.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.589+0000 7f6026a15640 1 --2- 172.21.15.16:0/3258951896 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f600806e2b0 0x7f6008070770 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.589+0000 7f6026a15640 1 --2- 172.21.15.16:0/3258951896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6020103020 0x7f6020195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.589+0000 7f6026a15640 1 --2- 172.21.15.16:0/3258951896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60201006f0 0x7f6020195640 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.589+0000 7f6026a15640 1 -- 172.21.15.16:0/3258951896 >> 172.21.15.16:0/3258951896 conn(0x7f60200fa250 msgr2=0x7f60200fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:12.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.589+0000 7f6026a15640 1 -- 172.21.15.16:0/3258951896 shutdown_connections 2024-08-01T06:59:12.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.589+0000 7f6026a15640 1 -- 172.21.15.16:0/3258951896 wait complete. 2024-08-01T06:59:12.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.671+0000 7f0063ab9640 1 -- 172.21.15.16:0/3264289990 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f005c0ffc80 msgr2=0x7f005c100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:12.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.671+0000 7f0063ab9640 1 --2- 172.21.15.16:0/3264289990 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f005c0ffc80 0x7f005c100100 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f004c009880 tx=0x7f004c02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.671+0000 7f0063ab9640 1 -- 172.21.15.16:0/3264289990 shutdown_connections 2024-08-01T06:59:12.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.671+0000 7f0063ab9640 1 --2- 172.21.15.16:0/3264289990 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f005c0ffc80 0x7f005c100100 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.671+0000 7f0063ab9640 1 --2- 172.21.15.16:0/3264289990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f005c0fea80 0x7f005c0fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.671+0000 7f0063ab9640 1 -- 172.21.15.16:0/3264289990 >> 172.21.15.16:0/3264289990 conn(0x7f005c0fa230 msgr2=0x7f005c0fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:12.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.672+0000 7f0063ab9640 1 -- 172.21.15.16:0/3264289990 shutdown_connections 2024-08-01T06:59:12.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.672+0000 7f0063ab9640 1 -- 172.21.15.16:0/3264289990 wait complete. 2024-08-01T06:59:12.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.672+0000 7f0063ab9640 1 Processor -- start 2024-08-01T06:59:12.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.672+0000 7f0063ab9640 1 -- start start 2024-08-01T06:59:12.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.672+0000 7f0063ab9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f005c0fea80 0x7f005c1955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:12.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.672+0000 7f0063ab9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f005c0ffc80 0x7f005c195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:12.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.672+0000 7f0063ab9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c1960f0 con 0x7f005c0fea80 2024-08-01T06:59:12.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.672+0000 7f0063ab9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c196260 con 0x7f005c0ffc80 2024-08-01T06:59:12.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.673+0000 7f0061855640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f005c0fea80 0x7f005c1955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:12.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.673+0000 7f0061855640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f005c0fea80 0x7f005c1955e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41172/0 (socket says 172.21.15.16:41172) 2024-08-01T06:59:12.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.673+0000 7f0061855640 1 -- 172.21.15.16:0/2262368192 learned_addr learned my addr 172.21.15.16:0/2262368192 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:59:12.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.673+0000 7f0061054640 1 --2- 172.21.15.16:0/2262368192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f005c0ffc80 0x7f005c195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:12.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.673+0000 7f0061855640 1 -- 172.21.15.16:0/2262368192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f005c0ffc80 msgr2=0x7f005c195b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:12.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.673+0000 7f0061855640 1 --2- 172.21.15.16:0/2262368192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f005c0ffc80 0x7f005c195b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.673+0000 7f0061855640 1 -- 172.21.15.16:0/2262368192 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c009560 con 0x7f005c0fea80 2024-08-01T06:59:12.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.673+0000 7f0061855640 1 --2- 172.21.15.16:0/2262368192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f005c0fea80 0x7f005c1955e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f005800d900 tx=0x7f005800ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:12.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.673+0000 7f0052ffd640 1 -- 172.21.15.16:0/2262368192 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0058009c00 con 0x7f005c0fea80 2024-08-01T06:59:12.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.673+0000 7f0052ffd640 1 -- 172.21.15.16:0/2262368192 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0058009d60 con 0x7f005c0fea80 2024-08-01T06:59:12.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.673+0000 7f0063ab9640 1 -- 172.21.15.16:0/2262368192 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005c19ad00 con 0x7f005c0fea80 2024-08-01T06:59:12.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.673+0000 7f0052ffd640 1 -- 172.21.15.16:0/2262368192 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f005800f7b0 con 0x7f005c0fea80 2024-08-01T06:59:12.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.673+0000 7f0063ab9640 1 -- 172.21.15.16:0/2262368192 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005c19b1c0 con 0x7f005c0fea80 2024-08-01T06:59:12.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.675+0000 7f0063ab9640 1 -- 172.21.15.16:0/2262368192 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005c0fee80 con 0x7f005c0fea80 2024-08-01T06:59:12.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.675+0000 7f0052ffd640 1 -- 172.21.15.16:0/2262368192 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f005800f910 con 0x7f005c0fea80 2024-08-01T06:59:12.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.675+0000 7f0052ffd640 1 --2- 172.21.15.16:0/2262368192 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f004806e2b0 0x7f0048070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:12.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.675+0000 7f0052ffd640 1 -- 172.21.15.16:0/2262368192 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f005808e680 con 0x7f005c0fea80 2024-08-01T06:59:12.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.676+0000 7f0061054640 1 --2- 172.21.15.16:0/2262368192 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f004806e2b0 0x7f0048070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:12.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.676+0000 7f0061054640 1 --2- 172.21.15.16:0/2262368192 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f004806e2b0 0x7f0048070770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f004c000c00 tx=0x7f004c0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:12.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.680+0000 7f0052ffd640 1 -- 172.21.15.16:0/2262368192 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0058057a00 con 0x7f005c0fea80 2024-08-01T06:59:12.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:12 smithi089 ceph-mon[82218]: pgmap v30: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:59:12.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:12 smithi089 ceph-mon[82218]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:59:12.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:12 smithi016 ceph-mon[93645]: pgmap v30: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:59:12.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:12 smithi016 ceph-mon[93645]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:59:12.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.926+0000 7f0063ab9640 1 -- 172.21.15.16:0/2262368192 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f005c19b760 con 0x7f005c0fea80 2024-08-01T06:59:12.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.927+0000 7f0052ffd640 1 -- 172.21.15.16:0/2262368192 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+730 (secure 0 0 0) 0x7f005805b080 con 0x7f005c0fea80 2024-08-01T06:59:12.929 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:59:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T06:59:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T06:59:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:59:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T06:59:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T06:59:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:59:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T06:59:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 6 2024-08-01T06:59:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:59:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T06:59:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4 2024-08-01T06:59:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:59:12.930 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T06:59:12.930 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 10, 2024-08-01T06:59:12.930 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 4 2024-08-01T06:59:12.930 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T06:59:12.930 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:59:12.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.929+0000 7f0063ab9640 1 -- 172.21.15.16:0/2262368192 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f004806e2b0 msgr2=0x7f0048070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:12.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.929+0000 7f0063ab9640 1 --2- 172.21.15.16:0/2262368192 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f004806e2b0 0x7f0048070770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f004c000c00 tx=0x7f004c0314e0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.929+0000 7f0063ab9640 1 -- 172.21.15.16:0/2262368192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f005c0fea80 msgr2=0x7f005c1955e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:12.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.929+0000 7f0063ab9640 1 --2- 172.21.15.16:0/2262368192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f005c0fea80 0x7f005c1955e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f005800d900 tx=0x7f005800ddc0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.929+0000 7f0063ab9640 1 -- 172.21.15.16:0/2262368192 shutdown_connections 2024-08-01T06:59:12.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.929+0000 7f0063ab9640 1 --2- 172.21.15.16:0/2262368192 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f004806e2b0 0x7f0048070770 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.929+0000 7f0063ab9640 1 --2- 172.21.15.16:0/2262368192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f005c0ffc80 0x7f005c195b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.929+0000 7f0063ab9640 1 --2- 172.21.15.16:0/2262368192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f005c0fea80 0x7f005c1955e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:12.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.930+0000 7f0063ab9640 1 -- 172.21.15.16:0/2262368192 >> 172.21.15.16:0/2262368192 conn(0x7f005c0fa230 msgr2=0x7f005c0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:12.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.930+0000 7f0063ab9640 1 -- 172.21.15.16:0/2262368192 shutdown_connections 2024-08-01T06:59:12.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:12.930+0000 7f0063ab9640 1 -- 172.21.15.16:0/2262368192 wait complete. 2024-08-01T06:59:13.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.012+0000 7ff94a5ec640 1 -- 172.21.15.16:0/2023408511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9440feaf0 msgr2=0x7ff9440feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:13.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.012+0000 7ff94a5ec640 1 --2- 172.21.15.16:0/2023408511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9440feaf0 0x7ff9440feef0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff934009880 tx=0x7ff93402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.013+0000 7ff94a5ec640 1 -- 172.21.15.16:0/2023408511 shutdown_connections 2024-08-01T06:59:13.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.013+0000 7ff94a5ec640 1 --2- 172.21.15.16:0/2023408511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9440ffcf0 0x7ff944100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.013+0000 7ff94a5ec640 1 --2- 172.21.15.16:0/2023408511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9440feaf0 0x7ff9440feef0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.013+0000 7ff94a5ec640 1 -- 172.21.15.16:0/2023408511 >> 172.21.15.16:0/2023408511 conn(0x7ff9440fa280 msgr2=0x7ff9440fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:13.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.013+0000 7ff94a5ec640 1 -- 172.21.15.16:0/2023408511 shutdown_connections 2024-08-01T06:59:13.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.013+0000 7ff94a5ec640 1 -- 172.21.15.16:0/2023408511 wait complete. 2024-08-01T06:59:13.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.013+0000 7ff94a5ec640 1 Processor -- start 2024-08-01T06:59:13.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.013+0000 7ff94a5ec640 1 -- start start 2024-08-01T06:59:13.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.014+0000 7ff94a5ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9440feaf0 0x7ff944197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:13.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.014+0000 7ff94a5ec640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9440ffcf0 0x7ff944197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:13.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.014+0000 7ff94a5ec640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff944198460 con 0x7ff9440ffcf0 2024-08-01T06:59:13.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.014+0000 7ff94a5ec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9441985d0 con 0x7ff9440feaf0 2024-08-01T06:59:13.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.014+0000 7ff9437fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9440ffcf0 0x7ff944197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:13.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.014+0000 7ff943fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9440feaf0 0x7ff944197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:13.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.014+0000 7ff943fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9440feaf0 0x7ff944197950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:55340/0 (socket says 172.21.15.16:55340) 2024-08-01T06:59:13.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.014+0000 7ff9437fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9440ffcf0 0x7ff944197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41186/0 (socket says 172.21.15.16:41186) 2024-08-01T06:59:13.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.014+0000 7ff943fff640 1 -- 172.21.15.16:0/2904891478 learned_addr learned my addr 172.21.15.16:0/2904891478 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:59:13.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.014+0000 7ff9437fe640 1 -- 172.21.15.16:0/2904891478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9440feaf0 msgr2=0x7ff944197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:13.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.014+0000 7ff9437fe640 1 --2- 172.21.15.16:0/2904891478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9440feaf0 0x7ff944197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.014+0000 7ff9437fe640 1 -- 172.21.15.16:0/2904891478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff934009560 con 0x7ff9440ffcf0 2024-08-01T06:59:13.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.014+0000 7ff9437fe640 1 --2- 172.21.15.16:0/2904891478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9440ffcf0 0x7ff944197e90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff93800b3a0 tx=0x7ff93800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:13.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.014+0000 7ff9417fa640 1 -- 172.21.15.16:0/2904891478 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff938011800 con 0x7ff9440ffcf0 2024-08-01T06:59:13.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.015+0000 7ff9417fa640 1 -- 172.21.15.16:0/2904891478 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff938011e20 con 0x7ff9440ffcf0 2024-08-01T06:59:13.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.015+0000 7ff9417fa640 1 -- 172.21.15.16:0/2904891478 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff93800f2e0 con 0x7ff9440ffcf0 2024-08-01T06:59:13.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.015+0000 7ff94a5ec640 1 -- 172.21.15.16:0/2904891478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94419d070 con 0x7ff9440ffcf0 2024-08-01T06:59:13.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.015+0000 7ff94a5ec640 1 -- 172.21.15.16:0/2904891478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94419d640 con 0x7ff9440ffcf0 2024-08-01T06:59:13.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.016+0000 7ff94a5ec640 1 -- 172.21.15.16:0/2904891478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff944107760 con 0x7ff9440ffcf0 2024-08-01T06:59:13.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.016+0000 7ff9417fa640 1 -- 172.21.15.16:0/2904891478 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7ff938010380 con 0x7ff9440ffcf0 2024-08-01T06:59:13.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.017+0000 7ff9417fa640 1 --2- 172.21.15.16:0/2904891478 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff92c06e2b0 0x7ff92c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:13.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.017+0000 7ff9417fa640 1 -- 172.21.15.16:0/2904891478 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff93808dd80 con 0x7ff9440ffcf0 2024-08-01T06:59:13.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.017+0000 7ff943fff640 1 --2- 172.21.15.16:0/2904891478 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff92c06e2b0 0x7ff92c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:13.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.017+0000 7ff943fff640 1 --2- 172.21.15.16:0/2904891478 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff92c06e2b0 0x7ff92c070770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff934000c00 tx=0x7ff9340314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:13.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.021+0000 7ff9417fa640 1 -- 172.21.15.16:0/2904891478 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff938057020 con 0x7ff9440ffcf0 2024-08-01T06:59:13.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.239+0000 7ff94a5ec640 1 -- 172.21.15.16:0/2904891478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff9441078f0 con 0x7ff9440ffcf0 2024-08-01T06:59:13.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.239+0000 7ff9417fa640 1 -- 172.21.15.16:0/2904891478 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1938 (secure 0 0 0) 0x7ff9380157b0 con 0x7ff9440ffcf0 2024-08-01T06:59:13.241 INFO:teuthology.orchestra.run.smithi016.stdout:e19 2024-08-01T06:59:13.241 INFO:teuthology.orchestra.run.smithi016.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-08-01T06:59:13.241 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T06:59:13.241 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:59:13.242 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T06:59:13.242 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:59:13.242 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T06:59:13.242 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T06:59:13.242 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 19 2024-08-01T06:59:13.242 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T06:59:13.242 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T06:59:13.242 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T06:53:32.617145+0000 2024-08-01T06:59:13.242 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T06:59:13.242 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T06:59:13.242 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T06:59:13.243 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T06:59:13.243 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T06:59:13.243 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T06:59:13.243 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T06:59:13.243 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T06:59:13.243 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 46 2024-08-01T06:59:13.243 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:59:13.243 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T06:59:13.243 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T06:59:13.243 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=14482,1=24281} 2024-08-01T06:59:13.243 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T06:59:13.243 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T06:59:13.243 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T06:59:13.243 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T06:59:13.244 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T06:59:13.244 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T06:59:13.244 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T06:59:13.244 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T06:59:13.244 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T06:59:13.244 INFO:teuthology.orchestra.run.smithi016.stdout:qdb_cluster leader: 0 members: 2024-08-01T06:59:13.244 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:59:13.244 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:24299} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:59:13.244 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{1:24281} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:59:13.244 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:24291} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:59:13.244 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:59:13.244 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:59:13.245 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-08-01T06:59:13.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.242+0000 7ff94a5ec640 1 -- 172.21.15.16:0/2904891478 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff92c06e2b0 msgr2=0x7ff92c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:13.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.242+0000 7ff94a5ec640 1 --2- 172.21.15.16:0/2904891478 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff92c06e2b0 0x7ff92c070770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff934000c00 tx=0x7ff9340314e0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.242+0000 7ff94a5ec640 1 -- 172.21.15.16:0/2904891478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9440ffcf0 msgr2=0x7ff944197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:13.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.242+0000 7ff94a5ec640 1 --2- 172.21.15.16:0/2904891478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9440ffcf0 0x7ff944197e90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff93800b3a0 tx=0x7ff93800b860 comp rx=0 tx=0).stop 2024-08-01T06:59:13.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.242+0000 7ff94a5ec640 1 -- 172.21.15.16:0/2904891478 shutdown_connections 2024-08-01T06:59:13.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.242+0000 7ff94a5ec640 1 --2- 172.21.15.16:0/2904891478 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff92c06e2b0 0x7ff92c070770 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.242+0000 7ff94a5ec640 1 --2- 172.21.15.16:0/2904891478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9440ffcf0 0x7ff944197e90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.242+0000 7ff94a5ec640 1 --2- 172.21.15.16:0/2904891478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9440feaf0 0x7ff944197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.242+0000 7ff94a5ec640 1 -- 172.21.15.16:0/2904891478 >> 172.21.15.16:0/2904891478 conn(0x7ff9440fa280 msgr2=0x7ff944067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:13.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.242+0000 7ff94a5ec640 1 -- 172.21.15.16:0/2904891478 shutdown_connections 2024-08-01T06:59:13.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.242+0000 7ff94a5ec640 1 -- 172.21.15.16:0/2904891478 wait complete. 2024-08-01T06:59:13.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.326+0000 7fed427f4640 1 -- 172.21.15.16:0/773017540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed3c100630 msgr2=0x7fed3c102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:13.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.326+0000 7fed427f4640 1 --2- 172.21.15.16:0/773017540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed3c100630 0x7fed3c102a20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fed2c0098b0 tx=0x7fed2c02a4d0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.326+0000 7fed427f4640 1 -- 172.21.15.16:0/773017540 shutdown_connections 2024-08-01T06:59:13.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.326+0000 7fed427f4640 1 --2- 172.21.15.16:0/773017540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed3c102f60 0x7fed3c105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.326+0000 7fed427f4640 1 --2- 172.21.15.16:0/773017540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed3c100630 0x7fed3c102a20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.326+0000 7fed427f4640 1 -- 172.21.15.16:0/773017540 >> 172.21.15.16:0/773017540 conn(0x7fed3c0fa250 msgr2=0x7fed3c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:13.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.326+0000 7fed427f4640 1 -- 172.21.15.16:0/773017540 shutdown_connections 2024-08-01T06:59:13.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.326+0000 7fed427f4640 1 -- 172.21.15.16:0/773017540 wait complete. 2024-08-01T06:59:13.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.327+0000 7fed427f4640 1 Processor -- start 2024-08-01T06:59:13.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.327+0000 7fed427f4640 1 -- start start 2024-08-01T06:59:13.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.327+0000 7fed427f4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed3c100630 0x7fed3c0fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:13.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.327+0000 7fed427f4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed3c102f60 0x7fed3c0fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:13.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.327+0000 7fed427f4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c0feb20 con 0x7fed3c102f60 2024-08-01T06:59:13.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.327+0000 7fed427f4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c0fec90 con 0x7fed3c100630 2024-08-01T06:59:13.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.328+0000 7fed3b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed3c102f60 0x7fed3c0fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:13.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.328+0000 7fed3b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed3c102f60 0x7fed3c0fe5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41212/0 (socket says 172.21.15.16:41212) 2024-08-01T06:59:13.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.328+0000 7fed3b7fe640 1 -- 172.21.15.16:0/1756767832 learned_addr learned my addr 172.21.15.16:0/1756767832 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:59:13.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.328+0000 7fed3bfff640 1 --2- 172.21.15.16:0/1756767832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed3c100630 0x7fed3c0fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:13.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.328+0000 7fed3b7fe640 1 -- 172.21.15.16:0/1756767832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed3c100630 msgr2=0x7fed3c0fff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:13.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.328+0000 7fed3b7fe640 1 --2- 172.21.15.16:0/1756767832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed3c100630 0x7fed3c0fff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.328+0000 7fed3b7fe640 1 -- 172.21.15.16:0/1756767832 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c009560 con 0x7fed3c102f60 2024-08-01T06:59:13.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.328+0000 7fed3b7fe640 1 --2- 172.21.15.16:0/1756767832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed3c102f60 0x7fed3c0fe5e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fed3000e970 tx=0x7fed3000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:13.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.328+0000 7fed397fa640 1 -- 172.21.15.16:0/1756767832 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed3000cc90 con 0x7fed3c102f60 2024-08-01T06:59:13.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.328+0000 7fed397fa640 1 -- 172.21.15.16:0/1756767832 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed3000cdf0 con 0x7fed3c102f60 2024-08-01T06:59:13.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.328+0000 7fed427f4640 1 -- 172.21.15.16:0/1756767832 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3c0fef70 con 0x7fed3c102f60 2024-08-01T06:59:13.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.328+0000 7fed397fa640 1 -- 172.21.15.16:0/1756767832 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed30010430 con 0x7fed3c102f60 2024-08-01T06:59:13.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.328+0000 7fed427f4640 1 -- 172.21.15.16:0/1756767832 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3c19d6c0 con 0x7fed3c102f60 2024-08-01T06:59:13.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.329+0000 7fed427f4640 1 -- 172.21.15.16:0/1756767832 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3c1087e0 con 0x7fed3c102f60 2024-08-01T06:59:13.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.330+0000 7fed397fa640 1 -- 172.21.15.16:0/1756767832 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fed300046c0 con 0x7fed3c102f60 2024-08-01T06:59:13.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.331+0000 7fed397fa640 1 --2- 172.21.15.16:0/1756767832 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fed2406e2b0 0x7fed24070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:13.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.331+0000 7fed3bfff640 1 --2- 172.21.15.16:0/1756767832 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fed2406e2b0 0x7fed24070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:13.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.331+0000 7fed397fa640 1 -- 172.21.15.16:0/1756767832 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fed30014070 con 0x7fed3c102f60 2024-08-01T06:59:13.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.331+0000 7fed3bfff640 1 --2- 172.21.15.16:0/1756767832 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fed2406e2b0 0x7fed24070770 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fed2c006010 tx=0x7fed2c0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:13.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.335+0000 7fed397fa640 1 -- 172.21.15.16:0/1756767832 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fed30057a10 con 0x7fed3c102f60 2024-08-01T06:59:13.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.530+0000 7fed427f4640 1 -- 172.21.15.16:0/1756767832 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fed3c103980 con 0x7fed2406e2b0 2024-08-01T06:59:13.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.531+0000 7fed397fa640 1 -- 172.21.15.16:0/1756767832 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fed3c103980 con 0x7fed2406e2b0 2024-08-01T06:59:13.533 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:59:13.533 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T06:59:13.533 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T06:59:13.533 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T06:59:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-08-01T06:59:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-08-01T06:59:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr" 2024-08-01T06:59:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-08-01T06:59:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "4/23 daemons upgraded", 2024-08-01T06:59:13.534 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading crash daemons", 2024-08-01T06:59:13.535 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T06:59:13.535 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:59:13.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.534+0000 7fed427f4640 1 -- 172.21.15.16:0/1756767832 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fed2406e2b0 msgr2=0x7fed24070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:13.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.534+0000 7fed427f4640 1 --2- 172.21.15.16:0/1756767832 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fed2406e2b0 0x7fed24070770 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fed2c006010 tx=0x7fed2c0314e0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.534+0000 7fed427f4640 1 -- 172.21.15.16:0/1756767832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed3c102f60 msgr2=0x7fed3c0fe5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:13.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.534+0000 7fed427f4640 1 --2- 172.21.15.16:0/1756767832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed3c102f60 0x7fed3c0fe5e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fed3000e970 tx=0x7fed3000ee30 comp rx=0 tx=0).stop 2024-08-01T06:59:13.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.534+0000 7fed427f4640 1 -- 172.21.15.16:0/1756767832 shutdown_connections 2024-08-01T06:59:13.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.534+0000 7fed427f4640 1 --2- 172.21.15.16:0/1756767832 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fed2406e2b0 0x7fed24070770 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.534+0000 7fed427f4640 1 --2- 172.21.15.16:0/1756767832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed3c102f60 0x7fed3c0fe5e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.534+0000 7fed427f4640 1 --2- 172.21.15.16:0/1756767832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed3c100630 0x7fed3c0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.534+0000 7fed427f4640 1 -- 172.21.15.16:0/1756767832 >> 172.21.15.16:0/1756767832 conn(0x7fed3c0fa250 msgr2=0x7fed3c0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:13.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.534+0000 7fed427f4640 1 -- 172.21.15.16:0/1756767832 shutdown_connections 2024-08-01T06:59:13.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.534+0000 7fed427f4640 1 -- 172.21.15.16:0/1756767832 wait complete. 2024-08-01T06:59:13.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.620+0000 7fd8a47da640 1 -- 172.21.15.16:0/3360018734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd89c0feaf0 msgr2=0x7fd89c0feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:13.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.620+0000 7fd8a47da640 1 --2- 172.21.15.16:0/3360018734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd89c0feaf0 0x7fd89c0feef0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd898009880 tx=0x7fd89802a4a0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.620+0000 7fd8a47da640 1 -- 172.21.15.16:0/3360018734 shutdown_connections 2024-08-01T06:59:13.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.620+0000 7fd8a47da640 1 --2- 172.21.15.16:0/3360018734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd89c0ffcf0 0x7fd89c100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.620+0000 7fd8a47da640 1 --2- 172.21.15.16:0/3360018734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd89c0feaf0 0x7fd89c0feef0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.620+0000 7fd8a47da640 1 -- 172.21.15.16:0/3360018734 >> 172.21.15.16:0/3360018734 conn(0x7fd89c0fa280 msgr2=0x7fd89c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:13.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.620+0000 7fd8a47da640 1 -- 172.21.15.16:0/3360018734 shutdown_connections 2024-08-01T06:59:13.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.620+0000 7fd8a47da640 1 -- 172.21.15.16:0/3360018734 wait complete. 2024-08-01T06:59:13.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.621+0000 7fd8a47da640 1 Processor -- start 2024-08-01T06:59:13.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.621+0000 7fd8a47da640 1 -- start start 2024-08-01T06:59:13.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.621+0000 7fd8a47da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd89c0feaf0 0x7fd89c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:13.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.621+0000 7fd8a47da640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd89c0ffcf0 0x7fd89c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:13.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.621+0000 7fd8a47da640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c19a9b0 con 0x7fd89c0ffcf0 2024-08-01T06:59:13.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.621+0000 7fd8a47da640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c19ab20 con 0x7fd89c0feaf0 2024-08-01T06:59:13.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.621+0000 7fd8a1d75640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd89c0ffcf0 0x7fd89c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:13.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.621+0000 7fd8a1d75640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd89c0ffcf0 0x7fd89c19a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41238/0 (socket says 172.21.15.16:41238) 2024-08-01T06:59:13.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.621+0000 7fd8a1d75640 1 -- 172.21.15.16:0/135283651 learned_addr learned my addr 172.21.15.16:0/135283651 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:59:13.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.621+0000 7fd8a2576640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd89c0feaf0 0x7fd89c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:13.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.621+0000 7fd8a1d75640 1 -- 172.21.15.16:0/135283651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd89c0feaf0 msgr2=0x7fd89c0687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:13.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.621+0000 7fd8a1d75640 1 --2- 172.21.15.16:0/135283651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd89c0feaf0 0x7fd89c0687d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.621+0000 7fd8a1d75640 1 -- 172.21.15.16:0/135283651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd898009560 con 0x7fd89c0ffcf0 2024-08-01T06:59:13.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.621+0000 7fd8a2576640 1 --2- 172.21.15.16:0/135283651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd89c0feaf0 0x7fd89c0687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T06:59:13.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.622+0000 7fd8a1d75640 1 --2- 172.21.15.16:0/135283651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd89c0ffcf0 0x7fd89c19a3e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00e970 tx=0x7fd88c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:13.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.622+0000 7fd8937fe640 1 -- 172.21.15.16:0/135283651 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd88c00cc90 con 0x7fd89c0ffcf0 2024-08-01T06:59:13.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.622+0000 7fd8937fe640 1 -- 172.21.15.16:0/135283651 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd88c00cdf0 con 0x7fd89c0ffcf0 2024-08-01T06:59:13.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.622+0000 7fd8937fe640 1 -- 172.21.15.16:0/135283651 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd88c010430 con 0x7fd89c0ffcf0 2024-08-01T06:59:13.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.622+0000 7fd8a47da640 1 -- 172.21.15.16:0/135283651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89c19ae00 con 0x7fd89c0ffcf0 2024-08-01T06:59:13.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.622+0000 7fd8a47da640 1 -- 172.21.15.16:0/135283651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89c19b320 con 0x7fd89c0ffcf0 2024-08-01T06:59:13.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.623+0000 7fd8a47da640 1 -- 172.21.15.16:0/135283651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89c0feef0 con 0x7fd89c0ffcf0 2024-08-01T06:59:13.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.624+0000 7fd8937fe640 1 -- 172.21.15.16:0/135283651 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fd88c0046c0 con 0x7fd89c0ffcf0 2024-08-01T06:59:13.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.624+0000 7fd8937fe640 1 --2- 172.21.15.16:0/135283651 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd88806e2a0 0x7fd888070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:13.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.624+0000 7fd8937fe640 1 -- 172.21.15.16:0/135283651 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd88c014070 con 0x7fd89c0ffcf0 2024-08-01T06:59:13.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.624+0000 7fd8a2576640 1 --2- 172.21.15.16:0/135283651 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd88806e2a0 0x7fd888070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:13.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.625+0000 7fd8a2576640 1 --2- 172.21.15.16:0/135283651 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd88806e2a0 0x7fd888070760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd89c068d10 tx=0x7fd8980314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:13.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.629+0000 7fd8937fe640 1 -- 172.21.15.16:0/135283651 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd88c0579d0 con 0x7fd89c0ffcf0 2024-08-01T06:59:13.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.880+0000 7fd8a47da640 1 -- 172.21.15.16:0/135283651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd89c18e690 con 0x7fd89c0ffcf0 2024-08-01T06:59:13.882 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:13 smithi016 ceph-mon[93645]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:59:13.882 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:13 smithi016 ceph-mon[93645]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:59:13.882 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:13 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2262368192' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:13.883 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:13 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2904891478' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:59:13.883 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:13 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:13.883 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:13 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:13.883 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:13 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:59:13.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.881+0000 7fd8937fe640 1 -- 172.21.15.16:0/135283651 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd88c05b090 con 0x7fd89c0ffcf0 2024-08-01T06:59:13.883 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-08-01T06:59:13.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.883+0000 7fd8a47da640 1 -- 172.21.15.16:0/135283651 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd88806e2a0 msgr2=0x7fd888070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:13.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.883+0000 7fd8a47da640 1 --2- 172.21.15.16:0/135283651 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd88806e2a0 0x7fd888070760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd89c068d10 tx=0x7fd8980314e0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.883+0000 7fd8a47da640 1 -- 172.21.15.16:0/135283651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd89c0ffcf0 msgr2=0x7fd89c19a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:13.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.883+0000 7fd8a47da640 1 --2- 172.21.15.16:0/135283651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd89c0ffcf0 0x7fd89c19a3e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00e970 tx=0x7fd88c00ed70 comp rx=0 tx=0).stop 2024-08-01T06:59:13.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.883+0000 7fd8a47da640 1 -- 172.21.15.16:0/135283651 shutdown_connections 2024-08-01T06:59:13.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.883+0000 7fd8a47da640 1 --2- 172.21.15.16:0/135283651 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd88806e2a0 0x7fd888070760 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.883+0000 7fd8a47da640 1 --2- 172.21.15.16:0/135283651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd89c0ffcf0 0x7fd89c19a3e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.883+0000 7fd8a47da640 1 --2- 172.21.15.16:0/135283651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd89c0feaf0 0x7fd89c0687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:13.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.883+0000 7fd8a47da640 1 -- 172.21.15.16:0/135283651 >> 172.21.15.16:0/135283651 conn(0x7fd89c0fa280 msgr2=0x7fd89c1033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:13.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.883+0000 7fd8a47da640 1 -- 172.21.15.16:0/135283651 shutdown_connections 2024-08-01T06:59:13.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:13.883+0000 7fd8a47da640 1 -- 172.21.15.16:0/135283651 wait complete. 2024-08-01T06:59:14.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:13 smithi089 ceph-mon[82218]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:59:14.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:13 smithi089 ceph-mon[82218]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:59:14.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:13 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2262368192' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:14.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:13 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2904891478' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:59:14.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:13 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:14.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:13 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:14.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:13 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:59:15.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:14 smithi089 ceph-mon[82218]: pgmap v31: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:59:15.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:14 smithi089 ceph-mon[82218]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:59:15.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:14 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:15.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:14 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:15.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:14 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/135283651' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:59:15.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:14 smithi016 ceph-mon[93645]: pgmap v31: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T06:59:15.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:14 smithi016 ceph-mon[93645]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:59:15.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:14 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:15.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:14 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:15.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:14 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/135283651' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:59:17.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:16 smithi089 ceph-mon[82218]: pgmap v32: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:59:17.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:16 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:17.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:16 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:17.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:16 smithi016 ceph-mon[93645]: pgmap v32: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:59:17.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:16 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:17.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:16 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:18.030 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:59:18.031 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:18.031 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:18.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:59:18.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:18.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:19.039 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:18 smithi089 ceph-mon[82218]: pgmap v33: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:59:19.039 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:19.039 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:19.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:18 smithi016 ceph-mon[93645]: pgmap v33: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T06:59:19.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:19.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:20.853 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:20 smithi016 ceph-mon[93645]: pgmap v34: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-01T06:59:20.853 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:20 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:20.853 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:20 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:20.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:20 smithi089 ceph-mon[82218]: pgmap v34: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-01T06:59:20.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:20 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:20.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:20 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:21.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:21 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:21.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:21 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:21.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:21 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:21.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:21 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:22.624 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:22 smithi016 ceph-mon[93645]: pgmap v35: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-01T06:59:22.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:22 smithi089 ceph-mon[82218]: pgmap v35: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-01T06:59:23.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:23.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:23.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:59:23.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:59:23.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:23.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:59:23.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:23.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:23.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:23.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:23 smithi016 ceph-mon[93645]: Upgrade: Setting container_image for all crash 2024-08-01T06:59:23.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:23.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi016"}]: dispatch 2024-08-01T06:59:23.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi016"}]': finished 2024-08-01T06:59:23.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi089"}]: dispatch 2024-08-01T06:59:23.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi089"}]': finished 2024-08-01T06:59:23.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-08-01T06:59:23.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:23 smithi016 ceph-mon[93645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-08-01T06:59:23.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:23 smithi016 ceph-mon[93645]: Upgrade: osd.0 is safe to restart 2024-08-01T06:59:24.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:24.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:24.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:59:24.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:59:24.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:24.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:59:24.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:24.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:24.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:24.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:23 smithi089 ceph-mon[82218]: Upgrade: Setting container_image for all crash 2024-08-01T06:59:24.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:24.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi016"}]: dispatch 2024-08-01T06:59:24.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi016"}]': finished 2024-08-01T06:59:24.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi089"}]: dispatch 2024-08-01T06:59:24.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi089"}]': finished 2024-08-01T06:59:24.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-08-01T06:59:24.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:23 smithi089 ceph-mon[82218]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-08-01T06:59:24.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:23 smithi089 ceph-mon[82218]: Upgrade: osd.0 is safe to restart 2024-08-01T06:59:25.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:24 smithi089 ceph-mon[82218]: pgmap v36: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-01T06:59:25.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:24 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:25.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:24 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-01T06:59:25.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:24 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:59:25.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:24 smithi016 ceph-mon[93645]: pgmap v36: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-01T06:59:25.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:24 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:25.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:24 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-01T06:59:25.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:24 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:59:26.057 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:25 smithi016 ceph-mon[93645]: Upgrade: Updating osd.0 2024-08-01T06:59:26.058 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:25 smithi016 ceph-mon[93645]: Deploying daemon osd.0 on smithi016 2024-08-01T06:59:26.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:25 smithi089 ceph-mon[82218]: Upgrade: Updating osd.0 2024-08-01T06:59:26.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:25 smithi089 ceph-mon[82218]: Deploying daemon osd.0 on smithi016 2024-08-01T06:59:26.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:26 smithi016 ceph-mon[93645]: pgmap v37: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-01T06:59:27.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:26 smithi089 ceph-mon[82218]: pgmap v37: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-01T06:59:27.288 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:27 smithi016 systemd[1]: Stopping Ceph osd.0 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T06:59:27.648 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:27 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0[47643]: 2024-08-01T06:59:27.286+0000 7f0872841640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-01T06:59:27.648 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:27 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0[47643]: 2024-08-01T06:59:27.286+0000 7f0872841640 -1 osd.0 49 *** Got signal Terminated *** 2024-08-01T06:59:27.649 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:27 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0[47643]: 2024-08-01T06:59:27.286+0000 7f0872841640 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-01T06:59:28.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:27 smithi089 ceph-mon[82218]: osd.0 marked itself down and dead 2024-08-01T06:59:28.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:27 smithi016 ceph-mon[93645]: osd.0 marked itself down and dead 2024-08-01T06:59:28.648 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:28 smithi016 podman[101765]: 2024-08-01 06:59:28.392167111 +0000 UTC m=+1.236064056 container died 9b715749958374bbe7c1c0a458adc08ddfba60c7d25ad6663bcb981d91b5f3ff (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240716, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=reef-a3bbd72, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-08-01T06:59:29.080 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:28 smithi016 ceph-mon[93645]: pgmap v38: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-01T06:59:29.080 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:28 smithi016 ceph-mon[93645]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-01T06:59:29.080 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:28 smithi016 ceph-mon[93645]: osdmap e50: 6 total, 5 up, 6 in 2024-08-01T06:59:29.081 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:28 smithi016 podman[101765]: 2024-08-01 06:59:28.752949407 +0000 UTC m=+1.596846353 container cleanup 9b715749958374bbe7c1c0a458adc08ddfba60c7d25ad6663bcb981d91b5f3ff (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240716, GIT_BRANCH=HEAD, RELEASE=reef-a3bbd72, ceph=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2) 2024-08-01T06:59:29.081 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:28 smithi016 bash[101765]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0 2024-08-01T06:59:29.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:28 smithi089 ceph-mon[82218]: pgmap v38: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-01T06:59:29.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:28 smithi089 ceph-mon[82218]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-01T06:59:29.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:28 smithi089 ceph-mon[82218]: osdmap e50: 6 total, 5 up, 6 in 2024-08-01T06:59:29.398 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:29 smithi016 podman[101782]: 2024-08-01 06:59:29.079269679 +0000 UTC m=+0.689587834 container remove 9b715749958374bbe7c1c0a458adc08ddfba60c7d25ad6663bcb981d91b5f3ff (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-a3bbd72, org.label-schema.build-date=20240716) 2024-08-01T06:59:29.734 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:29 smithi016 podman[101873]: 2024-08-01 06:59:29.316788289 +0000 UTC m=+0.018209943 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T06:59:29.734 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:29 smithi016 podman[101873]: 2024-08-01 06:59:29.43032879 +0000 UTC m=+0.131750474 container create 53d3c65034779eb1ac57ee98126821ead864f06585914337086cb5e7a08fb141 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f9911e1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-01T06:59:29.735 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:29 smithi016 podman[101873]: 2024-08-01 06:59:29.658278056 +0000 UTC m=+0.359699712 container init 53d3c65034779eb1ac57ee98126821ead864f06585914337086cb5e7a08fb141 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f9911e1, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-01T06:59:29.735 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:29 smithi016 podman[101873]: 2024-08-01 06:59:29.661709447 +0000 UTC m=+0.363131098 container start 53d3c65034779eb1ac57ee98126821ead864f06585914337086cb5e7a08fb141 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-f9911e1) 2024-08-01T06:59:29.735 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:29 smithi016 podman[101873]: 2024-08-01 06:59:29.733162906 +0000 UTC m=+0.434584557 container attach 53d3c65034779eb1ac57ee98126821ead864f06585914337086cb5e7a08fb141 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-f9911e1, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-08-01T06:59:30.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:29 smithi089 ceph-mon[82218]: osdmap e51: 6 total, 5 up, 6 in 2024-08-01T06:59:30.146 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:29 smithi016 ceph-mon[93645]: osdmap e51: 6 total, 5 up, 6 in 2024-08-01T06:59:30.146 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:29 smithi016 podman[101873]: 2024-08-01 06:59:29.860941218 +0000 UTC m=+0.562362860 container died 53d3c65034779eb1ac57ee98126821ead864f06585914337086cb5e7a08fb141 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-f9911e1, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-01T06:59:30.819 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:30 smithi016 podman[101896]: 2024-08-01 06:59:30.411968572 +0000 UTC m=+0.544366233 container remove 53d3c65034779eb1ac57ee98126821ead864f06585914337086cb5e7a08fb141 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-f9911e1, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-01T06:59:30.819 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:30 smithi016 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.0.service: Deactivated successfully. 2024-08-01T06:59:30.819 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:30 smithi016 systemd[1]: Stopped Ceph osd.0 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T06:59:30.819 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:30 smithi016 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.0.service: Consumed 1min 7.688s CPU time. 2024-08-01T06:59:30.819 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:30 smithi016 systemd[1]: Starting Ceph osd.0 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T06:59:31.133 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:30 smithi016 ceph-mon[93645]: pgmap v41: 65 pgs: 34 peering, 31 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 3 op/s 2024-08-01T06:59:31.134 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:30 smithi016 ceph-mon[93645]: Health check failed: Reduced data availability: 28 pgs peering (PG_AVAILABILITY) 2024-08-01T06:59:31.134 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:30 smithi016 podman[101995]: 2024-08-01 06:59:30.772248172 +0000 UTC m=+0.018027198 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T06:59:31.134 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:30 smithi016 podman[101995]: 2024-08-01 06:59:30.896818964 +0000 UTC m=+0.142598021 container create 87e1234d8489a3ac994071a23c5c90aaacab6edf29c5584d5efb6cce87cc26e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-f9911e1, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_CLEAN=True) 2024-08-01T06:59:31.134 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 podman[101995]: 2024-08-01 06:59:31.132644066 +0000 UTC m=+0.378423080 container init 87e1234d8489a3ac994071a23c5c90aaacab6edf29c5584d5efb6cce87cc26e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-activate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f9911e1, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=) 2024-08-01T06:59:31.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:30 smithi089 ceph-mon[82218]: pgmap v41: 65 pgs: 34 peering, 31 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 3 op/s 2024-08-01T06:59:31.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:30 smithi089 ceph-mon[82218]: Health check failed: Reduced data availability: 28 pgs peering (PG_AVAILABILITY) 2024-08-01T06:59:31.398 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 podman[101995]: 2024-08-01 06:59:31.136313033 +0000 UTC m=+0.382092055 container start 87e1234d8489a3ac994071a23c5c90aaacab6edf29c5584d5efb6cce87cc26e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-activate, RELEASE=squid-f9911e1, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-08-01T06:59:31.399 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 podman[101995]: 2024-08-01 06:59:31.24131723 +0000 UTC m=+0.487096253 container attach 87e1234d8489a3ac994071a23c5c90aaacab6edf29c5584d5efb6cce87cc26e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-activate, RELEASE=squid-f9911e1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , ceph=True) 2024-08-01T06:59:31.399 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-activate[102010]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T06:59:31.399 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 bash[101995]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T06:59:31.399 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-activate[102010]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T06:59:31.399 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 bash[101995]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T06:59:31.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-activate[102010]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-01T06:59:31.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 bash[101995]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-01T06:59:31.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-activate[102010]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-08-01T06:59:31.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 bash[101995]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-08-01T06:59:31.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-activate[102010]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-08-01T06:59:31.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 bash[101995]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-08-01T06:59:31.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-activate[102010]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-08-01T06:59:31.899 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 bash[101995]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-08-01T06:59:31.900 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-activate[102010]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-08-01T06:59:31.900 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 bash[101995]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-08-01T06:59:31.900 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-activate[102010]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-01T06:59:31.900 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 bash[101995]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-01T06:59:31.900 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-activate[102010]: --> ceph-volume raw activate successful for osd ID: 0 2024-08-01T06:59:31.900 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 bash[101995]: --> ceph-volume raw activate successful for osd ID: 0 2024-08-01T06:59:31.900 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:31 smithi016 podman[101995]: 2024-08-01 06:59:31.527850885 +0000 UTC m=+0.773629911 container died 87e1234d8489a3ac994071a23c5c90aaacab6edf29c5584d5efb6cce87cc26e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-activate, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-f9911e1, ceph=True) 2024-08-01T06:59:32.338 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:32 smithi016 podman[102147]: 2024-08-01 06:59:32.120561328 +0000 UTC m=+0.587089258 container remove 87e1234d8489a3ac994071a23c5c90aaacab6edf29c5584d5efb6cce87cc26e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, RELEASE=squid-f9911e1, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-01T06:59:32.591 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:32 smithi016 podman[102208]: 2024-08-01 06:59:32.239943935 +0000 UTC m=+0.018291911 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T06:59:32.591 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:32 smithi016 podman[102208]: 2024-08-01 06:59:32.346304526 +0000 UTC m=+0.124652486 container create 4c2115ae6222ddbb3b2a6c1b56f92ee03797acda5593988ac09de2f2824313c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, RELEASE=squid-f9911e1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-08-01T06:59:32.591 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:32 smithi016 podman[102208]: 2024-08-01 06:59:32.565277828 +0000 UTC m=+0.343625799 container init 4c2115ae6222ddbb3b2a6c1b56f92ee03797acda5593988ac09de2f2824313c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-f9911e1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-08-01T06:59:32.591 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:32 smithi016 podman[102208]: 2024-08-01 06:59:32.568437374 +0000 UTC m=+0.346785345 container start 4c2115ae6222ddbb3b2a6c1b56f92ee03797acda5593988ac09de2f2824313c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f9911e1, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-01T06:59:32.591 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:32 smithi016 ceph-osd[102227]: -- 172.21.15.16:0/3489282816 <== mon.0 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c87d7821e0 con 0x55c87d71a000 2024-08-01T06:59:32.898 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:32 smithi016 bash[102208]: 4c2115ae6222ddbb3b2a6c1b56f92ee03797acda5593988ac09de2f2824313c9 2024-08-01T06:59:32.898 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:32 smithi016 systemd[1]: Started Ceph osd.0 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T06:59:32.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:32 smithi016 ceph-mon[93645]: pgmap v42: 65 pgs: 34 peering, 31 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-01T06:59:32.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:32.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:59:32.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:32.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:32.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:59:33.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:32 smithi089 ceph-mon[82218]: pgmap v42: 65 pgs: 34 peering, 31 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-01T06:59:33.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:33.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:59:33.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:33.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:33.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:59:33.398 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:33 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0[102223]: 2024-08-01T06:59:33.112+0000 7f48b2581640 -1 Falling back to public interface 2024-08-01T06:59:34.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:33 smithi089 ceph-mon[82218]: Health check failed: Degraded data redundancy: 52/288 objects degraded (18.056%), 20 pgs degraded (PG_DEGRADED) 2024-08-01T06:59:34.370 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:33 smithi089 ceph-mon[82218]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 28 pgs peering) 2024-08-01T06:59:34.374 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:33 smithi016 ceph-mon[93645]: Health check failed: Degraded data redundancy: 52/288 objects degraded (18.056%), 20 pgs degraded (PG_DEGRADED) 2024-08-01T06:59:34.375 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:33 smithi016 ceph-mon[93645]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 28 pgs peering) 2024-08-01T06:59:35.070 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:34 smithi016 ceph-mon[93645]: pgmap v43: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 3 op/s; 52/288 objects degraded (18.056%) 2024-08-01T06:59:35.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:34 smithi089 ceph-mon[82218]: pgmap v43: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 3 op/s; 52/288 objects degraded (18.056%) 2024-08-01T06:59:37.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:36 smithi089 ceph-mon[82218]: pgmap v44: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 3 op/s; 52/288 objects degraded (18.056%) 2024-08-01T06:59:37.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:36 smithi016 ceph-mon[93645]: pgmap v44: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 3 op/s; 52/288 objects degraded (18.056%) 2024-08-01T06:59:38.398 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:38 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0[102223]: 2024-08-01T06:59:38.096+0000 7f48b2581640 -1 osd.0 49 log_to_monitors true 2024-08-01T06:59:39.106 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 06:59:38 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0[102223]: 2024-08-01T06:59:38.900+0000 7f48aa31b640 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-01T06:59:39.107 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:38 smithi016 ceph-mon[93645]: pgmap v45: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 2 op/s; 52/288 objects degraded (18.056%) 2024-08-01T06:59:39.107 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:38 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:39.107 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:38 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:39.107 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:38 smithi016 ceph-mon[93645]: from='osd.0 [v2:172.21.15.16:6802/743048622,v1:172.21.15.16:6803/743048622]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-01T06:59:39.107 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:38 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:39.107 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:38 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:39.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:38 smithi089 ceph-mon[82218]: pgmap v45: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 2 op/s; 52/288 objects degraded (18.056%) 2024-08-01T06:59:39.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:38 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:39.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:38 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:39.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:38 smithi089 ceph-mon[82218]: from='osd.0 [v2:172.21.15.16:6802/743048622,v1:172.21.15.16:6803/743048622]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-01T06:59:39.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:38 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:39.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:38 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:40.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:39 smithi016 ceph-mon[93645]: from='osd.0 [v2:172.21.15.16:6802/743048622,v1:172.21.15.16:6803/743048622]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-01T06:59:40.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:39 smithi016 ceph-mon[93645]: osdmap e52: 6 total, 5 up, 6 in 2024-08-01T06:59:40.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:39 smithi016 ceph-mon[93645]: from='osd.0 [v2:172.21.15.16:6802/743048622,v1:172.21.15.16:6803/743048622]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-08-01T06:59:40.307 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:39 smithi089 ceph-mon[82218]: from='osd.0 [v2:172.21.15.16:6802/743048622,v1:172.21.15.16:6803/743048622]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-01T06:59:40.307 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:39 smithi089 ceph-mon[82218]: osdmap e52: 6 total, 5 up, 6 in 2024-08-01T06:59:40.307 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:39 smithi089 ceph-mon[82218]: from='osd.0 [v2:172.21.15.16:6802/743048622,v1:172.21.15.16:6803/743048622]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-08-01T06:59:40.980 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:40 smithi016 ceph-mon[93645]: pgmap v47: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 52/288 objects degraded (18.056%) 2024-08-01T06:59:40.980 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:40 smithi016 ceph-mon[93645]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-01T06:59:40.981 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:40 smithi016 ceph-mon[93645]: osd.0 [v2:172.21.15.16:6802/743048622,v1:172.21.15.16:6803/743048622] boot 2024-08-01T06:59:40.981 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:40 smithi016 ceph-mon[93645]: osdmap e53: 6 total, 6 up, 6 in 2024-08-01T06:59:40.981 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:40 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:59:41.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:40 smithi089 ceph-mon[82218]: pgmap v47: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 52/288 objects degraded (18.056%) 2024-08-01T06:59:41.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:40 smithi089 ceph-mon[82218]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-01T06:59:41.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:40 smithi089 ceph-mon[82218]: osd.0 [v2:172.21.15.16:6802/743048622,v1:172.21.15.16:6803/743048622] boot 2024-08-01T06:59:41.238 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:40 smithi089 ceph-mon[82218]: osdmap e53: 6 total, 6 up, 6 in 2024-08-01T06:59:41.239 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:40 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-01T06:59:42.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:41 smithi016 ceph-mon[93645]: osdmap e54: 6 total, 6 up, 6 in 2024-08-01T06:59:42.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:42.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:42.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:59:42.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:59:42.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:42.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:59:42.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:42.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:42.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:42.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-01T06:59:42.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:41 smithi089 ceph-mon[82218]: osdmap e54: 6 total, 6 up, 6 in 2024-08-01T06:59:42.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:42.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:42.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:59:42.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T06:59:42.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:42.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T06:59:42.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:42.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:42.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:42.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-01T06:59:43.162 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:42 smithi016 ceph-mon[93645]: pgmap v50: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 52/288 objects degraded (18.056%) 2024-08-01T06:59:43.162 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:42 smithi016 ceph-mon[93645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-01T06:59:43.162 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:42 smithi016 ceph-mon[93645]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-08-01T06:59:43.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:42 smithi089 ceph-mon[82218]: pgmap v50: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 52/288 objects degraded (18.056%) 2024-08-01T06:59:43.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:42 smithi089 ceph-mon[82218]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-01T06:59:43.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:42 smithi089 ceph-mon[82218]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-08-01T06:59:43.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.985+0000 7f4de0fed640 1 -- 172.21.15.16:0/2230620261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ddc102f60 msgr2=0x7f4ddc105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:43.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.985+0000 7f4de0fed640 1 --2- 172.21.15.16:0/2230620261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ddc102f60 0x7f4ddc105350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0098b0 tx=0x7f4dcc02a4d0 comp rx=0 tx=0).stop 2024-08-01T06:59:43.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.985+0000 7f4de0fed640 1 -- 172.21.15.16:0/2230620261 shutdown_connections 2024-08-01T06:59:43.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.985+0000 7f4de0fed640 1 --2- 172.21.15.16:0/2230620261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ddc102f60 0x7f4ddc105350 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:43.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.985+0000 7f4de0fed640 1 --2- 172.21.15.16:0/2230620261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ddc100630 0x7f4ddc102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:43.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.985+0000 7f4de0fed640 1 -- 172.21.15.16:0/2230620261 >> 172.21.15.16:0/2230620261 conn(0x7f4ddc0fa250 msgr2=0x7f4ddc0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:43.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.985+0000 7f4de0fed640 1 -- 172.21.15.16:0/2230620261 shutdown_connections 2024-08-01T06:59:43.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.985+0000 7f4de0fed640 1 -- 172.21.15.16:0/2230620261 wait complete. 2024-08-01T06:59:43.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.986+0000 7f4de0fed640 1 Processor -- start 2024-08-01T06:59:43.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.986+0000 7f4de0fed640 1 -- start start 2024-08-01T06:59:43.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.986+0000 7f4de0fed640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ddc100630 0x7f4ddc195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:43.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.986+0000 7f4de0fed640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ddc102f60 0x7f4ddc195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:43.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.986+0000 7f4de0fed640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc196160 con 0x7f4ddc102f60 2024-08-01T06:59:43.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.986+0000 7f4de0fed640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc1962d0 con 0x7f4ddc100630 2024-08-01T06:59:43.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.986+0000 7f4dd9d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ddc102f60 0x7f4ddc195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:43.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.986+0000 7f4dd9d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ddc102f60 0x7f4ddc195b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60398/0 (socket says 172.21.15.16:60398) 2024-08-01T06:59:43.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.986+0000 7f4dd9d9b640 1 -- 172.21.15.16:0/3165481473 learned_addr learned my addr 172.21.15.16:0/3165481473 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:59:43.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.987+0000 7f4dda59c640 1 --2- 172.21.15.16:0/3165481473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ddc100630 0x7f4ddc195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:43.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.987+0000 7f4dd9d9b640 1 -- 172.21.15.16:0/3165481473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ddc100630 msgr2=0x7f4ddc195650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:43.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.987+0000 7f4dd9d9b640 1 --2- 172.21.15.16:0/3165481473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ddc100630 0x7f4ddc195650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.987+0000 7f4dd9d9b640 1 -- 172.21.15.16:0/3165481473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc009560 con 0x7f4ddc102f60 2024-08-01T06:59:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.987+0000 7f4dda59c640 1 --2- 172.21.15.16:0/3165481473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ddc100630 0x7f4ddc195650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T06:59:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.987+0000 7f4dd9d9b640 1 --2- 172.21.15.16:0/3165481473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ddc102f60 0x7f4ddc195b90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009230 tx=0x7f4dcc005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.987+0000 7f4dcb7fe640 1 -- 172.21.15.16:0/3165481473 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dcc004b20 con 0x7f4ddc102f60 2024-08-01T06:59:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.987+0000 7f4de0fed640 1 -- 172.21.15.16:0/3165481473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc19ad10 con 0x7f4ddc102f60 2024-08-01T06:59:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.987+0000 7f4dcb7fe640 1 -- 172.21.15.16:0/3165481473 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4dcc004c80 con 0x7f4ddc102f60 2024-08-01T06:59:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.987+0000 7f4dcb7fe640 1 -- 172.21.15.16:0/3165481473 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dcc003bc0 con 0x7f4ddc102f60 2024-08-01T06:59:43.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.987+0000 7f4de0fed640 1 -- 172.21.15.16:0/3165481473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc19b280 con 0x7f4ddc102f60 2024-08-01T06:59:43.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.989+0000 7f4de0fed640 1 -- 172.21.15.16:0/3165481473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ddc108790 con 0x7f4ddc102f60 2024-08-01T06:59:43.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.989+0000 7f4dcb7fe640 1 -- 172.21.15.16:0/3165481473 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f4dcc031640 con 0x7f4ddc102f60 2024-08-01T06:59:43.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.989+0000 7f4dcb7fe640 1 --2- 172.21.15.16:0/3165481473 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f4dc406e2a0 0x7f4dc4070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:43.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.990+0000 7f4dcb7fe640 1 -- 172.21.15.16:0/3165481473 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f4dcc0af6e0 con 0x7f4ddc102f60 2024-08-01T06:59:43.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.990+0000 7f4dda59c640 1 --2- 172.21.15.16:0/3165481473 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f4dc406e2a0 0x7f4dc4070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:43.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.990+0000 7f4dda59c640 1 --2- 172.21.15.16:0/3165481473 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f4dc406e2a0 0x7f4dc4070760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00058c0 tx=0x7f4dd0005ec0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:43.994+0000 7f4dcb7fe640 1 -- 172.21.15.16:0/3165481473 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4dcc0787f0 con 0x7f4ddc102f60 2024-08-01T06:59:44.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.187+0000 7f4de0fed640 1 -- 172.21.15.16:0/3165481473 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ddc1039c0 con 0x7f4dc406e2a0 2024-08-01T06:59:44.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.189+0000 7f4dcb7fe640 1 -- 172.21.15.16:0/3165481473 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4ddc1039c0 con 0x7f4dc406e2a0 2024-08-01T06:59:44.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.190+0000 7f4de0fed640 1 -- 172.21.15.16:0/3165481473 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f4dc406e2a0 msgr2=0x7f4dc4070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:44.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.190+0000 7f4de0fed640 1 --2- 172.21.15.16:0/3165481473 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f4dc406e2a0 0x7f4dc4070760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00058c0 tx=0x7f4dd0005ec0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.190+0000 7f4de0fed640 1 -- 172.21.15.16:0/3165481473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ddc102f60 msgr2=0x7f4ddc195b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:44.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.190+0000 7f4de0fed640 1 --2- 172.21.15.16:0/3165481473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ddc102f60 0x7f4ddc195b90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009230 tx=0x7f4dcc005610 comp rx=0 tx=0).stop 2024-08-01T06:59:44.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.191+0000 7f4de0fed640 1 -- 172.21.15.16:0/3165481473 shutdown_connections 2024-08-01T06:59:44.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.191+0000 7f4de0fed640 1 --2- 172.21.15.16:0/3165481473 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f4dc406e2a0 0x7f4dc4070760 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.191+0000 7f4de0fed640 1 --2- 172.21.15.16:0/3165481473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ddc102f60 0x7f4ddc195b90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.191+0000 7f4de0fed640 1 --2- 172.21.15.16:0/3165481473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ddc100630 0x7f4ddc195650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.191+0000 7f4de0fed640 1 -- 172.21.15.16:0/3165481473 >> 172.21.15.16:0/3165481473 conn(0x7f4ddc0fa250 msgr2=0x7f4ddc0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:44.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.191+0000 7f4de0fed640 1 -- 172.21.15.16:0/3165481473 shutdown_connections 2024-08-01T06:59:44.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.191+0000 7f4de0fed640 1 -- 172.21.15.16:0/3165481473 wait complete. 2024-08-01T06:59:44.201 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T06:59:44.202 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:43 smithi016 ceph-mon[93645]: Health check update: Degraded data redundancy: 8/288 objects degraded (2.778%), 3 pgs degraded (PG_DEGRADED) 2024-08-01T06:59:44.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.276+0000 7f2552039640 1 -- 172.21.15.16:0/3181511906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f254c102f60 msgr2=0x7f254c105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:44.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.276+0000 7f2552039640 1 --2- 172.21.15.16:0/3181511906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f254c102f60 0x7f254c105350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f253c0098b0 tx=0x7f253c02a4d0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.276+0000 7f2552039640 1 -- 172.21.15.16:0/3181511906 shutdown_connections 2024-08-01T06:59:44.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.276+0000 7f2552039640 1 --2- 172.21.15.16:0/3181511906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f254c102f60 0x7f254c105350 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.276+0000 7f2552039640 1 --2- 172.21.15.16:0/3181511906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f254c100630 0x7f254c102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.276+0000 7f2552039640 1 -- 172.21.15.16:0/3181511906 >> 172.21.15.16:0/3181511906 conn(0x7f254c0fa250 msgr2=0x7f254c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:44.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.276+0000 7f2552039640 1 -- 172.21.15.16:0/3181511906 shutdown_connections 2024-08-01T06:59:44.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.276+0000 7f2552039640 1 -- 172.21.15.16:0/3181511906 wait complete. 2024-08-01T06:59:44.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.277+0000 7f2552039640 1 Processor -- start 2024-08-01T06:59:44.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.277+0000 7f2552039640 1 -- start start 2024-08-01T06:59:44.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.277+0000 7f2552039640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f254c100630 0x7f254c195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:44.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.277+0000 7f2552039640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f254c102f60 0x7f254c195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:44.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.277+0000 7f2552039640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c1960d0 con 0x7f254c100630 2024-08-01T06:59:44.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.277+0000 7f2552039640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c196240 con 0x7f254c102f60 2024-08-01T06:59:44.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.277+0000 7f254b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f254c100630 0x7f254c195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:44.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.277+0000 7f254b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f254c100630 0x7f254c195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60428/0 (socket says 172.21.15.16:60428) 2024-08-01T06:59:44.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.277+0000 7f254b7fe640 1 -- 172.21.15.16:0/1766253884 learned_addr learned my addr 172.21.15.16:0/1766253884 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:59:44.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.278+0000 7f254affd640 1 --2- 172.21.15.16:0/1766253884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f254c102f60 0x7f254c195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:44.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.278+0000 7f254b7fe640 1 -- 172.21.15.16:0/1766253884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f254c102f60 msgr2=0x7f254c195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:44.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.278+0000 7f254b7fe640 1 --2- 172.21.15.16:0/1766253884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f254c102f60 0x7f254c195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.278+0000 7f254b7fe640 1 -- 172.21.15.16:0/1766253884 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c009560 con 0x7f254c100630 2024-08-01T06:59:44.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.278+0000 7f254affd640 1 --2- 172.21.15.16:0/1766253884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f254c102f60 0x7f254c195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-01T06:59:44.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.278+0000 7f254b7fe640 1 --2- 172.21.15.16:0/1766253884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f254c100630 0x7f254c195650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f254000c8a0 tx=0x7f254000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:44.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.278+0000 7f2548ff9640 1 -- 172.21.15.16:0/1766253884 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2540007b80 con 0x7f254c100630 2024-08-01T06:59:44.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.278+0000 7f2548ff9640 1 -- 172.21.15.16:0/1766253884 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2540007ce0 con 0x7f254c100630 2024-08-01T06:59:44.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.278+0000 7f2552039640 1 -- 172.21.15.16:0/1766253884 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254c19ad20 con 0x7f254c100630 2024-08-01T06:59:44.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.278+0000 7f2548ff9640 1 -- 172.21.15.16:0/1766253884 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2540018810 con 0x7f254c100630 2024-08-01T06:59:44.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.278+0000 7f2552039640 1 -- 172.21.15.16:0/1766253884 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254c19b240 con 0x7f254c100630 2024-08-01T06:59:44.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.279+0000 7f2552039640 1 -- 172.21.15.16:0/1766253884 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f254c108790 con 0x7f254c100630 2024-08-01T06:59:44.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.280+0000 7f2548ff9640 1 -- 172.21.15.16:0/1766253884 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f2540018970 con 0x7f254c100630 2024-08-01T06:59:44.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.280+0000 7f2548ff9640 1 --2- 172.21.15.16:0/1766253884 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f253406e2b0 0x7f2534070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:44.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.280+0000 7f2548ff9640 1 -- 172.21.15.16:0/1766253884 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f254008e480 con 0x7f254c100630 2024-08-01T06:59:44.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.280+0000 7f254affd640 1 --2- 172.21.15.16:0/1766253884 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f253406e2b0 0x7f2534070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:44.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.281+0000 7f254affd640 1 --2- 172.21.15.16:0/1766253884 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f253406e2b0 0x7f2534070770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f253c02a9f0 tx=0x7f253c005de0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:44.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.285+0000 7f2548ff9640 1 -- 172.21.15.16:0/1766253884 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2540057610 con 0x7f254c100630 2024-08-01T06:59:44.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:43 smithi089 ceph-mon[82218]: Health check update: Degraded data redundancy: 8/288 objects degraded (2.778%), 3 pgs degraded (PG_DEGRADED) 2024-08-01T06:59:44.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.476+0000 7f2552039640 1 -- 172.21.15.16:0/1766253884 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f254c1039c0 con 0x7f253406e2b0 2024-08-01T06:59:44.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.477+0000 7f2548ff9640 1 -- 172.21.15.16:0/1766253884 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f254c1039c0 con 0x7f253406e2b0 2024-08-01T06:59:44.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.479+0000 7f2552039640 1 -- 172.21.15.16:0/1766253884 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f253406e2b0 msgr2=0x7f2534070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:44.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.479+0000 7f2552039640 1 --2- 172.21.15.16:0/1766253884 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f253406e2b0 0x7f2534070770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f253c02a9f0 tx=0x7f253c005de0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.479+0000 7f2552039640 1 -- 172.21.15.16:0/1766253884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f254c100630 msgr2=0x7f254c195650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:44.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.479+0000 7f2552039640 1 --2- 172.21.15.16:0/1766253884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f254c100630 0x7f254c195650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f254000c8a0 tx=0x7f254000cd60 comp rx=0 tx=0).stop 2024-08-01T06:59:44.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.479+0000 7f2552039640 1 -- 172.21.15.16:0/1766253884 shutdown_connections 2024-08-01T06:59:44.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.479+0000 7f2552039640 1 --2- 172.21.15.16:0/1766253884 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f253406e2b0 0x7f2534070770 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.479+0000 7f2552039640 1 --2- 172.21.15.16:0/1766253884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f254c102f60 0x7f254c195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.479+0000 7f2552039640 1 --2- 172.21.15.16:0/1766253884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f254c100630 0x7f254c195650 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.479+0000 7f2552039640 1 -- 172.21.15.16:0/1766253884 >> 172.21.15.16:0/1766253884 conn(0x7f254c0fa250 msgr2=0x7f254c0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:44.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.479+0000 7f2552039640 1 -- 172.21.15.16:0/1766253884 shutdown_connections 2024-08-01T06:59:44.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.479+0000 7f2552039640 1 -- 172.21.15.16:0/1766253884 wait complete. 2024-08-01T06:59:44.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.563+0000 7f11d093b640 1 -- 172.21.15.16:0/3389726124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11cc100d90 msgr2=0x7f11cc101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:44.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.563+0000 7f11d093b640 1 --2- 172.21.15.16:0/3389726124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11cc100d90 0x7f11cc101210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009880 tx=0x7f11b402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.563+0000 7f11d093b640 1 -- 172.21.15.16:0/3389726124 shutdown_connections 2024-08-01T06:59:44.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.563+0000 7f11d093b640 1 --2- 172.21.15.16:0/3389726124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11cc100d90 0x7f11cc101210 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.563+0000 7f11d093b640 1 --2- 172.21.15.16:0/3389726124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11cc0ffb90 0x7f11cc0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.563+0000 7f11d093b640 1 -- 172.21.15.16:0/3389726124 >> 172.21.15.16:0/3389726124 conn(0x7f11cc0fb320 msgr2=0x7f11cc0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:44.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.563+0000 7f11d093b640 1 -- 172.21.15.16:0/3389726124 shutdown_connections 2024-08-01T06:59:44.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.563+0000 7f11d093b640 1 -- 172.21.15.16:0/3389726124 wait complete. 2024-08-01T06:59:44.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.564+0000 7f11d093b640 1 Processor -- start 2024-08-01T06:59:44.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.564+0000 7f11d093b640 1 -- start start 2024-08-01T06:59:44.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.564+0000 7f11d093b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11cc0ffb90 0x7f11cc195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:44.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.564+0000 7f11d093b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11cc100d90 0x7f11cc195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:44.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.564+0000 7f11d093b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc196140 con 0x7f11cc0ffb90 2024-08-01T06:59:44.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.564+0000 7f11d093b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc1962b0 con 0x7f11cc100d90 2024-08-01T06:59:44.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.564+0000 7f11ca59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11cc0ffb90 0x7f11cc195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:44.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.564+0000 7f11ca59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11cc0ffb90 0x7f11cc195630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60452/0 (socket says 172.21.15.16:60452) 2024-08-01T06:59:44.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.564+0000 7f11ca59c640 1 -- 172.21.15.16:0/1741878081 learned_addr learned my addr 172.21.15.16:0/1741878081 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:59:44.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.565+0000 7f11c9d9b640 1 --2- 172.21.15.16:0/1741878081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11cc100d90 0x7f11cc195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:44.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.565+0000 7f11ca59c640 1 -- 172.21.15.16:0/1741878081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11cc100d90 msgr2=0x7f11cc195b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:44.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.565+0000 7f11ca59c640 1 --2- 172.21.15.16:0/1741878081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11cc100d90 0x7f11cc195b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.565+0000 7f11ca59c640 1 -- 172.21.15.16:0/1741878081 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b4009560 con 0x7f11cc0ffb90 2024-08-01T06:59:44.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.565+0000 7f11c9d9b640 1 --2- 172.21.15.16:0/1741878081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11cc100d90 0x7f11cc195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-01T06:59:44.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.565+0000 7f11ca59c640 1 --2- 172.21.15.16:0/1741878081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11cc0ffb90 0x7f11cc195630 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00d900 tx=0x7f11bc00ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:44.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.565+0000 7f11c37fe640 1 -- 172.21.15.16:0/1741878081 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11bc009c00 con 0x7f11cc0ffb90 2024-08-01T06:59:44.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.565+0000 7f11c37fe640 1 -- 172.21.15.16:0/1741878081 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f11bc009d60 con 0x7f11cc0ffb90 2024-08-01T06:59:44.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.565+0000 7f11d093b640 1 -- 172.21.15.16:0/1741878081 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11cc19ad50 con 0x7f11cc0ffb90 2024-08-01T06:59:44.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.565+0000 7f11c37fe640 1 -- 172.21.15.16:0/1741878081 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11bc00f660 con 0x7f11cc0ffb90 2024-08-01T06:59:44.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.565+0000 7f11d093b640 1 -- 172.21.15.16:0/1741878081 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11cc19b2c0 con 0x7f11cc0ffb90 2024-08-01T06:59:44.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.566+0000 7f11d093b640 1 -- 172.21.15.16:0/1741878081 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11cc18f730 con 0x7f11cc0ffb90 2024-08-01T06:59:44.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.567+0000 7f11c37fe640 1 -- 172.21.15.16:0/1741878081 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f11bc010460 con 0x7f11cc0ffb90 2024-08-01T06:59:44.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.567+0000 7f11c37fe640 1 --2- 172.21.15.16:0/1741878081 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f11b806e2b0 0x7f11b8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:44.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.567+0000 7f11c37fe640 1 -- 172.21.15.16:0/1741878081 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f11bc08e290 con 0x7f11cc0ffb90 2024-08-01T06:59:44.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.567+0000 7f11c9d9b640 1 --2- 172.21.15.16:0/1741878081 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f11b806e2b0 0x7f11b8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:44.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.568+0000 7f11c9d9b640 1 --2- 172.21.15.16:0/1741878081 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f11b806e2b0 0x7f11b8070770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f11b4031540 tx=0x7f11b4005de0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:44.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.572+0000 7f11c37fe640 1 -- 172.21.15.16:0/1741878081 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f11bc0573a0 con 0x7f11cc0ffb90 2024-08-01T06:59:44.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.756+0000 7f11d093b640 1 -- 172.21.15.16:0/1741878081 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f11cc02c550 con 0x7f11b806e2b0 2024-08-01T06:59:44.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.767+0000 7f11c37fe640 1 -- 172.21.15.16:0/1741878081 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f11cc02c550 con 0x7f11b806e2b0 2024-08-01T06:59:44.768 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T06:59:44.768 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (10m) 6s ago 11m 25.2M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T06:59:44.769 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (12m) 6s ago 12m 8246k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T06:59:44.769 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (11m) 28s ago 11m 8098k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T06:59:44.769 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (36s) 6s ago 11m 6899k - 19.1.0-1223-gf9911e17 93d93c74a2cc 2a96028287a2 2024-08-01T06:59:44.769 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (31s) 28s ago 10m 6895k - 19.1.0-1223-gf9911e17 93d93c74a2cc 8a23341bd6c3 2024-08-01T06:59:44.769 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (10m) 6s ago 11m 84.2M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T06:59:44.769 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (6m) 6s ago 6m 89.1M - 18.2.2-1767-ga3bbd728 d280790d1980 96e46c28d16c 2024-08-01T06:59:44.769 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (6m) 6s ago 6m 148M - 18.2.2-1767-ga3bbd728 d280790d1980 4bbe1a388689 2024-08-01T06:59:44.769 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (6m) 28s ago 6m 27.1M - 18.2.2-1767-ga3bbd728 d280790d1980 65ca121a6fbb 2024-08-01T06:59:44.769 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (6m) 28s ago 6m 25.6M - 18.2.2-1767-ga3bbd728 d280790d1980 05bb46c6fe94 2024-08-01T06:59:44.769 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:8443,9283,8765 running (2m) 6s ago 13m 495M - 19.1.0-1223-gf9911e17 93d93c74a2cc 8701e6315593 2024-08-01T06:59:44.769 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (109s) 28s ago 10m 438M - 19.1.0-1223-gf9911e17 93d93c74a2cc c6caa21f436f 2024-08-01T06:59:44.769 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (94s) 6s ago 13m 43.8M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc 48e94d076e6f 2024-08-01T06:59:44.769 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (74s) 28s ago 10m 33.1M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc c4b83b46ff15 2024-08-01T06:59:44.769 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (11m) 6s ago 11m 16.1M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T06:59:44.770 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (10m) 28s ago 10m 16.3M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T06:59:44.770 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (12s) 6s ago 10m 12.1M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 4c2115ae6222 2024-08-01T06:59:44.770 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (9m) 6s ago 9m 241M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 f3b050aed6b7 2024-08-01T06:59:44.770 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (9m) 6s ago 9m 228M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 33a72e1a5c91 2024-08-01T06:59:44.770 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (8m) 28s ago 8m 277M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 58c175e0f4eb 2024-08-01T06:59:44.770 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (8m) 28s ago 8m 260M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 15b8f910bad7 2024-08-01T06:59:44.770 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (7m) 28s ago 7m 236M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 ac887841899e 2024-08-01T06:59:44.770 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (115s) 6s ago 11m 56.0M - 2.43.0 a07b618ecd1d 45d23c96382e 2024-08-01T06:59:44.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.769+0000 7f11d093b640 1 -- 172.21.15.16:0/1741878081 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f11b806e2b0 msgr2=0x7f11b8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:44.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.769+0000 7f11d093b640 1 --2- 172.21.15.16:0/1741878081 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f11b806e2b0 0x7f11b8070770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f11b4031540 tx=0x7f11b4005de0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.769+0000 7f11d093b640 1 -- 172.21.15.16:0/1741878081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11cc0ffb90 msgr2=0x7f11cc195630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:44.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.769+0000 7f11d093b640 1 --2- 172.21.15.16:0/1741878081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11cc0ffb90 0x7f11cc195630 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00d900 tx=0x7f11bc00ddc0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.769+0000 7f11d093b640 1 -- 172.21.15.16:0/1741878081 shutdown_connections 2024-08-01T06:59:44.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.769+0000 7f11d093b640 1 --2- 172.21.15.16:0/1741878081 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f11b806e2b0 0x7f11b8070770 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.769+0000 7f11d093b640 1 --2- 172.21.15.16:0/1741878081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11cc100d90 0x7f11cc195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.769+0000 7f11d093b640 1 --2- 172.21.15.16:0/1741878081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11cc0ffb90 0x7f11cc195630 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.769+0000 7f11d093b640 1 -- 172.21.15.16:0/1741878081 >> 172.21.15.16:0/1741878081 conn(0x7f11cc0fb320 msgr2=0x7f11cc104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:44.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.769+0000 7f11d093b640 1 -- 172.21.15.16:0/1741878081 shutdown_connections 2024-08-01T06:59:44.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.769+0000 7f11d093b640 1 -- 172.21.15.16:0/1741878081 wait complete. 2024-08-01T06:59:44.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.851+0000 7f974e9ed640 1 -- 172.21.15.16:0/3257296663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9748100e40 msgr2=0x7f97481012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:44.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.851+0000 7f974e9ed640 1 --2- 172.21.15.16:0/3257296663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9748100e40 0x7f97481012c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f973c009880 tx=0x7f973c02a4a0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.851+0000 7f974e9ed640 1 -- 172.21.15.16:0/3257296663 shutdown_connections 2024-08-01T06:59:44.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.851+0000 7f974e9ed640 1 --2- 172.21.15.16:0/3257296663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9748100e40 0x7f97481012c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.851+0000 7f974e9ed640 1 --2- 172.21.15.16:0/3257296663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97480fde60 0x7f97480fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.851+0000 7f974e9ed640 1 -- 172.21.15.16:0/3257296663 >> 172.21.15.16:0/3257296663 conn(0x7f97480f99b0 msgr2=0x7f97480fbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:44.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.851+0000 7f974e9ed640 1 -- 172.21.15.16:0/3257296663 shutdown_connections 2024-08-01T06:59:44.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.851+0000 7f974e9ed640 1 -- 172.21.15.16:0/3257296663 wait complete. 2024-08-01T06:59:44.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.852+0000 7f974e9ed640 1 Processor -- start 2024-08-01T06:59:44.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.852+0000 7f974e9ed640 1 -- start start 2024-08-01T06:59:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.852+0000 7f974e9ed640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97480fde60 0x7f9748195610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.852+0000 7f974e9ed640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9748100e40 0x7f9748195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.852+0000 7f974e9ed640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9748196090 con 0x7f9748100e40 2024-08-01T06:59:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.852+0000 7f974e9ed640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9748196200 con 0x7f97480fde60 2024-08-01T06:59:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.852+0000 7f97477fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9748100e40 0x7f9748195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:44.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.852+0000 7f97477fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9748100e40 0x7f9748195b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60462/0 (socket says 172.21.15.16:60462) 2024-08-01T06:59:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.852+0000 7f97477fe640 1 -- 172.21.15.16:0/269066084 learned_addr learned my addr 172.21.15.16:0/269066084 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:59:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.853+0000 7f9747fff640 1 --2- 172.21.15.16:0/269066084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97480fde60 0x7f9748195610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.853+0000 7f97477fe640 1 -- 172.21.15.16:0/269066084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97480fde60 msgr2=0x7f9748195610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.853+0000 7f97477fe640 1 --2- 172.21.15.16:0/269066084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97480fde60 0x7f9748195610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.853+0000 7f97477fe640 1 -- 172.21.15.16:0/269066084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c009560 con 0x7f9748100e40 2024-08-01T06:59:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.853+0000 7f97477fe640 1 --2- 172.21.15.16:0/269066084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9748100e40 0x7f9748195b50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f973c005610 tx=0x7f973c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.853+0000 7f97457fa640 1 -- 172.21.15.16:0/269066084 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f973c004ba0 con 0x7f9748100e40 2024-08-01T06:59:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.853+0000 7f97457fa640 1 -- 172.21.15.16:0/269066084 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f973c004d00 con 0x7f9748100e40 2024-08-01T06:59:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.853+0000 7f974e9ed640 1 -- 172.21.15.16:0/269066084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f974819ac80 con 0x7f9748100e40 2024-08-01T06:59:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.853+0000 7f97457fa640 1 -- 172.21.15.16:0/269066084 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f973c003bd0 con 0x7f9748100e40 2024-08-01T06:59:44.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.853+0000 7f974e9ed640 1 -- 172.21.15.16:0/269066084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974819b1a0 con 0x7f9748100e40 2024-08-01T06:59:44.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.854+0000 7f974e9ed640 1 -- 172.21.15.16:0/269066084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9748108780 con 0x7f9748100e40 2024-08-01T06:59:44.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.855+0000 7f97457fa640 1 -- 172.21.15.16:0/269066084 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f973c031640 con 0x7f9748100e40 2024-08-01T06:59:44.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.855+0000 7f97457fa640 1 --2- 172.21.15.16:0/269066084 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f973006e2b0 0x7f9730070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:44.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.855+0000 7f97457fa640 1 -- 172.21.15.16:0/269066084 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f973c0af660 con 0x7f9748100e40 2024-08-01T06:59:44.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.855+0000 7f9747fff640 1 --2- 172.21.15.16:0/269066084 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f973006e2b0 0x7f9730070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:44.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.856+0000 7f9747fff640 1 --2- 172.21.15.16:0/269066084 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f973006e2b0 0x7f9730070770 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f97380058c0 tx=0x7f9738005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:44.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:44.860+0000 7f97457fa640 1 -- 172.21.15.16:0/269066084 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f973c0787f0 con 0x7f9748100e40 2024-08-01T06:59:45.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.105+0000 7f974e9ed640 1 -- 172.21.15.16:0/269066084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f974819b6a0 con 0x7f9748100e40 2024-08-01T06:59:45.107 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:44 smithi016 ceph-mon[93645]: pgmap v51: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.3 KiB/s rd, 6 op/s; 8/288 objects degraded (2.778%) 2024-08-01T06:59:45.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.105+0000 7f97457fa640 1 -- 172.21.15.16:0/269066084 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+832 (secure 0 0 0) 0x7f973c07beb0 con 0x7f9748100e40 2024-08-01T06:59:45.107 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:59:45.107 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T06:59:45.107 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T06:59:45.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:59:45.107 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T06:59:45.107 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T06:59:45.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:59:45.108 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T06:59:45.108 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 5, 2024-08-01T06:59:45.108 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 1 2024-08-01T06:59:45.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:59:45.108 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T06:59:45.108 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4 2024-08-01T06:59:45.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T06:59:45.108 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T06:59:45.109 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 9, 2024-08-01T06:59:45.109 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 5 2024-08-01T06:59:45.109 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T06:59:45.109 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:59:45.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.107+0000 7f974e9ed640 1 -- 172.21.15.16:0/269066084 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f973006e2b0 msgr2=0x7f9730070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:45.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.107+0000 7f974e9ed640 1 --2- 172.21.15.16:0/269066084 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f973006e2b0 0x7f9730070770 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f97380058c0 tx=0x7f9738005850 comp rx=0 tx=0).stop 2024-08-01T06:59:45.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.107+0000 7f974e9ed640 1 -- 172.21.15.16:0/269066084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9748100e40 msgr2=0x7f9748195b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:45.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.107+0000 7f974e9ed640 1 --2- 172.21.15.16:0/269066084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9748100e40 0x7f9748195b50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f973c005610 tx=0x7f973c005640 comp rx=0 tx=0).stop 2024-08-01T06:59:45.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.107+0000 7f974e9ed640 1 -- 172.21.15.16:0/269066084 shutdown_connections 2024-08-01T06:59:45.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.107+0000 7f974e9ed640 1 --2- 172.21.15.16:0/269066084 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f973006e2b0 0x7f9730070770 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.107+0000 7f974e9ed640 1 --2- 172.21.15.16:0/269066084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9748100e40 0x7f9748195b50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.107+0000 7f974e9ed640 1 --2- 172.21.15.16:0/269066084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97480fde60 0x7f9748195610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.107+0000 7f974e9ed640 1 -- 172.21.15.16:0/269066084 >> 172.21.15.16:0/269066084 conn(0x7f97480f99b0 msgr2=0x7f9748104070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:45.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.108+0000 7f974e9ed640 1 -- 172.21.15.16:0/269066084 shutdown_connections 2024-08-01T06:59:45.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.108+0000 7f974e9ed640 1 -- 172.21.15.16:0/269066084 wait complete. 2024-08-01T06:59:45.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.190+0000 7fd114d1f640 1 -- 172.21.15.16:0/3700707767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd110100690 msgr2=0x7fd110102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:45.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.190+0000 7fd114d1f640 1 --2- 172.21.15.16:0/3700707767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd110100690 0x7fd110102a80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd100009880 tx=0x7fd10002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.190+0000 7fd114d1f640 1 -- 172.21.15.16:0/3700707767 shutdown_connections 2024-08-01T06:59:45.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.190+0000 7fd114d1f640 1 --2- 172.21.15.16:0/3700707767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd110102fc0 0x7fd1101053b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.190+0000 7fd114d1f640 1 --2- 172.21.15.16:0/3700707767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd110100690 0x7fd110102a80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.190+0000 7fd114d1f640 1 -- 172.21.15.16:0/3700707767 >> 172.21.15.16:0/3700707767 conn(0x7fd1100fa250 msgr2=0x7fd1100fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:45.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.190+0000 7fd114d1f640 1 -- 172.21.15.16:0/3700707767 shutdown_connections 2024-08-01T06:59:45.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.190+0000 7fd114d1f640 1 -- 172.21.15.16:0/3700707767 wait complete. 2024-08-01T06:59:45.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.191+0000 7fd114d1f640 1 Processor -- start 2024-08-01T06:59:45.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.191+0000 7fd114d1f640 1 -- start start 2024-08-01T06:59:45.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.191+0000 7fd114d1f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd110100690 0x7fd1101955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:45.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.191+0000 7fd114d1f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd110102fc0 0x7fd110195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:45.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.191+0000 7fd114d1f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd110196050 con 0x7fd110100690 2024-08-01T06:59:45.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.191+0000 7fd114d1f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1101961c0 con 0x7fd110102fc0 2024-08-01T06:59:45.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.191+0000 7fd10e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd110100690 0x7fd1101955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:45.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.191+0000 7fd10e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd110100690 0x7fd1101955d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60482/0 (socket says 172.21.15.16:60482) 2024-08-01T06:59:45.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.191+0000 7fd10e59c640 1 -- 172.21.15.16:0/2887205224 learned_addr learned my addr 172.21.15.16:0/2887205224 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:59:45.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.192+0000 7fd10dd9b640 1 --2- 172.21.15.16:0/2887205224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd110102fc0 0x7fd110195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:45.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.192+0000 7fd10e59c640 1 -- 172.21.15.16:0/2887205224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd110102fc0 msgr2=0x7fd110195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:45.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.192+0000 7fd10e59c640 1 --2- 172.21.15.16:0/2887205224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd110102fc0 0x7fd110195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.192+0000 7fd10e59c640 1 -- 172.21.15.16:0/2887205224 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd100009560 con 0x7fd110100690 2024-08-01T06:59:45.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.192+0000 7fd10e59c640 1 --2- 172.21.15.16:0/2887205224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd110100690 0x7fd1101955d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd100006010 tx=0x7fd1000055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:45.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.192+0000 7fd0ff7fe640 1 -- 172.21.15.16:0/2887205224 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd100004b20 con 0x7fd110100690 2024-08-01T06:59:45.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.192+0000 7fd0ff7fe640 1 -- 172.21.15.16:0/2887205224 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd100004c80 con 0x7fd110100690 2024-08-01T06:59:45.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.192+0000 7fd114d1f640 1 -- 172.21.15.16:0/2887205224 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd11019aca0 con 0x7fd110100690 2024-08-01T06:59:45.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.192+0000 7fd0ff7fe640 1 -- 172.21.15.16:0/2887205224 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd100003b80 con 0x7fd110100690 2024-08-01T06:59:45.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.192+0000 7fd114d1f640 1 -- 172.21.15.16:0/2887205224 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11019b1a0 con 0x7fd110100690 2024-08-01T06:59:45.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.193+0000 7fd114d1f640 1 -- 172.21.15.16:0/2887205224 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd110108750 con 0x7fd110100690 2024-08-01T06:59:45.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.194+0000 7fd0ff7fe640 1 -- 172.21.15.16:0/2887205224 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fd100031640 con 0x7fd110100690 2024-08-01T06:59:45.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.194+0000 7fd0ff7fe640 1 --2- 172.21.15.16:0/2887205224 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd0f806e2a0 0x7fd0f8070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:45.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.194+0000 7fd0ff7fe640 1 -- 172.21.15.16:0/2887205224 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd1000af5a0 con 0x7fd110100690 2024-08-01T06:59:45.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.195+0000 7fd10dd9b640 1 --2- 172.21.15.16:0/2887205224 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd0f806e2a0 0x7fd0f8070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:45.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.195+0000 7fd10dd9b640 1 --2- 172.21.15.16:0/2887205224 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd0f806e2a0 0x7fd0f8070760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd104005e10 tx=0x7fd104005da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:45.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.199+0000 7fd0ff7fe640 1 -- 172.21.15.16:0/2887205224 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd100078730 con 0x7fd110100690 2024-08-01T06:59:45.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:44 smithi089 ceph-mon[82218]: pgmap v51: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.3 KiB/s rd, 6 op/s; 8/288 objects degraded (2.778%) 2024-08-01T06:59:45.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.412+0000 7fd114d1f640 1 -- 172.21.15.16:0/2887205224 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd11019b410 con 0x7fd110100690 2024-08-01T06:59:45.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.412+0000 7fd0ff7fe640 1 -- 172.21.15.16:0/2887205224 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1938 (secure 0 0 0) 0x7fd10007bdf0 con 0x7fd110100690 2024-08-01T06:59:45.415 INFO:teuthology.orchestra.run.smithi016.stdout:e19 2024-08-01T06:59:45.415 INFO:teuthology.orchestra.run.smithi016.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-08-01T06:59:45.415 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T06:59:45.415 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:59:45.415 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T06:59:45.415 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:59:45.415 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T06:59:45.416 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T06:59:45.416 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 19 2024-08-01T06:59:45.416 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T06:59:45.416 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T06:59:45.416 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T06:53:32.617145+0000 2024-08-01T06:59:45.416 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T06:59:45.416 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T06:59:45.416 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T06:59:45.416 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T06:59:45.416 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T06:59:45.416 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T06:59:45.416 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T06:59:45.416 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T06:59:45.416 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 46 2024-08-01T06:59:45.417 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T06:59:45.417 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T06:59:45.417 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T06:59:45.417 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=14482,1=24281} 2024-08-01T06:59:45.417 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T06:59:45.417 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T06:59:45.417 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T06:59:45.417 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T06:59:45.417 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T06:59:45.417 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T06:59:45.417 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T06:59:45.417 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T06:59:45.417 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T06:59:45.417 INFO:teuthology.orchestra.run.smithi016.stdout:qdb_cluster leader: 0 members: 2024-08-01T06:59:45.418 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:59:45.418 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:24299} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:59:45.418 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{1:24281} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:59:45.418 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:24291} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T06:59:45.418 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:59:45.418 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T06:59:45.419 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-08-01T06:59:45.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.415+0000 7fd114d1f640 1 -- 172.21.15.16:0/2887205224 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd0f806e2a0 msgr2=0x7fd0f8070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:45.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.415+0000 7fd114d1f640 1 --2- 172.21.15.16:0/2887205224 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd0f806e2a0 0x7fd0f8070760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd104005e10 tx=0x7fd104005da0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.415+0000 7fd114d1f640 1 -- 172.21.15.16:0/2887205224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd110100690 msgr2=0x7fd1101955d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:45.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.415+0000 7fd114d1f640 1 --2- 172.21.15.16:0/2887205224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd110100690 0x7fd1101955d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd100006010 tx=0x7fd1000055f0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.415+0000 7fd114d1f640 1 -- 172.21.15.16:0/2887205224 shutdown_connections 2024-08-01T06:59:45.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.415+0000 7fd114d1f640 1 --2- 172.21.15.16:0/2887205224 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd0f806e2a0 0x7fd0f8070760 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.415+0000 7fd114d1f640 1 --2- 172.21.15.16:0/2887205224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd110102fc0 0x7fd110195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.415+0000 7fd114d1f640 1 --2- 172.21.15.16:0/2887205224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd110100690 0x7fd1101955d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.415+0000 7fd114d1f640 1 -- 172.21.15.16:0/2887205224 >> 172.21.15.16:0/2887205224 conn(0x7fd1100fa250 msgr2=0x7fd1100fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:45.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.415+0000 7fd114d1f640 1 -- 172.21.15.16:0/2887205224 shutdown_connections 2024-08-01T06:59:45.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.415+0000 7fd114d1f640 1 -- 172.21.15.16:0/2887205224 wait complete. 2024-08-01T06:59:45.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.500+0000 7f9cb0533640 1 -- 172.21.15.16:0/3948356729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ca8102fc0 msgr2=0x7f9ca81053b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:45.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.500+0000 7f9cb0533640 1 --2- 172.21.15.16:0/3948356729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ca8102fc0 0x7f9ca81053b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009880 tx=0x7f9ca402a4a0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.500+0000 7f9cb0533640 1 -- 172.21.15.16:0/3948356729 shutdown_connections 2024-08-01T06:59:45.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.500+0000 7f9cb0533640 1 --2- 172.21.15.16:0/3948356729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ca8102fc0 0x7f9ca81053b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.500+0000 7f9cb0533640 1 --2- 172.21.15.16:0/3948356729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ca8100690 0x7f9ca8102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.500+0000 7f9cb0533640 1 -- 172.21.15.16:0/3948356729 >> 172.21.15.16:0/3948356729 conn(0x7f9ca80fa250 msgr2=0x7f9ca80fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:45.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.500+0000 7f9cb0533640 1 -- 172.21.15.16:0/3948356729 shutdown_connections 2024-08-01T06:59:45.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.500+0000 7f9cb0533640 1 -- 172.21.15.16:0/3948356729 wait complete. 2024-08-01T06:59:45.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.500+0000 7f9cb0533640 1 Processor -- start 2024-08-01T06:59:45.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.501+0000 7f9cb0533640 1 -- start start 2024-08-01T06:59:45.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.501+0000 7f9cb0533640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ca8100690 0x7f9ca81955a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:45.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.501+0000 7f9cb0533640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ca8102fc0 0x7f9ca8195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:45.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.501+0000 7f9cb0533640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca81960b0 con 0x7f9ca8102fc0 2024-08-01T06:59:45.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.501+0000 7f9cb0533640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca8196220 con 0x7f9ca8100690 2024-08-01T06:59:45.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.501+0000 7f9cadace640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ca8102fc0 0x7f9ca8195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:45.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.501+0000 7f9cadace640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ca8102fc0 0x7f9ca8195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60502/0 (socket says 172.21.15.16:60502) 2024-08-01T06:59:45.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.501+0000 7f9cadace640 1 -- 172.21.15.16:0/2244794614 learned_addr learned my addr 172.21.15.16:0/2244794614 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:59:45.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.501+0000 7f9cae2cf640 1 --2- 172.21.15.16:0/2244794614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ca8100690 0x7f9ca81955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:45.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.501+0000 7f9cadace640 1 -- 172.21.15.16:0/2244794614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ca8100690 msgr2=0x7f9ca81955a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:45.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.501+0000 7f9cadace640 1 --2- 172.21.15.16:0/2244794614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ca8100690 0x7f9ca81955a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.501+0000 7f9cadace640 1 -- 172.21.15.16:0/2244794614 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca4009560 con 0x7f9ca8102fc0 2024-08-01T06:59:45.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.501+0000 7f9cadace640 1 --2- 172.21.15.16:0/2244794614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ca8102fc0 0x7f9ca8195ae0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9ca40054f0 tx=0x7f9ca4005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:45.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.502+0000 7f9c9b7fe640 1 -- 172.21.15.16:0/2244794614 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ca4004aa0 con 0x7f9ca8102fc0 2024-08-01T06:59:45.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.502+0000 7f9c9b7fe640 1 -- 172.21.15.16:0/2244794614 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ca4004c00 con 0x7f9ca8102fc0 2024-08-01T06:59:45.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.502+0000 7f9cb0533640 1 -- 172.21.15.16:0/2244794614 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca819acc0 con 0x7f9ca8102fc0 2024-08-01T06:59:45.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.502+0000 7f9c9b7fe640 1 -- 172.21.15.16:0/2244794614 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ca4003ac0 con 0x7f9ca8102fc0 2024-08-01T06:59:45.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.502+0000 7f9cb0533640 1 -- 172.21.15.16:0/2244794614 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca819b290 con 0x7f9ca8102fc0 2024-08-01T06:59:45.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.503+0000 7f9cb0533640 1 -- 172.21.15.16:0/2244794614 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca8108720 con 0x7f9ca8102fc0 2024-08-01T06:59:45.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.503+0000 7f9c9b7fe640 1 -- 172.21.15.16:0/2244794614 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f9ca4003d80 con 0x7f9ca8102fc0 2024-08-01T06:59:45.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.504+0000 7f9c9b7fe640 1 --2- 172.21.15.16:0/2244794614 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9c9406e2b0 0x7f9c94070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:45.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.504+0000 7f9c9b7fe640 1 -- 172.21.15.16:0/2244794614 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f9ca40af4d0 con 0x7f9ca8102fc0 2024-08-01T06:59:45.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.504+0000 7f9cae2cf640 1 --2- 172.21.15.16:0/2244794614 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9c9406e2b0 0x7f9c94070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:45.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.504+0000 7f9cae2cf640 1 --2- 172.21.15.16:0/2244794614 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9c9406e2b0 0x7f9c94070770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00bbe0 tx=0x7f9c9c00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:45.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.508+0000 7f9c9b7fe640 1 -- 172.21.15.16:0/2244794614 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9ca4078690 con 0x7f9ca8102fc0 2024-08-01T06:59:45.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.702+0000 7f9cb0533640 1 -- 172.21.15.16:0/2244794614 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ca8103980 con 0x7f9c9406e2b0 2024-08-01T06:59:45.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.703+0000 7f9c9b7fe640 1 -- 172.21.15.16:0/2244794614 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9ca8103980 con 0x7f9c9406e2b0 2024-08-01T06:59:45.706 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T06:59:45.706 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T06:59:45.706 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T06:59:45.706 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T06:59:45.706 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-08-01T06:59:45.706 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-08-01T06:59:45.706 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr", 2024-08-01T06:59:45.706 INFO:teuthology.orchestra.run.smithi016.stdout: "crash" 2024-08-01T06:59:45.706 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-08-01T06:59:45.707 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "7/23 daemons upgraded", 2024-08-01T06:59:45.707 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-08-01T06:59:45.707 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T06:59:45.707 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T06:59:45.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.705+0000 7f9cb0533640 1 -- 172.21.15.16:0/2244794614 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9c9406e2b0 msgr2=0x7f9c94070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:45.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.705+0000 7f9cb0533640 1 --2- 172.21.15.16:0/2244794614 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9c9406e2b0 0x7f9c94070770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00bbe0 tx=0x7f9c9c00b390 comp rx=0 tx=0).stop 2024-08-01T06:59:45.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.705+0000 7f9cb0533640 1 -- 172.21.15.16:0/2244794614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ca8102fc0 msgr2=0x7f9ca8195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:45.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.705+0000 7f9cb0533640 1 --2- 172.21.15.16:0/2244794614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ca8102fc0 0x7f9ca8195ae0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9ca40054f0 tx=0x7f9ca4005520 comp rx=0 tx=0).stop 2024-08-01T06:59:45.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.705+0000 7f9cb0533640 1 -- 172.21.15.16:0/2244794614 shutdown_connections 2024-08-01T06:59:45.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.705+0000 7f9cb0533640 1 --2- 172.21.15.16:0/2244794614 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9c9406e2b0 0x7f9c94070770 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.705+0000 7f9cb0533640 1 --2- 172.21.15.16:0/2244794614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ca8102fc0 0x7f9ca8195ae0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.705+0000 7f9cb0533640 1 --2- 172.21.15.16:0/2244794614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ca8100690 0x7f9ca81955a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.705+0000 7f9cb0533640 1 -- 172.21.15.16:0/2244794614 >> 172.21.15.16:0/2244794614 conn(0x7f9ca80fa250 msgr2=0x7f9ca80fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:45.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.705+0000 7f9cb0533640 1 -- 172.21.15.16:0/2244794614 shutdown_connections 2024-08-01T06:59:45.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.706+0000 7f9cb0533640 1 -- 172.21.15.16:0/2244794614 wait complete. 2024-08-01T06:59:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.789+0000 7f3ba1755640 1 -- 172.21.15.16:0/3078443575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b9c0ffc80 msgr2=0x7f3b9c100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.789+0000 7f3ba1755640 1 --2- 172.21.15.16:0/3078443575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b9c0ffc80 0x7f3b9c100100 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009880 tx=0x7f3b9002a4a0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.789+0000 7f3ba1755640 1 -- 172.21.15.16:0/3078443575 shutdown_connections 2024-08-01T06:59:45.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.789+0000 7f3ba1755640 1 --2- 172.21.15.16:0/3078443575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b9c0ffc80 0x7f3b9c100100 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.789+0000 7f3ba1755640 1 --2- 172.21.15.16:0/3078443575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b9c0fea80 0x7f3b9c0fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.789+0000 7f3ba1755640 1 -- 172.21.15.16:0/3078443575 >> 172.21.15.16:0/3078443575 conn(0x7f3b9c0fa230 msgr2=0x7f3b9c0fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:45.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.789+0000 7f3ba1755640 1 -- 172.21.15.16:0/3078443575 shutdown_connections 2024-08-01T06:59:45.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.789+0000 7f3ba1755640 1 -- 172.21.15.16:0/3078443575 wait complete. 2024-08-01T06:59:45.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.789+0000 7f3ba1755640 1 Processor -- start 2024-08-01T06:59:45.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.789+0000 7f3ba1755640 1 -- start start 2024-08-01T06:59:45.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.790+0000 7f3ba1755640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b9c0fea80 0x7f3b9c102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:45.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.790+0000 7f3ba1755640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b9c0ffc80 0x7f3b9c101060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:45.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.790+0000 7f3ba1755640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c1015a0 con 0x7f3b9c0ffc80 2024-08-01T06:59:45.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.790+0000 7f3ba1755640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c101710 con 0x7f3b9c0fea80 2024-08-01T06:59:45.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.790+0000 7f3b9a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b9c0ffc80 0x7f3b9c101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:45.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.790+0000 7f3b9a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b9c0ffc80 0x7f3b9c101060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60534/0 (socket says 172.21.15.16:60534) 2024-08-01T06:59:45.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.790+0000 7f3b9a7fc640 1 -- 172.21.15.16:0/27971196 learned_addr learned my addr 172.21.15.16:0/27971196 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T06:59:45.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.790+0000 7f3b9affd640 1 --2- 172.21.15.16:0/27971196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b9c0fea80 0x7f3b9c102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:45.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.790+0000 7f3b9a7fc640 1 -- 172.21.15.16:0/27971196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b9c0fea80 msgr2=0x7f3b9c102a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:45.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.790+0000 7f3b9a7fc640 1 --2- 172.21.15.16:0/27971196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b9c0fea80 0x7f3b9c102a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:45.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.790+0000 7f3b9a7fc640 1 -- 172.21.15.16:0/27971196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90009560 con 0x7f3b9c0ffc80 2024-08-01T06:59:45.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.790+0000 7f3b9a7fc640 1 --2- 172.21.15.16:0/27971196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b9c0ffc80 0x7f3b9c101060 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3b90006010 tx=0x7f3b900055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:45.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.790+0000 7f3b83fff640 1 -- 172.21.15.16:0/27971196 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b90004aa0 con 0x7f3b9c0ffc80 2024-08-01T06:59:45.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.791+0000 7f3ba1755640 1 -- 172.21.15.16:0/27971196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9c101990 con 0x7f3b9c0ffc80 2024-08-01T06:59:45.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.791+0000 7f3b83fff640 1 -- 172.21.15.16:0/27971196 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b90004c00 con 0x7f3b9c0ffc80 2024-08-01T06:59:45.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.791+0000 7f3b83fff640 1 -- 172.21.15.16:0/27971196 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b900039b0 con 0x7f3b9c0ffc80 2024-08-01T06:59:45.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.791+0000 7f3ba1755640 1 -- 172.21.15.16:0/27971196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9c19d6e0 con 0x7f3b9c0ffc80 2024-08-01T06:59:45.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.792+0000 7f3ba1755640 1 -- 172.21.15.16:0/27971196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9c0fee80 con 0x7f3b9c0ffc80 2024-08-01T06:59:45.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.792+0000 7f3b83fff640 1 -- 172.21.15.16:0/27971196 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f3b90031c00 con 0x7f3b9c0ffc80 2024-08-01T06:59:45.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.793+0000 7f3b83fff640 1 --2- 172.21.15.16:0/27971196 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f3b8406e2b0 0x7f3b84070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T06:59:45.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.793+0000 7f3b83fff640 1 -- 172.21.15.16:0/27971196 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f3b900af570 con 0x7f3b9c0ffc80 2024-08-01T06:59:45.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.793+0000 7f3b9affd640 1 --2- 172.21.15.16:0/27971196 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f3b8406e2b0 0x7f3b84070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T06:59:45.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.793+0000 7f3b9affd640 1 --2- 172.21.15.16:0/27971196 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f3b8406e2b0 0x7f3b84070770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c005fd0 tx=0x7f3b8c005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T06:59:45.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:45.797+0000 7f3b83fff640 1 -- 172.21.15.16:0/27971196 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3b90078680 con 0x7f3b9c0ffc80 2024-08-01T06:59:46.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:46.043+0000 7f3ba1755640 1 -- 172.21.15.16:0/27971196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3b9c107670 con 0x7f3b9c0ffc80 2024-08-01T06:59:46.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:46.043+0000 7f3b83fff640 1 -- 172.21.15.16:0/27971196 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3b9007bd40 con 0x7f3b9c0ffc80 2024-08-01T06:59:46.046 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-08-01T06:59:46.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:46.045+0000 7f3ba1755640 1 -- 172.21.15.16:0/27971196 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f3b8406e2b0 msgr2=0x7f3b84070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:46.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:46.045+0000 7f3ba1755640 1 --2- 172.21.15.16:0/27971196 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f3b8406e2b0 0x7f3b84070770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c005fd0 tx=0x7f3b8c005850 comp rx=0 tx=0).stop 2024-08-01T06:59:46.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:46.045+0000 7f3ba1755640 1 -- 172.21.15.16:0/27971196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b9c0ffc80 msgr2=0x7f3b9c101060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T06:59:46.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:46.045+0000 7f3ba1755640 1 --2- 172.21.15.16:0/27971196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b9c0ffc80 0x7f3b9c101060 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3b90006010 tx=0x7f3b900055a0 comp rx=0 tx=0).stop 2024-08-01T06:59:46.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:46.045+0000 7f3ba1755640 1 -- 172.21.15.16:0/27971196 shutdown_connections 2024-08-01T06:59:46.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:46.046+0000 7f3ba1755640 1 --2- 172.21.15.16:0/27971196 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f3b8406e2b0 0x7f3b84070770 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:46.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:46.046+0000 7f3ba1755640 1 --2- 172.21.15.16:0/27971196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b9c0ffc80 0x7f3b9c101060 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:46.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:46.046+0000 7f3ba1755640 1 --2- 172.21.15.16:0/27971196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b9c0fea80 0x7f3b9c102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T06:59:46.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:46.046+0000 7f3ba1755640 1 -- 172.21.15.16:0/27971196 >> 172.21.15.16:0/27971196 conn(0x7f3b9c0fa230 msgr2=0x7f3b9c0684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T06:59:46.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:46.046+0000 7f3ba1755640 1 -- 172.21.15.16:0/27971196 shutdown_connections 2024-08-01T06:59:46.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T06:59:46.046+0000 7f3ba1755640 1 -- 172.21.15.16:0/27971196 wait complete. 2024-08-01T06:59:46.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:45 smithi089 ceph-mon[82218]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:59:46.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:45 smithi089 ceph-mon[82218]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:59:46.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:45 smithi089 ceph-mon[82218]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:59:46.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:45 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/269066084' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:46.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:45 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2887205224' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:59:46.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:45 smithi016 ceph-mon[93645]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:59:46.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:45 smithi016 ceph-mon[93645]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:59:46.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:45 smithi016 ceph-mon[93645]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:59:46.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:45 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/269066084' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T06:59:46.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:45 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2887205224' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T06:59:47.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:46 smithi089 ceph-mon[82218]: pgmap v52: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 2 op/s 2024-08-01T06:59:47.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:46 smithi089 ceph-mon[82218]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:59:47.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:46 smithi089 ceph-mon[82218]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/288 objects degraded (2.778%), 3 pgs degraded) 2024-08-01T06:59:47.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:46 smithi089 ceph-mon[82218]: Cluster is now healthy 2024-08-01T06:59:47.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:46 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/27971196' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:59:47.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:46 smithi016 ceph-mon[93645]: pgmap v52: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 2 op/s 2024-08-01T06:59:47.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:46 smithi016 ceph-mon[93645]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T06:59:47.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:46 smithi016 ceph-mon[93645]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/288 objects degraded (2.778%), 3 pgs degraded) 2024-08-01T06:59:47.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:46 smithi016 ceph-mon[93645]: Cluster is now healthy 2024-08-01T06:59:47.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:46 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/27971196' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T06:59:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:48 smithi089 ceph-mon[82218]: pgmap v53: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-01T06:59:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:59:48.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:48 smithi016 ceph-mon[93645]: pgmap v53: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-01T06:59:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T06:59:50.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:50 smithi089 ceph-mon[82218]: pgmap v54: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 669 B/s wr, 5 op/s 2024-08-01T06:59:50.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:50 smithi089 ceph-mon[82218]: mgrmap e38: smithi016.whigbo(active, since 92s), standbys: smithi089.hfgnsr 2024-08-01T06:59:50.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:50 smithi016 ceph-mon[93645]: pgmap v54: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 669 B/s wr, 5 op/s 2024-08-01T06:59:50.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:50 smithi016 ceph-mon[93645]: mgrmap e38: smithi016.whigbo(active, since 92s), standbys: smithi089.hfgnsr 2024-08-01T06:59:52.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:52 smithi089 ceph-mon[82218]: pgmap v55: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 604 B/s wr, 4 op/s 2024-08-01T06:59:52.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:52 smithi016 ceph-mon[93645]: pgmap v55: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 604 B/s wr, 4 op/s 2024-08-01T06:59:53.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:53 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:53.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:53 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:54.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:54 smithi089 ceph-mon[82218]: pgmap v56: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-01T06:59:54.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:54 smithi016 ceph-mon[93645]: pgmap v56: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-01T06:59:56.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:56 smithi089 ceph-mon[82218]: pgmap v57: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-08-01T06:59:56.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:56 smithi016 ceph-mon[93645]: pgmap v57: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-08-01T06:59:57.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:57 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-01T06:59:57.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:57 smithi089 ceph-mon[82218]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-01T06:59:57.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:57 smithi089 ceph-mon[82218]: Upgrade: osd.1 is safe to restart 2024-08-01T06:59:57.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:57 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-01T06:59:57.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:57 smithi016 ceph-mon[93645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-01T06:59:57.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:57 smithi016 ceph-mon[93645]: Upgrade: osd.1 is safe to restart 2024-08-01T06:59:58.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:58 smithi089 ceph-mon[82218]: pgmap v58: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-08-01T06:59:58.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:58 smithi016 ceph-mon[93645]: pgmap v58: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-08-01T06:59:59.840 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:59 smithi016 ceph-mon[93645]: Upgrade: Updating osd.1 2024-08-01T06:59:59.840 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:59 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:59.840 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:59 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-01T06:59:59.840 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:59 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:59:59.840 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 06:59:59 smithi016 ceph-mon[93645]: Deploying daemon osd.1 on smithi016 2024-08-01T06:59:59.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:59 smithi089 ceph-mon[82218]: Upgrade: Updating osd.1 2024-08-01T06:59:59.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:59 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T06:59:59.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:59 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-01T06:59:59.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:59 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T06:59:59.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 06:59:59 smithi089 ceph-mon[82218]: Deploying daemon osd.1 on smithi016 2024-08-01T07:00:00.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:00 smithi089 ceph-mon[82218]: pgmap v59: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-01T07:00:00.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:00 smithi089 ceph-mon[82218]: overall HEALTH_OK 2024-08-01T07:00:00.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:00 smithi016 ceph-mon[93645]: pgmap v59: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-01T07:00:00.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:00 smithi016 ceph-mon[93645]: overall HEALTH_OK 2024-08-01T07:00:01.845 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:01 smithi016 systemd[1]: Stopping Ceph osd.1 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T07:00:02.148 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:01 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1[55324]: 2024-08-01T07:00:01.843+0000 7f8bd12f7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-01T07:00:02.149 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:01 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1[55324]: 2024-08-01T07:00:01.843+0000 7f8bd12f7640 -1 osd.1 54 *** Got signal Terminated *** 2024-08-01T07:00:02.149 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:01 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1[55324]: 2024-08-01T07:00:01.843+0000 7f8bd12f7640 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-01T07:00:02.808 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:02 smithi089 ceph-mon[82218]: pgmap v60: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:00:02.808 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:02 smithi089 ceph-mon[82218]: osd.1 marked itself down and dead 2024-08-01T07:00:02.808 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:00:02.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:02 smithi016 ceph-mon[93645]: pgmap v60: 65 pgs: 65 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:00:02.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:02 smithi016 ceph-mon[93645]: osd.1 marked itself down and dead 2024-08-01T07:00:02.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:00:03.363 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:03 smithi016 podman[107132]: 2024-08-01 07:00:03.061919458 +0000 UTC m=+1.318681565 container died f3b050aed6b7b2bd6847900214e9d84da71a881a952f7caf9a913cb830f37899 (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240716, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=reef-a3bbd72, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-01T07:00:03.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:03 smithi016 ceph-mon[93645]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-01T07:00:03.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:03 smithi016 ceph-mon[93645]: osdmap e55: 6 total, 5 up, 6 in 2024-08-01T07:00:03.649 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:03 smithi016 podman[107132]: 2024-08-01 07:00:03.460183718 +0000 UTC m=+1.716945814 container cleanup f3b050aed6b7b2bd6847900214e9d84da71a881a952f7caf9a913cb830f37899 (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240716, org.label-schema.vendor=CentOS, RELEASE=reef-a3bbd72, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=) 2024-08-01T07:00:03.649 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:03 smithi016 bash[107132]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1 2024-08-01T07:00:03.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:03 smithi089 ceph-mon[82218]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-01T07:00:03.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:03 smithi089 ceph-mon[82218]: osdmap e55: 6 total, 5 up, 6 in 2024-08-01T07:00:04.148 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:03 smithi016 podman[107152]: 2024-08-01 07:00:03.768663443 +0000 UTC m=+0.705573107 container remove f3b050aed6b7b2bd6847900214e9d84da71a881a952f7caf9a913cb830f37899 (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=reef-a3bbd72, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240716, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-01T07:00:04.523 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:04 smithi016 ceph-mon[93645]: pgmap v62: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-08-01T07:00:04.523 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:04 smithi016 ceph-mon[93645]: Health check failed: Reduced data availability: 8 pgs peering (PG_AVAILABILITY) 2024-08-01T07:00:04.523 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:04 smithi016 ceph-mon[93645]: osdmap e56: 6 total, 5 up, 6 in 2024-08-01T07:00:04.524 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:04 smithi016 podman[107243]: 2024-08-01 07:00:04.174784375 +0000 UTC m=+0.018193207 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:00:04.524 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:04 smithi016 podman[107243]: 2024-08-01 07:00:04.279443545 +0000 UTC m=+0.122852406 container create ffbae2be11fda6c808037acf4699d4c8b36f79a98a7adb14e4879cd9796f8eff (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f9911e1, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-08-01T07:00:04.524 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:04 smithi016 podman[107243]: 2024-08-01 07:00:04.482305077 +0000 UTC m=+0.325713897 container init ffbae2be11fda6c808037acf4699d4c8b36f79a98a7adb14e4879cd9796f8eff (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-f9911e1, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-08-01T07:00:04.524 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:04 smithi016 podman[107243]: 2024-08-01 07:00:04.485948929 +0000 UTC m=+0.329357758 container start ffbae2be11fda6c808037acf4699d4c8b36f79a98a7adb14e4879cd9796f8eff (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-f9911e1) 2024-08-01T07:00:04.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:04 smithi089 ceph-mon[82218]: pgmap v62: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-08-01T07:00:04.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:04 smithi089 ceph-mon[82218]: Health check failed: Reduced data availability: 8 pgs peering (PG_AVAILABILITY) 2024-08-01T07:00:04.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:04 smithi089 ceph-mon[82218]: osdmap e56: 6 total, 5 up, 6 in 2024-08-01T07:00:04.898 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:04 smithi016 podman[107243]: 2024-08-01 07:00:04.590667074 +0000 UTC m=+0.434075905 container attach ffbae2be11fda6c808037acf4699d4c8b36f79a98a7adb14e4879cd9796f8eff (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f9911e1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-01T07:00:04.898 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:04 smithi016 podman[107266]: 2024-08-01 07:00:04.709534153 +0000 UTC m=+0.018791334 container died ffbae2be11fda6c808037acf4699d4c8b36f79a98a7adb14e4879cd9796f8eff (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, RELEASE=squid-f9911e1, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-01T07:00:05.538 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:05 smithi016 podman[107266]: 2024-08-01 07:00:05.294773247 +0000 UTC m=+0.604030489 container remove ffbae2be11fda6c808037acf4699d4c8b36f79a98a7adb14e4879cd9796f8eff (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-deactivate, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-f9911e1, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-01T07:00:05.539 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:05 smithi016 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.1.service: Deactivated successfully. 2024-08-01T07:00:05.539 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:05 smithi016 systemd[1]: Stopped Ceph osd.1 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T07:00:05.539 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:05 smithi016 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.1.service: Consumed 1min 13.852s CPU time. 2024-08-01T07:00:05.539 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:05 smithi016 ceph-mon[93645]: Health check failed: Degraded data redundancy: 3/288 objects degraded (1.042%), 2 pgs degraded (PG_DEGRADED) 2024-08-01T07:00:05.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:05 smithi089 ceph-mon[82218]: Health check failed: Degraded data redundancy: 3/288 objects degraded (1.042%), 2 pgs degraded (PG_DEGRADED) 2024-08-01T07:00:05.896 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:05 smithi016 systemd[1]: Starting Ceph osd.1 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T07:00:05.896 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:05 smithi016 podman[107368]: 2024-08-01 07:00:05.662915109 +0000 UTC m=+0.018112695 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:00:05.897 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:05 smithi016 podman[107368]: 2024-08-01 07:00:05.77091557 +0000 UTC m=+0.126113165 container create 5bd069ac716149ed6766e2085535dc4873f2874376814857d351b2f044a84d56 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-activate, RELEASE=squid-f9911e1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-01T07:00:06.149 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 podman[107368]: 2024-08-01 07:00:06.007487018 +0000 UTC m=+0.362684610 container init 5bd069ac716149ed6766e2085535dc4873f2874376814857d351b2f044a84d56 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-f9911e1) 2024-08-01T07:00:06.149 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 podman[107368]: 2024-08-01 07:00:06.0113773 +0000 UTC m=+0.366574894 container start 5bd069ac716149ed6766e2085535dc4873f2874376814857d351b2f044a84d56 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-f9911e1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-01T07:00:06.149 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 podman[107368]: 2024-08-01 07:00:06.098776115 +0000 UTC m=+0.453973719 container attach 5bd069ac716149ed6766e2085535dc4873f2874376814857d351b2f044a84d56 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, RELEASE=squid-f9911e1, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0) 2024-08-01T07:00:06.149 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-activate[107383]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:00:06.149 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 bash[107368]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:00:06.478 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-activate[107383]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:00:06.478 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 bash[107368]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:00:06.478 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-activate[107383]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-01T07:00:06.478 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 bash[107368]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-01T07:00:06.478 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-activate[107383]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-08-01T07:00:06.478 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 bash[107368]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-08-01T07:00:06.478 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-activate[107383]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-08-01T07:00:06.478 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 bash[107368]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-08-01T07:00:06.478 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-activate[107383]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-08-01T07:00:06.478 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 bash[107368]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-08-01T07:00:06.478 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-activate[107383]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-08-01T07:00:06.478 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 bash[107368]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-08-01T07:00:06.479 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-activate[107383]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-01T07:00:06.479 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 bash[107368]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-01T07:00:06.479 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-activate[107383]: --> ceph-volume raw activate successful for osd ID: 1 2024-08-01T07:00:06.479 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 bash[107368]: --> ceph-volume raw activate successful for osd ID: 1 2024-08-01T07:00:06.479 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:06 smithi016 podman[107368]: 2024-08-01 07:00:06.404793673 +0000 UTC m=+0.759991260 container died 5bd069ac716149ed6766e2085535dc4873f2874376814857d351b2f044a84d56 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-f9911e1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-08-01T07:00:06.770 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:06 smithi016 ceph-mon[93645]: pgmap v64: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 3/288 objects degraded (1.042%) 2024-08-01T07:00:06.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:06 smithi089 ceph-mon[82218]: pgmap v64: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 3/288 objects degraded (1.042%) 2024-08-01T07:00:07.148 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:07 smithi016 podman[107525]: 2024-08-01 07:00:07.019357315 +0000 UTC m=+0.608746886 container remove 5bd069ac716149ed6766e2085535dc4873f2874376814857d351b2f044a84d56 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-f9911e1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.build-date=20240724) 2024-08-01T07:00:07.499 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:07 smithi016 podman[107588]: 2024-08-01 07:00:07.145848412 +0000 UTC m=+0.018300205 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:00:07.499 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:07 smithi016 podman[107588]: 2024-08-01 07:00:07.262275913 +0000 UTC m=+0.134727748 container create fc2f7117be303477779000e706315ce62d8cdef35c11716db163182a12f8d8d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f9911e1, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-01T07:00:07.898 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:07 smithi016 podman[107588]: 2024-08-01 07:00:07.498281926 +0000 UTC m=+0.370733699 container init fc2f7117be303477779000e706315ce62d8cdef35c11716db163182a12f8d8d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-f9911e1, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-01T07:00:07.898 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:07 smithi016 podman[107588]: 2024-08-01 07:00:07.501658221 +0000 UTC m=+0.374109996 container start fc2f7117be303477779000e706315ce62d8cdef35c11716db163182a12f8d8d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-f9911e1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-08-01T07:00:07.899 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:07 smithi016 ceph-osd[107606]: -- 172.21.15.16:0/1422345701 <== mon.0 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559a46d321e0 con 0x559a46cca000 2024-08-01T07:00:07.899 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:07 smithi016 bash[107588]: fc2f7117be303477779000e706315ce62d8cdef35c11716db163182a12f8d8d1 2024-08-01T07:00:07.899 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:07 smithi016 systemd[1]: Started Ceph osd.1 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T07:00:08.398 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:08 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1[107602]: 2024-08-01T07:00:08.045+0000 7f0841aa7640 -1 Falling back to public interface 2024-08-01T07:00:08.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:08 smithi016 ceph-mon[93645]: pgmap v65: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3/288 objects degraded (1.042%) 2024-08-01T07:00:08.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:08 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:08.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:08 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:08.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:08 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:00:09.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:08 smithi089 ceph-mon[82218]: pgmap v65: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3/288 objects degraded (1.042%) 2024-08-01T07:00:09.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:08 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:09.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:08 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:09.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:08 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:00:09.982 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:09 smithi016 ceph-mon[93645]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 8 pgs peering) 2024-08-01T07:00:10.039 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:09 smithi089 ceph-mon[82218]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 8 pgs peering) 2024-08-01T07:00:10.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:10 smithi016 ceph-mon[93645]: pgmap v66: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/288 objects degraded (14.236%) 2024-08-01T07:00:10.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:10 smithi016 ceph-mon[93645]: Health check update: Degraded data redundancy: 41/288 objects degraded (14.236%), 15 pgs degraded (PG_DEGRADED) 2024-08-01T07:00:11.058 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:10 smithi089 ceph-mon[82218]: pgmap v66: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/288 objects degraded (14.236%) 2024-08-01T07:00:11.059 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:10 smithi089 ceph-mon[82218]: Health check update: Degraded data redundancy: 41/288 objects degraded (14.236%), 15 pgs degraded (PG_DEGRADED) 2024-08-01T07:00:12.979 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:12 smithi089 ceph-mon[82218]: pgmap v67: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/288 objects degraded (14.236%) 2024-08-01T07:00:13.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:12 smithi016 ceph-mon[93645]: pgmap v67: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/288 objects degraded (14.236%) 2024-08-01T07:00:13.648 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:13 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1[107602]: 2024-08-01T07:00:13.152+0000 7f0841aa7640 -1 osd.1 54 log_to_monitors true 2024-08-01T07:00:14.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:13 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:14.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:13 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:14.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:13 smithi089 ceph-mon[82218]: from='osd.1 [v2:172.21.15.16:6810/2406839915,v1:172.21.15.16:6811/2406839915]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-01T07:00:14.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:13 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:14.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:13 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:14.148 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:00:13 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1[107602]: 2024-08-01T07:00:13.844+0000 7f0839841640 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-01T07:00:14.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:13 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:14.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:13 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:14.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:13 smithi016 ceph-mon[93645]: from='osd.1 [v2:172.21.15.16:6810/2406839915,v1:172.21.15.16:6811/2406839915]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-01T07:00:14.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:13 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:14.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:13 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:15.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:14 smithi089 ceph-mon[82218]: pgmap v68: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 2 op/s; 41/288 objects degraded (14.236%) 2024-08-01T07:00:15.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:14 smithi089 ceph-mon[82218]: from='osd.1 [v2:172.21.15.16:6810/2406839915,v1:172.21.15.16:6811/2406839915]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-01T07:00:15.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:14 smithi089 ceph-mon[82218]: osdmap e57: 6 total, 5 up, 6 in 2024-08-01T07:00:15.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:14 smithi089 ceph-mon[82218]: from='osd.1 [v2:172.21.15.16:6810/2406839915,v1:172.21.15.16:6811/2406839915]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-08-01T07:00:15.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:14 smithi016 ceph-mon[93645]: pgmap v68: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 2 op/s; 41/288 objects degraded (14.236%) 2024-08-01T07:00:15.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:14 smithi016 ceph-mon[93645]: from='osd.1 [v2:172.21.15.16:6810/2406839915,v1:172.21.15.16:6811/2406839915]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-01T07:00:15.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:14 smithi016 ceph-mon[93645]: osdmap e57: 6 total, 5 up, 6 in 2024-08-01T07:00:15.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:14 smithi016 ceph-mon[93645]: from='osd.1 [v2:172.21.15.16:6810/2406839915,v1:172.21.15.16:6811/2406839915]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-08-01T07:00:16.096 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:15 smithi016 ceph-mon[93645]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-01T07:00:16.096 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:15 smithi016 ceph-mon[93645]: osd.1 [v2:172.21.15.16:6810/2406839915,v1:172.21.15.16:6811/2406839915] boot 2024-08-01T07:00:16.096 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:15 smithi016 ceph-mon[93645]: osdmap e58: 6 total, 6 up, 6 in 2024-08-01T07:00:16.097 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:15 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-01T07:00:16.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:15 smithi089 ceph-mon[82218]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-01T07:00:16.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:15 smithi089 ceph-mon[82218]: osd.1 [v2:172.21.15.16:6810/2406839915,v1:172.21.15.16:6811/2406839915] boot 2024-08-01T07:00:16.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:15 smithi089 ceph-mon[82218]: osdmap e58: 6 total, 6 up, 6 in 2024-08-01T07:00:16.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:15 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-01T07:00:16.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.140+0000 7faf125c7640 1 -- 172.21.15.16:0/3404130436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf0c0ffca0 msgr2=0x7faf0c100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:16.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.140+0000 7faf125c7640 1 --2- 172.21.15.16:0/3404130436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf0c0ffca0 0x7faf0c100120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faf00009880 tx=0x7faf0002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.140+0000 7faf125c7640 1 -- 172.21.15.16:0/3404130436 shutdown_connections 2024-08-01T07:00:16.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.140+0000 7faf125c7640 1 --2- 172.21.15.16:0/3404130436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf0c0ffca0 0x7faf0c100120 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.140+0000 7faf125c7640 1 --2- 172.21.15.16:0/3404130436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0c0feaa0 0x7faf0c0feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.140+0000 7faf125c7640 1 -- 172.21.15.16:0/3404130436 >> 172.21.15.16:0/3404130436 conn(0x7faf0c0fa230 msgr2=0x7faf0c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:16.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.140+0000 7faf125c7640 1 -- 172.21.15.16:0/3404130436 shutdown_connections 2024-08-01T07:00:16.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.140+0000 7faf125c7640 1 -- 172.21.15.16:0/3404130436 wait complete. 2024-08-01T07:00:16.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.141+0000 7faf125c7640 1 Processor -- start 2024-08-01T07:00:16.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.141+0000 7faf125c7640 1 -- start start 2024-08-01T07:00:16.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.141+0000 7faf125c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0c0feaa0 0x7faf0c195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:16.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.141+0000 7faf125c7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf0c0ffca0 0x7faf0c195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:16.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.141+0000 7faf125c7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c196180 con 0x7faf0c0ffca0 2024-08-01T07:00:16.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.141+0000 7faf125c7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c1962f0 con 0x7faf0c0feaa0 2024-08-01T07:00:16.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.141+0000 7faf0b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf0c0ffca0 0x7faf0c195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:16.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.141+0000 7faf0b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf0c0ffca0 0x7faf0c195bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41298/0 (socket says 172.21.15.16:41298) 2024-08-01T07:00:16.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.141+0000 7faf0b7fe640 1 -- 172.21.15.16:0/2548836664 learned_addr learned my addr 172.21.15.16:0/2548836664 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:00:16.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.142+0000 7faf0bfff640 1 --2- 172.21.15.16:0/2548836664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0c0feaa0 0x7faf0c195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:16.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.142+0000 7faf0b7fe640 1 -- 172.21.15.16:0/2548836664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0c0feaa0 msgr2=0x7faf0c195670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:16.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.142+0000 7faf0b7fe640 1 --2- 172.21.15.16:0/2548836664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0c0feaa0 0x7faf0c195670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.142+0000 7faf0b7fe640 1 -- 172.21.15.16:0/2548836664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf00009560 con 0x7faf0c0ffca0 2024-08-01T07:00:16.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.142+0000 7faf0b7fe640 1 --2- 172.21.15.16:0/2548836664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf0c0ffca0 0x7faf0c195bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faf00006010 tx=0x7faf000055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:16.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.142+0000 7faf097fa640 1 -- 172.21.15.16:0/2548836664 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf00004aa0 con 0x7faf0c0ffca0 2024-08-01T07:00:16.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.142+0000 7faf125c7640 1 -- 172.21.15.16:0/2548836664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0c19ad30 con 0x7faf0c0ffca0 2024-08-01T07:00:16.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.142+0000 7faf097fa640 1 -- 172.21.15.16:0/2548836664 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf00004c00 con 0x7faf0c0ffca0 2024-08-01T07:00:16.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.142+0000 7faf097fa640 1 -- 172.21.15.16:0/2548836664 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf00003a80 con 0x7faf0c0ffca0 2024-08-01T07:00:16.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.142+0000 7faf125c7640 1 -- 172.21.15.16:0/2548836664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0c19b2a0 con 0x7faf0c0ffca0 2024-08-01T07:00:16.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.143+0000 7faf125c7640 1 -- 172.21.15.16:0/2548836664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0c107690 con 0x7faf0c0ffca0 2024-08-01T07:00:16.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.144+0000 7faf097fa640 1 -- 172.21.15.16:0/2548836664 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7faf00003cf0 con 0x7faf0c0ffca0 2024-08-01T07:00:16.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.144+0000 7faf097fa640 1 --2- 172.21.15.16:0/2548836664 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7faef406e180 0x7faef4070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:16.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.145+0000 7faf097fa640 1 -- 172.21.15.16:0/2548836664 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7faf000af2e0 con 0x7faf0c0ffca0 2024-08-01T07:00:16.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.145+0000 7faf0bfff640 1 --2- 172.21.15.16:0/2548836664 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7faef406e180 0x7faef4070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:16.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.145+0000 7faf0bfff640 1 --2- 172.21.15.16:0/2548836664 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7faef406e180 0x7faef4070640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0ffb00 tx=0x7faefc00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:16.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.149+0000 7faf097fa640 1 -- 172.21.15.16:0/2548836664 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7faf000786c0 con 0x7faf0c0ffca0 2024-08-01T07:00:16.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.343+0000 7faf125c7640 1 -- 172.21.15.16:0/2548836664 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faf0c19b490 con 0x7faef406e180 2024-08-01T07:00:16.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.344+0000 7faf097fa640 1 -- 172.21.15.16:0/2548836664 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7faf0c19b490 con 0x7faef406e180 2024-08-01T07:00:16.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.346+0000 7faf125c7640 1 -- 172.21.15.16:0/2548836664 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7faef406e180 msgr2=0x7faef4070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:16.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.346+0000 7faf125c7640 1 --2- 172.21.15.16:0/2548836664 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7faef406e180 0x7faef4070640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0ffb00 tx=0x7faefc00b390 comp rx=0 tx=0).stop 2024-08-01T07:00:16.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.346+0000 7faf125c7640 1 -- 172.21.15.16:0/2548836664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf0c0ffca0 msgr2=0x7faf0c195bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:16.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.346+0000 7faf125c7640 1 --2- 172.21.15.16:0/2548836664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf0c0ffca0 0x7faf0c195bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faf00006010 tx=0x7faf000055a0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.346+0000 7faf125c7640 1 -- 172.21.15.16:0/2548836664 shutdown_connections 2024-08-01T07:00:16.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.346+0000 7faf125c7640 1 --2- 172.21.15.16:0/2548836664 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7faef406e180 0x7faef4070640 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.346+0000 7faf125c7640 1 --2- 172.21.15.16:0/2548836664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf0c0ffca0 0x7faf0c195bb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.346+0000 7faf125c7640 1 --2- 172.21.15.16:0/2548836664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf0c0feaa0 0x7faf0c195670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.346+0000 7faf125c7640 1 -- 172.21.15.16:0/2548836664 >> 172.21.15.16:0/2548836664 conn(0x7faf0c0fa230 msgr2=0x7faf0c0684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:16.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.346+0000 7faf125c7640 1 -- 172.21.15.16:0/2548836664 shutdown_connections 2024-08-01T07:00:16.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.346+0000 7faf125c7640 1 -- 172.21.15.16:0/2548836664 wait complete. 2024-08-01T07:00:16.356 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T07:00:16.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.431+0000 7f205a6b0640 1 -- 172.21.15.16:0/2490381031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20540ffb90 msgr2=0x7f20540fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:16.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.431+0000 7f205a6b0640 1 --2- 172.21.15.16:0/2490381031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20540ffb90 0x7f20540fff90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2044009880 tx=0x7f204402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.431+0000 7f205a6b0640 1 -- 172.21.15.16:0/2490381031 shutdown_connections 2024-08-01T07:00:16.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.431+0000 7f205a6b0640 1 --2- 172.21.15.16:0/2490381031 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2054100d90 0x7f2054101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.431+0000 7f205a6b0640 1 --2- 172.21.15.16:0/2490381031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20540ffb90 0x7f20540fff90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.431+0000 7f205a6b0640 1 -- 172.21.15.16:0/2490381031 >> 172.21.15.16:0/2490381031 conn(0x7f20540fb360 msgr2=0x7f20540fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:16.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.431+0000 7f205a6b0640 1 -- 172.21.15.16:0/2490381031 shutdown_connections 2024-08-01T07:00:16.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.431+0000 7f205a6b0640 1 -- 172.21.15.16:0/2490381031 wait complete. 2024-08-01T07:00:16.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.431+0000 7f205a6b0640 1 Processor -- start 2024-08-01T07:00:16.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.431+0000 7f205a6b0640 1 -- start start 2024-08-01T07:00:16.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.432+0000 7f205a6b0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20540ffb90 0x7f2054197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:16.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.432+0000 7f205a6b0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2054100d90 0x7f2054197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:16.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.432+0000 7f205a6b0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2054198350 con 0x7f20540ffb90 2024-08-01T07:00:16.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.432+0000 7f205a6b0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20541984c0 con 0x7f2054100d90 2024-08-01T07:00:16.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.432+0000 7f2053fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20540ffb90 0x7f2054197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:16.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.432+0000 7f2053fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20540ffb90 0x7f2054197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41308/0 (socket says 172.21.15.16:41308) 2024-08-01T07:00:16.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.432+0000 7f2053fff640 1 -- 172.21.15.16:0/3830084547 learned_addr learned my addr 172.21.15.16:0/3830084547 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:00:16.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.432+0000 7f20537fe640 1 --2- 172.21.15.16:0/3830084547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2054100d90 0x7f2054197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:16.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.432+0000 7f2053fff640 1 -- 172.21.15.16:0/3830084547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2054100d90 msgr2=0x7f2054197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:16.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.432+0000 7f2053fff640 1 --2- 172.21.15.16:0/3830084547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2054100d90 0x7f2054197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.432+0000 7f2053fff640 1 -- 172.21.15.16:0/3830084547 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2044009560 con 0x7f20540ffb90 2024-08-01T07:00:16.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.432+0000 7f2053fff640 1 --2- 172.21.15.16:0/3830084547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20540ffb90 0x7f2054197840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2044005610 tx=0x7f2044005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:16.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.433+0000 7f20517fa640 1 -- 172.21.15.16:0/3830084547 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2044004ba0 con 0x7f20540ffb90 2024-08-01T07:00:16.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.433+0000 7f20517fa640 1 -- 172.21.15.16:0/3830084547 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2044004d00 con 0x7f20540ffb90 2024-08-01T07:00:16.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.433+0000 7f205a6b0640 1 -- 172.21.15.16:0/3830084547 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f205419cf00 con 0x7f20540ffb90 2024-08-01T07:00:16.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.433+0000 7f20517fa640 1 -- 172.21.15.16:0/3830084547 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2044003bd0 con 0x7f20540ffb90 2024-08-01T07:00:16.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.433+0000 7f205a6b0640 1 -- 172.21.15.16:0/3830084547 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f205419d3f0 con 0x7f20540ffb90 2024-08-01T07:00:16.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.434+0000 7f205a6b0640 1 -- 172.21.15.16:0/3830084547 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20541056d0 con 0x7f20540ffb90 2024-08-01T07:00:16.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.434+0000 7f20517fa640 1 -- 172.21.15.16:0/3830084547 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2044031640 con 0x7f20540ffb90 2024-08-01T07:00:16.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.435+0000 7f20517fa640 1 --2- 172.21.15.16:0/3830084547 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f203c06e170 0x7f203c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:16.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.435+0000 7f20537fe640 1 --2- 172.21.15.16:0/3830084547 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f203c06e170 0x7f203c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:16.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.435+0000 7f20517fa640 1 -- 172.21.15.16:0/3830084547 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f20440af3e0 con 0x7f20540ffb90 2024-08-01T07:00:16.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.436+0000 7f20537fe640 1 --2- 172.21.15.16:0/3830084547 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f203c06e170 0x7f203c070630 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2054198d60 tx=0x7f204800a250 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:16.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.439+0000 7f20517fa640 1 -- 172.21.15.16:0/3830084547 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f20440787c0 con 0x7f20540ffb90 2024-08-01T07:00:16.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.634+0000 7f205a6b0640 1 -- 172.21.15.16:0/3830084547 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f205402c4f0 con 0x7f203c06e170 2024-08-01T07:00:16.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.635+0000 7f20517fa640 1 -- 172.21.15.16:0/3830084547 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f205402c4f0 con 0x7f203c06e170 2024-08-01T07:00:16.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.637+0000 7f205a6b0640 1 -- 172.21.15.16:0/3830084547 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f203c06e170 msgr2=0x7f203c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:16.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.637+0000 7f205a6b0640 1 --2- 172.21.15.16:0/3830084547 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f203c06e170 0x7f203c070630 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2054198d60 tx=0x7f204800a250 comp rx=0 tx=0).stop 2024-08-01T07:00:16.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.637+0000 7f205a6b0640 1 -- 172.21.15.16:0/3830084547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20540ffb90 msgr2=0x7f2054197840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:16.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.637+0000 7f205a6b0640 1 --2- 172.21.15.16:0/3830084547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20540ffb90 0x7f2054197840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2044005610 tx=0x7f2044005640 comp rx=0 tx=0).stop 2024-08-01T07:00:16.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.637+0000 7f205a6b0640 1 -- 172.21.15.16:0/3830084547 shutdown_connections 2024-08-01T07:00:16.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.637+0000 7f205a6b0640 1 --2- 172.21.15.16:0/3830084547 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f203c06e170 0x7f203c070630 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.637+0000 7f205a6b0640 1 --2- 172.21.15.16:0/3830084547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2054100d90 0x7f2054197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.637+0000 7f205a6b0640 1 --2- 172.21.15.16:0/3830084547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20540ffb90 0x7f2054197840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.637+0000 7f205a6b0640 1 -- 172.21.15.16:0/3830084547 >> 172.21.15.16:0/3830084547 conn(0x7f20540fb360 msgr2=0x7f2054072b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:16.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.637+0000 7f205a6b0640 1 -- 172.21.15.16:0/3830084547 shutdown_connections 2024-08-01T07:00:16.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.637+0000 7f205a6b0640 1 -- 172.21.15.16:0/3830084547 wait complete. 2024-08-01T07:00:16.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.724+0000 7f2ad80c4640 1 -- 172.21.15.16:0/2577351268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ad0103070 msgr2=0x7f2ad0105460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:16.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.724+0000 7f2ad80c4640 1 --2- 172.21.15.16:0/2577351268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ad0103070 0x7f2ad0105460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009880 tx=0x7f2ac002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.725+0000 7f2ad80c4640 1 -- 172.21.15.16:0/2577351268 shutdown_connections 2024-08-01T07:00:16.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.725+0000 7f2ad80c4640 1 --2- 172.21.15.16:0/2577351268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ad0103070 0x7f2ad0105460 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.725+0000 7f2ad80c4640 1 --2- 172.21.15.16:0/2577351268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ad0100740 0x7f2ad0102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.725+0000 7f2ad80c4640 1 -- 172.21.15.16:0/2577351268 >> 172.21.15.16:0/2577351268 conn(0x7f2ad00fa280 msgr2=0x7f2ad00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:16.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.725+0000 7f2ad80c4640 1 -- 172.21.15.16:0/2577351268 shutdown_connections 2024-08-01T07:00:16.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.725+0000 7f2ad80c4640 1 -- 172.21.15.16:0/2577351268 wait complete. 2024-08-01T07:00:16.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.725+0000 7f2ad80c4640 1 Processor -- start 2024-08-01T07:00:16.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.726+0000 7f2ad80c4640 1 -- start start 2024-08-01T07:00:16.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.726+0000 7f2ad80c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ad0100740 0x7f2ad0195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:16.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.726+0000 7f2ad80c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ad0103070 0x7f2ad0195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:16.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.726+0000 7f2ad80c4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad01961a0 con 0x7f2ad0103070 2024-08-01T07:00:16.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.726+0000 7f2ad80c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad0196310 con 0x7f2ad0100740 2024-08-01T07:00:16.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.726+0000 7f2ad565f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ad0103070 0x7f2ad0195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:16.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.726+0000 7f2ad5e60640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ad0100740 0x7f2ad0195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:16.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.726+0000 7f2ad565f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ad0103070 0x7f2ad0195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41328/0 (socket says 172.21.15.16:41328) 2024-08-01T07:00:16.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.726+0000 7f2ad565f640 1 -- 172.21.15.16:0/3361754675 learned_addr learned my addr 172.21.15.16:0/3361754675 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:00:16.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.726+0000 7f2ad565f640 1 -- 172.21.15.16:0/3361754675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ad0100740 msgr2=0x7f2ad0195690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:16.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.726+0000 7f2ad565f640 1 --2- 172.21.15.16:0/3361754675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ad0100740 0x7f2ad0195690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.726+0000 7f2ad565f640 1 -- 172.21.15.16:0/3361754675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac0009560 con 0x7f2ad0103070 2024-08-01T07:00:16.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.726+0000 7f2ad5e60640 1 --2- 172.21.15.16:0/3361754675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ad0100740 0x7f2ad0195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T07:00:16.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.727+0000 7f2ad565f640 1 --2- 172.21.15.16:0/3361754675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ad0103070 0x7f2ad0195bd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0032bb0 tx=0x7f2ac0032be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:16.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.727+0000 7f2ac6ffd640 1 -- 172.21.15.16:0/3361754675 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ac0005d50 con 0x7f2ad0103070 2024-08-01T07:00:16.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.727+0000 7f2ac6ffd640 1 -- 172.21.15.16:0/3361754675 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ac00046c0 con 0x7f2ad0103070 2024-08-01T07:00:16.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.727+0000 7f2ad80c4640 1 -- 172.21.15.16:0/3361754675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad019ad50 con 0x7f2ad0103070 2024-08-01T07:00:16.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.727+0000 7f2ac6ffd640 1 -- 172.21.15.16:0/3361754675 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ac0003a50 con 0x7f2ad0103070 2024-08-01T07:00:16.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.727+0000 7f2ad80c4640 1 -- 172.21.15.16:0/3361754675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad019b240 con 0x7f2ad0103070 2024-08-01T07:00:16.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.728+0000 7f2ad80c4640 1 -- 172.21.15.16:0/3361754675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad01087e0 con 0x7f2ad0103070 2024-08-01T07:00:16.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.729+0000 7f2ac6ffd640 1 -- 172.21.15.16:0/3361754675 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2ac0003c60 con 0x7f2ad0103070 2024-08-01T07:00:16.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.730+0000 7f2ac6ffd640 1 --2- 172.21.15.16:0/3361754675 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f2abc06e170 0x7f2abc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:16.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.730+0000 7f2ac6ffd640 1 -- 172.21.15.16:0/3361754675 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2ac00aece0 con 0x7f2ad0103070 2024-08-01T07:00:16.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.730+0000 7f2ad5e60640 1 --2- 172.21.15.16:0/3361754675 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f2abc06e170 0x7f2abc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:16.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.730+0000 7f2ad5e60640 1 --2- 172.21.15.16:0/3361754675 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f2abc06e170 0x7f2abc070630 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009fc0 tx=0x7f2acc005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:16.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.734+0000 7f2ac6ffd640 1 -- 172.21.15.16:0/3361754675 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2ac0078140 con 0x7f2ad0103070 2024-08-01T07:00:16.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:16 smithi016 ceph-mon[93645]: pgmap v71: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 41/288 objects degraded (14.236%) 2024-08-01T07:00:16.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:16 smithi016 ceph-mon[93645]: osdmap e59: 6 total, 6 up, 6 in 2024-08-01T07:00:16.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:16 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:16.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:16 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:16.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:16 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:00:16.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:16 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:00:16.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:16 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:16.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.947+0000 7f2ad80c4640 1 -- 172.21.15.16:0/3361754675 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ad0103a70 con 0x7f2abc06e170 2024-08-01T07:00:16.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.957+0000 7f2ac6ffd640 1 -- 172.21.15.16:0/3361754675 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f2ad0103a70 con 0x7f2abc06e170 2024-08-01T07:00:16.959 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T07:00:16.959 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (10m) 4s ago 12m 25.2M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T07:00:16.959 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (12m) 4s ago 12m 8879k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T07:00:16.959 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (11m) 60s ago 11m 8098k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T07:00:16.959 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (68s) 4s ago 12m 6899k - 19.1.0-1223-gf9911e17 93d93c74a2cc 2a96028287a2 2024-08-01T07:00:16.959 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (63s) 60s ago 11m 6895k - 19.1.0-1223-gf9911e17 93d93c74a2cc 8a23341bd6c3 2024-08-01T07:00:16.959 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (10m) 4s ago 12m 84.5M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T07:00:16.960 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (6m) 4s ago 6m 89.4M - 18.2.2-1767-ga3bbd728 d280790d1980 96e46c28d16c 2024-08-01T07:00:16.960 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (6m) 4s ago 6m 147M - 18.2.2-1767-ga3bbd728 d280790d1980 4bbe1a388689 2024-08-01T07:00:16.960 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (6m) 60s ago 6m 27.1M - 18.2.2-1767-ga3bbd728 d280790d1980 65ca121a6fbb 2024-08-01T07:00:16.960 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (6m) 60s ago 6m 25.6M - 18.2.2-1767-ga3bbd728 d280790d1980 05bb46c6fe94 2024-08-01T07:00:16.960 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:8443,9283,8765 running (3m) 4s ago 13m 499M - 19.1.0-1223-gf9911e17 93d93c74a2cc 8701e6315593 2024-08-01T07:00:16.960 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (2m) 60s ago 11m 438M - 19.1.0-1223-gf9911e17 93d93c74a2cc c6caa21f436f 2024-08-01T07:00:16.960 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (2m) 4s ago 13m 46.9M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc 48e94d076e6f 2024-08-01T07:00:16.960 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (107s) 60s ago 11m 33.1M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc c4b83b46ff15 2024-08-01T07:00:16.960 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (12m) 4s ago 12m 16.1M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T07:00:16.960 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (11m) 60s ago 11m 16.3M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T07:00:16.961 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (44s) 4s ago 10m 90.1M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 4c2115ae6222 2024-08-01T07:00:16.961 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (9s) 4s ago 10m 11.1M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc fc2f7117be30 2024-08-01T07:00:16.961 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (9m) 4s ago 9m 227M 1217M 18.2.2-1767-ga3bbd728 d280790d1980 33a72e1a5c91 2024-08-01T07:00:16.961 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (9m) 60s ago 9m 277M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 58c175e0f4eb 2024-08-01T07:00:16.961 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (8m) 60s ago 8m 260M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 15b8f910bad7 2024-08-01T07:00:16.961 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (8m) 60s ago 8m 236M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 ac887841899e 2024-08-01T07:00:16.961 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (2m) 4s ago 11m 56.1M - 2.43.0 a07b618ecd1d 45d23c96382e 2024-08-01T07:00:16.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.959+0000 7f2ad80c4640 1 -- 172.21.15.16:0/3361754675 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f2abc06e170 msgr2=0x7f2abc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:16.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.959+0000 7f2ad80c4640 1 --2- 172.21.15.16:0/3361754675 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f2abc06e170 0x7f2abc070630 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009fc0 tx=0x7f2acc005f90 comp rx=0 tx=0).stop 2024-08-01T07:00:16.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.959+0000 7f2ad80c4640 1 -- 172.21.15.16:0/3361754675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ad0103070 msgr2=0x7f2ad0195bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:16.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.959+0000 7f2ad80c4640 1 --2- 172.21.15.16:0/3361754675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ad0103070 0x7f2ad0195bd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0032bb0 tx=0x7f2ac0032be0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.960+0000 7f2ad80c4640 1 -- 172.21.15.16:0/3361754675 shutdown_connections 2024-08-01T07:00:16.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.960+0000 7f2ad80c4640 1 --2- 172.21.15.16:0/3361754675 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f2abc06e170 0x7f2abc070630 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.960+0000 7f2ad80c4640 1 --2- 172.21.15.16:0/3361754675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ad0103070 0x7f2ad0195bd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.960+0000 7f2ad80c4640 1 --2- 172.21.15.16:0/3361754675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ad0100740 0x7f2ad0195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:16.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.960+0000 7f2ad80c4640 1 -- 172.21.15.16:0/3361754675 >> 172.21.15.16:0/3361754675 conn(0x7f2ad00fa280 msgr2=0x7f2ad00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:16.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.960+0000 7f2ad80c4640 1 -- 172.21.15.16:0/3361754675 shutdown_connections 2024-08-01T07:00:16.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:16.960+0000 7f2ad80c4640 1 -- 172.21.15.16:0/3361754675 wait complete. 2024-08-01T07:00:17.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.042+0000 7f50d287d640 1 -- 172.21.15.16:0/155912192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50cc100d90 msgr2=0x7f50cc101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:17.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.042+0000 7f50d287d640 1 --2- 172.21.15.16:0/155912192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50cc100d90 0x7f50cc101210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009880 tx=0x7f50c002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.042+0000 7f50d287d640 1 -- 172.21.15.16:0/155912192 shutdown_connections 2024-08-01T07:00:17.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.042+0000 7f50d287d640 1 --2- 172.21.15.16:0/155912192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50cc100d90 0x7f50cc101210 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.042+0000 7f50d287d640 1 --2- 172.21.15.16:0/155912192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50cc0ffb90 0x7f50cc0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.042+0000 7f50d287d640 1 -- 172.21.15.16:0/155912192 >> 172.21.15.16:0/155912192 conn(0x7f50cc0fb320 msgr2=0x7f50cc0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:17.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.042+0000 7f50d287d640 1 -- 172.21.15.16:0/155912192 shutdown_connections 2024-08-01T07:00:17.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.042+0000 7f50d287d640 1 -- 172.21.15.16:0/155912192 wait complete. 2024-08-01T07:00:17.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.043+0000 7f50d287d640 1 Processor -- start 2024-08-01T07:00:17.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.043+0000 7f50d287d640 1 -- start start 2024-08-01T07:00:17.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.043+0000 7f50d287d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50cc0ffb90 0x7f50cc1955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:17.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.043+0000 7f50d287d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50cc100d90 0x7f50cc195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:17.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.043+0000 7f50d287d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc1960f0 con 0x7f50cc100d90 2024-08-01T07:00:17.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.043+0000 7f50d287d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc196260 con 0x7f50cc0ffb90 2024-08-01T07:00:17.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.044+0000 7f50cb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50cc100d90 0x7f50cc195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:17.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.044+0000 7f50cb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50cc100d90 0x7f50cc195b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41342/0 (socket says 172.21.15.16:41342) 2024-08-01T07:00:17.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.044+0000 7f50cb7fe640 1 -- 172.21.15.16:0/1899968176 learned_addr learned my addr 172.21.15.16:0/1899968176 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:00:17.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.044+0000 7f50cbfff640 1 --2- 172.21.15.16:0/1899968176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50cc0ffb90 0x7f50cc1955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:17.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.044+0000 7f50cb7fe640 1 -- 172.21.15.16:0/1899968176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50cc0ffb90 msgr2=0x7f50cc1955e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:17.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.044+0000 7f50cb7fe640 1 --2- 172.21.15.16:0/1899968176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50cc0ffb90 0x7f50cc1955e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.044+0000 7f50cb7fe640 1 -- 172.21.15.16:0/1899968176 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c0009560 con 0x7f50cc100d90 2024-08-01T07:00:17.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.044+0000 7f50cb7fe640 1 --2- 172.21.15.16:0/1899968176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50cc100d90 0x7f50cc195b20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f50c0005520 tx=0x7f50c0005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:17.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.044+0000 7f50c97fa640 1 -- 172.21.15.16:0/1899968176 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50c0004aa0 con 0x7f50cc100d90 2024-08-01T07:00:17.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.044+0000 7f50c97fa640 1 -- 172.21.15.16:0/1899968176 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f50c0004c00 con 0x7f50cc100d90 2024-08-01T07:00:17.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.044+0000 7f50d287d640 1 -- 172.21.15.16:0/1899968176 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50cc19aca0 con 0x7f50cc100d90 2024-08-01T07:00:17.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.044+0000 7f50c97fa640 1 -- 172.21.15.16:0/1899968176 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50c0003b10 con 0x7f50cc100d90 2024-08-01T07:00:17.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.044+0000 7f50d287d640 1 -- 172.21.15.16:0/1899968176 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50cc19b190 con 0x7f50cc100d90 2024-08-01T07:00:17.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.045+0000 7f50d287d640 1 -- 172.21.15.16:0/1899968176 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50cc108780 con 0x7f50cc100d90 2024-08-01T07:00:17.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.046+0000 7f50c97fa640 1 -- 172.21.15.16:0/1899968176 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f50c0031d20 con 0x7f50cc100d90 2024-08-01T07:00:17.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.046+0000 7f50c97fa640 1 --2- 172.21.15.16:0/1899968176 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f50b406e170 0x7f50b4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:17.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.047+0000 7f50c97fa640 1 -- 172.21.15.16:0/1899968176 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f50c00af260 con 0x7f50cc100d90 2024-08-01T07:00:17.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.047+0000 7f50cbfff640 1 --2- 172.21.15.16:0/1899968176 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f50b406e170 0x7f50b4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:17.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.047+0000 7f50cbfff640 1 --2- 172.21.15.16:0/1899968176 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f50b406e170 0x7f50b4070630 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f50bc005fd0 tx=0x7f50bc00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:17.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.051+0000 7f50c97fa640 1 -- 172.21.15.16:0/1899968176 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f50c0078640 con 0x7f50cc100d90 2024-08-01T07:00:17.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:16 smithi089 ceph-mon[82218]: pgmap v71: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 41/288 objects degraded (14.236%) 2024-08-01T07:00:17.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:16 smithi089 ceph-mon[82218]: osdmap e59: 6 total, 6 up, 6 in 2024-08-01T07:00:17.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:16 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:17.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:16 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:17.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:16 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:00:17.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:16 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:00:17.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:16 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:17.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.295+0000 7f50d287d640 1 -- 172.21.15.16:0/1899968176 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f50cc19b380 con 0x7f50cc100d90 2024-08-01T07:00:17.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.296+0000 7f50c97fa640 1 -- 172.21.15.16:0/1899968176 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+832 (secure 0 0 0) 0x7f50c007bd00 con 0x7f50cc100d90 2024-08-01T07:00:17.298 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:00:17.298 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T07:00:17.298 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:00:17.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:00:17.298 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T07:00:17.298 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:00:17.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:00:17.298 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T07:00:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4, 2024-08-01T07:00:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:00:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:00:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T07:00:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4 2024-08-01T07:00:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:00:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T07:00:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 8, 2024-08-01T07:00:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 6 2024-08-01T07:00:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T07:00:17.299 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:00:17.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.299+0000 7f50d287d640 1 -- 172.21.15.16:0/1899968176 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f50b406e170 msgr2=0x7f50b4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:17.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.299+0000 7f50d287d640 1 --2- 172.21.15.16:0/1899968176 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f50b406e170 0x7f50b4070630 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f50bc005fd0 tx=0x7f50bc00b410 comp rx=0 tx=0).stop 2024-08-01T07:00:17.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.299+0000 7f50d287d640 1 -- 172.21.15.16:0/1899968176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50cc100d90 msgr2=0x7f50cc195b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:17.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.299+0000 7f50d287d640 1 --2- 172.21.15.16:0/1899968176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50cc100d90 0x7f50cc195b20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f50c0005520 tx=0x7f50c0005550 comp rx=0 tx=0).stop 2024-08-01T07:00:17.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.299+0000 7f50d287d640 1 -- 172.21.15.16:0/1899968176 shutdown_connections 2024-08-01T07:00:17.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.299+0000 7f50d287d640 1 --2- 172.21.15.16:0/1899968176 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f50b406e170 0x7f50b4070630 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.299+0000 7f50d287d640 1 --2- 172.21.15.16:0/1899968176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50cc100d90 0x7f50cc195b20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.299+0000 7f50d287d640 1 --2- 172.21.15.16:0/1899968176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50cc0ffb90 0x7f50cc1955e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.299+0000 7f50d287d640 1 -- 172.21.15.16:0/1899968176 >> 172.21.15.16:0/1899968176 conn(0x7f50cc0fb320 msgr2=0x7f50cc0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:17.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.299+0000 7f50d287d640 1 -- 172.21.15.16:0/1899968176 shutdown_connections 2024-08-01T07:00:17.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.299+0000 7f50d287d640 1 -- 172.21.15.16:0/1899968176 wait complete. 2024-08-01T07:00:17.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.384+0000 7f6abf24a640 1 -- 172.21.15.16:0/1543577599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ab80ffcf0 msgr2=0x7f6ab8100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:17.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.384+0000 7f6abf24a640 1 --2- 172.21.15.16:0/1543577599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ab80ffcf0 0x7f6ab8100170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009880 tx=0x7f6aa402c6b0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.384+0000 7f6abf24a640 1 -- 172.21.15.16:0/1543577599 shutdown_connections 2024-08-01T07:00:17.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.384+0000 7f6abf24a640 1 --2- 172.21.15.16:0/1543577599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ab80ffcf0 0x7f6ab8100170 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.384+0000 7f6abf24a640 1 --2- 172.21.15.16:0/1543577599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ab80feaf0 0x7f6ab80feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.384+0000 7f6abf24a640 1 -- 172.21.15.16:0/1543577599 >> 172.21.15.16:0/1543577599 conn(0x7f6ab80fa280 msgr2=0x7f6ab80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:17.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.384+0000 7f6abf24a640 1 -- 172.21.15.16:0/1543577599 shutdown_connections 2024-08-01T07:00:17.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.384+0000 7f6abf24a640 1 -- 172.21.15.16:0/1543577599 wait complete. 2024-08-01T07:00:17.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.385+0000 7f6abf24a640 1 Processor -- start 2024-08-01T07:00:17.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.385+0000 7f6abf24a640 1 -- start start 2024-08-01T07:00:17.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.385+0000 7f6abf24a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ab80feaf0 0x7f6ab8193490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:17.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.385+0000 7f6abf24a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ab80ffcf0 0x7f6ab81939d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:17.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.385+0000 7f6abf24a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab8193fa0 con 0x7f6ab80feaf0 2024-08-01T07:00:17.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.385+0000 7f6abf24a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab8194110 con 0x7f6ab80ffcf0 2024-08-01T07:00:17.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.385+0000 7f6abcfe6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ab80feaf0 0x7f6ab8193490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:17.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.385+0000 7f6abcfe6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ab80feaf0 0x7f6ab8193490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41358/0 (socket says 172.21.15.16:41358) 2024-08-01T07:00:17.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.385+0000 7f6abcfe6640 1 -- 172.21.15.16:0/3632148543 learned_addr learned my addr 172.21.15.16:0/3632148543 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:00:17.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.386+0000 7f6ab7fff640 1 --2- 172.21.15.16:0/3632148543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ab80ffcf0 0x7f6ab81939d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:17.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.386+0000 7f6abcfe6640 1 -- 172.21.15.16:0/3632148543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ab80ffcf0 msgr2=0x7f6ab81939d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:17.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.386+0000 7f6abcfe6640 1 --2- 172.21.15.16:0/3632148543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ab80ffcf0 0x7f6ab81939d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.386+0000 7f6abcfe6640 1 -- 172.21.15.16:0/3632148543 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa4009560 con 0x7f6ab80feaf0 2024-08-01T07:00:17.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.386+0000 7f6abcfe6640 1 --2- 172.21.15.16:0/3632148543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ab80feaf0 0x7f6ab8193490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00e970 tx=0x7f6aac00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:17.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.386+0000 7f6ab5ffb640 1 -- 172.21.15.16:0/3632148543 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aac0096e0 con 0x7f6ab80feaf0 2024-08-01T07:00:17.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.386+0000 7f6abf24a640 1 -- 172.21.15.16:0/3632148543 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab8198bb0 con 0x7f6ab80feaf0 2024-08-01T07:00:17.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.386+0000 7f6ab5ffb640 1 -- 172.21.15.16:0/3632148543 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6aac0044f0 con 0x7f6ab80feaf0 2024-08-01T07:00:17.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.386+0000 7f6ab5ffb640 1 -- 172.21.15.16:0/3632148543 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aac010430 con 0x7f6ab80feaf0 2024-08-01T07:00:17.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.386+0000 7f6abf24a640 1 -- 172.21.15.16:0/3632148543 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab81990d0 con 0x7f6ab80feaf0 2024-08-01T07:00:17.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.388+0000 7f6abf24a640 1 -- 172.21.15.16:0/3632148543 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab80feef0 con 0x7f6ab80feaf0 2024-08-01T07:00:17.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.388+0000 7f6ab5ffb640 1 -- 172.21.15.16:0/3632148543 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6aac00cc90 con 0x7f6ab80feaf0 2024-08-01T07:00:17.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.389+0000 7f6ab5ffb640 1 --2- 172.21.15.16:0/3632148543 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f6aa806e170 0x7f6aa8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:17.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.389+0000 7f6ab5ffb640 1 -- 172.21.15.16:0/3632148543 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f6aac014070 con 0x7f6ab80feaf0 2024-08-01T07:00:17.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.389+0000 7f6ab7fff640 1 --2- 172.21.15.16:0/3632148543 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f6aa806e170 0x7f6aa8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:17.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.389+0000 7f6ab7fff640 1 --2- 172.21.15.16:0/3632148543 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f6aa806e170 0x7f6aa8070630 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4000c00 tx=0x7f6aa40334e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:17.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.393+0000 7f6ab5ffb640 1 -- 172.21.15.16:0/3632148543 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6aac057950 con 0x7f6ab80feaf0 2024-08-01T07:00:17.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.605+0000 7f6abf24a640 1 -- 172.21.15.16:0/3632148543 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6ab802c4e0 con 0x7f6ab80feaf0 2024-08-01T07:00:17.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.605+0000 7f6ab5ffb640 1 -- 172.21.15.16:0/3632148543 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1938 (secure 0 0 0) 0x7f6aac05b010 con 0x7f6ab80feaf0 2024-08-01T07:00:17.607 INFO:teuthology.orchestra.run.smithi016.stdout:e19 2024-08-01T07:00:17.607 INFO:teuthology.orchestra.run.smithi016.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-08-01T07:00:17.607 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T07:00:17.607 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T07:00:17.607 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T07:00:17.607 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:00:17.607 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T07:00:17.608 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T07:00:17.608 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 19 2024-08-01T07:00:17.608 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T07:00:17.608 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T07:00:17.608 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T06:53:32.617145+0000 2024-08-01T07:00:17.608 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T07:00:17.608 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T07:00:17.608 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T07:00:17.608 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T07:00:17.608 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T07:00:17.608 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T07:00:17.608 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T07:00:17.609 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T07:00:17.609 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 46 2024-08-01T07:00:17.609 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T07:00:17.609 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T07:00:17.609 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T07:00:17.609 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=14482,1=24281} 2024-08-01T07:00:17.609 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T07:00:17.609 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T07:00:17.609 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T07:00:17.609 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T07:00:17.609 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T07:00:17.609 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T07:00:17.609 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T07:00:17.609 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T07:00:17.610 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T07:00:17.610 INFO:teuthology.orchestra.run.smithi016.stdout:qdb_cluster leader: 0 members: 2024-08-01T07:00:17.610 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:00:17.610 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:24299} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:00:17.610 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{1:24281} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:00:17.610 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:24291} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:00:17.610 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:00:17.610 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:00:17.611 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-08-01T07:00:17.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.608+0000 7f6abf24a640 1 -- 172.21.15.16:0/3632148543 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f6aa806e170 msgr2=0x7f6aa8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:17.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.608+0000 7f6abf24a640 1 --2- 172.21.15.16:0/3632148543 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f6aa806e170 0x7f6aa8070630 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4000c00 tx=0x7f6aa40334e0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.608+0000 7f6abf24a640 1 -- 172.21.15.16:0/3632148543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ab80feaf0 msgr2=0x7f6ab8193490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:17.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.608+0000 7f6abf24a640 1 --2- 172.21.15.16:0/3632148543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ab80feaf0 0x7f6ab8193490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00e970 tx=0x7f6aac00ee30 comp rx=0 tx=0).stop 2024-08-01T07:00:17.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.609+0000 7f6abf24a640 1 -- 172.21.15.16:0/3632148543 shutdown_connections 2024-08-01T07:00:17.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.609+0000 7f6abf24a640 1 --2- 172.21.15.16:0/3632148543 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f6aa806e170 0x7f6aa8070630 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.609+0000 7f6abf24a640 1 --2- 172.21.15.16:0/3632148543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ab80ffcf0 0x7f6ab81939d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.609+0000 7f6abf24a640 1 --2- 172.21.15.16:0/3632148543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ab80feaf0 0x7f6ab8193490 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.609+0000 7f6abf24a640 1 -- 172.21.15.16:0/3632148543 >> 172.21.15.16:0/3632148543 conn(0x7f6ab80fa280 msgr2=0x7f6ab81033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:17.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.609+0000 7f6abf24a640 1 -- 172.21.15.16:0/3632148543 shutdown_connections 2024-08-01T07:00:17.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.609+0000 7f6abf24a640 1 -- 172.21.15.16:0/3632148543 wait complete. 2024-08-01T07:00:17.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.693+0000 7fc448a3a640 1 -- 172.21.15.16:0/3989244222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4441006d0 msgr2=0x7fc444102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:17.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.693+0000 7fc448a3a640 1 --2- 172.21.15.16:0/3989244222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4441006d0 0x7fc444102ac0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc434009880 tx=0x7fc43402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.693+0000 7fc448a3a640 1 -- 172.21.15.16:0/3989244222 shutdown_connections 2024-08-01T07:00:17.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.693+0000 7fc448a3a640 1 --2- 172.21.15.16:0/3989244222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc444103000 0x7fc4441053f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.693+0000 7fc448a3a640 1 --2- 172.21.15.16:0/3989244222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4441006d0 0x7fc444102ac0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.693+0000 7fc448a3a640 1 -- 172.21.15.16:0/3989244222 >> 172.21.15.16:0/3989244222 conn(0x7fc4440fa250 msgr2=0x7fc4440fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:17.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.693+0000 7fc448a3a640 1 -- 172.21.15.16:0/3989244222 shutdown_connections 2024-08-01T07:00:17.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.693+0000 7fc448a3a640 1 -- 172.21.15.16:0/3989244222 wait complete. 2024-08-01T07:00:17.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.694+0000 7fc448a3a640 1 Processor -- start 2024-08-01T07:00:17.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.694+0000 7fc448a3a640 1 -- start start 2024-08-01T07:00:17.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.694+0000 7fc448a3a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4441006d0 0x7fc444100030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:17.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.694+0000 7fc448a3a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc444103000 0x7fc4440fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:17.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.694+0000 7fc448a3a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440febc0 con 0x7fc4441006d0 2024-08-01T07:00:17.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.694+0000 7fc448a3a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440fed30 con 0x7fc444103000 2024-08-01T07:00:17.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.695+0000 7fc44259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4441006d0 0x7fc444100030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:17.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.695+0000 7fc44259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4441006d0 0x7fc444100030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41374/0 (socket says 172.21.15.16:41374) 2024-08-01T07:00:17.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.695+0000 7fc44259c640 1 -- 172.21.15.16:0/3557442751 learned_addr learned my addr 172.21.15.16:0/3557442751 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:00:17.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.695+0000 7fc441d9b640 1 --2- 172.21.15.16:0/3557442751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc444103000 0x7fc4440fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:17.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.695+0000 7fc44259c640 1 -- 172.21.15.16:0/3557442751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc444103000 msgr2=0x7fc4440fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:17.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.695+0000 7fc44259c640 1 --2- 172.21.15.16:0/3557442751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc444103000 0x7fc4440fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.695+0000 7fc44259c640 1 -- 172.21.15.16:0/3557442751 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc434009560 con 0x7fc4441006d0 2024-08-01T07:00:17.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.695+0000 7fc44259c640 1 --2- 172.21.15.16:0/3557442751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4441006d0 0x7fc444100030 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc434004650 tx=0x7fc4340055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:17.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.695+0000 7fc4337fe640 1 -- 172.21.15.16:0/3557442751 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc434004aa0 con 0x7fc4441006d0 2024-08-01T07:00:17.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.695+0000 7fc4337fe640 1 -- 172.21.15.16:0/3557442751 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc434005d50 con 0x7fc4441006d0 2024-08-01T07:00:17.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.695+0000 7fc448a3a640 1 -- 172.21.15.16:0/3557442751 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4440fefb0 con 0x7fc4441006d0 2024-08-01T07:00:17.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.695+0000 7fc4337fe640 1 -- 172.21.15.16:0/3557442751 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4340039e0 con 0x7fc4441006d0 2024-08-01T07:00:17.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.695+0000 7fc448a3a640 1 -- 172.21.15.16:0/3557442751 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc44419d680 con 0x7fc4441006d0 2024-08-01T07:00:17.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.696+0000 7fc448a3a640 1 -- 172.21.15.16:0/3557442751 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4441087d0 con 0x7fc4441006d0 2024-08-01T07:00:17.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.697+0000 7fc4337fe640 1 -- 172.21.15.16:0/3557442751 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc434031c00 con 0x7fc4441006d0 2024-08-01T07:00:17.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.697+0000 7fc4337fe640 1 --2- 172.21.15.16:0/3557442751 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc42c06e170 0x7fc42c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:17.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.698+0000 7fc4337fe640 1 -- 172.21.15.16:0/3557442751 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fc4340af170 con 0x7fc4441006d0 2024-08-01T07:00:17.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.698+0000 7fc441d9b640 1 --2- 172.21.15.16:0/3557442751 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc42c06e170 0x7fc42c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:17.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.698+0000 7fc441d9b640 1 --2- 172.21.15.16:0/3557442751 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc42c06e170 0x7fc42c070630 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc4440ffdb0 tx=0x7fc438005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:17.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.702+0000 7fc4337fe640 1 -- 172.21.15.16:0/3557442751 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc434078520 con 0x7fc4441006d0 2024-08-01T07:00:17.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.894+0000 7fc448a3a640 1 -- 172.21.15.16:0/3557442751 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4441039a0 con 0x7fc42c06e170 2024-08-01T07:00:17.896 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:17 smithi016 ceph-mon[93645]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:00:17.897 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:17 smithi016 ceph-mon[93645]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:00:17.897 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:00:17.897 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:00:17.897 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:00:17.897 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:00:17.897 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-01T07:00:17.897 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:17 smithi016 ceph-mon[93645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-01T07:00:17.897 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:17 smithi016 ceph-mon[93645]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-08-01T07:00:17.897 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:17 smithi016 ceph-mon[93645]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:00:17.897 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:17.897 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:00:17.897 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:17 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/1899968176' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:00:17.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:17 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/3632148543' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:00:17.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.896+0000 7fc4337fe640 1 -- 172.21.15.16:0/3557442751 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc4441039a0 con 0x7fc42c06e170 2024-08-01T07:00:17.898 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:00:17.898 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T07:00:17.898 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T07:00:17.898 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T07:00:17.899 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-08-01T07:00:17.899 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-08-01T07:00:17.899 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr", 2024-08-01T07:00:17.899 INFO:teuthology.orchestra.run.smithi016.stdout: "crash" 2024-08-01T07:00:17.899 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-08-01T07:00:17.899 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "8/23 daemons upgraded", 2024-08-01T07:00:17.899 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-08-01T07:00:17.899 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T07:00:17.899 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:00:17.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.898+0000 7fc448a3a640 1 -- 172.21.15.16:0/3557442751 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc42c06e170 msgr2=0x7fc42c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:17.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.898+0000 7fc448a3a640 1 --2- 172.21.15.16:0/3557442751 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc42c06e170 0x7fc42c070630 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc4440ffdb0 tx=0x7fc438005f90 comp rx=0 tx=0).stop 2024-08-01T07:00:17.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.898+0000 7fc448a3a640 1 -- 172.21.15.16:0/3557442751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4441006d0 msgr2=0x7fc444100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:17.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.898+0000 7fc448a3a640 1 --2- 172.21.15.16:0/3557442751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4441006d0 0x7fc444100030 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc434004650 tx=0x7fc4340055a0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.898+0000 7fc448a3a640 1 -- 172.21.15.16:0/3557442751 shutdown_connections 2024-08-01T07:00:17.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.898+0000 7fc448a3a640 1 --2- 172.21.15.16:0/3557442751 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc42c06e170 0x7fc42c070630 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.898+0000 7fc448a3a640 1 --2- 172.21.15.16:0/3557442751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc444103000 0x7fc4440fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.898+0000 7fc448a3a640 1 --2- 172.21.15.16:0/3557442751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4441006d0 0x7fc444100030 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.898+0000 7fc448a3a640 1 -- 172.21.15.16:0/3557442751 >> 172.21.15.16:0/3557442751 conn(0x7fc4440fa250 msgr2=0x7fc4440fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:17.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.898+0000 7fc448a3a640 1 -- 172.21.15.16:0/3557442751 shutdown_connections 2024-08-01T07:00:17.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.898+0000 7fc448a3a640 1 -- 172.21.15.16:0/3557442751 wait complete. 2024-08-01T07:00:17.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.981+0000 7f78e64aa640 1 -- 172.21.15.16:0/2679258035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e00feaf0 msgr2=0x7f78e00feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:17.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.981+0000 7f78e64aa640 1 --2- 172.21.15.16:0/2679258035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e00feaf0 0x7f78e00feef0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009880 tx=0x7f78d002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.981+0000 7f78e64aa640 1 -- 172.21.15.16:0/2679258035 shutdown_connections 2024-08-01T07:00:17.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.981+0000 7f78e64aa640 1 --2- 172.21.15.16:0/2679258035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e00ffcf0 0x7f78e0100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.981+0000 7f78e64aa640 1 --2- 172.21.15.16:0/2679258035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e00feaf0 0x7f78e00feef0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.981+0000 7f78e64aa640 1 -- 172.21.15.16:0/2679258035 >> 172.21.15.16:0/2679258035 conn(0x7f78e00fa280 msgr2=0x7f78e00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:17.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.981+0000 7f78e64aa640 1 -- 172.21.15.16:0/2679258035 shutdown_connections 2024-08-01T07:00:17.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.982+0000 7f78e64aa640 1 -- 172.21.15.16:0/2679258035 wait complete. 2024-08-01T07:00:17.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.982+0000 7f78e64aa640 1 Processor -- start 2024-08-01T07:00:17.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.982+0000 7f78e64aa640 1 -- start start 2024-08-01T07:00:17.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.982+0000 7f78e64aa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e00feaf0 0x7f78e0068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:17.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.983+0000 7f78e64aa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e00ffcf0 0x7f78e019c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:17.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.983+0000 7f78e64aa640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e0196230 con 0x7f78e00ffcf0 2024-08-01T07:00:17.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.983+0000 7f78e64aa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e019cd00 con 0x7f78e00feaf0 2024-08-01T07:00:17.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.983+0000 7f78df7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e00ffcf0 0x7f78e019c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:17.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.983+0000 7f78df7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e00ffcf0 0x7f78e019c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41380/0 (socket says 172.21.15.16:41380) 2024-08-01T07:00:17.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.983+0000 7f78df7fe640 1 -- 172.21.15.16:0/2724289104 learned_addr learned my addr 172.21.15.16:0/2724289104 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:00:17.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.983+0000 7f78dffff640 1 --2- 172.21.15.16:0/2724289104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e00feaf0 0x7f78e0068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:17.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.983+0000 7f78df7fe640 1 -- 172.21.15.16:0/2724289104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e00feaf0 msgr2=0x7f78e0068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:17.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.983+0000 7f78df7fe640 1 --2- 172.21.15.16:0/2724289104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e00feaf0 0x7f78e0068790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:17.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.983+0000 7f78df7fe640 1 -- 172.21.15.16:0/2724289104 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d0009560 con 0x7f78e00ffcf0 2024-08-01T07:00:17.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.983+0000 7f78dffff640 1 --2- 172.21.15.16:0/2724289104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e00feaf0 0x7f78e0068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T07:00:17.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.983+0000 7f78df7fe640 1 --2- 172.21.15.16:0/2724289104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e00ffcf0 0x7f78e019c7c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f78d400d8d0 tx=0x7f78d400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:17.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.983+0000 7f78dd7fa640 1 -- 172.21.15.16:0/2724289104 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78d400bea0 con 0x7f78e00ffcf0 2024-08-01T07:00:17.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.983+0000 7f78dd7fa640 1 -- 172.21.15.16:0/2724289104 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f78d4009bf0 con 0x7f78e00ffcf0 2024-08-01T07:00:17.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.983+0000 7f78e64aa640 1 -- 172.21.15.16:0/2724289104 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e019cf90 con 0x7f78e00ffcf0 2024-08-01T07:00:17.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.983+0000 7f78dd7fa640 1 -- 172.21.15.16:0/2724289104 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78d400f710 con 0x7f78e00ffcf0 2024-08-01T07:00:17.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.983+0000 7f78e64aa640 1 -- 172.21.15.16:0/2724289104 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e019d4b0 con 0x7f78e00ffcf0 2024-08-01T07:00:17.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.984+0000 7f78e64aa640 1 -- 172.21.15.16:0/2724289104 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e018e670 con 0x7f78e00ffcf0 2024-08-01T07:00:17.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.985+0000 7f78dd7fa640 1 -- 172.21.15.16:0/2724289104 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f78d4010460 con 0x7f78e00ffcf0 2024-08-01T07:00:17.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.985+0000 7f78dd7fa640 1 --2- 172.21.15.16:0/2724289104 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f78c806e170 0x7f78c8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:17.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.986+0000 7f78dd7fa640 1 -- 172.21.15.16:0/2724289104 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f78d408de50 con 0x7f78e00ffcf0 2024-08-01T07:00:17.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.986+0000 7f78dffff640 1 --2- 172.21.15.16:0/2724289104 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f78c806e170 0x7f78c8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:17.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.986+0000 7f78dffff640 1 --2- 172.21.15.16:0/2724289104 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f78c806e170 0x7f78c8070630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009230 tx=0x7f78d00314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:17.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:17.990+0000 7f78dd7fa640 1 -- 172.21.15.16:0/2724289104 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f78d405ad30 con 0x7f78e00ffcf0 2024-08-01T07:00:18.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:17 smithi089 ceph-mon[82218]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:00:18.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:17 smithi089 ceph-mon[82218]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:00:18.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:00:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:00:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:00:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:00:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-01T07:00:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:17 smithi089 ceph-mon[82218]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-01T07:00:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:17 smithi089 ceph-mon[82218]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-08-01T07:00:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:17 smithi089 ceph-mon[82218]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:00:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:00:18.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:17 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/1899968176' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:00:18.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:17 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/3632148543' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:00:18.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:18.233+0000 7f78e64aa640 1 -- 172.21.15.16:0/2724289104 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f78e002c480 con 0x7f78e00ffcf0 2024-08-01T07:00:18.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:18.234+0000 7f78dd7fa640 1 -- 172.21.15.16:0/2724289104 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1015 (secure 0 0 0) 0x7f78d4020410 con 0x7f78e00ffcf0 2024-08-01T07:00:18.235 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_WARN Degraded data redundancy: 41/288 objects degraded (14.236%), 15 pgs degraded 2024-08-01T07:00:18.235 INFO:teuthology.orchestra.run.smithi016.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 41/288 objects degraded (14.236%), 15 pgs degraded 2024-08-01T07:00:18.235 INFO:teuthology.orchestra.run.smithi016.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-08-01T07:00:18.235 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-08-01T07:00:18.236 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-08-01T07:00:18.236 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-08-01T07:00:18.236 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-08-01T07:00:18.236 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-08-01T07:00:18.236 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-08-01T07:00:18.236 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-08-01T07:00:18.236 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-08-01T07:00:18.236 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-08-01T07:00:18.236 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-08-01T07:00:18.236 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-08-01T07:00:18.236 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-08-01T07:00:18.236 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-08-01T07:00:18.236 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-08-01T07:00:18.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:18.235+0000 7f78e64aa640 1 -- 172.21.15.16:0/2724289104 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f78c806e170 msgr2=0x7f78c8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:18.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:18.236+0000 7f78e64aa640 1 --2- 172.21.15.16:0/2724289104 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f78c806e170 0x7f78c8070630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009230 tx=0x7f78d00314e0 comp rx=0 tx=0).stop 2024-08-01T07:00:18.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:18.236+0000 7f78e64aa640 1 -- 172.21.15.16:0/2724289104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e00ffcf0 msgr2=0x7f78e019c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:18.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:18.236+0000 7f78e64aa640 1 --2- 172.21.15.16:0/2724289104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e00ffcf0 0x7f78e019c7c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f78d400d8d0 tx=0x7f78d400dd90 comp rx=0 tx=0).stop 2024-08-01T07:00:18.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:18.236+0000 7f78e64aa640 1 -- 172.21.15.16:0/2724289104 shutdown_connections 2024-08-01T07:00:18.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:18.236+0000 7f78e64aa640 1 --2- 172.21.15.16:0/2724289104 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f78c806e170 0x7f78c8070630 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:18.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:18.236+0000 7f78e64aa640 1 --2- 172.21.15.16:0/2724289104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78e00ffcf0 0x7f78e019c7c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:18.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:18.236+0000 7f78e64aa640 1 --2- 172.21.15.16:0/2724289104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e00feaf0 0x7f78e0068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:18.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:18.236+0000 7f78e64aa640 1 -- 172.21.15.16:0/2724289104 >> 172.21.15.16:0/2724289104 conn(0x7f78e00fa280 msgr2=0x7f78e0103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:18.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:18.236+0000 7f78e64aa640 1 -- 172.21.15.16:0/2724289104 shutdown_connections 2024-08-01T07:00:18.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:18.236+0000 7f78e64aa640 1 -- 172.21.15.16:0/2724289104 wait complete. 2024-08-01T07:00:19.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:18 smithi089 ceph-mon[82218]: pgmap v73: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 41/288 objects degraded (14.236%) 2024-08-01T07:00:19.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:18 smithi089 ceph-mon[82218]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:00:19.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:18 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2724289104' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:00:19.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:18 smithi016 ceph-mon[93645]: pgmap v73: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 41/288 objects degraded (14.236%) 2024-08-01T07:00:19.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:18 smithi016 ceph-mon[93645]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:00:19.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:18 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2724289104' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:00:20.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:19 smithi016 ceph-mon[93645]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 41/288 objects degraded (14.236%), 15 pgs degraded) 2024-08-01T07:00:20.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:19 smithi016 ceph-mon[93645]: Cluster is now healthy 2024-08-01T07:00:20.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:19 smithi089 ceph-mon[82218]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 41/288 objects degraded (14.236%), 15 pgs degraded) 2024-08-01T07:00:20.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:19 smithi089 ceph-mon[82218]: Cluster is now healthy 2024-08-01T07:00:21.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:20 smithi016 ceph-mon[93645]: pgmap v74: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-01T07:00:21.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:20 smithi089 ceph-mon[82218]: pgmap v74: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-01T07:00:23.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:22 smithi089 ceph-mon[82218]: pgmap v75: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-01T07:00:23.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:22 smithi016 ceph-mon[93645]: pgmap v75: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-01T07:00:25.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:24 smithi089 ceph-mon[82218]: pgmap v76: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 1 op/s 2024-08-01T07:00:25.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:24 smithi016 ceph-mon[93645]: pgmap v76: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 1 op/s 2024-08-01T07:00:27.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:26 smithi016 ceph-mon[93645]: pgmap v77: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 2 op/s 2024-08-01T07:00:27.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:26 smithi089 ceph-mon[82218]: pgmap v77: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 2 op/s 2024-08-01T07:00:28.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:28 smithi089 ceph-mon[82218]: pgmap v78: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-08-01T07:00:28.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:28 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:28.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:28 smithi016 ceph-mon[93645]: pgmap v78: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-08-01T07:00:28.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:28 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:30.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:30 smithi089 ceph-mon[82218]: pgmap v79: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 3 op/s 2024-08-01T07:00:30.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:30 smithi016 ceph-mon[93645]: pgmap v79: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 3 op/s 2024-08-01T07:00:32.346 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:32 smithi016 ceph-mon[93645]: pgmap v80: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:00:32.347 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-01T07:00:32.347 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:32 smithi016 ceph-mon[93645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-01T07:00:32.347 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:32 smithi016 ceph-mon[93645]: Upgrade: osd.2 is safe to restart 2024-08-01T07:00:32.347 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:32.347 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:00:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:32 smithi089 ceph-mon[82218]: pgmap v80: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:00:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-01T07:00:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:32 smithi089 ceph-mon[82218]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-01T07:00:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:32 smithi089 ceph-mon[82218]: Upgrade: osd.2 is safe to restart 2024-08-01T07:00:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:00:34.505 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:34 smithi016 ceph-mon[93645]: pgmap v81: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:00:34.505 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:34 smithi016 ceph-mon[93645]: Upgrade: Updating osd.2 2024-08-01T07:00:34.505 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:34 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:34.505 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:34 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-01T07:00:34.505 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:34 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:00:34.505 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:34 smithi016 ceph-mon[93645]: Deploying daemon osd.2 on smithi016 2024-08-01T07:00:34.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:34 smithi089 ceph-mon[82218]: pgmap v81: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:00:34.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:34 smithi089 ceph-mon[82218]: Upgrade: Updating osd.2 2024-08-01T07:00:34.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:34 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:34.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:34 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-01T07:00:34.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:34 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:00:34.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:34 smithi089 ceph-mon[82218]: Deploying daemon osd.2 on smithi016 2024-08-01T07:00:36.351 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:36 smithi016 ceph-mon[93645]: pgmap v82: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:00:36.352 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:36 smithi016 systemd[1]: Stopping Ceph osd.2 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T07:00:36.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:36 smithi089 ceph-mon[82218]: pgmap v82: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:00:36.648 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:36 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2[63113]: 2024-08-01T07:00:36.349+0000 7f417d778640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-01T07:00:36.648 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:36 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2[63113]: 2024-08-01T07:00:36.349+0000 7f417d778640 -1 osd.2 59 *** Got signal Terminated *** 2024-08-01T07:00:36.649 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:36 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2[63113]: 2024-08-01T07:00:36.349+0000 7f417d778640 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-01T07:00:37.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:37 smithi016 ceph-mon[93645]: osd.2 marked itself down and dead 2024-08-01T07:00:37.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:37 smithi089 ceph-mon[82218]: osd.2 marked itself down and dead 2024-08-01T07:00:37.968 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:37 smithi016 podman[112663]: 2024-08-01 07:00:37.69946245 +0000 UTC m=+1.467298459 container died 33a72e1a5c911bd0194a9c198cbd3d6055c2d5899e4ae44a3cca6f5e0533a846 (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=reef-a3bbd72, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240716) 2024-08-01T07:00:38.335 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:38 smithi016 ceph-mon[93645]: pgmap v83: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:00:38.336 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:38 smithi016 ceph-mon[93645]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-01T07:00:38.336 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:38 smithi016 ceph-mon[93645]: osdmap e60: 6 total, 5 up, 6 in 2024-08-01T07:00:38.336 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:38 smithi016 podman[112663]: 2024-08-01 07:00:38.066595452 +0000 UTC m=+1.834431448 container cleanup 33a72e1a5c911bd0194a9c198cbd3d6055c2d5899e4ae44a3cca6f5e0533a846 (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=reef-a3bbd72, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240716, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-01T07:00:38.336 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:38 smithi016 bash[112663]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2 2024-08-01T07:00:38.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:38 smithi089 ceph-mon[82218]: pgmap v83: 65 pgs: 65 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:00:38.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:38 smithi089 ceph-mon[82218]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-01T07:00:38.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:38 smithi089 ceph-mon[82218]: osdmap e60: 6 total, 5 up, 6 in 2024-08-01T07:00:38.648 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:38 smithi016 podman[112680]: 2024-08-01 07:00:38.334754592 +0000 UTC m=+0.638222039 container remove 33a72e1a5c911bd0194a9c198cbd3d6055c2d5899e4ae44a3cca6f5e0533a846 (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=reef-a3bbd72, org.label-schema.build-date=20240716, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=) 2024-08-01T07:00:38.931 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:38 smithi016 podman[112765]: 2024-08-01 07:00:38.660751308 +0000 UTC m=+0.107428898 container create 83eb6b84f5366bc7f9bcdccc533dbb5d1fe29ddc1479453e5b3ec8f00336dd83 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-f9911e1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724) 2024-08-01T07:00:38.931 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:38 smithi016 podman[112765]: 2024-08-01 07:00:38.571258265 +0000 UTC m=+0.017935820 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:00:38.931 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:38 smithi016 podman[112765]: 2024-08-01 07:00:38.855571617 +0000 UTC m=+0.302249191 container init 83eb6b84f5366bc7f9bcdccc533dbb5d1fe29ddc1479453e5b3ec8f00336dd83 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-f9911e1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-01T07:00:38.931 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:38 smithi016 podman[112765]: 2024-08-01 07:00:38.859345639 +0000 UTC m=+0.306023188 container start 83eb6b84f5366bc7f9bcdccc533dbb5d1fe29ddc1479453e5b3ec8f00336dd83 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f9911e1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-08-01T07:00:38.931 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:38 smithi016 podman[112765]: 2024-08-01 07:00:38.930222457 +0000 UTC m=+0.376900009 container attach 83eb6b84f5366bc7f9bcdccc533dbb5d1fe29ddc1479453e5b3ec8f00336dd83 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-f9911e1, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-08-01T07:00:39.227 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:39 smithi016 podman[112765]: 2024-08-01 07:00:39.048471368 +0000 UTC m=+0.495148916 container died 83eb6b84f5366bc7f9bcdccc533dbb5d1fe29ddc1479453e5b3ec8f00336dd83 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-f9911e1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, ceph=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2) 2024-08-01T07:00:39.627 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:39 smithi016 ceph-mon[93645]: osdmap e61: 6 total, 5 up, 6 in 2024-08-01T07:00:39.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:39 smithi089 ceph-mon[82218]: osdmap e61: 6 total, 5 up, 6 in 2024-08-01T07:00:39.902 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:39 smithi016 podman[112788]: 2024-08-01 07:00:39.625949709 +0000 UTC m=+0.572042750 container remove 83eb6b84f5366bc7f9bcdccc533dbb5d1fe29ddc1479453e5b3ec8f00336dd83 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-f9911e1, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0) 2024-08-01T07:00:39.902 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:39 smithi016 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.2.service: Deactivated successfully. 2024-08-01T07:00:39.902 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:39 smithi016 systemd[1]: Stopped Ceph osd.2 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T07:00:39.902 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:39 smithi016 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.2.service: Consumed 1min 4.063s CPU time. 2024-08-01T07:00:39.902 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:39 smithi016 systemd[1]: Starting Ceph osd.2 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T07:00:40.340 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:40 smithi016 ceph-mon[93645]: pgmap v86: 65 pgs: 8 active+undersized, 12 peering, 7 active+undersized+degraded, 38 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s; 22/288 objects degraded (7.639%) 2024-08-01T07:00:40.340 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:40 smithi016 ceph-mon[93645]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-08-01T07:00:40.340 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:40 smithi016 ceph-mon[93645]: Health check failed: Degraded data redundancy: 22/288 objects degraded (7.639%), 7 pgs degraded (PG_DEGRADED) 2024-08-01T07:00:40.340 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 podman[112889]: 2024-08-01 07:00:39.99132409 +0000 UTC m=+0.018090311 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:00:40.340 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 podman[112889]: 2024-08-01 07:00:40.094086765 +0000 UTC m=+0.120853022 container create c418948484a85a3f3bb40f6758f397ca22b4d57d03520cfe017a83c2f030c26c (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-activate, RELEASE=squid-f9911e1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724) 2024-08-01T07:00:40.340 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 podman[112889]: 2024-08-01 07:00:40.338937992 +0000 UTC m=+0.365704227 container init c418948484a85a3f3bb40f6758f397ca22b4d57d03520cfe017a83c2f030c26c (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-activate, io.buildah.version=1.36.0, RELEASE=squid-f9911e1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True) 2024-08-01T07:00:40.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:40 smithi089 ceph-mon[82218]: pgmap v86: 65 pgs: 8 active+undersized, 12 peering, 7 active+undersized+degraded, 38 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s; 22/288 objects degraded (7.639%) 2024-08-01T07:00:40.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:40 smithi089 ceph-mon[82218]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-08-01T07:00:40.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:40 smithi089 ceph-mon[82218]: Health check failed: Degraded data redundancy: 22/288 objects degraded (7.639%), 7 pgs degraded (PG_DEGRADED) 2024-08-01T07:00:40.648 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 podman[112889]: 2024-08-01 07:00:40.343093757 +0000 UTC m=+0.369859973 container start c418948484a85a3f3bb40f6758f397ca22b4d57d03520cfe017a83c2f030c26c (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-activate, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=squid-f9911e1) 2024-08-01T07:00:40.649 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 podman[112889]: 2024-08-01 07:00:40.413588768 +0000 UTC m=+0.440354984 container attach c418948484a85a3f3bb40f6758f397ca22b4d57d03520cfe017a83c2f030c26c (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-activate, io.buildah.version=1.36.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f9911e1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-01T07:00:40.649 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-activate[112904]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:00:40.649 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 bash[112889]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:00:40.649 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-activate[112904]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:00:40.649 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 bash[112889]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:00:41.099 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-activate[112904]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-01T07:00:41.099 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 bash[112889]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-01T07:00:41.099 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-activate[112904]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-08-01T07:00:41.099 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 bash[112889]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-08-01T07:00:41.099 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-activate[112904]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-08-01T07:00:41.099 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 bash[112889]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-08-01T07:00:41.099 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-activate[112904]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-08-01T07:00:41.099 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 bash[112889]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-08-01T07:00:41.099 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-activate[112904]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-08-01T07:00:41.099 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 bash[112889]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-08-01T07:00:41.100 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-activate[112904]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-01T07:00:41.100 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 bash[112889]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-01T07:00:41.100 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-activate[112904]: --> ceph-volume raw activate successful for osd ID: 2 2024-08-01T07:00:41.100 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 bash[112889]: --> ceph-volume raw activate successful for osd ID: 2 2024-08-01T07:00:41.100 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:40 smithi016 podman[112889]: 2024-08-01 07:00:40.734123875 +0000 UTC m=+0.760890091 container died c418948484a85a3f3bb40f6758f397ca22b4d57d03520cfe017a83c2f030c26c (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-f9911e1) 2024-08-01T07:00:41.398 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:41 smithi016 podman[113036]: 2024-08-01 07:00:41.292714279 +0000 UTC m=+0.552462584 container remove c418948484a85a3f3bb40f6758f397ca22b4d57d03520cfe017a83c2f030c26c (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-f9911e1, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2) 2024-08-01T07:00:41.788 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:41 smithi016 podman[113098]: 2024-08-01 07:00:41.414855056 +0000 UTC m=+0.018512860 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:00:41.789 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:41 smithi016 podman[113098]: 2024-08-01 07:00:41.518499293 +0000 UTC m=+0.122157087 container create 3364752c936536d9fda25aad9db8e1cc04e1d13f7586308060728bed71d0801c (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f9911e1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True) 2024-08-01T07:00:41.789 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:41 smithi016 podman[113098]: 2024-08-01 07:00:41.787961898 +0000 UTC m=+0.391619702 container init 3364752c936536d9fda25aad9db8e1cc04e1d13f7586308060728bed71d0801c (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_BRANCH=HEAD, RELEASE=squid-f9911e1, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-01T07:00:42.150 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:41 smithi016 podman[113098]: 2024-08-01 07:00:41.79144083 +0000 UTC m=+0.395098622 container start 3364752c936536d9fda25aad9db8e1cc04e1d13f7586308060728bed71d0801c (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f9911e1, GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-01T07:00:42.150 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:41 smithi016 ceph-osd[113117]: -- 172.21.15.16:0/4034531828 <== mon.0 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5569f97d01e0 con 0x5569f8983c00 2024-08-01T07:00:42.150 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:41 smithi016 bash[113098]: 3364752c936536d9fda25aad9db8e1cc04e1d13f7586308060728bed71d0801c 2024-08-01T07:00:42.150 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:41 smithi016 systemd[1]: Started Ceph osd.2 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T07:00:42.459 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:42 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2[113113]: 2024-08-01T07:00:42.336+0000 7f03347bf640 -1 Falling back to public interface 2024-08-01T07:00:43.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:42 smithi016 ceph-mon[93645]: pgmap v87: 65 pgs: 8 active+undersized, 12 peering, 7 active+undersized+degraded, 38 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 2 op/s; 22/288 objects degraded (7.639%) 2024-08-01T07:00:43.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:42 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:43.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:42 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:43.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:42 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:00:43.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:42 smithi089 ceph-mon[82218]: pgmap v87: 65 pgs: 8 active+undersized, 12 peering, 7 active+undersized+degraded, 38 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 2 op/s; 22/288 objects degraded (7.639%) 2024-08-01T07:00:43.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:42 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:43.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:42 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:43.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:42 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:00:44.315 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:43 smithi016 ceph-mon[93645]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-08-01T07:00:44.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:43 smithi089 ceph-mon[82218]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-08-01T07:00:45.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:45 smithi089 ceph-mon[82218]: pgmap v88: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 38/288 objects degraded (13.194%) 2024-08-01T07:00:45.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:45 smithi016 ceph-mon[93645]: pgmap v88: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 38/288 objects degraded (13.194%) 2024-08-01T07:00:46.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:46 smithi089 ceph-mon[82218]: Health check update: Degraded data redundancy: 38/288 objects degraded (13.194%), 13 pgs degraded (PG_DEGRADED) 2024-08-01T07:00:46.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:46 smithi016 ceph-mon[93645]: Health check update: Degraded data redundancy: 38/288 objects degraded (13.194%), 13 pgs degraded (PG_DEGRADED) 2024-08-01T07:00:47.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:47 smithi089 ceph-mon[82218]: pgmap v89: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s; 38/288 objects degraded (13.194%) 2024-08-01T07:00:47.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:47 smithi016 ceph-mon[93645]: pgmap v89: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s; 38/288 objects degraded (13.194%) 2024-08-01T07:00:47.398 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:47 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2[113113]: 2024-08-01T07:00:47.227+0000 7f03347bf640 -1 osd.2 59 log_to_monitors true 2024-08-01T07:00:48.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.324+0000 7f164c849640 1 -- 172.21.15.16:0/1447689112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1648100680 msgr2=0x7f1648102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:48.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.324+0000 7f164c849640 1 --2- 172.21.15.16:0/1447689112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1648100680 0x7f1648102a70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f16380098b0 tx=0x7f163802a4d0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.324+0000 7f164c849640 1 -- 172.21.15.16:0/1447689112 shutdown_connections 2024-08-01T07:00:48.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.324+0000 7f164c849640 1 --2- 172.21.15.16:0/1447689112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1648102fb0 0x7f16481053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.324+0000 7f164c849640 1 --2- 172.21.15.16:0/1447689112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1648100680 0x7f1648102a70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.324+0000 7f164c849640 1 -- 172.21.15.16:0/1447689112 >> 172.21.15.16:0/1447689112 conn(0x7f16480fa280 msgr2=0x7f16480fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:48.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.324+0000 7f164c849640 1 -- 172.21.15.16:0/1447689112 shutdown_connections 2024-08-01T07:00:48.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.324+0000 7f164c849640 1 -- 172.21.15.16:0/1447689112 wait complete. 2024-08-01T07:00:48.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.325+0000 7f164c849640 1 Processor -- start 2024-08-01T07:00:48.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.325+0000 7f164c849640 1 -- start start 2024-08-01T07:00:48.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.325+0000 7f164c849640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1648100680 0x7f16480fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:48.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.325+0000 7f164c849640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1648102fb0 0x7f16480fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:48.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.325+0000 7f164c849640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1648100520 con 0x7f1648102fb0 2024-08-01T07:00:48.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.325+0000 7f164c849640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16480feba0 con 0x7f1648100680 2024-08-01T07:00:48.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.326+0000 7f1645d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1648102fb0 0x7f16480fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:48.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.326+0000 7f1645d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1648102fb0 0x7f16480fe630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39782/0 (socket says 172.21.15.16:39782) 2024-08-01T07:00:48.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.326+0000 7f1645d9b640 1 -- 172.21.15.16:0/858544425 learned_addr learned my addr 172.21.15.16:0/858544425 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:00:48.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.326+0000 7f164659c640 1 --2- 172.21.15.16:0/858544425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1648100680 0x7f16480fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:48.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.326+0000 7f1645d9b640 1 -- 172.21.15.16:0/858544425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1648100680 msgr2=0x7f16480fffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:48.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.326+0000 7f1645d9b640 1 --2- 172.21.15.16:0/858544425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1648100680 0x7f16480fffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.326+0000 7f1645d9b640 1 -- 172.21.15.16:0/858544425 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1638009560 con 0x7f1648102fb0 2024-08-01T07:00:48.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.326+0000 7f164659c640 1 --2- 172.21.15.16:0/858544425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1648100680 0x7f16480fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T07:00:48.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.326+0000 7f1645d9b640 1 --2- 172.21.15.16:0/858544425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1648102fb0 0x7f16480fe630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f163c00c8f0 tx=0x7f163c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:48.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.326+0000 7f16377fe640 1 -- 172.21.15.16:0/858544425 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f163c004410 con 0x7f1648102fb0 2024-08-01T07:00:48.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.326+0000 7f164c849640 1 -- 172.21.15.16:0/858544425 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16480fee80 con 0x7f1648102fb0 2024-08-01T07:00:48.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.326+0000 7f16377fe640 1 -- 172.21.15.16:0/858544425 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f163c007c60 con 0x7f1648102fb0 2024-08-01T07:00:48.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.326+0000 7f16377fe640 1 -- 172.21.15.16:0/858544425 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f163c00f450 con 0x7f1648102fb0 2024-08-01T07:00:48.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.326+0000 7f164c849640 1 -- 172.21.15.16:0/858544425 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16480ff3d0 con 0x7f1648102fb0 2024-08-01T07:00:48.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.327+0000 7f164c849640 1 -- 172.21.15.16:0/858544425 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1648108810 con 0x7f1648102fb0 2024-08-01T07:00:48.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.328+0000 7f16377fe640 1 -- 172.21.15.16:0/858544425 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f163c0077a0 con 0x7f1648102fb0 2024-08-01T07:00:48.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.328+0000 7f16377fe640 1 --2- 172.21.15.16:0/858544425 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f163006e170 0x7f1630070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:48.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.328+0000 7f16377fe640 1 -- 172.21.15.16:0/858544425 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f163c08e100 con 0x7f1648102fb0 2024-08-01T07:00:48.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.329+0000 7f164659c640 1 --2- 172.21.15.16:0/858544425 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f163006e170 0x7f1630070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:48.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.329+0000 7f164659c640 1 --2- 172.21.15.16:0/858544425 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f163006e170 0x7f1630070630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1638006010 tx=0x7f16380314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:48.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.333+0000 7f16377fe640 1 -- 172.21.15.16:0/858544425 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f163c057430 con 0x7f1648102fb0 2024-08-01T07:00:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:48 smithi089 ceph-mon[82218]: pgmap v90: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 3 op/s; 38/288 objects degraded (13.194%) 2024-08-01T07:00:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:48.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:00:48.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:48.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:48.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:48 smithi089 ceph-mon[82218]: from='osd.2 [v2:172.21.15.16:6818/3998232796,v1:172.21.15.16:6819/3998232796]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-01T07:00:48.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:48.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:48.398 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:00:48 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2[113113]: 2024-08-01T07:00:48.162+0000 7f0328551640 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-01T07:00:48.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:48 smithi016 ceph-mon[93645]: pgmap v90: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 213 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 3 op/s; 38/288 objects degraded (13.194%) 2024-08-01T07:00:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:00:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:48 smithi016 ceph-mon[93645]: from='osd.2 [v2:172.21.15.16:6818/3998232796,v1:172.21.15.16:6819/3998232796]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-01T07:00:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:48.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:48.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.527+0000 7f164c849640 1 -- 172.21.15.16:0/858544425 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f16481039d0 con 0x7f163006e170 2024-08-01T07:00:48.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.528+0000 7f16377fe640 1 -- 172.21.15.16:0/858544425 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f16481039d0 con 0x7f163006e170 2024-08-01T07:00:48.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.530+0000 7f164c849640 1 -- 172.21.15.16:0/858544425 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f163006e170 msgr2=0x7f1630070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:48.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.530+0000 7f164c849640 1 --2- 172.21.15.16:0/858544425 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f163006e170 0x7f1630070630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1638006010 tx=0x7f16380314e0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.530+0000 7f164c849640 1 -- 172.21.15.16:0/858544425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1648102fb0 msgr2=0x7f16480fe630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:48.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.530+0000 7f164c849640 1 --2- 172.21.15.16:0/858544425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1648102fb0 0x7f16480fe630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f163c00c8f0 tx=0x7f163c00cdb0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.531+0000 7f164c849640 1 -- 172.21.15.16:0/858544425 shutdown_connections 2024-08-01T07:00:48.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.531+0000 7f164c849640 1 --2- 172.21.15.16:0/858544425 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f163006e170 0x7f1630070630 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.531+0000 7f164c849640 1 --2- 172.21.15.16:0/858544425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1648102fb0 0x7f16480fe630 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.531+0000 7f164c849640 1 --2- 172.21.15.16:0/858544425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1648100680 0x7f16480fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.531+0000 7f164c849640 1 -- 172.21.15.16:0/858544425 >> 172.21.15.16:0/858544425 conn(0x7f16480fa280 msgr2=0x7f16480fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:48.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.531+0000 7f164c849640 1 -- 172.21.15.16:0/858544425 shutdown_connections 2024-08-01T07:00:48.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.531+0000 7f164c849640 1 -- 172.21.15.16:0/858544425 wait complete. 2024-08-01T07:00:48.541 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T07:00:48.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.616+0000 7fa0adefd640 1 -- 172.21.15.16:0/232815564 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a8100d90 msgr2=0x7fa0a8101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:48.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.616+0000 7fa0adefd640 1 --2- 172.21.15.16:0/232815564 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a8100d90 0x7fa0a8101210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa090009880 tx=0x7fa09002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.616+0000 7fa0adefd640 1 -- 172.21.15.16:0/232815564 shutdown_connections 2024-08-01T07:00:48.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.616+0000 7fa0adefd640 1 --2- 172.21.15.16:0/232815564 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a8100d90 0x7fa0a8101210 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.616+0000 7fa0adefd640 1 --2- 172.21.15.16:0/232815564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a80ffb90 0x7fa0a80fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.616+0000 7fa0adefd640 1 -- 172.21.15.16:0/232815564 >> 172.21.15.16:0/232815564 conn(0x7fa0a80fb360 msgr2=0x7fa0a80fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:48.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.616+0000 7fa0adefd640 1 -- 172.21.15.16:0/232815564 shutdown_connections 2024-08-01T07:00:48.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.616+0000 7fa0adefd640 1 -- 172.21.15.16:0/232815564 wait complete. 2024-08-01T07:00:48.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.617+0000 7fa0adefd640 1 Processor -- start 2024-08-01T07:00:48.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.617+0000 7fa0adefd640 1 -- start start 2024-08-01T07:00:48.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.617+0000 7fa0adefd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a80ffb90 0x7fa0a8197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:48.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.617+0000 7fa0adefd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a8100d90 0x7fa0a8197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:48.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.617+0000 7fa0adefd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a8198360 con 0x7fa0a80ffb90 2024-08-01T07:00:48.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.617+0000 7fa0adefd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a81984d0 con 0x7fa0a8100d90 2024-08-01T07:00:48.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.617+0000 7fa0a77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a80ffb90 0x7fa0a8197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:48.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.617+0000 7fa0a77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a80ffb90 0x7fa0a8197850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39792/0 (socket says 172.21.15.16:39792) 2024-08-01T07:00:48.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.617+0000 7fa0a77fe640 1 -- 172.21.15.16:0/3205405083 learned_addr learned my addr 172.21.15.16:0/3205405083 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:00:48.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.617+0000 7fa09ffff640 1 --2- 172.21.15.16:0/3205405083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a8100d90 0x7fa0a8197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:48.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.618+0000 7fa0a77fe640 1 -- 172.21.15.16:0/3205405083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a8100d90 msgr2=0x7fa0a8197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:48.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.618+0000 7fa0a77fe640 1 --2- 172.21.15.16:0/3205405083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a8100d90 0x7fa0a8197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.618+0000 7fa0a77fe640 1 -- 172.21.15.16:0/3205405083 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa090009560 con 0x7fa0a80ffb90 2024-08-01T07:00:48.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.618+0000 7fa0a77fe640 1 --2- 172.21.15.16:0/3205405083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a80ffb90 0x7fa0a8197850 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa09800d900 tx=0x7fa09800ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:48.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.618+0000 7fa0a57fa640 1 -- 172.21.15.16:0/3205405083 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa098009c00 con 0x7fa0a80ffb90 2024-08-01T07:00:48.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.618+0000 7fa0a57fa640 1 -- 172.21.15.16:0/3205405083 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa098009d60 con 0x7fa0a80ffb90 2024-08-01T07:00:48.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.618+0000 7fa0adefd640 1 -- 172.21.15.16:0/3205405083 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a819cf70 con 0x7fa0a80ffb90 2024-08-01T07:00:48.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.618+0000 7fa0a57fa640 1 -- 172.21.15.16:0/3205405083 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa09800f7b0 con 0x7fa0a80ffb90 2024-08-01T07:00:48.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.618+0000 7fa0adefd640 1 -- 172.21.15.16:0/3205405083 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a819d430 con 0x7fa0a80ffb90 2024-08-01T07:00:48.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.619+0000 7fa0adefd640 1 -- 172.21.15.16:0/3205405083 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a80fff90 con 0x7fa0a80ffb90 2024-08-01T07:00:48.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.620+0000 7fa0a57fa640 1 -- 172.21.15.16:0/3205405083 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa098010460 con 0x7fa0a80ffb90 2024-08-01T07:00:48.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.620+0000 7fa0a57fa640 1 --2- 172.21.15.16:0/3205405083 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa09406e170 0x7fa094070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:48.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.621+0000 7fa0a57fa640 1 -- 172.21.15.16:0/3205405083 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa09808e3e0 con 0x7fa0a80ffb90 2024-08-01T07:00:48.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.621+0000 7fa09ffff640 1 --2- 172.21.15.16:0/3205405083 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa09406e170 0x7fa094070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:48.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.621+0000 7fa09ffff640 1 --2- 172.21.15.16:0/3205405083 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa09406e170 0x7fa094070630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa090000c00 tx=0x7fa0900314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:48.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.625+0000 7fa0a57fa640 1 -- 172.21.15.16:0/3205405083 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa098057710 con 0x7fa0a80ffb90 2024-08-01T07:00:48.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.820+0000 7fa0adefd640 1 -- 172.21.15.16:0/3205405083 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0a802c590 con 0x7fa09406e170 2024-08-01T07:00:48.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.821+0000 7fa0a57fa640 1 -- 172.21.15.16:0/3205405083 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa0a802c590 con 0x7fa09406e170 2024-08-01T07:00:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.823+0000 7fa0adefd640 1 -- 172.21.15.16:0/3205405083 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa09406e170 msgr2=0x7fa094070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.823+0000 7fa0adefd640 1 --2- 172.21.15.16:0/3205405083 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa09406e170 0x7fa094070630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa090000c00 tx=0x7fa0900314e0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.823+0000 7fa0adefd640 1 -- 172.21.15.16:0/3205405083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a80ffb90 msgr2=0x7fa0a8197850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.823+0000 7fa0adefd640 1 --2- 172.21.15.16:0/3205405083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a80ffb90 0x7fa0a8197850 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa09800d900 tx=0x7fa09800ddc0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.823+0000 7fa0adefd640 1 -- 172.21.15.16:0/3205405083 shutdown_connections 2024-08-01T07:00:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.823+0000 7fa0adefd640 1 --2- 172.21.15.16:0/3205405083 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa09406e170 0x7fa094070630 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.823+0000 7fa0adefd640 1 --2- 172.21.15.16:0/3205405083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a8100d90 0x7fa0a8197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.823+0000 7fa0adefd640 1 --2- 172.21.15.16:0/3205405083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a80ffb90 0x7fa0a8197850 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.823+0000 7fa0adefd640 1 -- 172.21.15.16:0/3205405083 >> 172.21.15.16:0/3205405083 conn(0x7fa0a80fb360 msgr2=0x7fa0a8072b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:48.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.824+0000 7fa0adefd640 1 -- 172.21.15.16:0/3205405083 shutdown_connections 2024-08-01T07:00:48.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.824+0000 7fa0adefd640 1 -- 172.21.15.16:0/3205405083 wait complete. 2024-08-01T07:00:48.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.908+0000 7f35504d2640 1 -- 172.21.15.16:0/552305949 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3548100d90 msgr2=0x7f3548101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:48.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.908+0000 7f35504d2640 1 --2- 172.21.15.16:0/552305949 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3548100d90 0x7f3548101210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f353c009880 tx=0x7f353c02a4a0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.908+0000 7f35504d2640 1 -- 172.21.15.16:0/552305949 shutdown_connections 2024-08-01T07:00:48.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.908+0000 7f35504d2640 1 --2- 172.21.15.16:0/552305949 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3548100d90 0x7f3548101210 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.908+0000 7f35504d2640 1 --2- 172.21.15.16:0/552305949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35480ffb90 0x7f35480fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.908+0000 7f35504d2640 1 -- 172.21.15.16:0/552305949 >> 172.21.15.16:0/552305949 conn(0x7f35480fb320 msgr2=0x7f35480fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:48.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.908+0000 7f35504d2640 1 -- 172.21.15.16:0/552305949 shutdown_connections 2024-08-01T07:00:48.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.908+0000 7f35504d2640 1 -- 172.21.15.16:0/552305949 wait complete. 2024-08-01T07:00:48.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.908+0000 7f35504d2640 1 Processor -- start 2024-08-01T07:00:48.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.908+0000 7f35504d2640 1 -- start start 2024-08-01T07:00:48.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.909+0000 7f35504d2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35480ffb90 0x7f3548195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:48.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.909+0000 7f35504d2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3548100d90 0x7f3548195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:48.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.909+0000 7f35504d2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3548196140 con 0x7f3548100d90 2024-08-01T07:00:48.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.909+0000 7f35504d2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35481962b0 con 0x7f35480ffb90 2024-08-01T07:00:48.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.909+0000 7f354da6d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3548100d90 0x7f3548195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:48.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.909+0000 7f354da6d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3548100d90 0x7f3548195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53974/0 (socket says 172.21.15.16:53974) 2024-08-01T07:00:48.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.909+0000 7f354da6d640 1 -- 172.21.15.16:0/1693877707 learned_addr learned my addr 172.21.15.16:0/1693877707 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:00:48.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.909+0000 7f354e26e640 1 --2- 172.21.15.16:0/1693877707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35480ffb90 0x7f3548195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:48.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.909+0000 7f354da6d640 1 -- 172.21.15.16:0/1693877707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35480ffb90 msgr2=0x7f3548195630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:48.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.909+0000 7f354da6d640 1 --2- 172.21.15.16:0/1693877707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35480ffb90 0x7f3548195630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:48.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.909+0000 7f354da6d640 1 -- 172.21.15.16:0/1693877707 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c009560 con 0x7f3548100d90 2024-08-01T07:00:48.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.909+0000 7f354e26e640 1 --2- 172.21.15.16:0/1693877707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35480ffb90 0x7f3548195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T07:00:48.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.909+0000 7f354da6d640 1 --2- 172.21.15.16:0/1693877707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3548100d90 0x7f3548195b70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f353c005640 tx=0x7f353c005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:48.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.909+0000 7f353b7fe640 1 -- 172.21.15.16:0/1693877707 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f353c004ba0 con 0x7f3548100d90 2024-08-01T07:00:48.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.910+0000 7f35504d2640 1 -- 172.21.15.16:0/1693877707 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354819acf0 con 0x7f3548100d90 2024-08-01T07:00:48.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.910+0000 7f353b7fe640 1 -- 172.21.15.16:0/1693877707 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f353c004d00 con 0x7f3548100d90 2024-08-01T07:00:48.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.910+0000 7f353b7fe640 1 -- 172.21.15.16:0/1693877707 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f353c003c30 con 0x7f3548100d90 2024-08-01T07:00:48.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.910+0000 7f35504d2640 1 -- 172.21.15.16:0/1693877707 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354819b260 con 0x7f3548100d90 2024-08-01T07:00:48.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.911+0000 7f35504d2640 1 -- 172.21.15.16:0/1693877707 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354818f730 con 0x7f3548100d90 2024-08-01T07:00:48.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.912+0000 7f353b7fe640 1 -- 172.21.15.16:0/1693877707 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f353c031640 con 0x7f3548100d90 2024-08-01T07:00:48.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.912+0000 7f353b7fe640 1 --2- 172.21.15.16:0/1693877707 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f353406e170 0x7f3534070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:48.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.912+0000 7f353b7fe640 1 -- 172.21.15.16:0/1693877707 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f353c0af3e0 con 0x7f3548100d90 2024-08-01T07:00:48.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.912+0000 7f354e26e640 1 --2- 172.21.15.16:0/1693877707 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f353406e170 0x7f3534070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:48.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.913+0000 7f354e26e640 1 --2- 172.21.15.16:0/1693877707 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f353406e170 0x7f3534070630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f35440058c0 tx=0x7f3544005ec0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:48.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:48.916+0000 7f353b7fe640 1 -- 172.21.15.16:0/1693877707 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f353c078710 con 0x7f3548100d90 2024-08-01T07:00:49.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.103+0000 7f35504d2640 1 -- 172.21.15.16:0/1693877707 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f354802c480 con 0x7f353406e170 2024-08-01T07:00:49.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.113+0000 7f353b7fe640 1 -- 172.21.15.16:0/1693877707 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f354802c480 con 0x7f353406e170 2024-08-01T07:00:49.119 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T07:00:49.120 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (11m) 1s ago 12m 25.2M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T07:00:49.120 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (13m) 1s ago 13m 8929k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T07:00:49.120 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (12m) 92s ago 12m 8098k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T07:00:49.120 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (100s) 1s ago 13m 6899k - 19.1.0-1223-gf9911e17 93d93c74a2cc 2a96028287a2 2024-08-01T07:00:49.120 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (96s) 92s ago 12m 6895k - 19.1.0-1223-gf9911e17 93d93c74a2cc 8a23341bd6c3 2024-08-01T07:00:49.120 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (11m) 1s ago 12m 84.5M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T07:00:49.120 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (7m) 1s ago 7m 89.3M - 18.2.2-1767-ga3bbd728 d280790d1980 96e46c28d16c 2024-08-01T07:00:49.120 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (7m) 1s ago 7m 147M - 18.2.2-1767-ga3bbd728 d280790d1980 4bbe1a388689 2024-08-01T07:00:49.120 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (7m) 92s ago 7m 27.1M - 18.2.2-1767-ga3bbd728 d280790d1980 65ca121a6fbb 2024-08-01T07:00:49.120 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (7m) 92s ago 7m 25.6M - 18.2.2-1767-ga3bbd728 d280790d1980 05bb46c6fe94 2024-08-01T07:00:49.120 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:8443,9283,8765 running (3m) 1s ago 14m 501M - 19.1.0-1223-gf9911e17 93d93c74a2cc 8701e6315593 2024-08-01T07:00:49.121 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (2m) 92s ago 11m 438M - 19.1.0-1223-gf9911e17 93d93c74a2cc c6caa21f436f 2024-08-01T07:00:49.121 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (2m) 1s ago 14m 48.2M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc 48e94d076e6f 2024-08-01T07:00:49.121 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (2m) 92s ago 11m 33.1M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc c4b83b46ff15 2024-08-01T07:00:49.121 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (12m) 1s ago 12m 15.9M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T07:00:49.121 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (11m) 92s ago 11m 16.3M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T07:00:49.121 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (76s) 1s ago 11m 93.0M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 4c2115ae6222 2024-08-01T07:00:49.121 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (41s) 1s ago 10m 95.5M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc fc2f7117be30 2024-08-01T07:00:49.121 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (7s) 1s ago 10m 12.1M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 3364752c9365 2024-08-01T07:00:49.121 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (9m) 92s ago 9m 277M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 58c175e0f4eb 2024-08-01T07:00:49.121 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (9m) 92s ago 9m 260M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 15b8f910bad7 2024-08-01T07:00:49.121 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (8m) 92s ago 8m 236M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 ac887841899e 2024-08-01T07:00:49.121 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (2m) 1s ago 12m 60.6M - 2.43.0 a07b618ecd1d 45d23c96382e 2024-08-01T07:00:49.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.115+0000 7f35504d2640 1 -- 172.21.15.16:0/1693877707 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f353406e170 msgr2=0x7f3534070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:49.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.115+0000 7f35504d2640 1 --2- 172.21.15.16:0/1693877707 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f353406e170 0x7f3534070630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f35440058c0 tx=0x7f3544005ec0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.115+0000 7f35504d2640 1 -- 172.21.15.16:0/1693877707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3548100d90 msgr2=0x7f3548195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:49.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.115+0000 7f35504d2640 1 --2- 172.21.15.16:0/1693877707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3548100d90 0x7f3548195b70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f353c005640 tx=0x7f353c005670 comp rx=0 tx=0).stop 2024-08-01T07:00:49.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.115+0000 7f35504d2640 1 -- 172.21.15.16:0/1693877707 shutdown_connections 2024-08-01T07:00:49.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.115+0000 7f35504d2640 1 --2- 172.21.15.16:0/1693877707 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f353406e170 0x7f3534070630 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.115+0000 7f35504d2640 1 --2- 172.21.15.16:0/1693877707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3548100d90 0x7f3548195b70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.115+0000 7f35504d2640 1 --2- 172.21.15.16:0/1693877707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35480ffb90 0x7f3548195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.115+0000 7f35504d2640 1 -- 172.21.15.16:0/1693877707 >> 172.21.15.16:0/1693877707 conn(0x7f35480fb320 msgr2=0x7f3548104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:49.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.115+0000 7f35504d2640 1 -- 172.21.15.16:0/1693877707 shutdown_connections 2024-08-01T07:00:49.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.115+0000 7f35504d2640 1 -- 172.21.15.16:0/1693877707 wait complete. 2024-08-01T07:00:49.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.209+0000 7fb229f9d640 1 -- 172.21.15.16:0/900696121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2240fe220 msgr2=0x7fb2240fe620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:49.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.209+0000 7fb229f9d640 1 --2- 172.21.15.16:0/900696121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2240fe220 0x7fb2240fe620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb218009880 tx=0x7fb21802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.209+0000 7fb229f9d640 1 -- 172.21.15.16:0/900696121 shutdown_connections 2024-08-01T07:00:49.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.209+0000 7fb229f9d640 1 --2- 172.21.15.16:0/900696121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2240feb60 0x7fb2240fefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.209+0000 7fb229f9d640 1 --2- 172.21.15.16:0/900696121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2240fe220 0x7fb2240fe620 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.209+0000 7fb229f9d640 1 -- 172.21.15.16:0/900696121 >> 172.21.15.16:0/900696121 conn(0x7fb2240fa010 msgr2=0x7fb2240fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:49.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.209+0000 7fb229f9d640 1 -- 172.21.15.16:0/900696121 shutdown_connections 2024-08-01T07:00:49.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.209+0000 7fb229f9d640 1 -- 172.21.15.16:0/900696121 wait complete. 2024-08-01T07:00:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.210+0000 7fb229f9d640 1 Processor -- start 2024-08-01T07:00:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.210+0000 7fb229f9d640 1 -- start start 2024-08-01T07:00:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.210+0000 7fb229f9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2240fe220 0x7fb224197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.210+0000 7fb229f9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2240feb60 0x7fb224197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.210+0000 7fb229f9d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb224198210 con 0x7fb2240feb60 2024-08-01T07:00:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.210+0000 7fb229f9d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb224198380 con 0x7fb2240fe220 2024-08-01T07:00:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.210+0000 7fb223fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2240feb60 0x7fb224197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.210+0000 7fb223fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2240feb60 0x7fb224197c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53980/0 (socket says 172.21.15.16:53980) 2024-08-01T07:00:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.210+0000 7fb223fff640 1 -- 172.21.15.16:0/4192782116 learned_addr learned my addr 172.21.15.16:0/4192782116 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:00:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.210+0000 7fb228f9b640 1 --2- 172.21.15.16:0/4192782116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2240fe220 0x7fb224197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.210+0000 7fb223fff640 1 -- 172.21.15.16:0/4192782116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2240fe220 msgr2=0x7fb224197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.210+0000 7fb223fff640 1 --2- 172.21.15.16:0/4192782116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2240fe220 0x7fb224197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.210+0000 7fb223fff640 1 -- 172.21.15.16:0/4192782116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb218009560 con 0x7fb2240feb60 2024-08-01T07:00:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.211+0000 7fb228f9b640 1 --2- 172.21.15.16:0/4192782116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2240fe220 0x7fb224197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-01T07:00:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.211+0000 7fb223fff640 1 --2- 172.21.15.16:0/4192782116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2240feb60 0x7fb224197c40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb21000b450 tx=0x7fb21000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.211+0000 7fb221ffb640 1 -- 172.21.15.16:0/4192782116 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb210011860 con 0x7fb2240feb60 2024-08-01T07:00:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.211+0000 7fb221ffb640 1 -- 172.21.15.16:0/4192782116 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb210011e80 con 0x7fb2240feb60 2024-08-01T07:00:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.211+0000 7fb221ffb640 1 -- 172.21.15.16:0/4192782116 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb21000f570 con 0x7fb2240feb60 2024-08-01T07:00:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.211+0000 7fb229f9d640 1 -- 172.21.15.16:0/4192782116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22419ce20 con 0x7fb2240feb60 2024-08-01T07:00:49.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.211+0000 7fb229f9d640 1 -- 172.21.15.16:0/4192782116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22419d370 con 0x7fb2240feb60 2024-08-01T07:00:49.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.212+0000 7fb229f9d640 1 -- 172.21.15.16:0/4192782116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22410a7f0 con 0x7fb2240feb60 2024-08-01T07:00:49.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.213+0000 7fb221ffb640 1 -- 172.21.15.16:0/4192782116 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb2100103e0 con 0x7fb2240feb60 2024-08-01T07:00:49.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.213+0000 7fb221ffb640 1 --2- 172.21.15.16:0/4192782116 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fb21406e170 0x7fb214070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:49.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.213+0000 7fb221ffb640 1 -- 172.21.15.16:0/4192782116 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fb21008e030 con 0x7fb2240feb60 2024-08-01T07:00:49.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.213+0000 7fb228f9b640 1 --2- 172.21.15.16:0/4192782116 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fb21406e170 0x7fb214070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:49.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.214+0000 7fb228f9b640 1 --2- 172.21.15.16:0/4192782116 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fb21406e170 0x7fb214070630 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb218031540 tx=0x7fb218005de0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:49.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.218+0000 7fb221ffb640 1 -- 172.21.15.16:0/4192782116 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb210057360 con 0x7fb2240feb60 2024-08-01T07:00:49.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:49 smithi016 ceph-mon[93645]: from='osd.2 [v2:172.21.15.16:6818/3998232796,v1:172.21.15.16:6819/3998232796]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-01T07:00:49.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:49 smithi016 ceph-mon[93645]: osdmap e62: 6 total, 5 up, 6 in 2024-08-01T07:00:49.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:49 smithi016 ceph-mon[93645]: from='osd.2 [v2:172.21.15.16:6818/3998232796,v1:172.21.15.16:6819/3998232796]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-08-01T07:00:49.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:49 smithi016 ceph-mon[93645]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:00:49.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:49 smithi016 ceph-mon[93645]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:00:49.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.466+0000 7fb229f9d640 1 -- 172.21.15.16:0/4192782116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb22419d640 con 0x7fb2240feb60 2024-08-01T07:00:49.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.466+0000 7fb221ffb640 1 -- 172.21.15.16:0/4192782116 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+832 (secure 0 0 0) 0x7fb22419d640 con 0x7fb2240feb60 2024-08-01T07:00:49.468 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:00:49.468 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T07:00:49.469 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:00:49.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:00:49.469 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T07:00:49.469 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:00:49.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:00:49.469 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T07:00:49.469 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 3, 2024-08-01T07:00:49.469 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 3 2024-08-01T07:00:49.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:00:49.470 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T07:00:49.470 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4 2024-08-01T07:00:49.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:00:49.470 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T07:00:49.470 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 7, 2024-08-01T07:00:49.470 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 7 2024-08-01T07:00:49.470 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T07:00:49.470 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:00:49.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.468+0000 7fb229f9d640 1 -- 172.21.15.16:0/4192782116 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fb21406e170 msgr2=0x7fb214070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:49.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.468+0000 7fb229f9d640 1 --2- 172.21.15.16:0/4192782116 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fb21406e170 0x7fb214070630 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb218031540 tx=0x7fb218005de0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.468+0000 7fb229f9d640 1 -- 172.21.15.16:0/4192782116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2240feb60 msgr2=0x7fb224197c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:49.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.468+0000 7fb229f9d640 1 --2- 172.21.15.16:0/4192782116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2240feb60 0x7fb224197c40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb21000b450 tx=0x7fb21000b910 comp rx=0 tx=0).stop 2024-08-01T07:00:49.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.469+0000 7fb229f9d640 1 -- 172.21.15.16:0/4192782116 shutdown_connections 2024-08-01T07:00:49.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.469+0000 7fb229f9d640 1 --2- 172.21.15.16:0/4192782116 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fb21406e170 0x7fb214070630 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.469+0000 7fb229f9d640 1 --2- 172.21.15.16:0/4192782116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2240feb60 0x7fb224197c40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.469+0000 7fb229f9d640 1 --2- 172.21.15.16:0/4192782116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2240fe220 0x7fb224197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.469+0000 7fb229f9d640 1 -- 172.21.15.16:0/4192782116 >> 172.21.15.16:0/4192782116 conn(0x7fb2240fa010 msgr2=0x7fb224106850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:49.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.469+0000 7fb229f9d640 1 -- 172.21.15.16:0/4192782116 shutdown_connections 2024-08-01T07:00:49.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.469+0000 7fb229f9d640 1 -- 172.21.15.16:0/4192782116 wait complete. 2024-08-01T07:00:49.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.552+0000 7f3f8b6c8640 1 -- 172.21.15.16:0/1792560117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f840feaf0 msgr2=0x7f3f840feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:49.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.552+0000 7f3f8b6c8640 1 --2- 172.21.15.16:0/1792560117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f840feaf0 0x7f3f840feef0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3f80009880 tx=0x7f3f8002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.552+0000 7f3f8b6c8640 1 -- 172.21.15.16:0/1792560117 shutdown_connections 2024-08-01T07:00:49.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.552+0000 7f3f8b6c8640 1 --2- 172.21.15.16:0/1792560117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f840ffcf0 0x7f3f84100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.552+0000 7f3f8b6c8640 1 --2- 172.21.15.16:0/1792560117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f840feaf0 0x7f3f840feef0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.552+0000 7f3f8b6c8640 1 -- 172.21.15.16:0/1792560117 >> 172.21.15.16:0/1792560117 conn(0x7f3f840fa280 msgr2=0x7f3f840fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:49.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.552+0000 7f3f8b6c8640 1 -- 172.21.15.16:0/1792560117 shutdown_connections 2024-08-01T07:00:49.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.552+0000 7f3f8b6c8640 1 -- 172.21.15.16:0/1792560117 wait complete. 2024-08-01T07:00:49.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.553+0000 7f3f8b6c8640 1 Processor -- start 2024-08-01T07:00:49.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.553+0000 7f3f8b6c8640 1 -- start start 2024-08-01T07:00:49.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.553+0000 7f3f8b6c8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f840feaf0 0x7f3f841956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:49.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.553+0000 7f3f8b6c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f840ffcf0 0x7f3f84195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:49.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.553+0000 7f3f8b6c8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f841961f0 con 0x7f3f840feaf0 2024-08-01T07:00:49.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.553+0000 7f3f8b6c8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f84196360 con 0x7f3f840ffcf0 2024-08-01T07:00:49.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.553+0000 7f3f89464640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f840feaf0 0x7f3f841956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:49.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.553+0000 7f3f89464640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f840feaf0 0x7f3f841956e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53996/0 (socket says 172.21.15.16:53996) 2024-08-01T07:00:49.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.553+0000 7f3f89464640 1 -- 172.21.15.16:0/3206054566 learned_addr learned my addr 172.21.15.16:0/3206054566 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:00:49.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.553+0000 7f3f88c63640 1 --2- 172.21.15.16:0/3206054566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f840ffcf0 0x7f3f84195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:49.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.553+0000 7f3f89464640 1 -- 172.21.15.16:0/3206054566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f840ffcf0 msgr2=0x7f3f84195c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:49.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.553+0000 7f3f89464640 1 --2- 172.21.15.16:0/3206054566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f840ffcf0 0x7f3f84195c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.553+0000 7f3f89464640 1 -- 172.21.15.16:0/3206054566 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f80009560 con 0x7f3f840feaf0 2024-08-01T07:00:49.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.553+0000 7f3f88c63640 1 --2- 172.21.15.16:0/3206054566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f840ffcf0 0x7f3f84195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T07:00:49.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.553+0000 7f3f89464640 1 --2- 172.21.15.16:0/3206054566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f840feaf0 0x7f3f841956e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f800054f0 tx=0x7f3f80005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:49.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.554+0000 7f3f7a7fc640 1 -- 172.21.15.16:0/3206054566 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f80004aa0 con 0x7f3f840feaf0 2024-08-01T07:00:49.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.554+0000 7f3f7a7fc640 1 -- 172.21.15.16:0/3206054566 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f80004c00 con 0x7f3f840feaf0 2024-08-01T07:00:49.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.554+0000 7f3f8b6c8640 1 -- 172.21.15.16:0/3206054566 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8419ada0 con 0x7f3f840feaf0 2024-08-01T07:00:49.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.554+0000 7f3f7a7fc640 1 -- 172.21.15.16:0/3206054566 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f80003ac0 con 0x7f3f840feaf0 2024-08-01T07:00:49.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.554+0000 7f3f8b6c8640 1 -- 172.21.15.16:0/3206054566 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8419b230 con 0x7f3f840feaf0 2024-08-01T07:00:49.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.555+0000 7f3f8b6c8640 1 -- 172.21.15.16:0/3206054566 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f84107700 con 0x7f3f840feaf0 2024-08-01T07:00:49.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.555+0000 7f3f7a7fc640 1 -- 172.21.15.16:0/3206054566 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3f80003d80 con 0x7f3f840feaf0 2024-08-01T07:00:49.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.556+0000 7f3f7a7fc640 1 --2- 172.21.15.16:0/3206054566 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f3f7006e170 0x7f3f70070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:49.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.556+0000 7f3f7a7fc640 1 -- 172.21.15.16:0/3206054566 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f3f800af3f0 con 0x7f3f840feaf0 2024-08-01T07:00:49.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.556+0000 7f3f88c63640 1 --2- 172.21.15.16:0/3206054566 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f3f7006e170 0x7f3f70070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:49.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.556+0000 7f3f88c63640 1 --2- 172.21.15.16:0/3206054566 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f3f7006e170 0x7f3f70070630 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3f740058c0 tx=0x7f3f74005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:49.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.560+0000 7f3f7a7fc640 1 -- 172.21.15.16:0/3206054566 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3f80078680 con 0x7f3f840feaf0 2024-08-01T07:00:49.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:49 smithi089 ceph-mon[82218]: from='osd.2 [v2:172.21.15.16:6818/3998232796,v1:172.21.15.16:6819/3998232796]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-01T07:00:49.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:49 smithi089 ceph-mon[82218]: osdmap e62: 6 total, 5 up, 6 in 2024-08-01T07:00:49.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:49 smithi089 ceph-mon[82218]: from='osd.2 [v2:172.21.15.16:6818/3998232796,v1:172.21.15.16:6819/3998232796]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-08-01T07:00:49.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:49 smithi089 ceph-mon[82218]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:00:49.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:49 smithi089 ceph-mon[82218]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:00:49.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.777+0000 7f3f8b6c8640 1 -- 172.21.15.16:0/3206054566 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3f8419b450 con 0x7f3f840feaf0 2024-08-01T07:00:49.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.777+0000 7f3f7a7fc640 1 -- 172.21.15.16:0/3206054566 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1938 (secure 0 0 0) 0x7f3f8007bd40 con 0x7f3f840feaf0 2024-08-01T07:00:49.779 INFO:teuthology.orchestra.run.smithi016.stdout:e19 2024-08-01T07:00:49.779 INFO:teuthology.orchestra.run.smithi016.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-08-01T07:00:49.779 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T07:00:49.779 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T07:00:49.779 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T07:00:49.779 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:00:49.779 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T07:00:49.780 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T07:00:49.780 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 19 2024-08-01T07:00:49.780 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T07:00:49.780 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T07:00:49.780 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T06:53:32.617145+0000 2024-08-01T07:00:49.780 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T07:00:49.780 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T07:00:49.780 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T07:00:49.780 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T07:00:49.780 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T07:00:49.780 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T07:00:49.780 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T07:00:49.780 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T07:00:49.781 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 46 2024-08-01T07:00:49.781 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T07:00:49.781 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T07:00:49.781 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T07:00:49.781 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=14482,1=24281} 2024-08-01T07:00:49.781 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T07:00:49.781 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T07:00:49.781 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T07:00:49.781 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T07:00:49.781 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T07:00:49.781 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T07:00:49.782 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T07:00:49.782 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T07:00:49.782 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T07:00:49.782 INFO:teuthology.orchestra.run.smithi016.stdout:qdb_cluster leader: 0 members: 2024-08-01T07:00:49.782 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:00:49.782 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:24299} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:00:49.782 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{1:24281} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:00:49.782 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:24291} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:00:49.782 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:00:49.782 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:00:49.783 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-08-01T07:00:49.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.779+0000 7f3f8b6c8640 1 -- 172.21.15.16:0/3206054566 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f3f7006e170 msgr2=0x7f3f70070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:49.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.779+0000 7f3f8b6c8640 1 --2- 172.21.15.16:0/3206054566 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f3f7006e170 0x7f3f70070630 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3f740058c0 tx=0x7f3f74005850 comp rx=0 tx=0).stop 2024-08-01T07:00:49.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.779+0000 7f3f8b6c8640 1 -- 172.21.15.16:0/3206054566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f840feaf0 msgr2=0x7f3f841956e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:49.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.779+0000 7f3f8b6c8640 1 --2- 172.21.15.16:0/3206054566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f840feaf0 0x7f3f841956e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f800054f0 tx=0x7f3f80005520 comp rx=0 tx=0).stop 2024-08-01T07:00:49.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.779+0000 7f3f8b6c8640 1 -- 172.21.15.16:0/3206054566 shutdown_connections 2024-08-01T07:00:49.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.779+0000 7f3f8b6c8640 1 --2- 172.21.15.16:0/3206054566 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f3f7006e170 0x7f3f70070630 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.779+0000 7f3f8b6c8640 1 --2- 172.21.15.16:0/3206054566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f840ffcf0 0x7f3f84195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.779+0000 7f3f8b6c8640 1 --2- 172.21.15.16:0/3206054566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f840feaf0 0x7f3f841956e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.779+0000 7f3f8b6c8640 1 -- 172.21.15.16:0/3206054566 >> 172.21.15.16:0/3206054566 conn(0x7f3f840fa280 msgr2=0x7f3f84067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:49.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.779+0000 7f3f8b6c8640 1 -- 172.21.15.16:0/3206054566 shutdown_connections 2024-08-01T07:00:49.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.779+0000 7f3f8b6c8640 1 -- 172.21.15.16:0/3206054566 wait complete. 2024-08-01T07:00:49.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.867+0000 7faa2ed99640 1 -- 172.21.15.16:0/335993248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa28100d80 msgr2=0x7faa28101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:49.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.867+0000 7faa2ed99640 1 --2- 172.21.15.16:0/335993248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa28100d80 0x7faa28101200 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faa14009880 tx=0x7faa1402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.867+0000 7faa2ed99640 1 -- 172.21.15.16:0/335993248 shutdown_connections 2024-08-01T07:00:49.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.867+0000 7faa2ed99640 1 --2- 172.21.15.16:0/335993248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa28100d80 0x7faa28101200 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.867+0000 7faa2ed99640 1 --2- 172.21.15.16:0/335993248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa280ffb80 0x7faa280fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.867+0000 7faa2ed99640 1 -- 172.21.15.16:0/335993248 >> 172.21.15.16:0/335993248 conn(0x7faa280fb2f0 msgr2=0x7faa280fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:49.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.867+0000 7faa2ed99640 1 -- 172.21.15.16:0/335993248 shutdown_connections 2024-08-01T07:00:49.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.867+0000 7faa2ed99640 1 -- 172.21.15.16:0/335993248 wait complete. 2024-08-01T07:00:49.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.868+0000 7faa2ed99640 1 Processor -- start 2024-08-01T07:00:49.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.868+0000 7faa2ed99640 1 -- start start 2024-08-01T07:00:49.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.868+0000 7faa2ed99640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa280ffb80 0x7faa281978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:49.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.868+0000 7faa2ed99640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa28100d80 0x7faa28197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:49.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.868+0000 7faa2ed99640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa28198320 con 0x7faa28100d80 2024-08-01T07:00:49.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.868+0000 7faa2ed99640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa28198490 con 0x7faa280ffb80 2024-08-01T07:00:49.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.868+0000 7faa27fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa28100d80 0x7faa28197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:49.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.868+0000 7faa27fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa28100d80 0x7faa28197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54028/0 (socket says 172.21.15.16:54028) 2024-08-01T07:00:49.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.868+0000 7faa27fff640 1 -- 172.21.15.16:0/1358002295 learned_addr learned my addr 172.21.15.16:0/1358002295 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:00:49.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.868+0000 7faa2cb35640 1 --2- 172.21.15.16:0/1358002295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa280ffb80 0x7faa281978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:49.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.869+0000 7faa27fff640 1 -- 172.21.15.16:0/1358002295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa280ffb80 msgr2=0x7faa281978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:49.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.869+0000 7faa27fff640 1 --2- 172.21.15.16:0/1358002295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa280ffb80 0x7faa281978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:49.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.869+0000 7faa27fff640 1 -- 172.21.15.16:0/1358002295 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa14009560 con 0x7faa28100d80 2024-08-01T07:00:49.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.869+0000 7faa27fff640 1 --2- 172.21.15.16:0/1358002295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa28100d80 0x7faa28197de0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faa14006010 tx=0x7faa140055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:49.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.869+0000 7faa25ffb640 1 -- 172.21.15.16:0/1358002295 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa14004b20 con 0x7faa28100d80 2024-08-01T07:00:49.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.869+0000 7faa25ffb640 1 -- 172.21.15.16:0/1358002295 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa14004c80 con 0x7faa28100d80 2024-08-01T07:00:49.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.869+0000 7faa2ed99640 1 -- 172.21.15.16:0/1358002295 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2819cec0 con 0x7faa28100d80 2024-08-01T07:00:49.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.869+0000 7faa25ffb640 1 -- 172.21.15.16:0/1358002295 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa14003b80 con 0x7faa28100d80 2024-08-01T07:00:49.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.869+0000 7faa2ed99640 1 -- 172.21.15.16:0/1358002295 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa2819d3b0 con 0x7faa28100d80 2024-08-01T07:00:49.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.870+0000 7faa2ed99640 1 -- 172.21.15.16:0/1358002295 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa281056c0 con 0x7faa28100d80 2024-08-01T07:00:49.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.871+0000 7faa25ffb640 1 -- 172.21.15.16:0/1358002295 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7faa14031640 con 0x7faa28100d80 2024-08-01T07:00:49.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.871+0000 7faa25ffb640 1 --2- 172.21.15.16:0/1358002295 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7faa1806e180 0x7faa18070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:49.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.871+0000 7faa25ffb640 1 -- 172.21.15.16:0/1358002295 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6500+0+0 (secure 0 0 0) 0x7faa140af330 con 0x7faa28100d80 2024-08-01T07:00:49.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.871+0000 7faa2cb35640 1 --2- 172.21.15.16:0/1358002295 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7faa1806e180 0x7faa18070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:49.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.872+0000 7faa2cb35640 1 --2- 172.21.15.16:0/1358002295 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7faa1806e180 0x7faa18070640 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa28100be0 tx=0x7faa1c005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:49.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:49.876+0000 7faa25ffb640 1 -- 172.21.15.16:0/1358002295 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7faa14078710 con 0x7faa28100d80 2024-08-01T07:00:50.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.074+0000 7faa2ed99640 1 -- 172.21.15.16:0/1358002295 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa2802c4f0 con 0x7faa1806e180 2024-08-01T07:00:50.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.075+0000 7faa25ffb640 1 -- 172.21.15.16:0/1358002295 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7faa2802c4f0 con 0x7faa1806e180 2024-08-01T07:00:50.076 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:00:50.077 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T07:00:50.077 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T07:00:50.077 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T07:00:50.077 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-08-01T07:00:50.077 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-08-01T07:00:50.077 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr", 2024-08-01T07:00:50.077 INFO:teuthology.orchestra.run.smithi016.stdout: "crash" 2024-08-01T07:00:50.077 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-08-01T07:00:50.077 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "9/23 daemons upgraded", 2024-08-01T07:00:50.077 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-08-01T07:00:50.078 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T07:00:50.078 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:00:50.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.078+0000 7faa2ed99640 1 -- 172.21.15.16:0/1358002295 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7faa1806e180 msgr2=0x7faa18070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:50.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.078+0000 7faa2ed99640 1 --2- 172.21.15.16:0/1358002295 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7faa1806e180 0x7faa18070640 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa28100be0 tx=0x7faa1c005f90 comp rx=0 tx=0).stop 2024-08-01T07:00:50.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.078+0000 7faa2ed99640 1 -- 172.21.15.16:0/1358002295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa28100d80 msgr2=0x7faa28197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:50.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.078+0000 7faa2ed99640 1 --2- 172.21.15.16:0/1358002295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa28100d80 0x7faa28197de0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faa14006010 tx=0x7faa140055f0 comp rx=0 tx=0).stop 2024-08-01T07:00:50.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.078+0000 7faa2ed99640 1 -- 172.21.15.16:0/1358002295 shutdown_connections 2024-08-01T07:00:50.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.078+0000 7faa2ed99640 1 --2- 172.21.15.16:0/1358002295 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7faa1806e180 0x7faa18070640 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:50.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.078+0000 7faa2ed99640 1 --2- 172.21.15.16:0/1358002295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa28100d80 0x7faa28197de0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:50.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.078+0000 7faa2ed99640 1 --2- 172.21.15.16:0/1358002295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa280ffb80 0x7faa281978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:50.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.078+0000 7faa2ed99640 1 -- 172.21.15.16:0/1358002295 >> 172.21.15.16:0/1358002295 conn(0x7faa280fb2f0 msgr2=0x7faa28072b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:50.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.078+0000 7faa2ed99640 1 -- 172.21.15.16:0/1358002295 shutdown_connections 2024-08-01T07:00:50.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.078+0000 7faa2ed99640 1 -- 172.21.15.16:0/1358002295 wait complete. 2024-08-01T07:00:50.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.176+0000 7f22127fc640 1 -- 172.21.15.16:0/1582384948 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22040428b0 con 0x7f22140fdbe0 2024-08-01T07:00:50.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.177+0000 7f22189f3640 1 -- 172.21.15.16:0/1582384948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140fdbe0 msgr2=0x7f22140fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:50.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.177+0000 7f22189f3640 1 --2- 172.21.15.16:0/1582384948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140fdbe0 0x7f22140fdfe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2204009880 tx=0x7f220403b4c0 comp rx=0 tx=0).stop 2024-08-01T07:00:50.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.177+0000 7f22189f3640 1 -- 172.21.15.16:0/1582384948 shutdown_connections 2024-08-01T07:00:50.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.177+0000 7f22189f3640 1 --2- 172.21.15.16:0/1582384948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22140fede0 0x7f22140ff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:50.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.177+0000 7f22189f3640 1 --2- 172.21.15.16:0/1582384948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140fdbe0 0x7f22140fdfe0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:50.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.177+0000 7f22189f3640 1 -- 172.21.15.16:0/1582384948 >> 172.21.15.16:0/1582384948 conn(0x7f22140f9370 msgr2=0x7f22140fb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:50.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.178+0000 7f22189f3640 1 -- 172.21.15.16:0/1582384948 shutdown_connections 2024-08-01T07:00:50.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.178+0000 7f22189f3640 1 -- 172.21.15.16:0/1582384948 wait complete. 2024-08-01T07:00:50.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.179+0000 7f22189f3640 1 Processor -- start 2024-08-01T07:00:50.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.179+0000 7f22189f3640 1 -- start start 2024-08-01T07:00:50.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.179+0000 7f22189f3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140fdbe0 0x7f2214105de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:50.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.180+0000 7f22189f3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22140fede0 0x7f2214106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:50.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.180+0000 7f22189f3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2214106940 con 0x7f22140fdbe0 2024-08-01T07:00:50.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.180+0000 7f22189f3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2214106ab0 con 0x7f22140fede0 2024-08-01T07:00:50.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.180+0000 7f22137fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140fdbe0 0x7f2214105de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:50.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.180+0000 7f22137fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140fdbe0 0x7f2214105de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54058/0 (socket says 172.21.15.16:54058) 2024-08-01T07:00:50.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.180+0000 7f22137fe640 1 -- 172.21.15.16:0/1962923928 learned_addr learned my addr 172.21.15.16:0/1962923928 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:00:50.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.180+0000 7f22137fe640 1 -- 172.21.15.16:0/1962923928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22140fede0 msgr2=0x7f2214106320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-01T07:00:50.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.180+0000 7f22137fe640 1 --2- 172.21.15.16:0/1962923928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22140fede0 0x7f2214106320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:50.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.180+0000 7f22137fe640 1 -- 172.21.15.16:0/1962923928 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2204009560 con 0x7f22140fdbe0 2024-08-01T07:00:50.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.182+0000 7f22137fe640 1 --2- 172.21.15.16:0/1962923928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140fdbe0 0x7f2214105de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2204009850 tx=0x7f2204005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:50.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.183+0000 7f2210ff9640 1 -- 172.21.15.16:0/1962923928 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2204004b60 con 0x7f22140fdbe0 2024-08-01T07:00:50.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.183+0000 7f2210ff9640 1 -- 172.21.15.16:0/1962923928 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2204004cc0 con 0x7f22140fdbe0 2024-08-01T07:00:50.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.184+0000 7f2210ff9640 1 -- 172.21.15.16:0/1962923928 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2204003ae0 con 0x7f22140fdbe0 2024-08-01T07:00:50.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.185+0000 7f22189f3640 1 -- 172.21.15.16:0/1962923928 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221410b4e0 con 0x7f22140fdbe0 2024-08-01T07:00:50.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.185+0000 7f22189f3640 1 -- 172.21.15.16:0/1962923928 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221410b9d0 con 0x7f22140fdbe0 2024-08-01T07:00:50.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.187+0000 7f22189f3640 1 -- 172.21.15.16:0/1962923928 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22140fe060 con 0x7f22140fdbe0 2024-08-01T07:00:50.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.188+0000 7f2210ff9640 1 -- 172.21.15.16:0/1962923928 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2204003c40 con 0x7f22140fdbe0 2024-08-01T07:00:50.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.189+0000 7f2210ff9640 1 --2- 172.21.15.16:0/1962923928 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f21fc06e050 0x7f21fc070510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:00:50.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.190+0000 7f2210ff9640 1 -- 172.21.15.16:0/1962923928 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f22040bffb0 con 0x7f22140fdbe0 2024-08-01T07:00:50.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.190+0000 7f2212ffd640 1 --2- 172.21.15.16:0/1962923928 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f21fc06e050 0x7f21fc070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:00:50.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.192+0000 7f2212ffd640 1 --2- 172.21.15.16:0/1962923928 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f21fc06e050 0x7f21fc070510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2214106f10 tx=0x7f2208006c20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:00:50.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.200+0000 7f2210ff9640 1 -- 172.21.15.16:0/1962923928 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2204089340 con 0x7f22140fdbe0 2024-08-01T07:00:50.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:50 smithi016 ceph-mon[93645]: pgmap v92: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 38/288 objects degraded (13.194%) 2024-08-01T07:00:50.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:50 smithi016 ceph-mon[93645]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:00:50.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:50 smithi016 ceph-mon[93645]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-01T07:00:50.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:50 smithi016 ceph-mon[93645]: osd.2 [v2:172.21.15.16:6818/3998232796,v1:172.21.15.16:6819/3998232796] boot 2024-08-01T07:00:50.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:50 smithi016 ceph-mon[93645]: osdmap e63: 6 total, 6 up, 6 in 2024-08-01T07:00:50.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:50 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T07:00:50.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:50 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/4192782116' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:00:50.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:50 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/3206054566' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:00:50.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.448+0000 7f22189f3640 1 -- 172.21.15.16:0/1962923928 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f221410be80 con 0x7f22140fdbe0 2024-08-01T07:00:50.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.449+0000 7f2210ff9640 1 -- 172.21.15.16:0/1962923928 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+907 (secure 0 0 0) 0x7f2204051090 con 0x7f22140fdbe0 2024-08-01T07:00:50.451 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_WARN Degraded data redundancy: 38/288 objects degraded (13.194%), 13 pgs degraded 2024-08-01T07:00:50.451 INFO:teuthology.orchestra.run.smithi016.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 38/288 objects degraded (13.194%), 13 pgs degraded 2024-08-01T07:00:50.451 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-08-01T07:00:50.451 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-08-01T07:00:50.451 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-08-01T07:00:50.451 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-08-01T07:00:50.451 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-08-01T07:00:50.451 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-08-01T07:00:50.451 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-08-01T07:00:50.451 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-08-01T07:00:50.451 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-08-01T07:00:50.452 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.17 is active+undersized+degraded, acting [5,1] 2024-08-01T07:00:50.452 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-08-01T07:00:50.452 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-08-01T07:00:50.452 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-08-01T07:00:50.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.451+0000 7f22189f3640 1 -- 172.21.15.16:0/1962923928 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f21fc06e050 msgr2=0x7f21fc070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:50.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.451+0000 7f22189f3640 1 --2- 172.21.15.16:0/1962923928 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f21fc06e050 0x7f21fc070510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2214106f10 tx=0x7f2208006c20 comp rx=0 tx=0).stop 2024-08-01T07:00:50.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.451+0000 7f22189f3640 1 -- 172.21.15.16:0/1962923928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140fdbe0 msgr2=0x7f2214105de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:00:50.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.451+0000 7f22189f3640 1 --2- 172.21.15.16:0/1962923928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140fdbe0 0x7f2214105de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2204009850 tx=0x7f2204005630 comp rx=0 tx=0).stop 2024-08-01T07:00:50.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.451+0000 7f22189f3640 1 -- 172.21.15.16:0/1962923928 shutdown_connections 2024-08-01T07:00:50.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.451+0000 7f22189f3640 1 --2- 172.21.15.16:0/1962923928 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f21fc06e050 0x7f21fc070510 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:50.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.451+0000 7f22189f3640 1 --2- 172.21.15.16:0/1962923928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22140fede0 0x7f2214106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:50.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.451+0000 7f22189f3640 1 --2- 172.21.15.16:0/1962923928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140fdbe0 0x7f2214105de0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:00:50.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.451+0000 7f22189f3640 1 -- 172.21.15.16:0/1962923928 >> 172.21.15.16:0/1962923928 conn(0x7f22140f9370 msgr2=0x7f22140f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:00:50.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.451+0000 7f22189f3640 1 -- 172.21.15.16:0/1962923928 shutdown_connections 2024-08-01T07:00:50.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:00:50.451+0000 7f22189f3640 1 -- 172.21.15.16:0/1962923928 wait complete. 2024-08-01T07:00:50.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:50 smithi089 ceph-mon[82218]: pgmap v92: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 38/288 objects degraded (13.194%) 2024-08-01T07:00:50.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:50 smithi089 ceph-mon[82218]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:00:50.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:50 smithi089 ceph-mon[82218]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-01T07:00:50.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:50 smithi089 ceph-mon[82218]: osd.2 [v2:172.21.15.16:6818/3998232796,v1:172.21.15.16:6819/3998232796] boot 2024-08-01T07:00:50.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:50 smithi089 ceph-mon[82218]: osdmap e63: 6 total, 6 up, 6 in 2024-08-01T07:00:50.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:50 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-01T07:00:50.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:50 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/4192782116' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:00:50.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:50 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/3206054566' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:00:51.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:51 smithi016 ceph-mon[93645]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:00:51.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:51 smithi016 ceph-mon[93645]: osdmap e64: 6 total, 6 up, 6 in 2024-08-01T07:00:51.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:51 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/1962923928' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:00:51.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:51 smithi089 ceph-mon[82218]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:00:51.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:51 smithi089 ceph-mon[82218]: osdmap e64: 6 total, 6 up, 6 in 2024-08-01T07:00:51.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:51 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/1962923928' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:00:52.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:52 smithi016 ceph-mon[93645]: pgmap v95: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 38/288 objects degraded (13.194%) 2024-08-01T07:00:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:00:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:00:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:00:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:00:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:00:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:00:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-01T07:00:52.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:52 smithi016 ceph-mon[93645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-01T07:00:52.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:52 smithi016 ceph-mon[93645]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-08-01T07:00:52.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:52 smithi089 ceph-mon[82218]: pgmap v95: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 38/288 objects degraded (13.194%) 2024-08-01T07:00:52.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:52.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:52.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:00:52.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:00:52.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:00:52.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:00:52.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:00:52.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:00:52.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:00:52.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-01T07:00:52.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:52 smithi089 ceph-mon[82218]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-01T07:00:52.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:52 smithi089 ceph-mon[82218]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-08-01T07:00:53.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:53 smithi089 ceph-mon[82218]: Health check update: Degraded data redundancy: 23/288 objects degraded (7.986%), 8 pgs degraded (PG_DEGRADED) 2024-08-01T07:00:53.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:53 smithi016 ceph-mon[93645]: Health check update: Degraded data redundancy: 23/288 objects degraded (7.986%), 8 pgs degraded (PG_DEGRADED) 2024-08-01T07:00:54.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:54 smithi089 ceph-mon[82218]: pgmap v96: 65 pgs: 9 active+undersized, 8 active+undersized+degraded, 48 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 4 op/s; 23/288 objects degraded (7.986%) 2024-08-01T07:00:54.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:54 smithi016 ceph-mon[93645]: pgmap v96: 65 pgs: 9 active+undersized, 8 active+undersized+degraded, 48 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 4 op/s; 23/288 objects degraded (7.986%) 2024-08-01T07:00:55.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:55 smithi089 ceph-mon[82218]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/288 objects degraded (7.986%), 8 pgs degraded) 2024-08-01T07:00:55.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:55 smithi089 ceph-mon[82218]: Cluster is now healthy 2024-08-01T07:00:55.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:55 smithi016 ceph-mon[93645]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/288 objects degraded (7.986%), 8 pgs degraded) 2024-08-01T07:00:55.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:55 smithi016 ceph-mon[93645]: Cluster is now healthy 2024-08-01T07:00:56.891 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:56 smithi089 ceph-mon[82218]: pgmap v97: 65 pgs: 65 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-08-01T07:00:56.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:56 smithi016 ceph-mon[93645]: pgmap v97: 65 pgs: 65 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-08-01T07:00:58.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:00:58 smithi089 ceph-mon[82218]: pgmap v98: 65 pgs: 65 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s 2024-08-01T07:00:58.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:00:58 smithi016 ceph-mon[93645]: pgmap v98: 65 pgs: 65 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s 2024-08-01T07:01:00.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:00 smithi089 ceph-mon[82218]: pgmap v99: 65 pgs: 65 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-08-01T07:01:00.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:00 smithi016 ceph-mon[93645]: pgmap v99: 65 pgs: 65 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-08-01T07:01:02.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:02 smithi089 ceph-mon[82218]: pgmap v100: 65 pgs: 65 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-01T07:01:02.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:02.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:01:02.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:02.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:02 smithi016 ceph-mon[93645]: pgmap v100: 65 pgs: 65 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-01T07:01:02.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:02.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:01:02.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:04.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:04 smithi089 ceph-mon[82218]: pgmap v101: 65 pgs: 65 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s 2024-08-01T07:01:04.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:04 smithi016 ceph-mon[93645]: pgmap v101: 65 pgs: 65 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s 2024-08-01T07:01:06.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:06 smithi089 ceph-mon[82218]: pgmap v102: 65 pgs: 65 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:01:06.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:06 smithi016 ceph-mon[93645]: pgmap v102: 65 pgs: 65 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:01:07.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-01T07:01:07.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:07 smithi089 ceph-mon[82218]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-01T07:01:07.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:07 smithi089 ceph-mon[82218]: Upgrade: osd.3 is safe to restart 2024-08-01T07:01:07.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-01T07:01:07.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:07 smithi016 ceph-mon[93645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-01T07:01:07.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:07 smithi016 ceph-mon[93645]: Upgrade: osd.3 is safe to restart 2024-08-01T07:01:08.734 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:08 smithi089 ceph-mon[82218]: pgmap v103: 65 pgs: 65 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:01:08.734 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:08 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:08.734 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:08 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-01T07:01:08.734 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:08 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:01:08.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:08 smithi016 ceph-mon[93645]: pgmap v103: 65 pgs: 65 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:01:08.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:08 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:08.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:08 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-01T07:01:08.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:08 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:01:09.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:09 smithi089 ceph-mon[82218]: Upgrade: Updating osd.3 2024-08-01T07:01:09.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:09 smithi089 ceph-mon[82218]: Deploying daemon osd.3 on smithi089 2024-08-01T07:01:09.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:09 smithi016 ceph-mon[93645]: Upgrade: Updating osd.3 2024-08-01T07:01:09.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:09 smithi016 ceph-mon[93645]: Deploying daemon osd.3 on smithi089 2024-08-01T07:01:10.862 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:10 smithi089 ceph-mon[82218]: pgmap v104: 65 pgs: 65 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:01:10.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:10 smithi016 ceph-mon[93645]: pgmap v104: 65 pgs: 65 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:01:11.137 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:11 smithi089 systemd[1]: Stopping Ceph osd.3 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T07:01:11.580 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:11 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3[42442]: 2024-08-01T07:01:11.374+0000 7fe2f8f2c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-01T07:01:11.580 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:11 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3[42442]: 2024-08-01T07:01:11.374+0000 7fe2f8f2c640 -1 osd.3 64 *** Got signal Terminated *** 2024-08-01T07:01:11.580 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:11 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3[42442]: 2024-08-01T07:01:11.374+0000 7fe2f8f2c640 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-01T07:01:11.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:11 smithi089 ceph-mon[82218]: osd.3 marked itself down and dead 2024-08-01T07:01:11.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:11 smithi016 ceph-mon[93645]: osd.3 marked itself down and dead 2024-08-01T07:01:12.387 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:12 smithi089 podman[91192]: 2024-08-01 07:01:12.121710092 +0000 UTC m=+0.875167158 container died 58c175e0f4eb4168aefe937be8f35099725ecdd23b7fb3ce05ec94cec2a23299 (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3, RELEASE=reef-a3bbd72, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240716, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0) 2024-08-01T07:01:12.768 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:12 smithi089 ceph-mon[82218]: pgmap v105: 65 pgs: 65 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:01:12.768 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:12 smithi089 ceph-mon[82218]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-01T07:01:12.768 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:12 smithi089 ceph-mon[82218]: osdmap e65: 6 total, 5 up, 6 in 2024-08-01T07:01:12.769 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:12 smithi089 podman[91192]: 2024-08-01 07:01:12.491111035 +0000 UTC m=+1.244568103 container cleanup 58c175e0f4eb4168aefe937be8f35099725ecdd23b7fb3ce05ec94cec2a23299 (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240716, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=reef-a3bbd72, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-08-01T07:01:12.769 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:12 smithi089 bash[91192]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3 2024-08-01T07:01:12.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:12 smithi016 ceph-mon[93645]: pgmap v105: 65 pgs: 65 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:01:12.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:12 smithi016 ceph-mon[93645]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-01T07:01:12.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:12 smithi016 ceph-mon[93645]: osdmap e65: 6 total, 5 up, 6 in 2024-08-01T07:01:13.090 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:12 smithi089 podman[91212]: 2024-08-01 07:01:12.767590136 +0000 UTC m=+0.648971027 container remove 58c175e0f4eb4168aefe937be8f35099725ecdd23b7fb3ce05ec94cec2a23299 (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3, RELEASE=reef-a3bbd72, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240716, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-08-01T07:01:13.347 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:13 smithi089 podman[91297]: 2024-08-01 07:01:12.991877677 +0000 UTC m=+0.017266001 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:01:13.347 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:13 smithi089 podman[91297]: 2024-08-01 07:01:13.118703681 +0000 UTC m=+0.144091988 container create 9cccae74f17fe5ad06caa4e6365ee9265a2e7997993455611f92913f14bee657 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-f9911e1, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-01T07:01:13.348 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:13 smithi089 podman[91297]: 2024-08-01 07:01:13.346515936 +0000 UTC m=+0.371904240 container init 9cccae74f17fe5ad06caa4e6365ee9265a2e7997993455611f92913f14bee657 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, RELEASE=squid-f9911e1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-01T07:01:13.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:13 smithi089 ceph-mon[82218]: osdmap e66: 6 total, 5 up, 6 in 2024-08-01T07:01:13.637 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:13 smithi089 podman[91297]: 2024-08-01 07:01:13.349939306 +0000 UTC m=+0.375327613 container start 9cccae74f17fe5ad06caa4e6365ee9265a2e7997993455611f92913f14bee657 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-deactivate, RELEASE=squid-f9911e1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-08-01T07:01:13.637 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:13 smithi089 podman[91297]: 2024-08-01 07:01:13.421381495 +0000 UTC m=+0.446769821 container attach 9cccae74f17fe5ad06caa4e6365ee9265a2e7997993455611f92913f14bee657 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-f9911e1, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-08-01T07:01:13.638 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:13 smithi089 podman[91297]: 2024-08-01 07:01:13.534084182 +0000 UTC m=+0.559472486 container died 9cccae74f17fe5ad06caa4e6365ee9265a2e7997993455611f92913f14bee657 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f9911e1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-01T07:01:13.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:13 smithi016 ceph-mon[93645]: osdmap e66: 6 total, 5 up, 6 in 2024-08-01T07:01:14.586 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:14 smithi089 podman[91320]: 2024-08-01 07:01:14.155146611 +0000 UTC m=+0.615246365 container remove 9cccae74f17fe5ad06caa4e6365ee9265a2e7997993455611f92913f14bee657 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f9911e1, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-01T07:01:14.586 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:14 smithi089 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.3.service: Deactivated successfully. 2024-08-01T07:01:14.586 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:14 smithi089 systemd[1]: Stopped Ceph osd.3 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T07:01:14.586 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:14 smithi089 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.3.service: Consumed 1min 16.765s CPU time. 2024-08-01T07:01:14.586 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:14 smithi089 systemd[1]: Starting Ceph osd.3 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T07:01:14.839 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:14 smithi089 ceph-mon[82218]: pgmap v108: 65 pgs: 10 active+undersized, 6 stale+active+clean, 8 active+undersized+degraded, 41 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 34/288 objects degraded (11.806%) 2024-08-01T07:01:14.839 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:14 smithi089 ceph-mon[82218]: Health check failed: Degraded data redundancy: 34/288 objects degraded (11.806%), 8 pgs degraded (PG_DEGRADED) 2024-08-01T07:01:14.839 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:14 smithi089 podman[91417]: 2024-08-01 07:01:14.584935157 +0000 UTC m=+0.114279106 container create 9081f9df076b2fe10a0db583b997497d0b67bec7acb5439d79a20d46566234e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=squid-f9911e1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD) 2024-08-01T07:01:14.839 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:14 smithi089 podman[91417]: 2024-08-01 07:01:14.487955553 +0000 UTC m=+0.017299459 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:01:14.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:14 smithi016 ceph-mon[93645]: pgmap v108: 65 pgs: 10 active+undersized, 6 stale+active+clean, 8 active+undersized+degraded, 41 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 34/288 objects degraded (11.806%) 2024-08-01T07:01:14.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:14 smithi016 ceph-mon[93645]: Health check failed: Degraded data redundancy: 34/288 objects degraded (11.806%), 8 pgs degraded (PG_DEGRADED) 2024-08-01T07:01:15.137 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:14 smithi089 podman[91417]: 2024-08-01 07:01:14.838079812 +0000 UTC m=+0.367423724 container init 9081f9df076b2fe10a0db583b997497d0b67bec7acb5439d79a20d46566234e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, RELEASE=squid-f9911e1, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-08-01T07:01:15.138 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:14 smithi089 podman[91417]: 2024-08-01 07:01:14.841662686 +0000 UTC m=+0.371006591 container start 9081f9df076b2fe10a0db583b997497d0b67bec7acb5439d79a20d46566234e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-activate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f9911e1, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724) 2024-08-01T07:01:15.138 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:14 smithi089 podman[91417]: 2024-08-01 07:01:14.904364037 +0000 UTC m=+0.433707944 container attach 9081f9df076b2fe10a0db583b997497d0b67bec7acb5439d79a20d46566234e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f9911e1, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-01T07:01:15.138 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:14 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-activate[91431]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:01:15.138 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:14 smithi089 bash[91417]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:01:15.138 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:14 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-activate[91431]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:01:15.138 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:14 smithi089 bash[91417]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:01:15.533 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:15 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-activate[91431]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-01T07:01:15.533 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:15 smithi089 bash[91417]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-01T07:01:15.534 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:15 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-activate[91431]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-08-01T07:01:15.534 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:15 smithi089 bash[91417]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-08-01T07:01:15.534 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:15 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-activate[91431]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-08-01T07:01:15.534 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:15 smithi089 bash[91417]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-08-01T07:01:15.534 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:15 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-activate[91431]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-08-01T07:01:15.534 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:15 smithi089 bash[91417]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-08-01T07:01:15.534 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:15 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-activate[91431]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-08-01T07:01:15.534 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:15 smithi089 bash[91417]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-08-01T07:01:15.534 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:15 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-activate[91431]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-01T07:01:15.534 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:15 smithi089 bash[91417]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-01T07:01:15.534 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:15 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-activate[91431]: --> ceph-volume raw activate successful for osd ID: 3 2024-08-01T07:01:15.534 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:15 smithi089 bash[91417]: --> ceph-volume raw activate successful for osd ID: 3 2024-08-01T07:01:15.535 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:15 smithi089 podman[91417]: 2024-08-01 07:01:15.221556967 +0000 UTC m=+0.750900868 container died 9081f9df076b2fe10a0db583b997497d0b67bec7acb5439d79a20d46566234e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f9911e1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-01T07:01:16.137 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:15 smithi089 podman[91554]: 2024-08-01 07:01:15.808174841 +0000 UTC m=+0.580784936 container remove 9081f9df076b2fe10a0db583b997497d0b67bec7acb5439d79a20d46566234e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-activate, RELEASE=squid-f9911e1, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-01T07:01:16.137 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:16 smithi089 podman[91612]: 2024-08-01 07:01:15.923033468 +0000 UTC m=+0.016899925 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:01:16.137 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:16 smithi089 podman[91612]: 2024-08-01 07:01:16.042549906 +0000 UTC m=+0.136416346 container create 9a18feae4353cd48f65d81e135c61642a658db8b6acf03891d25ad4d0f14d16f (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f9911e1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240724, GIT_CLEAN=True) 2024-08-01T07:01:16.414 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:16 smithi089 podman[91612]: 2024-08-01 07:01:16.295250624 +0000 UTC m=+0.389117066 container init 9a18feae4353cd48f65d81e135c61642a658db8b6acf03891d25ad4d0f14d16f (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-f9911e1, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-01T07:01:16.415 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:16 smithi089 podman[91612]: 2024-08-01 07:01:16.298499237 +0000 UTC m=+0.392365678 container start 9a18feae4353cd48f65d81e135c61642a658db8b6acf03891d25ad4d0f14d16f (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3, RELEASE=squid-f9911e1, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-01T07:01:16.415 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:16 smithi089 ceph-osd[91631]: -- 172.21.15.89:0/84231175 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5577ef3bc1e0 con 0x5577ef354000 2024-08-01T07:01:16.415 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:16 smithi089 bash[91612]: 9a18feae4353cd48f65d81e135c61642a658db8b6acf03891d25ad4d0f14d16f 2024-08-01T07:01:16.841 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:16 smithi089 systemd[1]: Started Ceph osd.3 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T07:01:16.841 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:16 smithi089 ceph-mon[82218]: pgmap v109: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 64/288 objects degraded (22.222%) 2024-08-01T07:01:16.841 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:16 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:16.842 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:16 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:16.842 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:16 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:01:16.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:16 smithi016 ceph-mon[93645]: pgmap v109: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 64/288 objects degraded (22.222%) 2024-08-01T07:01:16.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:16 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:16.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:16 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:16.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:16 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:01:17.137 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:16 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3[91627]: 2024-08-01T07:01:16.839+0000 7f9268369640 -1 Falling back to public interface 2024-08-01T07:01:18.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:18 smithi016 ceph-mon[93645]: pgmap v110: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 64/288 objects degraded (22.222%) 2024-08-01T07:01:18.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:18.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:01:18.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:18 smithi089 ceph-mon[82218]: pgmap v110: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 64/288 objects degraded (22.222%) 2024-08-01T07:01:18.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:18.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:01:20.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.549+0000 7f1247194640 1 -- 172.21.15.16:0/1277012254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1240100630 msgr2=0x7f1240102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:20.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.549+0000 7f1247194640 1 --2- 172.21.15.16:0/1277012254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1240100630 0x7f1240102a20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f12340098b0 tx=0x7f123402a4d0 comp rx=0 tx=0).stop 2024-08-01T07:01:20.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.550+0000 7f1247194640 1 -- 172.21.15.16:0/1277012254 shutdown_connections 2024-08-01T07:01:20.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.550+0000 7f1247194640 1 --2- 172.21.15.16:0/1277012254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1240102f60 0x7f1240105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:20.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.550+0000 7f1247194640 1 --2- 172.21.15.16:0/1277012254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1240100630 0x7f1240102a20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:20.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.550+0000 7f1247194640 1 -- 172.21.15.16:0/1277012254 >> 172.21.15.16:0/1277012254 conn(0x7f12400fa250 msgr2=0x7f12400fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:20.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.550+0000 7f1247194640 1 -- 172.21.15.16:0/1277012254 shutdown_connections 2024-08-01T07:01:20.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.550+0000 7f1247194640 1 -- 172.21.15.16:0/1277012254 wait complete. 2024-08-01T07:01:20.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.550+0000 7f1247194640 1 Processor -- start 2024-08-01T07:01:20.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.550+0000 7f1247194640 1 -- start start 2024-08-01T07:01:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.551+0000 7f1247194640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1240100630 0x7f1240195660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.551+0000 7f1247194640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1240102f60 0x7f1240195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.551+0000 7f1247194640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1240196170 con 0x7f1240102f60 2024-08-01T07:01:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.551+0000 7f1247194640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12401962e0 con 0x7f1240100630 2024-08-01T07:01:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.551+0000 7f123ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1240102f60 0x7f1240195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.551+0000 7f1244f30640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1240100630 0x7f1240195660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.551+0000 7f123ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1240102f60 0x7f1240195ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40776/0 (socket says 172.21.15.16:40776) 2024-08-01T07:01:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.551+0000 7f1244f30640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1240100630 0x7f1240195660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:56680/0 (socket says 172.21.15.16:56680) 2024-08-01T07:01:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.551+0000 7f123ffff640 1 -- 172.21.15.16:0/2259584658 learned_addr learned my addr 172.21.15.16:0/2259584658 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:01:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.551+0000 7f1244f30640 1 -- 172.21.15.16:0/2259584658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1240102f60 msgr2=0x7f1240195ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.551+0000 7f1244f30640 1 --2- 172.21.15.16:0/2259584658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1240102f60 0x7f1240195ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.551+0000 7f1244f30640 1 -- 172.21.15.16:0/2259584658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1234009560 con 0x7f1240100630 2024-08-01T07:01:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.551+0000 7f1244f30640 1 --2- 172.21.15.16:0/2259584658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1240100630 0x7f1240195660 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f123402a9f0 tx=0x7f12340055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:20.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.552+0000 7f123dffb640 1 -- 172.21.15.16:0/2259584658 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1234004aa0 con 0x7f1240100630 2024-08-01T07:01:20.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.552+0000 7f1247194640 1 -- 172.21.15.16:0/2259584658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124019ad20 con 0x7f1240100630 2024-08-01T07:01:20.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.552+0000 7f123dffb640 1 -- 172.21.15.16:0/2259584658 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1234004c00 con 0x7f1240100630 2024-08-01T07:01:20.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.552+0000 7f123dffb640 1 -- 172.21.15.16:0/2259584658 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1234003a80 con 0x7f1240100630 2024-08-01T07:01:20.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.552+0000 7f1247194640 1 -- 172.21.15.16:0/2259584658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124019b240 con 0x7f1240100630 2024-08-01T07:01:20.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.553+0000 7f1247194640 1 -- 172.21.15.16:0/2259584658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12401087e0 con 0x7f1240100630 2024-08-01T07:01:20.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.554+0000 7f123dffb640 1 -- 172.21.15.16:0/2259584658 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1234031c90 con 0x7f1240100630 2024-08-01T07:01:20.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.554+0000 7f123dffb640 1 --2- 172.21.15.16:0/2259584658 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f123006e170 0x7f1230070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:20.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.554+0000 7f123dffb640 1 -- 172.21.15.16:0/2259584658 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f12340af2b0 con 0x7f1240100630 2024-08-01T07:01:20.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.555+0000 7f123ffff640 1 --2- 172.21.15.16:0/2259584658 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f123006e170 0x7f1230070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:20.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.555+0000 7f123ffff640 1 --2- 172.21.15.16:0/2259584658 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f123006e170 0x7f1230070630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1240196b80 tx=0x7f122c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:20.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.560+0000 7f123dffb640 1 -- 172.21.15.16:0/2259584658 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f12340785f0 con 0x7f1240100630 2024-08-01T07:01:20.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:20 smithi089 ceph-mon[82218]: pgmap v111: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 64/288 objects degraded (22.222%) 2024-08-01T07:01:20.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:20 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:20.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:20 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:20.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:20 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:20.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:20 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:20.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:20 smithi016 ceph-mon[93645]: pgmap v111: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 64/288 objects degraded (22.222%) 2024-08-01T07:01:20.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:20 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:20.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:20 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:20.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:20 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:20.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:20 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:20.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.755+0000 7f1247194640 1 -- 172.21.15.16:0/2259584658 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1240103980 con 0x7f123006e170 2024-08-01T07:01:20.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.756+0000 7f123dffb640 1 -- 172.21.15.16:0/2259584658 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f1240103980 con 0x7f123006e170 2024-08-01T07:01:20.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.758+0000 7f1247194640 1 -- 172.21.15.16:0/2259584658 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f123006e170 msgr2=0x7f1230070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:20.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.758+0000 7f1247194640 1 --2- 172.21.15.16:0/2259584658 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f123006e170 0x7f1230070630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1240196b80 tx=0x7f122c00b410 comp rx=0 tx=0).stop 2024-08-01T07:01:20.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.758+0000 7f1247194640 1 -- 172.21.15.16:0/2259584658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1240100630 msgr2=0x7f1240195660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:20.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.758+0000 7f1247194640 1 --2- 172.21.15.16:0/2259584658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1240100630 0x7f1240195660 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f123402a9f0 tx=0x7f12340055a0 comp rx=0 tx=0).stop 2024-08-01T07:01:20.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.758+0000 7f1247194640 1 -- 172.21.15.16:0/2259584658 shutdown_connections 2024-08-01T07:01:20.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.758+0000 7f1247194640 1 --2- 172.21.15.16:0/2259584658 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f123006e170 0x7f1230070630 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:20.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.758+0000 7f1247194640 1 --2- 172.21.15.16:0/2259584658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1240102f60 0x7f1240195ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:20.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.758+0000 7f1247194640 1 --2- 172.21.15.16:0/2259584658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1240100630 0x7f1240195660 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:20.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.758+0000 7f1247194640 1 -- 172.21.15.16:0/2259584658 >> 172.21.15.16:0/2259584658 conn(0x7f12400fa250 msgr2=0x7f12400fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:20.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.758+0000 7f1247194640 1 -- 172.21.15.16:0/2259584658 shutdown_connections 2024-08-01T07:01:20.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.758+0000 7f1247194640 1 -- 172.21.15.16:0/2259584658 wait complete. 2024-08-01T07:01:20.769 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T07:01:20.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.843+0000 7f564d7a7640 1 -- 172.21.15.16:0/770293347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56480ffb90 msgr2=0x7f56480fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:20.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.843+0000 7f564d7a7640 1 --2- 172.21.15.16:0/770293347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56480ffb90 0x7f56480fff90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5638009880 tx=0x7f563802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:01:20.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.843+0000 7f564d7a7640 1 -- 172.21.15.16:0/770293347 shutdown_connections 2024-08-01T07:01:20.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.843+0000 7f564d7a7640 1 --2- 172.21.15.16:0/770293347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5648100d90 0x7f5648101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:20.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.843+0000 7f564d7a7640 1 --2- 172.21.15.16:0/770293347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56480ffb90 0x7f56480fff90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:20.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.843+0000 7f564d7a7640 1 -- 172.21.15.16:0/770293347 >> 172.21.15.16:0/770293347 conn(0x7f56480fb320 msgr2=0x7f56480fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:20.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.843+0000 7f564d7a7640 1 -- 172.21.15.16:0/770293347 shutdown_connections 2024-08-01T07:01:20.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.843+0000 7f564d7a7640 1 -- 172.21.15.16:0/770293347 wait complete. 2024-08-01T07:01:20.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.844+0000 7f564d7a7640 1 Processor -- start 2024-08-01T07:01:20.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.844+0000 7f564d7a7640 1 -- start start 2024-08-01T07:01:20.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.844+0000 7f564d7a7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56480ffb90 0x7f5648074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:20.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.844+0000 7f564d7a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5648100d90 0x7f56480728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:20.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.844+0000 7f564d7a7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5648072de0 con 0x7f5648100d90 2024-08-01T07:01:20.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.844+0000 7f564d7a7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5648072f50 con 0x7f56480ffb90 2024-08-01T07:01:20.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.844+0000 7f563ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5648100d90 0x7f56480728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:20.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.844+0000 7f563ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5648100d90 0x7f56480728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40788/0 (socket says 172.21.15.16:40788) 2024-08-01T07:01:20.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.844+0000 7f563ffff640 1 -- 172.21.15.16:0/3614769699 learned_addr learned my addr 172.21.15.16:0/3614769699 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:01:20.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.844+0000 7f5646ffd640 1 --2- 172.21.15.16:0/3614769699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56480ffb90 0x7f5648074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:20.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.844+0000 7f563ffff640 1 -- 172.21.15.16:0/3614769699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56480ffb90 msgr2=0x7f5648074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:20.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.844+0000 7f563ffff640 1 --2- 172.21.15.16:0/3614769699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56480ffb90 0x7f5648074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:20.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.844+0000 7f563ffff640 1 -- 172.21.15.16:0/3614769699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5638009560 con 0x7f5648100d90 2024-08-01T07:01:20.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.845+0000 7f563ffff640 1 --2- 172.21.15.16:0/3614769699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5648100d90 0x7f56480728a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f563000e970 tx=0x7f563000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:20.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.845+0000 7f5644ff9640 1 -- 172.21.15.16:0/3614769699 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f563000cc90 con 0x7f5648100d90 2024-08-01T07:01:20.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.845+0000 7f5644ff9640 1 -- 172.21.15.16:0/3614769699 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f563000cdf0 con 0x7f5648100d90 2024-08-01T07:01:20.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.845+0000 7f5644ff9640 1 -- 172.21.15.16:0/3614769699 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5630010430 con 0x7f5648100d90 2024-08-01T07:01:20.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.845+0000 7f564d7a7640 1 -- 172.21.15.16:0/3614769699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5648073230 con 0x7f5648100d90 2024-08-01T07:01:20.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.845+0000 7f564d7a7640 1 -- 172.21.15.16:0/3614769699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564819d6f0 con 0x7f5648100d90 2024-08-01T07:01:20.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.846+0000 7f564d7a7640 1 -- 172.21.15.16:0/3614769699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564818f730 con 0x7f5648100d90 2024-08-01T07:01:20.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.846+0000 7f5644ff9640 1 -- 172.21.15.16:0/3614769699 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f56300046c0 con 0x7f5648100d90 2024-08-01T07:01:20.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.847+0000 7f5644ff9640 1 --2- 172.21.15.16:0/3614769699 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f563406e180 0x7f5634070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:20.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.847+0000 7f5644ff9640 1 -- 172.21.15.16:0/3614769699 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f5630014070 con 0x7f5648100d90 2024-08-01T07:01:20.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.847+0000 7f5646ffd640 1 --2- 172.21.15.16:0/3614769699 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f563406e180 0x7f5634070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:20.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.847+0000 7f5646ffd640 1 --2- 172.21.15.16:0/3614769699 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f563406e180 0x7f5634070640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5638006010 tx=0x7f56380314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:20.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:20.851+0000 7f5644ff9640 1 -- 172.21.15.16:0/3614769699 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5630057950 con 0x7f5648100d90 2024-08-01T07:01:21.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.044+0000 7f564d7a7640 1 -- 172.21.15.16:0/3614769699 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f564802c4c0 con 0x7f563406e180 2024-08-01T07:01:21.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.045+0000 7f5644ff9640 1 -- 172.21.15.16:0/3614769699 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f564802c4c0 con 0x7f563406e180 2024-08-01T07:01:21.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.047+0000 7f564d7a7640 1 -- 172.21.15.16:0/3614769699 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f563406e180 msgr2=0x7f5634070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:21.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.047+0000 7f564d7a7640 1 --2- 172.21.15.16:0/3614769699 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f563406e180 0x7f5634070640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5638006010 tx=0x7f56380314e0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.047+0000 7f564d7a7640 1 -- 172.21.15.16:0/3614769699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5648100d90 msgr2=0x7f56480728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:21.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.047+0000 7f564d7a7640 1 --2- 172.21.15.16:0/3614769699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5648100d90 0x7f56480728a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f563000e970 tx=0x7f563000ed70 comp rx=0 tx=0).stop 2024-08-01T07:01:21.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.048+0000 7f564d7a7640 1 -- 172.21.15.16:0/3614769699 shutdown_connections 2024-08-01T07:01:21.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.048+0000 7f564d7a7640 1 --2- 172.21.15.16:0/3614769699 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f563406e180 0x7f5634070640 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.048+0000 7f564d7a7640 1 --2- 172.21.15.16:0/3614769699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5648100d90 0x7f56480728a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.048+0000 7f564d7a7640 1 --2- 172.21.15.16:0/3614769699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56480ffb90 0x7f5648074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.048+0000 7f564d7a7640 1 -- 172.21.15.16:0/3614769699 >> 172.21.15.16:0/3614769699 conn(0x7f56480fb320 msgr2=0x7f56481044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:21.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.048+0000 7f564d7a7640 1 -- 172.21.15.16:0/3614769699 shutdown_connections 2024-08-01T07:01:21.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.048+0000 7f564d7a7640 1 -- 172.21.15.16:0/3614769699 wait complete. 2024-08-01T07:01:21.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.132+0000 7f7b24d77640 1 -- 172.21.15.16:0/388208788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100060 msgr2=0x7f7b20100460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:21.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.132+0000 7f7b24d77640 1 --2- 172.21.15.16:0/388208788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100060 0x7f7b20100460 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009880 tx=0x7f7b1002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.132+0000 7f7b24d77640 1 -- 172.21.15.16:0/388208788 shutdown_connections 2024-08-01T07:01:21.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.132+0000 7f7b24d77640 1 --2- 172.21.15.16:0/388208788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b20100a30 0x7f7b200fdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.132+0000 7f7b24d77640 1 --2- 172.21.15.16:0/388208788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100060 0x7f7b20100460 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.132+0000 7f7b24d77640 1 -- 172.21.15.16:0/388208788 >> 172.21.15.16:0/388208788 conn(0x7f7b200f99c0 msgr2=0x7f7b200fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:21.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.132+0000 7f7b24d77640 1 -- 172.21.15.16:0/388208788 shutdown_connections 2024-08-01T07:01:21.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.132+0000 7f7b24d77640 1 -- 172.21.15.16:0/388208788 wait complete. 2024-08-01T07:01:21.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.133+0000 7f7b24d77640 1 Processor -- start 2024-08-01T07:01:21.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.133+0000 7f7b24d77640 1 -- start start 2024-08-01T07:01:21.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.133+0000 7f7b24d77640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100060 0x7f7b201978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:21.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.133+0000 7f7b24d77640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b20100a30 0x7f7b20197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:21.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.133+0000 7f7b24d77640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b20198330 con 0x7f7b20100060 2024-08-01T07:01:21.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.133+0000 7f7b24d77640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b201984a0 con 0x7f7b20100a30 2024-08-01T07:01:21.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.133+0000 7f7b1e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100060 0x7f7b201978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:21.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.133+0000 7f7b1e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100060 0x7f7b201978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40794/0 (socket says 172.21.15.16:40794) 2024-08-01T07:01:21.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.133+0000 7f7b1e59c640 1 -- 172.21.15.16:0/51592880 learned_addr learned my addr 172.21.15.16:0/51592880 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:01:21.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.133+0000 7f7b1dd9b640 1 --2- 172.21.15.16:0/51592880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b20100a30 0x7f7b20197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:21.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.134+0000 7f7b1e59c640 1 -- 172.21.15.16:0/51592880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b20100a30 msgr2=0x7f7b20197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:21.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.134+0000 7f7b1e59c640 1 --2- 172.21.15.16:0/51592880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b20100a30 0x7f7b20197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.134+0000 7f7b1e59c640 1 -- 172.21.15.16:0/51592880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b10009560 con 0x7f7b20100060 2024-08-01T07:01:21.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.134+0000 7f7b1e59c640 1 --2- 172.21.15.16:0/51592880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100060 0x7f7b201978b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009230 tx=0x7f7b100055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:21.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.134+0000 7f7b177fe640 1 -- 172.21.15.16:0/51592880 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b10004aa0 con 0x7f7b20100060 2024-08-01T07:01:21.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.134+0000 7f7b177fe640 1 -- 172.21.15.16:0/51592880 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b10004c00 con 0x7f7b20100060 2024-08-01T07:01:21.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.134+0000 7f7b24d77640 1 -- 172.21.15.16:0/51592880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2019cf20 con 0x7f7b20100060 2024-08-01T07:01:21.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.134+0000 7f7b177fe640 1 -- 172.21.15.16:0/51592880 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b10003b50 con 0x7f7b20100060 2024-08-01T07:01:21.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.134+0000 7f7b24d77640 1 -- 172.21.15.16:0/51592880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2019d410 con 0x7f7b20100060 2024-08-01T07:01:21.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.135+0000 7f7b24d77640 1 -- 172.21.15.16:0/51592880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b20191920 con 0x7f7b20100060 2024-08-01T07:01:21.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.135+0000 7f7b177fe640 1 -- 172.21.15.16:0/51592880 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7b10031640 con 0x7f7b20100060 2024-08-01T07:01:21.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.136+0000 7f7b177fe640 1 --2- 172.21.15.16:0/51592880 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7b0c06e180 0x7f7b0c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:21.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.136+0000 7f7b177fe640 1 -- 172.21.15.16:0/51592880 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f7b100af350 con 0x7f7b20100060 2024-08-01T07:01:21.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.136+0000 7f7b1dd9b640 1 --2- 172.21.15.16:0/51592880 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7b0c06e180 0x7f7b0c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:21.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.136+0000 7f7b1dd9b640 1 --2- 172.21.15.16:0/51592880 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7b0c06e180 0x7f7b0c070640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b08005e10 tx=0x7f7b08005da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:21.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.140+0000 7f7b177fe640 1 -- 172.21.15.16:0/51592880 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7b10078680 con 0x7f7b20100060 2024-08-01T07:01:21.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.324+0000 7f7b24d77640 1 -- 172.21.15.16:0/51592880 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b2002c4f0 con 0x7f7b0c06e180 2024-08-01T07:01:21.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.334+0000 7f7b177fe640 1 -- 172.21.15.16:0/51592880 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f7b2002c4f0 con 0x7f7b0c06e180 2024-08-01T07:01:21.335 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T07:01:21.335 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (11m) 34s ago 13m 25.2M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T07:01:21.335 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (13m) 34s ago 13m 8929k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T07:01:21.336 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (12m) 1s ago 12m 8258k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T07:01:21.336 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (2m) 34s ago 13m 6899k - 19.1.0-1223-gf9911e17 93d93c74a2cc 2a96028287a2 2024-08-01T07:01:21.336 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (2m) 1s ago 12m 6895k - 19.1.0-1223-gf9911e17 93d93c74a2cc 8a23341bd6c3 2024-08-01T07:01:21.336 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (11m) 34s ago 13m 84.5M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T07:01:21.336 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (8m) 34s ago 8m 89.3M - 18.2.2-1767-ga3bbd728 d280790d1980 96e46c28d16c 2024-08-01T07:01:21.336 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (7m) 34s ago 7m 147M - 18.2.2-1767-ga3bbd728 d280790d1980 4bbe1a388689 2024-08-01T07:01:21.336 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (8m) 1s ago 8m 27.0M - 18.2.2-1767-ga3bbd728 d280790d1980 65ca121a6fbb 2024-08-01T07:01:21.336 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (7m) 1s ago 7m 25.4M - 18.2.2-1767-ga3bbd728 d280790d1980 05bb46c6fe94 2024-08-01T07:01:21.336 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:8443,9283,8765 running (4m) 34s ago 14m 501M - 19.1.0-1223-gf9911e17 93d93c74a2cc 8701e6315593 2024-08-01T07:01:21.336 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (3m) 1s ago 12m 440M - 19.1.0-1223-gf9911e17 93d93c74a2cc c6caa21f436f 2024-08-01T07:01:21.336 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (3m) 34s ago 14m 48.2M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc 48e94d076e6f 2024-08-01T07:01:21.337 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (2m) 1s ago 12m 38.7M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc c4b83b46ff15 2024-08-01T07:01:21.337 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (13m) 34s ago 13m 15.9M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T07:01:21.337 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (12m) 1s ago 12m 16.3M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T07:01:21.337 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (109s) 34s ago 11m 93.0M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 4c2115ae6222 2024-08-01T07:01:21.337 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (74s) 34s ago 11m 95.5M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc fc2f7117be30 2024-08-01T07:01:21.337 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (39s) 34s ago 10m 12.1M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 3364752c9365 2024-08-01T07:01:21.337 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (5s) 1s ago 10m 12.1M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 9a18feae4353 2024-08-01T07:01:21.337 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (9m) 1s ago 9m 262M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 15b8f910bad7 2024-08-01T07:01:21.337 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (9m) 1s ago 9m 236M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 ac887841899e 2024-08-01T07:01:21.337 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (3m) 34s ago 12m 60.6M - 2.43.0 a07b618ecd1d 45d23c96382e 2024-08-01T07:01:21.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.336+0000 7f7b24d77640 1 -- 172.21.15.16:0/51592880 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7b0c06e180 msgr2=0x7f7b0c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:21.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.336+0000 7f7b24d77640 1 --2- 172.21.15.16:0/51592880 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7b0c06e180 0x7f7b0c070640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b08005e10 tx=0x7f7b08005da0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.336+0000 7f7b24d77640 1 -- 172.21.15.16:0/51592880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100060 msgr2=0x7f7b201978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:21.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.336+0000 7f7b24d77640 1 --2- 172.21.15.16:0/51592880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100060 0x7f7b201978b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009230 tx=0x7f7b100055a0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.336+0000 7f7b24d77640 1 -- 172.21.15.16:0/51592880 shutdown_connections 2024-08-01T07:01:21.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.336+0000 7f7b24d77640 1 --2- 172.21.15.16:0/51592880 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7b0c06e180 0x7f7b0c070640 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.336+0000 7f7b24d77640 1 --2- 172.21.15.16:0/51592880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b20100a30 0x7f7b20197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.336+0000 7f7b24d77640 1 --2- 172.21.15.16:0/51592880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b20100060 0x7f7b201978b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.336+0000 7f7b24d77640 1 -- 172.21.15.16:0/51592880 >> 172.21.15.16:0/51592880 conn(0x7f7b200f99c0 msgr2=0x7f7b201077a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:21.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.336+0000 7f7b24d77640 1 -- 172.21.15.16:0/51592880 shutdown_connections 2024-08-01T07:01:21.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.336+0000 7f7b24d77640 1 -- 172.21.15.16:0/51592880 wait complete. 2024-08-01T07:01:21.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.419+0000 7fdec6e77640 1 -- 172.21.15.16:0/250985380 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec00ffb90 msgr2=0x7fdec00fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:21.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.419+0000 7fdec6e77640 1 --2- 172.21.15.16:0/250985380 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec00ffb90 0x7fdec00fff90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009880 tx=0x7fdeb402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.419+0000 7fdec6e77640 1 -- 172.21.15.16:0/250985380 shutdown_connections 2024-08-01T07:01:21.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.419+0000 7fdec6e77640 1 --2- 172.21.15.16:0/250985380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdec0100d90 0x7fdec0101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.419+0000 7fdec6e77640 1 --2- 172.21.15.16:0/250985380 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec00ffb90 0x7fdec00fff90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.419+0000 7fdec6e77640 1 -- 172.21.15.16:0/250985380 >> 172.21.15.16:0/250985380 conn(0x7fdec00fb320 msgr2=0x7fdec00fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:21.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.419+0000 7fdec6e77640 1 -- 172.21.15.16:0/250985380 shutdown_connections 2024-08-01T07:01:21.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.419+0000 7fdec6e77640 1 -- 172.21.15.16:0/250985380 wait complete. 2024-08-01T07:01:21.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.420+0000 7fdec6e77640 1 Processor -- start 2024-08-01T07:01:21.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.420+0000 7fdec6e77640 1 -- start start 2024-08-01T07:01:21.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.420+0000 7fdec6e77640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdec00ffb90 0x7fdec0195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:21.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.420+0000 7fdec6e77640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec0100d90 0x7fdec0195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:21.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.420+0000 7fdec6e77640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec0196180 con 0x7fdec0100d90 2024-08-01T07:01:21.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.420+0000 7fdec6e77640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec01962f0 con 0x7fdec00ffb90 2024-08-01T07:01:21.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.420+0000 7fdebffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec0100d90 0x7fdec0195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:21.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.420+0000 7fdebffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec0100d90 0x7fdec0195bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40808/0 (socket says 172.21.15.16:40808) 2024-08-01T07:01:21.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.420+0000 7fdebffff640 1 -- 172.21.15.16:0/1585999079 learned_addr learned my addr 172.21.15.16:0/1585999079 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:01:21.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.420+0000 7fdec4c13640 1 --2- 172.21.15.16:0/1585999079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdec00ffb90 0x7fdec0195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:21.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.420+0000 7fdebffff640 1 -- 172.21.15.16:0/1585999079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdec00ffb90 msgr2=0x7fdec0195670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:21.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.420+0000 7fdebffff640 1 --2- 172.21.15.16:0/1585999079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdec00ffb90 0x7fdec0195670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.420+0000 7fdebffff640 1 -- 172.21.15.16:0/1585999079 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb4009560 con 0x7fdec0100d90 2024-08-01T07:01:21.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.421+0000 7fdebffff640 1 --2- 172.21.15.16:0/1585999079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec0100d90 0x7fdec0195bb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdeac00d900 tx=0x7fdeac00ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:21.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.421+0000 7fdebdffb640 1 -- 172.21.15.16:0/1585999079 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdeac009c00 con 0x7fdec0100d90 2024-08-01T07:01:21.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.421+0000 7fdec6e77640 1 -- 172.21.15.16:0/1585999079 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec019ad90 con 0x7fdec0100d90 2024-08-01T07:01:21.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.421+0000 7fdebdffb640 1 -- 172.21.15.16:0/1585999079 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdeac009d60 con 0x7fdec0100d90 2024-08-01T07:01:21.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.421+0000 7fdebdffb640 1 -- 172.21.15.16:0/1585999079 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdeac0049d0 con 0x7fdec0100d90 2024-08-01T07:01:21.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.421+0000 7fdec6e77640 1 -- 172.21.15.16:0/1585999079 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec019b2b0 con 0x7fdec0100d90 2024-08-01T07:01:21.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.422+0000 7fdec6e77640 1 -- 172.21.15.16:0/1585999079 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec00fff90 con 0x7fdec0100d90 2024-08-01T07:01:21.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.423+0000 7fdebdffb640 1 -- 172.21.15.16:0/1585999079 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdeac004020 con 0x7fdec0100d90 2024-08-01T07:01:21.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.423+0000 7fdebdffb640 1 --2- 172.21.15.16:0/1585999079 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fdeb006e170 0x7fdeb0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:21.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.423+0000 7fdebdffb640 1 -- 172.21.15.16:0/1585999079 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fdeac08de20 con 0x7fdec0100d90 2024-08-01T07:01:21.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.423+0000 7fdec4c13640 1 --2- 172.21.15.16:0/1585999079 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fdeb006e170 0x7fdeb0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:21.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.424+0000 7fdec4c13640 1 --2- 172.21.15.16:0/1585999079 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fdeb006e170 0x7fdeb0070630 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4005940 tx=0x7fdeb40058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:21.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.427+0000 7fdebdffb640 1 -- 172.21.15.16:0/1585999079 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fdeac057150 con 0x7fdec0100d90 2024-08-01T07:01:21.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:21 smithi089 ceph-mon[82218]: Health check update: Degraded data redundancy: 64/288 objects degraded (22.222%), 19 pgs degraded (PG_DEGRADED) 2024-08-01T07:01:21.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:21 smithi089 ceph-mon[82218]: from='client.44211 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:01:21.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:21 smithi016 ceph-mon[93645]: Health check update: Degraded data redundancy: 64/288 objects degraded (22.222%), 19 pgs degraded (PG_DEGRADED) 2024-08-01T07:01:21.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:21 smithi016 ceph-mon[93645]: from='client.44211 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:01:21.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.673+0000 7fdec6e77640 1 -- 172.21.15.16:0/1585999079 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdec018f710 con 0x7fdec0100d90 2024-08-01T07:01:21.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.673+0000 7fdebdffb640 1 -- 172.21.15.16:0/1585999079 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+832 (secure 0 0 0) 0x7fdeac05a810 con 0x7fdec0100d90 2024-08-01T07:01:21.675 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:01:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T07:01:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:01:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:01:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T07:01:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:01:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:01:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T07:01:21.675 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 2, 2024-08-01T07:01:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 3 2024-08-01T07:01:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:01:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T07:01:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4 2024-08-01T07:01:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:01:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T07:01:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 6, 2024-08-01T07:01:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 7 2024-08-01T07:01:21.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T07:01:21.676 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:01:21.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.675+0000 7fdec6e77640 1 -- 172.21.15.16:0/1585999079 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fdeb006e170 msgr2=0x7fdeb0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:21.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.675+0000 7fdec6e77640 1 --2- 172.21.15.16:0/1585999079 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fdeb006e170 0x7fdeb0070630 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4005940 tx=0x7fdeb40058d0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.675+0000 7fdec6e77640 1 -- 172.21.15.16:0/1585999079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec0100d90 msgr2=0x7fdec0195bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:21.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.675+0000 7fdec6e77640 1 --2- 172.21.15.16:0/1585999079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec0100d90 0x7fdec0195bb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdeac00d900 tx=0x7fdeac00ddc0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.675+0000 7fdec6e77640 1 -- 172.21.15.16:0/1585999079 shutdown_connections 2024-08-01T07:01:21.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.675+0000 7fdec6e77640 1 --2- 172.21.15.16:0/1585999079 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fdeb006e170 0x7fdeb0070630 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.675+0000 7fdec6e77640 1 --2- 172.21.15.16:0/1585999079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec0100d90 0x7fdec0195bb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.675+0000 7fdec6e77640 1 --2- 172.21.15.16:0/1585999079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdec00ffb90 0x7fdec0195670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.675+0000 7fdec6e77640 1 -- 172.21.15.16:0/1585999079 >> 172.21.15.16:0/1585999079 conn(0x7fdec00fb320 msgr2=0x7fdec0104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:21.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.676+0000 7fdec6e77640 1 -- 172.21.15.16:0/1585999079 shutdown_connections 2024-08-01T07:01:21.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.676+0000 7fdec6e77640 1 -- 172.21.15.16:0/1585999079 wait complete. 2024-08-01T07:01:21.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.759+0000 7fad91d9e640 1 -- 172.21.15.16:0/4244288091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad8c0feaf0 msgr2=0x7fad8c0feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:21.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.759+0000 7fad91d9e640 1 --2- 172.21.15.16:0/4244288091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad8c0feaf0 0x7fad8c0feef0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009880 tx=0x7fad7c02a4a0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.759+0000 7fad91d9e640 1 -- 172.21.15.16:0/4244288091 shutdown_connections 2024-08-01T07:01:21.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.759+0000 7fad91d9e640 1 --2- 172.21.15.16:0/4244288091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad8c0ffcf0 0x7fad8c100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.759+0000 7fad91d9e640 1 --2- 172.21.15.16:0/4244288091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad8c0feaf0 0x7fad8c0feef0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.759+0000 7fad91d9e640 1 -- 172.21.15.16:0/4244288091 >> 172.21.15.16:0/4244288091 conn(0x7fad8c0fa280 msgr2=0x7fad8c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:21.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.759+0000 7fad91d9e640 1 -- 172.21.15.16:0/4244288091 shutdown_connections 2024-08-01T07:01:21.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.759+0000 7fad91d9e640 1 -- 172.21.15.16:0/4244288091 wait complete. 2024-08-01T07:01:21.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.759+0000 7fad91d9e640 1 Processor -- start 2024-08-01T07:01:21.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.759+0000 7fad91d9e640 1 -- start start 2024-08-01T07:01:21.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.760+0000 7fad91d9e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad8c0feaf0 0x7fad8c195730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:21.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.760+0000 7fad91d9e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad8c0ffcf0 0x7fad8c195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:21.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.760+0000 7fad91d9e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c196240 con 0x7fad8c0ffcf0 2024-08-01T07:01:21.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.760+0000 7fad91d9e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c1963b0 con 0x7fad8c0feaf0 2024-08-01T07:01:21.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.760+0000 7fad82ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad8c0ffcf0 0x7fad8c195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:21.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.760+0000 7fad8b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad8c0feaf0 0x7fad8c195730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:21.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.760+0000 7fad82ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad8c0ffcf0 0x7fad8c195c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40822/0 (socket says 172.21.15.16:40822) 2024-08-01T07:01:21.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.760+0000 7fad8b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad8c0feaf0 0x7fad8c195730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:56768/0 (socket says 172.21.15.16:56768) 2024-08-01T07:01:21.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.760+0000 7fad82ffd640 1 -- 172.21.15.16:0/2479307824 learned_addr learned my addr 172.21.15.16:0/2479307824 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:01:21.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.760+0000 7fad8b7fe640 1 -- 172.21.15.16:0/2479307824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad8c0ffcf0 msgr2=0x7fad8c195c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:21.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.760+0000 7fad8b7fe640 1 --2- 172.21.15.16:0/2479307824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad8c0ffcf0 0x7fad8c195c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.760+0000 7fad8b7fe640 1 -- 172.21.15.16:0/2479307824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7c009560 con 0x7fad8c0feaf0 2024-08-01T07:01:21.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.760+0000 7fad82ffd640 1 --2- 172.21.15.16:0/2479307824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad8c0ffcf0 0x7fad8c195c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T07:01:21.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.761+0000 7fad8b7fe640 1 --2- 172.21.15.16:0/2479307824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad8c0feaf0 0x7fad8c195730 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fad7c02a9c0 tx=0x7fad7c0055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:21.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.761+0000 7fad897fa640 1 -- 172.21.15.16:0/2479307824 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad7c004aa0 con 0x7fad8c0feaf0 2024-08-01T07:01:21.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.761+0000 7fad897fa640 1 -- 172.21.15.16:0/2479307824 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad7c005d50 con 0x7fad8c0feaf0 2024-08-01T07:01:21.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.761+0000 7fad91d9e640 1 -- 172.21.15.16:0/2479307824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8c19adf0 con 0x7fad8c0feaf0 2024-08-01T07:01:21.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.761+0000 7fad897fa640 1 -- 172.21.15.16:0/2479307824 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad7c003a20 con 0x7fad8c0feaf0 2024-08-01T07:01:21.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.761+0000 7fad91d9e640 1 -- 172.21.15.16:0/2479307824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8c19b250 con 0x7fad8c0feaf0 2024-08-01T07:01:21.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.762+0000 7fad91d9e640 1 -- 172.21.15.16:0/2479307824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad8c107700 con 0x7fad8c0feaf0 2024-08-01T07:01:21.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.762+0000 7fad897fa640 1 -- 172.21.15.16:0/2479307824 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fad7c031c90 con 0x7fad8c0feaf0 2024-08-01T07:01:21.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.763+0000 7fad897fa640 1 --2- 172.21.15.16:0/2479307824 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fad7806e180 0x7fad78070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:21.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.763+0000 7fad897fa640 1 -- 172.21.15.16:0/2479307824 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fad7c0af030 con 0x7fad8c0feaf0 2024-08-01T07:01:21.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.763+0000 7fad82ffd640 1 --2- 172.21.15.16:0/2479307824 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fad7806e180 0x7fad78070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:21.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.763+0000 7fad82ffd640 1 --2- 172.21.15.16:0/2479307824 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fad7806e180 0x7fad78070640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fad8c196c50 tx=0x7fad74005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:21.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.768+0000 7fad897fa640 1 -- 172.21.15.16:0/2479307824 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fad7c078410 con 0x7fad8c0feaf0 2024-08-01T07:01:21.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.979+0000 7fad91d9e640 1 -- 172.21.15.16:0/2479307824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fad8c19b7f0 con 0x7fad8c0feaf0 2024-08-01T07:01:21.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.979+0000 7fad897fa640 1 -- 172.21.15.16:0/2479307824 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1938 (secure 0 0 0) 0x7fad7c07bad0 con 0x7fad8c0feaf0 2024-08-01T07:01:21.981 INFO:teuthology.orchestra.run.smithi016.stdout:e19 2024-08-01T07:01:21.981 INFO:teuthology.orchestra.run.smithi016.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-08-01T07:01:21.981 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T07:01:21.981 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T07:01:21.982 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T07:01:21.982 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:01:21.982 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T07:01:21.982 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T07:01:21.982 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 19 2024-08-01T07:01:21.982 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T07:01:21.982 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T07:01:21.982 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T06:53:32.617145+0000 2024-08-01T07:01:21.982 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T07:01:21.982 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T07:01:21.982 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T07:01:21.982 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T07:01:21.982 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T07:01:21.983 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T07:01:21.983 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T07:01:21.983 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T07:01:21.983 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 46 2024-08-01T07:01:21.983 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T07:01:21.983 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T07:01:21.983 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T07:01:21.983 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=14482,1=24281} 2024-08-01T07:01:21.983 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T07:01:21.983 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T07:01:21.983 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T07:01:21.983 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T07:01:21.983 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T07:01:21.983 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T07:01:21.984 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T07:01:21.984 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T07:01:21.984 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T07:01:21.984 INFO:teuthology.orchestra.run.smithi016.stdout:qdb_cluster leader: 0 members: 2024-08-01T07:01:21.984 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:01:21.984 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:24299} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:01:21.984 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{1:24281} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:01:21.984 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:24291} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:01:21.984 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:01:21.984 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:01:21.985 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-08-01T07:01:21.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.982+0000 7fad91d9e640 1 -- 172.21.15.16:0/2479307824 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fad7806e180 msgr2=0x7fad78070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:21.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.982+0000 7fad91d9e640 1 --2- 172.21.15.16:0/2479307824 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fad7806e180 0x7fad78070640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fad8c196c50 tx=0x7fad74005f90 comp rx=0 tx=0).stop 2024-08-01T07:01:21.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.982+0000 7fad91d9e640 1 -- 172.21.15.16:0/2479307824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad8c0feaf0 msgr2=0x7fad8c195730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:21.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.982+0000 7fad91d9e640 1 --2- 172.21.15.16:0/2479307824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad8c0feaf0 0x7fad8c195730 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fad7c02a9c0 tx=0x7fad7c0055a0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.982+0000 7fad91d9e640 1 -- 172.21.15.16:0/2479307824 shutdown_connections 2024-08-01T07:01:21.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.982+0000 7fad91d9e640 1 --2- 172.21.15.16:0/2479307824 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fad7806e180 0x7fad78070640 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.982+0000 7fad91d9e640 1 --2- 172.21.15.16:0/2479307824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad8c0ffcf0 0x7fad8c195c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.982+0000 7fad91d9e640 1 --2- 172.21.15.16:0/2479307824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad8c0feaf0 0x7fad8c195730 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:21.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.982+0000 7fad91d9e640 1 -- 172.21.15.16:0/2479307824 >> 172.21.15.16:0/2479307824 conn(0x7fad8c0fa280 msgr2=0x7fad8c067cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:21.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.982+0000 7fad91d9e640 1 -- 172.21.15.16:0/2479307824 shutdown_connections 2024-08-01T07:01:21.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:21.982+0000 7fad91d9e640 1 -- 172.21.15.16:0/2479307824 wait complete. 2024-08-01T07:01:22.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.068+0000 7f877dc09640 1 -- 172.21.15.16:0/2045600659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87780fea80 msgr2=0x7f87780fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:22.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.068+0000 7f877dc09640 1 --2- 172.21.15.16:0/2045600659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87780fea80 0x7f87780fee80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8768009880 tx=0x7f876802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:01:22.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.068+0000 7f877dc09640 1 -- 172.21.15.16:0/2045600659 shutdown_connections 2024-08-01T07:01:22.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.068+0000 7f877dc09640 1 --2- 172.21.15.16:0/2045600659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87780ffc80 0x7f8778100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:22.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.068+0000 7f877dc09640 1 --2- 172.21.15.16:0/2045600659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87780fea80 0x7f87780fee80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:22.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.068+0000 7f877dc09640 1 -- 172.21.15.16:0/2045600659 >> 172.21.15.16:0/2045600659 conn(0x7f87780fa230 msgr2=0x7f87780fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:22.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.068+0000 7f877dc09640 1 -- 172.21.15.16:0/2045600659 shutdown_connections 2024-08-01T07:01:22.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.068+0000 7f877dc09640 1 -- 172.21.15.16:0/2045600659 wait complete. 2024-08-01T07:01:22.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.069+0000 7f877dc09640 1 Processor -- start 2024-08-01T07:01:22.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.069+0000 7f877dc09640 1 -- start start 2024-08-01T07:01:22.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.069+0000 7f877dc09640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87780fea80 0x7f8778102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:22.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.069+0000 7f877dc09640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87780ffc80 0x7f8778101060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:22.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.069+0000 7f877dc09640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87781015a0 con 0x7f87780ffc80 2024-08-01T07:01:22.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.069+0000 7f877dc09640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8778101710 con 0x7f87780fea80 2024-08-01T07:01:22.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.069+0000 7f876ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87780ffc80 0x7f8778101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:22.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.069+0000 7f87777fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87780fea80 0x7f8778102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:22.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.069+0000 7f876ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87780ffc80 0x7f8778101060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40840/0 (socket says 172.21.15.16:40840) 2024-08-01T07:01:22.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.069+0000 7f87777fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87780fea80 0x7f8778102a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:56796/0 (socket says 172.21.15.16:56796) 2024-08-01T07:01:22.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.069+0000 7f876ffff640 1 -- 172.21.15.16:0/1582330470 learned_addr learned my addr 172.21.15.16:0/1582330470 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:01:22.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.069+0000 7f87777fe640 1 -- 172.21.15.16:0/1582330470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87780ffc80 msgr2=0x7f8778101060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:22.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.069+0000 7f87777fe640 1 --2- 172.21.15.16:0/1582330470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87780ffc80 0x7f8778101060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:22.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.069+0000 7f87777fe640 1 -- 172.21.15.16:0/1582330470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8768009560 con 0x7f87780fea80 2024-08-01T07:01:22.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.069+0000 7f876ffff640 1 --2- 172.21.15.16:0/1582330470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87780ffc80 0x7f8778101060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T07:01:22.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.070+0000 7f87777fe640 1 --2- 172.21.15.16:0/1582330470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87780fea80 0x7f8778102a10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f876802a9c0 tx=0x7f87680055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:22.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.070+0000 7f87757fa640 1 -- 172.21.15.16:0/1582330470 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8768004aa0 con 0x7f87780fea80 2024-08-01T07:01:22.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.070+0000 7f877dc09640 1 -- 172.21.15.16:0/1582330470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8778101990 con 0x7f87780fea80 2024-08-01T07:01:22.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.070+0000 7f87757fa640 1 -- 172.21.15.16:0/1582330470 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8768005d50 con 0x7f87780fea80 2024-08-01T07:01:22.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.070+0000 7f87757fa640 1 -- 172.21.15.16:0/1582330470 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87680039b0 con 0x7f87780fea80 2024-08-01T07:01:22.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.070+0000 7f877dc09640 1 -- 172.21.15.16:0/1582330470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877819d6a0 con 0x7f87780fea80 2024-08-01T07:01:22.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.071+0000 7f877dc09640 1 -- 172.21.15.16:0/1582330470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87780fee80 con 0x7f87780fea80 2024-08-01T07:01:22.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.071+0000 7f87757fa640 1 -- 172.21.15.16:0/1582330470 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8768031c00 con 0x7f87780fea80 2024-08-01T07:01:22.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.072+0000 7f87757fa640 1 --2- 172.21.15.16:0/1582330470 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f876406e180 0x7f8764070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:22.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.072+0000 7f87757fa640 1 -- 172.21.15.16:0/1582330470 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f87680af160 con 0x7f87780fea80 2024-08-01T07:01:22.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.072+0000 7f876ffff640 1 --2- 172.21.15.16:0/1582330470 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f876406e180 0x7f8764070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:22.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.072+0000 7f876ffff640 1 --2- 172.21.15.16:0/1582330470 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f876406e180 0x7f8764070640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8778102790 tx=0x7f8760005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:22.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.076+0000 7f87757fa640 1 -- 172.21.15.16:0/1582330470 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f87680784a0 con 0x7f87780fea80 2024-08-01T07:01:22.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.271+0000 7f877dc09640 1 -- 172.21.15.16:0/1582330470 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8778068c50 con 0x7f876406e180 2024-08-01T07:01:22.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.272+0000 7f87757fa640 1 -- 172.21.15.16:0/1582330470 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f8778068c50 con 0x7f876406e180 2024-08-01T07:01:22.273 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:01:22.273 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T07:01:22.273 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T07:01:22.273 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T07:01:22.273 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-08-01T07:01:22.274 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-08-01T07:01:22.274 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr", 2024-08-01T07:01:22.274 INFO:teuthology.orchestra.run.smithi016.stdout: "crash" 2024-08-01T07:01:22.274 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-08-01T07:01:22.274 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "10/23 daemons upgraded", 2024-08-01T07:01:22.274 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-08-01T07:01:22.274 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T07:01:22.274 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:01:22.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.274+0000 7f877dc09640 1 -- 172.21.15.16:0/1582330470 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f876406e180 msgr2=0x7f8764070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:22.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.274+0000 7f877dc09640 1 --2- 172.21.15.16:0/1582330470 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f876406e180 0x7f8764070640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8778102790 tx=0x7f8760005f90 comp rx=0 tx=0).stop 2024-08-01T07:01:22.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.274+0000 7f877dc09640 1 -- 172.21.15.16:0/1582330470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87780fea80 msgr2=0x7f8778102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:22.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.274+0000 7f877dc09640 1 --2- 172.21.15.16:0/1582330470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87780fea80 0x7f8778102a10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f876802a9c0 tx=0x7f87680055a0 comp rx=0 tx=0).stop 2024-08-01T07:01:22.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.274+0000 7f877dc09640 1 -- 172.21.15.16:0/1582330470 shutdown_connections 2024-08-01T07:01:22.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.274+0000 7f877dc09640 1 --2- 172.21.15.16:0/1582330470 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f876406e180 0x7f8764070640 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:22.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.274+0000 7f877dc09640 1 --2- 172.21.15.16:0/1582330470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87780ffc80 0x7f8778101060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:22.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.274+0000 7f877dc09640 1 --2- 172.21.15.16:0/1582330470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87780fea80 0x7f8778102a10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:22.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.274+0000 7f877dc09640 1 -- 172.21.15.16:0/1582330470 >> 172.21.15.16:0/1582330470 conn(0x7f87780fa230 msgr2=0x7f8778068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:22.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.274+0000 7f877dc09640 1 -- 172.21.15.16:0/1582330470 shutdown_connections 2024-08-01T07:01:22.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.274+0000 7f877dc09640 1 -- 172.21.15.16:0/1582330470 wait complete. 2024-08-01T07:01:22.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.358+0000 7f29f4e34640 1 -- 172.21.15.16:0/4198528330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29f0100d80 msgr2=0x7f29f0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:22.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.358+0000 7f29f4e34640 1 --2- 172.21.15.16:0/4198528330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29f0100d80 0x7f29f0101200 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009880 tx=0x7f29e402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:01:22.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.358+0000 7f29f4e34640 1 -- 172.21.15.16:0/4198528330 shutdown_connections 2024-08-01T07:01:22.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.358+0000 7f29f4e34640 1 --2- 172.21.15.16:0/4198528330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29f0100d80 0x7f29f0101200 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:22.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.358+0000 7f29f4e34640 1 --2- 172.21.15.16:0/4198528330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29f00ffb80 0x7f29f00fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:22.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.358+0000 7f29f4e34640 1 -- 172.21.15.16:0/4198528330 >> 172.21.15.16:0/4198528330 conn(0x7f29f00fb330 msgr2=0x7f29f00fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:22.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.358+0000 7f29f4e34640 1 -- 172.21.15.16:0/4198528330 shutdown_connections 2024-08-01T07:01:22.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.358+0000 7f29f4e34640 1 -- 172.21.15.16:0/4198528330 wait complete. 2024-08-01T07:01:22.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.359+0000 7f29f4e34640 1 Processor -- start 2024-08-01T07:01:22.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.359+0000 7f29f4e34640 1 -- start start 2024-08-01T07:01:22.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.359+0000 7f29f4e34640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29f00ffb80 0x7f29f01955c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:22.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.359+0000 7f29f4e34640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29f0100d80 0x7f29f0195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:22.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.359+0000 7f29f4e34640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f01960d0 con 0x7f29f0100d80 2024-08-01T07:01:22.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.359+0000 7f29f4e34640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f0196240 con 0x7f29f00ffb80 2024-08-01T07:01:22.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.359+0000 7f29edd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29f0100d80 0x7f29f0195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:22.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.359+0000 7f29edd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29f0100d80 0x7f29f0195b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40864/0 (socket says 172.21.15.16:40864) 2024-08-01T07:01:22.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.359+0000 7f29edd9b640 1 -- 172.21.15.16:0/3481468371 learned_addr learned my addr 172.21.15.16:0/3481468371 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:01:22.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.359+0000 7f29ee59c640 1 --2- 172.21.15.16:0/3481468371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29f00ffb80 0x7f29f01955c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:22.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.360+0000 7f29edd9b640 1 -- 172.21.15.16:0/3481468371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29f00ffb80 msgr2=0x7f29f01955c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:22.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.360+0000 7f29edd9b640 1 --2- 172.21.15.16:0/3481468371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29f00ffb80 0x7f29f01955c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:22.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.360+0000 7f29edd9b640 1 -- 172.21.15.16:0/3481468371 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e4009560 con 0x7f29f0100d80 2024-08-01T07:01:22.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.360+0000 7f29ee59c640 1 --2- 172.21.15.16:0/3481468371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29f00ffb80 0x7f29f01955c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T07:01:22.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.360+0000 7f29edd9b640 1 --2- 172.21.15.16:0/3481468371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29f0100d80 0x7f29f0195b00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f29e40055a0 tx=0x7f29e40055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:22.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.360+0000 7f29df7fe640 1 -- 172.21.15.16:0/3481468371 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e4004aa0 con 0x7f29f0100d80 2024-08-01T07:01:22.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.360+0000 7f29f4e34640 1 -- 172.21.15.16:0/3481468371 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f019ac80 con 0x7f29f0100d80 2024-08-01T07:01:22.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.360+0000 7f29df7fe640 1 -- 172.21.15.16:0/3481468371 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29e4004c00 con 0x7f29f0100d80 2024-08-01T07:01:22.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.360+0000 7f29df7fe640 1 -- 172.21.15.16:0/3481468371 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e4003b10 con 0x7f29f0100d80 2024-08-01T07:01:22.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.360+0000 7f29f4e34640 1 -- 172.21.15.16:0/3481468371 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f019b1f0 con 0x7f29f0100d80 2024-08-01T07:01:22.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.361+0000 7f29f4e34640 1 -- 172.21.15.16:0/3481468371 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f0108790 con 0x7f29f0100d80 2024-08-01T07:01:22.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.362+0000 7f29df7fe640 1 -- 172.21.15.16:0/3481468371 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f29e4003d40 con 0x7f29f0100d80 2024-08-01T07:01:22.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.362+0000 7f29df7fe640 1 --2- 172.21.15.16:0/3481468371 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f29d806e170 0x7f29d8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:22.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.362+0000 7f29df7fe640 1 -- 172.21.15.16:0/3481468371 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f29e40af180 con 0x7f29f0100d80 2024-08-01T07:01:22.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.362+0000 7f29ee59c640 1 --2- 172.21.15.16:0/3481468371 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f29d806e170 0x7f29d8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:22.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.363+0000 7f29ee59c640 1 --2- 172.21.15.16:0/3481468371 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f29d806e170 0x7f29d8070630 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f29f0100be0 tx=0x7f29e0005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:22.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.367+0000 7f29df7fe640 1 -- 172.21.15.16:0/3481468371 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f29e4078620 con 0x7f29f0100d80 2024-08-01T07:01:22.547 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:22 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3[91627]: 2024-08-01T07:01:22.266+0000 7f9268369640 -1 osd.3 64 log_to_monitors true 2024-08-01T07:01:22.547 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:01:22 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3[91627]: 2024-08-01T07:01:22.406+0000 7f9260103640 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-01T07:01:22.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:22 smithi089 ceph-mon[82218]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:01:22.548 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:22 smithi089 ceph-mon[82218]: pgmap v112: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 64/288 objects degraded (22.222%) 2024-08-01T07:01:22.548 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:22 smithi089 ceph-mon[82218]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:01:22.548 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:22 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/1585999079' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:01:22.548 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:22 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2479307824' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:01:22.548 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:22 smithi089 ceph-mon[82218]: from='osd.3 [v2:172.21.15.89:6800/2040087243,v1:172.21.15.89:6801/2040087243]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-01T07:01:22.548 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:22 smithi089 ceph-mon[82218]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-01T07:01:22.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.613+0000 7f29f4e34640 1 -- 172.21.15.16:0/3481468371 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f29f0108920 con 0x7f29f0100d80 2024-08-01T07:01:22.614 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:22 smithi016 ceph-mon[93645]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:01:22.615 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:22 smithi016 ceph-mon[93645]: pgmap v112: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 213 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 64/288 objects degraded (22.222%) 2024-08-01T07:01:22.615 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:22 smithi016 ceph-mon[93645]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:01:22.615 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:22 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/1585999079' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:01:22.615 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:22 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2479307824' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:01:22.615 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:22 smithi016 ceph-mon[93645]: from='osd.3 [v2:172.21.15.89:6800/2040087243,v1:172.21.15.89:6801/2040087243]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-01T07:01:22.615 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:22 smithi016 ceph-mon[93645]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-01T07:01:22.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.613+0000 7f29df7fe640 1 -- 172.21.15.16:0/3481468371 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1327 (secure 0 0 0) 0x7f29e407bce0 con 0x7f29f0100d80 2024-08-01T07:01:22.616 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 64/288 objects degraded (22.222%), 19 pgs degraded 2024-08-01T07:01:22.616 INFO:teuthology.orchestra.run.smithi016.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-01T07:01:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: osd.3 (root=default,host=smithi089) is down 2024-08-01T07:01:22.616 INFO:teuthology.orchestra.run.smithi016.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 64/288 objects degraded (22.222%), 19 pgs degraded 2024-08-01T07:01:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-08-01T07:01:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-08-01T07:01:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-08-01T07:01:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-08-01T07:01:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-08-01T07:01:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-08-01T07:01:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-08-01T07:01:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-08-01T07:01:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-08-01T07:01:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-08-01T07:01:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-08-01T07:01:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.12 is active+undersized+degraded, acting [1,0] 2024-08-01T07:01:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-08-01T07:01:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-08-01T07:01:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-08-01T07:01:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-08-01T07:01:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-08-01T07:01:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-08-01T07:01:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-08-01T07:01:22.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.616+0000 7f29f4e34640 1 -- 172.21.15.16:0/3481468371 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f29d806e170 msgr2=0x7f29d8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:22.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.616+0000 7f29f4e34640 1 --2- 172.21.15.16:0/3481468371 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f29d806e170 0x7f29d8070630 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f29f0100be0 tx=0x7f29e0005f90 comp rx=0 tx=0).stop 2024-08-01T07:01:22.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.616+0000 7f29f4e34640 1 -- 172.21.15.16:0/3481468371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29f0100d80 msgr2=0x7f29f0195b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:22.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.616+0000 7f29f4e34640 1 --2- 172.21.15.16:0/3481468371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29f0100d80 0x7f29f0195b00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f29e40055a0 tx=0x7f29e40055d0 comp rx=0 tx=0).stop 2024-08-01T07:01:22.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.616+0000 7f29f4e34640 1 -- 172.21.15.16:0/3481468371 shutdown_connections 2024-08-01T07:01:22.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.616+0000 7f29f4e34640 1 --2- 172.21.15.16:0/3481468371 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f29d806e170 0x7f29d8070630 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:22.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.616+0000 7f29f4e34640 1 --2- 172.21.15.16:0/3481468371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29f0100d80 0x7f29f0195b00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:22.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.616+0000 7f29f4e34640 1 --2- 172.21.15.16:0/3481468371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29f00ffb80 0x7f29f01955c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:22.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.616+0000 7f29f4e34640 1 -- 172.21.15.16:0/3481468371 >> 172.21.15.16:0/3481468371 conn(0x7f29f00fb330 msgr2=0x7f29f00fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:22.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.616+0000 7f29f4e34640 1 -- 172.21.15.16:0/3481468371 shutdown_connections 2024-08-01T07:01:22.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:22.616+0000 7f29f4e34640 1 -- 172.21.15.16:0/3481468371 wait complete. 2024-08-01T07:01:23.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:23 smithi089 ceph-mon[82218]: from='client.44229 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:01:23.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:23 smithi089 ceph-mon[82218]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-01T07:01:23.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:23 smithi089 ceph-mon[82218]: osdmap e67: 6 total, 5 up, 6 in 2024-08-01T07:01:23.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:23 smithi089 ceph-mon[82218]: from='osd.3 [v2:172.21.15.89:6800/2040087243,v1:172.21.15.89:6801/2040087243]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T07:01:23.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:23 smithi089 ceph-mon[82218]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T07:01:23.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:23 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/3481468371' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:01:23.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:23.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:23.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:01:23.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:01:23.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:23.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:01:23.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:01:23.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:01:23.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:01:23.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-01T07:01:23.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:23 smithi016 ceph-mon[93645]: from='client.44229 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:01:23.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:23 smithi016 ceph-mon[93645]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-01T07:01:23.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:23 smithi016 ceph-mon[93645]: osdmap e67: 6 total, 5 up, 6 in 2024-08-01T07:01:23.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:23 smithi016 ceph-mon[93645]: from='osd.3 [v2:172.21.15.89:6800/2040087243,v1:172.21.15.89:6801/2040087243]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T07:01:23.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:23 smithi016 ceph-mon[93645]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T07:01:23.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:23 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/3481468371' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:01:23.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:23.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:23.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:01:23.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:01:23.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:23.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:01:23.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:01:23.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:01:23.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:01:23.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-01T07:01:24.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:24 smithi089 ceph-mon[82218]: pgmap v114: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s; 64/288 objects degraded (22.222%) 2024-08-01T07:01:24.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:24 smithi089 ceph-mon[82218]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-01T07:01:24.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:24 smithi089 ceph-mon[82218]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-08-01T07:01:24.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:24 smithi089 ceph-mon[82218]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-01T07:01:24.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:24 smithi089 ceph-mon[82218]: osd.3 [v2:172.21.15.89:6800/2040087243,v1:172.21.15.89:6801/2040087243] boot 2024-08-01T07:01:24.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:24 smithi089 ceph-mon[82218]: osdmap e68: 6 total, 6 up, 6 in 2024-08-01T07:01:24.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:24 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-01T07:01:24.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:24 smithi016 ceph-mon[93645]: pgmap v114: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s; 64/288 objects degraded (22.222%) 2024-08-01T07:01:24.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:24 smithi016 ceph-mon[93645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-01T07:01:24.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:24 smithi016 ceph-mon[93645]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-08-01T07:01:24.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:24 smithi016 ceph-mon[93645]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-01T07:01:24.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:24 smithi016 ceph-mon[93645]: osd.3 [v2:172.21.15.89:6800/2040087243,v1:172.21.15.89:6801/2040087243] boot 2024-08-01T07:01:24.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:24 smithi016 ceph-mon[93645]: osdmap e68: 6 total, 6 up, 6 in 2024-08-01T07:01:24.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:24 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-01T07:01:25.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:25 smithi089 ceph-mon[82218]: osdmap e69: 6 total, 6 up, 6 in 2024-08-01T07:01:25.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:25 smithi016 ceph-mon[93645]: osdmap e69: 6 total, 6 up, 6 in 2024-08-01T07:01:26.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:26 smithi089 ceph-mon[82218]: pgmap v117: 65 pgs: 11 peering, 13 active+undersized, 14 active+undersized+degraded, 27 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 46/288 objects degraded (15.972%) 2024-08-01T07:01:27.009 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:26 smithi089 ceph-mon[82218]: Health check update: Degraded data redundancy: 46/288 objects degraded (15.972%), 14 pgs degraded (PG_DEGRADED) 2024-08-01T07:01:27.010 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:26 smithi016 ceph-mon[93645]: pgmap v117: 65 pgs: 11 peering, 13 active+undersized, 14 active+undersized+degraded, 27 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 46/288 objects degraded (15.972%) 2024-08-01T07:01:27.010 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:26 smithi016 ceph-mon[93645]: Health check update: Degraded data redundancy: 46/288 objects degraded (15.972%), 14 pgs degraded (PG_DEGRADED) 2024-08-01T07:01:28.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:28 smithi089 ceph-mon[82218]: pgmap v118: 65 pgs: 11 peering, 13 active+undersized, 14 active+undersized+degraded, 27 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 46/288 objects degraded (15.972%) 2024-08-01T07:01:28.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:28 smithi016 ceph-mon[93645]: pgmap v118: 65 pgs: 11 peering, 13 active+undersized, 14 active+undersized+degraded, 27 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 46/288 objects degraded (15.972%) 2024-08-01T07:01:29.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:29 smithi089 ceph-mon[82218]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/288 objects degraded (15.972%), 14 pgs degraded) 2024-08-01T07:01:29.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:29 smithi089 ceph-mon[82218]: Cluster is now healthy 2024-08-01T07:01:29.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:29 smithi016 ceph-mon[93645]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/288 objects degraded (15.972%), 14 pgs degraded) 2024-08-01T07:01:29.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:29 smithi016 ceph-mon[93645]: Cluster is now healthy 2024-08-01T07:01:30.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:30 smithi089 ceph-mon[82218]: pgmap v119: 65 pgs: 65 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-01T07:01:30.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:30 smithi016 ceph-mon[93645]: pgmap v119: 65 pgs: 65 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-01T07:01:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:32 smithi089 ceph-mon[82218]: pgmap v120: 65 pgs: 65 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 3 op/s 2024-08-01T07:01:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:01:32.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:32 smithi016 ceph-mon[93645]: pgmap v120: 65 pgs: 65 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 3 op/s 2024-08-01T07:01:32.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:32.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:01:34.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:34 smithi089 ceph-mon[82218]: pgmap v121: 65 pgs: 65 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-08-01T07:01:34.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:34 smithi016 ceph-mon[93645]: pgmap v121: 65 pgs: 65 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-08-01T07:01:36.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:36 smithi089 ceph-mon[82218]: pgmap v122: 65 pgs: 65 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-01T07:01:36.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:36 smithi016 ceph-mon[93645]: pgmap v122: 65 pgs: 65 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-01T07:01:38.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:38 smithi016 ceph-mon[93645]: pgmap v123: 65 pgs: 65 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s 2024-08-01T07:01:38.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:38 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:38.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:38 smithi089 ceph-mon[82218]: pgmap v123: 65 pgs: 65 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s 2024-08-01T07:01:38.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:38 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:39.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:39 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-01T07:01:39.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:39 smithi089 ceph-mon[82218]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-01T07:01:39.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:39 smithi089 ceph-mon[82218]: Upgrade: osd.4 is safe to restart 2024-08-01T07:01:39.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:39 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-01T07:01:39.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:39 smithi016 ceph-mon[93645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-01T07:01:39.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:39 smithi016 ceph-mon[93645]: Upgrade: osd.4 is safe to restart 2024-08-01T07:01:41.026 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:40 smithi089 ceph-mon[82218]: pgmap v124: 65 pgs: 65 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-08-01T07:01:41.027 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:40 smithi089 ceph-mon[82218]: Upgrade: Updating osd.4 2024-08-01T07:01:41.027 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:40 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:41.027 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:40 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-01T07:01:41.027 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:40 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:01:41.027 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:40 smithi089 ceph-mon[82218]: Deploying daemon osd.4 on smithi089 2024-08-01T07:01:41.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:40 smithi016 ceph-mon[93645]: pgmap v124: 65 pgs: 65 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-08-01T07:01:41.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:40 smithi016 ceph-mon[93645]: Upgrade: Updating osd.4 2024-08-01T07:01:41.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:40 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:41.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:40 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-01T07:01:41.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:40 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:01:41.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:40 smithi016 ceph-mon[93645]: Deploying daemon osd.4 on smithi089 2024-08-01T07:01:42.951 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:42 smithi016 ceph-mon[93645]: pgmap v125: 65 pgs: 65 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:01:42.956 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:42 smithi089 ceph-mon[82218]: pgmap v125: 65 pgs: 65 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:01:42.956 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:42 smithi089 systemd[1]: Stopping Ceph osd.4 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T07:01:43.387 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:42 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[48882]: 2024-08-01T07:01:42.954+0000 7f9b8ba3e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-01T07:01:43.387 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:42 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[48882]: 2024-08-01T07:01:42.954+0000 7f9b8ba3e640 -1 osd.4 69 *** Got signal Terminated *** 2024-08-01T07:01:43.387 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:42 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[48882]: 2024-08-01T07:01:42.954+0000 7f9b8ba3e640 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-01T07:01:44.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:43 smithi089 ceph-mon[82218]: osd.4 marked itself down and dead 2024-08-01T07:01:44.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:43 smithi016 ceph-mon[93645]: osd.4 marked itself down and dead 2024-08-01T07:01:44.500 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:44 smithi089 podman[96330]: 2024-08-01 07:01:44.211029255 +0000 UTC m=+1.365215735 container died 15b8f910bad7910dc47a48971e012a53831a5ae0f8bdb40f3dc33d69633b9d8c (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=reef-a3bbd72, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240716, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-01T07:01:44.883 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:44 smithi089 ceph-mon[82218]: pgmap v126: 65 pgs: 65 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:01:44.883 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:44 smithi089 ceph-mon[82218]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-01T07:01:44.883 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:44 smithi089 ceph-mon[82218]: osdmap e70: 6 total, 5 up, 6 in 2024-08-01T07:01:44.883 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:44 smithi089 podman[96330]: 2024-08-01 07:01:44.596536437 +0000 UTC m=+1.750722907 container cleanup 15b8f910bad7910dc47a48971e012a53831a5ae0f8bdb40f3dc33d69633b9d8c (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=reef-a3bbd72, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240716, ceph=True, io.buildah.version=1.36.0) 2024-08-01T07:01:44.883 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:44 smithi089 bash[96330]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4 2024-08-01T07:01:44.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:44 smithi016 ceph-mon[93645]: pgmap v126: 65 pgs: 65 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:01:44.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:44 smithi016 ceph-mon[93645]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-01T07:01:44.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:44 smithi016 ceph-mon[93645]: osdmap e70: 6 total, 5 up, 6 in 2024-08-01T07:01:45.137 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:44 smithi089 podman[96345]: 2024-08-01 07:01:44.881933907 +0000 UTC m=+0.668264566 container remove 15b8f910bad7910dc47a48971e012a53831a5ae0f8bdb40f3dc33d69633b9d8c (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4, RELEASE=reef-a3bbd72, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240716, org.label-schema.schema-version=1.0) 2024-08-01T07:01:45.537 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:45 smithi089 podman[96435]: 2024-08-01 07:01:45.136061008 +0000 UTC m=+0.017122790 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:01:45.537 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:45 smithi089 podman[96435]: 2024-08-01 07:01:45.249810627 +0000 UTC m=+0.130872405 container create 84254bdc73c4f1e7ae80288dd2b9572d9dccd7d7c2b5a962ed2a957ecdba207c (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240724, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f9911e1, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-01T07:01:45.537 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:45 smithi089 podman[96435]: 2024-08-01 07:01:45.535949042 +0000 UTC m=+0.417010839 container init 84254bdc73c4f1e7ae80288dd2b9572d9dccd7d7c2b5a962ed2a957ecdba207c (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f9911e1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux ) 2024-08-01T07:01:45.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:45 smithi089 ceph-mon[82218]: osdmap e71: 6 total, 5 up, 6 in 2024-08-01T07:01:45.887 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:45 smithi089 podman[96435]: 2024-08-01 07:01:45.539530939 +0000 UTC m=+0.420592724 container start 84254bdc73c4f1e7ae80288dd2b9572d9dccd7d7c2b5a962ed2a957ecdba207c (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-f9911e1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-01T07:01:45.888 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:45 smithi089 podman[96435]: 2024-08-01 07:01:45.627340429 +0000 UTC m=+0.508402209 container attach 84254bdc73c4f1e7ae80288dd2b9572d9dccd7d7c2b5a962ed2a957ecdba207c (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, RELEASE=squid-f9911e1) 2024-08-01T07:01:45.888 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:45 smithi089 podman[96435]: 2024-08-01 07:01:45.73009236 +0000 UTC m=+0.611154142 container died 84254bdc73c4f1e7ae80288dd2b9572d9dccd7d7c2b5a962ed2a957ecdba207c (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f9911e1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-01T07:01:46.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:45 smithi016 ceph-mon[93645]: osdmap e71: 6 total, 5 up, 6 in 2024-08-01T07:01:46.677 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:46 smithi089 podman[96459]: 2024-08-01 07:01:46.406194746 +0000 UTC m=+0.670269206 container remove 84254bdc73c4f1e7ae80288dd2b9572d9dccd7d7c2b5a962ed2a957ecdba207c (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240724, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-f9911e1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-01T07:01:46.677 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:46 smithi089 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.4.service: Deactivated successfully. 2024-08-01T07:01:46.677 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:46 smithi089 systemd[1]: Stopped Ceph osd.4 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T07:01:46.677 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:46 smithi089 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.4.service: Consumed 1min 6.960s CPU time. 2024-08-01T07:01:46.677 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:46 smithi089 systemd[1]: Starting Ceph osd.4 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T07:01:46.976 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:46 smithi089 ceph-mon[82218]: pgmap v129: 65 pgs: 16 peering, 3 stale+active+clean, 46 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:01:46.976 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:46 smithi089 ceph-mon[82218]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-08-01T07:01:46.977 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:46 smithi089 podman[96557]: 2024-08-01 07:01:46.750228461 +0000 UTC m=+0.017212756 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:01:46.977 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:46 smithi089 podman[96557]: 2024-08-01 07:01:46.874498862 +0000 UTC m=+0.141483140 container create 6c99fb040b10a93da87795a145609f5fe55e4204a3d14ffd00c6829bf9fcc81b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-f9911e1, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-01T07:01:47.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:46 smithi016 ceph-mon[93645]: pgmap v129: 65 pgs: 16 peering, 3 stale+active+clean, 46 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:01:47.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:46 smithi016 ceph-mon[93645]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-08-01T07:01:47.259 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 podman[96557]: 2024-08-01 07:01:47.127261908 +0000 UTC m=+0.394246208 container init 6c99fb040b10a93da87795a145609f5fe55e4204a3d14ffd00c6829bf9fcc81b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, ceph=True, RELEASE=squid-f9911e1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724) 2024-08-01T07:01:47.259 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 podman[96557]: 2024-08-01 07:01:47.130880344 +0000 UTC m=+0.397864623 container start 6c99fb040b10a93da87795a145609f5fe55e4204a3d14ffd00c6829bf9fcc81b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-activate, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f9911e1, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-01T07:01:47.259 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 podman[96557]: 2024-08-01 07:01:47.193752108 +0000 UTC m=+0.460736388 container attach 6c99fb040b10a93da87795a145609f5fe55e4204a3d14ffd00c6829bf9fcc81b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f9911e1, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240724, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-01T07:01:47.513 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-activate[96572]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:01:47.513 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 bash[96557]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:01:47.513 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-activate[96572]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:01:47.513 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 bash[96557]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:01:47.513 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-activate[96572]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-01T07:01:47.513 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 bash[96557]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-01T07:01:47.513 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-activate[96572]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-08-01T07:01:47.514 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 bash[96557]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-08-01T07:01:47.514 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-activate[96572]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-08-01T07:01:47.514 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 bash[96557]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-08-01T07:01:47.514 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-activate[96572]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-08-01T07:01:47.514 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 bash[96557]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-08-01T07:01:47.514 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-activate[96572]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-08-01T07:01:47.514 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 bash[96557]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-08-01T07:01:47.514 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-activate[96572]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-01T07:01:47.514 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 bash[96557]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-01T07:01:47.515 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-activate[96572]: --> ceph-volume raw activate successful for osd ID: 4 2024-08-01T07:01:47.515 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 bash[96557]: --> ceph-volume raw activate successful for osd ID: 4 2024-08-01T07:01:47.515 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:47 smithi089 podman[96557]: 2024-08-01 07:01:47.511938348 +0000 UTC m=+0.778922630 container died 6c99fb040b10a93da87795a145609f5fe55e4204a3d14ffd00c6829bf9fcc81b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, RELEASE=squid-f9911e1, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240724) 2024-08-01T07:01:48.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:48 smithi089 ceph-mon[82218]: pgmap v130: 65 pgs: 16 peering, 3 stale+active+clean, 46 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-01T07:01:48.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:48.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:01:48.394 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:48 smithi089 podman[96704]: 2024-08-01 07:01:48.139347497 +0000 UTC m=+0.621525783 container remove 6c99fb040b10a93da87795a145609f5fe55e4204a3d14ffd00c6829bf9fcc81b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f9911e1, io.buildah.version=1.36.0, org.label-schema.license=GPLv2) 2024-08-01T07:01:48.395 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:48 smithi089 podman[96764]: 2024-08-01 07:01:48.253804145 +0000 UTC m=+0.017493279 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:01:48.395 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:48 smithi089 podman[96764]: 2024-08-01 07:01:48.390823717 +0000 UTC m=+0.154512851 container create 7c51ba7a636a9d5e5e384f01f1fefe4bc16bfd7b9d6ad67a22054803444f2b05 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-f9911e1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-01T07:01:48.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:48 smithi016 ceph-mon[93645]: pgmap v130: 65 pgs: 16 peering, 3 stale+active+clean, 46 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-01T07:01:48.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:48.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:01:49.137 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:48 smithi089 podman[96764]: 2024-08-01 07:01:48.651523517 +0000 UTC m=+0.415212660 container init 7c51ba7a636a9d5e5e384f01f1fefe4bc16bfd7b9d6ad67a22054803444f2b05 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, ceph=True, RELEASE=squid-f9911e1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-08-01T07:01:49.137 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:48 smithi089 podman[96764]: 2024-08-01 07:01:48.654728123 +0000 UTC m=+0.418417255 container start 7c51ba7a636a9d5e5e384f01f1fefe4bc16bfd7b9d6ad67a22054803444f2b05 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, RELEASE=squid-f9911e1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-08-01T07:01:49.137 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:48 smithi089 ceph-osd[96782]: -- 172.21.15.89:0/3519365531 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5583a3f541e0 con 0x5583a3107c00 2024-08-01T07:01:49.138 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:48 smithi089 bash[96764]: 7c51ba7a636a9d5e5e384f01f1fefe4bc16bfd7b9d6ad67a22054803444f2b05 2024-08-01T07:01:49.138 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:48 smithi089 systemd[1]: Started Ceph osd.4 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T07:01:49.598 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:49 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[96778]: 2024-08-01T07:01:49.202+0000 7f1ef55d4640 -1 Falling back to public interface 2024-08-01T07:01:49.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:49 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:49.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:49 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:49.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:49 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:01:50.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:49 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:50.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:49 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:50.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:49 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:01:51.101 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:50 smithi089 ceph-mon[82218]: pgmap v131: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s; 48/288 objects degraded (16.667%) 2024-08-01T07:01:51.101 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:50 smithi089 ceph-mon[82218]: Health check failed: Degraded data redundancy: 48/288 objects degraded (16.667%), 15 pgs degraded (PG_DEGRADED) 2024-08-01T07:01:51.101 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:50 smithi089 ceph-mon[82218]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-08-01T07:01:51.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:50 smithi016 ceph-mon[93645]: pgmap v131: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s; 48/288 objects degraded (16.667%) 2024-08-01T07:01:51.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:50 smithi016 ceph-mon[93645]: Health check failed: Degraded data redundancy: 48/288 objects degraded (16.667%), 15 pgs degraded (PG_DEGRADED) 2024-08-01T07:01:51.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:50 smithi016 ceph-mon[93645]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-08-01T07:01:52.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.716+0000 7f91b910f640 1 -- 172.21.15.16:0/2353463810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91b40feaf0 msgr2=0x7f91b40feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:52.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.716+0000 7f91b910f640 1 --2- 172.21.15.16:0/2353463810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91b40feaf0 0x7f91b40feef0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009880 tx=0x7f91a402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:01:52.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.716+0000 7f91b910f640 1 -- 172.21.15.16:0/2353463810 shutdown_connections 2024-08-01T07:01:52.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.716+0000 7f91b910f640 1 --2- 172.21.15.16:0/2353463810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b40ffcf0 0x7f91b4100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:52.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.716+0000 7f91b910f640 1 --2- 172.21.15.16:0/2353463810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91b40feaf0 0x7f91b40feef0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:52.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.716+0000 7f91b910f640 1 -- 172.21.15.16:0/2353463810 >> 172.21.15.16:0/2353463810 conn(0x7f91b40fa280 msgr2=0x7f91b40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:52.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.716+0000 7f91b910f640 1 -- 172.21.15.16:0/2353463810 shutdown_connections 2024-08-01T07:01:52.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.716+0000 7f91b910f640 1 -- 172.21.15.16:0/2353463810 wait complete. 2024-08-01T07:01:52.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.717+0000 7f91b910f640 1 Processor -- start 2024-08-01T07:01:52.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.717+0000 7f91b910f640 1 -- start start 2024-08-01T07:01:52.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.718+0000 7f91b910f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b40feaf0 0x7f91b41978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:52.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.718+0000 7f91b910f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91b40ffcf0 0x7f91b4197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:52.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.718+0000 7f91b910f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b41983b0 con 0x7f91b40ffcf0 2024-08-01T07:01:52.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.718+0000 7f91b910f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b4198520 con 0x7f91b40feaf0 2024-08-01T07:01:52.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.718+0000 7f91aa59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91b40ffcf0 0x7f91b4197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:52.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.718+0000 7f91aa59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91b40ffcf0 0x7f91b4197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47582/0 (socket says 172.21.15.16:47582) 2024-08-01T07:01:52.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.718+0000 7f91aa59c640 1 -- 172.21.15.16:0/1875498927 learned_addr learned my addr 172.21.15.16:0/1875498927 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:01:52.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.718+0000 7f91b2d9d640 1 --2- 172.21.15.16:0/1875498927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b40feaf0 0x7f91b41978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:52.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.718+0000 7f91aa59c640 1 -- 172.21.15.16:0/1875498927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b40feaf0 msgr2=0x7f91b41978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:52.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.718+0000 7f91aa59c640 1 --2- 172.21.15.16:0/1875498927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b40feaf0 0x7f91b41978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:52.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.718+0000 7f91aa59c640 1 -- 172.21.15.16:0/1875498927 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a4009560 con 0x7f91b40ffcf0 2024-08-01T07:01:52.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.719+0000 7f91aa59c640 1 --2- 172.21.15.16:0/1875498927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91b40ffcf0 0x7f91b4197de0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f919c00e9a0 tx=0x7f919c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:52.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.719+0000 7f91b0d99640 1 -- 172.21.15.16:0/1875498927 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f919c00cc90 con 0x7f91b40ffcf0 2024-08-01T07:01:52.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.719+0000 7f91b0d99640 1 -- 172.21.15.16:0/1875498927 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f919c00cdf0 con 0x7f91b40ffcf0 2024-08-01T07:01:52.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.719+0000 7f91b0d99640 1 -- 172.21.15.16:0/1875498927 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f919c0187f0 con 0x7f91b40ffcf0 2024-08-01T07:01:52.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.719+0000 7f91b910f640 1 -- 172.21.15.16:0/1875498927 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b419cfc0 con 0x7f91b40ffcf0 2024-08-01T07:01:52.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.719+0000 7f91b910f640 1 -- 172.21.15.16:0/1875498927 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b419d4e0 con 0x7f91b40ffcf0 2024-08-01T07:01:52.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.720+0000 7f91b910f640 1 -- 172.21.15.16:0/1875498927 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b40feef0 con 0x7f91b40ffcf0 2024-08-01T07:01:52.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.721+0000 7f91b0d99640 1 -- 172.21.15.16:0/1875498927 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f919c010c10 con 0x7f91b40ffcf0 2024-08-01T07:01:52.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.721+0000 7f91b0d99640 1 --2- 172.21.15.16:0/1875498927 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f91a006e170 0x7f91a0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:52.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.721+0000 7f91b0d99640 1 -- 172.21.15.16:0/1875498927 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f919c014070 con 0x7f91b40ffcf0 2024-08-01T07:01:52.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.721+0000 7f91b2d9d640 1 --2- 172.21.15.16:0/1875498927 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f91a006e170 0x7f91a0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:52.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.722+0000 7f91b2d9d640 1 --2- 172.21.15.16:0/1875498927 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f91a006e170 0x7f91a0070630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009230 tx=0x7f91a40314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:52.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.726+0000 7f91b0d99640 1 -- 172.21.15.16:0/1875498927 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f919c053df0 con 0x7f91b40ffcf0 2024-08-01T07:01:52.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.918+0000 7f91b910f640 1 -- 172.21.15.16:0/1875498927 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91b40683f0 con 0x7f91a006e170 2024-08-01T07:01:52.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.920+0000 7f91b0d99640 1 -- 172.21.15.16:0/1875498927 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f91b40683f0 con 0x7f91a006e170 2024-08-01T07:01:52.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.922+0000 7f91b910f640 1 -- 172.21.15.16:0/1875498927 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f91a006e170 msgr2=0x7f91a0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:52.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.922+0000 7f91b910f640 1 --2- 172.21.15.16:0/1875498927 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f91a006e170 0x7f91a0070630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009230 tx=0x7f91a40314e0 comp rx=0 tx=0).stop 2024-08-01T07:01:52.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.922+0000 7f91b910f640 1 -- 172.21.15.16:0/1875498927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91b40ffcf0 msgr2=0x7f91b4197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:52.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.922+0000 7f91b910f640 1 --2- 172.21.15.16:0/1875498927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91b40ffcf0 0x7f91b4197de0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f919c00e9a0 tx=0x7f919c00ee60 comp rx=0 tx=0).stop 2024-08-01T07:01:52.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.922+0000 7f91b910f640 1 -- 172.21.15.16:0/1875498927 shutdown_connections 2024-08-01T07:01:52.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.922+0000 7f91b910f640 1 --2- 172.21.15.16:0/1875498927 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f91a006e170 0x7f91a0070630 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:52.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.922+0000 7f91b910f640 1 --2- 172.21.15.16:0/1875498927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91b40ffcf0 0x7f91b4197de0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:52.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.922+0000 7f91b910f640 1 --2- 172.21.15.16:0/1875498927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91b40feaf0 0x7f91b41978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:52.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.922+0000 7f91b910f640 1 -- 172.21.15.16:0/1875498927 >> 172.21.15.16:0/1875498927 conn(0x7f91b40fa280 msgr2=0x7f91b4067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:52.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.922+0000 7f91b910f640 1 -- 172.21.15.16:0/1875498927 shutdown_connections 2024-08-01T07:01:52.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:52.922+0000 7f91b910f640 1 -- 172.21.15.16:0/1875498927 wait complete. 2024-08-01T07:01:52.933 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T07:01:53.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.009+0000 7f2d12696640 1 -- 172.21.15.16:0/3134831001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d0c0feaa0 msgr2=0x7f2d0c0feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:53.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.009+0000 7f2d12696640 1 --2- 172.21.15.16:0/3134831001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d0c0feaa0 0x7f2d0c0feea0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc009880 tx=0x7f2cfc02a4a0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.009+0000 7f2d12696640 1 -- 172.21.15.16:0/3134831001 shutdown_connections 2024-08-01T07:01:53.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.009+0000 7f2d12696640 1 --2- 172.21.15.16:0/3134831001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d0c0ffca0 0x7f2d0c100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.009+0000 7f2d12696640 1 --2- 172.21.15.16:0/3134831001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d0c0feaa0 0x7f2d0c0feea0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.009+0000 7f2d12696640 1 -- 172.21.15.16:0/3134831001 >> 172.21.15.16:0/3134831001 conn(0x7f2d0c0fa250 msgr2=0x7f2d0c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:53.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.009+0000 7f2d12696640 1 -- 172.21.15.16:0/3134831001 shutdown_connections 2024-08-01T07:01:53.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.009+0000 7f2d12696640 1 -- 172.21.15.16:0/3134831001 wait complete. 2024-08-01T07:01:53.012 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:52 smithi016 ceph-mon[93645]: pgmap v132: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 3 op/s; 48/288 objects degraded (16.667%) 2024-08-01T07:01:53.012 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:53.012 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:53.012 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:53.012 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:53.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.010+0000 7f2d12696640 1 Processor -- start 2024-08-01T07:01:53.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.010+0000 7f2d12696640 1 -- start start 2024-08-01T07:01:53.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.010+0000 7f2d12696640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d0c0feaa0 0x7f2d0c195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:53.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.010+0000 7f2d12696640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d0c0ffca0 0x7f2d0c195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:53.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.010+0000 7f2d12696640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c196140 con 0x7f2d0c0feaa0 2024-08-01T07:01:53.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.010+0000 7f2d12696640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c1962b0 con 0x7f2d0c0ffca0 2024-08-01T07:01:53.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.010+0000 7f2d0bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d0c0feaa0 0x7f2d0c195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:53.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.010+0000 7f2d0bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d0c0feaa0 0x7f2d0c195630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47602/0 (socket says 172.21.15.16:47602) 2024-08-01T07:01:53.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.011+0000 7f2d0bfff640 1 -- 172.21.15.16:0/485170215 learned_addr learned my addr 172.21.15.16:0/485170215 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:01:53.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.011+0000 7f2d0b7fe640 1 --2- 172.21.15.16:0/485170215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d0c0ffca0 0x7f2d0c195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:53.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.011+0000 7f2d0bfff640 1 -- 172.21.15.16:0/485170215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d0c0ffca0 msgr2=0x7f2d0c195b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:53.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.011+0000 7f2d0bfff640 1 --2- 172.21.15.16:0/485170215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d0c0ffca0 0x7f2d0c195b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.011+0000 7f2d0bfff640 1 -- 172.21.15.16:0/485170215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc009560 con 0x7f2d0c0feaa0 2024-08-01T07:01:53.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.011+0000 7f2d0bfff640 1 --2- 172.21.15.16:0/485170215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d0c0feaa0 0x7f2d0c195630 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc004650 tx=0x7f2cfc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:53.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.011+0000 7f2d097fa640 1 -- 172.21.15.16:0/485170215 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cfc004aa0 con 0x7f2d0c0feaa0 2024-08-01T07:01:53.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.011+0000 7f2d097fa640 1 -- 172.21.15.16:0/485170215 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2cfc005d50 con 0x7f2d0c0feaa0 2024-08-01T07:01:53.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.011+0000 7f2d12696640 1 -- 172.21.15.16:0/485170215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0c19acf0 con 0x7f2d0c0feaa0 2024-08-01T07:01:53.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.011+0000 7f2d097fa640 1 -- 172.21.15.16:0/485170215 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cfc0039e0 con 0x7f2d0c0feaa0 2024-08-01T07:01:53.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.011+0000 7f2d12696640 1 -- 172.21.15.16:0/485170215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0c19b210 con 0x7f2d0c0feaa0 2024-08-01T07:01:53.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.012+0000 7f2d12696640 1 -- 172.21.15.16:0/485170215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0c1076b0 con 0x7f2d0c0feaa0 2024-08-01T07:01:53.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.013+0000 7f2d097fa640 1 -- 172.21.15.16:0/485170215 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2cfc031c00 con 0x7f2d0c0feaa0 2024-08-01T07:01:53.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.013+0000 7f2d097fa640 1 --2- 172.21.15.16:0/485170215 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f2cf406e180 0x7f2cf4070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:53.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.013+0000 7f2d097fa640 1 -- 172.21.15.16:0/485170215 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2cfc0af170 con 0x7f2d0c0feaa0 2024-08-01T07:01:53.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.013+0000 7f2d0b7fe640 1 --2- 172.21.15.16:0/485170215 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f2cf406e180 0x7f2cf4070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:53.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.014+0000 7f2d0b7fe640 1 --2- 172.21.15.16:0/485170215 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f2cf406e180 0x7f2cf4070640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c196b50 tx=0x7f2d00005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:53.017 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:52 smithi089 ceph-mon[82218]: pgmap v132: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 3 op/s; 48/288 objects degraded (16.667%) 2024-08-01T07:01:53.018 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:53.018 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:53.018 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:53.018 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:53.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.018+0000 7f2d097fa640 1 -- 172.21.15.16:0/485170215 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2cfc078550 con 0x7f2d0c0feaa0 2024-08-01T07:01:53.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.213+0000 7f2d12696640 1 -- 172.21.15.16:0/485170215 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d0c19b400 con 0x7f2cf406e180 2024-08-01T07:01:53.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.214+0000 7f2d097fa640 1 -- 172.21.15.16:0/485170215 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2d0c19b400 con 0x7f2cf406e180 2024-08-01T07:01:53.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.216+0000 7f2d12696640 1 -- 172.21.15.16:0/485170215 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f2cf406e180 msgr2=0x7f2cf4070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:53.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.216+0000 7f2d12696640 1 --2- 172.21.15.16:0/485170215 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f2cf406e180 0x7f2cf4070640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c196b50 tx=0x7f2d00005f90 comp rx=0 tx=0).stop 2024-08-01T07:01:53.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.216+0000 7f2d12696640 1 -- 172.21.15.16:0/485170215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d0c0feaa0 msgr2=0x7f2d0c195630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:53.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.216+0000 7f2d12696640 1 --2- 172.21.15.16:0/485170215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d0c0feaa0 0x7f2d0c195630 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc004650 tx=0x7f2cfc0055a0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.216+0000 7f2d12696640 1 -- 172.21.15.16:0/485170215 shutdown_connections 2024-08-01T07:01:53.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.216+0000 7f2d12696640 1 --2- 172.21.15.16:0/485170215 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f2cf406e180 0x7f2cf4070640 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.216+0000 7f2d12696640 1 --2- 172.21.15.16:0/485170215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d0c0ffca0 0x7f2d0c195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.216+0000 7f2d12696640 1 --2- 172.21.15.16:0/485170215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d0c0feaa0 0x7f2d0c195630 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.216+0000 7f2d12696640 1 -- 172.21.15.16:0/485170215 >> 172.21.15.16:0/485170215 conn(0x7f2d0c0fa250 msgr2=0x7f2d0c0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:53.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.216+0000 7f2d12696640 1 -- 172.21.15.16:0/485170215 shutdown_connections 2024-08-01T07:01:53.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.216+0000 7f2d12696640 1 -- 172.21.15.16:0/485170215 wait complete. 2024-08-01T07:01:53.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.300+0000 7f037639f640 1 -- 172.21.15.16:0/3317464670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0370100490 msgr2=0x7f0370102880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:53.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.300+0000 7f037639f640 1 --2- 172.21.15.16:0/3317464670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0370100490 0x7f0370102880 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f036c009880 tx=0x7f036c02a4a0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.300+0000 7f037639f640 1 -- 172.21.15.16:0/3317464670 shutdown_connections 2024-08-01T07:01:53.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.300+0000 7f037639f640 1 --2- 172.21.15.16:0/3317464670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0370102dc0 0x7f03701051b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.300+0000 7f037639f640 1 --2- 172.21.15.16:0/3317464670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0370100490 0x7f0370102880 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.300+0000 7f037639f640 1 -- 172.21.15.16:0/3317464670 >> 172.21.15.16:0/3317464670 conn(0x7f03700fa010 msgr2=0x7f03700fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:53.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.300+0000 7f037639f640 1 -- 172.21.15.16:0/3317464670 shutdown_connections 2024-08-01T07:01:53.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.300+0000 7f037639f640 1 -- 172.21.15.16:0/3317464670 wait complete. 2024-08-01T07:01:53.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.301+0000 7f037639f640 1 Processor -- start 2024-08-01T07:01:53.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.301+0000 7f037639f640 1 -- start start 2024-08-01T07:01:53.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.301+0000 7f037639f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0370100490 0x7f03700ffda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:53.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.301+0000 7f037639f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0370102dc0 0x7f03700fe440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:53.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.301+0000 7f037639f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03700fe980 con 0x7f0370100490 2024-08-01T07:01:53.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.301+0000 7f037639f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03700feaf0 con 0x7f0370102dc0 2024-08-01T07:01:53.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.301+0000 7f037539d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0370100490 0x7f03700ffda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:53.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.301+0000 7f037539d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0370100490 0x7f03700ffda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47612/0 (socket says 172.21.15.16:47612) 2024-08-01T07:01:53.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.301+0000 7f037539d640 1 -- 172.21.15.16:0/3972999165 learned_addr learned my addr 172.21.15.16:0/3972999165 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:01:53.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.302+0000 7f0374b9c640 1 --2- 172.21.15.16:0/3972999165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0370102dc0 0x7f03700fe440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:53.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.302+0000 7f037539d640 1 -- 172.21.15.16:0/3972999165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0370102dc0 msgr2=0x7f03700fe440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:53.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.302+0000 7f037539d640 1 --2- 172.21.15.16:0/3972999165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0370102dc0 0x7f03700fe440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.302+0000 7f037539d640 1 -- 172.21.15.16:0/3972999165 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c009560 con 0x7f0370100490 2024-08-01T07:01:53.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.302+0000 7f037539d640 1 --2- 172.21.15.16:0/3972999165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0370100490 0x7f03700ffda0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f036c006010 tx=0x7f036c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:53.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.302+0000 7f03627fc640 1 -- 172.21.15.16:0/3972999165 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f036c004aa0 con 0x7f0370100490 2024-08-01T07:01:53.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.302+0000 7f03627fc640 1 -- 172.21.15.16:0/3972999165 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f036c004c00 con 0x7f0370100490 2024-08-01T07:01:53.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.302+0000 7f037639f640 1 -- 172.21.15.16:0/3972999165 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03700fedd0 con 0x7f0370100490 2024-08-01T07:01:53.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.302+0000 7f03627fc640 1 -- 172.21.15.16:0/3972999165 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f036c003ac0 con 0x7f0370100490 2024-08-01T07:01:53.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.302+0000 7f037639f640 1 -- 172.21.15.16:0/3972999165 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037019d4b0 con 0x7f0370100490 2024-08-01T07:01:53.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.304+0000 7f037639f640 1 -- 172.21.15.16:0/3972999165 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0370108570 con 0x7f0370100490 2024-08-01T07:01:53.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.304+0000 7f03627fc640 1 -- 172.21.15.16:0/3972999165 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f036c031640 con 0x7f0370100490 2024-08-01T07:01:53.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.304+0000 7f03627fc640 1 --2- 172.21.15.16:0/3972999165 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f035c06e180 0x7f035c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:53.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.305+0000 7f03627fc640 1 -- 172.21.15.16:0/3972999165 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f036c0af220 con 0x7f0370100490 2024-08-01T07:01:53.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.305+0000 7f0374b9c640 1 --2- 172.21.15.16:0/3972999165 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f035c06e180 0x7f035c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:53.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.305+0000 7f0374b9c640 1 --2- 172.21.15.16:0/3972999165 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f035c06e180 0x7f035c070640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f03700ffb20 tx=0x7f036400b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:53.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.309+0000 7f03627fc640 1 -- 172.21.15.16:0/3972999165 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f036c078600 con 0x7f0370100490 2024-08-01T07:01:53.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.492+0000 7f037639f640 1 -- 172.21.15.16:0/3972999165 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f03701037e0 con 0x7f035c06e180 2024-08-01T07:01:53.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.501+0000 7f03627fc640 1 -- 172.21.15.16:0/3972999165 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f03701037e0 con 0x7f035c06e180 2024-08-01T07:01:53.503 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T07:01:53.503 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (12m) 66s ago 13m 25.2M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T07:01:53.504 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (14m) 66s ago 14m 8929k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T07:01:53.504 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (13m) 1s ago 13m 8518k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T07:01:53.504 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (2m) 66s ago 14m 6899k - 19.1.0-1223-gf9911e17 93d93c74a2cc 2a96028287a2 2024-08-01T07:01:53.504 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (2m) 1s ago 13m 6895k - 19.1.0-1223-gf9911e17 93d93c74a2cc 8a23341bd6c3 2024-08-01T07:01:53.505 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (12m) 66s ago 13m 84.5M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T07:01:53.505 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (8m) 66s ago 8m 89.3M - 18.2.2-1767-ga3bbd728 d280790d1980 96e46c28d16c 2024-08-01T07:01:53.505 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (8m) 66s ago 8m 147M - 18.2.2-1767-ga3bbd728 d280790d1980 4bbe1a388689 2024-08-01T07:01:53.505 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (8m) 1s ago 8m 26.7M - 18.2.2-1767-ga3bbd728 d280790d1980 65ca121a6fbb 2024-08-01T07:01:53.505 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (8m) 1s ago 8m 25.7M - 18.2.2-1767-ga3bbd728 d280790d1980 05bb46c6fe94 2024-08-01T07:01:53.506 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:8443,9283,8765 running (5m) 66s ago 15m 501M - 19.1.0-1223-gf9911e17 93d93c74a2cc 8701e6315593 2024-08-01T07:01:53.506 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (3m) 1s ago 12m 440M - 19.1.0-1223-gf9911e17 93d93c74a2cc c6caa21f436f 2024-08-01T07:01:53.506 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (3m) 66s ago 15m 48.2M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc 48e94d076e6f 2024-08-01T07:01:53.506 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (3m) 1s ago 12m 39.6M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc c4b83b46ff15 2024-08-01T07:01:53.506 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (14m) 66s ago 14m 15.9M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T07:01:53.507 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (13m) 1s ago 13m 17.1M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T07:01:53.507 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (2m) 66s ago 12m 93.0M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 4c2115ae6222 2024-08-01T07:01:53.507 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (106s) 66s ago 11m 95.5M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc fc2f7117be30 2024-08-01T07:01:53.507 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (72s) 66s ago 11m 12.1M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 3364752c9365 2024-08-01T07:01:53.507 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (37s) 1s ago 10m 103M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 9a18feae4353 2024-08-01T07:01:53.507 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (5s) 1s ago 10m 12.1M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 7c51ba7a636a 2024-08-01T07:01:53.507 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (10m) 1s ago 10m 237M 2239M 18.2.2-1767-ga3bbd728 d280790d1980 ac887841899e 2024-08-01T07:01:53.507 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (4m) 66s ago 13m 60.6M - 2.43.0 a07b618ecd1d 45d23c96382e 2024-08-01T07:01:53.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.503+0000 7f037639f640 1 -- 172.21.15.16:0/3972999165 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f035c06e180 msgr2=0x7f035c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:53.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.503+0000 7f037639f640 1 --2- 172.21.15.16:0/3972999165 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f035c06e180 0x7f035c070640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f03700ffb20 tx=0x7f036400b390 comp rx=0 tx=0).stop 2024-08-01T07:01:53.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.503+0000 7f037639f640 1 -- 172.21.15.16:0/3972999165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0370100490 msgr2=0x7f03700ffda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:53.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.503+0000 7f037639f640 1 --2- 172.21.15.16:0/3972999165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0370100490 0x7f03700ffda0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f036c006010 tx=0x7f036c0055a0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.504+0000 7f037639f640 1 -- 172.21.15.16:0/3972999165 shutdown_connections 2024-08-01T07:01:53.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.504+0000 7f037639f640 1 --2- 172.21.15.16:0/3972999165 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f035c06e180 0x7f035c070640 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.504+0000 7f037639f640 1 --2- 172.21.15.16:0/3972999165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0370102dc0 0x7f03700fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.504+0000 7f037639f640 1 --2- 172.21.15.16:0/3972999165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0370100490 0x7f03700ffda0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.504+0000 7f037639f640 1 -- 172.21.15.16:0/3972999165 >> 172.21.15.16:0/3972999165 conn(0x7f03700fa010 msgr2=0x7f03700fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:53.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.504+0000 7f037639f640 1 -- 172.21.15.16:0/3972999165 shutdown_connections 2024-08-01T07:01:53.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.504+0000 7f037639f640 1 -- 172.21.15.16:0/3972999165 wait complete. 2024-08-01T07:01:53.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.586+0000 7f25cbc2d640 1 -- 172.21.15.16:0/1197707275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c4102fc0 msgr2=0x7f25c41053b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:53.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.586+0000 7f25cbc2d640 1 --2- 172.21.15.16:0/1197707275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c4102fc0 0x7f25c41053b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009880 tx=0x7f25b402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.586+0000 7f25cbc2d640 1 -- 172.21.15.16:0/1197707275 shutdown_connections 2024-08-01T07:01:53.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.586+0000 7f25cbc2d640 1 --2- 172.21.15.16:0/1197707275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c4102fc0 0x7f25c41053b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.586+0000 7f25cbc2d640 1 --2- 172.21.15.16:0/1197707275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25c4100690 0x7f25c4102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.586+0000 7f25cbc2d640 1 -- 172.21.15.16:0/1197707275 >> 172.21.15.16:0/1197707275 conn(0x7f25c40fa250 msgr2=0x7f25c40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:53.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.587+0000 7f25cbc2d640 1 -- 172.21.15.16:0/1197707275 shutdown_connections 2024-08-01T07:01:53.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.587+0000 7f25cbc2d640 1 -- 172.21.15.16:0/1197707275 wait complete. 2024-08-01T07:01:53.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.587+0000 7f25cbc2d640 1 Processor -- start 2024-08-01T07:01:53.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.587+0000 7f25cbc2d640 1 -- start start 2024-08-01T07:01:53.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.588+0000 7f25cbc2d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c4100690 0x7f25c41955a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:53.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.588+0000 7f25cbc2d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25c4102fc0 0x7f25c4195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:53.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.588+0000 7f25cbc2d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c41960b0 con 0x7f25c4100690 2024-08-01T07:01:53.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.588+0000 7f25cbc2d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c4196220 con 0x7f25c4102fc0 2024-08-01T07:01:53.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.588+0000 7f25c99c9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c4100690 0x7f25c41955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:53.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.588+0000 7f25c99c9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c4100690 0x7f25c41955a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47616/0 (socket says 172.21.15.16:47616) 2024-08-01T07:01:53.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.588+0000 7f25c99c9640 1 -- 172.21.15.16:0/1441962104 learned_addr learned my addr 172.21.15.16:0/1441962104 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:01:53.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.588+0000 7f25c91c8640 1 --2- 172.21.15.16:0/1441962104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25c4102fc0 0x7f25c4195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:53.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.588+0000 7f25c99c9640 1 -- 172.21.15.16:0/1441962104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25c4102fc0 msgr2=0x7f25c4195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:53.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.588+0000 7f25c99c9640 1 --2- 172.21.15.16:0/1441962104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25c4102fc0 0x7f25c4195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.588+0000 7f25c99c9640 1 -- 172.21.15.16:0/1441962104 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b4009560 con 0x7f25c4100690 2024-08-01T07:01:53.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.588+0000 7f25c99c9640 1 --2- 172.21.15.16:0/1441962104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c4100690 0x7f25c41955a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f25c000d900 tx=0x7f25c000ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:53.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.588+0000 7f25baffd640 1 -- 172.21.15.16:0/1441962104 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25c0009c00 con 0x7f25c4100690 2024-08-01T07:01:53.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.588+0000 7f25baffd640 1 -- 172.21.15.16:0/1441962104 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f25c000b660 con 0x7f25c4100690 2024-08-01T07:01:53.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.589+0000 7f25cbc2d640 1 -- 172.21.15.16:0/1441962104 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c419acc0 con 0x7f25c4100690 2024-08-01T07:01:53.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.589+0000 7f25baffd640 1 -- 172.21.15.16:0/1441962104 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25c000f680 con 0x7f25c4100690 2024-08-01T07:01:53.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.589+0000 7f25cbc2d640 1 -- 172.21.15.16:0/1441962104 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c419b210 con 0x7f25c4100690 2024-08-01T07:01:53.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.590+0000 7f25cbc2d640 1 -- 172.21.15.16:0/1441962104 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c4100a70 con 0x7f25c4100690 2024-08-01T07:01:53.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.590+0000 7f25baffd640 1 -- 172.21.15.16:0/1441962104 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f25c0010ab0 con 0x7f25c4100690 2024-08-01T07:01:53.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.591+0000 7f25baffd640 1 --2- 172.21.15.16:0/1441962104 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f25b006e170 0x7f25b0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:53.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.591+0000 7f25baffd640 1 -- 172.21.15.16:0/1441962104 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f25c008de80 con 0x7f25c4100690 2024-08-01T07:01:53.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.591+0000 7f25c91c8640 1 --2- 172.21.15.16:0/1441962104 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f25b006e170 0x7f25b0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:53.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.591+0000 7f25c91c8640 1 --2- 172.21.15.16:0/1441962104 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f25b006e170 0x7f25b0070630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009230 tx=0x7f25b40314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:53.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.595+0000 7f25baffd640 1 -- 172.21.15.16:0/1441962104 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f25c0057260 con 0x7f25c4100690 2024-08-01T07:01:53.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.867+0000 7f25cbc2d640 1 -- 172.21.15.16:0/1441962104 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f25c419b400 con 0x7f25c4100690 2024-08-01T07:01:53.869 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:53 smithi016 ceph-mon[93645]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:01:53.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.868+0000 7f25baffd640 1 -- 172.21.15.16:0/1441962104 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+832 (secure 0 0 0) 0x7f25c005a920 con 0x7f25c4100690 2024-08-01T07:01:53.870 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:01:53.870 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T07:01:53.870 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:01:53.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:01:53.870 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T07:01:53.870 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:01:53.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:01:53.871 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T07:01:53.871 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 1, 2024-08-01T07:01:53.871 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 4 2024-08-01T07:01:53.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:01:53.871 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T07:01:53.871 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4 2024-08-01T07:01:53.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:01:53.871 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T07:01:53.871 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 5, 2024-08-01T07:01:53.871 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 8 2024-08-01T07:01:53.871 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T07:01:53.871 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:01:53.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.870+0000 7f25cbc2d640 1 -- 172.21.15.16:0/1441962104 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f25b006e170 msgr2=0x7f25b0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:53.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.870+0000 7f25cbc2d640 1 --2- 172.21.15.16:0/1441962104 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f25b006e170 0x7f25b0070630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009230 tx=0x7f25b40314e0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.870+0000 7f25cbc2d640 1 -- 172.21.15.16:0/1441962104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c4100690 msgr2=0x7f25c41955a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:53.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.870+0000 7f25cbc2d640 1 --2- 172.21.15.16:0/1441962104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c4100690 0x7f25c41955a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f25c000d900 tx=0x7f25c000ddc0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.870+0000 7f25cbc2d640 1 -- 172.21.15.16:0/1441962104 shutdown_connections 2024-08-01T07:01:53.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.870+0000 7f25cbc2d640 1 --2- 172.21.15.16:0/1441962104 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f25b006e170 0x7f25b0070630 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.870+0000 7f25cbc2d640 1 --2- 172.21.15.16:0/1441962104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25c4102fc0 0x7f25c4195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.870+0000 7f25cbc2d640 1 --2- 172.21.15.16:0/1441962104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c4100690 0x7f25c41955a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.870+0000 7f25cbc2d640 1 -- 172.21.15.16:0/1441962104 >> 172.21.15.16:0/1441962104 conn(0x7f25c40fa250 msgr2=0x7f25c40fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:53.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.870+0000 7f25cbc2d640 1 -- 172.21.15.16:0/1441962104 shutdown_connections 2024-08-01T07:01:53.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.870+0000 7f25cbc2d640 1 -- 172.21.15.16:0/1441962104 wait complete. 2024-08-01T07:01:53.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.954+0000 7f6987a05640 1 -- 172.21.15.16:0/3221407294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69800fed60 msgr2=0x7f69800ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:53.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.954+0000 7f6987a05640 1 --2- 172.21.15.16:0/3221407294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69800fed60 0x7f69800ff1c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6970009880 tx=0x7f697002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.954+0000 7f6987a05640 1 -- 172.21.15.16:0/3221407294 shutdown_connections 2024-08-01T07:01:53.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.954+0000 7f6987a05640 1 --2- 172.21.15.16:0/3221407294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69800fed60 0x7f69800ff1c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.954+0000 7f6987a05640 1 --2- 172.21.15.16:0/3221407294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69800fe420 0x7f69800fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.954+0000 7f6987a05640 1 -- 172.21.15.16:0/3221407294 >> 172.21.15.16:0/3221407294 conn(0x7f69800fa250 msgr2=0x7f69800fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:53.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.955+0000 7f6987a05640 1 -- 172.21.15.16:0/3221407294 shutdown_connections 2024-08-01T07:01:53.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.955+0000 7f6987a05640 1 -- 172.21.15.16:0/3221407294 wait complete. 2024-08-01T07:01:53.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.955+0000 7f6987a05640 1 Processor -- start 2024-08-01T07:01:53.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.955+0000 7f6987a05640 1 -- start start 2024-08-01T07:01:53.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.955+0000 7f6987a05640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69800fe420 0x7f6980197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:53.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.955+0000 7f6987a05640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69800fed60 0x7f6980197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:53.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.955+0000 7f6987a05640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6980198360 con 0x7f69800fed60 2024-08-01T07:01:53.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.955+0000 7f6987a05640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69801984d0 con 0x7f69800fe420 2024-08-01T07:01:53.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.955+0000 7f6984fa0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69800fed60 0x7f6980197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:53.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.955+0000 7f6984fa0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69800fed60 0x7f6980197d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47624/0 (socket says 172.21.15.16:47624) 2024-08-01T07:01:53.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.955+0000 7f6984fa0640 1 -- 172.21.15.16:0/1654997354 learned_addr learned my addr 172.21.15.16:0/1654997354 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:01:53.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.956+0000 7f69857a1640 1 --2- 172.21.15.16:0/1654997354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69800fe420 0x7f6980197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:53.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.956+0000 7f6984fa0640 1 -- 172.21.15.16:0/1654997354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69800fe420 msgr2=0x7f6980197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:53.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.956+0000 7f6984fa0640 1 --2- 172.21.15.16:0/1654997354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69800fe420 0x7f6980197850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:53.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.956+0000 7f6984fa0640 1 -- 172.21.15.16:0/1654997354 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6970009560 con 0x7f69800fed60 2024-08-01T07:01:53.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.956+0000 7f6984fa0640 1 --2- 172.21.15.16:0/1654997354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69800fed60 0x7f6980197d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f69700055a0 tx=0x7f69700055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:53.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.956+0000 7f69767fc640 1 -- 172.21.15.16:0/1654997354 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6970004aa0 con 0x7f69800fed60 2024-08-01T07:01:53.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.956+0000 7f6987a05640 1 -- 172.21.15.16:0/1654997354 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698019cf10 con 0x7f69800fed60 2024-08-01T07:01:53.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.956+0000 7f69767fc640 1 -- 172.21.15.16:0/1654997354 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6970004c00 con 0x7f69800fed60 2024-08-01T07:01:53.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.956+0000 7f69767fc640 1 -- 172.21.15.16:0/1654997354 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6970003a80 con 0x7f69800fed60 2024-08-01T07:01:53.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.956+0000 7f6987a05640 1 -- 172.21.15.16:0/1654997354 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698019d450 con 0x7f69800fed60 2024-08-01T07:01:53.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.957+0000 7f6987a05640 1 -- 172.21.15.16:0/1654997354 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69800fe820 con 0x7f69800fed60 2024-08-01T07:01:53.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.958+0000 7f69767fc640 1 -- 172.21.15.16:0/1654997354 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6970031c70 con 0x7f69800fed60 2024-08-01T07:01:53.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.958+0000 7f69767fc640 1 --2- 172.21.15.16:0/1654997354 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f696c06e170 0x7f696c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:53.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.959+0000 7f69767fc640 1 -- 172.21.15.16:0/1654997354 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f69700af2c0 con 0x7f69800fed60 2024-08-01T07:01:53.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.959+0000 7f69857a1640 1 --2- 172.21.15.16:0/1654997354 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f696c06e170 0x7f696c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:53.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.959+0000 7f69857a1640 1 --2- 172.21.15.16:0/1654997354 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f696c06e170 0x7f696c070630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f697c005fd0 tx=0x7f697c00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:53.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:53.963+0000 7f69767fc640 1 -- 172.21.15.16:0/1654997354 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6970078640 con 0x7f69800fed60 2024-08-01T07:01:54.031 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:53 smithi089 ceph-mon[82218]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:01:54.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.176+0000 7f6987a05640 1 -- 172.21.15.16:0/1654997354 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6980191920 con 0x7f69800fed60 2024-08-01T07:01:54.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.177+0000 7f69767fc640 1 -- 172.21.15.16:0/1654997354 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1938 (secure 0 0 0) 0x7f697007bd00 con 0x7f69800fed60 2024-08-01T07:01:54.179 INFO:teuthology.orchestra.run.smithi016.stdout:e19 2024-08-01T07:01:54.179 INFO:teuthology.orchestra.run.smithi016.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-08-01T07:01:54.179 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T07:01:54.179 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T07:01:54.179 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T07:01:54.179 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:01:54.179 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T07:01:54.179 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T07:01:54.179 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 19 2024-08-01T07:01:54.179 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T07:01:54.179 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T07:01:54.179 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T06:53:32.617145+0000 2024-08-01T07:01:54.180 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T07:01:54.180 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T07:01:54.180 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T07:01:54.180 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T07:01:54.180 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T07:01:54.180 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T07:01:54.180 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T07:01:54.181 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T07:01:54.181 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 46 2024-08-01T07:01:54.181 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T07:01:54.181 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T07:01:54.181 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T07:01:54.181 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=14482,1=24281} 2024-08-01T07:01:54.181 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T07:01:54.181 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T07:01:54.181 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T07:01:54.181 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T07:01:54.181 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T07:01:54.181 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T07:01:54.181 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T07:01:54.182 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T07:01:54.182 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T07:01:54.182 INFO:teuthology.orchestra.run.smithi016.stdout:qdb_cluster leader: 0 members: 2024-08-01T07:01:54.182 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:01:54.182 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:24299} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:01:54.182 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{1:24281} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:01:54.182 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:24291} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:01:54.182 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:01:54.182 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:01:54.184 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-08-01T07:01:54.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.179+0000 7f6987a05640 1 -- 172.21.15.16:0/1654997354 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f696c06e170 msgr2=0x7f696c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:54.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.179+0000 7f6987a05640 1 --2- 172.21.15.16:0/1654997354 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f696c06e170 0x7f696c070630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f697c005fd0 tx=0x7f697c00b390 comp rx=0 tx=0).stop 2024-08-01T07:01:54.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.179+0000 7f6987a05640 1 -- 172.21.15.16:0/1654997354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69800fed60 msgr2=0x7f6980197d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:54.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.179+0000 7f6987a05640 1 --2- 172.21.15.16:0/1654997354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69800fed60 0x7f6980197d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f69700055a0 tx=0x7f69700055d0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.179+0000 7f6987a05640 1 -- 172.21.15.16:0/1654997354 shutdown_connections 2024-08-01T07:01:54.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.179+0000 7f6987a05640 1 --2- 172.21.15.16:0/1654997354 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f696c06e170 0x7f696c070630 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.179+0000 7f6987a05640 1 --2- 172.21.15.16:0/1654997354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69800fed60 0x7f6980197d90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.179+0000 7f6987a05640 1 --2- 172.21.15.16:0/1654997354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69800fe420 0x7f6980197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.179+0000 7f6987a05640 1 -- 172.21.15.16:0/1654997354 >> 172.21.15.16:0/1654997354 conn(0x7f69800fa250 msgr2=0x7f6980106ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:54.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.179+0000 7f6987a05640 1 -- 172.21.15.16:0/1654997354 shutdown_connections 2024-08-01T07:01:54.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.179+0000 7f6987a05640 1 -- 172.21.15.16:0/1654997354 wait complete. 2024-08-01T07:01:54.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.266+0000 7f60bd7da640 1 -- 172.21.15.16:0/752260389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60b80ffcf0 msgr2=0x7f60b8100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:54.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.266+0000 7f60bd7da640 1 --2- 172.21.15.16:0/752260389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60b80ffcf0 0x7f60b8100170 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009880 tx=0x7f60ac02a4a0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.266+0000 7f60bd7da640 1 -- 172.21.15.16:0/752260389 shutdown_connections 2024-08-01T07:01:54.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.266+0000 7f60bd7da640 1 --2- 172.21.15.16:0/752260389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60b80ffcf0 0x7f60b8100170 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.266+0000 7f60bd7da640 1 --2- 172.21.15.16:0/752260389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60b80feaf0 0x7f60b80feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.266+0000 7f60bd7da640 1 -- 172.21.15.16:0/752260389 >> 172.21.15.16:0/752260389 conn(0x7f60b80fa280 msgr2=0x7f60b80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:54.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.266+0000 7f60bd7da640 1 -- 172.21.15.16:0/752260389 shutdown_connections 2024-08-01T07:01:54.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.266+0000 7f60bd7da640 1 -- 172.21.15.16:0/752260389 wait complete. 2024-08-01T07:01:54.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.267+0000 7f60bd7da640 1 Processor -- start 2024-08-01T07:01:54.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.267+0000 7f60bd7da640 1 -- start start 2024-08-01T07:01:54.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.268+0000 7f60bd7da640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60b80feaf0 0x7f60b8068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:54.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.268+0000 7f60bd7da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60b80ffcf0 0x7f60b819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:54.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.268+0000 7f60bd7da640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b819a9a0 con 0x7f60b80feaf0 2024-08-01T07:01:54.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.268+0000 7f60bd7da640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b819aae0 con 0x7f60b80ffcf0 2024-08-01T07:01:54.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.268+0000 7f60b67fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60b80ffcf0 0x7f60b819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:54.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.268+0000 7f60b6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60b80feaf0 0x7f60b8068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:54.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.268+0000 7f60b67fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60b80ffcf0 0x7f60b819a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.16:56794/0 (socket says 172.21.15.16:56794) 2024-08-01T07:01:54.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.268+0000 7f60b67fc640 1 -- 172.21.15.16:0/3923193692 learned_addr learned my addr 172.21.15.16:0/3923193692 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:01:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.268+0000 7f60b67fc640 1 -- 172.21.15.16:0/3923193692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60b80feaf0 msgr2=0x7f60b8068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.268+0000 7f60b67fc640 1 --2- 172.21.15.16:0/3923193692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60b80feaf0 0x7f60b8068790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.268+0000 7f60b67fc640 1 -- 172.21.15.16:0/3923193692 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a8009490 con 0x7f60b80ffcf0 2024-08-01T07:01:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.268+0000 7f60b6ffd640 1 --2- 172.21.15.16:0/3923193692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60b80feaf0 0x7f60b8068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T07:01:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.268+0000 7f60b67fc640 1 --2- 172.21.15.16:0/3923193692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60b80ffcf0 0x7f60b819a3d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f60ac004650 tx=0x7f60ac0055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.269+0000 7f609ffff640 1 -- 172.21.15.16:0/3923193692 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60ac004aa0 con 0x7f60b80ffcf0 2024-08-01T07:01:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.269+0000 7f609ffff640 1 -- 172.21.15.16:0/3923193692 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60ac005d50 con 0x7f60b80ffcf0 2024-08-01T07:01:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.269+0000 7f60bd7da640 1 -- 172.21.15.16:0/3923193692 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ac009560 con 0x7f60b80ffcf0 2024-08-01T07:01:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.269+0000 7f609ffff640 1 -- 172.21.15.16:0/3923193692 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60ac0039e0 con 0x7f60b80ffcf0 2024-08-01T07:01:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.269+0000 7f60bd7da640 1 -- 172.21.15.16:0/3923193692 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b819b090 con 0x7f60b80ffcf0 2024-08-01T07:01:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.270+0000 7f60bd7da640 1 -- 172.21.15.16:0/3923193692 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b80feef0 con 0x7f60b80ffcf0 2024-08-01T07:01:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.270+0000 7f609ffff640 1 -- 172.21.15.16:0/3923193692 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f60ac003c50 con 0x7f60b80ffcf0 2024-08-01T07:01:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.271+0000 7f609ffff640 1 --2- 172.21.15.16:0/3923193692 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f60a006e170 0x7f60a0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.271+0000 7f609ffff640 1 -- 172.21.15.16:0/3923193692 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f60ac0af110 con 0x7f60b80ffcf0 2024-08-01T07:01:54.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.271+0000 7f60b6ffd640 1 --2- 172.21.15.16:0/3923193692 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f60a006e170 0x7f60a0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:54.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.271+0000 7f60b6ffd640 1 --2- 172.21.15.16:0/3923193692 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f60a006e170 0x7f60a0070630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f60b80ffb50 tx=0x7f60a8005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.275+0000 7f609ffff640 1 -- 172.21.15.16:0/3923193692 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f60ac078570 con 0x7f60b80ffcf0 2024-08-01T07:01:54.387 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:54 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[96778]: 2024-08-01T07:01:54.259+0000 7f1ef55d4640 -1 osd.4 69 log_to_monitors true 2024-08-01T07:01:54.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.477+0000 7f60bd7da640 1 -- 172.21.15.16:0/3923193692 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f60b802c450 con 0x7f60a006e170 2024-08-01T07:01:54.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.478+0000 7f609ffff640 1 -- 172.21.15.16:0/3923193692 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f60b802c450 con 0x7f60a006e170 2024-08-01T07:01:54.479 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:01:54.479 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T07:01:54.479 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T07:01:54.480 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T07:01:54.480 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-08-01T07:01:54.480 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-08-01T07:01:54.480 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr", 2024-08-01T07:01:54.480 INFO:teuthology.orchestra.run.smithi016.stdout: "crash" 2024-08-01T07:01:54.480 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-08-01T07:01:54.480 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "11/23 daemons upgraded", 2024-08-01T07:01:54.480 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-08-01T07:01:54.480 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T07:01:54.480 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:01:54.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.480+0000 7f60bd7da640 1 -- 172.21.15.16:0/3923193692 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f60a006e170 msgr2=0x7f60a0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:54.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.480+0000 7f60bd7da640 1 --2- 172.21.15.16:0/3923193692 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f60a006e170 0x7f60a0070630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f60b80ffb50 tx=0x7f60a8005f90 comp rx=0 tx=0).stop 2024-08-01T07:01:54.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.480+0000 7f60bd7da640 1 -- 172.21.15.16:0/3923193692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60b80ffcf0 msgr2=0x7f60b819a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:54.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.480+0000 7f60bd7da640 1 --2- 172.21.15.16:0/3923193692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60b80ffcf0 0x7f60b819a3d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f60ac004650 tx=0x7f60ac0055a0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.480+0000 7f60bd7da640 1 -- 172.21.15.16:0/3923193692 shutdown_connections 2024-08-01T07:01:54.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.480+0000 7f60bd7da640 1 --2- 172.21.15.16:0/3923193692 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f60a006e170 0x7f60a0070630 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.480+0000 7f60bd7da640 1 --2- 172.21.15.16:0/3923193692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60b80ffcf0 0x7f60b819a3d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.480+0000 7f60bd7da640 1 --2- 172.21.15.16:0/3923193692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60b80feaf0 0x7f60b8068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.480+0000 7f60bd7da640 1 -- 172.21.15.16:0/3923193692 >> 172.21.15.16:0/3923193692 conn(0x7f60b80fa280 msgr2=0x7f60b81033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:54.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.480+0000 7f60bd7da640 1 -- 172.21.15.16:0/3923193692 shutdown_connections 2024-08-01T07:01:54.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.480+0000 7f60bd7da640 1 -- 172.21.15.16:0/3923193692 wait complete. 2024-08-01T07:01:54.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.564+0000 7f6791495640 1 -- 172.21.15.16:0/2504801568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f678c100d90 msgr2=0x7f678c101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:54.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.564+0000 7f6791495640 1 --2- 172.21.15.16:0/2504801568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f678c100d90 0x7f678c101210 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6780009880 tx=0x7f678002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.564+0000 7f6791495640 1 -- 172.21.15.16:0/2504801568 shutdown_connections 2024-08-01T07:01:54.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.564+0000 7f6791495640 1 --2- 172.21.15.16:0/2504801568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f678c100d90 0x7f678c101210 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.564+0000 7f6791495640 1 --2- 172.21.15.16:0/2504801568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f678c0ffb90 0x7f678c0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.564+0000 7f6791495640 1 -- 172.21.15.16:0/2504801568 >> 172.21.15.16:0/2504801568 conn(0x7f678c0fb320 msgr2=0x7f678c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:54.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.564+0000 7f6791495640 1 -- 172.21.15.16:0/2504801568 shutdown_connections 2024-08-01T07:01:54.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.564+0000 7f6791495640 1 -- 172.21.15.16:0/2504801568 wait complete. 2024-08-01T07:01:54.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.565+0000 7f6791495640 1 Processor -- start 2024-08-01T07:01:54.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.565+0000 7f6791495640 1 -- start start 2024-08-01T07:01:54.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.565+0000 7f6791495640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f678c0ffb90 0x7f678c195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:54.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.565+0000 7f6791495640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f678c100d90 0x7f678c195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:54.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.565+0000 7f6791495640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c196140 con 0x7f678c100d90 2024-08-01T07:01:54.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.565+0000 7f6791495640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c1962b0 con 0x7f678c0ffb90 2024-08-01T07:01:54.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.565+0000 7f678a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f678c100d90 0x7f678c195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:54.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.565+0000 7f678a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f678c100d90 0x7f678c195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47658/0 (socket says 172.21.15.16:47658) 2024-08-01T07:01:54.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.565+0000 7f678affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f678c0ffb90 0x7f678c195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:54.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.565+0000 7f678a7fc640 1 -- 172.21.15.16:0/3294298278 learned_addr learned my addr 172.21.15.16:0/3294298278 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:01:54.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.566+0000 7f678a7fc640 1 -- 172.21.15.16:0/3294298278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f678c0ffb90 msgr2=0x7f678c195630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:54.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.566+0000 7f678a7fc640 1 --2- 172.21.15.16:0/3294298278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f678c0ffb90 0x7f678c195630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.566+0000 7f678a7fc640 1 -- 172.21.15.16:0/3294298278 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6780009560 con 0x7f678c100d90 2024-08-01T07:01:54.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.566+0000 7f678affd640 1 --2- 172.21.15.16:0/3294298278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f678c0ffb90 0x7f678c195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T07:01:54.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.566+0000 7f678a7fc640 1 --2- 172.21.15.16:0/3294298278 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f678c100d90 0x7f678c195b70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f67800055a0 tx=0x7f67800055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:54.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.566+0000 7f6773fff640 1 -- 172.21.15.16:0/3294298278 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6780004aa0 con 0x7f678c100d90 2024-08-01T07:01:54.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.566+0000 7f6791495640 1 -- 172.21.15.16:0/3294298278 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678c19acf0 con 0x7f678c100d90 2024-08-01T07:01:54.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.566+0000 7f6773fff640 1 -- 172.21.15.16:0/3294298278 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6780004c00 con 0x7f678c100d90 2024-08-01T07:01:54.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.566+0000 7f6773fff640 1 -- 172.21.15.16:0/3294298278 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6780003b10 con 0x7f678c100d90 2024-08-01T07:01:54.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.566+0000 7f6791495640 1 -- 172.21.15.16:0/3294298278 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678c19b260 con 0x7f678c100d90 2024-08-01T07:01:54.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.567+0000 7f6791495640 1 -- 172.21.15.16:0/3294298278 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678c18f730 con 0x7f678c100d90 2024-08-01T07:01:54.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.568+0000 7f6773fff640 1 -- 172.21.15.16:0/3294298278 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6780031d20 con 0x7f678c100d90 2024-08-01T07:01:54.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.568+0000 7f6773fff640 1 --2- 172.21.15.16:0/3294298278 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f677406e170 0x7f6774070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:01:54.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.568+0000 7f6773fff640 1 -- 172.21.15.16:0/3294298278 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f67800af1a0 con 0x7f678c100d90 2024-08-01T07:01:54.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.568+0000 7f678affd640 1 --2- 172.21.15.16:0/3294298278 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f677406e170 0x7f6774070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:01:54.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.569+0000 7f678affd640 1 --2- 172.21.15.16:0/3294298278 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f677406e170 0x7f6774070630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f678c100bf0 tx=0x7f677c005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:01:54.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.573+0000 7f6773fff640 1 -- 172.21.15.16:0/3294298278 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6780078640 con 0x7f678c100d90 2024-08-01T07:01:54.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.819+0000 7f6791495640 1 -- 172.21.15.16:0/3294298278 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f678c1087a0 con 0x7f678c100d90 2024-08-01T07:01:54.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.819+0000 7f6773fff640 1 -- 172.21.15.16:0/3294298278 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1106 (secure 0 0 0) 0x7f678007bd00 con 0x7f678c100d90 2024-08-01T07:01:54.821 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:54 smithi016 ceph-mon[93645]: pgmap v133: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 48/288 objects degraded (16.667%) 2024-08-01T07:01:54.821 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:54 smithi016 ceph-mon[93645]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:01:54.821 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:54 smithi016 ceph-mon[93645]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:01:54.821 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:54 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/1441962104' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:01:54.821 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:54 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/1654997354' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:01:54.821 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:54 smithi016 ceph-mon[93645]: from='osd.4 [v2:172.21.15.89:6808/3568453523,v1:172.21.15.89:6809/3568453523]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-01T07:01:54.821 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:54 smithi016 ceph-mon[93645]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-01T07:01:54.822 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 48/288 objects degraded (16.667%), 15 pgs degraded 2024-08-01T07:01:54.822 INFO:teuthology.orchestra.run.smithi016.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-01T07:01:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: osd.4 (root=default,host=smithi089) is down 2024-08-01T07:01:54.822 INFO:teuthology.orchestra.run.smithi016.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 48/288 objects degraded (16.667%), 15 pgs degraded 2024-08-01T07:01:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-08-01T07:01:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-08-01T07:01:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-08-01T07:01:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-08-01T07:01:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-08-01T07:01:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-08-01T07:01:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-08-01T07:01:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-08-01T07:01:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-08-01T07:01:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-08-01T07:01:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-08-01T07:01:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-08-01T07:01:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-08-01T07:01:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-08-01T07:01:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-08-01T07:01:54.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.821+0000 7f6791495640 1 -- 172.21.15.16:0/3294298278 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f677406e170 msgr2=0x7f6774070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:54.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.821+0000 7f6791495640 1 --2- 172.21.15.16:0/3294298278 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f677406e170 0x7f6774070630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f678c100bf0 tx=0x7f677c005f90 comp rx=0 tx=0).stop 2024-08-01T07:01:54.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.821+0000 7f6791495640 1 -- 172.21.15.16:0/3294298278 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f678c100d90 msgr2=0x7f678c195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:01:54.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.821+0000 7f6791495640 1 --2- 172.21.15.16:0/3294298278 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f678c100d90 0x7f678c195b70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f67800055a0 tx=0x7f67800055d0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.821+0000 7f6791495640 1 -- 172.21.15.16:0/3294298278 shutdown_connections 2024-08-01T07:01:54.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.821+0000 7f6791495640 1 --2- 172.21.15.16:0/3294298278 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f677406e170 0x7f6774070630 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.821+0000 7f6791495640 1 --2- 172.21.15.16:0/3294298278 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f678c100d90 0x7f678c195b70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.821+0000 7f6791495640 1 --2- 172.21.15.16:0/3294298278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f678c0ffb90 0x7f678c195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:01:54.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.821+0000 7f6791495640 1 -- 172.21.15.16:0/3294298278 >> 172.21.15.16:0/3294298278 conn(0x7f678c0fb320 msgr2=0x7f678c104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:01:54.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.821+0000 7f6791495640 1 -- 172.21.15.16:0/3294298278 shutdown_connections 2024-08-01T07:01:54.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:01:54.821+0000 7f6791495640 1 -- 172.21.15.16:0/3294298278 wait complete. 2024-08-01T07:01:55.137 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:01:54 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[96778]: 2024-08-01T07:01:54.737+0000 7f1ee9366640 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-01T07:01:55.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:54 smithi089 ceph-mon[82218]: pgmap v133: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 1023 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 48/288 objects degraded (16.667%) 2024-08-01T07:01:55.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:54 smithi089 ceph-mon[82218]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:01:55.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:54 smithi089 ceph-mon[82218]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:01:55.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:54 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/1441962104' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:01:55.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:54 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/1654997354' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:01:55.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:54 smithi089 ceph-mon[82218]: from='osd.4 [v2:172.21.15.89:6808/3568453523,v1:172.21.15.89:6809/3568453523]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-01T07:01:55.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:54 smithi089 ceph-mon[82218]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-01T07:01:55.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:55 smithi089 ceph-mon[82218]: from='client.44263 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:01:55.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:55 smithi089 ceph-mon[82218]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-01T07:01:55.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:55 smithi089 ceph-mon[82218]: osdmap e72: 6 total, 5 up, 6 in 2024-08-01T07:01:55.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:55 smithi089 ceph-mon[82218]: from='osd.4 [v2:172.21.15.89:6808/3568453523,v1:172.21.15.89:6809/3568453523]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T07:01:55.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:55 smithi089 ceph-mon[82218]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T07:01:55.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:55 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/3294298278' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:01:55.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:55 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:55.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:55 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:55.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:55 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:01:55.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:55 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:01:55.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:55 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:56.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:55 smithi016 ceph-mon[93645]: from='client.44263 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:01:56.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:55 smithi016 ceph-mon[93645]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-01T07:01:56.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:55 smithi016 ceph-mon[93645]: osdmap e72: 6 total, 5 up, 6 in 2024-08-01T07:01:56.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:55 smithi016 ceph-mon[93645]: from='osd.4 [v2:172.21.15.89:6808/3568453523,v1:172.21.15.89:6809/3568453523]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T07:01:56.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:55 smithi016 ceph-mon[93645]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T07:01:56.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:55 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/3294298278' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:01:56.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:55 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:56.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:55 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:56.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:55 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:01:56.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:55 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:01:56.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:55 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:01:57.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:56 smithi089 ceph-mon[82218]: pgmap v135: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s; 48/288 objects degraded (16.667%) 2024-08-01T07:01:57.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:56 smithi089 ceph-mon[82218]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-01T07:01:57.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:56 smithi089 ceph-mon[82218]: osd.4 [v2:172.21.15.89:6808/3568453523,v1:172.21.15.89:6809/3568453523] boot 2024-08-01T07:01:57.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:56 smithi089 ceph-mon[82218]: osdmap e73: 6 total, 6 up, 6 in 2024-08-01T07:01:57.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:56 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T07:01:57.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:56 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:01:57.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:56 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:01:57.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:56 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:01:57.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:56 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:01:57.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:56 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-01T07:01:57.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:56 smithi089 ceph-mon[82218]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-01T07:01:57.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:56 smithi089 ceph-mon[82218]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-08-01T07:01:57.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:56 smithi016 ceph-mon[93645]: pgmap v135: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s; 48/288 objects degraded (16.667%) 2024-08-01T07:01:57.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:56 smithi016 ceph-mon[93645]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-01T07:01:57.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:56 smithi016 ceph-mon[93645]: osd.4 [v2:172.21.15.89:6808/3568453523,v1:172.21.15.89:6809/3568453523] boot 2024-08-01T07:01:57.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:56 smithi016 ceph-mon[93645]: osdmap e73: 6 total, 6 up, 6 in 2024-08-01T07:01:57.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:56 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-01T07:01:57.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:56 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:01:57.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:56 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:01:57.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:56 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:01:57.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:56 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:01:57.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:56 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-01T07:01:57.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:56 smithi016 ceph-mon[93645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-01T07:01:57.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:56 smithi016 ceph-mon[93645]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-08-01T07:01:58.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:57 smithi089 ceph-mon[82218]: osdmap e74: 6 total, 6 up, 6 in 2024-08-01T07:01:58.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:57 smithi016 ceph-mon[93645]: osdmap e74: 6 total, 6 up, 6 in 2024-08-01T07:01:59.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:58 smithi089 ceph-mon[82218]: pgmap v138: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 48/288 objects degraded (16.667%) 2024-08-01T07:01:59.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:58 smithi016 ceph-mon[93645]: pgmap v138: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 48/288 objects degraded (16.667%) 2024-08-01T07:02:00.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:01:59 smithi089 ceph-mon[82218]: Health check update: Degraded data redundancy: 4/288 objects degraded (1.389%), 2 pgs degraded (PG_DEGRADED) 2024-08-01T07:02:00.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:01:59 smithi016 ceph-mon[93645]: Health check update: Degraded data redundancy: 4/288 objects degraded (1.389%), 2 pgs degraded (PG_DEGRADED) 2024-08-01T07:02:01.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:00 smithi089 ceph-mon[82218]: pgmap v139: 65 pgs: 4 active+undersized, 2 active+undersized+degraded, 59 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 4 op/s; 4/288 objects degraded (1.389%) 2024-08-01T07:02:01.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:00 smithi016 ceph-mon[93645]: pgmap v139: 65 pgs: 4 active+undersized, 2 active+undersized+degraded, 59 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 4 op/s; 4/288 objects degraded (1.389%) 2024-08-01T07:02:02.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:01 smithi089 ceph-mon[82218]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/288 objects degraded (1.389%), 2 pgs degraded) 2024-08-01T07:02:02.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:01 smithi089 ceph-mon[82218]: Cluster is now healthy 2024-08-01T07:02:02.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:01 smithi016 ceph-mon[93645]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/288 objects degraded (1.389%), 2 pgs degraded) 2024-08-01T07:02:02.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:01 smithi016 ceph-mon[93645]: Cluster is now healthy 2024-08-01T07:02:03.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:02 smithi089 ceph-mon[82218]: pgmap v140: 65 pgs: 65 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-08-01T07:02:03.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:03.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:02:03.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:02 smithi016 ceph-mon[93645]: pgmap v140: 65 pgs: 65 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-08-01T07:02:03.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:03.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:02:05.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:04 smithi089 ceph-mon[82218]: pgmap v141: 65 pgs: 65 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-08-01T07:02:05.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:04 smithi016 ceph-mon[93645]: pgmap v141: 65 pgs: 65 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-08-01T07:02:07.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:06 smithi089 ceph-mon[82218]: pgmap v142: 65 pgs: 65 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-08-01T07:02:07.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:06 smithi016 ceph-mon[93645]: pgmap v142: 65 pgs: 65 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-08-01T07:02:08.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:08 smithi089 ceph-mon[82218]: pgmap v143: 65 pgs: 65 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:02:08.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:08 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:08.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:08 smithi016 ceph-mon[93645]: pgmap v143: 65 pgs: 65 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:02:08.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:08 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:10.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:10 smithi089 ceph-mon[82218]: pgmap v144: 65 pgs: 65 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-08-01T07:02:10.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:10 smithi016 ceph-mon[93645]: pgmap v144: 65 pgs: 65 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-08-01T07:02:11.464 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:11 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-01T07:02:11.464 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:11 smithi089 ceph-mon[82218]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-01T07:02:11.464 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:11 smithi089 ceph-mon[82218]: Upgrade: osd.5 is safe to restart 2024-08-01T07:02:11.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:11 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-01T07:02:11.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:11 smithi016 ceph-mon[93645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-01T07:02:11.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:11 smithi016 ceph-mon[93645]: Upgrade: osd.5 is safe to restart 2024-08-01T07:02:12.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:12 smithi089 ceph-mon[82218]: pgmap v145: 65 pgs: 65 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:02:12.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:12 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:12.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:12 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-01T07:02:12.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:12 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:02:12.549 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:12 smithi016 ceph-mon[93645]: pgmap v145: 65 pgs: 65 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:02:12.550 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:12 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:12.550 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:12 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-01T07:02:12.550 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:12 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:02:13.453 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:13 smithi089 ceph-mon[82218]: Upgrade: Updating osd.5 2024-08-01T07:02:13.454 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:13 smithi089 ceph-mon[82218]: Deploying daemon osd.5 on smithi089 2024-08-01T07:02:13.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:13 smithi016 ceph-mon[93645]: Upgrade: Updating osd.5 2024-08-01T07:02:13.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:13 smithi016 ceph-mon[93645]: Deploying daemon osd.5 on smithi089 2024-08-01T07:02:14.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:14 smithi089 ceph-mon[82218]: pgmap v146: 65 pgs: 65 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:02:14.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:14 smithi016 ceph-mon[93645]: pgmap v146: 65 pgs: 65 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:02:15.274 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:15 smithi089 systemd[1]: Stopping Ceph osd.5 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T07:02:15.637 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:15 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[55492]: 2024-08-01T07:02:15.272+0000 7f374e45b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-01T07:02:15.637 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:15 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[55492]: 2024-08-01T07:02:15.272+0000 7f374e45b640 -1 osd.5 74 *** Got signal Terminated *** 2024-08-01T07:02:15.638 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:15 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[55492]: 2024-08-01T07:02:15.272+0000 7f374e45b640 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-01T07:02:16.603 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:16 smithi089 ceph-mon[82218]: pgmap v147: 65 pgs: 65 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:02:16.604 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:16 smithi089 ceph-mon[82218]: osd.5 marked itself down and dead 2024-08-01T07:02:16.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:16 smithi016 ceph-mon[93645]: pgmap v147: 65 pgs: 65 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:02:16.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:16 smithi016 ceph-mon[93645]: osd.5 marked itself down and dead 2024-08-01T07:02:16.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:16 smithi089 podman[101634]: 2024-08-01 07:02:16.60291962 +0000 UTC m=+1.434264141 container died ac887841899e7b10a8728b5c7339a0e1825fd062792df296221b88db36b4896b (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240716, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=reef-a3bbd72, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-01T07:02:17.368 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:17 smithi089 podman[101634]: 2024-08-01 07:02:17.048618845 +0000 UTC m=+1.879963364 container cleanup ac887841899e7b10a8728b5c7339a0e1825fd062792df296221b88db36b4896b (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5, org.label-schema.build-date=20240716, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=reef-a3bbd72, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-01T07:02:17.368 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:17 smithi089 bash[101634]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5 2024-08-01T07:02:17.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:17 smithi089 ceph-mon[82218]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-01T07:02:17.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:17 smithi089 ceph-mon[82218]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-08-01T07:02:17.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:17 smithi089 ceph-mon[82218]: osdmap e75: 6 total, 5 up, 6 in 2024-08-01T07:02:17.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]: dispatch 2024-08-01T07:02:17.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [0, 5]}]: dispatch 2024-08-01T07:02:17.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [3, 1]}]: dispatch 2024-08-01T07:02:17.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [3, 2]}]: dispatch 2024-08-01T07:02:17.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 5]}]: dispatch 2024-08-01T07:02:17.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 5]}]: dispatch 2024-08-01T07:02:17.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 5]}]: dispatch 2024-08-01T07:02:17.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [1, 5]}]: dispatch 2024-08-01T07:02:17.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [3, 0]}]: dispatch 2024-08-01T07:02:17.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [1, 0]}]: dispatch 2024-08-01T07:02:17.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:17.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:02:17.637 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:17 smithi089 podman[101653]: 2024-08-01 07:02:17.366926528 +0000 UTC m=+0.762356843 container remove ac887841899e7b10a8728b5c7339a0e1825fd062792df296221b88db36b4896b (image=quay.ceph.io/ceph-ci/ceph@sha256:874ad160b08ea56a94a9c10c9da918eee8eec002405aef1c3b4a5423f6209448, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240716, GIT_CLEAN=True, RELEASE=reef-a3bbd72, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-08-01T07:02:17.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:17 smithi016 ceph-mon[93645]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-01T07:02:17.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:17 smithi016 ceph-mon[93645]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-08-01T07:02:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:17 smithi016 ceph-mon[93645]: osdmap e75: 6 total, 5 up, 6 in 2024-08-01T07:02:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]: dispatch 2024-08-01T07:02:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [0, 5]}]: dispatch 2024-08-01T07:02:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [3, 1]}]: dispatch 2024-08-01T07:02:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [3, 2]}]: dispatch 2024-08-01T07:02:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 5]}]: dispatch 2024-08-01T07:02:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 5]}]: dispatch 2024-08-01T07:02:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 5]}]: dispatch 2024-08-01T07:02:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [1, 5]}]: dispatch 2024-08-01T07:02:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [3, 0]}]: dispatch 2024-08-01T07:02:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [1, 0]}]: dispatch 2024-08-01T07:02:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:02:18.046 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:17 smithi089 podman[101738]: 2024-08-01 07:02:17.623404312 +0000 UTC m=+0.017823539 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:02:18.046 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:17 smithi089 podman[101738]: 2024-08-01 07:02:17.734832033 +0000 UTC m=+0.129251296 container create e37369bef7f4d171c29c7ce0b96b84bf29782f4b93004b30599a4e4e3466f732 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-deactivate, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-f9911e1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-08-01T07:02:18.046 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:17 smithi089 podman[101738]: 2024-08-01 07:02:17.94552282 +0000 UTC m=+0.339942037 container init e37369bef7f4d171c29c7ce0b96b84bf29782f4b93004b30599a4e4e3466f732 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, RELEASE=squid-f9911e1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-01T07:02:18.046 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:17 smithi089 podman[101738]: 2024-08-01 07:02:17.949069725 +0000 UTC m=+0.343488950 container start e37369bef7f4d171c29c7ce0b96b84bf29782f4b93004b30599a4e4e3466f732 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-f9911e1, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0) 2024-08-01T07:02:18.047 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:18 smithi089 podman[101738]: 2024-08-01 07:02:18.045564278 +0000 UTC m=+0.439983511 container attach e37369bef7f4d171c29c7ce0b96b84bf29782f4b93004b30599a4e4e3466f732 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f9911e1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-08-01T07:02:18.387 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:18 smithi089 podman[101738]: 2024-08-01 07:02:18.135537512 +0000 UTC m=+0.529956740 container died e37369bef7f4d171c29c7ce0b96b84bf29782f4b93004b30599a4e4e3466f732 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-f9911e1, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-01T07:02:18.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:18 smithi089 ceph-mon[82218]: pgmap v149: 65 pgs: 13 stale+active+clean, 52 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-08-01T07:02:18.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]': finished 2024-08-01T07:02:18.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [0, 5]}]': finished 2024-08-01T07:02:18.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [3, 1]}]': finished 2024-08-01T07:02:18.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [3, 2]}]': finished 2024-08-01T07:02:18.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 5]}]': finished 2024-08-01T07:02:18.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 5]}]': finished 2024-08-01T07:02:18.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 5]}]': finished 2024-08-01T07:02:18.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [1, 5]}]': finished 2024-08-01T07:02:18.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [3, 0]}]': finished 2024-08-01T07:02:18.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [1, 0]}]': finished 2024-08-01T07:02:18.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:18 smithi089 ceph-mon[82218]: osdmap e76: 6 total, 5 up, 6 in 2024-08-01T07:02:18.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:18 smithi016 ceph-mon[93645]: pgmap v149: 65 pgs: 13 stale+active+clean, 52 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-08-01T07:02:18.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]': finished 2024-08-01T07:02:18.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [0, 5]}]': finished 2024-08-01T07:02:18.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [3, 1]}]': finished 2024-08-01T07:02:18.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [3, 2]}]': finished 2024-08-01T07:02:18.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 5]}]': finished 2024-08-01T07:02:18.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 5]}]': finished 2024-08-01T07:02:18.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 5]}]': finished 2024-08-01T07:02:18.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [1, 5]}]': finished 2024-08-01T07:02:18.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [3, 0]}]': finished 2024-08-01T07:02:18.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [1, 0]}]': finished 2024-08-01T07:02:18.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:18 smithi016 ceph-mon[93645]: osdmap e76: 6 total, 5 up, 6 in 2024-08-01T07:02:19.138 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:18 smithi089 podman[101761]: 2024-08-01 07:02:18.758233338 +0000 UTC m=+0.615983014 container remove e37369bef7f4d171c29c7ce0b96b84bf29782f4b93004b30599a4e4e3466f732 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-f9911e1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.build-date=20240724) 2024-08-01T07:02:19.138 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:18 smithi089 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.5.service: Deactivated successfully. 2024-08-01T07:02:19.138 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:18 smithi089 systemd[1]: Stopped Ceph osd.5 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T07:02:19.138 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:18 smithi089 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.5.service: Consumed 1min 7.259s CPU time. 2024-08-01T07:02:19.138 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:18 smithi089 systemd[1]: Starting Ceph osd.5 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T07:02:19.496 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:19 smithi089 ceph-mon[82218]: osdmap e77: 6 total, 5 up, 6 in 2024-08-01T07:02:19.497 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 podman[101861]: 2024-08-01 07:02:19.103448342 +0000 UTC m=+0.017466947 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:02:19.497 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 podman[101861]: 2024-08-01 07:02:19.24298342 +0000 UTC m=+0.157002023 container create ee236957f28a43b90dbb44c26a2c2dddd5e0b86353ed345df71b3158323756bc (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-activate, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, RELEASE=squid-f9911e1, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-01T07:02:19.497 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 podman[101861]: 2024-08-01 07:02:19.495772819 +0000 UTC m=+0.409791432 container init ee236957f28a43b90dbb44c26a2c2dddd5e0b86353ed345df71b3158323756bc (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-activate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, RELEASE=squid-f9911e1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-01T07:02:19.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:19 smithi016 ceph-mon[93645]: osdmap e77: 6 total, 5 up, 6 in 2024-08-01T07:02:19.853 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 podman[101861]: 2024-08-01 07:02:19.499834397 +0000 UTC m=+0.413853005 container start ee236957f28a43b90dbb44c26a2c2dddd5e0b86353ed345df71b3158323756bc (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-f9911e1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, ceph=True) 2024-08-01T07:02:19.853 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 podman[101861]: 2024-08-01 07:02:19.595850086 +0000 UTC m=+0.509868692 container attach ee236957f28a43b90dbb44c26a2c2dddd5e0b86353ed345df71b3158323756bc (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, RELEASE=squid-f9911e1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-01T07:02:19.853 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-activate[101876]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:02:19.853 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 bash[101861]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:02:19.853 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-activate[101876]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:02:19.853 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 bash[101861]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-01T07:02:19.853 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-activate[101876]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-01T07:02:19.853 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 bash[101861]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-01T07:02:20.137 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-activate[101876]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-08-01T07:02:20.137 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 bash[101861]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-08-01T07:02:20.137 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-activate[101876]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-08-01T07:02:20.138 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 bash[101861]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-08-01T07:02:20.138 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-activate[101876]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-08-01T07:02:20.138 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 bash[101861]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-08-01T07:02:20.138 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-activate[101876]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-08-01T07:02:20.138 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 bash[101861]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-08-01T07:02:20.138 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-activate[101876]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-01T07:02:20.138 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 bash[101861]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-01T07:02:20.138 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-activate[101876]: --> ceph-volume raw activate successful for osd ID: 5 2024-08-01T07:02:20.138 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 bash[101861]: --> ceph-volume raw activate successful for osd ID: 5 2024-08-01T07:02:20.138 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:19 smithi089 podman[101861]: 2024-08-01 07:02:19.902969616 +0000 UTC m=+0.816988232 container died ee236957f28a43b90dbb44c26a2c2dddd5e0b86353ed345df71b3158323756bc (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-activate, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-f9911e1, org.label-schema.vendor=CentOS, ceph=True) 2024-08-01T07:02:20.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:20 smithi089 ceph-mon[82218]: pgmap v152: 65 pgs: 4 remapped+peering, 9 active+undersized, 2 peering, 5 stale+active+clean, 10 active+undersized+degraded, 35 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 31/288 objects degraded (10.764%) 2024-08-01T07:02:20.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:20 smithi089 ceph-mon[82218]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-08-01T07:02:20.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:20 smithi089 ceph-mon[82218]: Health check failed: Degraded data redundancy: 31/288 objects degraded (10.764%), 10 pgs degraded (PG_DEGRADED) 2024-08-01T07:02:20.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:20 smithi089 ceph-mon[82218]: osdmap e78: 6 total, 5 up, 6 in 2024-08-01T07:02:20.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:20 smithi016 ceph-mon[93645]: pgmap v152: 65 pgs: 4 remapped+peering, 9 active+undersized, 2 peering, 5 stale+active+clean, 10 active+undersized+degraded, 35 active+clean; 213 MiB data, 926 MiB used, 536 GiB / 536 GiB avail; 31/288 objects degraded (10.764%) 2024-08-01T07:02:20.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:20 smithi016 ceph-mon[93645]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-08-01T07:02:20.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:20 smithi016 ceph-mon[93645]: Health check failed: Degraded data redundancy: 31/288 objects degraded (10.764%), 10 pgs degraded (PG_DEGRADED) 2024-08-01T07:02:20.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:20 smithi016 ceph-mon[93645]: osdmap e78: 6 total, 5 up, 6 in 2024-08-01T07:02:20.858 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:20 smithi089 podman[102004]: 2024-08-01 07:02:20.534175499 +0000 UTC m=+0.625036616 container remove ee236957f28a43b90dbb44c26a2c2dddd5e0b86353ed345df71b3158323756bc (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240724, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, RELEASE=squid-f9911e1, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-01T07:02:20.859 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:20 smithi089 podman[102063]: 2024-08-01 07:02:20.650336572 +0000 UTC m=+0.017092823 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:02:20.859 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:20 smithi089 podman[102063]: 2024-08-01 07:02:20.752000993 +0000 UTC m=+0.118757272 container create 08ffb10ca1a626d9dd8dcf55a6db923d1c546a3f939f1ae40dd8ff056578cc35 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240724, RELEASE=squid-f9911e1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-01T07:02:21.137 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:20 smithi089 podman[102063]: 2024-08-01 07:02:20.963183197 +0000 UTC m=+0.329939435 container init 08ffb10ca1a626d9dd8dcf55a6db923d1c546a3f939f1ae40dd8ff056578cc35 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f9911e1) 2024-08-01T07:02:21.137 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:20 smithi089 podman[102063]: 2024-08-01 07:02:20.966586754 +0000 UTC m=+0.333342988 container start 08ffb10ca1a626d9dd8dcf55a6db923d1c546a3f939f1ae40dd8ff056578cc35 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-f9911e1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-01T07:02:21.137 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:20 smithi089 ceph-osd[102082]: -- 172.21.15.89:0/1892486998 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c44cbf21e0 con 0x55c44bda1c00 2024-08-01T07:02:21.137 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:21 smithi089 bash[102063]: 08ffb10ca1a626d9dd8dcf55a6db923d1c546a3f939f1ae40dd8ff056578cc35 2024-08-01T07:02:21.138 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:21 smithi089 systemd[1]: Started Ceph osd.5 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T07:02:21.514 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:21 smithi089 ceph-mon[82218]: osdmap e79: 6 total, 5 up, 6 in 2024-08-01T07:02:21.515 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:21 smithi089 ceph-mon[82218]: osdmap e80: 6 total, 5 up, 6 in 2024-08-01T07:02:21.515 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:21 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:21.515 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:21 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:21.515 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:21 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:21.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:21 smithi016 ceph-mon[93645]: osdmap e79: 6 total, 5 up, 6 in 2024-08-01T07:02:21.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:21 smithi016 ceph-mon[93645]: osdmap e80: 6 total, 5 up, 6 in 2024-08-01T07:02:21.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:21 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:21.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:21 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:21.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:21 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:21.840 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:21 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:02:21.512+0000 7f911d33e640 -1 Falling back to public interface 2024-08-01T07:02:22.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:22 smithi089 ceph-mon[82218]: pgmap v156: 65 pgs: 1 active+clean+remapped, 4 remapped+peering, 13 active+undersized, 2 peering, 1 active+recovering+undersized+remapped, 1 stale+active+clean, 13 active+undersized+degraded, 30 active+clean; 213 MiB data, 927 MiB used, 536 GiB / 536 GiB avail; 40/288 objects degraded (13.889%); 0 B/s, 71 objects/s recovering 2024-08-01T07:02:22.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:22 smithi089 ceph-mon[82218]: osdmap e81: 6 total, 5 up, 6 in 2024-08-01T07:02:22.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:22 smithi016 ceph-mon[93645]: pgmap v156: 65 pgs: 1 active+clean+remapped, 4 remapped+peering, 13 active+undersized, 2 peering, 1 active+recovering+undersized+remapped, 1 stale+active+clean, 13 active+undersized+degraded, 30 active+clean; 213 MiB data, 927 MiB used, 536 GiB / 536 GiB avail; 40/288 objects degraded (13.889%); 0 B/s, 71 objects/s recovering 2024-08-01T07:02:22.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:22 smithi016 ceph-mon[93645]: osdmap e81: 6 total, 5 up, 6 in 2024-08-01T07:02:23.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:23 smithi089 ceph-mon[82218]: osdmap e82: 6 total, 5 up, 6 in 2024-08-01T07:02:23.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:23 smithi016 ceph-mon[93645]: osdmap e82: 6 total, 5 up, 6 in 2024-08-01T07:02:24.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.914+0000 7ffa38b2c640 1 -- 172.21.15.16:0/2741826444 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa340ffcf0 msgr2=0x7ffa34100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:24.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.914+0000 7ffa38b2c640 1 --2- 172.21.15.16:0/2741826444 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa340ffcf0 0x7ffa34100170 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c009880 tx=0x7ffa1c02a4a0 comp rx=0 tx=0).stop 2024-08-01T07:02:24.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.914+0000 7ffa38b2c640 1 -- 172.21.15.16:0/2741826444 shutdown_connections 2024-08-01T07:02:24.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.914+0000 7ffa38b2c640 1 --2- 172.21.15.16:0/2741826444 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa340ffcf0 0x7ffa34100170 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:24.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.914+0000 7ffa38b2c640 1 --2- 172.21.15.16:0/2741826444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa340feaf0 0x7ffa340feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:24.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.914+0000 7ffa38b2c640 1 -- 172.21.15.16:0/2741826444 >> 172.21.15.16:0/2741826444 conn(0x7ffa340fa280 msgr2=0x7ffa340fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:24.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.914+0000 7ffa38b2c640 1 -- 172.21.15.16:0/2741826444 shutdown_connections 2024-08-01T07:02:24.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.914+0000 7ffa38b2c640 1 -- 172.21.15.16:0/2741826444 wait complete. 2024-08-01T07:02:24.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.915+0000 7ffa38b2c640 1 Processor -- start 2024-08-01T07:02:24.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.915+0000 7ffa38b2c640 1 -- start start 2024-08-01T07:02:24.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.915+0000 7ffa38b2c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa340feaf0 0x7ffa341956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:24.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.915+0000 7ffa38b2c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa340ffcf0 0x7ffa34195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:24.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.915+0000 7ffa38b2c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa341961f0 con 0x7ffa340feaf0 2024-08-01T07:02:24.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.915+0000 7ffa38b2c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa34196360 con 0x7ffa340ffcf0 2024-08-01T07:02:24.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.915+0000 7ffa3259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa340feaf0 0x7ffa341956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:24.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.915+0000 7ffa3259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa340feaf0 0x7ffa341956e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58128/0 (socket says 172.21.15.16:58128) 2024-08-01T07:02:24.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.915+0000 7ffa2bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa340ffcf0 0x7ffa34195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:24.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.915+0000 7ffa3259c640 1 -- 172.21.15.16:0/617191957 learned_addr learned my addr 172.21.15.16:0/617191957 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:02:24.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.916+0000 7ffa2bfff640 1 -- 172.21.15.16:0/617191957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa340feaf0 msgr2=0x7ffa341956e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:24.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.916+0000 7ffa2bfff640 1 --2- 172.21.15.16:0/617191957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa340feaf0 0x7ffa341956e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:24.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.916+0000 7ffa2bfff640 1 -- 172.21.15.16:0/617191957 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c009560 con 0x7ffa340ffcf0 2024-08-01T07:02:24.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.916+0000 7ffa2bfff640 1 --2- 172.21.15.16:0/617191957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa340ffcf0 0x7ffa34195c20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c02a9c0 tx=0x7ffa1c0055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:24.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.916+0000 7ffa2b7fe640 1 -- 172.21.15.16:0/617191957 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa1c004aa0 con 0x7ffa340ffcf0 2024-08-01T07:02:24.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.916+0000 7ffa2b7fe640 1 -- 172.21.15.16:0/617191957 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa1c005d50 con 0x7ffa340ffcf0 2024-08-01T07:02:24.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.916+0000 7ffa38b2c640 1 -- 172.21.15.16:0/617191957 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3419ada0 con 0x7ffa340ffcf0 2024-08-01T07:02:24.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.916+0000 7ffa2b7fe640 1 -- 172.21.15.16:0/617191957 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa1c0039b0 con 0x7ffa340ffcf0 2024-08-01T07:02:24.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.916+0000 7ffa38b2c640 1 -- 172.21.15.16:0/617191957 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3419b290 con 0x7ffa340ffcf0 2024-08-01T07:02:24.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.917+0000 7ffa38b2c640 1 -- 172.21.15.16:0/617191957 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa34107700 con 0x7ffa340ffcf0 2024-08-01T07:02:24.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.918+0000 7ffa2b7fe640 1 -- 172.21.15.16:0/617191957 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ffa1c031c00 con 0x7ffa340ffcf0 2024-08-01T07:02:24.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.918+0000 7ffa2b7fe640 1 --2- 172.21.15.16:0/617191957 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ffa2006e170 0x7ffa20070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:24.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.918+0000 7ffa2b7fe640 1 -- 172.21.15.16:0/617191957 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7054+0+0 (secure 0 0 0) 0x7ffa1c0af380 con 0x7ffa340ffcf0 2024-08-01T07:02:24.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.918+0000 7ffa3259c640 1 --2- 172.21.15.16:0/617191957 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ffa2006e170 0x7ffa20070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:24.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.919+0000 7ffa3259c640 1 --2- 172.21.15.16:0/617191957 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ffa2006e170 0x7ffa20070630 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffa240058c0 tx=0x7ffa24005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:24.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:24.923+0000 7ffa2b7fe640 1 -- 172.21.15.16:0/617191957 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ffa1c0784a0 con 0x7ffa340ffcf0 2024-08-01T07:02:25.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.123+0000 7ffa38b2c640 1 -- 172.21.15.16:0/617191957 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa3419b480 con 0x7ffa2006e170 2024-08-01T07:02:25.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.124+0000 7ffa2b7fe640 1 -- 172.21.15.16:0/617191957 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ffa3419b480 con 0x7ffa2006e170 2024-08-01T07:02:25.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.126+0000 7ffa38b2c640 1 -- 172.21.15.16:0/617191957 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ffa2006e170 msgr2=0x7ffa20070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:25.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.126+0000 7ffa38b2c640 1 --2- 172.21.15.16:0/617191957 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ffa2006e170 0x7ffa20070630 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffa240058c0 tx=0x7ffa24005f90 comp rx=0 tx=0).stop 2024-08-01T07:02:25.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.126+0000 7ffa38b2c640 1 -- 172.21.15.16:0/617191957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa340ffcf0 msgr2=0x7ffa34195c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:25.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.126+0000 7ffa38b2c640 1 --2- 172.21.15.16:0/617191957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa340ffcf0 0x7ffa34195c20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c02a9c0 tx=0x7ffa1c0055a0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.126+0000 7ffa38b2c640 1 -- 172.21.15.16:0/617191957 shutdown_connections 2024-08-01T07:02:25.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.126+0000 7ffa38b2c640 1 --2- 172.21.15.16:0/617191957 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ffa2006e170 0x7ffa20070630 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.126+0000 7ffa38b2c640 1 --2- 172.21.15.16:0/617191957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa340ffcf0 0x7ffa34195c20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.126+0000 7ffa38b2c640 1 --2- 172.21.15.16:0/617191957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa340feaf0 0x7ffa341956e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.126+0000 7ffa38b2c640 1 -- 172.21.15.16:0/617191957 >> 172.21.15.16:0/617191957 conn(0x7ffa340fa280 msgr2=0x7ffa34067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:25.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.126+0000 7ffa38b2c640 1 -- 172.21.15.16:0/617191957 shutdown_connections 2024-08-01T07:02:25.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.126+0000 7ffa38b2c640 1 -- 172.21.15.16:0/617191957 wait complete. 2024-08-01T07:02:25.136 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T07:02:25.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.211+0000 7fde59d1d640 1 -- 172.21.15.16:0/521836572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde540feaf0 msgr2=0x7fde540feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:25.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.211+0000 7fde59d1d640 1 --2- 172.21.15.16:0/521836572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde540feaf0 0x7fde540feef0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fde44009880 tx=0x7fde4402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.211+0000 7fde59d1d640 1 -- 172.21.15.16:0/521836572 shutdown_connections 2024-08-01T07:02:25.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.211+0000 7fde59d1d640 1 --2- 172.21.15.16:0/521836572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde540ffcf0 0x7fde54100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.211+0000 7fde59d1d640 1 --2- 172.21.15.16:0/521836572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde540feaf0 0x7fde540feef0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.211+0000 7fde59d1d640 1 -- 172.21.15.16:0/521836572 >> 172.21.15.16:0/521836572 conn(0x7fde540fa280 msgr2=0x7fde540fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:25.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.211+0000 7fde59d1d640 1 -- 172.21.15.16:0/521836572 shutdown_connections 2024-08-01T07:02:25.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.211+0000 7fde59d1d640 1 -- 172.21.15.16:0/521836572 wait complete. 2024-08-01T07:02:25.215 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:24 smithi016 ceph-mon[93645]: pgmap v159: 65 pgs: 1 active+clean+remapped, 4 remapped+peering, 13 active+undersized, 2 peering, 1 active+recovering+undersized+remapped, 1 stale+active+clean, 13 active+undersized+degraded, 30 active+clean; 213 MiB data, 923 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 1 op/s; 40/288 objects degraded (13.889%); 0 B/s, 71 objects/s recovering 2024-08-01T07:02:25.216 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:24 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:25.216 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:24 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:25.216 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:24 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:25.216 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:24 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:25.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.212+0000 7fde59d1d640 1 Processor -- start 2024-08-01T07:02:25.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.212+0000 7fde59d1d640 1 -- start start 2024-08-01T07:02:25.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.212+0000 7fde59d1d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde540feaf0 0x7fde541945c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:25.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.212+0000 7fde59d1d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde540ffcf0 0x7fde54194b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:25.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.212+0000 7fde59d1d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde541950d0 con 0x7fde540feaf0 2024-08-01T07:02:25.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.212+0000 7fde59d1d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde54195240 con 0x7fde540ffcf0 2024-08-01T07:02:25.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.212+0000 7fde537fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde540feaf0 0x7fde541945c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:25.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.212+0000 7fde537fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde540feaf0 0x7fde541945c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58154/0 (socket says 172.21.15.16:58154) 2024-08-01T07:02:25.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.212+0000 7fde537fe640 1 -- 172.21.15.16:0/2193010250 learned_addr learned my addr 172.21.15.16:0/2193010250 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:02:25.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.212+0000 7fde4affd640 1 --2- 172.21.15.16:0/2193010250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde540ffcf0 0x7fde54194b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:25.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.213+0000 7fde4affd640 1 -- 172.21.15.16:0/2193010250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde540feaf0 msgr2=0x7fde541945c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:25.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.213+0000 7fde4affd640 1 --2- 172.21.15.16:0/2193010250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde540feaf0 0x7fde541945c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.213+0000 7fde4affd640 1 -- 172.21.15.16:0/2193010250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde44009560 con 0x7fde540ffcf0 2024-08-01T07:02:25.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.213+0000 7fde537fe640 1 --2- 172.21.15.16:0/2193010250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde540feaf0 0x7fde541945c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T07:02:25.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.213+0000 7fde4affd640 1 --2- 172.21.15.16:0/2193010250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde540ffcf0 0x7fde54194b00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00e970 tx=0x7fde3c00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:25.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.213+0000 7fde517fa640 1 -- 172.21.15.16:0/2193010250 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde3c009620 con 0x7fde540ffcf0 2024-08-01T07:02:25.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.213+0000 7fde517fa640 1 -- 172.21.15.16:0/2193010250 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde3c0044f0 con 0x7fde540ffcf0 2024-08-01T07:02:25.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.213+0000 7fde59d1d640 1 -- 172.21.15.16:0/2193010250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde54199ce0 con 0x7fde540ffcf0 2024-08-01T07:02:25.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.213+0000 7fde517fa640 1 -- 172.21.15.16:0/2193010250 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde3c0049d0 con 0x7fde540ffcf0 2024-08-01T07:02:25.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.213+0000 7fde59d1d640 1 -- 172.21.15.16:0/2193010250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5419a230 con 0x7fde540ffcf0 2024-08-01T07:02:25.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.214+0000 7fde59d1d640 1 -- 172.21.15.16:0/2193010250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5418e690 con 0x7fde540ffcf0 2024-08-01T07:02:25.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.215+0000 7fde517fa640 1 -- 172.21.15.16:0/2193010250 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fde3c00cc90 con 0x7fde540ffcf0 2024-08-01T07:02:25.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.215+0000 7fde517fa640 1 --2- 172.21.15.16:0/2193010250 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fde4006e170 0x7fde40070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:25.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.216+0000 7fde537fe640 1 --2- 172.21.15.16:0/2193010250 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fde4006e170 0x7fde40070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:25.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.216+0000 7fde517fa640 1 -- 172.21.15.16:0/2193010250 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7054+0+0 (secure 0 0 0) 0x7fde3c014070 con 0x7fde540ffcf0 2024-08-01T07:02:25.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.216+0000 7fde537fe640 1 --2- 172.21.15.16:0/2193010250 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fde4006e170 0x7fde40070630 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fde44000c00 tx=0x7fde440314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:25.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.220+0000 7fde517fa640 1 -- 172.21.15.16:0/2193010250 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fde3c057750 con 0x7fde540ffcf0 2024-08-01T07:02:25.252 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:24 smithi089 ceph-mon[82218]: pgmap v159: 65 pgs: 1 active+clean+remapped, 4 remapped+peering, 13 active+undersized, 2 peering, 1 active+recovering+undersized+remapped, 1 stale+active+clean, 13 active+undersized+degraded, 30 active+clean; 213 MiB data, 923 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 1 op/s; 40/288 objects degraded (13.889%); 0 B/s, 71 objects/s recovering 2024-08-01T07:02:25.252 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:24 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:25.252 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:24 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:25.252 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:24 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:25.252 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:24 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:25.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.411+0000 7fde59d1d640 1 -- 172.21.15.16:0/2193010250 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde5402c4f0 con 0x7fde4006e170 2024-08-01T07:02:25.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.413+0000 7fde517fa640 1 -- 172.21.15.16:0/2193010250 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fde5402c4f0 con 0x7fde4006e170 2024-08-01T07:02:25.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.415+0000 7fde59d1d640 1 -- 172.21.15.16:0/2193010250 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fde4006e170 msgr2=0x7fde40070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:25.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.415+0000 7fde59d1d640 1 --2- 172.21.15.16:0/2193010250 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fde4006e170 0x7fde40070630 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fde44000c00 tx=0x7fde440314e0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.415+0000 7fde59d1d640 1 -- 172.21.15.16:0/2193010250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde540ffcf0 msgr2=0x7fde54194b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:25.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.415+0000 7fde59d1d640 1 --2- 172.21.15.16:0/2193010250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde540ffcf0 0x7fde54194b00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00e970 tx=0x7fde3c00ee30 comp rx=0 tx=0).stop 2024-08-01T07:02:25.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.415+0000 7fde59d1d640 1 -- 172.21.15.16:0/2193010250 shutdown_connections 2024-08-01T07:02:25.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.415+0000 7fde59d1d640 1 --2- 172.21.15.16:0/2193010250 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fde4006e170 0x7fde40070630 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.415+0000 7fde59d1d640 1 --2- 172.21.15.16:0/2193010250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde540ffcf0 0x7fde54194b00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.415+0000 7fde59d1d640 1 --2- 172.21.15.16:0/2193010250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde540feaf0 0x7fde541945c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.415+0000 7fde59d1d640 1 -- 172.21.15.16:0/2193010250 >> 172.21.15.16:0/2193010250 conn(0x7fde540fa280 msgr2=0x7fde541033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:25.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.415+0000 7fde59d1d640 1 -- 172.21.15.16:0/2193010250 shutdown_connections 2024-08-01T07:02:25.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.415+0000 7fde59d1d640 1 -- 172.21.15.16:0/2193010250 wait complete. 2024-08-01T07:02:25.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.498+0000 7fc86b7b0640 1 -- 172.21.15.16:0/845828851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8640ffc80 msgr2=0x7fc864100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:25.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.498+0000 7fc86b7b0640 1 --2- 172.21.15.16:0/845828851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8640ffc80 0x7fc864100100 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc860009880 tx=0x7fc86002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.498+0000 7fc86b7b0640 1 -- 172.21.15.16:0/845828851 shutdown_connections 2024-08-01T07:02:25.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.498+0000 7fc86b7b0640 1 --2- 172.21.15.16:0/845828851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8640ffc80 0x7fc864100100 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.498+0000 7fc86b7b0640 1 --2- 172.21.15.16:0/845828851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8640fea80 0x7fc8640fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.499+0000 7fc86b7b0640 1 -- 172.21.15.16:0/845828851 >> 172.21.15.16:0/845828851 conn(0x7fc8640fa230 msgr2=0x7fc8640fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:25.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.499+0000 7fc86b7b0640 1 -- 172.21.15.16:0/845828851 shutdown_connections 2024-08-01T07:02:25.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.499+0000 7fc86b7b0640 1 -- 172.21.15.16:0/845828851 wait complete. 2024-08-01T07:02:25.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.499+0000 7fc86b7b0640 1 Processor -- start 2024-08-01T07:02:25.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.500+0000 7fc86b7b0640 1 -- start start 2024-08-01T07:02:25.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.500+0000 7fc86b7b0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8640fea80 0x7fc864068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:25.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.500+0000 7fc86b7b0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8640ffc80 0x7fc86419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:25.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.500+0000 7fc86b7b0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86419a910 con 0x7fc8640ffc80 2024-08-01T07:02:25.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.500+0000 7fc86b7b0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86419aa50 con 0x7fc8640fea80 2024-08-01T07:02:25.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.500+0000 7fc868d4b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8640ffc80 0x7fc86419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:25.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.500+0000 7fc86954c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8640fea80 0x7fc864068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:25.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.500+0000 7fc868d4b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8640ffc80 0x7fc86419a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58182/0 (socket says 172.21.15.16:58182) 2024-08-01T07:02:25.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.500+0000 7fc868d4b640 1 -- 172.21.15.16:0/1939682921 learned_addr learned my addr 172.21.15.16:0/1939682921 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:02:25.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.500+0000 7fc86954c640 1 -- 172.21.15.16:0/1939682921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8640ffc80 msgr2=0x7fc86419a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:25.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.500+0000 7fc86954c640 1 --2- 172.21.15.16:0/1939682921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8640ffc80 0x7fc86419a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.500+0000 7fc86954c640 1 -- 172.21.15.16:0/1939682921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc860009560 con 0x7fc8640fea80 2024-08-01T07:02:25.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.501+0000 7fc86954c640 1 --2- 172.21.15.16:0/1939682921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8640fea80 0x7fc864068fb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc85800e940 tx=0x7fc85800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:25.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.501+0000 7fc8567fc640 1 -- 172.21.15.16:0/1939682921 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc85800cc90 con 0x7fc8640fea80 2024-08-01T07:02:25.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.501+0000 7fc8567fc640 1 -- 172.21.15.16:0/1939682921 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc85800cdf0 con 0x7fc8640fea80 2024-08-01T07:02:25.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.501+0000 7fc86b7b0640 1 -- 172.21.15.16:0/1939682921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86419ad00 con 0x7fc8640fea80 2024-08-01T07:02:25.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.501+0000 7fc8567fc640 1 -- 172.21.15.16:0/1939682921 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc858010430 con 0x7fc8640fea80 2024-08-01T07:02:25.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.501+0000 7fc86b7b0640 1 -- 172.21.15.16:0/1939682921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86419b2d0 con 0x7fc8640fea80 2024-08-01T07:02:25.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.502+0000 7fc86b7b0640 1 -- 172.21.15.16:0/1939682921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86418e600 con 0x7fc8640fea80 2024-08-01T07:02:25.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.502+0000 7fc8567fc640 1 -- 172.21.15.16:0/1939682921 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc858003f70 con 0x7fc8640fea80 2024-08-01T07:02:25.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.503+0000 7fc8567fc640 1 --2- 172.21.15.16:0/1939682921 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc85006e180 0x7fc850070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:25.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.503+0000 7fc8567fc640 1 -- 172.21.15.16:0/1939682921 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7054+0+0 (secure 0 0 0) 0x7fc858014070 con 0x7fc8640fea80 2024-08-01T07:02:25.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.503+0000 7fc868d4b640 1 --2- 172.21.15.16:0/1939682921 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc85006e180 0x7fc850070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:25.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.504+0000 7fc868d4b640 1 --2- 172.21.15.16:0/1939682921 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc85006e180 0x7fc850070640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc864069530 tx=0x7fc8600314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:25.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.507+0000 7fc8567fc640 1 -- 172.21.15.16:0/1939682921 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc8580578c0 con 0x7fc8640fea80 2024-08-01T07:02:25.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.692+0000 7fc86b7b0640 1 -- 172.21.15.16:0/1939682921 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc86402c5c0 con 0x7fc85006e180 2024-08-01T07:02:25.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.701+0000 7fc8567fc640 1 -- 172.21.15.16:0/1939682921 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fc86402c5c0 con 0x7fc85006e180 2024-08-01T07:02:25.703 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T07:02:25.703 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (13m) 98s ago 14m 25.2M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T07:02:25.703 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (14m) 98s ago 14m 8929k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T07:02:25.703 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (13m) 1s ago 13m 8786k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T07:02:25.703 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (3m) 98s ago 14m 6899k - 19.1.0-1223-gf9911e17 93d93c74a2cc 2a96028287a2 2024-08-01T07:02:25.703 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (3m) 1s ago 13m 6895k - 19.1.0-1223-gf9911e17 93d93c74a2cc 8a23341bd6c3 2024-08-01T07:02:25.704 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (12m) 98s ago 14m 84.5M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T07:02:25.704 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (9m) 98s ago 9m 89.3M - 18.2.2-1767-ga3bbd728 d280790d1980 96e46c28d16c 2024-08-01T07:02:25.704 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (9m) 98s ago 9m 147M - 18.2.2-1767-ga3bbd728 d280790d1980 4bbe1a388689 2024-08-01T07:02:25.704 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (9m) 1s ago 9m 26.7M - 18.2.2-1767-ga3bbd728 d280790d1980 65ca121a6fbb 2024-08-01T07:02:25.704 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (8m) 1s ago 8m 25.7M - 18.2.2-1767-ga3bbd728 d280790d1980 05bb46c6fe94 2024-08-01T07:02:25.704 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:8443,9283,8765 running (5m) 98s ago 15m 501M - 19.1.0-1223-gf9911e17 93d93c74a2cc 8701e6315593 2024-08-01T07:02:25.704 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (4m) 1s ago 13m 441M - 19.1.0-1223-gf9911e17 93d93c74a2cc c6caa21f436f 2024-08-01T07:02:25.704 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (4m) 98s ago 15m 48.2M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc 48e94d076e6f 2024-08-01T07:02:25.704 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (3m) 1s ago 13m 41.8M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc c4b83b46ff15 2024-08-01T07:02:25.704 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (14m) 98s ago 14m 15.9M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T07:02:25.705 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (13m) 1s ago 13m 16.5M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T07:02:25.705 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (2m) 98s ago 12m 93.0M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 4c2115ae6222 2024-08-01T07:02:25.705 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (2m) 98s ago 12m 95.5M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc fc2f7117be30 2024-08-01T07:02:25.705 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (104s) 98s ago 11m 12.1M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 3364752c9365 2024-08-01T07:02:25.705 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (69s) 1s ago 11m 105M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 9a18feae4353 2024-08-01T07:02:25.705 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (37s) 1s ago 11m 128M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 7c51ba7a636a 2024-08-01T07:02:25.705 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (5s) 1s ago 10m 12.1M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 08ffb10ca1a6 2024-08-01T07:02:25.705 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (4m) 98s ago 13m 60.6M - 2.43.0 a07b618ecd1d 45d23c96382e 2024-08-01T07:02:25.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.703+0000 7fc86b7b0640 1 -- 172.21.15.16:0/1939682921 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc85006e180 msgr2=0x7fc850070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:25.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.703+0000 7fc86b7b0640 1 --2- 172.21.15.16:0/1939682921 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc85006e180 0x7fc850070640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc864069530 tx=0x7fc8600314e0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.703+0000 7fc86b7b0640 1 -- 172.21.15.16:0/1939682921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8640fea80 msgr2=0x7fc864068fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:25.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.703+0000 7fc86b7b0640 1 --2- 172.21.15.16:0/1939682921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8640fea80 0x7fc864068fb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc85800e940 tx=0x7fc85800ee00 comp rx=0 tx=0).stop 2024-08-01T07:02:25.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.703+0000 7fc86b7b0640 1 -- 172.21.15.16:0/1939682921 shutdown_connections 2024-08-01T07:02:25.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.703+0000 7fc86b7b0640 1 --2- 172.21.15.16:0/1939682921 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc85006e180 0x7fc850070640 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.703+0000 7fc86b7b0640 1 --2- 172.21.15.16:0/1939682921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8640ffc80 0x7fc86419a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.703+0000 7fc86b7b0640 1 --2- 172.21.15.16:0/1939682921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8640fea80 0x7fc864068fb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.703+0000 7fc86b7b0640 1 -- 172.21.15.16:0/1939682921 >> 172.21.15.16:0/1939682921 conn(0x7fc8640fa230 msgr2=0x7fc864103300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:25.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.704+0000 7fc86b7b0640 1 -- 172.21.15.16:0/1939682921 shutdown_connections 2024-08-01T07:02:25.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.704+0000 7fc86b7b0640 1 -- 172.21.15.16:0/1939682921 wait complete. 2024-08-01T07:02:25.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.785+0000 7f549ea31640 1 -- 172.21.15.16:0/1980330842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54980feaf0 msgr2=0x7f54980feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:25.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.785+0000 7f549ea31640 1 --2- 172.21.15.16:0/1980330842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54980feaf0 0x7f54980feef0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5488009880 tx=0x7f548802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.786+0000 7f549ea31640 1 -- 172.21.15.16:0/1980330842 shutdown_connections 2024-08-01T07:02:25.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.786+0000 7f549ea31640 1 --2- 172.21.15.16:0/1980330842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54980ffcf0 0x7f5498100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.786+0000 7f549ea31640 1 --2- 172.21.15.16:0/1980330842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54980feaf0 0x7f54980feef0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.786+0000 7f549ea31640 1 -- 172.21.15.16:0/1980330842 >> 172.21.15.16:0/1980330842 conn(0x7f54980fa280 msgr2=0x7f54980fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:25.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.786+0000 7f549ea31640 1 -- 172.21.15.16:0/1980330842 shutdown_connections 2024-08-01T07:02:25.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.786+0000 7f549ea31640 1 -- 172.21.15.16:0/1980330842 wait complete. 2024-08-01T07:02:25.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.787+0000 7f549ea31640 1 Processor -- start 2024-08-01T07:02:25.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.787+0000 7f549ea31640 1 -- start start 2024-08-01T07:02:25.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.787+0000 7f549ea31640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54980feaf0 0x7f5498194560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:25.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.787+0000 7f549ea31640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54980ffcf0 0x7f5498194aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:25.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.787+0000 7f549ea31640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5498195070 con 0x7f54980feaf0 2024-08-01T07:02:25.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.787+0000 7f549ea31640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54981951e0 con 0x7f54980ffcf0 2024-08-01T07:02:25.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.787+0000 7f5497fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54980feaf0 0x7f5498194560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:25.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.787+0000 7f5497fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54980feaf0 0x7f5498194560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58190/0 (socket says 172.21.15.16:58190) 2024-08-01T07:02:25.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.787+0000 7f5497fff640 1 -- 172.21.15.16:0/1262917113 learned_addr learned my addr 172.21.15.16:0/1262917113 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:02:25.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.787+0000 7f54977fe640 1 --2- 172.21.15.16:0/1262917113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54980ffcf0 0x7f5498194aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:25.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.788+0000 7f5497fff640 1 -- 172.21.15.16:0/1262917113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54980ffcf0 msgr2=0x7f5498194aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:25.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.788+0000 7f5497fff640 1 --2- 172.21.15.16:0/1262917113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54980ffcf0 0x7f5498194aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:25.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.788+0000 7f5497fff640 1 -- 172.21.15.16:0/1262917113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5488009560 con 0x7f54980feaf0 2024-08-01T07:02:25.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.788+0000 7f54977fe640 1 --2- 172.21.15.16:0/1262917113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54980ffcf0 0x7f5498194aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T07:02:25.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.788+0000 7f5497fff640 1 --2- 172.21.15.16:0/1262917113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54980feaf0 0x7f5498194560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5488004650 tx=0x7f54880055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:25.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.788+0000 7f54957fa640 1 -- 172.21.15.16:0/1262917113 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5488004aa0 con 0x7f54980feaf0 2024-08-01T07:02:25.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.788+0000 7f54957fa640 1 -- 172.21.15.16:0/1262917113 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5488005d50 con 0x7f54980feaf0 2024-08-01T07:02:25.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.788+0000 7f549ea31640 1 -- 172.21.15.16:0/1262917113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5498067cf0 con 0x7f54980feaf0 2024-08-01T07:02:25.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.788+0000 7f54957fa640 1 -- 172.21.15.16:0/1262917113 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54880039e0 con 0x7f54980feaf0 2024-08-01T07:02:25.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.788+0000 7f549ea31640 1 -- 172.21.15.16:0/1262917113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5498068190 con 0x7f54980feaf0 2024-08-01T07:02:25.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.789+0000 7f549ea31640 1 -- 172.21.15.16:0/1262917113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54980feef0 con 0x7f54980feaf0 2024-08-01T07:02:25.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.790+0000 7f54957fa640 1 -- 172.21.15.16:0/1262917113 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5488031c00 con 0x7f54980feaf0 2024-08-01T07:02:25.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.791+0000 7f54957fa640 1 --2- 172.21.15.16:0/1262917113 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f548006e170 0x7f5480070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:25.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.791+0000 7f54957fa640 1 -- 172.21.15.16:0/1262917113 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7054+0+0 (secure 0 0 0) 0x7f54880af390 con 0x7f54980feaf0 2024-08-01T07:02:25.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.791+0000 7f54977fe640 1 --2- 172.21.15.16:0/1262917113 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f548006e170 0x7f5480070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:25.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.791+0000 7f54977fe640 1 --2- 172.21.15.16:0/1262917113 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f548006e170 0x7f5480070630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5498195a80 tx=0x7f548c005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:25.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:25.795+0000 7f54957fa640 1 -- 172.21.15.16:0/1262917113 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5488078550 con 0x7f54980feaf0 2024-08-01T07:02:26.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.044+0000 7f549ea31640 1 -- 172.21.15.16:0/1262917113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f549818e220 con 0x7f54980feaf0 2024-08-01T07:02:26.047 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:25 smithi016 ceph-mon[93645]: Health check update: Degraded data redundancy: 40/288 objects degraded (13.889%), 13 pgs degraded (PG_DEGRADED) 2024-08-01T07:02:26.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.045+0000 7f54957fa640 1 -- 172.21.15.16:0/1262917113 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+726 (secure 0 0 0) 0x7f548807bc10 con 0x7f54980feaf0 2024-08-01T07:02:26.047 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:02:26.047 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T07:02:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:02:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:02:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T07:02:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:02:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:02:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T07:02:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 5 2024-08-01T07:02:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:02:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T07:02:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4 2024-08-01T07:02:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:02:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T07:02:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4, 2024-08-01T07:02:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 9 2024-08-01T07:02:26.049 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T07:02:26.049 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:02:26.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.047+0000 7f549ea31640 1 -- 172.21.15.16:0/1262917113 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f548006e170 msgr2=0x7f5480070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:26.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.047+0000 7f549ea31640 1 --2- 172.21.15.16:0/1262917113 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f548006e170 0x7f5480070630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5498195a80 tx=0x7f548c005f90 comp rx=0 tx=0).stop 2024-08-01T07:02:26.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.047+0000 7f549ea31640 1 -- 172.21.15.16:0/1262917113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54980feaf0 msgr2=0x7f5498194560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:26.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.047+0000 7f549ea31640 1 --2- 172.21.15.16:0/1262917113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54980feaf0 0x7f5498194560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5488004650 tx=0x7f54880055a0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.047+0000 7f549ea31640 1 -- 172.21.15.16:0/1262917113 shutdown_connections 2024-08-01T07:02:26.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.047+0000 7f549ea31640 1 --2- 172.21.15.16:0/1262917113 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f548006e170 0x7f5480070630 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.047+0000 7f549ea31640 1 --2- 172.21.15.16:0/1262917113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54980ffcf0 0x7f5498194aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.047+0000 7f549ea31640 1 --2- 172.21.15.16:0/1262917113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54980feaf0 0x7f5498194560 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.047+0000 7f549ea31640 1 -- 172.21.15.16:0/1262917113 >> 172.21.15.16:0/1262917113 conn(0x7f54980fa280 msgr2=0x7f5498103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:26.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.048+0000 7f549ea31640 1 -- 172.21.15.16:0/1262917113 shutdown_connections 2024-08-01T07:02:26.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.048+0000 7f549ea31640 1 -- 172.21.15.16:0/1262917113 wait complete. 2024-08-01T07:02:26.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.130+0000 7f7bdff8b640 1 -- 172.21.15.16:0/3720343698 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bd8072f10 msgr2=0x7f7bd8073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:26.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.130+0000 7f7bdff8b640 1 --2- 172.21.15.16:0/3720343698 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bd8072f10 0x7f7bd8073370 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8009880 tx=0x7f7bc802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.130+0000 7f7bdff8b640 1 -- 172.21.15.16:0/3720343698 shutdown_connections 2024-08-01T07:02:26.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.130+0000 7f7bdff8b640 1 --2- 172.21.15.16:0/3720343698 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bd8072f10 0x7f7bd8073370 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.130+0000 7f7bdff8b640 1 --2- 172.21.15.16:0/3720343698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bd80744e0 0x7f7bd8072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.130+0000 7f7bdff8b640 1 -- 172.21.15.16:0/3720343698 >> 172.21.15.16:0/3720343698 conn(0x7f7bd80fb320 msgr2=0x7f7bd80fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:26.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.130+0000 7f7bdff8b640 1 -- 172.21.15.16:0/3720343698 shutdown_connections 2024-08-01T07:02:26.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.130+0000 7f7bdff8b640 1 -- 172.21.15.16:0/3720343698 wait complete. 2024-08-01T07:02:26.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.131+0000 7f7bdff8b640 1 Processor -- start 2024-08-01T07:02:26.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.131+0000 7f7bdff8b640 1 -- start start 2024-08-01T07:02:26.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.131+0000 7f7bdff8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bd8072f10 0x7f7bd819bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:26.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.131+0000 7f7bdff8b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bd80744e0 0x7f7bd819c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:26.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.131+0000 7f7bdff8b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd819c7f0 con 0x7f7bd80744e0 2024-08-01T07:02:26.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.131+0000 7f7bdff8b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd819c960 con 0x7f7bd8072f10 2024-08-01T07:02:26.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.131+0000 7f7bdd526640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bd80744e0 0x7f7bd819c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:26.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.131+0000 7f7bddd27640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bd8072f10 0x7f7bd819bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:26.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.131+0000 7f7bdd526640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bd80744e0 0x7f7bd819c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58210/0 (socket says 172.21.15.16:58210) 2024-08-01T07:02:26.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.131+0000 7f7bdd526640 1 -- 172.21.15.16:0/2774318782 learned_addr learned my addr 172.21.15.16:0/2774318782 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:02:26.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.132+0000 7f7bddd27640 1 -- 172.21.15.16:0/2774318782 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bd80744e0 msgr2=0x7f7bd819c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:26.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.132+0000 7f7bddd27640 1 --2- 172.21.15.16:0/2774318782 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bd80744e0 0x7f7bd819c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.132+0000 7f7bddd27640 1 -- 172.21.15.16:0/2774318782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc8009560 con 0x7f7bd8072f10 2024-08-01T07:02:26.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.132+0000 7f7bddd27640 1 --2- 172.21.15.16:0/2774318782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bd8072f10 0x7f7bd819bce0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400e940 tx=0x7f7bd400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:26.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.132+0000 7f7bceffd640 1 -- 172.21.15.16:0/2774318782 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bd4009640 con 0x7f7bd8072f10 2024-08-01T07:02:26.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.132+0000 7f7bdff8b640 1 -- 172.21.15.16:0/2774318782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd81a13f0 con 0x7f7bd8072f10 2024-08-01T07:02:26.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.132+0000 7f7bceffd640 1 -- 172.21.15.16:0/2774318782 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7bd400cc90 con 0x7f7bd8072f10 2024-08-01T07:02:26.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.132+0000 7f7bceffd640 1 -- 172.21.15.16:0/2774318782 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bd4018810 con 0x7f7bd8072f10 2024-08-01T07:02:26.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.132+0000 7f7bdff8b640 1 -- 172.21.15.16:0/2774318782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd81a19c0 con 0x7f7bd8072f10 2024-08-01T07:02:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.133+0000 7f7bdff8b640 1 -- 172.21.15.16:0/2774318782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd8195d20 con 0x7f7bd8072f10 2024-08-01T07:02:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.133+0000 7f7bceffd640 1 -- 172.21.15.16:0/2774318782 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7bd4018a40 con 0x7f7bd8072f10 2024-08-01T07:02:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.134+0000 7f7bceffd640 1 --2- 172.21.15.16:0/2774318782 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7bc406e180 0x7f7bc4070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.134+0000 7f7bceffd640 1 -- 172.21.15.16:0/2774318782 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7054+0+0 (secure 0 0 0) 0x7f7bd4014070 con 0x7f7bd8072f10 2024-08-01T07:02:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.134+0000 7f7bdd526640 1 --2- 172.21.15.16:0/2774318782 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7bc406e180 0x7f7bc4070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.134+0000 7f7bdd526640 1 --2- 172.21.15.16:0/2774318782 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7bc406e180 0x7f7bc4070640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8000c00 tx=0x7f7bc8005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:26.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.138+0000 7f7bceffd640 1 -- 172.21.15.16:0/2774318782 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7bd4053df0 con 0x7f7bd8072f10 2024-08-01T07:02:26.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.353+0000 7f7bdff8b640 1 -- 172.21.15.16:0/2774318782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7bd802c480 con 0x7f7bd8072f10 2024-08-01T07:02:26.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.354+0000 7f7bceffd640 1 -- 172.21.15.16:0/2774318782 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1938 (secure 0 0 0) 0x7f7bd4057880 con 0x7f7bd8072f10 2024-08-01T07:02:26.355 INFO:teuthology.orchestra.run.smithi016.stdout:e19 2024-08-01T07:02:26.355 INFO:teuthology.orchestra.run.smithi016.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-08-01T07:02:26.355 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T07:02:26.356 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T07:02:26.356 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T07:02:26.356 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:02:26.356 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T07:02:26.356 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T07:02:26.356 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 19 2024-08-01T07:02:26.356 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T07:02:26.356 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T07:02:26.356 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T06:53:32.617145+0000 2024-08-01T07:02:26.356 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T07:02:26.356 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T07:02:26.356 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T07:02:26.356 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T07:02:26.357 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T07:02:26.357 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T07:02:26.357 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T07:02:26.357 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T07:02:26.357 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 46 2024-08-01T07:02:26.357 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T07:02:26.357 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T07:02:26.357 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T07:02:26.357 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=14482,1=24281} 2024-08-01T07:02:26.357 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T07:02:26.357 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T07:02:26.357 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T07:02:26.358 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T07:02:26.358 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T07:02:26.358 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T07:02:26.358 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T07:02:26.358 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T07:02:26.358 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T07:02:26.358 INFO:teuthology.orchestra.run.smithi016.stdout:qdb_cluster leader: 0 members: 2024-08-01T07:02:26.358 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:02:26.358 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:24299} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3976091043,v1:172.21.15.16:6827/3976091043] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:02:26.359 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{1:24281} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:02:26.359 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:24291} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.89:6826/1787175373,v1:172.21.15.89:6827/1787175373] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:02:26.359 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:02:26.359 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:02:26.360 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-08-01T07:02:26.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.356+0000 7f7bdff8b640 1 -- 172.21.15.16:0/2774318782 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7bc406e180 msgr2=0x7f7bc4070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:26.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.356+0000 7f7bdff8b640 1 --2- 172.21.15.16:0/2774318782 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7bc406e180 0x7f7bc4070640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8000c00 tx=0x7f7bc8005a20 comp rx=0 tx=0).stop 2024-08-01T07:02:26.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.357+0000 7f7bdff8b640 1 -- 172.21.15.16:0/2774318782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bd8072f10 msgr2=0x7f7bd819bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:26.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.357+0000 7f7bdff8b640 1 --2- 172.21.15.16:0/2774318782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bd8072f10 0x7f7bd819bce0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400e940 tx=0x7f7bd400ee00 comp rx=0 tx=0).stop 2024-08-01T07:02:26.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.357+0000 7f7bdff8b640 1 -- 172.21.15.16:0/2774318782 shutdown_connections 2024-08-01T07:02:26.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.357+0000 7f7bdff8b640 1 --2- 172.21.15.16:0/2774318782 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7bc406e180 0x7f7bc4070640 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.357+0000 7f7bdff8b640 1 --2- 172.21.15.16:0/2774318782 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bd80744e0 0x7f7bd819c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.357+0000 7f7bdff8b640 1 --2- 172.21.15.16:0/2774318782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bd8072f10 0x7f7bd819bce0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.357+0000 7f7bdff8b640 1 -- 172.21.15.16:0/2774318782 >> 172.21.15.16:0/2774318782 conn(0x7f7bd80fb320 msgr2=0x7f7bd81019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:26.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.357+0000 7f7bdff8b640 1 -- 172.21.15.16:0/2774318782 shutdown_connections 2024-08-01T07:02:26.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.357+0000 7f7bdff8b640 1 -- 172.21.15.16:0/2774318782 wait complete. 2024-08-01T07:02:26.379 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:25 smithi089 ceph-mon[82218]: Health check update: Degraded data redundancy: 40/288 objects degraded (13.889%), 13 pgs degraded (PG_DEGRADED) 2024-08-01T07:02:26.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.443+0000 7f57b74f5640 1 -- 172.21.15.16:0/3576748968 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57b0102f60 msgr2=0x7f57b0105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:26.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.443+0000 7f57b74f5640 1 --2- 172.21.15.16:0/3576748968 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57b0102f60 0x7f57b0105350 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f57a00098b0 tx=0x7f57a002a4d0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.443+0000 7f57b74f5640 1 -- 172.21.15.16:0/3576748968 shutdown_connections 2024-08-01T07:02:26.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.443+0000 7f57b74f5640 1 --2- 172.21.15.16:0/3576748968 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57b0102f60 0x7f57b0105350 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.443+0000 7f57b74f5640 1 --2- 172.21.15.16:0/3576748968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57b0100630 0x7f57b0102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.443+0000 7f57b74f5640 1 -- 172.21.15.16:0/3576748968 >> 172.21.15.16:0/3576748968 conn(0x7f57b00fa250 msgr2=0x7f57b00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:26.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.443+0000 7f57b74f5640 1 -- 172.21.15.16:0/3576748968 shutdown_connections 2024-08-01T07:02:26.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.443+0000 7f57b74f5640 1 -- 172.21.15.16:0/3576748968 wait complete. 2024-08-01T07:02:26.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.444+0000 7f57b74f5640 1 Processor -- start 2024-08-01T07:02:26.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.444+0000 7f57b74f5640 1 -- start start 2024-08-01T07:02:26.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.444+0000 7f57b74f5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57b0100630 0x7f57b0195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:26.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.444+0000 7f57b74f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57b0102f60 0x7f57b0195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:26.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.444+0000 7f57b74f5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b0196180 con 0x7f57b0100630 2024-08-01T07:02:26.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.444+0000 7f57b74f5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b01962f0 con 0x7f57b0102f60 2024-08-01T07:02:26.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.444+0000 7f57b5291640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57b0100630 0x7f57b0195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:26.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.444+0000 7f57b5291640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57b0100630 0x7f57b0195670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58224/0 (socket says 172.21.15.16:58224) 2024-08-01T07:02:26.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.444+0000 7f57b5291640 1 -- 172.21.15.16:0/3842814779 learned_addr learned my addr 172.21.15.16:0/3842814779 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:02:26.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.444+0000 7f57b4a90640 1 --2- 172.21.15.16:0/3842814779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57b0102f60 0x7f57b0195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:26.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.444+0000 7f57b5291640 1 -- 172.21.15.16:0/3842814779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57b0102f60 msgr2=0x7f57b0195bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:26.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.444+0000 7f57b5291640 1 --2- 172.21.15.16:0/3842814779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57b0102f60 0x7f57b0195bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.444+0000 7f57b5291640 1 -- 172.21.15.16:0/3842814779 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a0009560 con 0x7f57b0100630 2024-08-01T07:02:26.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.445+0000 7f57b5291640 1 --2- 172.21.15.16:0/3842814779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57b0100630 0x7f57b0195670 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00e9a0 tx=0x7f57ac00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:26.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.445+0000 7f57a67fc640 1 -- 172.21.15.16:0/3842814779 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57ac00cd50 con 0x7f57b0100630 2024-08-01T07:02:26.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.445+0000 7f57a67fc640 1 -- 172.21.15.16:0/3842814779 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f57ac00ceb0 con 0x7f57b0100630 2024-08-01T07:02:26.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.445+0000 7f57b74f5640 1 -- 172.21.15.16:0/3842814779 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b019ad90 con 0x7f57b0100630 2024-08-01T07:02:26.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.445+0000 7f57a67fc640 1 -- 172.21.15.16:0/3842814779 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57ac010660 con 0x7f57b0100630 2024-08-01T07:02:26.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.445+0000 7f57b74f5640 1 -- 172.21.15.16:0/3842814779 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b019b2d0 con 0x7f57b0100630 2024-08-01T07:02:26.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.446+0000 7f57b74f5640 1 -- 172.21.15.16:0/3842814779 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b01087b0 con 0x7f57b0100630 2024-08-01T07:02:26.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.446+0000 7f57a67fc640 1 -- 172.21.15.16:0/3842814779 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f57ac0048a0 con 0x7f57b0100630 2024-08-01T07:02:26.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.447+0000 7f57a67fc640 1 --2- 172.21.15.16:0/3842814779 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f579c06e170 0x7f579c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:26.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.447+0000 7f57a67fc640 1 -- 172.21.15.16:0/3842814779 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7054+0+0 (secure 0 0 0) 0x7f57ac014070 con 0x7f57b0100630 2024-08-01T07:02:26.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.447+0000 7f57b4a90640 1 --2- 172.21.15.16:0/3842814779 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f579c06e170 0x7f579c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:26.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.447+0000 7f57b4a90640 1 --2- 172.21.15.16:0/3842814779 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f579c06e170 0x7f579c070630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009880 tx=0x7f57a0004260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:26.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.451+0000 7f57a67fc640 1 -- 172.21.15.16:0/3842814779 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f57ac05b5a0 con 0x7f57b0100630 2024-08-01T07:02:26.637 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:26 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:02:26.415+0000 7f911d33e640 -1 osd.5 74 log_to_monitors true 2024-08-01T07:02:26.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.643+0000 7f57b74f5640 1 -- 172.21.15.16:0/3842814779 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f57b01039c0 con 0x7f579c06e170 2024-08-01T07:02:26.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.644+0000 7f57a67fc640 1 -- 172.21.15.16:0/3842814779 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f57b01039c0 con 0x7f579c06e170 2024-08-01T07:02:26.646 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:02:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T07:02:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T07:02:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T07:02:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-08-01T07:02:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-08-01T07:02:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr", 2024-08-01T07:02:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "osd", 2024-08-01T07:02:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "crash" 2024-08-01T07:02:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-08-01T07:02:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "12/23 daemons upgraded", 2024-08-01T07:02:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-08-01T07:02:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T07:02:26.647 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:02:26.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.646+0000 7f57b74f5640 1 -- 172.21.15.16:0/3842814779 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f579c06e170 msgr2=0x7f579c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:26.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.646+0000 7f57b74f5640 1 --2- 172.21.15.16:0/3842814779 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f579c06e170 0x7f579c070630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009880 tx=0x7f57a0004260 comp rx=0 tx=0).stop 2024-08-01T07:02:26.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.646+0000 7f57b74f5640 1 -- 172.21.15.16:0/3842814779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57b0100630 msgr2=0x7f57b0195670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:26.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.646+0000 7f57b74f5640 1 --2- 172.21.15.16:0/3842814779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57b0100630 0x7f57b0195670 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00e9a0 tx=0x7f57ac00eda0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.646+0000 7f57b74f5640 1 -- 172.21.15.16:0/3842814779 shutdown_connections 2024-08-01T07:02:26.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.646+0000 7f57b74f5640 1 --2- 172.21.15.16:0/3842814779 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f579c06e170 0x7f579c070630 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.646+0000 7f57b74f5640 1 --2- 172.21.15.16:0/3842814779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57b0102f60 0x7f57b0195bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.646+0000 7f57b74f5640 1 --2- 172.21.15.16:0/3842814779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57b0100630 0x7f57b0195670 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.646+0000 7f57b74f5640 1 -- 172.21.15.16:0/3842814779 >> 172.21.15.16:0/3842814779 conn(0x7f57b00fa250 msgr2=0x7f57b00fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:26.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.646+0000 7f57b74f5640 1 -- 172.21.15.16:0/3842814779 shutdown_connections 2024-08-01T07:02:26.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.647+0000 7f57b74f5640 1 -- 172.21.15.16:0/3842814779 wait complete. 2024-08-01T07:02:26.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.730+0000 7f93daa1f640 1 -- 172.21.15.16:0/3062956952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93d4101170 msgr2=0x7f93d4101570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:26.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.730+0000 7f93daa1f640 1 --2- 172.21.15.16:0/3062956952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93d4101170 0x7f93d4101570 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009880 tx=0x7f93c402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.730+0000 7f93daa1f640 1 -- 172.21.15.16:0/3062956952 shutdown_connections 2024-08-01T07:02:26.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.730+0000 7f93daa1f640 1 --2- 172.21.15.16:0/3062956952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d4101b40 0x7f93d40fdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.730+0000 7f93daa1f640 1 --2- 172.21.15.16:0/3062956952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93d4101170 0x7f93d4101570 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.730+0000 7f93daa1f640 1 -- 172.21.15.16:0/3062956952 >> 172.21.15.16:0/3062956952 conn(0x7f93d40f99c0 msgr2=0x7f93d40fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:26.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.730+0000 7f93daa1f640 1 -- 172.21.15.16:0/3062956952 shutdown_connections 2024-08-01T07:02:26.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.730+0000 7f93daa1f640 1 -- 172.21.15.16:0/3062956952 wait complete. 2024-08-01T07:02:26.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.730+0000 7f93daa1f640 1 Processor -- start 2024-08-01T07:02:26.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.730+0000 7f93daa1f640 1 -- start start 2024-08-01T07:02:26.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.731+0000 7f93daa1f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d4101170 0x7f93d4195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:26.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.731+0000 7f93daa1f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93d4101b40 0x7f93d4195bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:26.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.731+0000 7f93daa1f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d4196190 con 0x7f93d4101b40 2024-08-01T07:02:26.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.731+0000 7f93daa1f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d4196300 con 0x7f93d4101170 2024-08-01T07:02:26.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.731+0000 7f93d37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93d4101b40 0x7f93d4195bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:26.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.731+0000 7f93d37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93d4101b40 0x7f93d4195bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58242/0 (socket says 172.21.15.16:58242) 2024-08-01T07:02:26.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.731+0000 7f93d37fe640 1 -- 172.21.15.16:0/15037567 learned_addr learned my addr 172.21.15.16:0/15037567 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:02:26.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.731+0000 7f93d3fff640 1 --2- 172.21.15.16:0/15037567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d4101170 0x7f93d4195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:26.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.731+0000 7f93d37fe640 1 -- 172.21.15.16:0/15037567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d4101170 msgr2=0x7f93d4195680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:26.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.731+0000 7f93d37fe640 1 --2- 172.21.15.16:0/15037567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d4101170 0x7f93d4195680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.731+0000 7f93d37fe640 1 -- 172.21.15.16:0/15037567 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c4009560 con 0x7f93d4101b40 2024-08-01T07:02:26.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.731+0000 7f93d37fe640 1 --2- 172.21.15.16:0/15037567 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93d4101b40 0x7f93d4195bc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f93c800d6f0 tx=0x7f93c800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:26.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.732+0000 7f93d17fa640 1 -- 172.21.15.16:0/15037567 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c80051f0 con 0x7f93d4101b40 2024-08-01T07:02:26.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.732+0000 7f93d17fa640 1 -- 172.21.15.16:0/15037567 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93c8009ce0 con 0x7f93d4101b40 2024-08-01T07:02:26.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.732+0000 7f93daa1f640 1 -- 172.21.15.16:0/15037567 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d419ada0 con 0x7f93d4101b40 2024-08-01T07:02:26.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.732+0000 7f93d17fa640 1 -- 172.21.15.16:0/15037567 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c8004e80 con 0x7f93d4101b40 2024-08-01T07:02:26.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.732+0000 7f93daa1f640 1 -- 172.21.15.16:0/15037567 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d419b340 con 0x7f93d4101b40 2024-08-01T07:02:26.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.733+0000 7f93daa1f640 1 -- 172.21.15.16:0/15037567 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d4101570 con 0x7f93d4101b40 2024-08-01T07:02:26.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.733+0000 7f93d17fa640 1 -- 172.21.15.16:0/15037567 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f93c80046c0 con 0x7f93d4101b40 2024-08-01T07:02:26.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.734+0000 7f93d17fa640 1 --2- 172.21.15.16:0/15037567 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f93bc06e170 0x7f93bc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:26.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.734+0000 7f93d17fa640 1 -- 172.21.15.16:0/15037567 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7054+0+0 (secure 0 0 0) 0x7f93c808dc70 con 0x7f93d4101b40 2024-08-01T07:02:26.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.734+0000 7f93d3fff640 1 --2- 172.21.15.16:0/15037567 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f93bc06e170 0x7f93bc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:26.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.734+0000 7f93d3fff640 1 --2- 172.21.15.16:0/15037567 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f93bc06e170 0x7f93bc070630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009230 tx=0x7f93c40314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:26.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.738+0000 7f93d17fa640 1 -- 172.21.15.16:0/15037567 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f93c8056eb0 con 0x7f93d4101b40 2024-08-01T07:02:26.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.980+0000 7f93daa1f640 1 -- 172.21.15.16:0/15037567 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f93d41087d0 con 0x7f93d4101b40 2024-08-01T07:02:26.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.981+0000 7f93d17fa640 1 -- 172.21.15.16:0/15037567 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1234 (secure 0 0 0) 0x7f93c8020020 con 0x7f93d4101b40 2024-08-01T07:02:26.982 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 40/288 objects degraded (13.889%), 13 pgs degraded 2024-08-01T07:02:26.982 INFO:teuthology.orchestra.run.smithi016.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-01T07:02:26.983 INFO:teuthology.orchestra.run.smithi016.stdout: osd.5 (root=default,host=smithi089) is down 2024-08-01T07:02:26.983 INFO:teuthology.orchestra.run.smithi016.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-08-01T07:02:26.983 INFO:teuthology.orchestra.run.smithi016.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-08-01T07:02:26.983 INFO:teuthology.orchestra.run.smithi016.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 40/288 objects degraded (13.889%), 13 pgs degraded 2024-08-01T07:02:26.983 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-08-01T07:02:26.983 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-08-01T07:02:26.983 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-08-01T07:02:26.983 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-08-01T07:02:26.983 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-08-01T07:02:26.983 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-08-01T07:02:26.983 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.17 is active+undersized+degraded, acting [2,1] 2024-08-01T07:02:26.983 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-08-01T07:02:26.983 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-08-01T07:02:26.984 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-08-01T07:02:26.984 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-08-01T07:02:26.984 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-08-01T07:02:26.984 INFO:teuthology.orchestra.run.smithi016.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-08-01T07:02:26.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.983+0000 7f93daa1f640 1 -- 172.21.15.16:0/15037567 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f93bc06e170 msgr2=0x7f93bc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:26.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.983+0000 7f93daa1f640 1 --2- 172.21.15.16:0/15037567 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f93bc06e170 0x7f93bc070630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009230 tx=0x7f93c40314e0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.983+0000 7f93daa1f640 1 -- 172.21.15.16:0/15037567 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93d4101b40 msgr2=0x7f93d4195bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:26.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.983+0000 7f93daa1f640 1 --2- 172.21.15.16:0/15037567 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93d4101b40 0x7f93d4195bc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f93c800d6f0 tx=0x7f93c800dbb0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.983+0000 7f93daa1f640 1 -- 172.21.15.16:0/15037567 shutdown_connections 2024-08-01T07:02:26.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.983+0000 7f93daa1f640 1 --2- 172.21.15.16:0/15037567 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f93bc06e170 0x7f93bc070630 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.983+0000 7f93daa1f640 1 --2- 172.21.15.16:0/15037567 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93d4101b40 0x7f93d4195bc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.983+0000 7f93daa1f640 1 --2- 172.21.15.16:0/15037567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d4101170 0x7f93d4195680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:26.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.983+0000 7f93daa1f640 1 -- 172.21.15.16:0/15037567 >> 172.21.15.16:0/15037567 conn(0x7f93d40f99c0 msgr2=0x7f93d4104140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:26.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.983+0000 7f93daa1f640 1 -- 172.21.15.16:0/15037567 shutdown_connections 2024-08-01T07:02:26.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:26.983+0000 7f93daa1f640 1 -- 172.21.15.16:0/15037567 wait complete. 2024-08-01T07:02:27.283 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:02:27 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:02:27.020+0000 7f91110d0640 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-01T07:02:27.284 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:27 smithi089 ceph-mon[82218]: pgmap v160: 65 pgs: 8 active+clean+remapped, 13 active+undersized, 13 active+undersized+degraded, 31 active+clean; 213 MiB data, 955 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s; 40/288 objects degraded (13.889%); 15/288 objects misplaced (5.208%); 4.1 MiB/s, 0 keys/s, 233 objects/s recovering 2024-08-01T07:02:27.284 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:27 smithi089 ceph-mon[82218]: from='client.44273 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:02:27.284 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:27 smithi089 ceph-mon[82218]: from='client.44277 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:02:27.284 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:27 smithi089 ceph-mon[82218]: from='client.44281 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:02:27.284 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:27 smithi089 ceph-mon[82218]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-08-01T07:02:27.284 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:27 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/1262917113' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:27.284 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:27 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2774318782' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:02:27.284 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:27 smithi089 ceph-mon[82218]: from='osd.5 [v2:172.21.15.89:6816/1158828081,v1:172.21.15.89:6817/1158828081]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-01T07:02:27.284 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:27 smithi089 ceph-mon[82218]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-01T07:02:27.284 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:27 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/15037567' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:02:27.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:27 smithi016 ceph-mon[93645]: pgmap v160: 65 pgs: 8 active+clean+remapped, 13 active+undersized, 13 active+undersized+degraded, 31 active+clean; 213 MiB data, 955 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s; 40/288 objects degraded (13.889%); 15/288 objects misplaced (5.208%); 4.1 MiB/s, 0 keys/s, 233 objects/s recovering 2024-08-01T07:02:27.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:27 smithi016 ceph-mon[93645]: from='client.44273 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:02:27.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:27 smithi016 ceph-mon[93645]: from='client.44277 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:02:27.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:27 smithi016 ceph-mon[93645]: from='client.44281 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:02:27.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:27 smithi016 ceph-mon[93645]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-08-01T07:02:27.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:27 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/1262917113' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:27.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:27 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2774318782' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:02:27.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:27 smithi016 ceph-mon[93645]: from='osd.5 [v2:172.21.15.89:6816/1158828081,v1:172.21.15.89:6817/1158828081]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-01T07:02:27.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:27 smithi016 ceph-mon[93645]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-01T07:02:27.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:27 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/15037567' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:02:28.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:28 smithi089 ceph-mon[82218]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:02:28.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:28 smithi089 ceph-mon[82218]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-01T07:02:28.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:28 smithi089 ceph-mon[82218]: osdmap e83: 6 total, 5 up, 6 in 2024-08-01T07:02:28.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:28 smithi089 ceph-mon[82218]: from='osd.5 [v2:172.21.15.89:6816/1158828081,v1:172.21.15.89:6817/1158828081]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T07:02:28.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:28 smithi089 ceph-mon[82218]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T07:02:28.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:28 smithi016 ceph-mon[93645]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:02:28.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:28 smithi016 ceph-mon[93645]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-01T07:02:28.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:28 smithi016 ceph-mon[93645]: osdmap e83: 6 total, 5 up, 6 in 2024-08-01T07:02:28.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:28 smithi016 ceph-mon[93645]: from='osd.5 [v2:172.21.15.89:6816/1158828081,v1:172.21.15.89:6817/1158828081]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T07:02:28.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:28 smithi016 ceph-mon[93645]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-08-01T07:02:29.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: pgmap v162: 65 pgs: 8 active+clean+remapped, 13 active+undersized, 13 active+undersized+degraded, 31 active+clean; 213 MiB data, 874 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 40/288 objects degraded (13.889%); 15/288 objects misplaced (5.208%); 3.3 MiB/s, 0 keys/s, 191 objects/s recovering 2024-08-01T07:02:29.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-01T07:02:29.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: osd.5 [v2:172.21.15.89:6816/1158828081,v1:172.21.15.89:6817/1158828081] boot 2024-08-01T07:02:29.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: osdmap e84: 6 total, 6 up, 6 in 2024-08-01T07:02:29.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T07:02:29.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:29.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:29.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:02:29.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:02:29.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:29.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:29.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:29.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:29.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:29.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:29.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:29.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-08-01T07:02:29.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-08-01T07:02:29.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-08-01T07:02:29.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-08-01T07:02:29.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-08-01T07:02:29.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-08-01T07:02:29.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-08-01T07:02:29.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-08-01T07:02:29.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-08-01T07:02:29.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-08-01T07:02:29.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-08-01T07:02:29.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-08-01T07:02:29.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-08-01T07:02:29.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-08-01T07:02:29.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-08-01T07:02:29.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:29 smithi089 ceph-mon[82218]: osdmap e85: 6 total, 6 up, 6 in 2024-08-01T07:02:29.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: pgmap v162: 65 pgs: 8 active+clean+remapped, 13 active+undersized, 13 active+undersized+degraded, 31 active+clean; 213 MiB data, 874 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 40/288 objects degraded (13.889%); 15/288 objects misplaced (5.208%); 3.3 MiB/s, 0 keys/s, 191 objects/s recovering 2024-08-01T07:02:29.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-01T07:02:29.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: osd.5 [v2:172.21.15.89:6816/1158828081,v1:172.21.15.89:6817/1158828081] boot 2024-08-01T07:02:29.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: osdmap e84: 6 total, 6 up, 6 in 2024-08-01T07:02:29.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-01T07:02:29.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:29.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:29.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:02:29.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:02:29.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:29.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:29.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:29.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:29.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:29.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:29.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:29.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-08-01T07:02:29.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-08-01T07:02:29.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-08-01T07:02:29.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-08-01T07:02:29.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-08-01T07:02:29.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-08-01T07:02:29.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-08-01T07:02:29.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-08-01T07:02:29.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-08-01T07:02:29.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-08-01T07:02:29.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-08-01T07:02:29.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-08-01T07:02:29.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-08-01T07:02:29.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-08-01T07:02:29.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-08-01T07:02:29.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:29 smithi016 ceph-mon[93645]: osdmap e85: 6 total, 6 up, 6 in 2024-08-01T07:02:30.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:30 smithi089 ceph-mon[82218]: Upgrade: Setting container_image for all osd 2024-08-01T07:02:30.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:30 smithi089 ceph-mon[82218]: Upgrade: Setting require_osd_release to 19 squid 2024-08-01T07:02:30.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:30 smithi089 ceph-mon[82218]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-08-01T07:02:30.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:30 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:30.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:30 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-08-01T07:02:30.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:30 smithi016 ceph-mon[93645]: Upgrade: Setting container_image for all osd 2024-08-01T07:02:30.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:30 smithi016 ceph-mon[93645]: Upgrade: Setting require_osd_release to 19 squid 2024-08-01T07:02:30.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:30 smithi016 ceph-mon[93645]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-08-01T07:02:30.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:30 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:30.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:30 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-08-01T07:02:31.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: pgmap v165: 65 pgs: 5 peering, 7 remapped+peering, 1 active+clean+remapped, 10 active+undersized, 11 active+undersized+degraded, 31 active+clean; 213 MiB data, 875 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 36/288 objects degraded (12.500%); 3.3 MiB/s, 0 keys/s, 191 objects/s recovering 2024-08-01T07:02:31.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-08-01T07:02:31.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: osdmap e86: 6 total, 6 up, 6 in 2024-08-01T07:02:31.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-08-01T07:02:31.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: fsmap cephfs:2 {0=cephfs.smithi016.fziqod=up:active,1=cephfs.smithi089.jhouje=up:active} 2024-08-01T07:02:31.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:31.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:02:31.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:02:31.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:31.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:31.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:31.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:31.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:31.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:31.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:31.391 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-08-01T07:02:31.391 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: Health check update: Degraded data redundancy: 36/288 objects degraded (12.500%), 11 pgs degraded (PG_DEGRADED) 2024-08-01T07:02:31.391 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: stopping daemon mds.cephfs.smithi089.jhouje 2024-08-01T07:02:31.391 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-08-01T07:02:31.391 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-08-01T07:02:31.391 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: mds.? [v2:172.21.15.16:6826/3015300025,v1:172.21.15.16:6827/3015300025] up:boot 2024-08-01T07:02:31.392 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: mds.? [v2:172.21.15.89:6826/3851713020,v1:172.21.15.89:6827/3851713020] up:boot 2024-08-01T07:02:31.392 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: fsmap cephfs:2 {0=cephfs.smithi016.fziqod=up:active,1=cephfs.smithi089.jhouje=up:stopping} 2 up:standby 2024-08-01T07:02:31.392 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.bgqkxu"}]: dispatch 2024-08-01T07:02:31.392 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.xanuld"}]: dispatch 2024-08-01T07:02:31.392 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:31.392 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: osdmap e87: 6 total, 6 up, 6 in 2024-08-01T07:02:31.393 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:02:31.393 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:02:31.393 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:31.393 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:31.393 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:31.394 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:31.394 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:31.394 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:31.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: pgmap v165: 65 pgs: 5 peering, 7 remapped+peering, 1 active+clean+remapped, 10 active+undersized, 11 active+undersized+degraded, 31 active+clean; 213 MiB data, 875 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 36/288 objects degraded (12.500%); 3.3 MiB/s, 0 keys/s, 191 objects/s recovering 2024-08-01T07:02:31.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-08-01T07:02:31.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: osdmap e86: 6 total, 6 up, 6 in 2024-08-01T07:02:31.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-08-01T07:02:31.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: fsmap cephfs:2 {0=cephfs.smithi016.fziqod=up:active,1=cephfs.smithi089.jhouje=up:active} 2024-08-01T07:02:31.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:31.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:02:31.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:02:31.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:31.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:31.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:31.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:31.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:31.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:31.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:31.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-08-01T07:02:31.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: Health check update: Degraded data redundancy: 36/288 objects degraded (12.500%), 11 pgs degraded (PG_DEGRADED) 2024-08-01T07:02:31.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: stopping daemon mds.cephfs.smithi089.jhouje 2024-08-01T07:02:31.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-08-01T07:02:31.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-08-01T07:02:31.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: mds.? [v2:172.21.15.16:6826/3015300025,v1:172.21.15.16:6827/3015300025] up:boot 2024-08-01T07:02:31.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: mds.? [v2:172.21.15.89:6826/3851713020,v1:172.21.15.89:6827/3851713020] up:boot 2024-08-01T07:02:31.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: fsmap cephfs:2 {0=cephfs.smithi016.fziqod=up:active,1=cephfs.smithi089.jhouje=up:stopping} 2 up:standby 2024-08-01T07:02:31.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.bgqkxu"}]: dispatch 2024-08-01T07:02:31.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.xanuld"}]: dispatch 2024-08-01T07:02:31.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:31.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: osdmap e87: 6 total, 6 up, 6 in 2024-08-01T07:02:31.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:02:31.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:02:31.402 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:31.402 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:31.402 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:31.402 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:31.402 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:31.402 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:32 smithi089 ceph-mon[82218]: Upgrade: Scaling down filesystem cephfs 2024-08-01T07:02:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:32 smithi089 ceph-mon[82218]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-08-01T07:02:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:32 smithi089 ceph-mon[82218]: osdmap e88: 6 total, 6 up, 6 in 2024-08-01T07:02:32.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:32 smithi016 ceph-mon[93645]: Upgrade: Scaling down filesystem cephfs 2024-08-01T07:02:32.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:32 smithi016 ceph-mon[93645]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-08-01T07:02:32.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:32 smithi016 ceph-mon[93645]: osdmap e88: 6 total, 6 up, 6 in 2024-08-01T07:02:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:33 smithi089 ceph-mon[82218]: pgmap v168: 65 pgs: 5 peering, 8 remapped+peering, 9 active+undersized, 9 active+undersized+degraded, 34 active+clean; 213 MiB data, 875 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 32/288 objects degraded (11.111%) 2024-08-01T07:02:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:33 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:33 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:02:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:33 smithi089 ceph-mon[82218]: osdmap e89: 6 total, 6 up, 6 in 2024-08-01T07:02:33.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:33 smithi016 ceph-mon[93645]: pgmap v168: 65 pgs: 5 peering, 8 remapped+peering, 9 active+undersized, 9 active+undersized+degraded, 34 active+clean; 213 MiB data, 875 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 32/288 objects degraded (11.111%) 2024-08-01T07:02:33.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:33 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:33.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:33 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:02:33.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:33 smithi016 ceph-mon[93645]: osdmap e89: 6 total, 6 up, 6 in 2024-08-01T07:02:34.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:34 smithi089 ceph-mon[82218]: pgmap v171: 65 pgs: 5 peering, 7 remapped+peering, 53 active+clean; 213 MiB data, 883 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:02:34.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:34 smithi089 ceph-mon[82218]: osdmap e90: 6 total, 6 up, 6 in 2024-08-01T07:02:34.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:34 smithi089 ceph-mon[82218]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/288 objects degraded (11.111%), 9 pgs degraded) 2024-08-01T07:02:34.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:34 smithi089 ceph-mon[82218]: Cluster is now healthy 2024-08-01T07:02:34.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:34 smithi016 ceph-mon[93645]: pgmap v171: 65 pgs: 5 peering, 7 remapped+peering, 53 active+clean; 213 MiB data, 883 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:02:34.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:34 smithi016 ceph-mon[93645]: osdmap e90: 6 total, 6 up, 6 in 2024-08-01T07:02:34.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:34 smithi016 ceph-mon[93645]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/288 objects degraded (11.111%), 9 pgs degraded) 2024-08-01T07:02:34.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:34 smithi016 ceph-mon[93645]: Cluster is now healthy 2024-08-01T07:02:35.890 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:35 smithi089 ceph-mon[82218]: osdmap e91: 6 total, 6 up, 6 in 2024-08-01T07:02:35.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:35 smithi016 ceph-mon[93645]: osdmap e91: 6 total, 6 up, 6 in 2024-08-01T07:02:36.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:36 smithi089 ceph-mon[82218]: pgmap v174: 65 pgs: 1 active+recovering+undersized+remapped, 2 remapped+peering, 62 active+clean; 213 MiB data, 883 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s, 353 objects/s recovering 2024-08-01T07:02:36.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:36 smithi089 ceph-mon[82218]: osdmap e92: 6 total, 6 up, 6 in 2024-08-01T07:02:36.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:36 smithi016 ceph-mon[93645]: pgmap v174: 65 pgs: 1 active+recovering+undersized+remapped, 2 remapped+peering, 62 active+clean; 213 MiB data, 883 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s, 353 objects/s recovering 2024-08-01T07:02:36.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:36 smithi016 ceph-mon[93645]: osdmap e92: 6 total, 6 up, 6 in 2024-08-01T07:02:38.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:38 smithi089 ceph-mon[82218]: pgmap v176: 65 pgs: 65 active+clean; 213 MiB data, 883 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 225 B/s wr, 0 op/s; 3.5 MiB/s, 484 objects/s recovering 2024-08-01T07:02:38.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:38 smithi016 ceph-mon[93645]: pgmap v176: 65 pgs: 65 active+clean; 213 MiB data, 883 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 225 B/s wr, 0 op/s; 3.5 MiB/s, 484 objects/s recovering 2024-08-01T07:02:40.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:40 smithi089 ceph-mon[82218]: pgmap v177: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 0 op/s; 2.7 MiB/s, 365 objects/s recovering 2024-08-01T07:02:40.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:40 smithi016 ceph-mon[93645]: pgmap v177: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 0 op/s; 2.7 MiB/s, 365 objects/s recovering 2024-08-01T07:02:41.867 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:41.868 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:02:41.868 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:02:41.868 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:41.868 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:41.868 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:41.868 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:41.868 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:41.868 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:41.868 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:41 smithi089 ceph-mon[82218]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-08-01T07:02:41.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:41.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:02:41.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:02:41.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:41.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:41.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:41.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:41.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:41.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:41.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:41 smithi016 ceph-mon[93645]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-08-01T07:02:43.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:42 smithi089 ceph-mon[82218]: pgmap v178: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 407 B/s wr, 0 op/s; 0 B/s, 288 objects/s recovering 2024-08-01T07:02:43.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:42 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:43.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:42 smithi016 ceph-mon[93645]: pgmap v178: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 407 B/s wr, 0 op/s; 0 B/s, 288 objects/s recovering 2024-08-01T07:02:43.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:42 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:44.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:44 smithi016 ceph-mon[93645]: pgmap v179: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 360 B/s wr, 0 op/s; 0 B/s, 91 objects/s recovering 2024-08-01T07:02:45.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:44 smithi089 ceph-mon[82218]: pgmap v179: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 360 B/s wr, 0 op/s; 0 B/s, 91 objects/s recovering 2024-08-01T07:02:47.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:46 smithi089 ceph-mon[82218]: pgmap v180: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 409 B/s wr, 0 op/s; 0 B/s, 78 objects/s recovering 2024-08-01T07:02:47.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:46 smithi016 ceph-mon[93645]: pgmap v180: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 409 B/s wr, 0 op/s; 0 B/s, 78 objects/s recovering 2024-08-01T07:02:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:02:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:48 smithi089 ceph-mon[82218]: pgmap v181: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 355 B/s wr, 0 op/s; 0 B/s, 67 objects/s recovering 2024-08-01T07:02:48.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:48.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:02:48.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:48 smithi016 ceph-mon[93645]: pgmap v181: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 355 B/s wr, 0 op/s; 0 B/s, 67 objects/s recovering 2024-08-01T07:02:50.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:50 smithi089 ceph-mon[82218]: pgmap v182: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-08-01T07:02:50.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:50 smithi016 ceph-mon[93645]: pgmap v182: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-08-01T07:02:51.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:51 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:51.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:51 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:52.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:52 smithi089 ceph-mon[82218]: pgmap v183: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-08-01T07:02:52.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:02:52.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:02:52.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:52.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:52.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:52.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:52.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:52.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:52.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:52 smithi089 ceph-mon[82218]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-08-01T07:02:52.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:52 smithi016 ceph-mon[93645]: pgmap v183: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-08-01T07:02:52.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:02:52.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:02:52.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:02:52.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:02:52.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:52.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:52.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:52.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:52.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:52 smithi016 ceph-mon[93645]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-08-01T07:02:54.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:54 smithi089 ceph-mon[82218]: pgmap v184: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-08-01T07:02:54.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:54 smithi016 ceph-mon[93645]: pgmap v184: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-08-01T07:02:56.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:56 smithi089 ceph-mon[82218]: pgmap v185: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-08-01T07:02:56.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:56 smithi089 ceph-mon[82218]: daemon mds.cephfs.smithi089.jhouje finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-08-01T07:02:56.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:56 smithi016 ceph-mon[93645]: pgmap v185: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-08-01T07:02:56.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:56 smithi016 ceph-mon[93645]: daemon mds.cephfs.smithi089.jhouje finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-08-01T07:02:57.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.080+0000 7fc014d74640 1 -- 172.21.15.16:0/1234198590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0100ffb10 msgr2=0x7fc0100fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:57.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.080+0000 7fc014d74640 1 --2- 172.21.15.16:0/1234198590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0100ffb10 0x7fc0100fff10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc000009880 tx=0x7fc00002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.080+0000 7fc014d74640 1 -- 172.21.15.16:0/1234198590 shutdown_connections 2024-08-01T07:02:57.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.080+0000 7fc014d74640 1 --2- 172.21.15.16:0/1234198590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc010100d10 0x7fc010101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.080+0000 7fc014d74640 1 --2- 172.21.15.16:0/1234198590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0100ffb10 0x7fc0100fff10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.080+0000 7fc014d74640 1 -- 172.21.15.16:0/1234198590 >> 172.21.15.16:0/1234198590 conn(0x7fc0100fb2c0 msgr2=0x7fc0100fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:57.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.080+0000 7fc014d74640 1 -- 172.21.15.16:0/1234198590 shutdown_connections 2024-08-01T07:02:57.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.080+0000 7fc014d74640 1 -- 172.21.15.16:0/1234198590 wait complete. 2024-08-01T07:02:57.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.081+0000 7fc014d74640 1 Processor -- start 2024-08-01T07:02:57.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.082+0000 7fc014d74640 1 -- start start 2024-08-01T07:02:57.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.082+0000 7fc014d74640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0100ffb10 0x7fc010074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:57.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.082+0000 7fc014d74640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc010100d10 0x7fc0100728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:57.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.082+0000 7fc014d74640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc010072de0 con 0x7fc010100d10 2024-08-01T07:02:57.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.082+0000 7fc014d74640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc010072f50 con 0x7fc0100ffb10 2024-08-01T07:02:57.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.082+0000 7fc00dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc010100d10 0x7fc0100728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:57.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.082+0000 7fc00dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc010100d10 0x7fc0100728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52480/0 (socket says 172.21.15.16:52480) 2024-08-01T07:02:57.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.082+0000 7fc00dd9b640 1 -- 172.21.15.16:0/1966076864 learned_addr learned my addr 172.21.15.16:0/1966076864 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:02:57.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.082+0000 7fc00e59c640 1 --2- 172.21.15.16:0/1966076864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0100ffb10 0x7fc010074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:57.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.082+0000 7fc00dd9b640 1 -- 172.21.15.16:0/1966076864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0100ffb10 msgr2=0x7fc010074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:57.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.082+0000 7fc00dd9b640 1 --2- 172.21.15.16:0/1966076864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0100ffb10 0x7fc010074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.082+0000 7fc00dd9b640 1 -- 172.21.15.16:0/1966076864 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc000009560 con 0x7fc010100d10 2024-08-01T07:02:57.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.083+0000 7fc00dd9b640 1 --2- 172.21.15.16:0/1966076864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc010100d10 0x7fc0100728a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbff800d6f0 tx=0x7fbff800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:57.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.083+0000 7fc0077fe640 1 -- 172.21.15.16:0/1966076864 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbff8009a30 con 0x7fc010100d10 2024-08-01T07:02:57.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.083+0000 7fc0077fe640 1 -- 172.21.15.16:0/1966076864 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbff80054e0 con 0x7fc010100d10 2024-08-01T07:02:57.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.083+0000 7fc0077fe640 1 -- 172.21.15.16:0/1966076864 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbff8010460 con 0x7fc010100d10 2024-08-01T07:02:57.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.083+0000 7fc014d74640 1 -- 172.21.15.16:0/1966076864 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc010073230 con 0x7fc010100d10 2024-08-01T07:02:57.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.083+0000 7fc014d74640 1 -- 172.21.15.16:0/1966076864 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01019d620 con 0x7fc010100d10 2024-08-01T07:02:57.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.084+0000 7fc014d74640 1 -- 172.21.15.16:0/1966076864 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01018f6b0 con 0x7fc010100d10 2024-08-01T07:02:57.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.085+0000 7fc0077fe640 1 -- 172.21.15.16:0/1966076864 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbff8009b90 con 0x7fc010100d10 2024-08-01T07:02:57.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.085+0000 7fc0077fe640 1 --2- 172.21.15.16:0/1966076864 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fbffc06e170 0x7fbffc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:57.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.086+0000 7fc0077fe640 1 -- 172.21.15.16:0/1966076864 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6790+0+0 (secure 0 0 0) 0x7fbff808dc70 con 0x7fc010100d10 2024-08-01T07:02:57.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.086+0000 7fc00e59c640 1 --2- 172.21.15.16:0/1966076864 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fbffc06e170 0x7fbffc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:57.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.086+0000 7fc00e59c640 1 --2- 172.21.15.16:0/1966076864 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fbffc06e170 0x7fbffc070630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc000009230 tx=0x7fc0000314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:57.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.090+0000 7fc0077fe640 1 -- 172.21.15.16:0/1966076864 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fbff8056fb0 con 0x7fc010100d10 2024-08-01T07:02:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.284+0000 7fc014d74640 1 -- 172.21.15.16:0/1966076864 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc01002c4f0 con 0x7fbffc06e170 2024-08-01T07:02:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.285+0000 7fc0077fe640 1 -- 172.21.15.16:0/1966076864 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc01002c4f0 con 0x7fbffc06e170 2024-08-01T07:02:57.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.287+0000 7fc014d74640 1 -- 172.21.15.16:0/1966076864 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fbffc06e170 msgr2=0x7fbffc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:57.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.287+0000 7fc014d74640 1 --2- 172.21.15.16:0/1966076864 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fbffc06e170 0x7fbffc070630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc000009230 tx=0x7fc0000314e0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.287+0000 7fc014d74640 1 -- 172.21.15.16:0/1966076864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc010100d10 msgr2=0x7fc0100728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:57.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.287+0000 7fc014d74640 1 --2- 172.21.15.16:0/1966076864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc010100d10 0x7fc0100728a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbff800d6f0 tx=0x7fbff800dbb0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.287+0000 7fc014d74640 1 -- 172.21.15.16:0/1966076864 shutdown_connections 2024-08-01T07:02:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.287+0000 7fc014d74640 1 --2- 172.21.15.16:0/1966076864 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fbffc06e170 0x7fbffc070630 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.287+0000 7fc014d74640 1 --2- 172.21.15.16:0/1966076864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc010100d10 0x7fc0100728a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.287+0000 7fc014d74640 1 --2- 172.21.15.16:0/1966076864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0100ffb10 0x7fc010074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.287+0000 7fc014d74640 1 -- 172.21.15.16:0/1966076864 >> 172.21.15.16:0/1966076864 conn(0x7fc0100fb2c0 msgr2=0x7fc0101043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.287+0000 7fc014d74640 1 -- 172.21.15.16:0/1966076864 shutdown_connections 2024-08-01T07:02:57.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.287+0000 7fc014d74640 1 -- 172.21.15.16:0/1966076864 wait complete. 2024-08-01T07:02:57.297 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T07:02:57.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.371+0000 7fd809884640 1 -- 172.21.15.16:0/446178302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd804100630 msgr2=0x7fd804102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:57.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.371+0000 7fd809884640 1 --2- 172.21.15.16:0/446178302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd804100630 0x7fd804102a20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd7f40098b0 tx=0x7fd7f402a4d0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.371+0000 7fd809884640 1 -- 172.21.15.16:0/446178302 shutdown_connections 2024-08-01T07:02:57.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.371+0000 7fd809884640 1 --2- 172.21.15.16:0/446178302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd804102f60 0x7fd804105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.371+0000 7fd809884640 1 --2- 172.21.15.16:0/446178302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd804100630 0x7fd804102a20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.371+0000 7fd809884640 1 -- 172.21.15.16:0/446178302 >> 172.21.15.16:0/446178302 conn(0x7fd8040fa250 msgr2=0x7fd8040fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:57.373 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:57 smithi016 ceph-mon[93645]: mds.1 [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] down:stopped 2024-08-01T07:02:57.373 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:57 smithi016 ceph-mon[93645]: fsmap cephfs:1 {0=cephfs.smithi016.fziqod=up:active} 2 up:standby 2024-08-01T07:02:57.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.371+0000 7fd809884640 1 -- 172.21.15.16:0/446178302 shutdown_connections 2024-08-01T07:02:57.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.371+0000 7fd809884640 1 -- 172.21.15.16:0/446178302 wait complete. 2024-08-01T07:02:57.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.372+0000 7fd809884640 1 Processor -- start 2024-08-01T07:02:57.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.372+0000 7fd809884640 1 -- start start 2024-08-01T07:02:57.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.372+0000 7fd809884640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd804100630 0x7fd8041978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:57.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.372+0000 7fd809884640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd804102f60 0x7fd804197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:57.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.372+0000 7fd809884640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8041983c0 con 0x7fd804102f60 2024-08-01T07:02:57.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.372+0000 7fd809884640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd804198530 con 0x7fd804100630 2024-08-01T07:02:57.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.372+0000 7fd8027fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd804102f60 0x7fd804197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:57.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.372+0000 7fd8027fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd804102f60 0x7fd804197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52504/0 (socket says 172.21.15.16:52504) 2024-08-01T07:02:57.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.372+0000 7fd8027fc640 1 -- 172.21.15.16:0/4061001570 learned_addr learned my addr 172.21.15.16:0/4061001570 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:02:57.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.373+0000 7fd802ffd640 1 --2- 172.21.15.16:0/4061001570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd804100630 0x7fd8041978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:57.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.373+0000 7fd8027fc640 1 -- 172.21.15.16:0/4061001570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd804100630 msgr2=0x7fd8041978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:57.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.373+0000 7fd8027fc640 1 --2- 172.21.15.16:0/4061001570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd804100630 0x7fd8041978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.373+0000 7fd8027fc640 1 -- 172.21.15.16:0/4061001570 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f4009560 con 0x7fd804102f60 2024-08-01T07:02:57.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.373+0000 7fd8027fc640 1 --2- 172.21.15.16:0/4061001570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd804102f60 0x7fd804197df0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800d6f0 tx=0x7fd7f800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:57.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.373+0000 7fd808882640 1 -- 172.21.15.16:0/4061001570 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7f80051f0 con 0x7fd804102f60 2024-08-01T07:02:57.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.373+0000 7fd808882640 1 -- 172.21.15.16:0/4061001570 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7f8009ce0 con 0x7fd804102f60 2024-08-01T07:02:57.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.373+0000 7fd809884640 1 -- 172.21.15.16:0/4061001570 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80419cf80 con 0x7fd804102f60 2024-08-01T07:02:57.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.373+0000 7fd808882640 1 -- 172.21.15.16:0/4061001570 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7f8004e80 con 0x7fd804102f60 2024-08-01T07:02:57.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.373+0000 7fd809884640 1 -- 172.21.15.16:0/4061001570 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80419d520 con 0x7fd804102f60 2024-08-01T07:02:57.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.374+0000 7fd809884640 1 -- 172.21.15.16:0/4061001570 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd804100a10 con 0x7fd804102f60 2024-08-01T07:02:57.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.375+0000 7fd808882640 1 -- 172.21.15.16:0/4061001570 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd7f80046c0 con 0x7fd804102f60 2024-08-01T07:02:57.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.375+0000 7fd808882640 1 --2- 172.21.15.16:0/4061001570 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd7ec06e110 0x7fd7ec0705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:57.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.376+0000 7fd802ffd640 1 --2- 172.21.15.16:0/4061001570 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd7ec06e110 0x7fd7ec0705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:57.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.376+0000 7fd808882640 1 -- 172.21.15.16:0/4061001570 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6790+0+0 (secure 0 0 0) 0x7fd7f808dc90 con 0x7fd804102f60 2024-08-01T07:02:57.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.376+0000 7fd802ffd640 1 --2- 172.21.15.16:0/4061001570 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd7ec06e110 0x7fd7ec0705d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4006010 tx=0x7fd7f40314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:57.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.380+0000 7fd808882640 1 -- 172.21.15.16:0/4061001570 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd7f8056f50 con 0x7fd804102f60 2024-08-01T07:02:57.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:57 smithi089 ceph-mon[82218]: mds.1 [v2:172.21.15.89:6824/1878606630,v1:172.21.15.89:6825/1878606630] down:stopped 2024-08-01T07:02:57.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:57 smithi089 ceph-mon[82218]: fsmap cephfs:1 {0=cephfs.smithi016.fziqod=up:active} 2 up:standby 2024-08-01T07:02:57.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.574+0000 7fd809884640 1 -- 172.21.15.16:0/4061001570 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd80402c450 con 0x7fd7ec06e110 2024-08-01T07:02:57.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.575+0000 7fd808882640 1 -- 172.21.15.16:0/4061001570 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd80402c450 con 0x7fd7ec06e110 2024-08-01T07:02:57.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.577+0000 7fd809884640 1 -- 172.21.15.16:0/4061001570 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd7ec06e110 msgr2=0x7fd7ec0705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:57.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.577+0000 7fd809884640 1 --2- 172.21.15.16:0/4061001570 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd7ec06e110 0x7fd7ec0705d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4006010 tx=0x7fd7f40314e0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.577+0000 7fd809884640 1 -- 172.21.15.16:0/4061001570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd804102f60 msgr2=0x7fd804197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:57.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.577+0000 7fd809884640 1 --2- 172.21.15.16:0/4061001570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd804102f60 0x7fd804197df0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800d6f0 tx=0x7fd7f800dbb0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.577+0000 7fd809884640 1 -- 172.21.15.16:0/4061001570 shutdown_connections 2024-08-01T07:02:57.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.577+0000 7fd809884640 1 --2- 172.21.15.16:0/4061001570 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd7ec06e110 0x7fd7ec0705d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.577+0000 7fd809884640 1 --2- 172.21.15.16:0/4061001570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd804102f60 0x7fd804197df0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.577+0000 7fd809884640 1 --2- 172.21.15.16:0/4061001570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd804100630 0x7fd8041978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.577+0000 7fd809884640 1 -- 172.21.15.16:0/4061001570 >> 172.21.15.16:0/4061001570 conn(0x7fd8040fa250 msgr2=0x7fd8040fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:57.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.577+0000 7fd809884640 1 -- 172.21.15.16:0/4061001570 shutdown_connections 2024-08-01T07:02:57.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.577+0000 7fd809884640 1 -- 172.21.15.16:0/4061001570 wait complete. 2024-08-01T07:02:57.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.660+0000 7f7b038b1640 1 -- 172.21.15.16:0/867164312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7afc100680 msgr2=0x7f7afc102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:57.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.660+0000 7f7b038b1640 1 --2- 172.21.15.16:0/867164312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7afc100680 0x7f7afc102a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7af80098b0 tx=0x7f7af802a4d0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.660+0000 7f7b038b1640 1 -- 172.21.15.16:0/867164312 shutdown_connections 2024-08-01T07:02:57.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.660+0000 7f7b038b1640 1 --2- 172.21.15.16:0/867164312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7afc102fb0 0x7f7afc1053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.660+0000 7f7b038b1640 1 --2- 172.21.15.16:0/867164312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7afc100680 0x7f7afc102a70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.660+0000 7f7b038b1640 1 -- 172.21.15.16:0/867164312 >> 172.21.15.16:0/867164312 conn(0x7f7afc0fa280 msgr2=0x7f7afc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:57.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.661+0000 7f7b038b1640 1 -- 172.21.15.16:0/867164312 shutdown_connections 2024-08-01T07:02:57.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.661+0000 7f7b038b1640 1 -- 172.21.15.16:0/867164312 wait complete. 2024-08-01T07:02:57.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.661+0000 7f7b038b1640 1 Processor -- start 2024-08-01T07:02:57.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.661+0000 7f7b038b1640 1 -- start start 2024-08-01T07:02:57.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.661+0000 7f7b038b1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7afc100680 0x7f7afc0fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:57.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.661+0000 7f7b038b1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7afc102fb0 0x7f7afc0fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:57.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.661+0000 7f7b038b1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc0feb70 con 0x7f7afc102fb0 2024-08-01T07:02:57.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.661+0000 7f7b038b1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc0fece0 con 0x7f7afc100680 2024-08-01T07:02:57.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.662+0000 7f7b00e4c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7afc102fb0 0x7f7afc0fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:57.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.662+0000 7f7b00e4c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7afc102fb0 0x7f7afc0fe630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52510/0 (socket says 172.21.15.16:52510) 2024-08-01T07:02:57.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.662+0000 7f7b00e4c640 1 -- 172.21.15.16:0/3884241937 learned_addr learned my addr 172.21.15.16:0/3884241937 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:02:57.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.662+0000 7f7b0164d640 1 --2- 172.21.15.16:0/3884241937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7afc100680 0x7f7afc0fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:57.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.662+0000 7f7b00e4c640 1 -- 172.21.15.16:0/3884241937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7afc100680 msgr2=0x7f7afc0fffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:57.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.662+0000 7f7b00e4c640 1 --2- 172.21.15.16:0/3884241937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7afc100680 0x7f7afc0fffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.662+0000 7f7b00e4c640 1 -- 172.21.15.16:0/3884241937 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af8009560 con 0x7f7afc102fb0 2024-08-01T07:02:57.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.662+0000 7f7b00e4c640 1 --2- 172.21.15.16:0/3884241937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7afc102fb0 0x7f7afc0fe630 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00b3d0 tx=0x7f7aec00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:57.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.662+0000 7f7af27fc640 1 -- 172.21.15.16:0/3884241937 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aec011800 con 0x7f7afc102fb0 2024-08-01T07:02:57.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.662+0000 7f7b038b1640 1 -- 172.21.15.16:0/3884241937 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7afc0fefc0 con 0x7f7afc102fb0 2024-08-01T07:02:57.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.662+0000 7f7af27fc640 1 -- 172.21.15.16:0/3884241937 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7aec011e20 con 0x7f7afc102fb0 2024-08-01T07:02:57.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.662+0000 7f7af27fc640 1 -- 172.21.15.16:0/3884241937 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aec00f2e0 con 0x7f7afc102fb0 2024-08-01T07:02:57.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.662+0000 7f7b038b1640 1 -- 172.21.15.16:0/3884241937 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7afc19d7c0 con 0x7f7afc102fb0 2024-08-01T07:02:57.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.663+0000 7f7b038b1640 1 -- 172.21.15.16:0/3884241937 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7afc100a60 con 0x7f7afc102fb0 2024-08-01T07:02:57.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.664+0000 7f7af27fc640 1 -- 172.21.15.16:0/3884241937 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7aec010380 con 0x7f7afc102fb0 2024-08-01T07:02:57.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.664+0000 7f7af27fc640 1 --2- 172.21.15.16:0/3884241937 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7ae806e170 0x7f7ae8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:57.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.664+0000 7f7af27fc640 1 -- 172.21.15.16:0/3884241937 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6790+0+0 (secure 0 0 0) 0x7f7aec08df50 con 0x7f7afc102fb0 2024-08-01T07:02:57.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.664+0000 7f7b0164d640 1 --2- 172.21.15.16:0/3884241937 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7ae806e170 0x7f7ae8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:57.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.665+0000 7f7b0164d640 1 --2- 172.21.15.16:0/3884241937 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7ae806e170 0x7f7ae8070630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7af8031540 tx=0x7f7af8000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:57.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.669+0000 7f7af27fc640 1 -- 172.21.15.16:0/3884241937 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7aec0c2df0 con 0x7f7afc102fb0 2024-08-01T07:02:57.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.851+0000 7f7b038b1640 1 -- 172.21.15.16:0/3884241937 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7afc1039d0 con 0x7f7ae806e170 2024-08-01T07:02:57.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.861+0000 7f7af27fc640 1 -- 172.21.15.16:0/3884241937 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f7afc1039d0 con 0x7f7ae806e170 2024-08-01T07:02:57.863 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T07:02:57.863 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (13m) 2m ago 14m 25.2M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T07:02:57.863 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (15m) 2m ago 15m 8929k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T07:02:57.863 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (14m) 33s ago 14m 8786k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T07:02:57.863 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (3m) 2m ago 15m 6899k - 19.1.0-1223-gf9911e17 93d93c74a2cc 2a96028287a2 2024-08-01T07:02:57.863 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (3m) 33s ago 14m 6895k - 19.1.0-1223-gf9911e17 93d93c74a2cc 8a23341bd6c3 2024-08-01T07:02:57.863 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (13m) 2m ago 14m 84.5M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T07:02:57.863 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (9m) 2m ago 9m 89.3M - 18.2.2-1767-ga3bbd728 d280790d1980 96e46c28d16c 2024-08-01T07:02:57.863 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (9m) 2m ago 9m 147M - 18.2.2-1767-ga3bbd728 d280790d1980 4bbe1a388689 2024-08-01T07:02:57.864 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (9m) 33s ago 9m 26.7M - 18.2.2-1767-ga3bbd728 d280790d1980 65ca121a6fbb 2024-08-01T07:02:57.864 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (9m) 33s ago 9m 25.7M - 18.2.2-1767-ga3bbd728 d280790d1980 05bb46c6fe94 2024-08-01T07:02:57.864 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:8443,9283,8765 running (6m) 2m ago 16m 501M - 19.1.0-1223-gf9911e17 93d93c74a2cc 8701e6315593 2024-08-01T07:02:57.864 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (5m) 33s ago 14m 441M - 19.1.0-1223-gf9911e17 93d93c74a2cc c6caa21f436f 2024-08-01T07:02:57.864 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (4m) 2m ago 16m 48.2M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc 48e94d076e6f 2024-08-01T07:02:57.864 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (4m) 33s ago 13m 41.8M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc c4b83b46ff15 2024-08-01T07:02:57.864 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (15m) 2m ago 15m 15.9M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T07:02:57.864 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (14m) 33s ago 14m 16.5M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T07:02:57.864 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (3m) 2m ago 13m 93.0M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 4c2115ae6222 2024-08-01T07:02:57.865 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (2m) 2m ago 12m 95.5M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc fc2f7117be30 2024-08-01T07:02:57.865 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (2m) 2m ago 12m 12.1M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 3364752c9365 2024-08-01T07:02:57.865 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (101s) 33s ago 11m 105M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 9a18feae4353 2024-08-01T07:02:57.865 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (69s) 33s ago 11m 128M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 7c51ba7a636a 2024-08-01T07:02:57.865 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (37s) 33s ago 11m 12.1M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 08ffb10ca1a6 2024-08-01T07:02:57.865 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (5m) 2m ago 14m 60.6M - 2.43.0 a07b618ecd1d 45d23c96382e 2024-08-01T07:02:57.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.863+0000 7f7b038b1640 1 -- 172.21.15.16:0/3884241937 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7ae806e170 msgr2=0x7f7ae8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:57.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.863+0000 7f7b038b1640 1 --2- 172.21.15.16:0/3884241937 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7ae806e170 0x7f7ae8070630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7af8031540 tx=0x7f7af8000bc0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.863+0000 7f7b038b1640 1 -- 172.21.15.16:0/3884241937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7afc102fb0 msgr2=0x7f7afc0fe630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:57.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.863+0000 7f7b038b1640 1 --2- 172.21.15.16:0/3884241937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7afc102fb0 0x7f7afc0fe630 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00b3d0 tx=0x7f7aec00b890 comp rx=0 tx=0).stop 2024-08-01T07:02:57.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.863+0000 7f7b038b1640 1 -- 172.21.15.16:0/3884241937 shutdown_connections 2024-08-01T07:02:57.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.863+0000 7f7b038b1640 1 --2- 172.21.15.16:0/3884241937 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7ae806e170 0x7f7ae8070630 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.863+0000 7f7b038b1640 1 --2- 172.21.15.16:0/3884241937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7afc102fb0 0x7f7afc0fe630 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.863+0000 7f7b038b1640 1 --2- 172.21.15.16:0/3884241937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7afc100680 0x7f7afc0fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.863+0000 7f7b038b1640 1 -- 172.21.15.16:0/3884241937 >> 172.21.15.16:0/3884241937 conn(0x7f7afc0fa280 msgr2=0x7f7afc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:57.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.863+0000 7f7b038b1640 1 -- 172.21.15.16:0/3884241937 shutdown_connections 2024-08-01T07:02:57.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.863+0000 7f7b038b1640 1 -- 172.21.15.16:0/3884241937 wait complete. 2024-08-01T07:02:57.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.946+0000 7fcce6fc8640 1 -- 172.21.15.16:0/2472769602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce00feaa0 msgr2=0x7fcce00feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:57.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.946+0000 7fcce6fc8640 1 --2- 172.21.15.16:0/2472769602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce00feaa0 0x7fcce00feea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009880 tx=0x7fccd002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.946+0000 7fcce6fc8640 1 -- 172.21.15.16:0/2472769602 shutdown_connections 2024-08-01T07:02:57.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.946+0000 7fcce6fc8640 1 --2- 172.21.15.16:0/2472769602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcce00ffca0 0x7fcce0100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.946+0000 7fcce6fc8640 1 --2- 172.21.15.16:0/2472769602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce00feaa0 0x7fcce00feea0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.946+0000 7fcce6fc8640 1 -- 172.21.15.16:0/2472769602 >> 172.21.15.16:0/2472769602 conn(0x7fcce00fa250 msgr2=0x7fcce00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:57.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.946+0000 7fcce6fc8640 1 -- 172.21.15.16:0/2472769602 shutdown_connections 2024-08-01T07:02:57.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.946+0000 7fcce6fc8640 1 -- 172.21.15.16:0/2472769602 wait complete. 2024-08-01T07:02:57.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.947+0000 7fcce6fc8640 1 Processor -- start 2024-08-01T07:02:57.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.947+0000 7fcce6fc8640 1 -- start start 2024-08-01T07:02:57.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.947+0000 7fcce6fc8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce00feaa0 0x7fcce0195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:57.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.947+0000 7fcce6fc8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcce00ffca0 0x7fcce0195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:57.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.947+0000 7fcce6fc8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce0196150 con 0x7fcce00feaa0 2024-08-01T07:02:57.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.947+0000 7fcce6fc8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce01962c0 con 0x7fcce00ffca0 2024-08-01T07:02:57.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.947+0000 7fcce4d64640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce00feaa0 0x7fcce0195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:57.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.947+0000 7fcce4d64640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce00feaa0 0x7fcce0195640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52530/0 (socket says 172.21.15.16:52530) 2024-08-01T07:02:57.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.947+0000 7fcce4d64640 1 -- 172.21.15.16:0/2481606069 learned_addr learned my addr 172.21.15.16:0/2481606069 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:02:57.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.947+0000 7fccdffff640 1 --2- 172.21.15.16:0/2481606069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcce00ffca0 0x7fcce0195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:57.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.948+0000 7fcce4d64640 1 -- 172.21.15.16:0/2481606069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcce00ffca0 msgr2=0x7fcce0195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:57.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.948+0000 7fcce4d64640 1 --2- 172.21.15.16:0/2481606069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcce00ffca0 0x7fcce0195b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:57.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.948+0000 7fcce4d64640 1 -- 172.21.15.16:0/2481606069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd0009560 con 0x7fcce00feaa0 2024-08-01T07:02:57.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.948+0000 7fcce4d64640 1 --2- 172.21.15.16:0/2481606069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce00feaa0 0x7fcce0195640 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fccd00054f0 tx=0x7fccd0005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:57.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.948+0000 7fccddffb640 1 -- 172.21.15.16:0/2481606069 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccd0004aa0 con 0x7fcce00feaa0 2024-08-01T07:02:57.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.948+0000 7fccddffb640 1 -- 172.21.15.16:0/2481606069 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fccd0004c00 con 0x7fcce00feaa0 2024-08-01T07:02:57.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.948+0000 7fccddffb640 1 -- 172.21.15.16:0/2481606069 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccd0003ac0 con 0x7fcce00feaa0 2024-08-01T07:02:57.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.948+0000 7fcce6fc8640 1 -- 172.21.15.16:0/2481606069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce019acb0 con 0x7fcce00feaa0 2024-08-01T07:02:57.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.948+0000 7fcce6fc8640 1 -- 172.21.15.16:0/2481606069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce019b1a0 con 0x7fcce00feaa0 2024-08-01T07:02:57.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.950+0000 7fcce6fc8640 1 -- 172.21.15.16:0/2481606069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce0107690 con 0x7fcce00feaa0 2024-08-01T07:02:57.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.950+0000 7fccddffb640 1 -- 172.21.15.16:0/2481606069 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fccd0003d80 con 0x7fcce00feaa0 2024-08-01T07:02:57.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.950+0000 7fccddffb640 1 --2- 172.21.15.16:0/2481606069 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fccc806e170 0x7fccc8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:57.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.951+0000 7fccddffb640 1 -- 172.21.15.16:0/2481606069 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6790+0+0 (secure 0 0 0) 0x7fccd00af3c0 con 0x7fcce00feaa0 2024-08-01T07:02:57.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.951+0000 7fccdffff640 1 --2- 172.21.15.16:0/2481606069 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fccc806e170 0x7fccc8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:57.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.951+0000 7fccdffff640 1 --2- 172.21.15.16:0/2481606069 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fccc806e170 0x7fccc8070630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcce0196b10 tx=0x7fccd400b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:57.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:57.956+0000 7fccddffb640 1 -- 172.21.15.16:0/2481606069 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fccd0078680 con 0x7fcce00feaa0 2024-08-01T07:02:58.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.205+0000 7fcce6fc8640 1 -- 172.21.15.16:0/2481606069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcce019b3c0 con 0x7fcce00feaa0 2024-08-01T07:02:58.207 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:58 smithi016 ceph-mon[93645]: pgmap v186: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-08-01T07:02:58.207 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:58 smithi016 ceph-mon[93645]: mds.? [v2:172.21.15.89:6824/2498996985,v1:172.21.15.89:6825/2498996985] up:boot 2024-08-01T07:02:58.207 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:58 smithi016 ceph-mon[93645]: fsmap cephfs:1 {0=cephfs.smithi016.fziqod=up:active} 3 up:standby 2024-08-01T07:02:58.207 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:58 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.jhouje"}]: dispatch 2024-08-01T07:02:58.207 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:58 smithi016 ceph-mon[93645]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:02:58.207 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:58 smithi016 ceph-mon[93645]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:02:58.207 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:58 smithi016 ceph-mon[93645]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:02:58.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.205+0000 7fccddffb640 1 -- 172.21.15.16:0/2481606069 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+727 (secure 0 0 0) 0x7fccd007bd40 con 0x7fcce00feaa0 2024-08-01T07:02:58.208 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:02:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T07:02:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:02:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:02:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T07:02:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:02:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:02:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T07:02:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 6 2024-08-01T07:02:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:02:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T07:02:58.208 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4 2024-08-01T07:02:58.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:02:58.209 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T07:02:58.209 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 4, 2024-08-01T07:02:58.209 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 10 2024-08-01T07:02:58.209 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T07:02:58.209 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:02:58.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.207+0000 7fcce6fc8640 1 -- 172.21.15.16:0/2481606069 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fccc806e170 msgr2=0x7fccc8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:58.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.207+0000 7fcce6fc8640 1 --2- 172.21.15.16:0/2481606069 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fccc806e170 0x7fccc8070630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcce0196b10 tx=0x7fccd400b390 comp rx=0 tx=0).stop 2024-08-01T07:02:58.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.207+0000 7fcce6fc8640 1 -- 172.21.15.16:0/2481606069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce00feaa0 msgr2=0x7fcce0195640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:58.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.207+0000 7fcce6fc8640 1 --2- 172.21.15.16:0/2481606069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce00feaa0 0x7fcce0195640 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fccd00054f0 tx=0x7fccd0005520 comp rx=0 tx=0).stop 2024-08-01T07:02:58.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.207+0000 7fcce6fc8640 1 -- 172.21.15.16:0/2481606069 shutdown_connections 2024-08-01T07:02:58.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.207+0000 7fcce6fc8640 1 --2- 172.21.15.16:0/2481606069 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fccc806e170 0x7fccc8070630 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.207+0000 7fcce6fc8640 1 --2- 172.21.15.16:0/2481606069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcce00ffca0 0x7fcce0195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.207+0000 7fcce6fc8640 1 --2- 172.21.15.16:0/2481606069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce00feaa0 0x7fcce0195640 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.207+0000 7fcce6fc8640 1 -- 172.21.15.16:0/2481606069 >> 172.21.15.16:0/2481606069 conn(0x7fcce00fa250 msgr2=0x7fcce00fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:58.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.207+0000 7fcce6fc8640 1 -- 172.21.15.16:0/2481606069 shutdown_connections 2024-08-01T07:02:58.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.207+0000 7fcce6fc8640 1 -- 172.21.15.16:0/2481606069 wait complete. 2024-08-01T07:02:58.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.291+0000 7f1865068640 1 -- 172.21.15.16:0/478623845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18600ffb90 msgr2=0x7f18600fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:58.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.291+0000 7f1865068640 1 --2- 172.21.15.16:0/478623845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18600ffb90 0x7f18600fff90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1850009880 tx=0x7f185002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.291+0000 7f1865068640 1 -- 172.21.15.16:0/478623845 shutdown_connections 2024-08-01T07:02:58.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.291+0000 7f1865068640 1 --2- 172.21.15.16:0/478623845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1860100d90 0x7f1860101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.291+0000 7f1865068640 1 --2- 172.21.15.16:0/478623845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18600ffb90 0x7f18600fff90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.291+0000 7f1865068640 1 -- 172.21.15.16:0/478623845 >> 172.21.15.16:0/478623845 conn(0x7f18600fb320 msgr2=0x7f18600fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:58.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.291+0000 7f1865068640 1 -- 172.21.15.16:0/478623845 shutdown_connections 2024-08-01T07:02:58.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.291+0000 7f1865068640 1 -- 172.21.15.16:0/478623845 wait complete. 2024-08-01T07:02:58.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.292+0000 7f1865068640 1 Processor -- start 2024-08-01T07:02:58.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.292+0000 7f1865068640 1 -- start start 2024-08-01T07:02:58.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.292+0000 7f1865068640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18600ffb90 0x7f1860197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:58.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.292+0000 7f1865068640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1860100d90 0x7f1860197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:58.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.292+0000 7f1865068640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1860198380 con 0x7f1860100d90 2024-08-01T07:02:58.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.292+0000 7f1865068640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18601984f0 con 0x7f18600ffb90 2024-08-01T07:02:58.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.292+0000 7f185e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1860100d90 0x7f1860197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:58.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.292+0000 7f185e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1860100d90 0x7f1860197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52548/0 (socket says 172.21.15.16:52548) 2024-08-01T07:02:58.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.292+0000 7f185e59c640 1 -- 172.21.15.16:0/1789764483 learned_addr learned my addr 172.21.15.16:0/1789764483 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:02:58.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.293+0000 7f185ed9d640 1 --2- 172.21.15.16:0/1789764483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18600ffb90 0x7f1860197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:58.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.293+0000 7f185e59c640 1 -- 172.21.15.16:0/1789764483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18600ffb90 msgr2=0x7f1860197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:58.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.293+0000 7f185e59c640 1 --2- 172.21.15.16:0/1789764483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18600ffb90 0x7f1860197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.293+0000 7f185e59c640 1 -- 172.21.15.16:0/1789764483 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1850009560 con 0x7f1860100d90 2024-08-01T07:02:58.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.293+0000 7f185ed9d640 1 --2- 172.21.15.16:0/1789764483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18600ffb90 0x7f1860197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T07:02:58.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.293+0000 7f185e59c640 1 --2- 172.21.15.16:0/1789764483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1860100d90 0x7f1860197db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f185400d720 tx=0x7f185400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:58.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.293+0000 7f1847fff640 1 -- 172.21.15.16:0/1789764483 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18540051f0 con 0x7f1860100d90 2024-08-01T07:02:58.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.293+0000 7f1847fff640 1 -- 172.21.15.16:0/1789764483 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1854009ce0 con 0x7f1860100d90 2024-08-01T07:02:58.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.293+0000 7f1847fff640 1 -- 172.21.15.16:0/1789764483 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1854010460 con 0x7f1860100d90 2024-08-01T07:02:58.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.293+0000 7f1865068640 1 -- 172.21.15.16:0/1789764483 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186019cf90 con 0x7f1860100d90 2024-08-01T07:02:58.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.293+0000 7f1865068640 1 -- 172.21.15.16:0/1789764483 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186019d530 con 0x7f1860100d90 2024-08-01T07:02:58.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.294+0000 7f1865068640 1 -- 172.21.15.16:0/1789764483 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18600fff90 con 0x7f1860100d90 2024-08-01T07:02:58.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.295+0000 7f1847fff640 1 -- 172.21.15.16:0/1789764483 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1854009820 con 0x7f1860100d90 2024-08-01T07:02:58.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.295+0000 7f1847fff640 1 --2- 172.21.15.16:0/1789764483 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f184806e170 0x7f1848070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:58.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.295+0000 7f1847fff640 1 -- 172.21.15.16:0/1789764483 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6790+0+0 (secure 0 0 0) 0x7f185408de50 con 0x7f1860100d90 2024-08-01T07:02:58.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.295+0000 7f185ed9d640 1 --2- 172.21.15.16:0/1789764483 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f184806e170 0x7f1848070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:58.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.296+0000 7f185ed9d640 1 --2- 172.21.15.16:0/1789764483 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f184806e170 0x7f1848070630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1850009230 tx=0x7f18500314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:58.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.300+0000 7f1847fff640 1 -- 172.21.15.16:0/1789764483 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1854057060 con 0x7f1860100d90 2024-08-01T07:02:58.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:58 smithi089 ceph-mon[82218]: pgmap v186: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-08-01T07:02:58.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:58 smithi089 ceph-mon[82218]: mds.? [v2:172.21.15.89:6824/2498996985,v1:172.21.15.89:6825/2498996985] up:boot 2024-08-01T07:02:58.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:58 smithi089 ceph-mon[82218]: fsmap cephfs:1 {0=cephfs.smithi016.fziqod=up:active} 3 up:standby 2024-08-01T07:02:58.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:58 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.jhouje"}]: dispatch 2024-08-01T07:02:58.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:58 smithi089 ceph-mon[82218]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:02:58.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:58 smithi089 ceph-mon[82218]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:02:58.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:58 smithi089 ceph-mon[82218]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:02:58.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.512+0000 7f1865068640 1 -- 172.21.15.16:0/1789764483 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f18601056d0 con 0x7f1860100d90 2024-08-01T07:02:58.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.512+0000 7f1847fff640 1 -- 172.21.15.16:0/1789764483 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1925 (secure 0 0 0) 0x7f18540207a0 con 0x7f1860100d90 2024-08-01T07:02:58.514 INFO:teuthology.orchestra.run.smithi016.stdout:e23 2024-08-01T07:02:58.514 INFO:teuthology.orchestra.run.smithi016.stdout:btime 2024-08-01T07:02:57:125561+0000 2024-08-01T07:02:58.514 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T07:02:58.514 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T07:02:58.514 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T07:02:58.514 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:02:58.514 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T07:02:58.514 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T07:02:58.514 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 22 2024-08-01T07:02:58.515 INFO:teuthology.orchestra.run.smithi016.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-01T07:02:58.515 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T07:02:58.515 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T07:02:55.425341+0000 2024-08-01T07:02:58.515 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T07:02:58.515 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T07:02:58.515 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T07:02:58.515 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T07:02:58.515 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T07:02:58.515 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T07:02:58.515 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T07:02:58.515 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T07:02:58.515 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 0 2024-08-01T07:02:58.515 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T07:02:58.515 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 1 2024-08-01T07:02:58.515 INFO:teuthology.orchestra.run.smithi016.stdout:in 0 2024-08-01T07:02:58.515 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=14482} 2024-08-01T07:02:58.516 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T07:02:58.516 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T07:02:58.516 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 1 2024-08-01T07:02:58.516 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T07:02:58.516 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T07:02:58.516 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T07:02:58.516 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T07:02:58.516 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T07:02:58.516 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T07:02:58.516 INFO:teuthology.orchestra.run.smithi016.stdout:qdb_cluster leader: 14482 members: 14482 2024-08-01T07:02:58.516 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.16:6828/2984549955,v1:172.21.15.16:6829/2984549955] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:02:58.516 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:02:58.516 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:02:58.516 INFO:teuthology.orchestra.run.smithi016.stdout:Standby daemons: 2024-08-01T07:02:58.517 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:02:58.517 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{-1:44305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.16:6826/3015300025,v1:172.21.15.16:6827/3015300025] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:02:58.517 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{-1:44307} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/3851713020,v1:172.21.15.89:6827/3851713020] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:02:58.517 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{-1:44311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6824/2498996985,v1:172.21.15.89:6825/2498996985] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:02:58.517 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 23 2024-08-01T07:02:58.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.515+0000 7f1865068640 1 -- 172.21.15.16:0/1789764483 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f184806e170 msgr2=0x7f1848070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:58.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.515+0000 7f1865068640 1 --2- 172.21.15.16:0/1789764483 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f184806e170 0x7f1848070630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1850009230 tx=0x7f18500314e0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.515+0000 7f1865068640 1 -- 172.21.15.16:0/1789764483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1860100d90 msgr2=0x7f1860197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:58.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.515+0000 7f1865068640 1 --2- 172.21.15.16:0/1789764483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1860100d90 0x7f1860197db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f185400d720 tx=0x7f185400dbe0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.515+0000 7f1865068640 1 -- 172.21.15.16:0/1789764483 shutdown_connections 2024-08-01T07:02:58.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.515+0000 7f1865068640 1 --2- 172.21.15.16:0/1789764483 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f184806e170 0x7f1848070630 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.515+0000 7f1865068640 1 --2- 172.21.15.16:0/1789764483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1860100d90 0x7f1860197db0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.515+0000 7f1865068640 1 --2- 172.21.15.16:0/1789764483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18600ffb90 0x7f1860197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.515+0000 7f1865068640 1 -- 172.21.15.16:0/1789764483 >> 172.21.15.16:0/1789764483 conn(0x7f18600fb320 msgr2=0x7f1860072b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:58.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.515+0000 7f1865068640 1 -- 172.21.15.16:0/1789764483 shutdown_connections 2024-08-01T07:02:58.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.515+0000 7f1865068640 1 -- 172.21.15.16:0/1789764483 wait complete. 2024-08-01T07:02:58.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.600+0000 7fdddfd05640 1 -- 172.21.15.16:0/2801981041 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd8100630 msgr2=0x7fddd8102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:58.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.600+0000 7fdddfd05640 1 --2- 172.21.15.16:0/2801981041 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd8100630 0x7fddd8102a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fddd40098b0 tx=0x7fddd402a4d0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.600+0000 7fdddfd05640 1 -- 172.21.15.16:0/2801981041 shutdown_connections 2024-08-01T07:02:58.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.600+0000 7fdddfd05640 1 --2- 172.21.15.16:0/2801981041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddd8102f60 0x7fddd8105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.600+0000 7fdddfd05640 1 --2- 172.21.15.16:0/2801981041 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd8100630 0x7fddd8102a20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.600+0000 7fdddfd05640 1 -- 172.21.15.16:0/2801981041 >> 172.21.15.16:0/2801981041 conn(0x7fddd80fa250 msgr2=0x7fddd80fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:58.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.600+0000 7fdddfd05640 1 -- 172.21.15.16:0/2801981041 shutdown_connections 2024-08-01T07:02:58.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.600+0000 7fdddfd05640 1 -- 172.21.15.16:0/2801981041 wait complete. 2024-08-01T07:02:58.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.601+0000 7fdddfd05640 1 Processor -- start 2024-08-01T07:02:58.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.601+0000 7fdddfd05640 1 -- start start 2024-08-01T07:02:58.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.601+0000 7fdddfd05640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddd8100630 0x7fddd8195660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:58.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.601+0000 7fdddfd05640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd8102f60 0x7fddd8195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:58.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.601+0000 7fdddfd05640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd8196170 con 0x7fddd8102f60 2024-08-01T07:02:58.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.601+0000 7fdddfd05640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd81962e0 con 0x7fddd8100630 2024-08-01T07:02:58.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.601+0000 7fdddd2a0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd8102f60 0x7fddd8195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:58.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.601+0000 7fdddd2a0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd8102f60 0x7fddd8195ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52566/0 (socket says 172.21.15.16:52566) 2024-08-01T07:02:58.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.601+0000 7fdddd2a0640 1 -- 172.21.15.16:0/4251893838 learned_addr learned my addr 172.21.15.16:0/4251893838 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:02:58.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.601+0000 7fddddaa1640 1 --2- 172.21.15.16:0/4251893838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddd8100630 0x7fddd8195660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:58.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.601+0000 7fdddd2a0640 1 -- 172.21.15.16:0/4251893838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddd8100630 msgr2=0x7fddd8195660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:58.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.601+0000 7fdddd2a0640 1 --2- 172.21.15.16:0/4251893838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddd8100630 0x7fddd8195660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.601+0000 7fdddd2a0640 1 -- 172.21.15.16:0/4251893838 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd4009560 con 0x7fddd8102f60 2024-08-01T07:02:58.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.602+0000 7fdddd2a0640 1 --2- 172.21.15.16:0/4251893838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd8102f60 0x7fddd8195ba0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fddc800d6f0 tx=0x7fddc800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:58.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.602+0000 7fddceffd640 1 -- 172.21.15.16:0/4251893838 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddc80051f0 con 0x7fddd8102f60 2024-08-01T07:02:58.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.602+0000 7fddceffd640 1 -- 172.21.15.16:0/4251893838 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fddc8009ce0 con 0x7fddd8102f60 2024-08-01T07:02:58.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.602+0000 7fdddfd05640 1 -- 172.21.15.16:0/4251893838 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd819ad80 con 0x7fddd8102f60 2024-08-01T07:02:58.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.602+0000 7fddceffd640 1 -- 172.21.15.16:0/4251893838 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddc8004e80 con 0x7fddd8102f60 2024-08-01T07:02:58.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.602+0000 7fdddfd05640 1 -- 172.21.15.16:0/4251893838 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd819b350 con 0x7fddd8102f60 2024-08-01T07:02:58.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.603+0000 7fdddfd05640 1 -- 172.21.15.16:0/4251893838 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd81087e0 con 0x7fddd8102f60 2024-08-01T07:02:58.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.604+0000 7fddceffd640 1 -- 172.21.15.16:0/4251893838 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fddc80046c0 con 0x7fddd8102f60 2024-08-01T07:02:58.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.604+0000 7fddceffd640 1 --2- 172.21.15.16:0/4251893838 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fddc406e110 0x7fddc40705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:58.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.604+0000 7fddceffd640 1 -- 172.21.15.16:0/4251893838 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6790+0+0 (secure 0 0 0) 0x7fddc808dbf0 con 0x7fddd8102f60 2024-08-01T07:02:58.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.604+0000 7fddddaa1640 1 --2- 172.21.15.16:0/4251893838 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fddc406e110 0x7fddc40705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:58.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.605+0000 7fddddaa1640 1 --2- 172.21.15.16:0/4251893838 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fddc406e110 0x7fddc40705d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fddd4006010 tx=0x7fddd40314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:58.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.609+0000 7fddceffd640 1 -- 172.21.15.16:0/4251893838 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fddc8056eb0 con 0x7fddd8102f60 2024-08-01T07:02:58.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.799+0000 7fdddfd05640 1 -- 172.21.15.16:0/4251893838 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fddd819b590 con 0x7fddc406e110 2024-08-01T07:02:58.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.800+0000 7fddceffd640 1 -- 172.21.15.16:0/4251893838 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fddd819b590 con 0x7fddc406e110 2024-08-01T07:02:58.802 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:02:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T07:02:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T07:02:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T07:02:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-08-01T07:02:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-08-01T07:02:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr", 2024-08-01T07:02:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "osd", 2024-08-01T07:02:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: "crash" 2024-08-01T07:02:58.802 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-08-01T07:02:58.803 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "12/23 daemons upgraded", 2024-08-01T07:02:58.803 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading osd daemons", 2024-08-01T07:02:58.803 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T07:02:58.803 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:02:58.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.802+0000 7fdddfd05640 1 -- 172.21.15.16:0/4251893838 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fddc406e110 msgr2=0x7fddc40705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:58.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.802+0000 7fdddfd05640 1 --2- 172.21.15.16:0/4251893838 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fddc406e110 0x7fddc40705d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fddd4006010 tx=0x7fddd40314e0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.802+0000 7fdddfd05640 1 -- 172.21.15.16:0/4251893838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd8102f60 msgr2=0x7fddd8195ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:58.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.802+0000 7fdddfd05640 1 --2- 172.21.15.16:0/4251893838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd8102f60 0x7fddd8195ba0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fddc800d6f0 tx=0x7fddc800dbb0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.802+0000 7fdddfd05640 1 -- 172.21.15.16:0/4251893838 shutdown_connections 2024-08-01T07:02:58.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.802+0000 7fdddfd05640 1 --2- 172.21.15.16:0/4251893838 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fddc406e110 0x7fddc40705d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.802+0000 7fdddfd05640 1 --2- 172.21.15.16:0/4251893838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd8102f60 0x7fddd8195ba0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.802+0000 7fdddfd05640 1 --2- 172.21.15.16:0/4251893838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fddd8100630 0x7fddd8195660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.802+0000 7fdddfd05640 1 -- 172.21.15.16:0/4251893838 >> 172.21.15.16:0/4251893838 conn(0x7fddd80fa250 msgr2=0x7fddd80fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:58.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.802+0000 7fdddfd05640 1 -- 172.21.15.16:0/4251893838 shutdown_connections 2024-08-01T07:02:58.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.802+0000 7fdddfd05640 1 -- 172.21.15.16:0/4251893838 wait complete. 2024-08-01T07:02:58.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.886+0000 7f5d0f570640 1 -- 172.21.15.16:0/3292181808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d08102f60 msgr2=0x7f5d08105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.886+0000 7f5d0f570640 1 --2- 172.21.15.16:0/3292181808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d08102f60 0x7f5d08105350 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80098b0 tx=0x7f5cf802a4d0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.886+0000 7f5d0f570640 1 -- 172.21.15.16:0/3292181808 shutdown_connections 2024-08-01T07:02:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.886+0000 7f5d0f570640 1 --2- 172.21.15.16:0/3292181808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d08102f60 0x7f5d08105350 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.886+0000 7f5d0f570640 1 --2- 172.21.15.16:0/3292181808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d08100630 0x7f5d08102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.886+0000 7f5d0f570640 1 -- 172.21.15.16:0/3292181808 >> 172.21.15.16:0/3292181808 conn(0x7f5d080fa250 msgr2=0x7f5d080fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.886+0000 7f5d0f570640 1 -- 172.21.15.16:0/3292181808 shutdown_connections 2024-08-01T07:02:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.886+0000 7f5d0f570640 1 -- 172.21.15.16:0/3292181808 wait complete. 2024-08-01T07:02:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.886+0000 7f5d0f570640 1 Processor -- start 2024-08-01T07:02:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.887+0000 7f5d0f570640 1 -- start start 2024-08-01T07:02:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.887+0000 7f5d0f570640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d08100630 0x7f5d08195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.887+0000 7f5d0f570640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d08102f60 0x7f5d08195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.887+0000 7f5d0f570640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d08196160 con 0x7f5d08102f60 2024-08-01T07:02:58.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.887+0000 7f5d0f570640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d081962d0 con 0x7f5d08100630 2024-08-01T07:02:58.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.887+0000 7f5d0cb0b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d08102f60 0x7f5d08195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:58.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.887+0000 7f5d0cb0b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d08102f60 0x7f5d08195b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46666/0 (socket says 172.21.15.16:46666) 2024-08-01T07:02:58.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.887+0000 7f5d0cb0b640 1 -- 172.21.15.16:0/3106997550 learned_addr learned my addr 172.21.15.16:0/3106997550 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:02:58.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.887+0000 7f5d0d30c640 1 --2- 172.21.15.16:0/3106997550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d08100630 0x7f5d08195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:58.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.887+0000 7f5d0cb0b640 1 -- 172.21.15.16:0/3106997550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d08100630 msgr2=0x7f5d08195650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:58.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.887+0000 7f5d0cb0b640 1 --2- 172.21.15.16:0/3106997550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d08100630 0x7f5d08195650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:58.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.887+0000 7f5d0cb0b640 1 -- 172.21.15.16:0/3106997550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf8009560 con 0x7f5d08102f60 2024-08-01T07:02:58.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.887+0000 7f5d0d30c640 1 --2- 172.21.15.16:0/3106997550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d08100630 0x7f5d08195650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T07:02:58.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.887+0000 7f5d0cb0b640 1 --2- 172.21.15.16:0/3106997550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d08102f60 0x7f5d08195b90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8005610 tx=0x7f5cf8005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.888+0000 7f5cfe7fc640 1 -- 172.21.15.16:0/3106997550 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cf8004ba0 con 0x7f5d08102f60 2024-08-01T07:02:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.888+0000 7f5d0f570640 1 -- 172.21.15.16:0/3106997550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0819ad10 con 0x7f5d08102f60 2024-08-01T07:02:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.888+0000 7f5cfe7fc640 1 -- 172.21.15.16:0/3106997550 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5cf8004d00 con 0x7f5d08102f60 2024-08-01T07:02:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.888+0000 7f5cfe7fc640 1 -- 172.21.15.16:0/3106997550 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cf8003bf0 con 0x7f5d08102f60 2024-08-01T07:02:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.888+0000 7f5d0f570640 1 -- 172.21.15.16:0/3106997550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0819b280 con 0x7f5d08102f60 2024-08-01T07:02:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.889+0000 7f5d0f570640 1 -- 172.21.15.16:0/3106997550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d08108790 con 0x7f5d08102f60 2024-08-01T07:02:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.889+0000 7f5cfe7fc640 1 -- 172.21.15.16:0/3106997550 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5cf8031640 con 0x7f5d08102f60 2024-08-01T07:02:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.890+0000 7f5cfe7fc640 1 --2- 172.21.15.16:0/3106997550 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f5cf406e170 0x7f5cf4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:02:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.890+0000 7f5cfe7fc640 1 -- 172.21.15.16:0/3106997550 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6790+0+0 (secure 0 0 0) 0x7f5cf80af590 con 0x7f5d08102f60 2024-08-01T07:02:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.890+0000 7f5d0d30c640 1 --2- 172.21.15.16:0/3106997550 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f5cf406e170 0x7f5cf4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:02:58.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.891+0000 7f5d0d30c640 1 --2- 172.21.15.16:0/3106997550 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f5cf406e170 0x7f5cf4070630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5d040058c0 tx=0x7f5d04005ec0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:02:58.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:58.894+0000 7f5cfe7fc640 1 -- 172.21.15.16:0/3106997550 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5cf80787a0 con 0x7f5d08102f60 2024-08-01T07:02:59.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:59.142+0000 7f5d0f570640 1 -- 172.21.15.16:0/3106997550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5d08108920 con 0x7f5d08102f60 2024-08-01T07:02:59.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:59.143+0000 7f5cfe7fc640 1 -- 172.21.15.16:0/3106997550 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f5cf807be60 con 0x7f5d08102f60 2024-08-01T07:02:59.144 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-08-01T07:02:59.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:59.145+0000 7f5d0f570640 1 -- 172.21.15.16:0/3106997550 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f5cf406e170 msgr2=0x7f5cf4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:59.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:59.145+0000 7f5d0f570640 1 --2- 172.21.15.16:0/3106997550 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f5cf406e170 0x7f5cf4070630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5d040058c0 tx=0x7f5d04005ec0 comp rx=0 tx=0).stop 2024-08-01T07:02:59.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:59.145+0000 7f5d0f570640 1 -- 172.21.15.16:0/3106997550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d08102f60 msgr2=0x7f5d08195b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:02:59.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:59.145+0000 7f5d0f570640 1 --2- 172.21.15.16:0/3106997550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d08102f60 0x7f5d08195b90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8005610 tx=0x7f5cf8005640 comp rx=0 tx=0).stop 2024-08-01T07:02:59.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:59.145+0000 7f5d0f570640 1 -- 172.21.15.16:0/3106997550 shutdown_connections 2024-08-01T07:02:59.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:59.145+0000 7f5d0f570640 1 --2- 172.21.15.16:0/3106997550 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f5cf406e170 0x7f5cf4070630 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:59.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:59.145+0000 7f5d0f570640 1 --2- 172.21.15.16:0/3106997550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d08102f60 0x7f5d08195b90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:59.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:59.145+0000 7f5d0f570640 1 --2- 172.21.15.16:0/3106997550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d08100630 0x7f5d08195650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:02:59.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:59.145+0000 7f5d0f570640 1 -- 172.21.15.16:0/3106997550 >> 172.21.15.16:0/3106997550 conn(0x7f5d080fa250 msgr2=0x7f5d080fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:02:59.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:59.145+0000 7f5d0f570640 1 -- 172.21.15.16:0/3106997550 shutdown_connections 2024-08-01T07:02:59.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:02:59.145+0000 7f5d0f570640 1 -- 172.21.15.16:0/3106997550 wait complete. 2024-08-01T07:02:59.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:59 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2481606069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:59.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:59 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/1789764483' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:02:59.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:02:59 smithi089 ceph-mon[82218]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:02:59.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:59 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2481606069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:02:59.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:59 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/1789764483' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:02:59.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:02:59 smithi016 ceph-mon[93645]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:03:00.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:00 smithi016 ceph-mon[93645]: pgmap v187: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-08-01T07:03:00.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:00 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/3106997550' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:03:00.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:00 smithi089 ceph-mon[82218]: pgmap v187: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-08-01T07:03:00.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:00 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/3106997550' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:03:02.210 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:02 smithi016 ceph-mon[93645]: pgmap v188: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-08-01T07:03:02.210 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:03:02.210 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:03:02.210 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:03:02.210 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:02.210 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:03:02.210 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:02.210 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:02.210 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:02.210 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:02.210 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi016.bgqkxu"]}]: dispatch 2024-08-01T07:03:02.211 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:02 smithi016 ceph-mon[93645]: Upgrade: It appears safe to stop mds.cephfs.smithi016.bgqkxu 2024-08-01T07:03:02.211 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:03:02.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:02 smithi089 ceph-mon[82218]: pgmap v188: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-08-01T07:03:02.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:03:02.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:03:02.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:03:02.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:02.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:03:02.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:02.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:02.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:02.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:02.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi016.bgqkxu"]}]: dispatch 2024-08-01T07:03:02.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:02 smithi089 ceph-mon[82218]: Upgrade: It appears safe to stop mds.cephfs.smithi016.bgqkxu 2024-08-01T07:03:02.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:03:04.349 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:03 smithi016 ceph-mon[93645]: Upgrade: Updating mds.cephfs.smithi016.bgqkxu 2024-08-01T07:03:04.349 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:03 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:04.349 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:03 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi016.bgqkxu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T07:03:04.349 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:03 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:03:04.349 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:03 smithi016 ceph-mon[93645]: Deploying daemon mds.cephfs.smithi016.bgqkxu on smithi016 2024-08-01T07:03:04.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:03 smithi089 ceph-mon[82218]: Upgrade: Updating mds.cephfs.smithi016.bgqkxu 2024-08-01T07:03:04.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:03 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:04.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:03 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi016.bgqkxu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T07:03:04.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:03 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:03:04.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:03 smithi089 ceph-mon[82218]: Deploying daemon mds.cephfs.smithi016.bgqkxu on smithi016 2024-08-01T07:03:05.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:04 smithi089 ceph-mon[82218]: pgmap v189: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-08-01T07:03:05.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:04 smithi016 ceph-mon[93645]: pgmap v189: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-08-01T07:03:06.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:05 smithi089 ceph-mon[82218]: osdmap e93: 6 total, 6 up, 6 in 2024-08-01T07:03:06.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:05 smithi089 ceph-mon[82218]: fsmap cephfs:1 {0=cephfs.smithi016.fziqod=up:active} 2 up:standby 2024-08-01T07:03:06.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:05 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.bgqkxu"}]: dispatch 2024-08-01T07:03:06.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:05 smithi016 ceph-mon[93645]: osdmap e93: 6 total, 6 up, 6 in 2024-08-01T07:03:06.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:05 smithi016 ceph-mon[93645]: fsmap cephfs:1 {0=cephfs.smithi016.fziqod=up:active} 2 up:standby 2024-08-01T07:03:06.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:05 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.bgqkxu"}]: dispatch 2024-08-01T07:03:07.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:06 smithi016 ceph-mon[93645]: pgmap v191: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:07.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:06 smithi089 ceph-mon[82218]: pgmap v191: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:09.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:08 smithi089 ceph-mon[82218]: pgmap v192: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:09.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:08 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:09.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:08 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:09.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:08 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:03:09.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:08 smithi089 ceph-mon[82218]: mds.? [v2:172.21.15.16:6826/4064792079,v1:172.21.15.16:6827/4064792079] up:boot 2024-08-01T07:03:09.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:08 smithi089 ceph-mon[82218]: fsmap cephfs:1 {0=cephfs.smithi016.fziqod=up:active} 3 up:standby 2024-08-01T07:03:09.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:08 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.bgqkxu"}]: dispatch 2024-08-01T07:03:09.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:08 smithi016 ceph-mon[93645]: pgmap v192: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:09.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:08 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:09.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:08 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:09.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:08 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:03:09.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:08 smithi016 ceph-mon[93645]: mds.? [v2:172.21.15.16:6826/4064792079,v1:172.21.15.16:6827/4064792079] up:boot 2024-08-01T07:03:09.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:08 smithi016 ceph-mon[93645]: fsmap cephfs:1 {0=cephfs.smithi016.fziqod=up:active} 3 up:standby 2024-08-01T07:03:09.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:08 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.bgqkxu"}]: dispatch 2024-08-01T07:03:10.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:10 smithi016 ceph-mon[93645]: pgmap v193: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:11.114 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:10 smithi089 ceph-mon[82218]: pgmap v193: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:13.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:12 smithi089 ceph-mon[82218]: pgmap v194: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:13.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:12 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:13.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:12 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:13.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:12 smithi016 ceph-mon[93645]: pgmap v194: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:13.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:12 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:13.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:12 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:14.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:14 smithi016 ceph-mon[93645]: pgmap v195: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:14.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:14 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:14.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:14 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:14.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:14 smithi089 ceph-mon[82218]: pgmap v195: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:14.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:14 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:14.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:14 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:16.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:16 smithi016 ceph-mon[93645]: pgmap v196: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:16.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:16 smithi089 ceph-mon[82218]: pgmap v196: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:17.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:03:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:03:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:03:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi016.fziqod"]}]: dispatch 2024-08-01T07:03:17.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:17 smithi016 ceph-mon[93645]: Upgrade: It appears safe to stop mds.cephfs.smithi016.fziqod 2024-08-01T07:03:17.650 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:03:17.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:17.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:17.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:03:17.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:03:17.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:17.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:03:17.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:17.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:17.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:17.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:17.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi016.fziqod"]}]: dispatch 2024-08-01T07:03:17.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:17 smithi089 ceph-mon[82218]: Upgrade: It appears safe to stop mds.cephfs.smithi016.fziqod 2024-08-01T07:03:17.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:03:19.314 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:18 smithi016 ceph-mon[93645]: pgmap v197: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:19.315 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:18 smithi016 ceph-mon[93645]: Upgrade: Updating mds.cephfs.smithi016.fziqod 2024-08-01T07:03:19.315 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:19.315 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi016.fziqod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T07:03:19.315 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:03:19.315 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:18 smithi016 ceph-mon[93645]: Deploying daemon mds.cephfs.smithi016.fziqod on smithi016 2024-08-01T07:03:19.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:18 smithi089 ceph-mon[82218]: pgmap v197: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:19.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:18 smithi089 ceph-mon[82218]: Upgrade: Updating mds.cephfs.smithi016.fziqod 2024-08-01T07:03:19.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:19.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi016.fziqod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T07:03:19.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:03:19.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:18 smithi089 ceph-mon[82218]: Deploying daemon mds.cephfs.smithi016.fziqod on smithi016 2024-08-01T07:03:20.396 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:20 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016[93641]: 2024-08-01T07:03:20.060+0000 7f9e1dcaa640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-01T07:03:21.283 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:20 smithi089 ceph-mon[82218]: pgmap v198: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:21.283 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:20 smithi089 ceph-mon[82218]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-01T07:03:21.283 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:20 smithi089 ceph-mon[82218]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-01T07:03:21.283 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:20 smithi089 ceph-mon[82218]: osdmap e94: 6 total, 6 up, 6 in 2024-08-01T07:03:21.283 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:20 smithi089 ceph-mon[82218]: Standby daemon mds.cephfs.smithi016.bgqkxu assigned to filesystem cephfs as rank 0 2024-08-01T07:03:21.283 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:20 smithi089 ceph-mon[82218]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-01T07:03:21.283 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:20 smithi089 ceph-mon[82218]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-08-01T07:03:21.283 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:20 smithi089 ceph-mon[82218]: fsmap cephfs:1/1 {0=cephfs.smithi016.bgqkxu=up:replay} 2 up:standby 2024-08-01T07:03:21.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:20 smithi016 ceph-mon[93645]: pgmap v198: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:21.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:20 smithi016 ceph-mon[93645]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-01T07:03:21.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:20 smithi016 ceph-mon[93645]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-01T07:03:21.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:20 smithi016 ceph-mon[93645]: osdmap e94: 6 total, 6 up, 6 in 2024-08-01T07:03:21.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:20 smithi016 ceph-mon[93645]: Standby daemon mds.cephfs.smithi016.bgqkxu assigned to filesystem cephfs as rank 0 2024-08-01T07:03:21.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:20 smithi016 ceph-mon[93645]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-01T07:03:21.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:20 smithi016 ceph-mon[93645]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-08-01T07:03:21.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:20 smithi016 ceph-mon[93645]: fsmap cephfs:1/1 {0=cephfs.smithi016.bgqkxu=up:replay} 2 up:standby 2024-08-01T07:03:23.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:22 smithi016 ceph-mon[93645]: pgmap v200: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:23.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:22 smithi089 ceph-mon[82218]: pgmap v200: 65 pgs: 65 active+clean; 213 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:24.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:23 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.fziqod"}]: dispatch 2024-08-01T07:03:24.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:23 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.fziqod"}]: dispatch 2024-08-01T07:03:25.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:24 smithi089 ceph-mon[82218]: pgmap v201: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 1 op/s 2024-08-01T07:03:25.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:24 smithi016 ceph-mon[93645]: pgmap v201: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 1 op/s 2024-08-01T07:03:27.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:26 smithi089 ceph-mon[82218]: pgmap v202: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-08-01T07:03:27.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:26 smithi016 ceph-mon[93645]: pgmap v202: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-08-01T07:03:29.246 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:28 smithi016 ceph-mon[93645]: pgmap v203: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-08-01T07:03:29.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.244+0000 7f27efc1b640 1 -- 172.21.15.16:0/806630374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27e8100d90 msgr2=0x7f27e8101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:29.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.244+0000 7f27efc1b640 1 --2- 172.21.15.16:0/806630374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27e8100d90 0x7f27e8101210 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f27d8009880 tx=0x7f27d802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:03:29.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.244+0000 7f27efc1b640 1 -- 172.21.15.16:0/806630374 shutdown_connections 2024-08-01T07:03:29.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.244+0000 7f27efc1b640 1 --2- 172.21.15.16:0/806630374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27e8100d90 0x7f27e8101210 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:29.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.244+0000 7f27efc1b640 1 --2- 172.21.15.16:0/806630374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27e80ffb90 0x7f27e80fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:29.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.244+0000 7f27efc1b640 1 -- 172.21.15.16:0/806630374 >> 172.21.15.16:0/806630374 conn(0x7f27e80fb320 msgr2=0x7f27e80fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:03:29.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.244+0000 7f27efc1b640 1 -- 172.21.15.16:0/806630374 shutdown_connections 2024-08-01T07:03:29.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.244+0000 7f27efc1b640 1 -- 172.21.15.16:0/806630374 wait complete. 2024-08-01T07:03:29.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.244+0000 7f27efc1b640 1 Processor -- start 2024-08-01T07:03:29.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.245+0000 7f27efc1b640 1 -- start start 2024-08-01T07:03:29.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.245+0000 7f27efc1b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27e80ffb90 0x7f27e81955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:29.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.245+0000 7f27efc1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27e8100d90 0x7f27e8195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:29.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.245+0000 7f27efc1b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e81960f0 con 0x7f27e80ffb90 2024-08-01T07:03:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.245+0000 7f27efc1b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e8196260 con 0x7f27e8100d90 2024-08-01T07:03:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.245+0000 7f27ed9b7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27e80ffb90 0x7f27e81955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.245+0000 7f27ed9b7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27e80ffb90 0x7f27e81955e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55118/0 (socket says 172.21.15.16:55118) 2024-08-01T07:03:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.245+0000 7f27ed9b7640 1 -- 172.21.15.16:0/1376649724 learned_addr learned my addr 172.21.15.16:0/1376649724 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:03:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.245+0000 7f27ed1b6640 1 --2- 172.21.15.16:0/1376649724 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27e8100d90 0x7f27e8195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.245+0000 7f27ed1b6640 1 -- 172.21.15.16:0/1376649724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27e80ffb90 msgr2=0x7f27e81955e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.245+0000 7f27ed1b6640 1 --2- 172.21.15.16:0/1376649724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27e80ffb90 0x7f27e81955e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.245+0000 7f27ed1b6640 1 -- 172.21.15.16:0/1376649724 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d8009560 con 0x7f27e8100d90 2024-08-01T07:03:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.245+0000 7f27ed9b7640 1 --2- 172.21.15.16:0/1376649724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27e80ffb90 0x7f27e81955e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T07:03:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.246+0000 7f27ed1b6640 1 --2- 172.21.15.16:0/1376649724 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27e8100d90 0x7f27e8195b20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f27d802a9c0 tx=0x7f27d8005610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:03:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.246+0000 7f27deffd640 1 -- 172.21.15.16:0/1376649724 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27d8004b20 con 0x7f27e8100d90 2024-08-01T07:03:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.246+0000 7f27efc1b640 1 -- 172.21.15.16:0/1376649724 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e819aca0 con 0x7f27e8100d90 2024-08-01T07:03:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.246+0000 7f27efc1b640 1 -- 172.21.15.16:0/1376649724 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e819b210 con 0x7f27e8100d90 2024-08-01T07:03:29.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.246+0000 7f27deffd640 1 -- 172.21.15.16:0/1376649724 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f27d8004c80 con 0x7f27e8100d90 2024-08-01T07:03:29.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.246+0000 7f27deffd640 1 -- 172.21.15.16:0/1376649724 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27d8003b80 con 0x7f27e8100d90 2024-08-01T07:03:29.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.247+0000 7f27efc1b640 1 -- 172.21.15.16:0/1376649724 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e8108780 con 0x7f27e8100d90 2024-08-01T07:03:29.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.248+0000 7f27deffd640 1 -- 172.21.15.16:0/1376649724 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f27d8003ce0 con 0x7f27e8100d90 2024-08-01T07:03:29.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.248+0000 7f27deffd640 1 --2- 172.21.15.16:0/1376649724 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f27d406e170 0x7f27d4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:29.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.249+0000 7f27deffd640 1 -- 172.21.15.16:0/1376649724 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f27d80af3d0 con 0x7f27e8100d90 2024-08-01T07:03:29.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.249+0000 7f27ed9b7640 1 --2- 172.21.15.16:0/1376649724 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f27d406e170 0x7f27d4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:29.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.249+0000 7f27ed9b7640 1 --2- 172.21.15.16:0/1376649724 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f27d406e170 0x7f27d4070630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f27e400afc0 tx=0x7f27e400a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:03:29.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.253+0000 7f27deffd640 1 -- 172.21.15.16:0/1376649724 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f27d8078620 con 0x7f27e8100d90 2024-08-01T07:03:29.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:28 smithi089 ceph-mon[82218]: pgmap v203: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-08-01T07:03:29.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.447+0000 7f27efc1b640 1 -- 172.21.15.16:0/1376649724 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f27e819b450 con 0x7f27d406e170 2024-08-01T07:03:29.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.448+0000 7f27deffd640 1 -- 172.21.15.16:0/1376649724 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f27e819b450 con 0x7f27d406e170 2024-08-01T07:03:29.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.450+0000 7f27efc1b640 1 -- 172.21.15.16:0/1376649724 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f27d406e170 msgr2=0x7f27d4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:29.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.450+0000 7f27efc1b640 1 --2- 172.21.15.16:0/1376649724 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f27d406e170 0x7f27d4070630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f27e400afc0 tx=0x7f27e400a380 comp rx=0 tx=0).stop 2024-08-01T07:03:29.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.450+0000 7f27efc1b640 1 -- 172.21.15.16:0/1376649724 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27e8100d90 msgr2=0x7f27e8195b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:29.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.450+0000 7f27efc1b640 1 --2- 172.21.15.16:0/1376649724 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27e8100d90 0x7f27e8195b20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f27d802a9c0 tx=0x7f27d8005610 comp rx=0 tx=0).stop 2024-08-01T07:03:29.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.450+0000 7f27efc1b640 1 -- 172.21.15.16:0/1376649724 shutdown_connections 2024-08-01T07:03:29.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.450+0000 7f27efc1b640 1 --2- 172.21.15.16:0/1376649724 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f27d406e170 0x7f27d4070630 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:29.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.450+0000 7f27efc1b640 1 --2- 172.21.15.16:0/1376649724 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27e8100d90 0x7f27e8195b20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:29.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.450+0000 7f27efc1b640 1 --2- 172.21.15.16:0/1376649724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27e80ffb90 0x7f27e81955e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:29.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.450+0000 7f27efc1b640 1 -- 172.21.15.16:0/1376649724 >> 172.21.15.16:0/1376649724 conn(0x7f27e80fb320 msgr2=0x7f27e80fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:03:29.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.451+0000 7f27efc1b640 1 -- 172.21.15.16:0/1376649724 shutdown_connections 2024-08-01T07:03:29.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.451+0000 7f27efc1b640 1 -- 172.21.15.16:0/1376649724 wait complete. 2024-08-01T07:03:29.460 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T07:03:29.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.535+0000 7fced2546640 1 -- 172.21.15.16:0/1323370557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcecc0ffb80 msgr2=0x7fcecc0fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:29.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.535+0000 7fced2546640 1 --2- 172.21.15.16:0/1323370557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcecc0ffb80 0x7fcecc0fff80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009880 tx=0x7fcebc02a4a0 comp rx=0 tx=0).stop 2024-08-01T07:03:29.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.535+0000 7fced2546640 1 -- 172.21.15.16:0/1323370557 shutdown_connections 2024-08-01T07:03:29.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.535+0000 7fced2546640 1 --2- 172.21.15.16:0/1323370557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcecc100d80 0x7fcecc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:29.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.535+0000 7fced2546640 1 --2- 172.21.15.16:0/1323370557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcecc0ffb80 0x7fcecc0fff80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:29.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.535+0000 7fced2546640 1 -- 172.21.15.16:0/1323370557 >> 172.21.15.16:0/1323370557 conn(0x7fcecc0fb330 msgr2=0x7fcecc0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:03:29.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.535+0000 7fced2546640 1 -- 172.21.15.16:0/1323370557 shutdown_connections 2024-08-01T07:03:29.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.535+0000 7fced2546640 1 -- 172.21.15.16:0/1323370557 wait complete. 2024-08-01T07:03:29.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.536+0000 7fced2546640 1 Processor -- start 2024-08-01T07:03:29.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.536+0000 7fced2546640 1 -- start start 2024-08-01T07:03:29.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.536+0000 7fced2546640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcecc0ffb80 0x7fcecc197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:29.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.536+0000 7fced2546640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcecc100d80 0x7fcecc197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:29.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.536+0000 7fced2546640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc198350 con 0x7fcecc0ffb80 2024-08-01T07:03:29.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.536+0000 7fced2546640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc1984c0 con 0x7fcecc100d80 2024-08-01T07:03:29.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.536+0000 7fcecbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcecc0ffb80 0x7fcecc197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:29.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.536+0000 7fcecbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcecc0ffb80 0x7fcecc197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55136/0 (socket says 172.21.15.16:55136) 2024-08-01T07:03:29.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.536+0000 7fcecbfff640 1 -- 172.21.15.16:0/1227874572 learned_addr learned my addr 172.21.15.16:0/1227874572 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:03:29.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.536+0000 7fcecbfff640 1 -- 172.21.15.16:0/1227874572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcecc100d80 msgr2=0x7fcecc197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:29.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.536+0000 7fcecbfff640 1 --2- 172.21.15.16:0/1227874572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcecc100d80 0x7fcecc197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:29.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.536+0000 7fcecbfff640 1 -- 172.21.15.16:0/1227874572 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc009560 con 0x7fcecc0ffb80 2024-08-01T07:03:29.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.537+0000 7fcecbfff640 1 --2- 172.21.15.16:0/1227874572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcecc0ffb80 0x7fcecc197840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0054f0 tx=0x7fcebc005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:03:29.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.537+0000 7fcec97fa640 1 -- 172.21.15.16:0/1227874572 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcebc004aa0 con 0x7fcecc0ffb80 2024-08-01T07:03:29.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.537+0000 7fcec97fa640 1 -- 172.21.15.16:0/1227874572 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcebc004c00 con 0x7fcecc0ffb80 2024-08-01T07:03:29.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.537+0000 7fced2546640 1 -- 172.21.15.16:0/1227874572 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcecc19cf00 con 0x7fcecc0ffb80 2024-08-01T07:03:29.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.537+0000 7fcec97fa640 1 -- 172.21.15.16:0/1227874572 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcebc003ac0 con 0x7fcecc0ffb80 2024-08-01T07:03:29.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.537+0000 7fced2546640 1 -- 172.21.15.16:0/1227874572 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcecc19d440 con 0x7fcecc0ffb80 2024-08-01T07:03:29.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.538+0000 7fced2546640 1 -- 172.21.15.16:0/1227874572 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcecc1056c0 con 0x7fcecc0ffb80 2024-08-01T07:03:29.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.539+0000 7fcec97fa640 1 -- 172.21.15.16:0/1227874572 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fcebc003d30 con 0x7fcecc0ffb80 2024-08-01T07:03:29.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.539+0000 7fcec97fa640 1 --2- 172.21.15.16:0/1227874572 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fceb406e180 0x7fceb4070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:29.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.539+0000 7fcec97fa640 1 -- 172.21.15.16:0/1227874572 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fcebc0af470 con 0x7fcecc0ffb80 2024-08-01T07:03:29.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.539+0000 7fcecb7fe640 1 --2- 172.21.15.16:0/1227874572 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fceb406e180 0x7fceb4070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:29.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.540+0000 7fcecb7fe640 1 --2- 172.21.15.16:0/1227874572 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fceb406e180 0x7fceb4070640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcec0005fd0 tx=0x7fcec0005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:03:29.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.544+0000 7fcec97fa640 1 -- 172.21.15.16:0/1227874572 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fcebc0786b0 con 0x7fcecc0ffb80 2024-08-01T07:03:29.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.740+0000 7fced2546640 1 -- 172.21.15.16:0/1227874572 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcecc02c4f0 con 0x7fceb406e180 2024-08-01T07:03:29.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.741+0000 7fcec97fa640 1 -- 172.21.15.16:0/1227874572 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fcecc02c4f0 con 0x7fceb406e180 2024-08-01T07:03:29.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.743+0000 7fced2546640 1 -- 172.21.15.16:0/1227874572 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fceb406e180 msgr2=0x7fceb4070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:29.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.743+0000 7fced2546640 1 --2- 172.21.15.16:0/1227874572 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fceb406e180 0x7fceb4070640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcec0005fd0 tx=0x7fcec0005850 comp rx=0 tx=0).stop 2024-08-01T07:03:29.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.743+0000 7fced2546640 1 -- 172.21.15.16:0/1227874572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcecc0ffb80 msgr2=0x7fcecc197840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:29.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.743+0000 7fced2546640 1 --2- 172.21.15.16:0/1227874572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcecc0ffb80 0x7fcecc197840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0054f0 tx=0x7fcebc005520 comp rx=0 tx=0).stop 2024-08-01T07:03:29.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.743+0000 7fced2546640 1 -- 172.21.15.16:0/1227874572 shutdown_connections 2024-08-01T07:03:29.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.743+0000 7fced2546640 1 --2- 172.21.15.16:0/1227874572 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fceb406e180 0x7fceb4070640 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:29.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.743+0000 7fced2546640 1 --2- 172.21.15.16:0/1227874572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcecc100d80 0x7fcecc197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:29.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.743+0000 7fced2546640 1 --2- 172.21.15.16:0/1227874572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcecc0ffb80 0x7fcecc197840 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:29.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.743+0000 7fced2546640 1 -- 172.21.15.16:0/1227874572 >> 172.21.15.16:0/1227874572 conn(0x7fcecc0fb330 msgr2=0x7fcecc072b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:03:29.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.744+0000 7fced2546640 1 -- 172.21.15.16:0/1227874572 shutdown_connections 2024-08-01T07:03:29.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.744+0000 7fced2546640 1 -- 172.21.15.16:0/1227874572 wait complete. 2024-08-01T07:03:29.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.827+0000 7fc1000a5640 1 -- 172.21.15.16:0/2317897873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f8102fb0 msgr2=0x7fc0f81053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:29.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.827+0000 7fc1000a5640 1 --2- 172.21.15.16:0/2317897873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f8102fb0 0x7fc0f81053a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80098b0 tx=0x7fc0e802a4d0 comp rx=0 tx=0).stop 2024-08-01T07:03:29.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.827+0000 7fc1000a5640 1 -- 172.21.15.16:0/2317897873 shutdown_connections 2024-08-01T07:03:29.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.827+0000 7fc1000a5640 1 --2- 172.21.15.16:0/2317897873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f8102fb0 0x7fc0f81053a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:29.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.827+0000 7fc1000a5640 1 --2- 172.21.15.16:0/2317897873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f8100680 0x7fc0f8102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:29.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.827+0000 7fc1000a5640 1 -- 172.21.15.16:0/2317897873 >> 172.21.15.16:0/2317897873 conn(0x7fc0f80fa280 msgr2=0x7fc0f80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:03:29.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.827+0000 7fc1000a5640 1 -- 172.21.15.16:0/2317897873 shutdown_connections 2024-08-01T07:03:29.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.827+0000 7fc1000a5640 1 -- 172.21.15.16:0/2317897873 wait complete. 2024-08-01T07:03:29.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.828+0000 7fc1000a5640 1 Processor -- start 2024-08-01T07:03:29.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.828+0000 7fc1000a5640 1 -- start start 2024-08-01T07:03:29.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.828+0000 7fc1000a5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f8100680 0x7fc0f80fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:29.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.828+0000 7fc1000a5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f8102fb0 0x7fc0f80fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:29.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.828+0000 7fc1000a5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f80feb70 con 0x7fc0f8100680 2024-08-01T07:03:29.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.828+0000 7fc1000a5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f80fece0 con 0x7fc0f8102fb0 2024-08-01T07:03:29.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.828+0000 7fc0fde41640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f8100680 0x7fc0f80fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:29.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.828+0000 7fc0fde41640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f8100680 0x7fc0f80fffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55150/0 (socket says 172.21.15.16:55150) 2024-08-01T07:03:29.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.828+0000 7fc0fde41640 1 -- 172.21.15.16:0/1443930208 learned_addr learned my addr 172.21.15.16:0/1443930208 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:03:29.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.828+0000 7fc0fd640640 1 --2- 172.21.15.16:0/1443930208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f8102fb0 0x7fc0f80fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:29.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.828+0000 7fc0fde41640 1 -- 172.21.15.16:0/1443930208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f8102fb0 msgr2=0x7fc0f80fe630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:29.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.828+0000 7fc0fde41640 1 --2- 172.21.15.16:0/1443930208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f8102fb0 0x7fc0f80fe630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:29.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.828+0000 7fc0fde41640 1 -- 172.21.15.16:0/1443930208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e8009560 con 0x7fc0f8100680 2024-08-01T07:03:29.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.829+0000 7fc0fd640640 1 --2- 172.21.15.16:0/1443930208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f8102fb0 0x7fc0f80fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-01T07:03:29.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.829+0000 7fc0fde41640 1 --2- 172.21.15.16:0/1443930208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f8100680 0x7fc0f80fffe0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc0f400e970 tx=0x7fc0f400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:03:29.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.829+0000 7fc0eeffd640 1 -- 172.21.15.16:0/1443930208 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0f400cc90 con 0x7fc0f8100680 2024-08-01T07:03:29.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.829+0000 7fc0eeffd640 1 -- 172.21.15.16:0/1443930208 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc0f400cdf0 con 0x7fc0f8100680 2024-08-01T07:03:29.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.829+0000 7fc1000a5640 1 -- 172.21.15.16:0/1443930208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f80fefc0 con 0x7fc0f8100680 2024-08-01T07:03:29.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.829+0000 7fc0eeffd640 1 -- 172.21.15.16:0/1443930208 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0f4010430 con 0x7fc0f8100680 2024-08-01T07:03:29.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.829+0000 7fc1000a5640 1 -- 172.21.15.16:0/1443930208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f819d780 con 0x7fc0f8100680 2024-08-01T07:03:29.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.830+0000 7fc1000a5640 1 -- 172.21.15.16:0/1443930208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f8108800 con 0x7fc0f8100680 2024-08-01T07:03:29.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.831+0000 7fc0eeffd640 1 -- 172.21.15.16:0/1443930208 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc0f40046c0 con 0x7fc0f8100680 2024-08-01T07:03:29.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.831+0000 7fc0eeffd640 1 --2- 172.21.15.16:0/1443930208 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc0e406e170 0x7fc0e4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:29.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.831+0000 7fc0eeffd640 1 -- 172.21.15.16:0/1443930208 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fc0f4014070 con 0x7fc0f8100680 2024-08-01T07:03:29.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.831+0000 7fc0fd640640 1 --2- 172.21.15.16:0/1443930208 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc0e406e170 0x7fc0e4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:29.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.832+0000 7fc0fd640640 1 --2- 172.21.15.16:0/1443930208 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc0e406e170 0x7fc0e4070630 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc0e802a9f0 tx=0x7fc0e8005de0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:03:29.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:29.836+0000 7fc0eeffd640 1 -- 172.21.15.16:0/1443930208 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc0f4057a00 con 0x7fc0f8100680 2024-08-01T07:03:30.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.036+0000 7fc1000a5640 1 -- 172.21.15.16:0/1443930208 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0f8103a50 con 0x7fc0e406e170 2024-08-01T07:03:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.052+0000 7fc0eeffd640 1 -- 172.21.15.16:0/1443930208 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fc0f8103a50 con 0x7fc0e406e170 2024-08-01T07:03:30.053 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T07:03:30.053 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (14m) 17s ago 15m 25.3M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T07:03:30.054 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (15m) 17s ago 15m 9328k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T07:03:30.054 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (14m) 66s ago 14m 8786k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T07:03:30.054 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (4m) 17s ago 15m 6899k - 19.1.0-1223-gf9911e17 93d93c74a2cc 2a96028287a2 2024-08-01T07:03:30.054 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (4m) 66s ago 14m 6895k - 19.1.0-1223-gf9911e17 93d93c74a2cc 8a23341bd6c3 2024-08-01T07:03:30.054 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (13m) 17s ago 15m 85.5M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T07:03:30.054 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (22s) 17s ago 10m 15.2M - 19.1.0-1223-gf9911e17 93d93c74a2cc 2fb78654cbea 2024-08-01T07:03:30.054 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (10m) 17s ago 10m 146M - 18.2.2-1767-ga3bbd728 d280790d1980 4bbe1a388689 2024-08-01T07:03:30.054 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (10m) 66s ago 10m 26.7M - 18.2.2-1767-ga3bbd728 d280790d1980 65ca121a6fbb 2024-08-01T07:03:30.054 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (10m) 66s ago 10m 25.7M - 18.2.2-1767-ga3bbd728 d280790d1980 05bb46c6fe94 2024-08-01T07:03:30.054 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:8443,9283,8765 running (6m) 17s ago 16m 505M - 19.1.0-1223-gf9911e17 93d93c74a2cc 8701e6315593 2024-08-01T07:03:30.054 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (5m) 66s ago 14m 441M - 19.1.0-1223-gf9911e17 93d93c74a2cc c6caa21f436f 2024-08-01T07:03:30.054 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (5m) 17s ago 16m 52.7M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc 48e94d076e6f 2024-08-01T07:03:30.054 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (5m) 66s ago 14m 41.8M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc c4b83b46ff15 2024-08-01T07:03:30.055 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (15m) 17s ago 15m 15.7M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T07:03:30.055 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (14m) 66s ago 14m 16.5M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T07:03:30.055 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (3m) 17s ago 13m 203M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 4c2115ae6222 2024-08-01T07:03:30.055 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (3m) 17s ago 13m 111M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc fc2f7117be30 2024-08-01T07:03:30.055 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (2m) 17s ago 12m 141M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 3364752c9365 2024-08-01T07:03:30.055 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (2m) 66s ago 12m 105M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 9a18feae4353 2024-08-01T07:03:30.055 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (101s) 66s ago 12m 128M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 7c51ba7a636a 2024-08-01T07:03:30.055 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (69s) 66s ago 11m 12.1M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 08ffb10ca1a6 2024-08-01T07:03:30.055 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (5m) 17s ago 15m 69.1M - 2.43.0 a07b618ecd1d 45d23c96382e 2024-08-01T07:03:30.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.054+0000 7fc1000a5640 1 -- 172.21.15.16:0/1443930208 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc0e406e170 msgr2=0x7fc0e4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:30.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.054+0000 7fc1000a5640 1 --2- 172.21.15.16:0/1443930208 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc0e406e170 0x7fc0e4070630 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc0e802a9f0 tx=0x7fc0e8005de0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.054+0000 7fc1000a5640 1 -- 172.21.15.16:0/1443930208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f8100680 msgr2=0x7fc0f80fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:30.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.054+0000 7fc1000a5640 1 --2- 172.21.15.16:0/1443930208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f8100680 0x7fc0f80fffe0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc0f400e970 tx=0x7fc0f400ed70 comp rx=0 tx=0).stop 2024-08-01T07:03:30.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.054+0000 7fc1000a5640 1 -- 172.21.15.16:0/1443930208 shutdown_connections 2024-08-01T07:03:30.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.054+0000 7fc1000a5640 1 --2- 172.21.15.16:0/1443930208 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc0e406e170 0x7fc0e4070630 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.054+0000 7fc1000a5640 1 --2- 172.21.15.16:0/1443930208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f8102fb0 0x7fc0f80fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.054+0000 7fc1000a5640 1 --2- 172.21.15.16:0/1443930208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f8100680 0x7fc0f80fffe0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.054+0000 7fc1000a5640 1 -- 172.21.15.16:0/1443930208 >> 172.21.15.16:0/1443930208 conn(0x7fc0f80fa280 msgr2=0x7fc0f80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:03:30.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.054+0000 7fc1000a5640 1 -- 172.21.15.16:0/1443930208 shutdown_connections 2024-08-01T07:03:30.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.054+0000 7fc1000a5640 1 -- 172.21.15.16:0/1443930208 wait complete. 2024-08-01T07:03:30.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.138+0000 7f9ef744e640 1 -- 172.21.15.16:0/4225953449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ef00feaa0 msgr2=0x7f9ef00feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:30.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.138+0000 7f9ef744e640 1 --2- 172.21.15.16:0/4225953449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ef00feaa0 0x7f9ef00feea0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9eec009880 tx=0x7f9eec02a4a0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.138+0000 7f9ef744e640 1 -- 172.21.15.16:0/4225953449 shutdown_connections 2024-08-01T07:03:30.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.138+0000 7f9ef744e640 1 --2- 172.21.15.16:0/4225953449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ef00ffca0 0x7f9ef0100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.138+0000 7f9ef744e640 1 --2- 172.21.15.16:0/4225953449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ef00feaa0 0x7f9ef00feea0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.138+0000 7f9ef744e640 1 -- 172.21.15.16:0/4225953449 >> 172.21.15.16:0/4225953449 conn(0x7f9ef00fa250 msgr2=0x7f9ef00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:03:30.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.138+0000 7f9ef744e640 1 -- 172.21.15.16:0/4225953449 shutdown_connections 2024-08-01T07:03:30.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.138+0000 7f9ef744e640 1 -- 172.21.15.16:0/4225953449 wait complete. 2024-08-01T07:03:30.141 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:29 smithi016 ceph-mon[93645]: reconnect by client.24325 192.168.0.1:0/1592227876 after 0.000999985 2024-08-01T07:03:30.141 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:29 smithi016 ceph-mon[93645]: reconnect by client.14522 192.168.0.1:0/3418530137 after 0.000999985 2024-08-01T07:03:30.141 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:29 smithi016 ceph-mon[93645]: mds.? [v2:172.21.15.16:6826/4064792079,v1:172.21.15.16:6827/4064792079] up:reconnect 2024-08-01T07:03:30.141 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:29 smithi016 ceph-mon[93645]: fsmap cephfs:1/1 {0=cephfs.smithi016.bgqkxu=up:reconnect} 2 up:standby 2024-08-01T07:03:30.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.139+0000 7f9ef744e640 1 Processor -- start 2024-08-01T07:03:30.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.139+0000 7f9ef744e640 1 -- start start 2024-08-01T07:03:30.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.139+0000 7f9ef744e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ef00feaa0 0x7f9ef0102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:30.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.139+0000 7f9ef744e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ef00ffca0 0x7f9ef0101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:30.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.139+0000 7f9ef744e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef0102f70 con 0x7f9ef00ffca0 2024-08-01T07:03:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.139+0000 7f9ef744e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef01015f0 con 0x7f9ef00feaa0 2024-08-01T07:03:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.140+0000 7f9ef49e9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ef00ffca0 0x7f9ef0101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.140+0000 7f9ef49e9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ef00ffca0 0x7f9ef0101080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55178/0 (socket says 172.21.15.16:55178) 2024-08-01T07:03:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.140+0000 7f9ef49e9640 1 -- 172.21.15.16:0/2316656153 learned_addr learned my addr 172.21.15.16:0/2316656153 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:03:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.140+0000 7f9ef51ea640 1 --2- 172.21.15.16:0/2316656153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ef00feaa0 0x7f9ef0102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.140+0000 7f9ef49e9640 1 -- 172.21.15.16:0/2316656153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ef00feaa0 msgr2=0x7f9ef0102a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.140+0000 7f9ef49e9640 1 --2- 172.21.15.16:0/2316656153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ef00feaa0 0x7f9ef0102a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.140+0000 7f9ef49e9640 1 -- 172.21.15.16:0/2316656153 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec009560 con 0x7f9ef00ffca0 2024-08-01T07:03:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.140+0000 7f9ef49e9640 1 --2- 172.21.15.16:0/2316656153 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ef00ffca0 0x7f9ef0101080 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000c8a0 tx=0x7f9ee000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:03:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.140+0000 7f9ee67fc640 1 -- 172.21.15.16:0/2316656153 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ee0007b80 con 0x7f9ef00ffca0 2024-08-01T07:03:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.140+0000 7f9ee67fc640 1 -- 172.21.15.16:0/2316656153 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ee0007ce0 con 0x7f9ef00ffca0 2024-08-01T07:03:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.140+0000 7f9ef744e640 1 -- 172.21.15.16:0/2316656153 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef01018d0 con 0x7f9ef00ffca0 2024-08-01T07:03:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.140+0000 7f9ee67fc640 1 -- 172.21.15.16:0/2316656153 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ee0018810 con 0x7f9ef00ffca0 2024-08-01T07:03:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.140+0000 7f9ef744e640 1 -- 172.21.15.16:0/2316656153 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef0101ea0 con 0x7f9ef00ffca0 2024-08-01T07:03:30.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.141+0000 7f9ef744e640 1 -- 172.21.15.16:0/2316656153 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef0107690 con 0x7f9ef00ffca0 2024-08-01T07:03:30.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.142+0000 7f9ee67fc640 1 -- 172.21.15.16:0/2316656153 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9ee000f450 con 0x7f9ef00ffca0 2024-08-01T07:03:30.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.142+0000 7f9ee67fc640 1 --2- 172.21.15.16:0/2316656153 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9edc06e170 0x7f9edc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:30.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.143+0000 7f9ee67fc640 1 -- 172.21.15.16:0/2316656153 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f9ee008e4a0 con 0x7f9ef00ffca0 2024-08-01T07:03:30.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.143+0000 7f9ef51ea640 1 --2- 172.21.15.16:0/2316656153 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9edc06e170 0x7f9edc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:30.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.143+0000 7f9ef51ea640 1 --2- 172.21.15.16:0/2316656153 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9edc06e170 0x7f9edc070630 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9eec009230 tx=0x7f9eec005b50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:03:30.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.147+0000 7f9ee67fc640 1 -- 172.21.15.16:0/2316656153 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9ee0057660 con 0x7f9ef00ffca0 2024-08-01T07:03:30.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:29 smithi089 ceph-mon[82218]: reconnect by client.24325 192.168.0.1:0/1592227876 after 0.000999985 2024-08-01T07:03:30.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:29 smithi089 ceph-mon[82218]: reconnect by client.14522 192.168.0.1:0/3418530137 after 0.000999985 2024-08-01T07:03:30.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:29 smithi089 ceph-mon[82218]: mds.? [v2:172.21.15.16:6826/4064792079,v1:172.21.15.16:6827/4064792079] up:reconnect 2024-08-01T07:03:30.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:29 smithi089 ceph-mon[82218]: fsmap cephfs:1/1 {0=cephfs.smithi016.bgqkxu=up:reconnect} 2 up:standby 2024-08-01T07:03:30.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.401+0000 7f9ef744e640 1 -- 172.21.15.16:0/2316656153 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9ef0107820 con 0x7f9ef00ffca0 2024-08-01T07:03:30.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.401+0000 7f9ee67fc640 1 -- 172.21.15.16:0/2316656153 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+830 (secure 0 0 0) 0x7f9ee005ad20 con 0x7f9ef00ffca0 2024-08-01T07:03:30.403 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:03:30.403 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T07:03:30.403 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:03:30.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:03:30.403 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T07:03:30.403 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:03:30.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:03:30.404 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T07:03:30.404 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 6 2024-08-01T07:03:30.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:03:30.404 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T07:03:30.404 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 2, 2024-08-01T07:03:30.404 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 1 2024-08-01T07:03:30.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:03:30.404 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T07:03:30.404 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 18.2.2-1767-ga3bbd728 (a3bbd7289877bdcce87fd1f79da1a2d6578dde36) reef (stable)": 2, 2024-08-01T07:03:30.404 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 11 2024-08-01T07:03:30.404 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T07:03:30.404 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:03:30.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.403+0000 7f9ef744e640 1 -- 172.21.15.16:0/2316656153 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9edc06e170 msgr2=0x7f9edc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:30.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.403+0000 7f9ef744e640 1 --2- 172.21.15.16:0/2316656153 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9edc06e170 0x7f9edc070630 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9eec009230 tx=0x7f9eec005b50 comp rx=0 tx=0).stop 2024-08-01T07:03:30.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.403+0000 7f9ef744e640 1 -- 172.21.15.16:0/2316656153 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ef00ffca0 msgr2=0x7f9ef0101080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:30.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.403+0000 7f9ef744e640 1 --2- 172.21.15.16:0/2316656153 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ef00ffca0 0x7f9ef0101080 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000c8a0 tx=0x7f9ee000cd60 comp rx=0 tx=0).stop 2024-08-01T07:03:30.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.403+0000 7f9ef744e640 1 -- 172.21.15.16:0/2316656153 shutdown_connections 2024-08-01T07:03:30.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.403+0000 7f9ef744e640 1 --2- 172.21.15.16:0/2316656153 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9edc06e170 0x7f9edc070630 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.403+0000 7f9ef744e640 1 --2- 172.21.15.16:0/2316656153 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ef00ffca0 0x7f9ef0101080 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.403+0000 7f9ef744e640 1 --2- 172.21.15.16:0/2316656153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ef00feaa0 0x7f9ef0102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.404+0000 7f9ef744e640 1 -- 172.21.15.16:0/2316656153 >> 172.21.15.16:0/2316656153 conn(0x7f9ef00fa250 msgr2=0x7f9ef00684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:03:30.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.404+0000 7f9ef744e640 1 -- 172.21.15.16:0/2316656153 shutdown_connections 2024-08-01T07:03:30.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.404+0000 7f9ef744e640 1 -- 172.21.15.16:0/2316656153 wait complete. 2024-08-01T07:03:30.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.487+0000 7f20b3c86640 1 -- 172.21.15.16:0/2336649238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20ac0ffca0 msgr2=0x7f20ac100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:30.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.487+0000 7f20b3c86640 1 --2- 172.21.15.16:0/2336649238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20ac0ffca0 0x7f20ac100120 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f209c009880 tx=0x7f209c02a4a0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.487+0000 7f20b3c86640 1 -- 172.21.15.16:0/2336649238 shutdown_connections 2024-08-01T07:03:30.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.487+0000 7f20b3c86640 1 --2- 172.21.15.16:0/2336649238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20ac0ffca0 0x7f20ac100120 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.487+0000 7f20b3c86640 1 --2- 172.21.15.16:0/2336649238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20ac0feaa0 0x7f20ac0feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.487+0000 7f20b3c86640 1 -- 172.21.15.16:0/2336649238 >> 172.21.15.16:0/2336649238 conn(0x7f20ac0fa250 msgr2=0x7f20ac0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:03:30.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.487+0000 7f20b3c86640 1 -- 172.21.15.16:0/2336649238 shutdown_connections 2024-08-01T07:03:30.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.487+0000 7f20b3c86640 1 -- 172.21.15.16:0/2336649238 wait complete. 2024-08-01T07:03:30.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.488+0000 7f20b3c86640 1 Processor -- start 2024-08-01T07:03:30.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.488+0000 7f20b3c86640 1 -- start start 2024-08-01T07:03:30.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.488+0000 7f20b3c86640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20ac0feaa0 0x7f20ac195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:30.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.488+0000 7f20b3c86640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20ac0ffca0 0x7f20ac195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:30.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.488+0000 7f20b3c86640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac196160 con 0x7f20ac0feaa0 2024-08-01T07:03:30.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.488+0000 7f20b3c86640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac1962d0 con 0x7f20ac0ffca0 2024-08-01T07:03:30.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.488+0000 7f20b1a22640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20ac0feaa0 0x7f20ac195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:30.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.488+0000 7f20b1a22640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20ac0feaa0 0x7f20ac195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55190/0 (socket says 172.21.15.16:55190) 2024-08-01T07:03:30.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.488+0000 7f20b1a22640 1 -- 172.21.15.16:0/2151110853 learned_addr learned my addr 172.21.15.16:0/2151110853 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:03:30.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.489+0000 7f20b1a22640 1 -- 172.21.15.16:0/2151110853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20ac0ffca0 msgr2=0x7f20ac195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:30.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.489+0000 7f20b1221640 1 --2- 172.21.15.16:0/2151110853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20ac0ffca0 0x7f20ac195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:30.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.489+0000 7f20b1a22640 1 --2- 172.21.15.16:0/2151110853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20ac0ffca0 0x7f20ac195b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.489+0000 7f20b1a22640 1 -- 172.21.15.16:0/2151110853 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c009560 con 0x7f20ac0feaa0 2024-08-01T07:03:30.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.489+0000 7f20b1a22640 1 --2- 172.21.15.16:0/2151110853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20ac0feaa0 0x7f20ac195650 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f20a800c920 tx=0x7f20a800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:03:30.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.489+0000 7f20a2ffd640 1 -- 172.21.15.16:0/2151110853 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a80041f0 con 0x7f20ac0feaa0 2024-08-01T07:03:30.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.489+0000 7f20a2ffd640 1 -- 172.21.15.16:0/2151110853 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20a8007e70 con 0x7f20ac0feaa0 2024-08-01T07:03:30.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.489+0000 7f20b3c86640 1 -- 172.21.15.16:0/2151110853 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ac19ad70 con 0x7f20ac0feaa0 2024-08-01T07:03:30.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.489+0000 7f20a2ffd640 1 -- 172.21.15.16:0/2151110853 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a80049d0 con 0x7f20ac0feaa0 2024-08-01T07:03:30.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.489+0000 7f20b3c86640 1 -- 172.21.15.16:0/2151110853 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ac19b2e0 con 0x7f20ac0feaa0 2024-08-01T07:03:30.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.490+0000 7f20b3c86640 1 -- 172.21.15.16:0/2151110853 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ac1076b0 con 0x7f20ac0feaa0 2024-08-01T07:03:30.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.491+0000 7f20a2ffd640 1 -- 172.21.15.16:0/2151110853 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f20a8004350 con 0x7f20ac0feaa0 2024-08-01T07:03:30.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.491+0000 7f20a2ffd640 1 --2- 172.21.15.16:0/2151110853 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f209806e180 0x7f2098070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:30.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.491+0000 7f20a2ffd640 1 -- 172.21.15.16:0/2151110853 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f20a808dfb0 con 0x7f20ac0feaa0 2024-08-01T07:03:30.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.491+0000 7f20b1221640 1 --2- 172.21.15.16:0/2151110853 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f209806e180 0x7f2098070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:30.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.492+0000 7f20b1221640 1 --2- 172.21.15.16:0/2151110853 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f209806e180 0x7f2098070640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f209c02a9c0 tx=0x7f209c000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:03:30.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.496+0000 7f20a2ffd640 1 -- 172.21.15.16:0/2151110853 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f20a80571f0 con 0x7f20ac0feaa0 2024-08-01T07:03:30.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.715+0000 7f20b3c86640 1 -- 172.21.15.16:0/2151110853 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f20ac19b5b0 con 0x7f20ac0feaa0 2024-08-01T07:03:30.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.716+0000 7f20a2ffd640 1 -- 172.21.15.16:0/2151110853 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1786 (secure 0 0 0) 0x7f20a801d070 con 0x7f20ac0feaa0 2024-08-01T07:03:30.718 INFO:teuthology.orchestra.run.smithi016.stdout:e29 2024-08-01T07:03:30.718 INFO:teuthology.orchestra.run.smithi016.stdout:btime 2024-08-01T07:03:29:970798+0000 2024-08-01T07:03:30.718 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T07:03:30.718 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T07:03:30.718 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T07:03:30.718 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:03:30.718 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T07:03:30.718 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T07:03:30.719 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 29 2024-08-01T07:03:30.719 INFO:teuthology.orchestra.run.smithi016.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-01T07:03:30.719 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T07:03:30.719 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T07:03:28.973191+0000 2024-08-01T07:03:30.719 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T07:03:30.719 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T07:03:30.719 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T07:03:30.719 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T07:03:30.719 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T07:03:30.719 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T07:03:30.720 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T07:03:30.720 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T07:03:30.720 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 94 2024-08-01T07:03:30.720 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-01T07:03:30.720 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 1 2024-08-01T07:03:30.720 INFO:teuthology.orchestra.run.smithi016.stdout:in 0 2024-08-01T07:03:30.720 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=34414} 2024-08-01T07:03:30.720 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T07:03:30.720 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T07:03:30.720 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 1 2024-08-01T07:03:30.720 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T07:03:30.721 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T07:03:30.721 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T07:03:30.721 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T07:03:30.721 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T07:03:30.721 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T07:03:30.721 INFO:teuthology.orchestra.run.smithi016.stdout:qdb_cluster leader: 0 members: 2024-08-01T07:03:30.721 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:34414} state up:rejoin seq 8 join_fscid=1 addr [v2:172.21.15.16:6826/4064792079,v1:172.21.15.16:6827/4064792079] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:03:30.721 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:03:30.721 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:03:30.721 INFO:teuthology.orchestra.run.smithi016.stdout:Standby daemons: 2024-08-01T07:03:30.721 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:03:30.721 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{-1:44307} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/3851713020,v1:172.21.15.89:6827/3851713020] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:03:30.722 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{-1:44311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6824/2498996985,v1:172.21.15.89:6825/2498996985] compat {c=[1],r=[1],i=[7ff]}] 2024-08-01T07:03:30.722 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 29 2024-08-01T07:03:30.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.718+0000 7f20b3c86640 1 -- 172.21.15.16:0/2151110853 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f209806e180 msgr2=0x7f2098070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:30.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.718+0000 7f20b3c86640 1 --2- 172.21.15.16:0/2151110853 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f209806e180 0x7f2098070640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f209c02a9c0 tx=0x7f209c000bc0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.718+0000 7f20b3c86640 1 -- 172.21.15.16:0/2151110853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20ac0feaa0 msgr2=0x7f20ac195650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:30.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.718+0000 7f20b3c86640 1 --2- 172.21.15.16:0/2151110853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20ac0feaa0 0x7f20ac195650 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f20a800c920 tx=0x7f20a800cde0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.718+0000 7f20b3c86640 1 -- 172.21.15.16:0/2151110853 shutdown_connections 2024-08-01T07:03:30.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.718+0000 7f20b3c86640 1 --2- 172.21.15.16:0/2151110853 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f209806e180 0x7f2098070640 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.718+0000 7f20b3c86640 1 --2- 172.21.15.16:0/2151110853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20ac0ffca0 0x7f20ac195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.718+0000 7f20b3c86640 1 --2- 172.21.15.16:0/2151110853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20ac0feaa0 0x7f20ac195650 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.718+0000 7f20b3c86640 1 -- 172.21.15.16:0/2151110853 >> 172.21.15.16:0/2151110853 conn(0x7f20ac0fa250 msgr2=0x7f20ac068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:03:30.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.718+0000 7f20b3c86640 1 -- 172.21.15.16:0/2151110853 shutdown_connections 2024-08-01T07:03:30.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.718+0000 7f20b3c86640 1 -- 172.21.15.16:0/2151110853 wait complete. 2024-08-01T07:03:30.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.804+0000 7f8ac6fc9640 1 -- 172.21.15.16:0/3537706452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac0102fb0 msgr2=0x7f8ac01053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:30.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.804+0000 7f8ac6fc9640 1 --2- 172.21.15.16:0/3537706452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac0102fb0 0x7f8ac01053a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40098b0 tx=0x7f8ab402a4d0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.804+0000 7f8ac6fc9640 1 -- 172.21.15.16:0/3537706452 shutdown_connections 2024-08-01T07:03:30.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.804+0000 7f8ac6fc9640 1 --2- 172.21.15.16:0/3537706452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac0102fb0 0x7f8ac01053a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.804+0000 7f8ac6fc9640 1 --2- 172.21.15.16:0/3537706452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ac0100680 0x7f8ac0102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.804+0000 7f8ac6fc9640 1 -- 172.21.15.16:0/3537706452 >> 172.21.15.16:0/3537706452 conn(0x7f8ac00fa280 msgr2=0x7f8ac00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:03:30.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.804+0000 7f8ac6fc9640 1 -- 172.21.15.16:0/3537706452 shutdown_connections 2024-08-01T07:03:30.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.804+0000 7f8ac6fc9640 1 -- 172.21.15.16:0/3537706452 wait complete. 2024-08-01T07:03:30.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.804+0000 7f8ac6fc9640 1 Processor -- start 2024-08-01T07:03:30.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.804+0000 7f8ac6fc9640 1 -- start start 2024-08-01T07:03:30.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.804+0000 7f8ac6fc9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac0100680 0x7f8ac00fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:30.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.805+0000 7f8ac6fc9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ac0102fb0 0x7f8ac00fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:30.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.805+0000 7f8ac6fc9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac00feb70 con 0x7f8ac0100680 2024-08-01T07:03:30.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.805+0000 7f8ac6fc9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac00fece0 con 0x7f8ac0102fb0 2024-08-01T07:03:30.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.805+0000 7f8ac4d65640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac0100680 0x7f8ac00fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:30.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.805+0000 7f8ac4d65640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac0100680 0x7f8ac00fffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55212/0 (socket says 172.21.15.16:55212) 2024-08-01T07:03:30.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.805+0000 7f8ac4d65640 1 -- 172.21.15.16:0/2492859198 learned_addr learned my addr 172.21.15.16:0/2492859198 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:03:30.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.805+0000 7f8abffff640 1 --2- 172.21.15.16:0/2492859198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ac0102fb0 0x7f8ac00fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:30.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.805+0000 7f8ac4d65640 1 -- 172.21.15.16:0/2492859198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ac0102fb0 msgr2=0x7f8ac00fe630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:30.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.805+0000 7f8ac4d65640 1 --2- 172.21.15.16:0/2492859198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ac0102fb0 0x7f8ac00fe630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:30.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.805+0000 7f8ac4d65640 1 -- 172.21.15.16:0/2492859198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab4009560 con 0x7f8ac0100680 2024-08-01T07:03:30.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.805+0000 7f8ac4d65640 1 --2- 172.21.15.16:0/2492859198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac0100680 0x7f8ac00fffe0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000c8f0 tx=0x7f8ab000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:03:30.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.805+0000 7f8abdffb640 1 -- 172.21.15.16:0/2492859198 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ab0007b80 con 0x7f8ac0100680 2024-08-01T07:03:30.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.805+0000 7f8abdffb640 1 -- 172.21.15.16:0/2492859198 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ab00054e0 con 0x7f8ac0100680 2024-08-01T07:03:30.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.805+0000 7f8ac6fc9640 1 -- 172.21.15.16:0/2492859198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac00fefc0 con 0x7f8ac0100680 2024-08-01T07:03:30.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.805+0000 7f8abdffb640 1 -- 172.21.15.16:0/2492859198 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ab000f450 con 0x7f8ac0100680 2024-08-01T07:03:30.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.806+0000 7f8ac6fc9640 1 -- 172.21.15.16:0/2492859198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac019d780 con 0x7f8ac0100680 2024-08-01T07:03:30.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.807+0000 7f8ac6fc9640 1 -- 172.21.15.16:0/2492859198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac0109160 con 0x7f8ac0100680 2024-08-01T07:03:30.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.807+0000 7f8abdffb640 1 -- 172.21.15.16:0/2492859198 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8ab0004f60 con 0x7f8ac0100680 2024-08-01T07:03:30.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.808+0000 7f8abdffb640 1 --2- 172.21.15.16:0/2492859198 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f8aa806e170 0x7f8aa8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:30.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.808+0000 7f8abdffb640 1 -- 172.21.15.16:0/2492859198 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f8ab008e110 con 0x7f8ac0100680 2024-08-01T07:03:30.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.808+0000 7f8abffff640 1 --2- 172.21.15.16:0/2492859198 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f8aa806e170 0x7f8aa8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:30.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.808+0000 7f8abffff640 1 --2- 172.21.15.16:0/2492859198 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f8aa806e170 0x7f8aa8070630 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009880 tx=0x7f8ab4005b50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:03:30.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:30.812+0000 7f8abdffb640 1 -- 172.21.15.16:0/2492859198 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8ab00572d0 con 0x7f8ac0100680 2024-08-01T07:03:31.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.006+0000 7f8ac6fc9640 1 -- 172.21.15.16:0/2492859198 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ac0103a50 con 0x7f8aa806e170 2024-08-01T07:03:31.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.007+0000 7f8abdffb640 1 -- 172.21.15.16:0/2492859198 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8ac0103a50 con 0x7f8aa806e170 2024-08-01T07:03:31.009 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:03:31.009 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T07:03:31.009 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T07:03:31.009 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T07:03:31.009 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-08-01T07:03:31.009 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-08-01T07:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr", 2024-08-01T07:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: "osd", 2024-08-01T07:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: "crash" 2024-08-01T07:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-08-01T07:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "13/23 daemons upgraded", 2024-08-01T07:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading mds daemons", 2024-08-01T07:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T07:03:31.010 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:03:31.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.010+0000 7f8ac6fc9640 1 -- 172.21.15.16:0/2492859198 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f8aa806e170 msgr2=0x7f8aa8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:31.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.010+0000 7f8ac6fc9640 1 --2- 172.21.15.16:0/2492859198 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f8aa806e170 0x7f8aa8070630 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009880 tx=0x7f8ab4005b50 comp rx=0 tx=0).stop 2024-08-01T07:03:31.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.010+0000 7f8ac6fc9640 1 -- 172.21.15.16:0/2492859198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac0100680 msgr2=0x7f8ac00fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:31.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.010+0000 7f8ac6fc9640 1 --2- 172.21.15.16:0/2492859198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac0100680 0x7f8ac00fffe0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000c8f0 tx=0x7f8ab000cdb0 comp rx=0 tx=0).stop 2024-08-01T07:03:31.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.010+0000 7f8ac6fc9640 1 -- 172.21.15.16:0/2492859198 shutdown_connections 2024-08-01T07:03:31.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.010+0000 7f8ac6fc9640 1 --2- 172.21.15.16:0/2492859198 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f8aa806e170 0x7f8aa8070630 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:31.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.010+0000 7f8ac6fc9640 1 --2- 172.21.15.16:0/2492859198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ac0102fb0 0x7f8ac00fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:31.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.010+0000 7f8ac6fc9640 1 --2- 172.21.15.16:0/2492859198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac0100680 0x7f8ac00fffe0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:31.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.010+0000 7f8ac6fc9640 1 -- 172.21.15.16:0/2492859198 >> 172.21.15.16:0/2492859198 conn(0x7f8ac00fa280 msgr2=0x7f8ac00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:03:31.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.010+0000 7f8ac6fc9640 1 -- 172.21.15.16:0/2492859198 shutdown_connections 2024-08-01T07:03:31.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.010+0000 7f8ac6fc9640 1 -- 172.21.15.16:0/2492859198 wait complete. 2024-08-01T07:03:31.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.094+0000 7fe1a05fc640 1 -- 172.21.15.16:0/3664988344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe198100d90 msgr2=0x7fe198101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:31.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.094+0000 7fe1a05fc640 1 --2- 172.21.15.16:0/3664988344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe198100d90 0x7fe198101210 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe188009880 tx=0x7fe18802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:03:31.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.094+0000 7fe1a05fc640 1 -- 172.21.15.16:0/3664988344 shutdown_connections 2024-08-01T07:03:31.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.094+0000 7fe1a05fc640 1 --2- 172.21.15.16:0/3664988344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe198100d90 0x7fe198101210 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:31.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.094+0000 7fe1a05fc640 1 --2- 172.21.15.16:0/3664988344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1980ffb90 0x7fe1980fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:31.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.094+0000 7fe1a05fc640 1 -- 172.21.15.16:0/3664988344 >> 172.21.15.16:0/3664988344 conn(0x7fe1980fb320 msgr2=0x7fe1980fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:03:31.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.095+0000 7fe1a05fc640 1 -- 172.21.15.16:0/3664988344 shutdown_connections 2024-08-01T07:03:31.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.095+0000 7fe1a05fc640 1 -- 172.21.15.16:0/3664988344 wait complete. 2024-08-01T07:03:31.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.095+0000 7fe1a05fc640 1 Processor -- start 2024-08-01T07:03:31.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.095+0000 7fe1a05fc640 1 -- start start 2024-08-01T07:03:31.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.095+0000 7fe1a05fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1980ffb90 0x7fe198074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:31.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.095+0000 7fe1a05fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe198100d90 0x7fe1980728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:31.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.095+0000 7fe1a05fc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe198072de0 con 0x7fe1980ffb90 2024-08-01T07:03:31.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.095+0000 7fe1a05fc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe198072f50 con 0x7fe198100d90 2024-08-01T07:03:31.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.095+0000 7fe19e398640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1980ffb90 0x7fe198074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:31.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.095+0000 7fe19e398640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1980ffb90 0x7fe198074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55226/0 (socket says 172.21.15.16:55226) 2024-08-01T07:03:31.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.095+0000 7fe19e398640 1 -- 172.21.15.16:0/2667916239 learned_addr learned my addr 172.21.15.16:0/2667916239 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:03:31.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.096+0000 7fe19db97640 1 --2- 172.21.15.16:0/2667916239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe198100d90 0x7fe1980728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:31.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.096+0000 7fe19e398640 1 -- 172.21.15.16:0/2667916239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe198100d90 msgr2=0x7fe1980728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:31.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.096+0000 7fe19e398640 1 --2- 172.21.15.16:0/2667916239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe198100d90 0x7fe1980728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:31.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.096+0000 7fe19e398640 1 -- 172.21.15.16:0/2667916239 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe188009560 con 0x7fe1980ffb90 2024-08-01T07:03:31.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.096+0000 7fe19e398640 1 --2- 172.21.15.16:0/2667916239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1980ffb90 0x7fe198074250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe19400d8d0 tx=0x7fe19400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:03:31.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.096+0000 7fe18f7fe640 1 -- 172.21.15.16:0/2667916239 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe19400bea0 con 0x7fe1980ffb90 2024-08-01T07:03:31.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.096+0000 7fe18f7fe640 1 -- 172.21.15.16:0/2667916239 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe194009c00 con 0x7fe1980ffb90 2024-08-01T07:03:31.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.096+0000 7fe1a05fc640 1 -- 172.21.15.16:0/2667916239 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe198073230 con 0x7fe1980ffb90 2024-08-01T07:03:31.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.096+0000 7fe18f7fe640 1 -- 172.21.15.16:0/2667916239 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe19400f790 con 0x7fe1980ffb90 2024-08-01T07:03:31.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.096+0000 7fe1a05fc640 1 -- 172.21.15.16:0/2667916239 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe198073700 con 0x7fe1980ffb90 2024-08-01T07:03:31.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.097+0000 7fe1a05fc640 1 -- 172.21.15.16:0/2667916239 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1980fff90 con 0x7fe1980ffb90 2024-08-01T07:03:31.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.098+0000 7fe18f7fe640 1 -- 172.21.15.16:0/2667916239 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe19400fa50 con 0x7fe1980ffb90 2024-08-01T07:03:31.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.098+0000 7fe18f7fe640 1 --2- 172.21.15.16:0/2667916239 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fe18406e180 0x7fe184070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:03:31.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.098+0000 7fe18f7fe640 1 -- 172.21.15.16:0/2667916239 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fe19408e300 con 0x7fe1980ffb90 2024-08-01T07:03:31.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.098+0000 7fe19db97640 1 --2- 172.21.15.16:0/2667916239 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fe18406e180 0x7fe184070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:03:31.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.099+0000 7fe19db97640 1 --2- 172.21.15.16:0/2667916239 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fe18406e180 0x7fe184070640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe188000c00 tx=0x7fe188005d90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:03:31.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.103+0000 7fe18f7fe640 1 -- 172.21.15.16:0/2667916239 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe1940574c0 con 0x7fe1980ffb90 2024-08-01T07:03:31.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.386+0000 7fe1a05fc640 1 -- 172.21.15.16:0/2667916239 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe198108780 con 0x7fe1980ffb90 2024-08-01T07:03:31.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:30 smithi089 ceph-mon[82218]: pgmap v204: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-08-01T07:03:31.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:30 smithi089 ceph-mon[82218]: from='client.44337 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:03:31.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:30 smithi089 ceph-mon[82218]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:03:31.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:30 smithi089 ceph-mon[82218]: mds.? [v2:172.21.15.16:6826/4064792079,v1:172.21.15.16:6827/4064792079] up:rejoin 2024-08-01T07:03:31.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:30 smithi089 ceph-mon[82218]: fsmap cephfs:1/1 {0=cephfs.smithi016.bgqkxu=up:rejoin} 2 up:standby 2024-08-01T07:03:31.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:30 smithi089 ceph-mon[82218]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:03:31.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:30 smithi089 ceph-mon[82218]: daemon mds.cephfs.smithi016.bgqkxu is now active in filesystem cephfs as rank 0 2024-08-01T07:03:31.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:30 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2316656153' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:31.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:30 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2151110853' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:03:31.389 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:30 smithi016 ceph-mon[93645]: pgmap v204: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-08-01T07:03:31.389 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:31 smithi016 ceph-mon[93645]: from='client.44337 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:03:31.389 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:31 smithi016 ceph-mon[93645]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:03:31.389 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:31 smithi016 ceph-mon[93645]: mds.? [v2:172.21.15.16:6826/4064792079,v1:172.21.15.16:6827/4064792079] up:rejoin 2024-08-01T07:03:31.389 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:31 smithi016 ceph-mon[93645]: fsmap cephfs:1/1 {0=cephfs.smithi016.bgqkxu=up:rejoin} 2 up:standby 2024-08-01T07:03:31.389 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:31 smithi016 ceph-mon[93645]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:03:31.389 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:31 smithi016 ceph-mon[93645]: daemon mds.cephfs.smithi016.bgqkxu is now active in filesystem cephfs as rank 0 2024-08-01T07:03:31.389 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:31 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2316656153' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:31.390 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:31 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2151110853' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:03:31.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.386+0000 7fe18f7fe640 1 -- 172.21.15.16:0/2667916239 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe19405ab80 con 0x7fe1980ffb90 2024-08-01T07:03:31.390 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-08-01T07:03:31.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.388+0000 7fe1a05fc640 1 -- 172.21.15.16:0/2667916239 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fe18406e180 msgr2=0x7fe184070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:31.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.388+0000 7fe1a05fc640 1 --2- 172.21.15.16:0/2667916239 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fe18406e180 0x7fe184070640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe188000c00 tx=0x7fe188005d90 comp rx=0 tx=0).stop 2024-08-01T07:03:31.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.388+0000 7fe1a05fc640 1 -- 172.21.15.16:0/2667916239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1980ffb90 msgr2=0x7fe198074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:03:31.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.388+0000 7fe1a05fc640 1 --2- 172.21.15.16:0/2667916239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1980ffb90 0x7fe198074250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe19400d8d0 tx=0x7fe19400dd90 comp rx=0 tx=0).stop 2024-08-01T07:03:31.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.388+0000 7fe1a05fc640 1 -- 172.21.15.16:0/2667916239 shutdown_connections 2024-08-01T07:03:31.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.388+0000 7fe1a05fc640 1 --2- 172.21.15.16:0/2667916239 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fe18406e180 0x7fe184070640 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:31.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.388+0000 7fe1a05fc640 1 --2- 172.21.15.16:0/2667916239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe198100d90 0x7fe1980728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:31.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.388+0000 7fe1a05fc640 1 --2- 172.21.15.16:0/2667916239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1980ffb90 0x7fe198074250 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:03:31.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.388+0000 7fe1a05fc640 1 -- 172.21.15.16:0/2667916239 >> 172.21.15.16:0/2667916239 conn(0x7fe1980fb320 msgr2=0x7fe1980fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:03:31.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.388+0000 7fe1a05fc640 1 -- 172.21.15.16:0/2667916239 shutdown_connections 2024-08-01T07:03:31.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:03:31.388+0000 7fe1a05fc640 1 -- 172.21.15.16:0/2667916239 wait complete. 2024-08-01T07:03:32.252 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:31 smithi016 ceph-mon[93645]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-01T07:03:32.252 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:31 smithi016 ceph-mon[93645]: Cluster is now healthy 2024-08-01T07:03:32.252 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:31 smithi016 ceph-mon[93645]: mds.? [v2:172.21.15.16:6826/4064792079,v1:172.21.15.16:6827/4064792079] up:active 2024-08-01T07:03:32.253 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:31 smithi016 ceph-mon[93645]: fsmap cephfs:1 {0=cephfs.smithi016.bgqkxu=up:active} 2 up:standby 2024-08-01T07:03:32.253 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:31 smithi016 ceph-mon[93645]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:03:32.253 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:31 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2667916239' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:03:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:31 smithi089 ceph-mon[82218]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-01T07:03:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:31 smithi089 ceph-mon[82218]: Cluster is now healthy 2024-08-01T07:03:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:31 smithi089 ceph-mon[82218]: mds.? [v2:172.21.15.16:6826/4064792079,v1:172.21.15.16:6827/4064792079] up:active 2024-08-01T07:03:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:31 smithi089 ceph-mon[82218]: fsmap cephfs:1 {0=cephfs.smithi016.bgqkxu=up:active} 2 up:standby 2024-08-01T07:03:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:31 smithi089 ceph-mon[82218]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:03:32.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:31 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2667916239' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:03:33.324 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:33 smithi016 ceph-mon[93645]: pgmap v205: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-08-01T07:03:33.324 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:33 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:03:33.324 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:33 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:33.324 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:33 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:33.324 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:33 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:03:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:33 smithi089 ceph-mon[82218]: pgmap v205: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-08-01T07:03:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:33 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:03:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:33 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:33 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:33 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:03:34.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:34 smithi016 ceph-mon[93645]: mds.? [v2:172.21.15.16:6828/2186852070,v1:172.21.15.16:6829/2186852070] up:boot 2024-08-01T07:03:34.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:34 smithi016 ceph-mon[93645]: fsmap cephfs:1 {0=cephfs.smithi016.bgqkxu=up:active} 3 up:standby 2024-08-01T07:03:34.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:34 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.fziqod"}]: dispatch 2024-08-01T07:03:34.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:34 smithi089 ceph-mon[82218]: mds.? [v2:172.21.15.16:6828/2186852070,v1:172.21.15.16:6829/2186852070] up:boot 2024-08-01T07:03:34.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:34 smithi089 ceph-mon[82218]: fsmap cephfs:1 {0=cephfs.smithi016.bgqkxu=up:active} 3 up:standby 2024-08-01T07:03:34.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:34 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi016.fziqod"}]: dispatch 2024-08-01T07:03:35.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:35 smithi016 ceph-mon[93645]: pgmap v206: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 6 op/s 2024-08-01T07:03:35.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:35 smithi089 ceph-mon[82218]: pgmap v206: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 6 op/s 2024-08-01T07:03:37.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:37 smithi089 ceph-mon[82218]: pgmap v207: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-08-01T07:03:37.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:37 smithi016 ceph-mon[93645]: pgmap v207: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-08-01T07:03:38.965 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:38 smithi016 ceph-mon[93645]: pgmap v208: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-08-01T07:03:38.965 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:38 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:38.965 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:38 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:38.965 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:38 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:38.965 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:38 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:39.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:38 smithi089 ceph-mon[82218]: pgmap v208: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-08-01T07:03:39.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:38 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:39.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:38 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:39.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:38 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:39.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:38 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:40.931 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:40 smithi016 ceph-mon[93645]: pgmap v209: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 4.2 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-08-01T07:03:40.940 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:40 smithi089 ceph-mon[82218]: pgmap v209: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 4.2 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-08-01T07:03:43.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:42 smithi089 ceph-mon[82218]: pgmap v210: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-08-01T07:03:43.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:42 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:43.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:42 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:43.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:42 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:03:43.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:42 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:03:43.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:42 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:43.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:42 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:03:43.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:42 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:43.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:42 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:43.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:42 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:43.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:42 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:43.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:42 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi089.jhouje"]}]: dispatch 2024-08-01T07:03:43.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:42 smithi089 ceph-mon[82218]: Upgrade: It appears safe to stop mds.cephfs.smithi089.jhouje 2024-08-01T07:03:43.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:42 smithi016 ceph-mon[93645]: pgmap v210: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-08-01T07:03:43.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:42 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:43.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:42 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:43.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:42 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:03:43.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:42 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:03:43.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:42 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:43.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:42 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:03:43.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:42 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:43.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:42 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:43.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:42 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:43.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:42 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:43.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:42 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi089.jhouje"]}]: dispatch 2024-08-01T07:03:43.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:42 smithi016 ceph-mon[93645]: Upgrade: It appears safe to stop mds.cephfs.smithi089.jhouje 2024-08-01T07:03:44.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:44 smithi016 ceph-mon[93645]: pgmap v211: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-08-01T07:03:44.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:44 smithi016 ceph-mon[93645]: Upgrade: Updating mds.cephfs.smithi089.jhouje 2024-08-01T07:03:44.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:44 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:44.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:44 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.jhouje", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T07:03:44.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:44 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:03:44.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:44 smithi016 ceph-mon[93645]: Deploying daemon mds.cephfs.smithi089.jhouje on smithi089 2024-08-01T07:03:44.707 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:44 smithi089 ceph-mon[82218]: pgmap v211: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-08-01T07:03:44.707 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:44 smithi089 ceph-mon[82218]: Upgrade: Updating mds.cephfs.smithi089.jhouje 2024-08-01T07:03:44.707 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:44 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:44.707 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:44 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.jhouje", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T07:03:44.707 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:44 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:03:44.708 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:44 smithi089 ceph-mon[82218]: Deploying daemon mds.cephfs.smithi089.jhouje on smithi089 2024-08-01T07:03:46.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:46 smithi016 ceph-mon[93645]: pgmap v212: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-08-01T07:03:46.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:46 smithi016 ceph-mon[93645]: osdmap e95: 6 total, 6 up, 6 in 2024-08-01T07:03:46.649 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:46 smithi016 ceph-mon[93645]: fsmap cephfs:1 {0=cephfs.smithi016.bgqkxu=up:active} 2 up:standby 2024-08-01T07:03:46.704 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:46 smithi089 ceph-mon[82218]: pgmap v212: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-08-01T07:03:46.704 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:46 smithi089 ceph-mon[82218]: osdmap e95: 6 total, 6 up, 6 in 2024-08-01T07:03:46.704 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:46 smithi089 ceph-mon[82218]: fsmap cephfs:1 {0=cephfs.smithi016.bgqkxu=up:active} 2 up:standby 2024-08-01T07:03:47.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:03:47.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.jhouje"}]: dispatch 2024-08-01T07:03:47.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:03:47.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.jhouje"}]: dispatch 2024-08-01T07:03:48.454 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:48 smithi089 ceph-mon[82218]: pgmap v214: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:48.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:48 smithi016 ceph-mon[93645]: pgmap v214: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:51.071 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:50 smithi016 ceph-mon[93645]: pgmap v215: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:51.071 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:50 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:51.071 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:50 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:51.071 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:50 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:03:51.071 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:50 smithi016 ceph-mon[93645]: mds.? [v2:172.21.15.89:6824/3335707325,v1:172.21.15.89:6825/3335707325] up:boot 2024-08-01T07:03:51.071 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:50 smithi016 ceph-mon[93645]: fsmap cephfs:1 {0=cephfs.smithi016.bgqkxu=up:active} 3 up:standby 2024-08-01T07:03:51.071 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:50 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.jhouje"}]: dispatch 2024-08-01T07:03:51.106 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:50 smithi089 ceph-mon[82218]: pgmap v215: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:51.106 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:50 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:51.107 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:50 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:51.107 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:50 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:03:51.107 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:50 smithi089 ceph-mon[82218]: mds.? [v2:172.21.15.89:6824/3335707325,v1:172.21.15.89:6825/3335707325] up:boot 2024-08-01T07:03:51.107 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:50 smithi089 ceph-mon[82218]: fsmap cephfs:1 {0=cephfs.smithi016.bgqkxu=up:active} 3 up:standby 2024-08-01T07:03:51.107 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:50 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.jhouje"}]: dispatch 2024-08-01T07:03:53.129 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:52 smithi089 ceph-mon[82218]: pgmap v216: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:53.129 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:53.129 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:53.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:52 smithi016 ceph-mon[93645]: pgmap v216: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:53.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:53.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:54.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:54 smithi089 ceph-mon[82218]: pgmap v217: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:54.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:54 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:54.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:54 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:54.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:54 smithi016 ceph-mon[93645]: pgmap v217: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:54.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:54 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:54.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:54 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:56.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:56 smithi089 ceph-mon[82218]: pgmap v218: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:56.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:56 smithi016 ceph-mon[93645]: pgmap v218: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:57.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:57 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:57.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:57 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:57.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:57 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:03:57.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:57 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:03:57.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:57 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:57.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:57 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:03:57.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:57 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:57.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:57 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:57.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:57 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:57.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:57 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:57.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:57 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi089.xanuld"]}]: dispatch 2024-08-01T07:03:57.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:57 smithi089 ceph-mon[82218]: Upgrade: It appears safe to stop mds.cephfs.smithi089.xanuld 2024-08-01T07:03:57.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:57 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:57.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:57 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:57.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:57 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:03:57.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:57 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:03:57.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:57 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:57.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:57 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:03:57.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:57 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:57.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:57 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:57.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:57 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:57.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:57 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:03:57.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:57 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi089.xanuld"]}]: dispatch 2024-08-01T07:03:57.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:57 smithi016 ceph-mon[93645]: Upgrade: It appears safe to stop mds.cephfs.smithi089.xanuld 2024-08-01T07:03:59.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:59 smithi089 ceph-mon[82218]: pgmap v219: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:59.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:59 smithi089 ceph-mon[82218]: Upgrade: Updating mds.cephfs.smithi089.xanuld 2024-08-01T07:03:59.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:59 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:59.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:59 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.xanuld", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T07:03:59.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:59 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:03:59.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:03:59 smithi089 ceph-mon[82218]: Deploying daemon mds.cephfs.smithi089.xanuld on smithi089 2024-08-01T07:03:59.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:59 smithi016 ceph-mon[93645]: pgmap v219: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:03:59.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:59 smithi016 ceph-mon[93645]: Upgrade: Updating mds.cephfs.smithi089.xanuld 2024-08-01T07:03:59.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:59 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:03:59.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:59 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.xanuld", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-01T07:03:59.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:59 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:03:59.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:03:59 smithi016 ceph-mon[93645]: Deploying daemon mds.cephfs.smithi089.xanuld on smithi089 2024-08-01T07:04:01.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:01 smithi089 ceph-mon[82218]: pgmap v220: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:04:01.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:01 smithi089 ceph-mon[82218]: osdmap e96: 6 total, 6 up, 6 in 2024-08-01T07:04:01.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:01 smithi016 ceph-mon[93645]: pgmap v220: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:04:01.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:01 smithi016 ceph-mon[93645]: osdmap e96: 6 total, 6 up, 6 in 2024-08-01T07:04:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.477+0000 7fda7552b640 1 -- 172.21.15.16:0/2016143884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda700ffb90 msgr2=0x7fda700fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.477+0000 7fda7552b640 1 --2- 172.21.15.16:0/2016143884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda700ffb90 0x7fda700fff90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fda60009880 tx=0x7fda6002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:04:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.477+0000 7fda7552b640 1 -- 172.21.15.16:0/2016143884 shutdown_connections 2024-08-01T07:04:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.477+0000 7fda7552b640 1 --2- 172.21.15.16:0/2016143884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda70100d90 0x7fda70101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.477+0000 7fda7552b640 1 --2- 172.21.15.16:0/2016143884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda700ffb90 0x7fda700fff90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.477+0000 7fda7552b640 1 -- 172.21.15.16:0/2016143884 >> 172.21.15.16:0/2016143884 conn(0x7fda700fb320 msgr2=0x7fda700fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.477+0000 7fda7552b640 1 -- 172.21.15.16:0/2016143884 shutdown_connections 2024-08-01T07:04:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.478+0000 7fda7552b640 1 -- 172.21.15.16:0/2016143884 wait complete. 2024-08-01T07:04:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.478+0000 7fda7552b640 1 Processor -- start 2024-08-01T07:04:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.478+0000 7fda7552b640 1 -- start start 2024-08-01T07:04:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.478+0000 7fda7552b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda700ffb90 0x7fda70197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.478+0000 7fda7552b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda70100d90 0x7fda70197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.479+0000 7fda7552b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda70198300 con 0x7fda700ffb90 2024-08-01T07:04:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.479+0000 7fda7552b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda70198470 con 0x7fda70100d90 2024-08-01T07:04:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.479+0000 7fda6effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda700ffb90 0x7fda70197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.479+0000 7fda6effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda700ffb90 0x7fda70197880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49730/0 (socket says 172.21.15.16:49730) 2024-08-01T07:04:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.479+0000 7fda6effd640 1 -- 172.21.15.16:0/3853766214 learned_addr learned my addr 172.21.15.16:0/3853766214 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:04:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.479+0000 7fda6e7fc640 1 --2- 172.21.15.16:0/3853766214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda70100d90 0x7fda70197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.479+0000 7fda6effd640 1 -- 172.21.15.16:0/3853766214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda70100d90 msgr2=0x7fda70197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:01.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.479+0000 7fda6effd640 1 --2- 172.21.15.16:0/3853766214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda70100d90 0x7fda70197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:01.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.479+0000 7fda6effd640 1 -- 172.21.15.16:0/3853766214 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda60009560 con 0x7fda700ffb90 2024-08-01T07:04:01.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.479+0000 7fda6e7fc640 1 --2- 172.21.15.16:0/3853766214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda70100d90 0x7fda70197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T07:04:01.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.479+0000 7fda6effd640 1 --2- 172.21.15.16:0/3853766214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda700ffb90 0x7fda70197880 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fda60006010 tx=0x7fda600055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:01.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.479+0000 7fda57fff640 1 -- 172.21.15.16:0/3853766214 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda60004aa0 con 0x7fda700ffb90 2024-08-01T07:04:01.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.479+0000 7fda57fff640 1 -- 172.21.15.16:0/3853766214 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda60004c00 con 0x7fda700ffb90 2024-08-01T07:04:01.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.479+0000 7fda7552b640 1 -- 172.21.15.16:0/3853766214 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7019cef0 con 0x7fda700ffb90 2024-08-01T07:04:01.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.479+0000 7fda57fff640 1 -- 172.21.15.16:0/3853766214 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda60003ae0 con 0x7fda700ffb90 2024-08-01T07:04:01.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.479+0000 7fda7552b640 1 -- 172.21.15.16:0/3853766214 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7019d390 con 0x7fda700ffb90 2024-08-01T07:04:01.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.481+0000 7fda7552b640 1 -- 172.21.15.16:0/3853766214 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda70105260 con 0x7fda700ffb90 2024-08-01T07:04:01.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.481+0000 7fda57fff640 1 -- 172.21.15.16:0/3853766214 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fda60003d20 con 0x7fda700ffb90 2024-08-01T07:04:01.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.481+0000 7fda57fff640 1 --2- 172.21.15.16:0/3853766214 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fda5806e170 0x7fda58070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:01.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.482+0000 7fda57fff640 1 -- 172.21.15.16:0/3853766214 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fda600af4e0 con 0x7fda700ffb90 2024-08-01T07:04:01.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.482+0000 7fda6e7fc640 1 --2- 172.21.15.16:0/3853766214 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fda5806e170 0x7fda58070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:01.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.482+0000 7fda6e7fc640 1 --2- 172.21.15.16:0/3853766214 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fda5806e170 0x7fda58070630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fda70198da0 tx=0x7fda6400a5c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:01.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.486+0000 7fda57fff640 1 -- 172.21.15.16:0/3853766214 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fda600786a0 con 0x7fda700ffb90 2024-08-01T07:04:01.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.692+0000 7fda7552b640 1 -- 172.21.15.16:0/3853766214 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fda7002c520 con 0x7fda5806e170 2024-08-01T07:04:01.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.693+0000 7fda57fff640 1 -- 172.21.15.16:0/3853766214 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fda7002c520 con 0x7fda5806e170 2024-08-01T07:04:01.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.695+0000 7fda7552b640 1 -- 172.21.15.16:0/3853766214 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fda5806e170 msgr2=0x7fda58070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:01.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.695+0000 7fda7552b640 1 --2- 172.21.15.16:0/3853766214 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fda5806e170 0x7fda58070630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fda70198da0 tx=0x7fda6400a5c0 comp rx=0 tx=0).stop 2024-08-01T07:04:01.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.695+0000 7fda7552b640 1 -- 172.21.15.16:0/3853766214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda700ffb90 msgr2=0x7fda70197880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:01.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.695+0000 7fda7552b640 1 --2- 172.21.15.16:0/3853766214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda700ffb90 0x7fda70197880 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fda60006010 tx=0x7fda600055a0 comp rx=0 tx=0).stop 2024-08-01T07:04:01.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.695+0000 7fda7552b640 1 -- 172.21.15.16:0/3853766214 shutdown_connections 2024-08-01T07:04:01.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.695+0000 7fda7552b640 1 --2- 172.21.15.16:0/3853766214 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fda5806e170 0x7fda58070630 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:01.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.695+0000 7fda7552b640 1 --2- 172.21.15.16:0/3853766214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda70100d90 0x7fda70197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:01.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.695+0000 7fda7552b640 1 --2- 172.21.15.16:0/3853766214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda700ffb90 0x7fda70197880 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:01.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.695+0000 7fda7552b640 1 -- 172.21.15.16:0/3853766214 >> 172.21.15.16:0/3853766214 conn(0x7fda700fb320 msgr2=0x7fda70102430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:01.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.695+0000 7fda7552b640 1 -- 172.21.15.16:0/3853766214 shutdown_connections 2024-08-01T07:04:01.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.695+0000 7fda7552b640 1 -- 172.21.15.16:0/3853766214 wait complete. 2024-08-01T07:04:01.705 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T07:04:01.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.780+0000 7fef3664c640 1 -- 172.21.15.16:0/1687591321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef30100d90 msgr2=0x7fef30101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:01.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.780+0000 7fef3664c640 1 --2- 172.21.15.16:0/1687591321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef30100d90 0x7fef30101210 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fef24009880 tx=0x7fef2402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:04:01.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.780+0000 7fef3664c640 1 -- 172.21.15.16:0/1687591321 shutdown_connections 2024-08-01T07:04:01.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.780+0000 7fef3664c640 1 --2- 172.21.15.16:0/1687591321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef30100d90 0x7fef30101210 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:01.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.780+0000 7fef3664c640 1 --2- 172.21.15.16:0/1687591321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef300ffb90 0x7fef300fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:01.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.780+0000 7fef3664c640 1 -- 172.21.15.16:0/1687591321 >> 172.21.15.16:0/1687591321 conn(0x7fef300fb320 msgr2=0x7fef300fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:01.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.780+0000 7fef3664c640 1 -- 172.21.15.16:0/1687591321 shutdown_connections 2024-08-01T07:04:01.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.780+0000 7fef3664c640 1 -- 172.21.15.16:0/1687591321 wait complete. 2024-08-01T07:04:01.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.781+0000 7fef3664c640 1 Processor -- start 2024-08-01T07:04:01.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.781+0000 7fef3664c640 1 -- start start 2024-08-01T07:04:01.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.781+0000 7fef3664c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef300ffb90 0x7fef30074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:01.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.781+0000 7fef3664c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef30100d90 0x7fef300728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:01.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.781+0000 7fef3664c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef30072de0 con 0x7fef300ffb90 2024-08-01T07:04:01.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.781+0000 7fef3664c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef30072f50 con 0x7fef30100d90 2024-08-01T07:04:01.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.781+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef300ffb90 0x7fef30074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:01.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.781+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef300ffb90 0x7fef30074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49740/0 (socket says 172.21.15.16:49740) 2024-08-01T07:04:01.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.781+0000 7fef2ffff640 1 -- 172.21.15.16:0/3866720442 learned_addr learned my addr 172.21.15.16:0/3866720442 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:04:01.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.781+0000 7fef2f7fe640 1 --2- 172.21.15.16:0/3866720442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef30100d90 0x7fef300728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:01.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.781+0000 7fef2ffff640 1 -- 172.21.15.16:0/3866720442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef30100d90 msgr2=0x7fef300728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:01.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.781+0000 7fef2ffff640 1 --2- 172.21.15.16:0/3866720442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef30100d90 0x7fef300728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:01.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.781+0000 7fef2ffff640 1 -- 172.21.15.16:0/3866720442 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef24009560 con 0x7fef300ffb90 2024-08-01T07:04:01.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.782+0000 7fef2ffff640 1 --2- 172.21.15.16:0/3866720442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef300ffb90 0x7fef30074250 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fef2000d8d0 tx=0x7fef2000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:01.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.782+0000 7fef2d7fa640 1 -- 172.21.15.16:0/3866720442 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef20009a30 con 0x7fef300ffb90 2024-08-01T07:04:01.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.782+0000 7fef2d7fa640 1 -- 172.21.15.16:0/3866720442 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef20009b90 con 0x7fef300ffb90 2024-08-01T07:04:01.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.782+0000 7fef3664c640 1 -- 172.21.15.16:0/3866720442 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef30073230 con 0x7fef300ffb90 2024-08-01T07:04:01.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.782+0000 7fef2d7fa640 1 -- 172.21.15.16:0/3866720442 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef2000f680 con 0x7fef300ffb90 2024-08-01T07:04:01.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.782+0000 7fef3664c640 1 -- 172.21.15.16:0/3866720442 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3019d690 con 0x7fef300ffb90 2024-08-01T07:04:01.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.783+0000 7fef3664c640 1 -- 172.21.15.16:0/3866720442 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef3018f730 con 0x7fef300ffb90 2024-08-01T07:04:01.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.784+0000 7fef2d7fa640 1 -- 172.21.15.16:0/3866720442 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fef20009d00 con 0x7fef300ffb90 2024-08-01T07:04:01.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.785+0000 7fef2d7fa640 1 --2- 172.21.15.16:0/3866720442 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fef1806e170 0x7fef18070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:01.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.785+0000 7fef2d7fa640 1 -- 172.21.15.16:0/3866720442 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fef2008e020 con 0x7fef300ffb90 2024-08-01T07:04:01.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.785+0000 7fef2f7fe640 1 --2- 172.21.15.16:0/3866720442 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fef1806e170 0x7fef18070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:01.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.785+0000 7fef2f7fe640 1 --2- 172.21.15.16:0/3866720442 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fef1806e170 0x7fef18070630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fef24000c00 tx=0x7fef240314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:01.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.788+0000 7fef2d7fa640 1 -- 172.21.15.16:0/3866720442 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fef200573b0 con 0x7fef300ffb90 2024-08-01T07:04:01.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.982+0000 7fef3664c640 1 -- 172.21.15.16:0/3866720442 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef3002c560 con 0x7fef1806e170 2024-08-01T07:04:01.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.983+0000 7fef2d7fa640 1 -- 172.21.15.16:0/3866720442 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fef3002c560 con 0x7fef1806e170 2024-08-01T07:04:01.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.985+0000 7fef3664c640 1 -- 172.21.15.16:0/3866720442 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fef1806e170 msgr2=0x7fef18070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:01.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.985+0000 7fef3664c640 1 --2- 172.21.15.16:0/3866720442 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fef1806e170 0x7fef18070630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fef24000c00 tx=0x7fef240314e0 comp rx=0 tx=0).stop 2024-08-01T07:04:01.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.985+0000 7fef3664c640 1 -- 172.21.15.16:0/3866720442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef300ffb90 msgr2=0x7fef30074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:01.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.985+0000 7fef3664c640 1 --2- 172.21.15.16:0/3866720442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef300ffb90 0x7fef30074250 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fef2000d8d0 tx=0x7fef2000dd90 comp rx=0 tx=0).stop 2024-08-01T07:04:01.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.985+0000 7fef3664c640 1 -- 172.21.15.16:0/3866720442 shutdown_connections 2024-08-01T07:04:01.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.985+0000 7fef3664c640 1 --2- 172.21.15.16:0/3866720442 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fef1806e170 0x7fef18070630 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:01.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.985+0000 7fef3664c640 1 --2- 172.21.15.16:0/3866720442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef30100d90 0x7fef300728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:01.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.985+0000 7fef3664c640 1 --2- 172.21.15.16:0/3866720442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef300ffb90 0x7fef30074250 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:01.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.985+0000 7fef3664c640 1 -- 172.21.15.16:0/3866720442 >> 172.21.15.16:0/3866720442 conn(0x7fef300fb320 msgr2=0x7fef30104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:01.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.985+0000 7fef3664c640 1 -- 172.21.15.16:0/3866720442 shutdown_connections 2024-08-01T07:04:01.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:01.985+0000 7fef3664c640 1 -- 172.21.15.16:0/3866720442 wait complete. 2024-08-01T07:04:02.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.070+0000 7fef32b3b640 1 -- 172.21.15.16:0/1262789797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef2c0feaf0 msgr2=0x7fef2c0feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:02.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.070+0000 7fef32b3b640 1 --2- 172.21.15.16:0/1262789797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef2c0feaf0 0x7fef2c0feef0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fef20009880 tx=0x7fef2002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.070+0000 7fef32b3b640 1 -- 172.21.15.16:0/1262789797 shutdown_connections 2024-08-01T07:04:02.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.070+0000 7fef32b3b640 1 --2- 172.21.15.16:0/1262789797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef2c0ffcf0 0x7fef2c100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.070+0000 7fef32b3b640 1 --2- 172.21.15.16:0/1262789797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef2c0feaf0 0x7fef2c0feef0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.070+0000 7fef32b3b640 1 -- 172.21.15.16:0/1262789797 >> 172.21.15.16:0/1262789797 conn(0x7fef2c0fa280 msgr2=0x7fef2c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:02.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.071+0000 7fef32b3b640 1 -- 172.21.15.16:0/1262789797 shutdown_connections 2024-08-01T07:04:02.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.071+0000 7fef32b3b640 1 -- 172.21.15.16:0/1262789797 wait complete. 2024-08-01T07:04:02.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.071+0000 7fef32b3b640 1 Processor -- start 2024-08-01T07:04:02.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.071+0000 7fef32b3b640 1 -- start start 2024-08-01T07:04:02.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.071+0000 7fef32b3b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef2c0feaf0 0x7fef2c102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:02.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.071+0000 7fef32b3b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef2c0ffcf0 0x7fef2c1010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:02.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.071+0000 7fef32b3b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c101610 con 0x7fef2c0ffcf0 2024-08-01T07:04:02.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.071+0000 7fef32b3b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c101780 con 0x7fef2c0feaf0 2024-08-01T07:04:02.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.071+0000 7fef2bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef2c0ffcf0 0x7fef2c1010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:02.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.072+0000 7fef2bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef2c0ffcf0 0x7fef2c1010d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49754/0 (socket says 172.21.15.16:49754) 2024-08-01T07:04:02.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.072+0000 7fef2bfff640 1 -- 172.21.15.16:0/1821734208 learned_addr learned my addr 172.21.15.16:0/1821734208 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:04:02.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.072+0000 7fef308d7640 1 --2- 172.21.15.16:0/1821734208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef2c0feaf0 0x7fef2c102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:02.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.072+0000 7fef2bfff640 1 -- 172.21.15.16:0/1821734208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef2c0feaf0 msgr2=0x7fef2c102a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:02.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.072+0000 7fef2bfff640 1 --2- 172.21.15.16:0/1821734208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef2c0feaf0 0x7fef2c102a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.072+0000 7fef2bfff640 1 -- 172.21.15.16:0/1821734208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef20009560 con 0x7fef2c0ffcf0 2024-08-01T07:04:02.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.072+0000 7fef2bfff640 1 --2- 172.21.15.16:0/1821734208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef2c0ffcf0 0x7fef2c1010d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fef1800d8d0 tx=0x7fef1800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:02.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.072+0000 7fef29ffb640 1 -- 172.21.15.16:0/1821734208 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef1800bea0 con 0x7fef2c0ffcf0 2024-08-01T07:04:02.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.072+0000 7fef32b3b640 1 -- 172.21.15.16:0/1821734208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2c101a60 con 0x7fef2c0ffcf0 2024-08-01T07:04:02.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.072+0000 7fef29ffb640 1 -- 172.21.15.16:0/1821734208 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef18009c00 con 0x7fef2c0ffcf0 2024-08-01T07:04:02.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.072+0000 7fef29ffb640 1 -- 172.21.15.16:0/1821734208 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef1800f700 con 0x7fef2c0ffcf0 2024-08-01T07:04:02.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.072+0000 7fef32b3b640 1 -- 172.21.15.16:0/1821734208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2c19d710 con 0x7fef2c0ffcf0 2024-08-01T07:04:02.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.073+0000 7fef32b3b640 1 -- 172.21.15.16:0/1821734208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2c0feef0 con 0x7fef2c0ffcf0 2024-08-01T07:04:02.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.074+0000 7fef29ffb640 1 -- 172.21.15.16:0/1821734208 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fef18010460 con 0x7fef2c0ffcf0 2024-08-01T07:04:02.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.075+0000 7fef29ffb640 1 --2- 172.21.15.16:0/1821734208 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fef1c06e180 0x7fef1c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:02.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.075+0000 7fef29ffb640 1 -- 172.21.15.16:0/1821734208 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fef1808e2a0 con 0x7fef2c0ffcf0 2024-08-01T07:04:02.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.075+0000 7fef308d7640 1 --2- 172.21.15.16:0/1821734208 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fef1c06e180 0x7fef1c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:02.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.075+0000 7fef308d7640 1 --2- 172.21.15.16:0/1821734208 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fef1c06e180 0x7fef1c070640 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fef20006010 tx=0x7fef200314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:02.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.079+0000 7fef29ffb640 1 -- 172.21.15.16:0/1821734208 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fef18057510 con 0x7fef2c0ffcf0 2024-08-01T07:04:02.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.265+0000 7fef32b3b640 1 -- 172.21.15.16:0/1821734208 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fef2c0683f0 con 0x7fef1c06e180 2024-08-01T07:04:02.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.275+0000 7fef29ffb640 1 -- 172.21.15.16:0/1821734208 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fef2c0683f0 con 0x7fef1c06e180 2024-08-01T07:04:02.276 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T07:04:02.276 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (14m) 24s ago 16m 25.3M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T07:04:02.276 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (16m) 24s ago 16m 9361k - 18.2.2-1767-ga3bbd728 d280790d1980 5a951f7fe3c8 2024-08-01T07:04:02.276 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (15m) 9s ago 15m 9084k - 18.2.2-1767-ga3bbd728 d280790d1980 11740a7fdedb 2024-08-01T07:04:02.276 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (4m) 24s ago 16m 6899k - 19.1.0-1223-gf9911e17 93d93c74a2cc 2a96028287a2 2024-08-01T07:04:02.277 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (4m) 9s ago 15m 6895k - 19.1.0-1223-gf9911e17 93d93c74a2cc 8a23341bd6c3 2024-08-01T07:04:02.277 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (14m) 24s ago 15m 85.5M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T07:04:02.277 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (54s) 24s ago 10m 90.4M - 19.1.0-1223-gf9911e17 93d93c74a2cc 2fb78654cbea 2024-08-01T07:04:02.277 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (30s) 24s ago 10m 10.7M - 19.1.0-1223-gf9911e17 93d93c74a2cc d3ca5deb5bb6 2024-08-01T07:04:02.277 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (12s) 9s ago 10m 11.6M - 19.1.0-1223-gf9911e17 93d93c74a2cc 6e9b9ebf3bc9 2024-08-01T07:04:02.277 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (10m) 9s ago 10m 12.5M - 18.2.2-1767-ga3bbd728 d280790d1980 05bb46c6fe94 2024-08-01T07:04:02.277 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:8443,9283,8765 running (7m) 24s ago 17m 505M - 19.1.0-1223-gf9911e17 93d93c74a2cc 8701e6315593 2024-08-01T07:04:02.277 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (6m) 9s ago 15m 441M - 19.1.0-1223-gf9911e17 93d93c74a2cc c6caa21f436f 2024-08-01T07:04:02.277 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (5m) 24s ago 17m 53.8M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc 48e94d076e6f 2024-08-01T07:04:02.277 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (5m) 9s ago 15m 39.7M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc c4b83b46ff15 2024-08-01T07:04:02.277 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (16m) 24s ago 16m 15.7M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T07:04:02.277 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (15m) 9s ago 15m 16.6M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T07:04:02.277 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (4m) 24s ago 14m 206M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 4c2115ae6222 2024-08-01T07:04:02.277 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (3m) 24s ago 13m 109M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc fc2f7117be30 2024-08-01T07:04:02.278 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (3m) 24s ago 13m 145M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 3364752c9365 2024-08-01T07:04:02.278 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (2m) 9s ago 13m 114M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 9a18feae4353 2024-08-01T07:04:02.278 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (2m) 9s ago 12m 166M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 7c51ba7a636a 2024-08-01T07:04:02.278 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (101s) 9s ago 12m 132M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 08ffb10ca1a6 2024-08-01T07:04:02.278 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (6m) 24s ago 15m 69.2M - 2.43.0 a07b618ecd1d 45d23c96382e 2024-08-01T07:04:02.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.277+0000 7fef32b3b640 1 -- 172.21.15.16:0/1821734208 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fef1c06e180 msgr2=0x7fef1c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:02.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.277+0000 7fef32b3b640 1 --2- 172.21.15.16:0/1821734208 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fef1c06e180 0x7fef1c070640 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fef20006010 tx=0x7fef200314e0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.277+0000 7fef32b3b640 1 -- 172.21.15.16:0/1821734208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef2c0ffcf0 msgr2=0x7fef2c1010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:02.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.277+0000 7fef32b3b640 1 --2- 172.21.15.16:0/1821734208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef2c0ffcf0 0x7fef2c1010d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fef1800d8d0 tx=0x7fef1800dd90 comp rx=0 tx=0).stop 2024-08-01T07:04:02.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.277+0000 7fef32b3b640 1 -- 172.21.15.16:0/1821734208 shutdown_connections 2024-08-01T07:04:02.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.277+0000 7fef32b3b640 1 --2- 172.21.15.16:0/1821734208 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fef1c06e180 0x7fef1c070640 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.277+0000 7fef32b3b640 1 --2- 172.21.15.16:0/1821734208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef2c0ffcf0 0x7fef2c1010d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.277+0000 7fef32b3b640 1 --2- 172.21.15.16:0/1821734208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef2c0feaf0 0x7fef2c102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.277+0000 7fef32b3b640 1 -- 172.21.15.16:0/1821734208 >> 172.21.15.16:0/1821734208 conn(0x7fef2c0fa280 msgr2=0x7fef2c067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:02.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.277+0000 7fef32b3b640 1 -- 172.21.15.16:0/1821734208 shutdown_connections 2024-08-01T07:04:02.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.277+0000 7fef32b3b640 1 -- 172.21.15.16:0/1821734208 wait complete. 2024-08-01T07:04:02.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.360+0000 7f0b6497e640 1 -- 172.21.15.16:0/2858038240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b60100d90 msgr2=0x7f0b60101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:02.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.360+0000 7f0b6497e640 1 --2- 172.21.15.16:0/2858038240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b60100d90 0x7f0b60101210 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009880 tx=0x7f0b5402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.361 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:02 smithi016 ceph-mon[93645]: fsmap cephfs:1 {0=cephfs.smithi016.bgqkxu=up:active} 2 up:standby 2024-08-01T07:04:02.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.360+0000 7f0b6497e640 1 -- 172.21.15.16:0/2858038240 shutdown_connections 2024-08-01T07:04:02.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.360+0000 7f0b6497e640 1 --2- 172.21.15.16:0/2858038240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b60100d90 0x7f0b60101210 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.360+0000 7f0b6497e640 1 --2- 172.21.15.16:0/2858038240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b600ffb90 0x7f0b600fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.360+0000 7f0b6497e640 1 -- 172.21.15.16:0/2858038240 >> 172.21.15.16:0/2858038240 conn(0x7f0b600fb320 msgr2=0x7f0b600fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:02.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.360+0000 7f0b6497e640 1 -- 172.21.15.16:0/2858038240 shutdown_connections 2024-08-01T07:04:02.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.360+0000 7f0b6497e640 1 -- 172.21.15.16:0/2858038240 wait complete. 2024-08-01T07:04:02.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.361+0000 7f0b6497e640 1 Processor -- start 2024-08-01T07:04:02.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.361+0000 7f0b6497e640 1 -- start start 2024-08-01T07:04:02.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.361+0000 7f0b6497e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b600ffb90 0x7f0b601977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:02.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.361+0000 7f0b6497e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b60100d90 0x7f0b60197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:02.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.361+0000 7f0b6497e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b60198300 con 0x7f0b600ffb90 2024-08-01T07:04:02.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.361+0000 7f0b6497e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b60198470 con 0x7f0b60100d90 2024-08-01T07:04:02.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.361+0000 7f0b5e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b600ffb90 0x7f0b601977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:02.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.361+0000 7f0b5e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b600ffb90 0x7f0b601977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49762/0 (socket says 172.21.15.16:49762) 2024-08-01T07:04:02.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.361+0000 7f0b5e59c640 1 -- 172.21.15.16:0/1341903445 learned_addr learned my addr 172.21.15.16:0/1341903445 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:04:02.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.361+0000 7f0b5dd9b640 1 --2- 172.21.15.16:0/1341903445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b60100d90 0x7f0b60197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:02.364 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:02 smithi089 ceph-mon[82218]: fsmap cephfs:1 {0=cephfs.smithi016.bgqkxu=up:active} 2 up:standby 2024-08-01T07:04:02.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.362+0000 7f0b5e59c640 1 -- 172.21.15.16:0/1341903445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b60100d90 msgr2=0x7f0b60197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:02.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.362+0000 7f0b5e59c640 1 --2- 172.21.15.16:0/1341903445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b60100d90 0x7f0b60197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.362+0000 7f0b5e59c640 1 -- 172.21.15.16:0/1341903445 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b54009560 con 0x7f0b600ffb90 2024-08-01T07:04:02.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.362+0000 7f0b5e59c640 1 --2- 172.21.15.16:0/1341903445 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b600ffb90 0x7f0b601977f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000d720 tx=0x7f0b5000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:02.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.362+0000 7f0b4f7fe640 1 -- 172.21.15.16:0/1341903445 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b500041f0 con 0x7f0b600ffb90 2024-08-01T07:04:02.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.362+0000 7f0b4f7fe640 1 -- 172.21.15.16:0/1341903445 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b50004350 con 0x7f0b600ffb90 2024-08-01T07:04:02.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.362+0000 7f0b6497e640 1 -- 172.21.15.16:0/1341903445 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6019cf10 con 0x7f0b600ffb90 2024-08-01T07:04:02.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.362+0000 7f0b6497e640 1 -- 172.21.15.16:0/1341903445 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6019d450 con 0x7f0b600ffb90 2024-08-01T07:04:02.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.362+0000 7f0b4f7fe640 1 -- 172.21.15.16:0/1341903445 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b50003df0 con 0x7f0b600ffb90 2024-08-01T07:04:02.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.363+0000 7f0b6497e640 1 -- 172.21.15.16:0/1341903445 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b40005280 con 0x7f0b600ffb90 2024-08-01T07:04:02.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.364+0000 7f0b4f7fe640 1 -- 172.21.15.16:0/1341903445 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0b500035f0 con 0x7f0b600ffb90 2024-08-01T07:04:02.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.365+0000 7f0b4f7fe640 1 --2- 172.21.15.16:0/1341903445 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f0b4806e110 0x7f0b480705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:02.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.365+0000 7f0b4f7fe640 1 -- 172.21.15.16:0/1341903445 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f0b5008dd10 con 0x7f0b600ffb90 2024-08-01T07:04:02.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.365+0000 7f0b5dd9b640 1 --2- 172.21.15.16:0/1341903445 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f0b4806e110 0x7f0b480705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:02.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.365+0000 7f0b5dd9b640 1 --2- 172.21.15.16:0/1341903445 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f0b4806e110 0x7f0b480705d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0b54000c00 tx=0x7f0b540314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:02.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.369+0000 7f0b4f7fe640 1 -- 172.21.15.16:0/1341903445 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0b50056ee0 con 0x7f0b600ffb90 2024-08-01T07:04:02.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.613+0000 7f0b6497e640 1 -- 172.21.15.16:0/1341903445 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0b40005d40 con 0x7f0b600ffb90 2024-08-01T07:04:02.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.613+0000 7f0b4f7fe640 1 -- 172.21.15.16:0/1341903445 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f0b5005a5a0 con 0x7f0b600ffb90 2024-08-01T07:04:02.615 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:04:02.615 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T07:04:02.615 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:04:02.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:04:02.615 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T07:04:02.615 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:04:02.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:04:02.615 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T07:04:02.615 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 6 2024-08-01T07:04:02.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:04:02.615 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T07:04:02.616 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 3 2024-08-01T07:04:02.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:04:02.616 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T07:04:02.616 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 13 2024-08-01T07:04:02.616 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T07:04:02.616 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:04:02.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.615+0000 7f0b6497e640 1 -- 172.21.15.16:0/1341903445 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f0b4806e110 msgr2=0x7f0b480705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:02.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.615+0000 7f0b6497e640 1 --2- 172.21.15.16:0/1341903445 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f0b4806e110 0x7f0b480705d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0b54000c00 tx=0x7f0b540314e0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.615+0000 7f0b6497e640 1 -- 172.21.15.16:0/1341903445 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b600ffb90 msgr2=0x7f0b601977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:02.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.615+0000 7f0b6497e640 1 --2- 172.21.15.16:0/1341903445 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b600ffb90 0x7f0b601977f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000d720 tx=0x7f0b5000dbe0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.615+0000 7f0b6497e640 1 -- 172.21.15.16:0/1341903445 shutdown_connections 2024-08-01T07:04:02.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.615+0000 7f0b6497e640 1 --2- 172.21.15.16:0/1341903445 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f0b4806e110 0x7f0b480705d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.615+0000 7f0b6497e640 1 --2- 172.21.15.16:0/1341903445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b60100d90 0x7f0b60197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.615+0000 7f0b6497e640 1 --2- 172.21.15.16:0/1341903445 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b600ffb90 0x7f0b601977f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.615+0000 7f0b6497e640 1 -- 172.21.15.16:0/1341903445 >> 172.21.15.16:0/1341903445 conn(0x7f0b600fb320 msgr2=0x7f0b600fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:02.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.615+0000 7f0b6497e640 1 -- 172.21.15.16:0/1341903445 shutdown_connections 2024-08-01T07:04:02.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.615+0000 7f0b6497e640 1 -- 172.21.15.16:0/1341903445 wait complete. 2024-08-01T07:04:02.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.698+0000 7fa4d78d5640 1 -- 172.21.15.16:0/3087708044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d0100740 msgr2=0x7fa4d0102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:02.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.698+0000 7fa4d78d5640 1 --2- 172.21.15.16:0/3087708044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d0100740 0x7fa4d0102b30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009880 tx=0x7fa4cc02a4a0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.699+0000 7fa4d78d5640 1 -- 172.21.15.16:0/3087708044 shutdown_connections 2024-08-01T07:04:02.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.699+0000 7fa4d78d5640 1 --2- 172.21.15.16:0/3087708044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4d0103070 0x7fa4d0105460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.699+0000 7fa4d78d5640 1 --2- 172.21.15.16:0/3087708044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d0100740 0x7fa4d0102b30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.699+0000 7fa4d78d5640 1 -- 172.21.15.16:0/3087708044 >> 172.21.15.16:0/3087708044 conn(0x7fa4d00fa280 msgr2=0x7fa4d00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:02.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.699+0000 7fa4d78d5640 1 -- 172.21.15.16:0/3087708044 shutdown_connections 2024-08-01T07:04:02.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.699+0000 7fa4d78d5640 1 -- 172.21.15.16:0/3087708044 wait complete. 2024-08-01T07:04:02.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.699+0000 7fa4d78d5640 1 Processor -- start 2024-08-01T07:04:02.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.699+0000 7fa4d78d5640 1 -- start start 2024-08-01T07:04:02.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.699+0000 7fa4d78d5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4d0100740 0x7fa4d0197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:02.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.699+0000 7fa4d78d5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d0103070 0x7fa4d0197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:02.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.699+0000 7fa4d78d5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d0198420 con 0x7fa4d0103070 2024-08-01T07:04:02.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.700+0000 7fa4d78d5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d0198590 con 0x7fa4d0100740 2024-08-01T07:04:02.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.700+0000 7fa4d4e70640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d0103070 0x7fa4d0197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:02.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.700+0000 7fa4d4e70640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d0103070 0x7fa4d0197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49776/0 (socket says 172.21.15.16:49776) 2024-08-01T07:04:02.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.700+0000 7fa4d4e70640 1 -- 172.21.15.16:0/2928205559 learned_addr learned my addr 172.21.15.16:0/2928205559 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:04:02.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.700+0000 7fa4d5671640 1 --2- 172.21.15.16:0/2928205559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4d0100740 0x7fa4d0197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:02.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.700+0000 7fa4d4e70640 1 -- 172.21.15.16:0/2928205559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4d0100740 msgr2=0x7fa4d0197910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:02.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.700+0000 7fa4d4e70640 1 --2- 172.21.15.16:0/2928205559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4d0100740 0x7fa4d0197910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.700+0000 7fa4d4e70640 1 -- 172.21.15.16:0/2928205559 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc009560 con 0x7fa4d0103070 2024-08-01T07:04:02.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.700+0000 7fa4d5671640 1 --2- 172.21.15.16:0/2928205559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4d0100740 0x7fa4d0197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T07:04:02.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.700+0000 7fa4d4e70640 1 --2- 172.21.15.16:0/2928205559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d0103070 0x7fa4d0197e50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400e9a0 tx=0x7fa4c400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:02.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.700+0000 7fa4c27fc640 1 -- 172.21.15.16:0/2928205559 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c400cc90 con 0x7fa4d0103070 2024-08-01T07:04:02.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.700+0000 7fa4c27fc640 1 -- 172.21.15.16:0/2928205559 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa4c400cdf0 con 0x7fa4d0103070 2024-08-01T07:04:02.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.700+0000 7fa4d78d5640 1 -- 172.21.15.16:0/2928205559 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d019d030 con 0x7fa4d0103070 2024-08-01T07:04:02.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.700+0000 7fa4c27fc640 1 -- 172.21.15.16:0/2928205559 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c4010430 con 0x7fa4d0103070 2024-08-01T07:04:02.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.700+0000 7fa4d78d5640 1 -- 172.21.15.16:0/2928205559 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d019d550 con 0x7fa4d0103070 2024-08-01T07:04:02.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.701+0000 7fa4d78d5640 1 -- 172.21.15.16:0/2928205559 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d0100b20 con 0x7fa4d0103070 2024-08-01T07:04:02.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.702+0000 7fa4c27fc640 1 -- 172.21.15.16:0/2928205559 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa4c4005020 con 0x7fa4d0103070 2024-08-01T07:04:02.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.702+0000 7fa4c27fc640 1 --2- 172.21.15.16:0/2928205559 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa4bc06e170 0x7fa4bc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:02.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.703+0000 7fa4c27fc640 1 -- 172.21.15.16:0/2928205559 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fa4c4014070 con 0x7fa4d0103070 2024-08-01T07:04:02.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.703+0000 7fa4d5671640 1 --2- 172.21.15.16:0/2928205559 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa4bc06e170 0x7fa4bc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:02.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.703+0000 7fa4d5671640 1 --2- 172.21.15.16:0/2928205559 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa4bc06e170 0x7fa4bc070630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc000c00 tx=0x7fa4cc0314a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:02.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.707+0000 7fa4c27fc640 1 -- 172.21.15.16:0/2928205559 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa4c40579d0 con 0x7fa4d0103070 2024-08-01T07:04:02.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.916+0000 7fa4d78d5640 1 -- 172.21.15.16:0/2928205559 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa4d00fbdc0 con 0x7fa4d0103070 2024-08-01T07:04:02.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.916+0000 7fa4c27fc640 1 -- 172.21.15.16:0/2928205559 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 34 v34) v1 ==== 76+0+1797 (secure 0 0 0) 0x7fa4c405b090 con 0x7fa4d0103070 2024-08-01T07:04:02.918 INFO:teuthology.orchestra.run.smithi016.stdout:e34 2024-08-01T07:04:02.918 INFO:teuthology.orchestra.run.smithi016.stdout:btime 2024-08-01T07:04:01:051676+0000 2024-08-01T07:04:02.918 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T07:04:02.918 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T07:04:02.918 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T07:04:02.918 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:04:02.918 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T07:04:02.918 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T07:04:02.919 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 30 2024-08-01T07:04:02.919 INFO:teuthology.orchestra.run.smithi016.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-01T07:04:02.919 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T07:04:02.919 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T07:03:30.995134+0000 2024-08-01T07:04:02.919 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T07:04:02.919 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T07:04:02.919 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T07:04:02.919 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T07:04:02.919 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T07:04:02.920 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T07:04:02.920 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T07:04:02.920 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T07:04:02.920 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 94 2024-08-01T07:04:02.920 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-01T07:04:02.920 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 1 2024-08-01T07:04:02.920 INFO:teuthology.orchestra.run.smithi016.stdout:in 0 2024-08-01T07:04:02.920 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=34414} 2024-08-01T07:04:02.920 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T07:04:02.920 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T07:04:02.920 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 1 2024-08-01T07:04:02.920 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T07:04:02.920 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T07:04:02.921 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T07:04:02.921 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T07:04:02.921 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T07:04:02.921 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T07:04:02.921 INFO:teuthology.orchestra.run.smithi016.stdout:qdb_cluster leader: 34414 members: 34414 2024-08-01T07:04:02.921 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:34414} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.16:6826/4064792079,v1:172.21.15.16:6827/4064792079] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:04:02.921 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:04:02.921 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:04:02.921 INFO:teuthology.orchestra.run.smithi016.stdout:Standby daemons: 2024-08-01T07:04:02.921 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:04:02.921 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{-1:34446} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.16:6828/2186852070,v1:172.21.15.16:6829/2186852070] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:04:02.921 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{-1:44357} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6824/3335707325,v1:172.21.15.89:6825/3335707325] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:04:02.922 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 34 2024-08-01T07:04:02.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.919+0000 7fa4d78d5640 1 -- 172.21.15.16:0/2928205559 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa4bc06e170 msgr2=0x7fa4bc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:02.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.919+0000 7fa4d78d5640 1 --2- 172.21.15.16:0/2928205559 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa4bc06e170 0x7fa4bc070630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc000c00 tx=0x7fa4cc0314a0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.919+0000 7fa4d78d5640 1 -- 172.21.15.16:0/2928205559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d0103070 msgr2=0x7fa4d0197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:02.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.919+0000 7fa4d78d5640 1 --2- 172.21.15.16:0/2928205559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d0103070 0x7fa4d0197e50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400e9a0 tx=0x7fa4c400ee60 comp rx=0 tx=0).stop 2024-08-01T07:04:02.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.919+0000 7fa4d78d5640 1 -- 172.21.15.16:0/2928205559 shutdown_connections 2024-08-01T07:04:02.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.919+0000 7fa4d78d5640 1 --2- 172.21.15.16:0/2928205559 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa4bc06e170 0x7fa4bc070630 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.919+0000 7fa4d78d5640 1 --2- 172.21.15.16:0/2928205559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d0103070 0x7fa4d0197e50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.919+0000 7fa4d78d5640 1 --2- 172.21.15.16:0/2928205559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4d0100740 0x7fa4d0197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:02.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.919+0000 7fa4d78d5640 1 -- 172.21.15.16:0/2928205559 >> 172.21.15.16:0/2928205559 conn(0x7fa4d00fa280 msgr2=0x7fa4d00fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:02.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.919+0000 7fa4d78d5640 1 -- 172.21.15.16:0/2928205559 shutdown_connections 2024-08-01T07:04:02.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:02.919+0000 7fa4d78d5640 1 -- 172.21.15.16:0/2928205559 wait complete. 2024-08-01T07:04:03.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.003+0000 7f98edacd640 1 -- 172.21.15.16:0/1665779704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98e80feaa0 msgr2=0x7f98e80feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:03.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.003+0000 7f98edacd640 1 --2- 172.21.15.16:0/1665779704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98e80feaa0 0x7f98e80feea0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f98d8009880 tx=0x7f98d802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:04:03.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.003+0000 7f98edacd640 1 -- 172.21.15.16:0/1665779704 shutdown_connections 2024-08-01T07:04:03.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.003+0000 7f98edacd640 1 --2- 172.21.15.16:0/1665779704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98e80ffca0 0x7f98e8100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:03.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.003+0000 7f98edacd640 1 --2- 172.21.15.16:0/1665779704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98e80feaa0 0x7f98e80feea0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:03.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.003+0000 7f98edacd640 1 -- 172.21.15.16:0/1665779704 >> 172.21.15.16:0/1665779704 conn(0x7f98e80fa250 msgr2=0x7f98e80fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:03.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.003+0000 7f98edacd640 1 -- 172.21.15.16:0/1665779704 shutdown_connections 2024-08-01T07:04:03.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.003+0000 7f98edacd640 1 -- 172.21.15.16:0/1665779704 wait complete. 2024-08-01T07:04:03.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.004+0000 7f98edacd640 1 Processor -- start 2024-08-01T07:04:03.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.004+0000 7f98edacd640 1 -- start start 2024-08-01T07:04:03.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.004+0000 7f98edacd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98e80feaa0 0x7f98e8068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:03.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.004+0000 7f98edacd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98e80ffca0 0x7f98e819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:03.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.004+0000 7f98edacd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e819a9a0 con 0x7f98e80ffca0 2024-08-01T07:04:03.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.004+0000 7f98edacd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e819aae0 con 0x7f98e80feaa0 2024-08-01T07:04:03.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.004+0000 7f98e6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98e80ffca0 0x7f98e819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:03.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.004+0000 7f98e6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98e80ffca0 0x7f98e819a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49796/0 (socket says 172.21.15.16:49796) 2024-08-01T07:04:03.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.004+0000 7f98e6ffd640 1 -- 172.21.15.16:0/3559732952 learned_addr learned my addr 172.21.15.16:0/3559732952 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:04:03.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.004+0000 7f98e77fe640 1 --2- 172.21.15.16:0/3559732952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98e80feaa0 0x7f98e8068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:03.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.005+0000 7f98e6ffd640 1 -- 172.21.15.16:0/3559732952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98e80feaa0 msgr2=0x7f98e8068fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:03.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.005+0000 7f98e6ffd640 1 --2- 172.21.15.16:0/3559732952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98e80feaa0 0x7f98e8068fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:03.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.005+0000 7f98e6ffd640 1 -- 172.21.15.16:0/3559732952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d8009560 con 0x7f98e80ffca0 2024-08-01T07:04:03.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.005+0000 7f98e6ffd640 1 --2- 172.21.15.16:0/3559732952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98e80ffca0 0x7f98e819a3d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00e970 tx=0x7f98dc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:03.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.005+0000 7f98e4ff9640 1 -- 172.21.15.16:0/3559732952 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98dc00cc90 con 0x7f98e80ffca0 2024-08-01T07:04:03.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.005+0000 7f98e4ff9640 1 -- 172.21.15.16:0/3559732952 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98dc00cdf0 con 0x7f98e80ffca0 2024-08-01T07:04:03.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.005+0000 7f98edacd640 1 -- 172.21.15.16:0/3559732952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e819ad90 con 0x7f98e80ffca0 2024-08-01T07:04:03.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.005+0000 7f98e4ff9640 1 -- 172.21.15.16:0/3559732952 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98dc010430 con 0x7f98e80ffca0 2024-08-01T07:04:03.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.005+0000 7f98edacd640 1 -- 172.21.15.16:0/3559732952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e819b330 con 0x7f98e80ffca0 2024-08-01T07:04:03.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.006+0000 7f98edacd640 1 -- 172.21.15.16:0/3559732952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e80feea0 con 0x7f98e80ffca0 2024-08-01T07:04:03.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.007+0000 7f98e4ff9640 1 -- 172.21.15.16:0/3559732952 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f98dc0046c0 con 0x7f98e80ffca0 2024-08-01T07:04:03.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.007+0000 7f98e4ff9640 1 --2- 172.21.15.16:0/3559732952 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f98d006e170 0x7f98d0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:03.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.007+0000 7f98e4ff9640 1 -- 172.21.15.16:0/3559732952 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f98dc014070 con 0x7f98e80ffca0 2024-08-01T07:04:03.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.007+0000 7f98e77fe640 1 --2- 172.21.15.16:0/3559732952 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f98d006e170 0x7f98d0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:03.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.008+0000 7f98e77fe640 1 --2- 172.21.15.16:0/3559732952 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f98d006e170 0x7f98d0070630 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f98d8005940 tx=0x7f98d80058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:03.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.011+0000 7f98e4ff9640 1 -- 172.21.15.16:0/3559732952 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f98dc0579d0 con 0x7f98e80ffca0 2024-08-01T07:04:03.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.205+0000 7f98edacd640 1 -- 172.21.15.16:0/3559732952 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98e802c540 con 0x7f98d006e170 2024-08-01T07:04:03.207 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:03 smithi016 ceph-mon[93645]: pgmap v222: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:04:03.207 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:03 smithi016 ceph-mon[93645]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:04:03.207 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:03 smithi016 ceph-mon[93645]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:04:03.207 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:03 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:04:03.207 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:03 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/1341903445' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:03.207 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:03 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2928205559' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:04:03.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.206+0000 7f98e4ff9640 1 -- 172.21.15.16:0/3559732952 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f98e802c540 con 0x7f98d006e170 2024-08-01T07:04:03.208 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:04:03.208 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T07:04:03.208 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T07:04:03.208 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T07:04:03.208 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-08-01T07:04:03.208 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-08-01T07:04:03.208 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr", 2024-08-01T07:04:03.208 INFO:teuthology.orchestra.run.smithi016.stdout: "osd", 2024-08-01T07:04:03.209 INFO:teuthology.orchestra.run.smithi016.stdout: "crash" 2024-08-01T07:04:03.209 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-08-01T07:04:03.209 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "15/23 daemons upgraded", 2024-08-01T07:04:03.209 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading mds daemons", 2024-08-01T07:04:03.209 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T07:04:03.209 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:04:03.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.208+0000 7f98edacd640 1 -- 172.21.15.16:0/3559732952 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f98d006e170 msgr2=0x7f98d0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:03.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.208+0000 7f98edacd640 1 --2- 172.21.15.16:0/3559732952 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f98d006e170 0x7f98d0070630 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f98d8005940 tx=0x7f98d80058d0 comp rx=0 tx=0).stop 2024-08-01T07:04:03.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.208+0000 7f98edacd640 1 -- 172.21.15.16:0/3559732952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98e80ffca0 msgr2=0x7f98e819a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:03.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.208+0000 7f98edacd640 1 --2- 172.21.15.16:0/3559732952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98e80ffca0 0x7f98e819a3d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00e970 tx=0x7f98dc00ed70 comp rx=0 tx=0).stop 2024-08-01T07:04:03.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.208+0000 7f98edacd640 1 -- 172.21.15.16:0/3559732952 shutdown_connections 2024-08-01T07:04:03.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.208+0000 7f98edacd640 1 --2- 172.21.15.16:0/3559732952 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f98d006e170 0x7f98d0070630 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:03.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.208+0000 7f98edacd640 1 --2- 172.21.15.16:0/3559732952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98e80ffca0 0x7f98e819a3d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:03.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.208+0000 7f98edacd640 1 --2- 172.21.15.16:0/3559732952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98e80feaa0 0x7f98e8068fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:03.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.208+0000 7f98edacd640 1 -- 172.21.15.16:0/3559732952 >> 172.21.15.16:0/3559732952 conn(0x7f98e80fa250 msgr2=0x7f98e8103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:03.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.209+0000 7f98edacd640 1 -- 172.21.15.16:0/3559732952 shutdown_connections 2024-08-01T07:04:03.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.209+0000 7f98edacd640 1 -- 172.21.15.16:0/3559732952 wait complete. 2024-08-01T07:04:03.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.292+0000 7f2abe92c640 1 -- 172.21.15.16:0/3641746318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ab80ffb90 msgr2=0x7f2ab80fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:03.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.292+0000 7f2abe92c640 1 --2- 172.21.15.16:0/3641746318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ab80ffb90 0x7f2ab80fff90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009880 tx=0x7f2aa802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:04:03.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.293+0000 7f2abe92c640 1 -- 172.21.15.16:0/3641746318 shutdown_connections 2024-08-01T07:04:03.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.293+0000 7f2abe92c640 1 --2- 172.21.15.16:0/3641746318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab8100d90 0x7f2ab8101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:03.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.293+0000 7f2abe92c640 1 --2- 172.21.15.16:0/3641746318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ab80ffb90 0x7f2ab80fff90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:03.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.293+0000 7f2abe92c640 1 -- 172.21.15.16:0/3641746318 >> 172.21.15.16:0/3641746318 conn(0x7f2ab80fb320 msgr2=0x7f2ab80fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:03.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.293+0000 7f2abe92c640 1 -- 172.21.15.16:0/3641746318 shutdown_connections 2024-08-01T07:04:03.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.293+0000 7f2abe92c640 1 -- 172.21.15.16:0/3641746318 wait complete. 2024-08-01T07:04:03.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.293+0000 7f2abe92c640 1 Processor -- start 2024-08-01T07:04:03.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.293+0000 7f2abe92c640 1 -- start start 2024-08-01T07:04:03.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.294+0000 7f2abe92c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ab80ffb90 0x7f2ab8195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:03.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.294+0000 7f2abe92c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab8100d90 0x7f2ab8195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:03.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.294+0000 7f2abe92c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab81961a0 con 0x7f2ab80ffb90 2024-08-01T07:04:03.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.294+0000 7f2abe92c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab8196310 con 0x7f2ab8100d90 2024-08-01T07:04:03.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.294+0000 7f2ab7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ab80ffb90 0x7f2ab8195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:03.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.294+0000 7f2ab7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ab80ffb90 0x7f2ab8195690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49820/0 (socket says 172.21.15.16:49820) 2024-08-01T07:04:03.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.294+0000 7f2ab7fff640 1 -- 172.21.15.16:0/1499265638 learned_addr learned my addr 172.21.15.16:0/1499265638 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:04:03.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.294+0000 7f2ab77fe640 1 --2- 172.21.15.16:0/1499265638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab8100d90 0x7f2ab8195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:03.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.294+0000 7f2ab7fff640 1 -- 172.21.15.16:0/1499265638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab8100d90 msgr2=0x7f2ab8195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:03.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.294+0000 7f2ab7fff640 1 --2- 172.21.15.16:0/1499265638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab8100d90 0x7f2ab8195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:03.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.294+0000 7f2ab7fff640 1 -- 172.21.15.16:0/1499265638 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa8009560 con 0x7f2ab80ffb90 2024-08-01T07:04:03.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.294+0000 7f2ab7fff640 1 --2- 172.21.15.16:0/1499265638 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ab80ffb90 0x7f2ab8195690 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8004650 tx=0x7f2aa80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:03.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.294+0000 7f2ab57fa640 1 -- 172.21.15.16:0/1499265638 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2aa8004aa0 con 0x7f2ab80ffb90 2024-08-01T07:04:03.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.294+0000 7f2ab57fa640 1 -- 172.21.15.16:0/1499265638 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2aa8005d50 con 0x7f2ab80ffb90 2024-08-01T07:04:03.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.294+0000 7f2abe92c640 1 -- 172.21.15.16:0/1499265638 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab819ad00 con 0x7f2ab80ffb90 2024-08-01T07:04:03.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.295+0000 7f2ab57fa640 1 -- 172.21.15.16:0/1499265638 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2aa80039e0 con 0x7f2ab80ffb90 2024-08-01T07:04:03.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.295+0000 7f2abe92c640 1 -- 172.21.15.16:0/1499265638 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab819b220 con 0x7f2ab80ffb90 2024-08-01T07:04:03.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.296+0000 7f2abe92c640 1 -- 172.21.15.16:0/1499265638 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab818f730 con 0x7f2ab80ffb90 2024-08-01T07:04:03.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.296+0000 7f2ab57fa640 1 -- 172.21.15.16:0/1499265638 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2aa8031c00 con 0x7f2ab80ffb90 2024-08-01T07:04:03.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.296+0000 7f2ab57fa640 1 --2- 172.21.15.16:0/1499265638 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f2aa006e170 0x7f2aa0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:03.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.297+0000 7f2ab57fa640 1 -- 172.21.15.16:0/1499265638 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f2aa80af320 con 0x7f2ab80ffb90 2024-08-01T07:04:03.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.297+0000 7f2ab77fe640 1 --2- 172.21.15.16:0/1499265638 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f2aa006e170 0x7f2aa0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:03.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.297+0000 7f2ab77fe640 1 --2- 172.21.15.16:0/1499265638 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f2aa006e170 0x7f2aa0070630 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8196b60 tx=0x7f2aac005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:03.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.301+0000 7f2ab57fa640 1 -- 172.21.15.16:0/1499265638 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2aa8078590 con 0x7f2ab80ffb90 2024-08-01T07:04:03.383 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:03 smithi089 ceph-mon[82218]: pgmap v222: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:04:03.383 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:03 smithi089 ceph-mon[82218]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:04:03.383 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:03 smithi089 ceph-mon[82218]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:04:03.383 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:03 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:04:03.383 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:03 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/1341903445' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:03.384 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:03 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2928205559' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:04:03.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.547+0000 7f2abe92c640 1 -- 172.21.15.16:0/1499265638 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2ab81087a0 con 0x7f2ab80ffb90 2024-08-01T07:04:03.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.547+0000 7f2ab57fa640 1 -- 172.21.15.16:0/1499265638 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f2aa8076e60 con 0x7f2ab80ffb90 2024-08-01T07:04:03.549 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-08-01T07:04:03.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.550+0000 7f2abe92c640 1 -- 172.21.15.16:0/1499265638 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f2aa006e170 msgr2=0x7f2aa0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:03.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.550+0000 7f2abe92c640 1 --2- 172.21.15.16:0/1499265638 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f2aa006e170 0x7f2aa0070630 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8196b60 tx=0x7f2aac005f90 comp rx=0 tx=0).stop 2024-08-01T07:04:03.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.550+0000 7f2abe92c640 1 -- 172.21.15.16:0/1499265638 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ab80ffb90 msgr2=0x7f2ab8195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:03.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.550+0000 7f2abe92c640 1 --2- 172.21.15.16:0/1499265638 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ab80ffb90 0x7f2ab8195690 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8004650 tx=0x7f2aa80055a0 comp rx=0 tx=0).stop 2024-08-01T07:04:03.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.550+0000 7f2abe92c640 1 -- 172.21.15.16:0/1499265638 shutdown_connections 2024-08-01T07:04:03.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.550+0000 7f2abe92c640 1 --2- 172.21.15.16:0/1499265638 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f2aa006e170 0x7f2aa0070630 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:03.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.550+0000 7f2abe92c640 1 --2- 172.21.15.16:0/1499265638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab8100d90 0x7f2ab8195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:03.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.550+0000 7f2abe92c640 1 --2- 172.21.15.16:0/1499265638 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ab80ffb90 0x7f2ab8195690 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:03.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.550+0000 7f2abe92c640 1 -- 172.21.15.16:0/1499265638 >> 172.21.15.16:0/1499265638 conn(0x7f2ab80fb320 msgr2=0x7f2ab81044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:03.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.550+0000 7f2abe92c640 1 -- 172.21.15.16:0/1499265638 shutdown_connections 2024-08-01T07:04:03.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:03.550+0000 7f2abe92c640 1 -- 172.21.15.16:0/1499265638 wait complete. 2024-08-01T07:04:04.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:04 smithi089 ceph-mon[82218]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:04:04.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:04 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/1499265638' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:04:04.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:04 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:04.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:04 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:04.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:04 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:04:04.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:04 smithi016 ceph-mon[93645]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:04:04.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:04 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/1499265638' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:04:04.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:04 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:04.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:04 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:04.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:04 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:04:05.359 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:05 smithi089 ceph-mon[82218]: pgmap v223: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:04:05.359 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:05 smithi089 ceph-mon[82218]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:04:05.359 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:05 smithi089 ceph-mon[82218]: mds.? [v2:172.21.15.89:6826/885893699,v1:172.21.15.89:6827/885893699] up:boot 2024-08-01T07:04:05.359 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:05 smithi089 ceph-mon[82218]: fsmap cephfs:1 {0=cephfs.smithi016.bgqkxu=up:active} 3 up:standby 2024-08-01T07:04:05.359 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:05 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.xanuld"}]: dispatch 2024-08-01T07:04:05.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:05 smithi016 ceph-mon[93645]: pgmap v223: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:04:05.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:05 smithi016 ceph-mon[93645]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:04:05.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:05 smithi016 ceph-mon[93645]: mds.? [v2:172.21.15.89:6826/885893699,v1:172.21.15.89:6827/885893699] up:boot 2024-08-01T07:04:05.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:05 smithi016 ceph-mon[93645]: fsmap cephfs:1 {0=cephfs.smithi016.bgqkxu=up:active} 3 up:standby 2024-08-01T07:04:05.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:05 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.xanuld"}]: dispatch 2024-08-01T07:04:06.358 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:06 smithi016 ceph-mon[93645]: pgmap v224: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:04:06.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:06 smithi089 ceph-mon[82218]: pgmap v224: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:04:07.784 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:07.784 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:07.784 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:07.784 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:07.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:07.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:07.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:07.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:08.729 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:08 smithi089 ceph-mon[82218]: pgmap v225: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:04:08.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:08 smithi016 ceph-mon[93645]: pgmap v225: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:04:10.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: pgmap v226: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:04:10.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:10.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:10.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:04:10.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:04:10.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:10.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:04:10.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:10.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:10.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:10.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:10.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:10.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:10.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi016.bgqkxu"}]: dispatch 2024-08-01T07:04:10.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi016.bgqkxu"}]': finished 2024-08-01T07:04:10.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi016.fziqod"}]: dispatch 2024-08-01T07:04:10.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi016.fziqod"}]': finished 2024-08-01T07:04:10.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.jhouje"}]: dispatch 2024-08-01T07:04:10.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.jhouje"}]': finished 2024-08-01T07:04:10.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.xanuld"}]: dispatch 2024-08-01T07:04:10.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.xanuld"}]': finished 2024-08-01T07:04:10.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:10 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-08-01T07:04:10.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: pgmap v226: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:04:10.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:04:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:04:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:04:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:10.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi016.bgqkxu"}]: dispatch 2024-08-01T07:04:10.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi016.bgqkxu"}]': finished 2024-08-01T07:04:10.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi016.fziqod"}]: dispatch 2024-08-01T07:04:10.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi016.fziqod"}]': finished 2024-08-01T07:04:10.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.jhouje"}]: dispatch 2024-08-01T07:04:10.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.jhouje"}]': finished 2024-08-01T07:04:10.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.xanuld"}]: dispatch 2024-08-01T07:04:10.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.xanuld"}]': finished 2024-08-01T07:04:10.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:10 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-08-01T07:04:11.673 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:11 smithi089 ceph-mon[82218]: Upgrade: Setting container_image for all mds 2024-08-01T07:04:11.673 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:11 smithi089 ceph-mon[82218]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-08-01T07:04:11.673 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:11 smithi089 ceph-mon[82218]: daemon mds.cephfs.smithi016.fziqod assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-01T07:04:11.673 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:11 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-08-01T07:04:11.673 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:11 smithi089 ceph-mon[82218]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi016.fziqod=up:starting} 2 up:standby 2024-08-01T07:04:11.673 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:11 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:11.674 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:11 smithi089 ceph-mon[82218]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-08-01T07:04:11.674 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:11 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-08-01T07:04:11.674 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:11 smithi089 ceph-mon[82218]: daemon mds.cephfs.smithi016.fziqod is now active in filesystem cephfs as rank 1 2024-08-01T07:04:11.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:11 smithi016 ceph-mon[93645]: Upgrade: Setting container_image for all mds 2024-08-01T07:04:11.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:11 smithi016 ceph-mon[93645]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-08-01T07:04:11.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:11 smithi016 ceph-mon[93645]: daemon mds.cephfs.smithi016.fziqod assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-01T07:04:11.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:11 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-08-01T07:04:11.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:11 smithi016 ceph-mon[93645]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi016.fziqod=up:starting} 2 up:standby 2024-08-01T07:04:11.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:11 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:11.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:11 smithi016 ceph-mon[93645]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-08-01T07:04:11.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:11 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-08-01T07:04:11.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:11 smithi016 ceph-mon[93645]: daemon mds.cephfs.smithi016.fziqod is now active in filesystem cephfs as rank 1 2024-08-01T07:04:12.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:12 smithi089 ceph-mon[82218]: pgmap v227: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:04:12.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:12 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-08-01T07:04:12.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:12 smithi089 ceph-mon[82218]: mds.? [v2:172.21.15.16:6828/2186852070,v1:172.21.15.16:6829/2186852070] up:active 2024-08-01T07:04:12.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:12 smithi089 ceph-mon[82218]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi016.fziqod=up:active} 2 up:standby 2024-08-01T07:04:12.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:12 smithi089 ceph-mon[82218]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi016.fziqod=up:active} 2 up:standby-replay 2024-08-01T07:04:12.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:12 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:12.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:12 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:12.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:12 smithi089 ceph-mon[82218]: Upgrade: Setting container_image for all rgw 2024-08-01T07:04:12.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:12 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:12.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:12 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:12.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:12 smithi089 ceph-mon[82218]: Upgrade: Setting container_image for all rbd-mirror 2024-08-01T07:04:12.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:12 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:12.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:12 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:12.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:12 smithi016 ceph-mon[93645]: pgmap v227: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-08-01T07:04:12.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:12 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-08-01T07:04:12.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:12 smithi016 ceph-mon[93645]: mds.? [v2:172.21.15.16:6828/2186852070,v1:172.21.15.16:6829/2186852070] up:active 2024-08-01T07:04:12.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:12 smithi016 ceph-mon[93645]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi016.fziqod=up:active} 2 up:standby 2024-08-01T07:04:12.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:12 smithi016 ceph-mon[93645]: fsmap cephfs:2 {0=cephfs.smithi016.bgqkxu=up:active,1=cephfs.smithi016.fziqod=up:active} 2 up:standby-replay 2024-08-01T07:04:12.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:12 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:12.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:12 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:12.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:12 smithi016 ceph-mon[93645]: Upgrade: Setting container_image for all rgw 2024-08-01T07:04:12.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:12 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:12.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:12 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:12.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:12 smithi016 ceph-mon[93645]: Upgrade: Setting container_image for all rbd-mirror 2024-08-01T07:04:12.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:12 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:12.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:12 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:14.343 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:14 smithi016 ceph-mon[93645]: Upgrade: Updating ceph-exporter.smithi016 (1/2) 2024-08-01T07:04:14.343 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:14 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:14.343 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:14 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi016", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-01T07:04:14.343 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:14 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:04:14.343 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:14 smithi016 ceph-mon[93645]: Deploying daemon ceph-exporter.smithi016 on smithi016 2024-08-01T07:04:14.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:14 smithi089 ceph-mon[82218]: Upgrade: Updating ceph-exporter.smithi016 (1/2) 2024-08-01T07:04:14.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:14 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:14.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:14 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi016", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-01T07:04:14.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:14 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:04:14.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:14 smithi089 ceph-mon[82218]: Deploying daemon ceph-exporter.smithi016 on smithi016 2024-08-01T07:04:15.241 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:15 smithi016 ceph-mon[93645]: pgmap v228: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 85 B/s wr, 5 op/s 2024-08-01T07:04:15.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:15 smithi089 ceph-mon[82218]: pgmap v228: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 85 B/s wr, 5 op/s 2024-08-01T07:04:17.350 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:17 smithi089 ceph-mon[82218]: pgmap v229: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 7.3 MiB/s rd, 170 B/s wr, 9 op/s 2024-08-01T07:04:17.350 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:17.350 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:17.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:17 smithi016 ceph-mon[93645]: pgmap v229: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 7.3 MiB/s rd, 170 B/s wr, 9 op/s 2024-08-01T07:04:17.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:17.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:18.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:04:18.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:04:19.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:19 smithi089 ceph-mon[82218]: pgmap v230: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 170 B/s wr, 10 op/s 2024-08-01T07:04:19.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:19 smithi089 ceph-mon[82218]: Upgrade: Updating ceph-exporter.smithi089 (2/2) 2024-08-01T07:04:19.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:19 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:19.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:19 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-01T07:04:19.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:19 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:04:19.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:19 smithi089 ceph-mon[82218]: Deploying daemon ceph-exporter.smithi089 on smithi089 2024-08-01T07:04:19.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:19 smithi016 ceph-mon[93645]: pgmap v230: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 170 B/s wr, 10 op/s 2024-08-01T07:04:19.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:19 smithi016 ceph-mon[93645]: Upgrade: Updating ceph-exporter.smithi089 (2/2) 2024-08-01T07:04:19.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:19 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:19.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:19 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi089", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-01T07:04:19.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:19 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:04:19.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:19 smithi016 ceph-mon[93645]: Deploying daemon ceph-exporter.smithi089 on smithi089 2024-08-01T07:04:20.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:20 smithi089 ceph-mon[82218]: pgmap v231: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 13 op/s 2024-08-01T07:04:20.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:20 smithi016 ceph-mon[93645]: pgmap v231: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 13 op/s 2024-08-01T07:04:22.379 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:22 smithi089 ceph-mon[82218]: pgmap v232: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 13 op/s 2024-08-01T07:04:22.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:22 smithi016 ceph-mon[93645]: pgmap v232: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 13 op/s 2024-08-01T07:04:24.482 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:24 smithi089 ceph-mon[82218]: pgmap v233: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 13 op/s 2024-08-01T07:04:24.523 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:24 smithi016 ceph-mon[93645]: pgmap v233: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 13 op/s 2024-08-01T07:04:26.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:26 smithi089 ceph-mon[82218]: pgmap v234: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 85 B/s wr, 8 op/s 2024-08-01T07:04:26.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:26 smithi016 ceph-mon[93645]: pgmap v234: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 85 B/s wr, 8 op/s 2024-08-01T07:04:27.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:27 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:27.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:27 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:27.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:27 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:04:27.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:27 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:27.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:27 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:27.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:27 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:04:28.632 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:28 smithi089 ceph-mon[82218]: pgmap v235: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 9.8 MiB/s rd, 5 op/s 2024-08-01T07:04:28.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:28 smithi016 ceph-mon[93645]: pgmap v235: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 9.8 MiB/s rd, 5 op/s 2024-08-01T07:04:29.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:29.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:29.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:29.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:29 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:29.979 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:29.979 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:29.979 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:29.979 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:29 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:31.049 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:30 smithi089 ceph-mon[82218]: pgmap v236: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 7.2 MiB/s rd, 5 op/s 2024-08-01T07:04:31.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:30 smithi016 ceph-mon[93645]: pgmap v236: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 7.2 MiB/s rd, 5 op/s 2024-08-01T07:04:32.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:32.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:32.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:32.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:31 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:32.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:32.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:32.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:32.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:31 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:33.367 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:32 smithi016 ceph-mon[93645]: pgmap v237: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-08-01T07:04:33.368 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:04:33.368 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:33.368 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:32 smithi089 ceph-mon[82218]: pgmap v237: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-08-01T07:04:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:04:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:33.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.639+0000 7f3e491d4640 1 -- 172.21.15.16:0/1038603539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e440ffb90 msgr2=0x7f3e440fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:33.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.639+0000 7f3e491d4640 1 --2- 172.21.15.16:0/1038603539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e440ffb90 0x7f3e440fff90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009880 tx=0x7f3e3402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:04:33.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.639+0000 7f3e491d4640 1 -- 172.21.15.16:0/1038603539 shutdown_connections 2024-08-01T07:04:33.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.639+0000 7f3e491d4640 1 --2- 172.21.15.16:0/1038603539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e44100d90 0x7f3e44101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:33.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.639+0000 7f3e491d4640 1 --2- 172.21.15.16:0/1038603539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e440ffb90 0x7f3e440fff90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:33.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.639+0000 7f3e491d4640 1 -- 172.21.15.16:0/1038603539 >> 172.21.15.16:0/1038603539 conn(0x7f3e440fb360 msgr2=0x7f3e440fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:33.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.639+0000 7f3e491d4640 1 -- 172.21.15.16:0/1038603539 shutdown_connections 2024-08-01T07:04:33.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.639+0000 7f3e491d4640 1 -- 172.21.15.16:0/1038603539 wait complete. 2024-08-01T07:04:33.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.640+0000 7f3e491d4640 1 Processor -- start 2024-08-01T07:04:33.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.640+0000 7f3e491d4640 1 -- start start 2024-08-01T07:04:33.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.640+0000 7f3e491d4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e440ffb90 0x7f3e44195610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:33.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.640+0000 7f3e491d4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e44100d90 0x7f3e44195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:33.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.640+0000 7f3e491d4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e44196120 con 0x7f3e440ffb90 2024-08-01T07:04:33.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.640+0000 7f3e491d4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e44196290 con 0x7f3e44100d90 2024-08-01T07:04:33.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.640+0000 7f3e42d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e440ffb90 0x7f3e44195610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:33.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.640+0000 7f3e42d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e440ffb90 0x7f3e44195610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52840/0 (socket says 172.21.15.16:52840) 2024-08-01T07:04:33.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.640+0000 7f3e42d9d640 1 -- 172.21.15.16:0/301769242 learned_addr learned my addr 172.21.15.16:0/301769242 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:04:33.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.640+0000 7f3e3a59c640 1 --2- 172.21.15.16:0/301769242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e44100d90 0x7f3e44195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:33.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.641+0000 7f3e42d9d640 1 -- 172.21.15.16:0/301769242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e44100d90 msgr2=0x7f3e44195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:33.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.641+0000 7f3e42d9d640 1 --2- 172.21.15.16:0/301769242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e44100d90 0x7f3e44195b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:33.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.641+0000 7f3e42d9d640 1 -- 172.21.15.16:0/301769242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e34009560 con 0x7f3e440ffb90 2024-08-01T07:04:33.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.641+0000 7f3e42d9d640 1 --2- 172.21.15.16:0/301769242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e440ffb90 0x7f3e44195610 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3e340054f0 tx=0x7f3e34005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:33.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.641+0000 7f3e40d99640 1 -- 172.21.15.16:0/301769242 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e34004aa0 con 0x7f3e440ffb90 2024-08-01T07:04:33.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.641+0000 7f3e491d4640 1 -- 172.21.15.16:0/301769242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4419acd0 con 0x7f3e440ffb90 2024-08-01T07:04:33.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.641+0000 7f3e40d99640 1 -- 172.21.15.16:0/301769242 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3e34004c00 con 0x7f3e440ffb90 2024-08-01T07:04:33.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.641+0000 7f3e40d99640 1 -- 172.21.15.16:0/301769242 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e34003ac0 con 0x7f3e440ffb90 2024-08-01T07:04:33.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.641+0000 7f3e491d4640 1 -- 172.21.15.16:0/301769242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4419b1c0 con 0x7f3e440ffb90 2024-08-01T07:04:33.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.642+0000 7f3e491d4640 1 -- 172.21.15.16:0/301769242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e44108780 con 0x7f3e440ffb90 2024-08-01T07:04:33.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.643+0000 7f3e40d99640 1 -- 172.21.15.16:0/301769242 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3e34003d80 con 0x7f3e440ffb90 2024-08-01T07:04:33.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.643+0000 7f3e40d99640 1 --2- 172.21.15.16:0/301769242 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f3e3006e180 0x7f3e30070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:33.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.643+0000 7f3e40d99640 1 -- 172.21.15.16:0/301769242 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f3e340af570 con 0x7f3e440ffb90 2024-08-01T07:04:33.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.643+0000 7f3e3a59c640 1 --2- 172.21.15.16:0/301769242 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f3e3006e180 0x7f3e30070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:33.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.644+0000 7f3e3a59c640 1 --2- 172.21.15.16:0/301769242 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f3e3006e180 0x7f3e30070640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c005fd0 tx=0x7f3e2c005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:33.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.648+0000 7f3e40d99640 1 -- 172.21.15.16:0/301769242 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3e34078730 con 0x7f3e440ffb90 2024-08-01T07:04:33.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.844+0000 7f3e491d4640 1 -- 172.21.15.16:0/301769242 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e4419b3e0 con 0x7f3e3006e180 2024-08-01T07:04:33.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.845+0000 7f3e40d99640 1 -- 172.21.15.16:0/301769242 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f3e4419b3e0 con 0x7f3e3006e180 2024-08-01T07:04:33.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.847+0000 7f3e491d4640 1 -- 172.21.15.16:0/301769242 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f3e3006e180 msgr2=0x7f3e30070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:33.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.847+0000 7f3e491d4640 1 --2- 172.21.15.16:0/301769242 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f3e3006e180 0x7f3e30070640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c005fd0 tx=0x7f3e2c005850 comp rx=0 tx=0).stop 2024-08-01T07:04:33.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.847+0000 7f3e491d4640 1 -- 172.21.15.16:0/301769242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e440ffb90 msgr2=0x7f3e44195610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:33.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.847+0000 7f3e491d4640 1 --2- 172.21.15.16:0/301769242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e440ffb90 0x7f3e44195610 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3e340054f0 tx=0x7f3e34005520 comp rx=0 tx=0).stop 2024-08-01T07:04:33.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.848+0000 7f3e491d4640 1 -- 172.21.15.16:0/301769242 shutdown_connections 2024-08-01T07:04:33.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.848+0000 7f3e491d4640 1 --2- 172.21.15.16:0/301769242 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f3e3006e180 0x7f3e30070640 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:33.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.848+0000 7f3e491d4640 1 --2- 172.21.15.16:0/301769242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e44100d90 0x7f3e44195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:33.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.848+0000 7f3e491d4640 1 --2- 172.21.15.16:0/301769242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e440ffb90 0x7f3e44195610 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:33.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.848+0000 7f3e491d4640 1 -- 172.21.15.16:0/301769242 >> 172.21.15.16:0/301769242 conn(0x7f3e440fb360 msgr2=0x7f3e44103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:33.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.848+0000 7f3e491d4640 1 -- 172.21.15.16:0/301769242 shutdown_connections 2024-08-01T07:04:33.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.848+0000 7f3e491d4640 1 -- 172.21.15.16:0/301769242 wait complete. 2024-08-01T07:04:33.858 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T07:04:33.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.934+0000 7f9a64f9c640 1 -- 172.21.15.16:0/3813160877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a600feaf0 msgr2=0x7f9a600feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:33.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.934+0000 7f9a64f9c640 1 --2- 172.21.15.16:0/3813160877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a600feaf0 0x7f9a600feef0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9a50009880 tx=0x7f9a5002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:04:33.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.934+0000 7f9a64f9c640 1 -- 172.21.15.16:0/3813160877 shutdown_connections 2024-08-01T07:04:33.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.934+0000 7f9a64f9c640 1 --2- 172.21.15.16:0/3813160877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a600ffcf0 0x7f9a60100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:33.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.934+0000 7f9a64f9c640 1 --2- 172.21.15.16:0/3813160877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a600feaf0 0x7f9a600feef0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:33.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.934+0000 7f9a64f9c640 1 -- 172.21.15.16:0/3813160877 >> 172.21.15.16:0/3813160877 conn(0x7f9a600fa280 msgr2=0x7f9a600fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:33.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.934+0000 7f9a64f9c640 1 -- 172.21.15.16:0/3813160877 shutdown_connections 2024-08-01T07:04:33.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.934+0000 7f9a64f9c640 1 -- 172.21.15.16:0/3813160877 wait complete. 2024-08-01T07:04:33.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.934+0000 7f9a64f9c640 1 Processor -- start 2024-08-01T07:04:33.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.934+0000 7f9a64f9c640 1 -- start start 2024-08-01T07:04:33.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.935+0000 7f9a64f9c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a600feaf0 0x7f9a60195660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:33.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.935+0000 7f9a64f9c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a600ffcf0 0x7f9a60195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:33.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.935+0000 7f9a64f9c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a60196170 con 0x7f9a600ffcf0 2024-08-01T07:04:33.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.935+0000 7f9a64f9c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a601962e0 con 0x7f9a600feaf0 2024-08-01T07:04:33.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.935+0000 7f9a57fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a600ffcf0 0x7f9a60195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:33.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.935+0000 7f9a57fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a600ffcf0 0x7f9a60195ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52852/0 (socket says 172.21.15.16:52852) 2024-08-01T07:04:33.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.935+0000 7f9a57fff640 1 -- 172.21.15.16:0/2104140134 learned_addr learned my addr 172.21.15.16:0/2104140134 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:04:33.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.935+0000 7f9a5e59c640 1 --2- 172.21.15.16:0/2104140134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a600feaf0 0x7f9a60195660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:33.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.935+0000 7f9a57fff640 1 -- 172.21.15.16:0/2104140134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a600feaf0 msgr2=0x7f9a60195660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:33.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.935+0000 7f9a57fff640 1 --2- 172.21.15.16:0/2104140134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a600feaf0 0x7f9a60195660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:33.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.935+0000 7f9a57fff640 1 -- 172.21.15.16:0/2104140134 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a50009560 con 0x7f9a600ffcf0 2024-08-01T07:04:33.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.935+0000 7f9a57fff640 1 --2- 172.21.15.16:0/2104140134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a600ffcf0 0x7f9a60195ba0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9a4800d900 tx=0x7f9a4800ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:33.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.936+0000 7f9a577fe640 1 -- 172.21.15.16:0/2104140134 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a48009c00 con 0x7f9a600ffcf0 2024-08-01T07:04:33.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.936+0000 7f9a64f9c640 1 -- 172.21.15.16:0/2104140134 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a6019ad80 con 0x7f9a600ffcf0 2024-08-01T07:04:33.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.936+0000 7f9a577fe640 1 -- 172.21.15.16:0/2104140134 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a4800b660 con 0x7f9a600ffcf0 2024-08-01T07:04:33.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.936+0000 7f9a577fe640 1 -- 172.21.15.16:0/2104140134 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a4800f680 con 0x7f9a600ffcf0 2024-08-01T07:04:33.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.936+0000 7f9a64f9c640 1 -- 172.21.15.16:0/2104140134 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6019b2d0 con 0x7f9a600ffcf0 2024-08-01T07:04:33.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.937+0000 7f9a64f9c640 1 -- 172.21.15.16:0/2104140134 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a601076e0 con 0x7f9a600ffcf0 2024-08-01T07:04:33.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.937+0000 7f9a577fe640 1 -- 172.21.15.16:0/2104140134 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9a48010ab0 con 0x7f9a600ffcf0 2024-08-01T07:04:33.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.938+0000 7f9a577fe640 1 --2- 172.21.15.16:0/2104140134 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9a4c06e180 0x7f9a4c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:33.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.938+0000 7f9a577fe640 1 -- 172.21.15.16:0/2104140134 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f9a4808dfe0 con 0x7f9a600ffcf0 2024-08-01T07:04:33.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.938+0000 7f9a5e59c640 1 --2- 172.21.15.16:0/2104140134 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9a4c06e180 0x7f9a4c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:33.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.938+0000 7f9a5e59c640 1 --2- 172.21.15.16:0/2104140134 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9a4c06e180 0x7f9a4c070640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9a50006010 tx=0x7f9a500314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:33.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:33.942+0000 7f9a577fe640 1 -- 172.21.15.16:0/2104140134 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9a48057250 con 0x7f9a600ffcf0 2024-08-01T07:04:34.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.138+0000 7f9a64f9c640 1 -- 172.21.15.16:0/2104140134 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a6019b4c0 con 0x7f9a4c06e180 2024-08-01T07:04:34.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.140+0000 7f9a577fe640 1 -- 172.21.15.16:0/2104140134 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f9a6019b4c0 con 0x7f9a4c06e180 2024-08-01T07:04:34.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.142+0000 7f9a64f9c640 1 -- 172.21.15.16:0/2104140134 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9a4c06e180 msgr2=0x7f9a4c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.142+0000 7f9a64f9c640 1 --2- 172.21.15.16:0/2104140134 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9a4c06e180 0x7f9a4c070640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9a50006010 tx=0x7f9a500314e0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.142+0000 7f9a64f9c640 1 -- 172.21.15.16:0/2104140134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a600ffcf0 msgr2=0x7f9a60195ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.142+0000 7f9a64f9c640 1 --2- 172.21.15.16:0/2104140134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a600ffcf0 0x7f9a60195ba0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9a4800d900 tx=0x7f9a4800ddc0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.142+0000 7f9a64f9c640 1 -- 172.21.15.16:0/2104140134 shutdown_connections 2024-08-01T07:04:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.142+0000 7f9a64f9c640 1 --2- 172.21.15.16:0/2104140134 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9a4c06e180 0x7f9a4c070640 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.142+0000 7f9a64f9c640 1 --2- 172.21.15.16:0/2104140134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a600ffcf0 0x7f9a60195ba0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.142+0000 7f9a64f9c640 1 --2- 172.21.15.16:0/2104140134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a600feaf0 0x7f9a60195660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.142+0000 7f9a64f9c640 1 -- 172.21.15.16:0/2104140134 >> 172.21.15.16:0/2104140134 conn(0x7f9a600fa280 msgr2=0x7f9a600fbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.142+0000 7f9a64f9c640 1 -- 172.21.15.16:0/2104140134 shutdown_connections 2024-08-01T07:04:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.142+0000 7f9a64f9c640 1 -- 172.21.15.16:0/2104140134 wait complete. 2024-08-01T07:04:34.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.228+0000 7ff6f7519640 1 -- 172.21.15.16:0/1245303804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6f0102f10 msgr2=0x7ff6f0103390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:34.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.228+0000 7ff6f7519640 1 --2- 172.21.15.16:0/1245303804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6f0102f10 0x7ff6f0103390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009880 tx=0x7ff6e002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.228+0000 7ff6f7519640 1 -- 172.21.15.16:0/1245303804 shutdown_connections 2024-08-01T07:04:34.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.228+0000 7ff6f7519640 1 --2- 172.21.15.16:0/1245303804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6f0102f10 0x7ff6f0103390 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.228+0000 7ff6f7519640 1 --2- 172.21.15.16:0/1245303804 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6f0101d10 0x7ff6f0102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.228+0000 7ff6f7519640 1 -- 172.21.15.16:0/1245303804 >> 172.21.15.16:0/1245303804 conn(0x7ff6f00fd4e0 msgr2=0x7ff6f00ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:34.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.229+0000 7ff6f7519640 1 -- 172.21.15.16:0/1245303804 shutdown_connections 2024-08-01T07:04:34.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.229+0000 7ff6f7519640 1 -- 172.21.15.16:0/1245303804 wait complete. 2024-08-01T07:04:34.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.229+0000 7ff6f7519640 1 Processor -- start 2024-08-01T07:04:34.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.229+0000 7ff6f7519640 1 -- start start 2024-08-01T07:04:34.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.230+0000 7ff6f7519640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6f0101d10 0x7ff6f019bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:34.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.230+0000 7ff6f7519640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6f0102f10 0x7ff6f019c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:34.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.230+0000 7ff6f7519640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f019c6a0 con 0x7ff6f0101d10 2024-08-01T07:04:34.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.230+0000 7ff6f7519640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f019c810 con 0x7ff6f0102f10 2024-08-01T07:04:34.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.230+0000 7ff6f52b5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6f0101d10 0x7ff6f019bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:34.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.230+0000 7ff6f52b5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6f0101d10 0x7ff6f019bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52862/0 (socket says 172.21.15.16:52862) 2024-08-01T07:04:34.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.230+0000 7ff6f52b5640 1 -- 172.21.15.16:0/3833912311 learned_addr learned my addr 172.21.15.16:0/3833912311 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:04:34.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.230+0000 7ff6f4ab4640 1 --2- 172.21.15.16:0/3833912311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6f0102f10 0x7ff6f019c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:34.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.230+0000 7ff6f52b5640 1 -- 172.21.15.16:0/3833912311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6f0102f10 msgr2=0x7ff6f019c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:34.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.230+0000 7ff6f52b5640 1 --2- 172.21.15.16:0/3833912311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6f0102f10 0x7ff6f019c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.230+0000 7ff6f52b5640 1 -- 172.21.15.16:0/3833912311 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e0009560 con 0x7ff6f0101d10 2024-08-01T07:04:34.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.230+0000 7ff6f52b5640 1 --2- 172.21.15.16:0/3833912311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6f0101d10 0x7ff6f019bb90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00e970 tx=0x7ff6ec00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:34.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.231+0000 7ff6e67fc640 1 -- 172.21.15.16:0/3833912311 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6ec0096e0 con 0x7ff6f0101d10 2024-08-01T07:04:34.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.231+0000 7ff6e67fc640 1 -- 172.21.15.16:0/3833912311 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6ec0044f0 con 0x7ff6f0101d10 2024-08-01T07:04:34.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.231+0000 7ff6f7519640 1 -- 172.21.15.16:0/3833912311 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f01a12b0 con 0x7ff6f0101d10 2024-08-01T07:04:34.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.231+0000 7ff6f7519640 1 -- 172.21.15.16:0/3833912311 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f01a1850 con 0x7ff6f0101d10 2024-08-01T07:04:34.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.231+0000 7ff6e67fc640 1 -- 172.21.15.16:0/3833912311 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6ec010430 con 0x7ff6f0101d10 2024-08-01T07:04:34.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.232+0000 7ff6f7519640 1 -- 172.21.15.16:0/3833912311 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f0102110 con 0x7ff6f0101d10 2024-08-01T07:04:34.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.233+0000 7ff6e67fc640 1 -- 172.21.15.16:0/3833912311 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff6ec00cc90 con 0x7ff6f0101d10 2024-08-01T07:04:34.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.233+0000 7ff6e67fc640 1 --2- 172.21.15.16:0/3833912311 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff6dc06e180 0x7ff6dc070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:34.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.233+0000 7ff6e67fc640 1 -- 172.21.15.16:0/3833912311 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7ff6ec014070 con 0x7ff6f0101d10 2024-08-01T07:04:34.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.233+0000 7ff6f4ab4640 1 --2- 172.21.15.16:0/3833912311 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff6dc06e180 0x7ff6dc070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:34.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.234+0000 7ff6f4ab4640 1 --2- 172.21.15.16:0/3833912311 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff6dc06e180 0x7ff6dc070640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0000c00 tx=0x7ff6e00314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:34.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.238+0000 7ff6e67fc640 1 -- 172.21.15.16:0/3833912311 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff6ec0578f0 con 0x7ff6f0101d10 2024-08-01T07:04:34.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.423+0000 7ff6f7519640 1 -- 172.21.15.16:0/3833912311 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6f002c4f0 con 0x7ff6dc06e180 2024-08-01T07:04:34.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.433+0000 7ff6e67fc640 1 -- 172.21.15.16:0/3833912311 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7ff6f002c4f0 con 0x7ff6dc06e180 2024-08-01T07:04:34.435 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T07:04:34.435 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (15m) 3s ago 16m 25.3M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T07:04:34.435 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (18s) 3s ago 16m 8162k - 19.1.0-1223-gf9911e17 93d93c74a2cc a847ec3f462f 2024-08-01T07:04:34.435 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (8s) 5s ago 15m 7856k - 19.1.0-1223-gf9911e17 93d93c74a2cc f2f5e0a7786f 2024-08-01T07:04:34.435 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (5m) 3s ago 16m 6899k - 19.1.0-1223-gf9911e17 93d93c74a2cc 2a96028287a2 2024-08-01T07:04:34.435 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (5m) 5s ago 15m 6895k - 19.1.0-1223-gf9911e17 93d93c74a2cc 8a23341bd6c3 2024-08-01T07:04:34.435 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (15m) 3s ago 16m 86.0M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T07:04:34.436 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (87s) 3s ago 11m 89.6M - 19.1.0-1223-gf9911e17 93d93c74a2cc 2fb78654cbea 2024-08-01T07:04:34.436 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (62s) 3s ago 11m 16.2M - 19.1.0-1223-gf9911e17 93d93c74a2cc d3ca5deb5bb6 2024-08-01T07:04:34.436 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (45s) 5s ago 11m 86.1M - 19.1.0-1223-gf9911e17 93d93c74a2cc 6e9b9ebf3bc9 2024-08-01T07:04:34.436 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (31s) 5s ago 11m 15.6M - 19.1.0-1223-gf9911e17 93d93c74a2cc 98dd666884c1 2024-08-01T07:04:34.436 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:8443,9283,8765 running (7m) 3s ago 17m 507M - 19.1.0-1223-gf9911e17 93d93c74a2cc 8701e6315593 2024-08-01T07:04:34.436 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (6m) 5s ago 15m 441M - 19.1.0-1223-gf9911e17 93d93c74a2cc c6caa21f436f 2024-08-01T07:04:34.436 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (6m) 3s ago 18m 54.5M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc 48e94d076e6f 2024-08-01T07:04:34.437 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (6m) 5s ago 15m 41.6M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc c4b83b46ff15 2024-08-01T07:04:34.437 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (16m) 3s ago 16m 15.9M - 1.5.0 0da6a335fe13 5da9d9d9fa71 2024-08-01T07:04:34.437 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (15m) 5s ago 15m 16.8M - 1.5.0 0da6a335fe13 41436e622322 2024-08-01T07:04:34.437 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (5m) 3s ago 14m 207M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 4c2115ae6222 2024-08-01T07:04:34.437 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (4m) 3s ago 14m 110M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc fc2f7117be30 2024-08-01T07:04:34.437 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (3m) 3s ago 13m 144M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 3364752c9365 2024-08-01T07:04:34.437 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (3m) 5s ago 13m 118M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 9a18feae4353 2024-08-01T07:04:34.437 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (2m) 5s ago 13m 169M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 7c51ba7a636a 2024-08-01T07:04:34.438 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (2m) 5s ago 12m 127M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 08ffb10ca1a6 2024-08-01T07:04:34.438 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (6m) 3s ago 16m 71.3M - 2.43.0 a07b618ecd1d 45d23c96382e 2024-08-01T07:04:34.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.435+0000 7ff6f7519640 1 -- 172.21.15.16:0/3833912311 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff6dc06e180 msgr2=0x7ff6dc070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:34.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.435+0000 7ff6f7519640 1 --2- 172.21.15.16:0/3833912311 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff6dc06e180 0x7ff6dc070640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0000c00 tx=0x7ff6e00314e0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.435+0000 7ff6f7519640 1 -- 172.21.15.16:0/3833912311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6f0101d10 msgr2=0x7ff6f019bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:34.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.435+0000 7ff6f7519640 1 --2- 172.21.15.16:0/3833912311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6f0101d10 0x7ff6f019bb90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00e970 tx=0x7ff6ec00ee30 comp rx=0 tx=0).stop 2024-08-01T07:04:34.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.435+0000 7ff6f7519640 1 -- 172.21.15.16:0/3833912311 shutdown_connections 2024-08-01T07:04:34.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.435+0000 7ff6f7519640 1 --2- 172.21.15.16:0/3833912311 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff6dc06e180 0x7ff6dc070640 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.435+0000 7ff6f7519640 1 --2- 172.21.15.16:0/3833912311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6f0102f10 0x7ff6f019c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.435+0000 7ff6f7519640 1 --2- 172.21.15.16:0/3833912311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6f0101d10 0x7ff6f019bb90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.435+0000 7ff6f7519640 1 -- 172.21.15.16:0/3833912311 >> 172.21.15.16:0/3833912311 conn(0x7ff6f00fd4e0 msgr2=0x7ff6f00ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:34.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.435+0000 7ff6f7519640 1 -- 172.21.15.16:0/3833912311 shutdown_connections 2024-08-01T07:04:34.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.435+0000 7ff6f7519640 1 -- 172.21.15.16:0/3833912311 wait complete. 2024-08-01T07:04:34.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.520+0000 7f7b54c28640 1 -- 172.21.15.16:0/870697249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b50101d90 msgr2=0x7f7b50102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:34.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.520+0000 7f7b54c28640 1 --2- 172.21.15.16:0/870697249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b50101d90 0x7f7b50102190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7b38009880 tx=0x7f7b3802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.520+0000 7f7b54c28640 1 -- 172.21.15.16:0/870697249 shutdown_connections 2024-08-01T07:04:34.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.520+0000 7f7b54c28640 1 --2- 172.21.15.16:0/870697249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b50102f90 0x7f7b50103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.520+0000 7f7b54c28640 1 --2- 172.21.15.16:0/870697249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b50101d90 0x7f7b50102190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.520+0000 7f7b54c28640 1 -- 172.21.15.16:0/870697249 >> 172.21.15.16:0/870697249 conn(0x7f7b500fd520 msgr2=0x7f7b500ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:34.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.521+0000 7f7b54c28640 1 -- 172.21.15.16:0/870697249 shutdown_connections 2024-08-01T07:04:34.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.521+0000 7f7b54c28640 1 -- 172.21.15.16:0/870697249 wait complete. 2024-08-01T07:04:34.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.521+0000 7f7b54c28640 1 Processor -- start 2024-08-01T07:04:34.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.521+0000 7f7b54c28640 1 -- start start 2024-08-01T07:04:34.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.522+0000 7f7b54c28640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b50101d90 0x7f7b50197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:34.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.522+0000 7f7b54c28640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b50102f90 0x7f7b50197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:34.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.522+0000 7f7b54c28640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b50198330 con 0x7f7b50102f90 2024-08-01T07:04:34.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.522+0000 7f7b54c28640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b501984a0 con 0x7f7b50101d90 2024-08-01T07:04:34.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.522+0000 7f7b4dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b50102f90 0x7f7b50197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:34.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.522+0000 7f7b4dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b50102f90 0x7f7b50197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52878/0 (socket says 172.21.15.16:52878) 2024-08-01T07:04:34.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.522+0000 7f7b4dd9b640 1 -- 172.21.15.16:0/3836478597 learned_addr learned my addr 172.21.15.16:0/3836478597 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:04:34.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.522+0000 7f7b4e59c640 1 --2- 172.21.15.16:0/3836478597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b50101d90 0x7f7b50197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:34.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.522+0000 7f7b4dd9b640 1 -- 172.21.15.16:0/3836478597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b50101d90 msgr2=0x7f7b50197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:34.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.522+0000 7f7b4dd9b640 1 --2- 172.21.15.16:0/3836478597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b50101d90 0x7f7b50197820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.522+0000 7f7b4dd9b640 1 -- 172.21.15.16:0/3836478597 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b38009560 con 0x7f7b50102f90 2024-08-01T07:04:34.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.522+0000 7f7b4e59c640 1 --2- 172.21.15.16:0/3836478597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b50101d90 0x7f7b50197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T07:04:34.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.522+0000 7f7b4dd9b640 1 --2- 172.21.15.16:0/3836478597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b50102f90 0x7f7b50197d60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000d900 tx=0x7f7b4000ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:34.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.523+0000 7f7b477fe640 1 -- 172.21.15.16:0/3836478597 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b40009c00 con 0x7f7b50102f90 2024-08-01T07:04:34.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.523+0000 7f7b477fe640 1 -- 172.21.15.16:0/3836478597 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b4000b660 con 0x7f7b50102f90 2024-08-01T07:04:34.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.523+0000 7f7b54c28640 1 -- 172.21.15.16:0/3836478597 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5019cf40 con 0x7f7b50102f90 2024-08-01T07:04:34.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.523+0000 7f7b477fe640 1 -- 172.21.15.16:0/3836478597 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b4000f680 con 0x7f7b50102f90 2024-08-01T07:04:34.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.523+0000 7f7b54c28640 1 -- 172.21.15.16:0/3836478597 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5019d4e0 con 0x7f7b50102f90 2024-08-01T07:04:34.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.524+0000 7f7b54c28640 1 -- 172.21.15.16:0/3836478597 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b50102190 con 0x7f7b50102f90 2024-08-01T07:04:34.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.525+0000 7f7b477fe640 1 -- 172.21.15.16:0/3836478597 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7b40010ab0 con 0x7f7b50102f90 2024-08-01T07:04:34.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.525+0000 7f7b477fe640 1 --2- 172.21.15.16:0/3836478597 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7b3c06e170 0x7f7b3c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:34.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.525+0000 7f7b4e59c640 1 --2- 172.21.15.16:0/3836478597 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7b3c06e170 0x7f7b3c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:34.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.525+0000 7f7b477fe640 1 -- 172.21.15.16:0/3836478597 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f7b4008df20 con 0x7f7b50102f90 2024-08-01T07:04:34.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.526+0000 7f7b4e59c640 1 --2- 172.21.15.16:0/3836478597 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7b3c06e170 0x7f7b3c070630 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7b38009230 tx=0x7f7b380314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:34.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.530+0000 7f7b477fe640 1 -- 172.21.15.16:0/3836478597 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7b400c2df0 con 0x7f7b50102f90 2024-08-01T07:04:34.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.783+0000 7f7b54c28640 1 -- 172.21.15.16:0/3836478597 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7b50191910 con 0x7f7b50102f90 2024-08-01T07:04:34.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.784+0000 7f7b477fe640 1 -- 172.21.15.16:0/3836478597 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f7b40017280 con 0x7f7b50102f90 2024-08-01T07:04:34.785 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:04:34.785 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T07:04:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:04:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:04:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T07:04:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:04:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:04:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T07:04:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 6 2024-08-01T07:04:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:04:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T07:04:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 4 2024-08-01T07:04:34.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:04:34.787 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T07:04:34.787 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 14 2024-08-01T07:04:34.787 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T07:04:34.787 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:04:34.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.786+0000 7f7b54c28640 1 -- 172.21.15.16:0/3836478597 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7b3c06e170 msgr2=0x7f7b3c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:34.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.786+0000 7f7b54c28640 1 --2- 172.21.15.16:0/3836478597 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7b3c06e170 0x7f7b3c070630 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7b38009230 tx=0x7f7b380314e0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.786+0000 7f7b54c28640 1 -- 172.21.15.16:0/3836478597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b50102f90 msgr2=0x7f7b50197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:34.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.786+0000 7f7b54c28640 1 --2- 172.21.15.16:0/3836478597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b50102f90 0x7f7b50197d60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000d900 tx=0x7f7b4000ddc0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.786+0000 7f7b54c28640 1 -- 172.21.15.16:0/3836478597 shutdown_connections 2024-08-01T07:04:34.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.786+0000 7f7b54c28640 1 --2- 172.21.15.16:0/3836478597 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7b3c06e170 0x7f7b3c070630 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.786+0000 7f7b54c28640 1 --2- 172.21.15.16:0/3836478597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b50102f90 0x7f7b50197d60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.786+0000 7f7b54c28640 1 --2- 172.21.15.16:0/3836478597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b50101d90 0x7f7b50197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.786+0000 7f7b54c28640 1 -- 172.21.15.16:0/3836478597 >> 172.21.15.16:0/3836478597 conn(0x7f7b500fd520 msgr2=0x7f7b501066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:34.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.786+0000 7f7b54c28640 1 -- 172.21.15.16:0/3836478597 shutdown_connections 2024-08-01T07:04:34.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.786+0000 7f7b54c28640 1 -- 172.21.15.16:0/3836478597 wait complete. 2024-08-01T07:04:34.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.870+0000 7f674bcd7640 1 -- 172.21.15.16:0/1443714948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6744100690 msgr2=0x7f6744102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:34.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.870+0000 7f674bcd7640 1 --2- 172.21.15.16:0/1443714948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6744100690 0x7f6744102a80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6740009880 tx=0x7f674002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.870+0000 7f674bcd7640 1 -- 172.21.15.16:0/1443714948 shutdown_connections 2024-08-01T07:04:34.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.870+0000 7f674bcd7640 1 --2- 172.21.15.16:0/1443714948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6744102fc0 0x7f67441053b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.870+0000 7f674bcd7640 1 --2- 172.21.15.16:0/1443714948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6744100690 0x7f6744102a80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.870+0000 7f674bcd7640 1 -- 172.21.15.16:0/1443714948 >> 172.21.15.16:0/1443714948 conn(0x7f67440fa250 msgr2=0x7f67440fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:34.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.870+0000 7f674bcd7640 1 -- 172.21.15.16:0/1443714948 shutdown_connections 2024-08-01T07:04:34.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.870+0000 7f674bcd7640 1 -- 172.21.15.16:0/1443714948 wait complete. 2024-08-01T07:04:34.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.871+0000 7f674bcd7640 1 Processor -- start 2024-08-01T07:04:34.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.871+0000 7f674bcd7640 1 -- start start 2024-08-01T07:04:34.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.871+0000 7f674bcd7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6744100690 0x7f67440ffff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:34.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.871+0000 7f674bcd7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6744102fc0 0x7f67440fe640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:34.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.871+0000 7f674bcd7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6744100530 con 0x7f6744102fc0 2024-08-01T07:04:34.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.871+0000 7f674bcd7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67440febb0 con 0x7f6744100690 2024-08-01T07:04:34.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.871+0000 7f6749272640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6744102fc0 0x7f67440fe640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:34.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.871+0000 7f6749272640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6744102fc0 0x7f67440fe640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52884/0 (socket says 172.21.15.16:52884) 2024-08-01T07:04:34.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.871+0000 7f6749272640 1 -- 172.21.15.16:0/3475608781 learned_addr learned my addr 172.21.15.16:0/3475608781 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:04:34.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.872+0000 7f6749a73640 1 --2- 172.21.15.16:0/3475608781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6744100690 0x7f67440ffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:34.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.872+0000 7f6749272640 1 -- 172.21.15.16:0/3475608781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6744100690 msgr2=0x7f67440ffff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:34.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.872+0000 7f6749272640 1 --2- 172.21.15.16:0/3475608781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6744100690 0x7f67440ffff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:34.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.872+0000 7f6749272640 1 -- 172.21.15.16:0/3475608781 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6740009560 con 0x7f6744102fc0 2024-08-01T07:04:34.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.872+0000 7f6749272640 1 --2- 172.21.15.16:0/3475608781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6744102fc0 0x7f67440fe640 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f673400c8f0 tx=0x7f673400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:34.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.872+0000 7f673affd640 1 -- 172.21.15.16:0/3475608781 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6734004410 con 0x7f6744102fc0 2024-08-01T07:04:34.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.872+0000 7f673affd640 1 -- 172.21.15.16:0/3475608781 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6734007c60 con 0x7f6744102fc0 2024-08-01T07:04:34.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.872+0000 7f673affd640 1 -- 172.21.15.16:0/3475608781 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f673400f450 con 0x7f6744102fc0 2024-08-01T07:04:34.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.872+0000 7f674bcd7640 1 -- 172.21.15.16:0/3475608781 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67440fee90 con 0x7f6744102fc0 2024-08-01T07:04:34.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.872+0000 7f674bcd7640 1 -- 172.21.15.16:0/3475608781 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67440ff460 con 0x7f6744102fc0 2024-08-01T07:04:34.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.873+0000 7f674bcd7640 1 -- 172.21.15.16:0/3475608781 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6744108750 con 0x7f6744102fc0 2024-08-01T07:04:34.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.874+0000 7f673affd640 1 -- 172.21.15.16:0/3475608781 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f67340077a0 con 0x7f6744102fc0 2024-08-01T07:04:34.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.874+0000 7f673affd640 1 --2- 172.21.15.16:0/3475608781 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f673006e170 0x7f6730070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:34.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.874+0000 7f673affd640 1 -- 172.21.15.16:0/3475608781 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f673408e190 con 0x7f6744102fc0 2024-08-01T07:04:34.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.874+0000 7f6749a73640 1 --2- 172.21.15.16:0/3475608781 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f673006e170 0x7f6730070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:34.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.875+0000 7f6749a73640 1 --2- 172.21.15.16:0/3475608781 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f673006e170 0x7f6730070630 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6740000c00 tx=0x7f67400314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:34.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:34.879+0000 7f673affd640 1 -- 172.21.15.16:0/3475608781 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f67340573d0 con 0x7f6744102fc0 2024-08-01T07:04:35.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.093+0000 7f674bcd7640 1 -- 172.21.15.16:0/3475608781 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6744108930 con 0x7f6744102fc0 2024-08-01T07:04:35.095 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:34 smithi016 ceph-mon[93645]: pgmap v238: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s 2024-08-01T07:04:35.095 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:34 smithi016 ceph-mon[93645]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:04:35.095 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:34 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/3836478597' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:35.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.093+0000 7f673affd640 1 -- 172.21.15.16:0/3475608781 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) v1 ==== 76+0+2000 (secure 0 0 0) 0x7f67340147e0 con 0x7f6744102fc0 2024-08-01T07:04:35.096 INFO:teuthology.orchestra.run.smithi016.stdout:e38 2024-08-01T07:04:35.096 INFO:teuthology.orchestra.run.smithi016.stdout:btime 2024-08-01T07:04:11:596120+0000 2024-08-01T07:04:35.096 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T07:04:35.096 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T07:04:35.096 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T07:04:35.096 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:04:35.096 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T07:04:35.096 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T07:04:35.097 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 38 2024-08-01T07:04:35.097 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T07:04:35.097 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T07:04:35.097 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T07:04:11.596112+0000 2024-08-01T07:04:35.097 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T07:04:35.097 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T07:04:35.097 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T07:04:35.097 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T07:04:35.097 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T07:04:35.097 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T07:04:35.097 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T07:04:35.097 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T07:04:35.097 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 94 2024-08-01T07:04:35.098 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-01T07:04:35.098 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T07:04:35.098 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T07:04:35.098 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=34414,1=34446} 2024-08-01T07:04:35.098 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T07:04:35.098 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T07:04:35.098 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T07:04:35.098 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T07:04:35.099 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T07:04:35.099 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T07:04:35.099 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T07:04:35.099 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T07:04:35.099 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T07:04:35.099 INFO:teuthology.orchestra.run.smithi016.stdout:qdb_cluster leader: 34414 members: 34446,34414 2024-08-01T07:04:35.099 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:34414} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.16:6826/4064792079,v1:172.21.15.16:6827/4064792079] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:04:35.099 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{0:44357} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6824/3335707325,v1:172.21.15.89:6825/3335707325] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:04:35.099 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{1:34446} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.16:6828/2186852070,v1:172.21.15.16:6829/2186852070] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:04:35.099 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:44387} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/885893699,v1:172.21.15.89:6827/885893699] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:04:35.099 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:04:35.099 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:04:35.100 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 38 2024-08-01T07:04:35.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.095+0000 7f674bcd7640 1 -- 172.21.15.16:0/3475608781 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f673006e170 msgr2=0x7f6730070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:35.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.095+0000 7f674bcd7640 1 --2- 172.21.15.16:0/3475608781 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f673006e170 0x7f6730070630 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6740000c00 tx=0x7f67400314e0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.095+0000 7f674bcd7640 1 -- 172.21.15.16:0/3475608781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6744102fc0 msgr2=0x7f67440fe640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:35.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.095+0000 7f674bcd7640 1 --2- 172.21.15.16:0/3475608781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6744102fc0 0x7f67440fe640 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f673400c8f0 tx=0x7f673400cdb0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.096+0000 7f674bcd7640 1 -- 172.21.15.16:0/3475608781 shutdown_connections 2024-08-01T07:04:35.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.096+0000 7f674bcd7640 1 --2- 172.21.15.16:0/3475608781 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f673006e170 0x7f6730070630 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.096+0000 7f674bcd7640 1 --2- 172.21.15.16:0/3475608781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6744102fc0 0x7f67440fe640 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.096+0000 7f674bcd7640 1 --2- 172.21.15.16:0/3475608781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6744100690 0x7f67440ffff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.096+0000 7f674bcd7640 1 -- 172.21.15.16:0/3475608781 >> 172.21.15.16:0/3475608781 conn(0x7f67440fa250 msgr2=0x7f67440fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:35.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.096+0000 7f674bcd7640 1 -- 172.21.15.16:0/3475608781 shutdown_connections 2024-08-01T07:04:35.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.096+0000 7f674bcd7640 1 -- 172.21.15.16:0/3475608781 wait complete. 2024-08-01T07:04:35.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.186+0000 7efe4b5cb640 1 -- 172.21.15.16:0/1012862589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe440ffcf0 msgr2=0x7efe44100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:35.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.186+0000 7efe4b5cb640 1 --2- 172.21.15.16:0/1012862589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe440ffcf0 0x7efe44100170 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efe34009880 tx=0x7efe3402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.187+0000 7efe4b5cb640 1 -- 172.21.15.16:0/1012862589 shutdown_connections 2024-08-01T07:04:35.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.187+0000 7efe4b5cb640 1 --2- 172.21.15.16:0/1012862589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe440ffcf0 0x7efe44100170 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.187+0000 7efe4b5cb640 1 --2- 172.21.15.16:0/1012862589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe440feaf0 0x7efe440feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.187+0000 7efe4b5cb640 1 -- 172.21.15.16:0/1012862589 >> 172.21.15.16:0/1012862589 conn(0x7efe440fa280 msgr2=0x7efe440fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:35.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.187+0000 7efe4b5cb640 1 -- 172.21.15.16:0/1012862589 shutdown_connections 2024-08-01T07:04:35.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.187+0000 7efe4b5cb640 1 -- 172.21.15.16:0/1012862589 wait complete. 2024-08-01T07:04:35.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.187+0000 7efe4b5cb640 1 Processor -- start 2024-08-01T07:04:35.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.188+0000 7efe4b5cb640 1 -- start start 2024-08-01T07:04:35.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.188+0000 7efe4b5cb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe440feaf0 0x7efe44068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:35.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.188+0000 7efe4b5cb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe440ffcf0 0x7efe4419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:35.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.188+0000 7efe4b5cb640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4419a9a0 con 0x7efe440ffcf0 2024-08-01T07:04:35.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.188+0000 7efe4b5cb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4419aae0 con 0x7efe440feaf0 2024-08-01T07:04:35.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.188+0000 7efe48b66640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe440ffcf0 0x7efe4419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:35.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.188+0000 7efe48b66640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe440ffcf0 0x7efe4419a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52906/0 (socket says 172.21.15.16:52906) 2024-08-01T07:04:35.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.188+0000 7efe48b66640 1 -- 172.21.15.16:0/2839329884 learned_addr learned my addr 172.21.15.16:0/2839329884 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:04:35.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.188+0000 7efe49367640 1 --2- 172.21.15.16:0/2839329884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe440feaf0 0x7efe44068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:35.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.188+0000 7efe49367640 1 -- 172.21.15.16:0/2839329884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe440ffcf0 msgr2=0x7efe4419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:35.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.188+0000 7efe49367640 1 --2- 172.21.15.16:0/2839329884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe440ffcf0 0x7efe4419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.188+0000 7efe49367640 1 -- 172.21.15.16:0/2839329884 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe34009560 con 0x7efe440feaf0 2024-08-01T07:04:35.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.188+0000 7efe48b66640 1 --2- 172.21.15.16:0/2839329884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe440ffcf0 0x7efe4419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-01T07:04:35.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.189+0000 7efe49367640 1 --2- 172.21.15.16:0/2839329884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe440feaf0 0x7efe44068790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efe4000d6a0 tx=0x7efe4000db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:35.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.189+0000 7efe3a7fc640 1 -- 172.21.15.16:0/2839329884 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe400041f0 con 0x7efe440feaf0 2024-08-01T07:04:35.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.189+0000 7efe3a7fc640 1 -- 172.21.15.16:0/2839329884 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe40004350 con 0x7efe440feaf0 2024-08-01T07:04:35.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.189+0000 7efe4b5cb640 1 -- 172.21.15.16:0/2839329884 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe4419ad90 con 0x7efe440feaf0 2024-08-01T07:04:35.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.189+0000 7efe3a7fc640 1 -- 172.21.15.16:0/2839329884 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe40003d40 con 0x7efe440feaf0 2024-08-01T07:04:35.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.189+0000 7efe4b5cb640 1 -- 172.21.15.16:0/2839329884 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4419b2b0 con 0x7efe440feaf0 2024-08-01T07:04:35.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.190+0000 7efe4b5cb640 1 -- 172.21.15.16:0/2839329884 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe440feef0 con 0x7efe440feaf0 2024-08-01T07:04:35.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.190+0000 7efe3a7fc640 1 -- 172.21.15.16:0/2839329884 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efe40010460 con 0x7efe440feaf0 2024-08-01T07:04:35.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.191+0000 7efe3a7fc640 1 --2- 172.21.15.16:0/2839329884 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7efe3006e170 0x7efe30070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:35.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.191+0000 7efe3a7fc640 1 -- 172.21.15.16:0/2839329884 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7efe4008dd30 con 0x7efe440feaf0 2024-08-01T07:04:35.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.191+0000 7efe48b66640 1 --2- 172.21.15.16:0/2839329884 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7efe3006e170 0x7efe30070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:35.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.191+0000 7efe48b66640 1 --2- 172.21.15.16:0/2839329884 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7efe3006e170 0x7efe30070630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efe44068d10 tx=0x7efe340314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:35.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.196+0000 7efe3a7fc640 1 -- 172.21.15.16:0/2839329884 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7efe40056fb0 con 0x7efe440feaf0 2024-08-01T07:04:35.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:34 smithi089 ceph-mon[82218]: pgmap v238: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s 2024-08-01T07:04:35.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:34 smithi089 ceph-mon[82218]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:04:35.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:34 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/3836478597' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:35.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.400+0000 7efe4b5cb640 1 -- 172.21.15.16:0/2839329884 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe4402c570 con 0x7efe3006e170 2024-08-01T07:04:35.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.401+0000 7efe3a7fc640 1 -- 172.21.15.16:0/2839329884 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7efe4402c570 con 0x7efe3006e170 2024-08-01T07:04:35.403 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:04:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T07:04:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T07:04:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T07:04:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-08-01T07:04:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: "mds", 2024-08-01T07:04:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph-exporter", 2024-08-01T07:04:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: "crash", 2024-08-01T07:04:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-08-01T07:04:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr", 2024-08-01T07:04:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: "osd" 2024-08-01T07:04:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-08-01T07:04:35.404 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "18/23 daemons upgraded", 2024-08-01T07:04:35.404 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading node-exporter daemons", 2024-08-01T07:04:35.404 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T07:04:35.404 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:04:35.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.403+0000 7efe4b5cb640 1 -- 172.21.15.16:0/2839329884 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7efe3006e170 msgr2=0x7efe30070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:35.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.403+0000 7efe4b5cb640 1 --2- 172.21.15.16:0/2839329884 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7efe3006e170 0x7efe30070630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efe44068d10 tx=0x7efe340314e0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.403+0000 7efe4b5cb640 1 -- 172.21.15.16:0/2839329884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe440feaf0 msgr2=0x7efe44068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:35.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.403+0000 7efe4b5cb640 1 --2- 172.21.15.16:0/2839329884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe440feaf0 0x7efe44068790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efe4000d6a0 tx=0x7efe4000db60 comp rx=0 tx=0).stop 2024-08-01T07:04:35.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.403+0000 7efe4b5cb640 1 -- 172.21.15.16:0/2839329884 shutdown_connections 2024-08-01T07:04:35.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.403+0000 7efe4b5cb640 1 --2- 172.21.15.16:0/2839329884 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7efe3006e170 0x7efe30070630 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.403+0000 7efe4b5cb640 1 --2- 172.21.15.16:0/2839329884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe440ffcf0 0x7efe4419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.403+0000 7efe4b5cb640 1 --2- 172.21.15.16:0/2839329884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe440feaf0 0x7efe44068790 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.403+0000 7efe4b5cb640 1 -- 172.21.15.16:0/2839329884 >> 172.21.15.16:0/2839329884 conn(0x7efe440fa280 msgr2=0x7efe441033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:35.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.403+0000 7efe4b5cb640 1 -- 172.21.15.16:0/2839329884 shutdown_connections 2024-08-01T07:04:35.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.403+0000 7efe4b5cb640 1 -- 172.21.15.16:0/2839329884 wait complete. 2024-08-01T07:04:35.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.488+0000 7fd9e8bd1640 1 -- 172.21.15.16:0/2704726369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9e40feaf0 msgr2=0x7fd9e40feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:35.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.488+0000 7fd9e8bd1640 1 --2- 172.21.15.16:0/2704726369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9e40feaf0 0x7fd9e40feef0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009880 tx=0x7fd9d402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.488+0000 7fd9e8bd1640 1 -- 172.21.15.16:0/2704726369 shutdown_connections 2024-08-01T07:04:35.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.488+0000 7fd9e8bd1640 1 --2- 172.21.15.16:0/2704726369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9e40ffcf0 0x7fd9e4100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.488+0000 7fd9e8bd1640 1 --2- 172.21.15.16:0/2704726369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9e40feaf0 0x7fd9e40feef0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.488+0000 7fd9e8bd1640 1 -- 172.21.15.16:0/2704726369 >> 172.21.15.16:0/2704726369 conn(0x7fd9e40fa280 msgr2=0x7fd9e40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:35.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.488+0000 7fd9e8bd1640 1 -- 172.21.15.16:0/2704726369 shutdown_connections 2024-08-01T07:04:35.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.488+0000 7fd9e8bd1640 1 -- 172.21.15.16:0/2704726369 wait complete. 2024-08-01T07:04:35.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.489+0000 7fd9e8bd1640 1 Processor -- start 2024-08-01T07:04:35.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.489+0000 7fd9e8bd1640 1 -- start start 2024-08-01T07:04:35.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.489+0000 7fd9e8bd1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9e40feaf0 0x7fd9e40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:35.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.489+0000 7fd9e8bd1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9e40ffcf0 0x7fd9e419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:35.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.490+0000 7fd9e8bd1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e419a8c0 con 0x7fd9e40feaf0 2024-08-01T07:04:35.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.490+0000 7fd9e8bd1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e419aa30 con 0x7fd9e40ffcf0 2024-08-01T07:04:35.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.490+0000 7fd9e259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9e40feaf0 0x7fd9e40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:35.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.490+0000 7fd9e259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9e40feaf0 0x7fd9e40687d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52930/0 (socket says 172.21.15.16:52930) 2024-08-01T07:04:35.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.490+0000 7fd9e259c640 1 -- 172.21.15.16:0/2595040885 learned_addr learned my addr 172.21.15.16:0/2595040885 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:04:35.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.490+0000 7fd9e1d9b640 1 --2- 172.21.15.16:0/2595040885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9e40ffcf0 0x7fd9e419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:35.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.490+0000 7fd9e259c640 1 -- 172.21.15.16:0/2595040885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9e40ffcf0 msgr2=0x7fd9e419a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:35.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.490+0000 7fd9e259c640 1 --2- 172.21.15.16:0/2595040885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9e40ffcf0 0x7fd9e419a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.490+0000 7fd9e259c640 1 -- 172.21.15.16:0/2595040885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d4009560 con 0x7fd9e40feaf0 2024-08-01T07:04:35.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.490+0000 7fd9e259c640 1 --2- 172.21.15.16:0/2595040885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9e40feaf0 0x7fd9e40687d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd9d402a9c0 tx=0x7fd9d4005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:35.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.490+0000 7fd9db7fe640 1 -- 172.21.15.16:0/2595040885 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9d4004b20 con 0x7fd9e40feaf0 2024-08-01T07:04:35.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.490+0000 7fd9e8bd1640 1 -- 172.21.15.16:0/2595040885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e419acb0 con 0x7fd9e40feaf0 2024-08-01T07:04:35.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.490+0000 7fd9db7fe640 1 -- 172.21.15.16:0/2595040885 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd9d4004c80 con 0x7fd9e40feaf0 2024-08-01T07:04:35.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.491+0000 7fd9db7fe640 1 -- 172.21.15.16:0/2595040885 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9d4003b80 con 0x7fd9e40feaf0 2024-08-01T07:04:35.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.491+0000 7fd9e8bd1640 1 -- 172.21.15.16:0/2595040885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e419b1a0 con 0x7fd9e40feaf0 2024-08-01T07:04:35.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.492+0000 7fd9e8bd1640 1 -- 172.21.15.16:0/2595040885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e418e670 con 0x7fd9e40feaf0 2024-08-01T07:04:35.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.492+0000 7fd9db7fe640 1 -- 172.21.15.16:0/2595040885 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd9d4031640 con 0x7fd9e40feaf0 2024-08-01T07:04:35.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.493+0000 7fd9db7fe640 1 --2- 172.21.15.16:0/2595040885 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd9d006e170 0x7fd9d0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:04:35.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.493+0000 7fd9db7fe640 1 -- 172.21.15.16:0/2595040885 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fd9d40af5d0 con 0x7fd9e40feaf0 2024-08-01T07:04:35.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.493+0000 7fd9e1d9b640 1 --2- 172.21.15.16:0/2595040885 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd9d006e170 0x7fd9d0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:04:35.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.493+0000 7fd9e1d9b640 1 --2- 172.21.15.16:0/2595040885 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd9d006e170 0x7fd9d0070630 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc005e10 tx=0x7fd9cc005da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:04:35.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.497+0000 7fd9db7fe640 1 -- 172.21.15.16:0/2595040885 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd9d4078790 con 0x7fd9e40feaf0 2024-08-01T07:04:35.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.751+0000 7fd9e8bd1640 1 -- 172.21.15.16:0/2595040885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd9e41076e0 con 0x7fd9e40feaf0 2024-08-01T07:04:35.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.751+0000 7fd9db7fe640 1 -- 172.21.15.16:0/2595040885 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd9d407be50 con 0x7fd9e40feaf0 2024-08-01T07:04:35.753 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-08-01T07:04:35.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.754+0000 7fd9e8bd1640 1 -- 172.21.15.16:0/2595040885 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd9d006e170 msgr2=0x7fd9d0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:35.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.754+0000 7fd9e8bd1640 1 --2- 172.21.15.16:0/2595040885 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd9d006e170 0x7fd9d0070630 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc005e10 tx=0x7fd9cc005da0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.754+0000 7fd9e8bd1640 1 -- 172.21.15.16:0/2595040885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9e40feaf0 msgr2=0x7fd9e40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:04:35.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.754+0000 7fd9e8bd1640 1 --2- 172.21.15.16:0/2595040885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9e40feaf0 0x7fd9e40687d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd9d402a9c0 tx=0x7fd9d4005610 comp rx=0 tx=0).stop 2024-08-01T07:04:35.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.754+0000 7fd9e8bd1640 1 -- 172.21.15.16:0/2595040885 shutdown_connections 2024-08-01T07:04:35.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.754+0000 7fd9e8bd1640 1 --2- 172.21.15.16:0/2595040885 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd9d006e170 0x7fd9d0070630 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.754+0000 7fd9e8bd1640 1 --2- 172.21.15.16:0/2595040885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9e40ffcf0 0x7fd9e419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.754+0000 7fd9e8bd1640 1 --2- 172.21.15.16:0/2595040885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9e40feaf0 0x7fd9e40687d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:04:35.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.754+0000 7fd9e8bd1640 1 -- 172.21.15.16:0/2595040885 >> 172.21.15.16:0/2595040885 conn(0x7fd9e40fa280 msgr2=0x7fd9e4103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:04:35.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.754+0000 7fd9e8bd1640 1 -- 172.21.15.16:0/2595040885 shutdown_connections 2024-08-01T07:04:35.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:04:35.754+0000 7fd9e8bd1640 1 -- 172.21.15.16:0/2595040885 wait complete. 2024-08-01T07:04:36.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:04:36.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:04:36.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/3475608781' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:04:36.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:36.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:36.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:04:36.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:04:36.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:36.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:04:36.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:36.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi016"}]: dispatch 2024-08-01T07:04:36.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi016"}]': finished 2024-08-01T07:04:36.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi089"}]: dispatch 2024-08-01T07:04:36.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi089"}]': finished 2024-08-01T07:04:36.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:36.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:36.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:36.390 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:35 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2595040885' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:04:36.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:04:36.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:04:36.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/3475608781' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:04:36.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:36.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:36.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:04:36.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:04:36.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:36.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:04:36.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.400 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:36.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi016"}]: dispatch 2024-08-01T07:04:36.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi016"}]': finished 2024-08-01T07:04:36.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi089"}]: dispatch 2024-08-01T07:04:36.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi089"}]': finished 2024-08-01T07:04:36.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:36.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:36.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:36.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:36.401 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:35 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2595040885' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:04:37.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:36 smithi089 ceph-mon[82218]: pgmap v239: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:04:37.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:36 smithi089 ceph-mon[82218]: Upgrade: Setting container_image for all ceph-exporter 2024-08-01T07:04:37.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:36 smithi089 ceph-mon[82218]: Upgrade: Setting container_image for all iscsi 2024-08-01T07:04:37.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:36 smithi089 ceph-mon[82218]: Upgrade: Setting container_image for all nfs 2024-08-01T07:04:37.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:36 smithi089 ceph-mon[82218]: Upgrade: Setting container_image for all nvmeof 2024-08-01T07:04:37.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:36 smithi089 ceph-mon[82218]: from='client.44413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:04:37.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:36 smithi016 ceph-mon[93645]: pgmap v239: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:04:37.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:36 smithi016 ceph-mon[93645]: Upgrade: Setting container_image for all ceph-exporter 2024-08-01T07:04:37.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:36 smithi016 ceph-mon[93645]: Upgrade: Setting container_image for all iscsi 2024-08-01T07:04:37.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:36 smithi016 ceph-mon[93645]: Upgrade: Setting container_image for all nfs 2024-08-01T07:04:37.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:36 smithi016 ceph-mon[93645]: Upgrade: Setting container_image for all nvmeof 2024-08-01T07:04:37.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:36 smithi016 ceph-mon[93645]: from='client.44413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:04:38.106 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:37 smithi016 ceph-mon[93645]: Upgrade: Updating node-exporter.smithi016 (1/2) 2024-08-01T07:04:38.107 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:37 smithi016 ceph-mon[93645]: Deploying daemon node-exporter.smithi016 on smithi016 2024-08-01T07:04:38.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:37 smithi089 ceph-mon[82218]: Upgrade: Updating node-exporter.smithi016 (1/2) 2024-08-01T07:04:38.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:37 smithi089 ceph-mon[82218]: Deploying daemon node-exporter.smithi016 on smithi016 2024-08-01T07:04:39.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:38 smithi089 ceph-mon[82218]: pgmap v240: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:04:39.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:38 smithi016 ceph-mon[93645]: pgmap v240: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:04:40.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:40 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:40.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:40 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:40.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:40 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:40.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:40 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:41.375 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:41 smithi089 ceph-mon[82218]: pgmap v241: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:04:41.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:41 smithi016 ceph-mon[93645]: pgmap v241: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:04:42.318 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:42 smithi016 ceph-mon[93645]: Upgrade: Updating node-exporter.smithi089 (2/2) 2024-08-01T07:04:42.318 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:42 smithi016 ceph-mon[93645]: Deploying daemon node-exporter.smithi089 on smithi089 2024-08-01T07:04:42.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:42 smithi089 ceph-mon[82218]: Upgrade: Updating node-exporter.smithi089 (2/2) 2024-08-01T07:04:42.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:42 smithi089 ceph-mon[82218]: Deploying daemon node-exporter.smithi089 on smithi089 2024-08-01T07:04:43.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:43 smithi089 ceph-mon[82218]: pgmap v242: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:04:43.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:43 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:43.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:43 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:43.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:43 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:04:43.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:43 smithi016 ceph-mon[93645]: pgmap v242: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:04:43.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:43 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:43.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:43 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:43.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:43 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:04:45.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:45 smithi089 ceph-mon[82218]: pgmap v243: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:04:45.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:45.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:45.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:45 smithi016 ceph-mon[93645]: pgmap v243: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:04:45.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:45.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:46.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:46 smithi089 ceph-mon[82218]: pgmap v244: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:04:46.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:46 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:46.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:46 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:46.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:46 smithi016 ceph-mon[93645]: pgmap v244: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:04:46.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:46 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:46.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:46 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:47.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:04:47.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:47.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:47.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:04:47.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:47.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:49.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:48 smithi089 ceph-mon[82218]: pgmap v245: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:04:49.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:49.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:49.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:49.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:49.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:48 smithi016 ceph-mon[93645]: pgmap v245: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:04:49.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:49.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:49.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:49.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:50.990 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:50 smithi016 ceph-mon[93645]: pgmap v246: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:04:51.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:50 smithi089 ceph-mon[82218]: pgmap v246: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:04:52.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:52.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:52.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:04:52.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:04:52.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:52.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:04:52.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.151 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:52 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:52.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:52.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:04:52.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:04:52.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:52.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:04:52.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:52.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:52 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:04:53.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:53 smithi089 ceph-mon[82218]: pgmap v247: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:04:53.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:53 smithi016 ceph-mon[93645]: pgmap v247: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:04:54.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:54 smithi016 ceph-mon[93645]: Upgrade: Updating prometheus.smithi016 2024-08-01T07:04:54.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:54 smithi016 ceph-mon[93645]: Deploying daemon prometheus.smithi016 on smithi016 2024-08-01T07:04:54.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:54 smithi089 ceph-mon[82218]: Upgrade: Updating prometheus.smithi016 2024-08-01T07:04:54.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:54 smithi089 ceph-mon[82218]: Deploying daemon prometheus.smithi016 on smithi016 2024-08-01T07:04:55.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:55 smithi089 ceph-mon[82218]: pgmap v248: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:04:55.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:55 smithi016 ceph-mon[93645]: pgmap v248: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:04:57.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:57 smithi089 ceph-mon[82218]: pgmap v249: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:04:57.392 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:57 smithi016 ceph-mon[93645]: pgmap v249: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:04:59.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:59 smithi089 ceph-mon[82218]: pgmap v250: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:04:59.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:59 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:59.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:59 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:59.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:04:59 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:04:59.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:59 smithi016 ceph-mon[93645]: pgmap v250: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:04:59.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:59 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:59.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:59 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:04:59.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:04:59 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:05:01.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:01 smithi016 ceph-mon[93645]: pgmap v251: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:05:01.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:01 smithi089 ceph-mon[82218]: pgmap v251: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:05:03.367 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:03 smithi016 ceph-mon[93645]: pgmap v252: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:05:03.367 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:03 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:05:03.368 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:03 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:03.368 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:03 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:03.368 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:03 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:03.368 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:03 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:03.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:03 smithi089 ceph-mon[82218]: pgmap v252: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:05:03.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:03 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:05:03.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:03 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:03.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:03 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:03.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:03 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:03.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:03 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:05.382 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:05 smithi016 ceph-mon[93645]: pgmap v253: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:05:05.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:05 smithi089 ceph-mon[82218]: pgmap v253: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:05:05.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.842+0000 7fcfabbe9640 1 -- 172.21.15.16:0/2153616040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfa40ffca0 msgr2=0x7fcfa4100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:05.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.842+0000 7fcfabbe9640 1 --2- 172.21.15.16:0/2153616040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfa40ffca0 0x7fcfa4100120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009880 tx=0x7fcf9402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:05:05.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.842+0000 7fcfabbe9640 1 -- 172.21.15.16:0/2153616040 shutdown_connections 2024-08-01T07:05:05.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.842+0000 7fcfabbe9640 1 --2- 172.21.15.16:0/2153616040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfa40ffca0 0x7fcfa4100120 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:05.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.842+0000 7fcfabbe9640 1 --2- 172.21.15.16:0/2153616040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfa40feaa0 0x7fcfa40feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:05.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.842+0000 7fcfabbe9640 1 -- 172.21.15.16:0/2153616040 >> 172.21.15.16:0/2153616040 conn(0x7fcfa40fa250 msgr2=0x7fcfa40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:05.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.842+0000 7fcfabbe9640 1 -- 172.21.15.16:0/2153616040 shutdown_connections 2024-08-01T07:05:05.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.842+0000 7fcfabbe9640 1 -- 172.21.15.16:0/2153616040 wait complete. 2024-08-01T07:05:05.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.843+0000 7fcfabbe9640 1 Processor -- start 2024-08-01T07:05:05.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.843+0000 7fcfabbe9640 1 -- start start 2024-08-01T07:05:05.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.843+0000 7fcfabbe9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfa40feaa0 0x7fcfa4102e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:05.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.843+0000 7fcfabbe9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfa40ffca0 0x7fcfa41014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:05.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.843+0000 7fcfabbe9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa4101a10 con 0x7fcfa40feaa0 2024-08-01T07:05:05.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.843+0000 7fcfabbe9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa4101b80 con 0x7fcfa40ffca0 2024-08-01T07:05:05.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.843+0000 7fcfa9985640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfa40feaa0 0x7fcfa4102e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:05.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.843+0000 7fcfa9985640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfa40feaa0 0x7fcfa4102e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52438/0 (socket says 172.21.15.16:52438) 2024-08-01T07:05:05.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.843+0000 7fcfa9985640 1 -- 172.21.15.16:0/3171689515 learned_addr learned my addr 172.21.15.16:0/3171689515 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:05:05.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.844+0000 7fcfa9184640 1 --2- 172.21.15.16:0/3171689515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfa40ffca0 0x7fcfa41014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:05.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.844+0000 7fcfa9985640 1 -- 172.21.15.16:0/3171689515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfa40ffca0 msgr2=0x7fcfa41014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:05.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.844+0000 7fcfa9985640 1 --2- 172.21.15.16:0/3171689515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfa40ffca0 0x7fcfa41014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:05.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.844+0000 7fcfa9985640 1 -- 172.21.15.16:0/3171689515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf94009560 con 0x7fcfa40feaa0 2024-08-01T07:05:05.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.844+0000 7fcfa9985640 1 --2- 172.21.15.16:0/3171689515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfa40feaa0 0x7fcfa4102e80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000d8d0 tx=0x7fcfa000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:05.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.844+0000 7fcf9affd640 1 -- 172.21.15.16:0/3171689515 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfa0009a30 con 0x7fcfa40feaa0 2024-08-01T07:05:05.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.844+0000 7fcf9affd640 1 -- 172.21.15.16:0/3171689515 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcfa0009b90 con 0x7fcfa40feaa0 2024-08-01T07:05:05.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.844+0000 7fcf9affd640 1 -- 172.21.15.16:0/3171689515 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfa000f680 con 0x7fcfa40feaa0 2024-08-01T07:05:05.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.844+0000 7fcfabbe9640 1 -- 172.21.15.16:0/3171689515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa4101e60 con 0x7fcfa40feaa0 2024-08-01T07:05:05.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.844+0000 7fcfabbe9640 1 -- 172.21.15.16:0/3171689515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa419d670 con 0x7fcfa40feaa0 2024-08-01T07:05:05.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.845+0000 7fcfabbe9640 1 -- 172.21.15.16:0/3171689515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa40feea0 con 0x7fcfa40feaa0 2024-08-01T07:05:05.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.846+0000 7fcf9affd640 1 -- 172.21.15.16:0/3171689515 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fcfa0009d00 con 0x7fcfa40feaa0 2024-08-01T07:05:05.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.846+0000 7fcf9affd640 1 --2- 172.21.15.16:0/3171689515 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fcf9006e170 0x7fcf90070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:05.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.846+0000 7fcf9affd640 1 -- 172.21.15.16:0/3171689515 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fcfa008e110 con 0x7fcfa40feaa0 2024-08-01T07:05:05.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.847+0000 7fcfa9184640 1 --2- 172.21.15.16:0/3171689515 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fcf9006e170 0x7fcf90070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:05.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.847+0000 7fcfa9184640 1 --2- 172.21.15.16:0/3171689515 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fcf9006e170 0x7fcf90070630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcf94000c00 tx=0x7fcf940314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:05.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:05.851+0000 7fcf9affd640 1 -- 172.21.15.16:0/3171689515 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fcfa00572d0 con 0x7fcfa40feaa0 2024-08-01T07:05:06.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.049+0000 7fcfabbe9640 1 -- 172.21.15.16:0/3171689515 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfa4068b60 con 0x7fcf9006e170 2024-08-01T07:05:06.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.050+0000 7fcf9affd640 1 -- 172.21.15.16:0/3171689515 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7fcfa4068b60 con 0x7fcf9006e170 2024-08-01T07:05:06.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.052+0000 7fcfabbe9640 1 -- 172.21.15.16:0/3171689515 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fcf9006e170 msgr2=0x7fcf90070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:06.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.052+0000 7fcfabbe9640 1 --2- 172.21.15.16:0/3171689515 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fcf9006e170 0x7fcf90070630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcf94000c00 tx=0x7fcf940314e0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.052+0000 7fcfabbe9640 1 -- 172.21.15.16:0/3171689515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfa40feaa0 msgr2=0x7fcfa4102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:06.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.052+0000 7fcfabbe9640 1 --2- 172.21.15.16:0/3171689515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfa40feaa0 0x7fcfa4102e80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000d8d0 tx=0x7fcfa000dd90 comp rx=0 tx=0).stop 2024-08-01T07:05:06.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.052+0000 7fcfabbe9640 1 -- 172.21.15.16:0/3171689515 shutdown_connections 2024-08-01T07:05:06.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.052+0000 7fcfabbe9640 1 --2- 172.21.15.16:0/3171689515 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fcf9006e170 0x7fcf90070630 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.052+0000 7fcfabbe9640 1 --2- 172.21.15.16:0/3171689515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfa40ffca0 0x7fcfa41014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.052+0000 7fcfabbe9640 1 --2- 172.21.15.16:0/3171689515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfa40feaa0 0x7fcfa4102e80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.052+0000 7fcfabbe9640 1 -- 172.21.15.16:0/3171689515 >> 172.21.15.16:0/3171689515 conn(0x7fcfa40fa250 msgr2=0x7fcfa4068450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:06.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.052+0000 7fcfabbe9640 1 -- 172.21.15.16:0/3171689515 shutdown_connections 2024-08-01T07:05:06.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.052+0000 7fcfabbe9640 1 -- 172.21.15.16:0/3171689515 wait complete. 2024-08-01T07:05:06.063 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T07:05:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.140+0000 7ff9092b1640 1 -- 172.21.15.16:0/2843597284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9040feaa0 msgr2=0x7ff9040feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.140+0000 7ff9092b1640 1 --2- 172.21.15.16:0/2843597284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9040feaa0 0x7ff9040feea0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4009880 tx=0x7ff8f402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.140+0000 7ff9092b1640 1 -- 172.21.15.16:0/2843597284 shutdown_connections 2024-08-01T07:05:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.140+0000 7ff9092b1640 1 --2- 172.21.15.16:0/2843597284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9040ffca0 0x7ff904100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.140+0000 7ff9092b1640 1 --2- 172.21.15.16:0/2843597284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9040feaa0 0x7ff9040feea0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.140+0000 7ff9092b1640 1 -- 172.21.15.16:0/2843597284 >> 172.21.15.16:0/2843597284 conn(0x7ff9040fa250 msgr2=0x7ff9040fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:06.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.140+0000 7ff9092b1640 1 -- 172.21.15.16:0/2843597284 shutdown_connections 2024-08-01T07:05:06.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.140+0000 7ff9092b1640 1 -- 172.21.15.16:0/2843597284 wait complete. 2024-08-01T07:05:06.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.141+0000 7ff9092b1640 1 Processor -- start 2024-08-01T07:05:06.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.141+0000 7ff9092b1640 1 -- start start 2024-08-01T07:05:06.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.141+0000 7ff9092b1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9040feaa0 0x7ff904102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:06.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.141+0000 7ff9092b1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9040ffca0 0x7ff904101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:06.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.141+0000 7ff9092b1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9041015c0 con 0x7ff9040ffca0 2024-08-01T07:05:06.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.141+0000 7ff9092b1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff904101730 con 0x7ff9040feaa0 2024-08-01T07:05:06.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.141+0000 7ff8fbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9040ffca0 0x7ff904101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:06.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.141+0000 7ff8fbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9040ffca0 0x7ff904101080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52456/0 (socket says 172.21.15.16:52456) 2024-08-01T07:05:06.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.141+0000 7ff8fbfff640 1 -- 172.21.15.16:0/1461371543 learned_addr learned my addr 172.21.15.16:0/1461371543 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:05:06.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.141+0000 7ff902ffd640 1 --2- 172.21.15.16:0/1461371543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9040feaa0 0x7ff904102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:06.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.142+0000 7ff8fbfff640 1 -- 172.21.15.16:0/1461371543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9040feaa0 msgr2=0x7ff904102a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:06.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.142+0000 7ff8fbfff640 1 --2- 172.21.15.16:0/1461371543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9040feaa0 0x7ff904102a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.142+0000 7ff8fbfff640 1 -- 172.21.15.16:0/1461371543 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f4009560 con 0x7ff9040ffca0 2024-08-01T07:05:06.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.142+0000 7ff8fbfff640 1 --2- 172.21.15.16:0/1461371543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9040ffca0 0x7ff904101080 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00e970 tx=0x7ff8ec00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:06.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.142+0000 7ff900ff9640 1 -- 172.21.15.16:0/1461371543 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8ec00cc90 con 0x7ff9040ffca0 2024-08-01T07:05:06.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.142+0000 7ff900ff9640 1 -- 172.21.15.16:0/1461371543 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff8ec00cdf0 con 0x7ff9040ffca0 2024-08-01T07:05:06.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.142+0000 7ff9092b1640 1 -- 172.21.15.16:0/1461371543 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff904101a10 con 0x7ff9040ffca0 2024-08-01T07:05:06.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.142+0000 7ff900ff9640 1 -- 172.21.15.16:0/1461371543 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8ec010430 con 0x7ff9040ffca0 2024-08-01T07:05:06.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.142+0000 7ff9092b1640 1 -- 172.21.15.16:0/1461371543 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90419d690 con 0x7ff9040ffca0 2024-08-01T07:05:06.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.143+0000 7ff9092b1640 1 -- 172.21.15.16:0/1461371543 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9041076b0 con 0x7ff9040ffca0 2024-08-01T07:05:06.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.144+0000 7ff900ff9640 1 -- 172.21.15.16:0/1461371543 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff8ec0046c0 con 0x7ff9040ffca0 2024-08-01T07:05:06.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.144+0000 7ff900ff9640 1 --2- 172.21.15.16:0/1461371543 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff8f006e170 0x7ff8f0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:06.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.144+0000 7ff900ff9640 1 -- 172.21.15.16:0/1461371543 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7ff8ec014070 con 0x7ff9040ffca0 2024-08-01T07:05:06.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.144+0000 7ff902ffd640 1 --2- 172.21.15.16:0/1461371543 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff8f006e170 0x7ff8f0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:06.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.145+0000 7ff902ffd640 1 --2- 172.21.15.16:0/1461371543 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff8f006e170 0x7ff8f0070630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4009230 tx=0x7ff8f40314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:06.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.149+0000 7ff900ff9640 1 -- 172.21.15.16:0/1461371543 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff8ec057950 con 0x7ff9040ffca0 2024-08-01T07:05:06.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.346+0000 7ff9092b1640 1 -- 172.21.15.16:0/1461371543 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff904068bd0 con 0x7ff8f006e170 2024-08-01T07:05:06.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.347+0000 7ff900ff9640 1 -- 172.21.15.16:0/1461371543 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7ff904068bd0 con 0x7ff8f006e170 2024-08-01T07:05:06.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.350+0000 7ff9092b1640 1 -- 172.21.15.16:0/1461371543 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff8f006e170 msgr2=0x7ff8f0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:06.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.350+0000 7ff9092b1640 1 --2- 172.21.15.16:0/1461371543 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff8f006e170 0x7ff8f0070630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4009230 tx=0x7ff8f40314e0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.350+0000 7ff9092b1640 1 -- 172.21.15.16:0/1461371543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9040ffca0 msgr2=0x7ff904101080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:06.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.350+0000 7ff9092b1640 1 --2- 172.21.15.16:0/1461371543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9040ffca0 0x7ff904101080 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00e970 tx=0x7ff8ec00ed70 comp rx=0 tx=0).stop 2024-08-01T07:05:06.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.350+0000 7ff9092b1640 1 -- 172.21.15.16:0/1461371543 shutdown_connections 2024-08-01T07:05:06.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.350+0000 7ff9092b1640 1 --2- 172.21.15.16:0/1461371543 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff8f006e170 0x7ff8f0070630 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.350+0000 7ff9092b1640 1 --2- 172.21.15.16:0/1461371543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9040ffca0 0x7ff904101080 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.350+0000 7ff9092b1640 1 --2- 172.21.15.16:0/1461371543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9040feaa0 0x7ff904102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.350+0000 7ff9092b1640 1 -- 172.21.15.16:0/1461371543 >> 172.21.15.16:0/1461371543 conn(0x7ff9040fa250 msgr2=0x7ff9040684c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:06.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.350+0000 7ff9092b1640 1 -- 172.21.15.16:0/1461371543 shutdown_connections 2024-08-01T07:05:06.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.350+0000 7ff9092b1640 1 -- 172.21.15.16:0/1461371543 wait complete. 2024-08-01T07:05:06.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.435+0000 7f90c7f3c640 1 -- 172.21.15.16:0/3321752044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90c00fedb0 msgr2=0x7f90c00ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:06.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.435+0000 7f90c7f3c640 1 --2- 172.21.15.16:0/3321752044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90c00fedb0 0x7f90c00ff210 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009880 tx=0x7f90b002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.435+0000 7f90c7f3c640 1 -- 172.21.15.16:0/3321752044 shutdown_connections 2024-08-01T07:05:06.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.435+0000 7f90c7f3c640 1 --2- 172.21.15.16:0/3321752044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90c00fedb0 0x7f90c00ff210 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.435+0000 7f90c7f3c640 1 --2- 172.21.15.16:0/3321752044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90c00fe470 0x7f90c00fe870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.435+0000 7f90c7f3c640 1 -- 172.21.15.16:0/3321752044 >> 172.21.15.16:0/3321752044 conn(0x7f90c00fa280 msgr2=0x7f90c00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:06.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.435+0000 7f90c7f3c640 1 -- 172.21.15.16:0/3321752044 shutdown_connections 2024-08-01T07:05:06.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.435+0000 7f90c7f3c640 1 -- 172.21.15.16:0/3321752044 wait complete. 2024-08-01T07:05:06.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.436+0000 7f90c7f3c640 1 Processor -- start 2024-08-01T07:05:06.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.436+0000 7f90c7f3c640 1 -- start start 2024-08-01T07:05:06.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.436+0000 7f90c7f3c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90c00fe470 0x7f90c01978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:06.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.437+0000 7f90c7f3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90c00fedb0 0x7f90c0197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:06.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.437+0000 7f90c7f3c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c01983c0 con 0x7f90c00fe470 2024-08-01T07:05:06.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.437+0000 7f90c7f3c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c0198530 con 0x7f90c00fedb0 2024-08-01T07:05:06.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.437+0000 7f90c5cd8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90c00fe470 0x7f90c01978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:06.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.437+0000 7f90c5cd8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90c00fe470 0x7f90c01978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52466/0 (socket says 172.21.15.16:52466) 2024-08-01T07:05:06.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.437+0000 7f90c5cd8640 1 -- 172.21.15.16:0/2414953506 learned_addr learned my addr 172.21.15.16:0/2414953506 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:05:06.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.437+0000 7f90c54d7640 1 --2- 172.21.15.16:0/2414953506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90c00fedb0 0x7f90c0197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:06.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.437+0000 7f90c5cd8640 1 -- 172.21.15.16:0/2414953506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90c00fedb0 msgr2=0x7f90c0197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:06.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.437+0000 7f90c5cd8640 1 --2- 172.21.15.16:0/2414953506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90c00fedb0 0x7f90c0197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.437+0000 7f90c5cd8640 1 -- 172.21.15.16:0/2414953506 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc009490 con 0x7f90c00fe470 2024-08-01T07:05:06.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.437+0000 7f90c5cd8640 1 --2- 172.21.15.16:0/2414953506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90c00fe470 0x7f90c01978b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00ea10 tx=0x7f90bc00eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:06.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.437+0000 7f90b6ffd640 1 -- 172.21.15.16:0/2414953506 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90bc00cd50 con 0x7f90c00fe470 2024-08-01T07:05:06.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.438+0000 7f90c7f3c640 1 -- 172.21.15.16:0/2414953506 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b0009560 con 0x7f90c00fe470 2024-08-01T07:05:06.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.438+0000 7f90b6ffd640 1 -- 172.21.15.16:0/2414953506 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f90bc00ceb0 con 0x7f90c00fe470 2024-08-01T07:05:06.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.438+0000 7f90b6ffd640 1 -- 172.21.15.16:0/2414953506 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90bc004a60 con 0x7f90c00fe470 2024-08-01T07:05:06.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.438+0000 7f90c7f3c640 1 -- 172.21.15.16:0/2414953506 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c019d300 con 0x7f90c00fe470 2024-08-01T07:05:06.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.439+0000 7f90c7f3c640 1 -- 172.21.15.16:0/2414953506 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c00fe870 con 0x7f90c00fe470 2024-08-01T07:05:06.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.440+0000 7f90b6ffd640 1 -- 172.21.15.16:0/2414953506 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f90bc004d40 con 0x7f90c00fe470 2024-08-01T07:05:06.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.440+0000 7f90b6ffd640 1 --2- 172.21.15.16:0/2414953506 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f90ac06e170 0x7f90ac070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:06.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.440+0000 7f90b6ffd640 1 -- 172.21.15.16:0/2414953506 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f90bc014070 con 0x7f90c00fe470 2024-08-01T07:05:06.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.440+0000 7f90c54d7640 1 --2- 172.21.15.16:0/2414953506 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f90ac06e170 0x7f90ac070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:06.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.441+0000 7f90c54d7640 1 --2- 172.21.15.16:0/2414953506 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f90ac06e170 0x7f90ac070630 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f90b0000c00 tx=0x7f90b00314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:06.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.446+0000 7f90b6ffd640 1 -- 172.21.15.16:0/2414953506 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f90bc057780 con 0x7f90c00fe470 2024-08-01T07:05:06.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.639+0000 7f90c7f3c640 1 -- 172.21.15.16:0/2414953506 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f90c002c4f0 con 0x7f90ac06e170 2024-08-01T07:05:06.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.649+0000 7f90b6ffd640 1 -- 172.21.15.16:0/2414953506 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f90c002c4f0 con 0x7f90ac06e170 2024-08-01T07:05:06.650 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T07:05:06.650 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (15m) 4s ago 17m 25.3M - 0.25.0 c8568f914cd2 b19c5cf45f1b 2024-08-01T07:05:06.650 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (50s) 4s ago 17m 8409k - 19.1.0-1223-gf9911e17 93d93c74a2cc a847ec3f462f 2024-08-01T07:05:06.650 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (40s) 21s ago 16m 8224k - 19.1.0-1223-gf9911e17 93d93c74a2cc f2f5e0a7786f 2024-08-01T07:05:06.650 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (5m) 4s ago 17m 6899k - 19.1.0-1223-gf9911e17 93d93c74a2cc 2a96028287a2 2024-08-01T07:05:06.651 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (5m) 21s ago 16m 6895k - 19.1.0-1223-gf9911e17 93d93c74a2cc 8a23341bd6c3 2024-08-01T07:05:06.651 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (15m) 4s ago 16m 86.0M - 9.4.7 954c08fa6188 2693f8451cc2 2024-08-01T07:05:06.651 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (119s) 4s ago 11m 89.9M - 19.1.0-1223-gf9911e17 93d93c74a2cc 2fb78654cbea 2024-08-01T07:05:06.651 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (94s) 4s ago 11m 17.2M - 19.1.0-1223-gf9911e17 93d93c74a2cc d3ca5deb5bb6 2024-08-01T07:05:06.651 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (77s) 21s ago 11m 86.0M - 19.1.0-1223-gf9911e17 93d93c74a2cc 6e9b9ebf3bc9 2024-08-01T07:05:06.651 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (63s) 21s ago 11m 16.1M - 19.1.0-1223-gf9911e17 93d93c74a2cc 98dd666884c1 2024-08-01T07:05:06.651 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:8443,9283,8765 running (8m) 4s ago 18m 509M - 19.1.0-1223-gf9911e17 93d93c74a2cc 8701e6315593 2024-08-01T07:05:06.651 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (7m) 21s ago 16m 442M - 19.1.0-1223-gf9911e17 93d93c74a2cc c6caa21f436f 2024-08-01T07:05:06.651 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (6m) 4s ago 18m 57.6M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc 48e94d076e6f 2024-08-01T07:05:06.651 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (6m) 21s ago 16m 43.6M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc c4b83b46ff15 2024-08-01T07:05:06.651 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (28s) 4s ago 17m 7922k - 1.5.0 0da6a335fe13 d2aef4eb39e6 2024-08-01T07:05:06.651 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (24s) 21s ago 16m 5653k - 1.5.0 0da6a335fe13 318349c489e1 2024-08-01T07:05:06.651 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (5m) 4s ago 15m 207M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 4c2115ae6222 2024-08-01T07:05:06.652 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (4m) 4s ago 14m 111M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc fc2f7117be30 2024-08-01T07:05:06.652 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (4m) 4s ago 14m 145M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 3364752c9365 2024-08-01T07:05:06.652 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (3m) 21s ago 14m 117M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 9a18feae4353 2024-08-01T07:05:06.652 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (3m) 21s ago 13m 168M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 7c51ba7a636a 2024-08-01T07:05:06.652 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (2m) 21s ago 13m 127M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 08ffb10ca1a6 2024-08-01T07:05:06.652 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (9s) 4s ago 16m 42.1M - 2.43.0 a07b618ecd1d a411dec2c11d 2024-08-01T07:05:06.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.651+0000 7f90c7f3c640 1 -- 172.21.15.16:0/2414953506 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f90ac06e170 msgr2=0x7f90ac070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:06.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.651+0000 7f90c7f3c640 1 --2- 172.21.15.16:0/2414953506 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f90ac06e170 0x7f90ac070630 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f90b0000c00 tx=0x7f90b00314e0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.651+0000 7f90c7f3c640 1 -- 172.21.15.16:0/2414953506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90c00fe470 msgr2=0x7f90c01978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:06.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.651+0000 7f90c7f3c640 1 --2- 172.21.15.16:0/2414953506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90c00fe470 0x7f90c01978b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00ea10 tx=0x7f90bc00eed0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.651+0000 7f90c7f3c640 1 -- 172.21.15.16:0/2414953506 shutdown_connections 2024-08-01T07:05:06.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.651+0000 7f90c7f3c640 1 --2- 172.21.15.16:0/2414953506 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f90ac06e170 0x7f90ac070630 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.651+0000 7f90c7f3c640 1 --2- 172.21.15.16:0/2414953506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90c00fedb0 0x7f90c0197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.651+0000 7f90c7f3c640 1 --2- 172.21.15.16:0/2414953506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90c00fe470 0x7f90c01978b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.651+0000 7f90c7f3c640 1 -- 172.21.15.16:0/2414953506 >> 172.21.15.16:0/2414953506 conn(0x7f90c00fa280 msgr2=0x7f90c0106f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:06.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.651+0000 7f90c7f3c640 1 -- 172.21.15.16:0/2414953506 shutdown_connections 2024-08-01T07:05:06.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.651+0000 7f90c7f3c640 1 -- 172.21.15.16:0/2414953506 wait complete. 2024-08-01T07:05:06.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.734+0000 7fd2091b8640 1 -- 172.21.15.16:0/4130729210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd204102f60 msgr2=0x7fd204105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:06.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.734+0000 7fd2091b8640 1 --2- 172.21.15.16:0/4130729210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd204102f60 0x7fd204105350 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd1f40098b0 tx=0x7fd1f402a4d0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.734+0000 7fd2091b8640 1 -- 172.21.15.16:0/4130729210 shutdown_connections 2024-08-01T07:05:06.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.734+0000 7fd2091b8640 1 --2- 172.21.15.16:0/4130729210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd204102f60 0x7fd204105350 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.734+0000 7fd2091b8640 1 --2- 172.21.15.16:0/4130729210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd204100630 0x7fd204102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.734+0000 7fd2091b8640 1 -- 172.21.15.16:0/4130729210 >> 172.21.15.16:0/4130729210 conn(0x7fd2040fa250 msgr2=0x7fd2040fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:06.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.734+0000 7fd2091b8640 1 -- 172.21.15.16:0/4130729210 shutdown_connections 2024-08-01T07:05:06.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.734+0000 7fd2091b8640 1 -- 172.21.15.16:0/4130729210 wait complete. 2024-08-01T07:05:06.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.735+0000 7fd2091b8640 1 Processor -- start 2024-08-01T07:05:06.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.735+0000 7fd2091b8640 1 -- start start 2024-08-01T07:05:06.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.736+0000 7fd2091b8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd204100630 0x7fd2040fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:06.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.736+0000 7fd2091b8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd204102f60 0x7fd2040fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:06.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.736+0000 7fd2091b8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2041004d0 con 0x7fd204102f60 2024-08-01T07:05:06.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.736+0000 7fd2091b8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2040feb50 con 0x7fd204100630 2024-08-01T07:05:06.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.736+0000 7fd20259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd204102f60 0x7fd2040fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:06.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.736+0000 7fd20259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd204102f60 0x7fd2040fe5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52488/0 (socket says 172.21.15.16:52488) 2024-08-01T07:05:06.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.736+0000 7fd20259c640 1 -- 172.21.15.16:0/2766829181 learned_addr learned my addr 172.21.15.16:0/2766829181 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:05:06.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.736+0000 7fd202d9d640 1 --2- 172.21.15.16:0/2766829181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd204100630 0x7fd2040fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:06.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.736+0000 7fd20259c640 1 -- 172.21.15.16:0/2766829181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd204100630 msgr2=0x7fd2040fff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:06.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.736+0000 7fd20259c640 1 --2- 172.21.15.16:0/2766829181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd204100630 0x7fd2040fff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:06.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.736+0000 7fd20259c640 1 -- 172.21.15.16:0/2766829181 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f4009560 con 0x7fd204102f60 2024-08-01T07:05:06.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.736+0000 7fd20259c640 1 --2- 172.21.15.16:0/2766829181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd204102f60 0x7fd2040fe5e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd1f402a9f0 tx=0x7fd1f4005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:06.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.737+0000 7fd1ebfff640 1 -- 172.21.15.16:0/2766829181 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1f4004b20 con 0x7fd204102f60 2024-08-01T07:05:06.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.737+0000 7fd1ebfff640 1 -- 172.21.15.16:0/2766829181 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd1f4004c80 con 0x7fd204102f60 2024-08-01T07:05:06.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.737+0000 7fd2091b8640 1 -- 172.21.15.16:0/2766829181 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2040fedd0 con 0x7fd204102f60 2024-08-01T07:05:06.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.737+0000 7fd1ebfff640 1 -- 172.21.15.16:0/2766829181 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1f4003b50 con 0x7fd204102f60 2024-08-01T07:05:06.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.737+0000 7fd2091b8640 1 -- 172.21.15.16:0/2766829181 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2040ff2f0 con 0x7fd204102f60 2024-08-01T07:05:06.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.738+0000 7fd2091b8640 1 -- 172.21.15.16:0/2766829181 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd204100a10 con 0x7fd204102f60 2024-08-01T07:05:06.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.739+0000 7fd1ebfff640 1 -- 172.21.15.16:0/2766829181 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd1f4031640 con 0x7fd204102f60 2024-08-01T07:05:06.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.739+0000 7fd1ebfff640 1 --2- 172.21.15.16:0/2766829181 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd1ec06e170 0x7fd1ec070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:06.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.740+0000 7fd202d9d640 1 --2- 172.21.15.16:0/2766829181 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd1ec06e170 0x7fd1ec070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:06.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.740+0000 7fd1ebfff640 1 -- 172.21.15.16:0/2766829181 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fd1f40af500 con 0x7fd204102f60 2024-08-01T07:05:06.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.740+0000 7fd202d9d640 1 --2- 172.21.15.16:0/2766829181 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd1ec06e170 0x7fd1ec070630 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800abe0 tx=0x7fd1f800a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:06.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:06.746+0000 7fd1ebfff640 1 -- 172.21.15.16:0/2766829181 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd1f40786c0 con 0x7fd204102f60 2024-08-01T07:05:07.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.003+0000 7fd2091b8640 1 -- 172.21.15.16:0/2766829181 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd204108960 con 0x7fd204102f60 2024-08-01T07:05:07.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.004+0000 7fd1ebfff640 1 -- 172.21.15.16:0/2766829181 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7fd1f4031d00 con 0x7fd204102f60 2024-08-01T07:05:07.006 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:05:07.006 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T07:05:07.007 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:05:07.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:05:07.007 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T07:05:07.007 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:05:07.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:05:07.008 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T07:05:07.008 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 6 2024-08-01T07:05:07.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:05:07.008 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T07:05:07.009 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 4 2024-08-01T07:05:07.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:05:07.009 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T07:05:07.009 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 14 2024-08-01T07:05:07.009 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T07:05:07.010 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:05:07.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.006+0000 7fd2091b8640 1 -- 172.21.15.16:0/2766829181 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd1ec06e170 msgr2=0x7fd1ec070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:07.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.006+0000 7fd2091b8640 1 --2- 172.21.15.16:0/2766829181 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd1ec06e170 0x7fd1ec070630 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800abe0 tx=0x7fd1f800a2d0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.006+0000 7fd2091b8640 1 -- 172.21.15.16:0/2766829181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd204102f60 msgr2=0x7fd2040fe5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:07.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.006+0000 7fd2091b8640 1 --2- 172.21.15.16:0/2766829181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd204102f60 0x7fd2040fe5e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd1f402a9f0 tx=0x7fd1f4005610 comp rx=0 tx=0).stop 2024-08-01T07:05:07.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.006+0000 7fd2091b8640 1 -- 172.21.15.16:0/2766829181 shutdown_connections 2024-08-01T07:05:07.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.006+0000 7fd2091b8640 1 --2- 172.21.15.16:0/2766829181 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fd1ec06e170 0x7fd1ec070630 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.006+0000 7fd2091b8640 1 --2- 172.21.15.16:0/2766829181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd204102f60 0x7fd2040fe5e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.006+0000 7fd2091b8640 1 --2- 172.21.15.16:0/2766829181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd204100630 0x7fd2040fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.006+0000 7fd2091b8640 1 -- 172.21.15.16:0/2766829181 >> 172.21.15.16:0/2766829181 conn(0x7fd2040fa250 msgr2=0x7fd2040fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:07.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.007+0000 7fd2091b8640 1 -- 172.21.15.16:0/2766829181 shutdown_connections 2024-08-01T07:05:07.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.007+0000 7fd2091b8640 1 -- 172.21.15.16:0/2766829181 wait complete. 2024-08-01T07:05:07.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.092+0000 7f22ded18640 1 -- 172.21.15.16:0/757317117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d80fea00 msgr2=0x7f22d80fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:07.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.092+0000 7f22ded18640 1 --2- 172.21.15.16:0/757317117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d80fea00 0x7f22d80fee00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009880 tx=0x7f22d002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.092+0000 7f22ded18640 1 -- 172.21.15.16:0/757317117 shutdown_connections 2024-08-01T07:05:07.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.092+0000 7f22ded18640 1 --2- 172.21.15.16:0/757317117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22d80ffc00 0x7f22d8100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.092+0000 7f22ded18640 1 --2- 172.21.15.16:0/757317117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d80fea00 0x7f22d80fee00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.092+0000 7f22ded18640 1 -- 172.21.15.16:0/757317117 >> 172.21.15.16:0/757317117 conn(0x7f22d80fa190 msgr2=0x7f22d80fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:07.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.092+0000 7f22ded18640 1 -- 172.21.15.16:0/757317117 shutdown_connections 2024-08-01T07:05:07.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.092+0000 7f22ded18640 1 -- 172.21.15.16:0/757317117 wait complete. 2024-08-01T07:05:07.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.092+0000 7f22ded18640 1 Processor -- start 2024-08-01T07:05:07.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.092+0000 7f22ded18640 1 -- start start 2024-08-01T07:05:07.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.092+0000 7f22ded18640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22d80fea00 0x7f22d8102990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:07.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.092+0000 7f22ded18640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d80ffc00 0x7f22d8100fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:07.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.093+0000 7f22ded18640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d8101520 con 0x7f22d80ffc00 2024-08-01T07:05:07.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.093+0000 7f22ded18640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d8101690 con 0x7f22d80fea00 2024-08-01T07:05:07.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.093+0000 7f22d7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d80ffc00 0x7f22d8100fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:07.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.093+0000 7f22d7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d80ffc00 0x7f22d8100fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52516/0 (socket says 172.21.15.16:52516) 2024-08-01T07:05:07.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.093+0000 7f22d7fff640 1 -- 172.21.15.16:0/3518749577 learned_addr learned my addr 172.21.15.16:0/3518749577 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:05:07.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.093+0000 7f22dcab4640 1 --2- 172.21.15.16:0/3518749577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22d80fea00 0x7f22d8102990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:07.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.093+0000 7f22d7fff640 1 -- 172.21.15.16:0/3518749577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22d80fea00 msgr2=0x7f22d8102990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:07.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.093+0000 7f22d7fff640 1 --2- 172.21.15.16:0/3518749577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22d80fea00 0x7f22d8102990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.093+0000 7f22d7fff640 1 -- 172.21.15.16:0/3518749577 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d0009560 con 0x7f22d80ffc00 2024-08-01T07:05:07.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.093+0000 7f22d7fff640 1 --2- 172.21.15.16:0/3518749577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d80ffc00 0x7f22d8100fe0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f22c800cc60 tx=0x7f22c800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:07.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.093+0000 7f22d5ffb640 1 -- 172.21.15.16:0/3518749577 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22c8004b20 con 0x7f22d80ffc00 2024-08-01T07:05:07.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.093+0000 7f22d5ffb640 1 -- 172.21.15.16:0/3518749577 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22c8004c80 con 0x7f22d80ffc00 2024-08-01T07:05:07.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.093+0000 7f22ded18640 1 -- 172.21.15.16:0/3518749577 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d8101970 con 0x7f22d80ffc00 2024-08-01T07:05:07.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.093+0000 7f22d5ffb640 1 -- 172.21.15.16:0/3518749577 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22c800f750 con 0x7f22d80ffc00 2024-08-01T07:05:07.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.094+0000 7f22ded18640 1 -- 172.21.15.16:0/3518749577 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d819d630 con 0x7f22d80ffc00 2024-08-01T07:05:07.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.095+0000 7f22ded18640 1 -- 172.21.15.16:0/3518749577 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d80fee00 con 0x7f22d80ffc00 2024-08-01T07:05:07.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.095+0000 7f22d5ffb640 1 -- 172.21.15.16:0/3518749577 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f22c800f9c0 con 0x7f22d80ffc00 2024-08-01T07:05:07.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.096+0000 7f22d5ffb640 1 --2- 172.21.15.16:0/3518749577 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f22c406e180 0x7f22c4070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:07.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.096+0000 7f22d5ffb640 1 -- 172.21.15.16:0/3518749577 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f22c808e4e0 con 0x7f22d80ffc00 2024-08-01T07:05:07.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.096+0000 7f22dcab4640 1 --2- 172.21.15.16:0/3518749577 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f22c406e180 0x7f22c4070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:07.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.096+0000 7f22dcab4640 1 --2- 172.21.15.16:0/3518749577 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f22c406e180 0x7f22c4070640 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f22d0006010 tx=0x7f22d0031500 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:07.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.100+0000 7f22d5ffb640 1 -- 172.21.15.16:0/3518749577 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f22c80576a0 con 0x7f22d80ffc00 2024-08-01T07:05:07.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.320+0000 7f22ded18640 1 -- 172.21.15.16:0/3518749577 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f22d81075f0 con 0x7f22d80ffc00 2024-08-01T07:05:07.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.321+0000 7f22d5ffb640 1 -- 172.21.15.16:0/3518749577 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) v1 ==== 76+0+2000 (secure 0 0 0) 0x7f22c805ad60 con 0x7f22d80ffc00 2024-08-01T07:05:07.323 INFO:teuthology.orchestra.run.smithi016.stdout:e38 2024-08-01T07:05:07.323 INFO:teuthology.orchestra.run.smithi016.stdout:btime 2024-08-01T07:04:11:596120+0000 2024-08-01T07:05:07.323 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T07:05:07.324 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T07:05:07.324 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T07:05:07.324 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:05:07.324 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T07:05:07.324 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T07:05:07.325 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 38 2024-08-01T07:05:07.325 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T07:05:07.325 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T07:05:07.325 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T07:04:11.596112+0000 2024-08-01T07:05:07.325 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T07:05:07.326 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T07:05:07.326 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T07:05:07.326 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T07:05:07.326 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T07:05:07.326 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T07:05:07.327 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T07:05:07.327 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T07:05:07.327 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 94 2024-08-01T07:05:07.327 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-01T07:05:07.328 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T07:05:07.328 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T07:05:07.328 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=34414,1=34446} 2024-08-01T07:05:07.328 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T07:05:07.329 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T07:05:07.329 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T07:05:07.329 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T07:05:07.329 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T07:05:07.329 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T07:05:07.330 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T07:05:07.330 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T07:05:07.330 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T07:05:07.330 INFO:teuthology.orchestra.run.smithi016.stdout:qdb_cluster leader: 34414 members: 34446,34414 2024-08-01T07:05:07.330 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:34414} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.16:6826/4064792079,v1:172.21.15.16:6827/4064792079] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:05:07.330 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{0:44357} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6824/3335707325,v1:172.21.15.89:6825/3335707325] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:05:07.331 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{1:34446} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.16:6828/2186852070,v1:172.21.15.16:6829/2186852070] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:05:07.331 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:44387} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/885893699,v1:172.21.15.89:6827/885893699] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:05:07.331 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:05:07.331 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:05:07.332 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 38 2024-08-01T07:05:07.332 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: pgmap v254: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:05:07.333 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:07.333 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:07.333 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:05:07.333 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:05:07.333 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:05:07.333 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:07.334 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-01T07:05:07.334 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:05:07.334 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.334 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.334 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.335 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.335 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.335 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.335 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.335 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.336 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.336 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.336 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.336 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.336 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.336 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.337 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:07 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2766829181' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.323+0000 7f22ded18640 1 -- 172.21.15.16:0/3518749577 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f22c406e180 msgr2=0x7f22c4070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:07.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.323+0000 7f22ded18640 1 --2- 172.21.15.16:0/3518749577 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f22c406e180 0x7f22c4070640 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f22d0006010 tx=0x7f22d0031500 comp rx=0 tx=0).stop 2024-08-01T07:05:07.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.323+0000 7f22ded18640 1 -- 172.21.15.16:0/3518749577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d80ffc00 msgr2=0x7f22d8100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:07.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.323+0000 7f22ded18640 1 --2- 172.21.15.16:0/3518749577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d80ffc00 0x7f22d8100fe0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f22c800cc60 tx=0x7f22c800a620 comp rx=0 tx=0).stop 2024-08-01T07:05:07.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.324+0000 7f22ded18640 1 -- 172.21.15.16:0/3518749577 shutdown_connections 2024-08-01T07:05:07.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.324+0000 7f22ded18640 1 --2- 172.21.15.16:0/3518749577 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f22c406e180 0x7f22c4070640 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.324+0000 7f22ded18640 1 --2- 172.21.15.16:0/3518749577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d80ffc00 0x7f22d8100fe0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.324+0000 7f22ded18640 1 --2- 172.21.15.16:0/3518749577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22d80fea00 0x7f22d8102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.324+0000 7f22ded18640 1 -- 172.21.15.16:0/3518749577 >> 172.21.15.16:0/3518749577 conn(0x7f22d80fa190 msgr2=0x7f22d8067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:07.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.324+0000 7f22ded18640 1 -- 172.21.15.16:0/3518749577 shutdown_connections 2024-08-01T07:05:07.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.324+0000 7f22ded18640 1 -- 172.21.15.16:0/3518749577 wait complete. 2024-08-01T07:05:07.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: pgmap v254: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:05:07.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:07.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:07.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:05:07.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:05:07.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:05:07.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:07.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-01T07:05:07.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:05:07.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.389 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:07 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2766829181' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:07.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.407+0000 7f2403140640 1 -- 172.21.15.16:0/3963426709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23fc100630 msgr2=0x7f23fc102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:07.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.407+0000 7f2403140640 1 --2- 172.21.15.16:0/3963426709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23fc100630 0x7f23fc102a20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f23f80098b0 tx=0x7f23f802a4d0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.408+0000 7f2403140640 1 -- 172.21.15.16:0/3963426709 shutdown_connections 2024-08-01T07:05:07.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.408+0000 7f2403140640 1 --2- 172.21.15.16:0/3963426709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23fc102f60 0x7f23fc105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.408+0000 7f2403140640 1 --2- 172.21.15.16:0/3963426709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23fc100630 0x7f23fc102a20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.408+0000 7f2403140640 1 -- 172.21.15.16:0/3963426709 >> 172.21.15.16:0/3963426709 conn(0x7f23fc0fa250 msgr2=0x7f23fc0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:07.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.408+0000 7f2403140640 1 -- 172.21.15.16:0/3963426709 shutdown_connections 2024-08-01T07:05:07.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.408+0000 7f2403140640 1 -- 172.21.15.16:0/3963426709 wait complete. 2024-08-01T07:05:07.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.408+0000 7f2403140640 1 Processor -- start 2024-08-01T07:05:07.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.408+0000 7f2403140640 1 -- start start 2024-08-01T07:05:07.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.408+0000 7f2403140640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23fc100630 0x7f23fc195660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:07.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.408+0000 7f2403140640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23fc102f60 0x7f23fc195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:07.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.408+0000 7f2403140640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc196170 con 0x7f23fc102f60 2024-08-01T07:05:07.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.408+0000 7f2403140640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc1962e0 con 0x7f23fc100630 2024-08-01T07:05:07.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.409+0000 7f23f3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23fc102f60 0x7f23fc195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:07.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.409+0000 7f23f3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23fc102f60 0x7f23fc195ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52528/0 (socket says 172.21.15.16:52528) 2024-08-01T07:05:07.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.409+0000 7f23f3fff640 1 -- 172.21.15.16:0/2970144561 learned_addr learned my addr 172.21.15.16:0/2970144561 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:05:07.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.409+0000 7f2400edc640 1 --2- 172.21.15.16:0/2970144561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23fc100630 0x7f23fc195660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:07.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.409+0000 7f23f3fff640 1 -- 172.21.15.16:0/2970144561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23fc100630 msgr2=0x7f23fc195660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:07.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.409+0000 7f23f3fff640 1 --2- 172.21.15.16:0/2970144561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23fc100630 0x7f23fc195660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.409+0000 7f23f3fff640 1 -- 172.21.15.16:0/2970144561 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f8009560 con 0x7f23fc102f60 2024-08-01T07:05:07.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.409+0000 7f23f3fff640 1 --2- 172.21.15.16:0/2970144561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23fc102f60 0x7f23fc195ba0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f23ec00e9a0 tx=0x7f23ec00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:07.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.409+0000 7f23f1ffb640 1 -- 172.21.15.16:0/2970144561 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23ec00cc90 con 0x7f23fc102f60 2024-08-01T07:05:07.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.409+0000 7f2403140640 1 -- 172.21.15.16:0/2970144561 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23fc19ad80 con 0x7f23fc102f60 2024-08-01T07:05:07.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.409+0000 7f23f1ffb640 1 -- 172.21.15.16:0/2970144561 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23ec00cdf0 con 0x7f23fc102f60 2024-08-01T07:05:07.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.409+0000 7f23f1ffb640 1 -- 172.21.15.16:0/2970144561 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23ec010430 con 0x7f23fc102f60 2024-08-01T07:05:07.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.410+0000 7f2403140640 1 -- 172.21.15.16:0/2970144561 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23fc19b350 con 0x7f23fc102f60 2024-08-01T07:05:07.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.411+0000 7f2403140640 1 -- 172.21.15.16:0/2970144561 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23fc1087e0 con 0x7f23fc102f60 2024-08-01T07:05:07.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.411+0000 7f23f1ffb640 1 -- 172.21.15.16:0/2970144561 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f23ec005020 con 0x7f23fc102f60 2024-08-01T07:05:07.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.411+0000 7f23f1ffb640 1 --2- 172.21.15.16:0/2970144561 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f23e406e180 0x7f23e4070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:07.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.412+0000 7f23f1ffb640 1 -- 172.21.15.16:0/2970144561 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f23ec014070 con 0x7f23fc102f60 2024-08-01T07:05:07.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.412+0000 7f2400edc640 1 --2- 172.21.15.16:0/2970144561 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f23e406e180 0x7f23e4070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:07.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.412+0000 7f2400edc640 1 --2- 172.21.15.16:0/2970144561 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f23e406e180 0x7f23e4070640 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f23f8006010 tx=0x7f23f8031500 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:07.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.416+0000 7f23f1ffb640 1 -- 172.21.15.16:0/2970144561 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f23ec057990 con 0x7f23fc102f60 2024-08-01T07:05:07.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.614+0000 7f2403140640 1 -- 172.21.15.16:0/2970144561 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f23fc103980 con 0x7f23e406e180 2024-08-01T07:05:07.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.615+0000 7f23f1ffb640 1 -- 172.21.15.16:0/2970144561 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7f23fc103980 con 0x7f23e406e180 2024-08-01T07:05:07.617 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:05:07.617 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T07:05:07.617 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T07:05:07.617 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T07:05:07.617 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-08-01T07:05:07.618 INFO:teuthology.orchestra.run.smithi016.stdout: "mds", 2024-08-01T07:05:07.618 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph-exporter", 2024-08-01T07:05:07.618 INFO:teuthology.orchestra.run.smithi016.stdout: "crash", 2024-08-01T07:05:07.618 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-08-01T07:05:07.618 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr", 2024-08-01T07:05:07.618 INFO:teuthology.orchestra.run.smithi016.stdout: "osd" 2024-08-01T07:05:07.618 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-08-01T07:05:07.618 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "18/23 daemons upgraded", 2024-08-01T07:05:07.618 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading alertmanager daemons", 2024-08-01T07:05:07.618 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T07:05:07.618 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:05:07.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.618+0000 7f2403140640 1 -- 172.21.15.16:0/2970144561 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f23e406e180 msgr2=0x7f23e4070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:07.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.618+0000 7f2403140640 1 --2- 172.21.15.16:0/2970144561 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f23e406e180 0x7f23e4070640 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f23f8006010 tx=0x7f23f8031500 comp rx=0 tx=0).stop 2024-08-01T07:05:07.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.618+0000 7f2403140640 1 -- 172.21.15.16:0/2970144561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23fc102f60 msgr2=0x7f23fc195ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:07.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.618+0000 7f2403140640 1 --2- 172.21.15.16:0/2970144561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23fc102f60 0x7f23fc195ba0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f23ec00e9a0 tx=0x7f23ec00ee60 comp rx=0 tx=0).stop 2024-08-01T07:05:07.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.618+0000 7f2403140640 1 -- 172.21.15.16:0/2970144561 shutdown_connections 2024-08-01T07:05:07.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.618+0000 7f2403140640 1 --2- 172.21.15.16:0/2970144561 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f23e406e180 0x7f23e4070640 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.618+0000 7f2403140640 1 --2- 172.21.15.16:0/2970144561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23fc102f60 0x7f23fc195ba0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.618+0000 7f2403140640 1 --2- 172.21.15.16:0/2970144561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23fc100630 0x7f23fc195660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.618+0000 7f2403140640 1 -- 172.21.15.16:0/2970144561 >> 172.21.15.16:0/2970144561 conn(0x7f23fc0fa250 msgr2=0x7f23fc0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:07.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.618+0000 7f2403140640 1 -- 172.21.15.16:0/2970144561 shutdown_connections 2024-08-01T07:05:07.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.618+0000 7f2403140640 1 -- 172.21.15.16:0/2970144561 wait complete. 2024-08-01T07:05:07.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.705+0000 7fab83020640 1 -- 172.21.15.16:0/479448137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7c103010 msgr2=0x7fab7c105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:07.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.705+0000 7fab83020640 1 --2- 172.21.15.16:0/479448137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7c103010 0x7fab7c105400 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fab6c009880 tx=0x7fab6c02a4a0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.705+0000 7fab83020640 1 -- 172.21.15.16:0/479448137 shutdown_connections 2024-08-01T07:05:07.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.705+0000 7fab83020640 1 --2- 172.21.15.16:0/479448137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7c103010 0x7fab7c105400 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.705+0000 7fab83020640 1 --2- 172.21.15.16:0/479448137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab7c1006e0 0x7fab7c102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.705+0000 7fab83020640 1 -- 172.21.15.16:0/479448137 >> 172.21.15.16:0/479448137 conn(0x7fab7c0fa280 msgr2=0x7fab7c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:07.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.705+0000 7fab83020640 1 -- 172.21.15.16:0/479448137 shutdown_connections 2024-08-01T07:05:07.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.705+0000 7fab83020640 1 -- 172.21.15.16:0/479448137 wait complete. 2024-08-01T07:05:07.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.706+0000 7fab83020640 1 Processor -- start 2024-08-01T07:05:07.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.706+0000 7fab83020640 1 -- start start 2024-08-01T07:05:07.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.706+0000 7fab83020640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7c1006e0 0x7fab7c100040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:07.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.706+0000 7fab83020640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab7c103010 0x7fab7c0fe690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:07.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.706+0000 7fab83020640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c0febd0 con 0x7fab7c1006e0 2024-08-01T07:05:07.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.706+0000 7fab83020640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c0fed40 con 0x7fab7c103010 2024-08-01T07:05:07.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.706+0000 7fab80dbc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7c1006e0 0x7fab7c100040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:07.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.706+0000 7fab80dbc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7c1006e0 0x7fab7c100040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52536/0 (socket says 172.21.15.16:52536) 2024-08-01T07:05:07.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.706+0000 7fab80dbc640 1 -- 172.21.15.16:0/549040317 learned_addr learned my addr 172.21.15.16:0/549040317 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:05:07.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.706+0000 7fab73fff640 1 --2- 172.21.15.16:0/549040317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab7c103010 0x7fab7c0fe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:07.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.706+0000 7fab80dbc640 1 -- 172.21.15.16:0/549040317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab7c103010 msgr2=0x7fab7c0fe690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:07.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.706+0000 7fab80dbc640 1 --2- 172.21.15.16:0/549040317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab7c103010 0x7fab7c0fe690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.706+0000 7fab80dbc640 1 -- 172.21.15.16:0/549040317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c009560 con 0x7fab7c1006e0 2024-08-01T07:05:07.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.706+0000 7fab73fff640 1 --2- 172.21.15.16:0/549040317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab7c103010 0x7fab7c0fe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T07:05:07.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.707+0000 7fab80dbc640 1 --2- 172.21.15.16:0/549040317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7c1006e0 0x7fab7c100040 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fab7800e970 tx=0x7fab7800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:07.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.707+0000 7fab71ffb640 1 -- 172.21.15.16:0/549040317 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab7800cc90 con 0x7fab7c1006e0 2024-08-01T07:05:07.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.707+0000 7fab71ffb640 1 -- 172.21.15.16:0/549040317 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab7800cdf0 con 0x7fab7c1006e0 2024-08-01T07:05:07.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.707+0000 7fab83020640 1 -- 172.21.15.16:0/549040317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7c0ff020 con 0x7fab7c1006e0 2024-08-01T07:05:07.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.707+0000 7fab71ffb640 1 -- 172.21.15.16:0/549040317 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab78010430 con 0x7fab7c1006e0 2024-08-01T07:05:07.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.707+0000 7fab83020640 1 -- 172.21.15.16:0/549040317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7c19d6a0 con 0x7fab7c1006e0 2024-08-01T07:05:07.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.708+0000 7fab83020640 1 -- 172.21.15.16:0/549040317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab7c100ac0 con 0x7fab7c1006e0 2024-08-01T07:05:07.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.708+0000 7fab71ffb640 1 -- 172.21.15.16:0/549040317 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fab780046c0 con 0x7fab7c1006e0 2024-08-01T07:05:07.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.709+0000 7fab71ffb640 1 --2- 172.21.15.16:0/549040317 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fab6406e170 0x7fab64070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:07.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.709+0000 7fab71ffb640 1 -- 172.21.15.16:0/549040317 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fab78014070 con 0x7fab7c1006e0 2024-08-01T07:05:07.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.709+0000 7fab73fff640 1 --2- 172.21.15.16:0/549040317 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fab6406e170 0x7fab64070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:07.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.709+0000 7fab73fff640 1 --2- 172.21.15.16:0/549040317 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fab6406e170 0x7fab64070630 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fab6c009230 tx=0x7fab6c0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:07.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.713+0000 7fab71ffb640 1 -- 172.21.15.16:0/549040317 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fab78057a00 con 0x7fab7c1006e0 2024-08-01T07:05:07.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.972+0000 7fab83020640 1 -- 172.21.15.16:0/549040317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fab7c1090f0 con 0x7fab7c1006e0 2024-08-01T07:05:07.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.972+0000 7fab71ffb640 1 -- 172.21.15.16:0/549040317 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fab7805b0c0 con 0x7fab7c1006e0 2024-08-01T07:05:07.974 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-08-01T07:05:07.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.974+0000 7fab83020640 1 -- 172.21.15.16:0/549040317 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fab6406e170 msgr2=0x7fab64070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:07.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.974+0000 7fab83020640 1 --2- 172.21.15.16:0/549040317 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fab6406e170 0x7fab64070630 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fab6c009230 tx=0x7fab6c0314e0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.974+0000 7fab83020640 1 -- 172.21.15.16:0/549040317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7c1006e0 msgr2=0x7fab7c100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:07.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.974+0000 7fab83020640 1 --2- 172.21.15.16:0/549040317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7c1006e0 0x7fab7c100040 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fab7800e970 tx=0x7fab7800ed70 comp rx=0 tx=0).stop 2024-08-01T07:05:07.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.975+0000 7fab83020640 1 -- 172.21.15.16:0/549040317 shutdown_connections 2024-08-01T07:05:07.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.975+0000 7fab83020640 1 --2- 172.21.15.16:0/549040317 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fab6406e170 0x7fab64070630 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.975+0000 7fab83020640 1 --2- 172.21.15.16:0/549040317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab7c103010 0x7fab7c0fe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.975+0000 7fab83020640 1 --2- 172.21.15.16:0/549040317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7c1006e0 0x7fab7c100040 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:07.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.975+0000 7fab83020640 1 -- 172.21.15.16:0/549040317 >> 172.21.15.16:0/549040317 conn(0x7fab7c0fa280 msgr2=0x7fab7c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:07.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.975+0000 7fab83020640 1 -- 172.21.15.16:0/549040317 shutdown_connections 2024-08-01T07:05:07.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:07.975+0000 7fab83020640 1 -- 172.21.15.16:0/549040317 wait complete. 2024-08-01T07:05:08.279 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:08 smithi016 ceph-mon[93645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-01T07:05:08.279 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:08 smithi016 ceph-mon[93645]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:05:08.279 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:08 smithi016 ceph-mon[93645]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:05:08.279 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:08 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/3518749577' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:05:08.279 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:08 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/549040317' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:05:08.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:08 smithi089 ceph-mon[82218]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-01T07:05:08.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:08 smithi089 ceph-mon[82218]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:05:08.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:08 smithi089 ceph-mon[82218]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:05:08.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:08 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/3518749577' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:05:08.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:08 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/549040317' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:05:09.271 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:09 smithi016 ceph-mon[93645]: pgmap v255: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:05:09.271 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:09 smithi016 ceph-mon[93645]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:05:09.271 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:09 smithi016 ceph-mon[93645]: Upgrade: Updating alertmanager.smithi016 2024-08-01T07:05:09.271 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:09 smithi016 ceph-mon[93645]: Deploying daemon alertmanager.smithi016 on smithi016 2024-08-01T07:05:09.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:09 smithi089 ceph-mon[82218]: pgmap v255: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:05:09.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:09 smithi089 ceph-mon[82218]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:05:09.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:09 smithi089 ceph-mon[82218]: Upgrade: Updating alertmanager.smithi016 2024-08-01T07:05:09.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:09 smithi089 ceph-mon[82218]: Deploying daemon alertmanager.smithi016 on smithi016 2024-08-01T07:05:11.344 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:11 smithi016 ceph-mon[93645]: pgmap v256: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:05:11.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:11 smithi089 ceph-mon[82218]: pgmap v256: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:05:13.117 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:13 smithi016 ceph-mon[93645]: pgmap v257: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:05:13.367 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:13 smithi089 ceph-mon[82218]: pgmap v257: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:05:14.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:14 smithi089 ceph-mon[82218]: pgmap v258: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:05:14.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:14 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:14.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:14 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:14.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:14 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:05:14.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:14 smithi016 ceph-mon[93645]: pgmap v258: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:05:14.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:14 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:14.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:14 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:14.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:14 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:05:16.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:16 smithi089 ceph-mon[82218]: pgmap v259: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:05:16.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:16 smithi016 ceph-mon[93645]: pgmap v259: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:05:17.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:05:17.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:05:18.984 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:18 smithi016 ceph-mon[93645]: pgmap v260: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:05:18.984 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:18.985 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:18.985 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:18.985 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:19.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:18 smithi089 ceph-mon[82218]: pgmap v260: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:05:19.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:19.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:19.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:19.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:20.964 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:20 smithi016 ceph-mon[93645]: pgmap v261: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:05:21.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:20 smithi089 ceph-mon[82218]: pgmap v261: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:05:22.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: pgmap v262: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:05:22.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:22.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:22.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:05:22.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:05:22.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:22.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-01T07:05:22.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-01T07:05:22.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:05:22.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:22.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:22.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:22.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:22.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:22.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:22.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:22.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:22.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:22.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:22.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:22.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:22.900 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:22.901 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:22.901 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:22 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:23.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: pgmap v262: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:05:23.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:23.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:23.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:05:23.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:05:23.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:23.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-01T07:05:23.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-01T07:05:23.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:05:23.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:23.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:23.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:23.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:23.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:23.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:23.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:23.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:23.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:23.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:23.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:23.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:23.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:23.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:23.140 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:22 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:24.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:24 smithi016 ceph-mon[93645]: pgmap v263: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:05:24.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:24 smithi016 ceph-mon[93645]: Upgrade: Updating grafana.smithi016 2024-08-01T07:05:24.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:24 smithi016 ceph-mon[93645]: Deploying daemon grafana.smithi016 on smithi016 2024-08-01T07:05:25.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:24 smithi089 ceph-mon[82218]: pgmap v263: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:05:25.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:24 smithi089 ceph-mon[82218]: Upgrade: Updating grafana.smithi016 2024-08-01T07:05:25.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:24 smithi089 ceph-mon[82218]: Deploying daemon grafana.smithi016 on smithi016 2024-08-01T07:05:27.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:26 smithi089 ceph-mon[82218]: pgmap v264: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:05:27.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:26 smithi016 ceph-mon[93645]: pgmap v264: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:05:29.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:28 smithi089 ceph-mon[82218]: pgmap v265: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:05:29.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:28 smithi016 ceph-mon[93645]: pgmap v265: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:05:31.058 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:30 smithi016 ceph-mon[93645]: pgmap v266: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:05:31.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:30 smithi089 ceph-mon[82218]: pgmap v266: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:05:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:32 smithi089 ceph-mon[82218]: pgmap v267: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:05:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:05:33.025 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:32 smithi016 ceph-mon[93645]: pgmap v267: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:05:33.025 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:05:35.126 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:34 smithi016 ceph-mon[93645]: pgmap v268: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:05:35.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:34 smithi089 ceph-mon[82218]: pgmap v268: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:05:37.076 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:36 smithi016 ceph-mon[93645]: pgmap v269: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:05:37.076 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:36 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:37.076 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:36 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:37.076 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:36 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:05:37.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:36 smithi089 ceph-mon[82218]: pgmap v269: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:05:37.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:36 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:37.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:36 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:37.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:36 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:05:38.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.062+0000 7ff32ada2640 1 -- 172.21.15.16:0/1835244943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff324100d90 msgr2=0x7ff324101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:38.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.062+0000 7ff32ada2640 1 --2- 172.21.15.16:0/1835244943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff324100d90 0x7ff324101210 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff314009880 tx=0x7ff31402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.062+0000 7ff32ada2640 1 -- 172.21.15.16:0/1835244943 shutdown_connections 2024-08-01T07:05:38.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.062+0000 7ff32ada2640 1 --2- 172.21.15.16:0/1835244943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff324100d90 0x7ff324101210 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.062+0000 7ff32ada2640 1 --2- 172.21.15.16:0/1835244943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3240ffb90 0x7ff3240fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.062+0000 7ff32ada2640 1 -- 172.21.15.16:0/1835244943 >> 172.21.15.16:0/1835244943 conn(0x7ff3240fb320 msgr2=0x7ff3240fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:38.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.062+0000 7ff32ada2640 1 -- 172.21.15.16:0/1835244943 shutdown_connections 2024-08-01T07:05:38.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.062+0000 7ff32ada2640 1 -- 172.21.15.16:0/1835244943 wait complete. 2024-08-01T07:05:38.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.063+0000 7ff32ada2640 1 Processor -- start 2024-08-01T07:05:38.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.063+0000 7ff32ada2640 1 -- start start 2024-08-01T07:05:38.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.063+0000 7ff32ada2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3240ffb90 0x7ff324195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:38.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.063+0000 7ff32ada2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff324100d90 0x7ff324195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:38.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.063+0000 7ff32ada2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff324196140 con 0x7ff3240ffb90 2024-08-01T07:05:38.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.063+0000 7ff32ada2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3241962b0 con 0x7ff324100d90 2024-08-01T07:05:38.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.063+0000 7ff328b3e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3240ffb90 0x7ff324195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:38.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.063+0000 7ff328b3e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3240ffb90 0x7ff324195630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35106/0 (socket says 172.21.15.16:35106) 2024-08-01T07:05:38.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.063+0000 7ff328b3e640 1 -- 172.21.15.16:0/1898044585 learned_addr learned my addr 172.21.15.16:0/1898044585 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:05:38.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.064+0000 7ff31bfff640 1 --2- 172.21.15.16:0/1898044585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff324100d90 0x7ff324195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:38.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.064+0000 7ff328b3e640 1 -- 172.21.15.16:0/1898044585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff324100d90 msgr2=0x7ff324195b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:38.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.064+0000 7ff328b3e640 1 --2- 172.21.15.16:0/1898044585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff324100d90 0x7ff324195b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.064+0000 7ff328b3e640 1 -- 172.21.15.16:0/1898044585 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff314009560 con 0x7ff3240ffb90 2024-08-01T07:05:38.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.064+0000 7ff31bfff640 1 --2- 172.21.15.16:0/1898044585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff324100d90 0x7ff324195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-01T07:05:38.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.064+0000 7ff328b3e640 1 --2- 172.21.15.16:0/1898044585 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3240ffb90 0x7ff324195630 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff32000c920 tx=0x7ff32000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:38.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.064+0000 7ff319ffb640 1 -- 172.21.15.16:0/1898044585 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3200041f0 con 0x7ff3240ffb90 2024-08-01T07:05:38.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.064+0000 7ff319ffb640 1 -- 172.21.15.16:0/1898044585 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff320007e70 con 0x7ff3240ffb90 2024-08-01T07:05:38.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.064+0000 7ff32ada2640 1 -- 172.21.15.16:0/1898044585 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32419ad50 con 0x7ff3240ffb90 2024-08-01T07:05:38.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.064+0000 7ff319ffb640 1 -- 172.21.15.16:0/1898044585 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3200049d0 con 0x7ff3240ffb90 2024-08-01T07:05:38.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.064+0000 7ff32ada2640 1 -- 172.21.15.16:0/1898044585 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32419b2c0 con 0x7ff3240ffb90 2024-08-01T07:05:38.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.065+0000 7ff32ada2640 1 -- 172.21.15.16:0/1898044585 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32418f730 con 0x7ff3240ffb90 2024-08-01T07:05:38.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.066+0000 7ff319ffb640 1 -- 172.21.15.16:0/1898044585 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff320004350 con 0x7ff3240ffb90 2024-08-01T07:05:38.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.066+0000 7ff319ffb640 1 --2- 172.21.15.16:0/1898044585 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff30c06e170 0x7ff30c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:38.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.066+0000 7ff319ffb640 1 -- 172.21.15.16:0/1898044585 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7ff32008e080 con 0x7ff3240ffb90 2024-08-01T07:05:38.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.066+0000 7ff31bfff640 1 --2- 172.21.15.16:0/1898044585 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff30c06e170 0x7ff30c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:38.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.067+0000 7ff31bfff640 1 --2- 172.21.15.16:0/1898044585 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff30c06e170 0x7ff30c070630 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff314031540 tx=0x7ff314005de0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:38.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.071+0000 7ff319ffb640 1 -- 172.21.15.16:0/1898044585 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff320057240 con 0x7ff3240ffb90 2024-08-01T07:05:38.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.284+0000 7ff32ada2640 1 -- 172.21.15.16:0/1898044585 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff32402c550 con 0x7ff30c06e170 2024-08-01T07:05:38.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.285+0000 7ff319ffb640 1 -- 172.21.15.16:0/1898044585 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7ff32402c550 con 0x7ff30c06e170 2024-08-01T07:05:38.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.288+0000 7ff32ada2640 1 -- 172.21.15.16:0/1898044585 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff30c06e170 msgr2=0x7ff30c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:38.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.288+0000 7ff32ada2640 1 --2- 172.21.15.16:0/1898044585 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff30c06e170 0x7ff30c070630 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff314031540 tx=0x7ff314005de0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.288+0000 7ff32ada2640 1 -- 172.21.15.16:0/1898044585 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3240ffb90 msgr2=0x7ff324195630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:38.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.288+0000 7ff32ada2640 1 --2- 172.21.15.16:0/1898044585 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3240ffb90 0x7ff324195630 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff32000c920 tx=0x7ff32000cde0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.288+0000 7ff32ada2640 1 -- 172.21.15.16:0/1898044585 shutdown_connections 2024-08-01T07:05:38.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.288+0000 7ff32ada2640 1 --2- 172.21.15.16:0/1898044585 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff30c06e170 0x7ff30c070630 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.288+0000 7ff32ada2640 1 --2- 172.21.15.16:0/1898044585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff324100d90 0x7ff324195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.288+0000 7ff32ada2640 1 --2- 172.21.15.16:0/1898044585 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3240ffb90 0x7ff324195630 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.288+0000 7ff32ada2640 1 -- 172.21.15.16:0/1898044585 >> 172.21.15.16:0/1898044585 conn(0x7ff3240fb320 msgr2=0x7ff324104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:38.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.288+0000 7ff32ada2640 1 -- 172.21.15.16:0/1898044585 shutdown_connections 2024-08-01T07:05:38.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.288+0000 7ff32ada2640 1 -- 172.21.15.16:0/1898044585 wait complete. 2024-08-01T07:05:38.299 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T07:05:38.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.382+0000 7f7d76226640 1 -- 172.21.15.16:0/2005759069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d700ffcf0 msgr2=0x7f7d70100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:38.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.382+0000 7f7d76226640 1 --2- 172.21.15.16:0/2005759069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d700ffcf0 0x7f7d70100170 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009880 tx=0x7f7d5802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.382+0000 7f7d76226640 1 -- 172.21.15.16:0/2005759069 shutdown_connections 2024-08-01T07:05:38.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.382+0000 7f7d76226640 1 --2- 172.21.15.16:0/2005759069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d700ffcf0 0x7f7d70100170 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.382+0000 7f7d76226640 1 --2- 172.21.15.16:0/2005759069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d700feaf0 0x7f7d700feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.382+0000 7f7d76226640 1 -- 172.21.15.16:0/2005759069 >> 172.21.15.16:0/2005759069 conn(0x7f7d700fa280 msgr2=0x7f7d700fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:38.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.382+0000 7f7d76226640 1 -- 172.21.15.16:0/2005759069 shutdown_connections 2024-08-01T07:05:38.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.382+0000 7f7d76226640 1 -- 172.21.15.16:0/2005759069 wait complete. 2024-08-01T07:05:38.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.383+0000 7f7d76226640 1 Processor -- start 2024-08-01T07:05:38.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.383+0000 7f7d76226640 1 -- start start 2024-08-01T07:05:38.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.383+0000 7f7d76226640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d700feaf0 0x7f7d70068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:38.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.383+0000 7f7d76226640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d700ffcf0 0x7f7d7019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:38.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.383+0000 7f7d76226640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7019aa20 con 0x7f7d700feaf0 2024-08-01T07:05:38.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.383+0000 7f7d76226640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7019ab60 con 0x7f7d700ffcf0 2024-08-01T07:05:38.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.383+0000 7f7d6f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d700feaf0 0x7f7d70068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:38.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.383+0000 7f7d6f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d700feaf0 0x7f7d70068790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35118/0 (socket says 172.21.15.16:35118) 2024-08-01T07:05:38.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.383+0000 7f7d6f7fe640 1 -- 172.21.15.16:0/526337281 learned_addr learned my addr 172.21.15.16:0/526337281 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:05:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.384+0000 7f7d6effd640 1 --2- 172.21.15.16:0/526337281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d700ffcf0 0x7f7d7019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.384+0000 7f7d6f7fe640 1 -- 172.21.15.16:0/526337281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d700ffcf0 msgr2=0x7f7d7019a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.384+0000 7f7d6f7fe640 1 --2- 172.21.15.16:0/526337281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d700ffcf0 0x7f7d7019a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.384+0000 7f7d6f7fe640 1 -- 172.21.15.16:0/526337281 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d58009560 con 0x7f7d700feaf0 2024-08-01T07:05:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.384+0000 7f7d6f7fe640 1 --2- 172.21.15.16:0/526337281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d700feaf0 0x7f7d70068790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000c8f0 tx=0x7f7d6000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.384+0000 7f7d6cff9640 1 -- 172.21.15.16:0/526337281 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d600041f0 con 0x7f7d700feaf0 2024-08-01T07:05:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.384+0000 7f7d76226640 1 -- 172.21.15.16:0/526337281 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7019ae10 con 0x7f7d700feaf0 2024-08-01T07:05:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.384+0000 7f7d6cff9640 1 -- 172.21.15.16:0/526337281 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d60007e70 con 0x7f7d700feaf0 2024-08-01T07:05:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.384+0000 7f7d76226640 1 -- 172.21.15.16:0/526337281 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7019b330 con 0x7f7d700feaf0 2024-08-01T07:05:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.384+0000 7f7d6cff9640 1 -- 172.21.15.16:0/526337281 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d600049d0 con 0x7f7d700feaf0 2024-08-01T07:05:38.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.385+0000 7f7d76226640 1 -- 172.21.15.16:0/526337281 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d700feef0 con 0x7f7d700feaf0 2024-08-01T07:05:38.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.386+0000 7f7d6cff9640 1 -- 172.21.15.16:0/526337281 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7d60004350 con 0x7f7d700feaf0 2024-08-01T07:05:38.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.386+0000 7f7d6cff9640 1 --2- 172.21.15.16:0/526337281 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7d5c06e170 0x7f7d5c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:38.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.386+0000 7f7d6cff9640 1 -- 172.21.15.16:0/526337281 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f7d6008dfb0 con 0x7f7d700feaf0 2024-08-01T07:05:38.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.387+0000 7f7d6effd640 1 --2- 172.21.15.16:0/526337281 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7d5c06e170 0x7f7d5c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:38.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.387+0000 7f7d6effd640 1 --2- 172.21.15.16:0/526337281 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7d5c06e170 0x7f7d5c070630 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7d58006010 tx=0x7f7d58000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.391+0000 7f7d6cff9640 1 -- 172.21.15.16:0/526337281 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7d600571f0 con 0x7f7d700feaf0 2024-08-01T07:05:38.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.583+0000 7f7d76226640 1 -- 172.21.15.16:0/526337281 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d7002c550 con 0x7f7d5c06e170 2024-08-01T07:05:38.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.584+0000 7f7d6cff9640 1 -- 172.21.15.16:0/526337281 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7f7d7002c550 con 0x7f7d5c06e170 2024-08-01T07:05:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.586+0000 7f7d76226640 1 -- 172.21.15.16:0/526337281 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7d5c06e170 msgr2=0x7f7d5c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.586+0000 7f7d76226640 1 --2- 172.21.15.16:0/526337281 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7d5c06e170 0x7f7d5c070630 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7d58006010 tx=0x7f7d58000bc0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.586+0000 7f7d76226640 1 -- 172.21.15.16:0/526337281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d700feaf0 msgr2=0x7f7d70068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.586+0000 7f7d76226640 1 --2- 172.21.15.16:0/526337281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d700feaf0 0x7f7d70068790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000c8f0 tx=0x7f7d6000cdb0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.586+0000 7f7d76226640 1 -- 172.21.15.16:0/526337281 shutdown_connections 2024-08-01T07:05:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.586+0000 7f7d76226640 1 --2- 172.21.15.16:0/526337281 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f7d5c06e170 0x7f7d5c070630 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.586+0000 7f7d76226640 1 --2- 172.21.15.16:0/526337281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d700ffcf0 0x7f7d7019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.586+0000 7f7d76226640 1 --2- 172.21.15.16:0/526337281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d700feaf0 0x7f7d70068790 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.586+0000 7f7d76226640 1 -- 172.21.15.16:0/526337281 >> 172.21.15.16:0/526337281 conn(0x7f7d700fa280 msgr2=0x7f7d701033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.586+0000 7f7d76226640 1 -- 172.21.15.16:0/526337281 shutdown_connections 2024-08-01T07:05:38.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.587+0000 7f7d76226640 1 -- 172.21.15.16:0/526337281 wait complete. 2024-08-01T07:05:38.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.673+0000 7f51ba4ab640 1 -- 172.21.15.16:0/375677502 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51b4100630 msgr2=0x7f51b4102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:38.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.673+0000 7f51ba4ab640 1 --2- 172.21.15.16:0/375677502 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51b4100630 0x7f51b4102a20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f51a40098b0 tx=0x7f51a402a4d0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.673+0000 7f51ba4ab640 1 -- 172.21.15.16:0/375677502 shutdown_connections 2024-08-01T07:05:38.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.673+0000 7f51ba4ab640 1 --2- 172.21.15.16:0/375677502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51b4102f60 0x7f51b4105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.673+0000 7f51ba4ab640 1 --2- 172.21.15.16:0/375677502 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51b4100630 0x7f51b4102a20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.673+0000 7f51ba4ab640 1 -- 172.21.15.16:0/375677502 >> 172.21.15.16:0/375677502 conn(0x7f51b40fa250 msgr2=0x7f51b40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:38.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.673+0000 7f51ba4ab640 1 -- 172.21.15.16:0/375677502 shutdown_connections 2024-08-01T07:05:38.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.673+0000 7f51ba4ab640 1 -- 172.21.15.16:0/375677502 wait complete. 2024-08-01T07:05:38.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.674+0000 7f51ba4ab640 1 Processor -- start 2024-08-01T07:05:38.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.674+0000 7f51ba4ab640 1 -- start start 2024-08-01T07:05:38.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.674+0000 7f51ba4ab640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51b4100630 0x7f51b4195660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:38.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.674+0000 7f51ba4ab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51b4102f60 0x7f51b4195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:38.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.674+0000 7f51ba4ab640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b4196170 con 0x7f51b4100630 2024-08-01T07:05:38.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.674+0000 7f51ba4ab640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b41962e0 con 0x7f51b4102f60 2024-08-01T07:05:38.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.674+0000 7f51b3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51b4100630 0x7f51b4195660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:38.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.674+0000 7f51b3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51b4100630 0x7f51b4195660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35126/0 (socket says 172.21.15.16:35126) 2024-08-01T07:05:38.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.674+0000 7f51b3fff640 1 -- 172.21.15.16:0/921108557 learned_addr learned my addr 172.21.15.16:0/921108557 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:05:38.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.675+0000 7f51b37fe640 1 --2- 172.21.15.16:0/921108557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51b4102f60 0x7f51b4195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:38.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.675+0000 7f51b3fff640 1 -- 172.21.15.16:0/921108557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51b4102f60 msgr2=0x7f51b4195ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:38.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.675+0000 7f51b3fff640 1 --2- 172.21.15.16:0/921108557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51b4102f60 0x7f51b4195ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.675+0000 7f51b3fff640 1 -- 172.21.15.16:0/921108557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a4009560 con 0x7f51b4100630 2024-08-01T07:05:38.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.675+0000 7f51b3fff640 1 --2- 172.21.15.16:0/921108557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51b4100630 0x7f51b4195660 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f51a4005610 tx=0x7f51a4005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:38.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.675+0000 7f51b17fa640 1 -- 172.21.15.16:0/921108557 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51a4004ba0 con 0x7f51b4100630 2024-08-01T07:05:38.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.675+0000 7f51b17fa640 1 -- 172.21.15.16:0/921108557 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f51a4004d00 con 0x7f51b4100630 2024-08-01T07:05:38.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.675+0000 7f51ba4ab640 1 -- 172.21.15.16:0/921108557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b419ad20 con 0x7f51b4100630 2024-08-01T07:05:38.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.675+0000 7f51b17fa640 1 -- 172.21.15.16:0/921108557 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51a4003c40 con 0x7f51b4100630 2024-08-01T07:05:38.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.675+0000 7f51ba4ab640 1 -- 172.21.15.16:0/921108557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b419b240 con 0x7f51b4100630 2024-08-01T07:05:38.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.676+0000 7f51ba4ab640 1 -- 172.21.15.16:0/921108557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b41087e0 con 0x7f51b4100630 2024-08-01T07:05:38.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.677+0000 7f51b17fa640 1 -- 172.21.15.16:0/921108557 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f51a4031640 con 0x7f51b4100630 2024-08-01T07:05:38.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.677+0000 7f51b17fa640 1 --2- 172.21.15.16:0/921108557 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f519c06e170 0x7f519c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:38.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.677+0000 7f51b17fa640 1 -- 172.21.15.16:0/921108557 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f51a40af4a0 con 0x7f51b4100630 2024-08-01T07:05:38.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.677+0000 7f51b37fe640 1 --2- 172.21.15.16:0/921108557 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f519c06e170 0x7f519c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:38.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.678+0000 7f51b37fe640 1 --2- 172.21.15.16:0/921108557 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f519c06e170 0x7f519c070630 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f51b4196b80 tx=0x7f51a800a250 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:38.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.682+0000 7f51b17fa640 1 -- 172.21.15.16:0/921108557 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f51a4078710 con 0x7f51b4100630 2024-08-01T07:05:38.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.867+0000 7f51ba4ab640 1 -- 172.21.15.16:0/921108557 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f51b419b430 con 0x7f519c06e170 2024-08-01T07:05:38.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.877+0000 7f51b17fa640 1 -- 172.21.15.16:0/921108557 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f51b419b430 con 0x7f519c06e170 2024-08-01T07:05:38.878 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T07:05:38.878 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (26s) 21s ago 17m 16.2M - 0.25.0 c8568f914cd2 5bf0f01a8089 2024-08-01T07:05:38.878 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (82s) 21s ago 17m 8430k - 19.1.0-1223-gf9911e17 93d93c74a2cc a847ec3f462f 2024-08-01T07:05:38.878 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (73s) 53s ago 16m 8224k - 19.1.0-1223-gf9911e17 93d93c74a2cc f2f5e0a7786f 2024-08-01T07:05:38.879 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (6m) 21s ago 17m 6899k - 19.1.0-1223-gf9911e17 93d93c74a2cc 2a96028287a2 2024-08-01T07:05:38.879 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (6m) 53s ago 16m 6895k - 19.1.0-1223-gf9911e17 93d93c74a2cc 8a23341bd6c3 2024-08-01T07:05:38.879 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 starting - - - - 2024-08-01T07:05:38.879 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (2m) 21s ago 12m 89.9M - 19.1.0-1223-gf9911e17 93d93c74a2cc 2fb78654cbea 2024-08-01T07:05:38.879 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (2m) 21s ago 12m 17.7M - 19.1.0-1223-gf9911e17 93d93c74a2cc d3ca5deb5bb6 2024-08-01T07:05:38.879 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (109s) 53s ago 12m 86.0M - 19.1.0-1223-gf9911e17 93d93c74a2cc 6e9b9ebf3bc9 2024-08-01T07:05:38.879 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (95s) 53s ago 12m 16.1M - 19.1.0-1223-gf9911e17 93d93c74a2cc 98dd666884c1 2024-08-01T07:05:38.879 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:8443,9283,8765 running (8m) 21s ago 18m 509M - 19.1.0-1223-gf9911e17 93d93c74a2cc 8701e6315593 2024-08-01T07:05:38.879 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (7m) 53s ago 16m 442M - 19.1.0-1223-gf9911e17 93d93c74a2cc c6caa21f436f 2024-08-01T07:05:38.879 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (7m) 21s ago 19m 57.3M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc 48e94d076e6f 2024-08-01T07:05:38.879 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (7m) 53s ago 16m 43.6M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc c4b83b46ff15 2024-08-01T07:05:38.879 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (60s) 21s ago 17m 8162k - 1.5.0 0da6a335fe13 d2aef4eb39e6 2024-08-01T07:05:38.880 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (56s) 53s ago 16m 5653k - 1.5.0 0da6a335fe13 318349c489e1 2024-08-01T07:05:38.880 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (6m) 21s ago 15m 207M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 4c2115ae6222 2024-08-01T07:05:38.880 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (5m) 21s ago 15m 110M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc fc2f7117be30 2024-08-01T07:05:38.880 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (4m) 21s ago 15m 144M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 3364752c9365 2024-08-01T07:05:38.880 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (4m) 53s ago 14m 117M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 9a18feae4353 2024-08-01T07:05:38.880 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (3m) 53s ago 14m 168M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 7c51ba7a636a 2024-08-01T07:05:38.880 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (3m) 53s ago 13m 127M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 08ffb10ca1a6 2024-08-01T07:05:38.881 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (41s) 21s ago 17m 43.9M - 2.43.0 a07b618ecd1d a411dec2c11d 2024-08-01T07:05:38.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.879+0000 7f51ba4ab640 1 -- 172.21.15.16:0/921108557 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f519c06e170 msgr2=0x7f519c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:38.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.879+0000 7f51ba4ab640 1 --2- 172.21.15.16:0/921108557 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f519c06e170 0x7f519c070630 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f51b4196b80 tx=0x7f51a800a250 comp rx=0 tx=0).stop 2024-08-01T07:05:38.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.879+0000 7f51ba4ab640 1 -- 172.21.15.16:0/921108557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51b4100630 msgr2=0x7f51b4195660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:38.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.879+0000 7f51ba4ab640 1 --2- 172.21.15.16:0/921108557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51b4100630 0x7f51b4195660 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f51a4005610 tx=0x7f51a4005640 comp rx=0 tx=0).stop 2024-08-01T07:05:38.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.879+0000 7f51ba4ab640 1 -- 172.21.15.16:0/921108557 shutdown_connections 2024-08-01T07:05:38.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.879+0000 7f51ba4ab640 1 --2- 172.21.15.16:0/921108557 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f519c06e170 0x7f519c070630 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.879+0000 7f51ba4ab640 1 --2- 172.21.15.16:0/921108557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51b4102f60 0x7f51b4195ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.879+0000 7f51ba4ab640 1 --2- 172.21.15.16:0/921108557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51b4100630 0x7f51b4195660 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.879+0000 7f51ba4ab640 1 -- 172.21.15.16:0/921108557 >> 172.21.15.16:0/921108557 conn(0x7f51b40fa250 msgr2=0x7f51b40fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:38.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.879+0000 7f51ba4ab640 1 -- 172.21.15.16:0/921108557 shutdown_connections 2024-08-01T07:05:38.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.879+0000 7f51ba4ab640 1 -- 172.21.15.16:0/921108557 wait complete. 2024-08-01T07:05:38.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.962+0000 7f1141e4d640 1 -- 172.21.15.16:0/2596924135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f113c103010 msgr2=0x7f113c105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:38.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.962+0000 7f1141e4d640 1 --2- 172.21.15.16:0/2596924135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f113c103010 0x7f113c105400 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1124009880 tx=0x7f112402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.962+0000 7f1141e4d640 1 -- 172.21.15.16:0/2596924135 shutdown_connections 2024-08-01T07:05:38.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.962+0000 7f1141e4d640 1 --2- 172.21.15.16:0/2596924135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f113c103010 0x7f113c105400 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.962+0000 7f1141e4d640 1 --2- 172.21.15.16:0/2596924135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f113c1006e0 0x7f113c102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.962+0000 7f1141e4d640 1 -- 172.21.15.16:0/2596924135 >> 172.21.15.16:0/2596924135 conn(0x7f113c0fa280 msgr2=0x7f113c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:38.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.962+0000 7f1141e4d640 1 -- 172.21.15.16:0/2596924135 shutdown_connections 2024-08-01T07:05:38.965 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:38 smithi016 ceph-mon[93645]: pgmap v270: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:05:38.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.962+0000 7f1141e4d640 1 -- 172.21.15.16:0/2596924135 wait complete. 2024-08-01T07:05:38.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.963+0000 7f1141e4d640 1 Processor -- start 2024-08-01T07:05:38.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.963+0000 7f1141e4d640 1 -- start start 2024-08-01T07:05:38.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.963+0000 7f1141e4d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f113c1006e0 0x7f113c195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:38.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.963+0000 7f1141e4d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f113c103010 0x7f113c195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:38.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.963+0000 7f1141e4d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c196150 con 0x7f113c103010 2024-08-01T07:05:38.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.963+0000 7f1141e4d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c1962c0 con 0x7f113c1006e0 2024-08-01T07:05:38.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.963+0000 7f1133fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f113c103010 0x7f113c195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:38.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.963+0000 7f1133fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f113c103010 0x7f113c195b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50410/0 (socket says 172.21.15.16:50410) 2024-08-01T07:05:38.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.963+0000 7f1133fff640 1 -- 172.21.15.16:0/973874633 learned_addr learned my addr 172.21.15.16:0/973874633 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:05:38.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.963+0000 7f113b7fe640 1 --2- 172.21.15.16:0/973874633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f113c1006e0 0x7f113c195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:38.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.964+0000 7f1133fff640 1 -- 172.21.15.16:0/973874633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f113c1006e0 msgr2=0x7f113c195640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:38.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.964+0000 7f1133fff640 1 --2- 172.21.15.16:0/973874633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f113c1006e0 0x7f113c195640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:38.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.964+0000 7f1133fff640 1 -- 172.21.15.16:0/973874633 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1124009560 con 0x7f113c103010 2024-08-01T07:05:38.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.964+0000 7f1133fff640 1 --2- 172.21.15.16:0/973874633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f113c103010 0x7f113c195b80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f11240054f0 tx=0x7f1124005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:38.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.964+0000 7f11397fa640 1 -- 172.21.15.16:0/973874633 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1124004aa0 con 0x7f113c103010 2024-08-01T07:05:38.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.964+0000 7f11397fa640 1 -- 172.21.15.16:0/973874633 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1124004c00 con 0x7f113c103010 2024-08-01T07:05:38.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.964+0000 7f1141e4d640 1 -- 172.21.15.16:0/973874633 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113c19ad60 con 0x7f113c103010 2024-08-01T07:05:38.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.964+0000 7f11397fa640 1 -- 172.21.15.16:0/973874633 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1124003ac0 con 0x7f113c103010 2024-08-01T07:05:38.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.964+0000 7f1141e4d640 1 -- 172.21.15.16:0/973874633 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113c19b2b0 con 0x7f113c103010 2024-08-01T07:05:38.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.965+0000 7f1141e4d640 1 -- 172.21.15.16:0/973874633 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113c108790 con 0x7f113c103010 2024-08-01T07:05:38.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.966+0000 7f11397fa640 1 -- 172.21.15.16:0/973874633 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1124003d30 con 0x7f113c103010 2024-08-01T07:05:38.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.966+0000 7f11397fa640 1 --2- 172.21.15.16:0/973874633 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f112806e170 0x7f1128070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:38.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.966+0000 7f11397fa640 1 -- 172.21.15.16:0/973874633 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f11240af2b0 con 0x7f113c103010 2024-08-01T07:05:38.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.967+0000 7f113b7fe640 1 --2- 172.21.15.16:0/973874633 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f112806e170 0x7f1128070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:38.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.967+0000 7f113b7fe640 1 --2- 172.21.15.16:0/973874633 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f112806e170 0x7f1128070630 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f112c005fd0 tx=0x7f112c00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:38.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:38.971+0000 7f11397fa640 1 -- 172.21.15.16:0/973874633 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f11240785a0 con 0x7f113c103010 2024-08-01T07:05:39.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:38 smithi089 ceph-mon[82218]: pgmap v270: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:05:39.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.252+0000 7f1141e4d640 1 -- 172.21.15.16:0/973874633 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f113c108920 con 0x7f113c103010 2024-08-01T07:05:39.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.253+0000 7f11397fa640 1 -- 172.21.15.16:0/973874633 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f112407bc60 con 0x7f113c103010 2024-08-01T07:05:39.254 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:05:39.254 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T07:05:39.254 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:05:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:05:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T07:05:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:05:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:05:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T07:05:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 6 2024-08-01T07:05:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:05:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T07:05:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 4 2024-08-01T07:05:39.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:05:39.256 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T07:05:39.256 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 14 2024-08-01T07:05:39.256 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T07:05:39.256 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:05:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.255+0000 7f1141e4d640 1 -- 172.21.15.16:0/973874633 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f112806e170 msgr2=0x7f1128070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.255+0000 7f1141e4d640 1 --2- 172.21.15.16:0/973874633 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f112806e170 0x7f1128070630 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f112c005fd0 tx=0x7f112c00b390 comp rx=0 tx=0).stop 2024-08-01T07:05:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.255+0000 7f1141e4d640 1 -- 172.21.15.16:0/973874633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f113c103010 msgr2=0x7f113c195b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.255+0000 7f1141e4d640 1 --2- 172.21.15.16:0/973874633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f113c103010 0x7f113c195b80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f11240054f0 tx=0x7f1124005520 comp rx=0 tx=0).stop 2024-08-01T07:05:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.255+0000 7f1141e4d640 1 -- 172.21.15.16:0/973874633 shutdown_connections 2024-08-01T07:05:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.255+0000 7f1141e4d640 1 --2- 172.21.15.16:0/973874633 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f112806e170 0x7f1128070630 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:39.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.255+0000 7f1141e4d640 1 --2- 172.21.15.16:0/973874633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f113c103010 0x7f113c195b80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:39.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.255+0000 7f1141e4d640 1 --2- 172.21.15.16:0/973874633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f113c1006e0 0x7f113c195640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:39.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.255+0000 7f1141e4d640 1 -- 172.21.15.16:0/973874633 >> 172.21.15.16:0/973874633 conn(0x7f113c0fa280 msgr2=0x7f113c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:39.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.255+0000 7f1141e4d640 1 -- 172.21.15.16:0/973874633 shutdown_connections 2024-08-01T07:05:39.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.255+0000 7f1141e4d640 1 -- 172.21.15.16:0/973874633 wait complete. 2024-08-01T07:05:39.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.340+0000 7fa308419640 1 -- 172.21.15.16:0/1419535830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3000ffcf0 msgr2=0x7fa300100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:39.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.340+0000 7fa308419640 1 --2- 172.21.15.16:0/1419535830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3000ffcf0 0x7fa300100170 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00097e0 tx=0x7fa2f002a3f0 comp rx=0 tx=0).stop 2024-08-01T07:05:39.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.340+0000 7fa308419640 1 -- 172.21.15.16:0/1419535830 shutdown_connections 2024-08-01T07:05:39.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.340+0000 7fa308419640 1 --2- 172.21.15.16:0/1419535830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3000ffcf0 0x7fa300100170 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:39.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.340+0000 7fa308419640 1 --2- 172.21.15.16:0/1419535830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3000feaf0 0x7fa3000feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:39.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.340+0000 7fa308419640 1 -- 172.21.15.16:0/1419535830 >> 172.21.15.16:0/1419535830 conn(0x7fa3000fa280 msgr2=0x7fa3000fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:39.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.340+0000 7fa308419640 1 -- 172.21.15.16:0/1419535830 shutdown_connections 2024-08-01T07:05:39.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.340+0000 7fa308419640 1 -- 172.21.15.16:0/1419535830 wait complete. 2024-08-01T07:05:39.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.340+0000 7fa308419640 1 Processor -- start 2024-08-01T07:05:39.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.340+0000 7fa308419640 1 -- start start 2024-08-01T07:05:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.341+0000 7fa308419640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3000feaf0 0x7fa3001956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.341+0000 7fa308419640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3000ffcf0 0x7fa300195c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.341+0000 7fa308419640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3001961d0 con 0x7fa3000ffcf0 2024-08-01T07:05:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.341+0000 7fa308419640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa300196340 con 0x7fa3000feaf0 2024-08-01T07:05:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.341+0000 7fa3059b4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3000ffcf0 0x7fa300195c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.341+0000 7fa3059b4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3000ffcf0 0x7fa300195c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50430/0 (socket says 172.21.15.16:50430) 2024-08-01T07:05:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.341+0000 7fa3059b4640 1 -- 172.21.15.16:0/1992280599 learned_addr learned my addr 172.21.15.16:0/1992280599 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:05:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.341+0000 7fa3061b5640 1 --2- 172.21.15.16:0/1992280599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3000feaf0 0x7fa3001956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.341+0000 7fa3059b4640 1 -- 172.21.15.16:0/1992280599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3000feaf0 msgr2=0x7fa3001956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.341+0000 7fa3059b4640 1 --2- 172.21.15.16:0/1992280599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3000feaf0 0x7fa3001956c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:39.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.341+0000 7fa3059b4640 1 -- 172.21.15.16:0/1992280599 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2fc009560 con 0x7fa3000ffcf0 2024-08-01T07:05:39.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.342+0000 7fa3059b4640 1 --2- 172.21.15.16:0/1992280599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3000ffcf0 0x7fa300195c00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0030c00 tx=0x7fa2f0030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:39.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.342+0000 7fa2f77fe640 1 -- 172.21.15.16:0/1992280599 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2f00044f0 con 0x7fa3000ffcf0 2024-08-01T07:05:39.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.342+0000 7fa2f77fe640 1 -- 172.21.15.16:0/1992280599 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa2f0003cc0 con 0x7fa3000ffcf0 2024-08-01T07:05:39.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.342+0000 7fa308419640 1 -- 172.21.15.16:0/1992280599 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f0009490 con 0x7fa3000ffcf0 2024-08-01T07:05:39.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.342+0000 7fa2f77fe640 1 -- 172.21.15.16:0/1992280599 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2f0031e10 con 0x7fa3000ffcf0 2024-08-01T07:05:39.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.342+0000 7fa308419640 1 -- 172.21.15.16:0/1992280599 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30019b0e0 con 0x7fa3000ffcf0 2024-08-01T07:05:39.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.343+0000 7fa308419640 1 -- 172.21.15.16:0/1992280599 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3001076e0 con 0x7fa3000ffcf0 2024-08-01T07:05:39.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.344+0000 7fa2f77fe640 1 -- 172.21.15.16:0/1992280599 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa2f0003800 con 0x7fa3000ffcf0 2024-08-01T07:05:39.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.344+0000 7fa2f77fe640 1 --2- 172.21.15.16:0/1992280599 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa2ec06e170 0x7fa2ec070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:39.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.344+0000 7fa2f77fe640 1 -- 172.21.15.16:0/1992280599 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fa2f00af8d0 con 0x7fa3000ffcf0 2024-08-01T07:05:39.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.344+0000 7fa3061b5640 1 --2- 172.21.15.16:0/1992280599 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa2ec06e170 0x7fa2ec070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:39.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.345+0000 7fa3061b5640 1 --2- 172.21.15.16:0/1992280599 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa2ec06e170 0x7fa2ec070630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009530 tx=0x7fa2fc009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:39.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.349+0000 7fa2f77fe640 1 -- 172.21.15.16:0/1992280599 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa2f0078b10 con 0x7fa3000ffcf0 2024-08-01T07:05:39.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.609+0000 7fa308419640 1 -- 172.21.15.16:0/1992280599 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa30019b4f0 con 0x7fa3000ffcf0 2024-08-01T07:05:39.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.610+0000 7fa2f77fe640 1 -- 172.21.15.16:0/1992280599 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) v1 ==== 76+0+2000 (secure 0 0 0) 0x7fa2f007c1d0 con 0x7fa3000ffcf0 2024-08-01T07:05:39.612 INFO:teuthology.orchestra.run.smithi016.stdout:e38 2024-08-01T07:05:39.612 INFO:teuthology.orchestra.run.smithi016.stdout:btime 2024-08-01T07:04:11:596120+0000 2024-08-01T07:05:39.613 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T07:05:39.613 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T07:05:39.613 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T07:05:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:05:39.613 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T07:05:39.613 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T07:05:39.614 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 38 2024-08-01T07:05:39.614 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T07:05:39.614 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T07:05:39.614 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T07:04:11.596112+0000 2024-08-01T07:05:39.614 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T07:05:39.614 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T07:05:39.614 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T07:05:39.614 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T07:05:39.615 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T07:05:39.615 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T07:05:39.615 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T07:05:39.615 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T07:05:39.615 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 94 2024-08-01T07:05:39.615 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-01T07:05:39.615 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T07:05:39.615 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T07:05:39.616 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=34414,1=34446} 2024-08-01T07:05:39.616 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T07:05:39.616 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T07:05:39.616 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T07:05:39.616 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T07:05:39.616 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T07:05:39.616 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T07:05:39.617 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T07:05:39.617 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T07:05:39.617 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T07:05:39.617 INFO:teuthology.orchestra.run.smithi016.stdout:qdb_cluster leader: 34414 members: 34446,34414 2024-08-01T07:05:39.617 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:34414} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.16:6826/4064792079,v1:172.21.15.16:6827/4064792079] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:05:39.617 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{0:44357} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6824/3335707325,v1:172.21.15.89:6825/3335707325] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:05:39.617 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{1:34446} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.16:6828/2186852070,v1:172.21.15.16:6829/2186852070] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:05:39.618 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:44387} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/885893699,v1:172.21.15.89:6827/885893699] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:05:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:05:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:05:39.619 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 38 2024-08-01T07:05:39.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.612+0000 7fa308419640 1 -- 172.21.15.16:0/1992280599 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa2ec06e170 msgr2=0x7fa2ec070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:39.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.612+0000 7fa308419640 1 --2- 172.21.15.16:0/1992280599 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa2ec06e170 0x7fa2ec070630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009530 tx=0x7fa2fc009260 comp rx=0 tx=0).stop 2024-08-01T07:05:39.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.612+0000 7fa308419640 1 -- 172.21.15.16:0/1992280599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3000ffcf0 msgr2=0x7fa300195c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:39.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.612+0000 7fa308419640 1 --2- 172.21.15.16:0/1992280599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3000ffcf0 0x7fa300195c00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0030c00 tx=0x7fa2f0030c30 comp rx=0 tx=0).stop 2024-08-01T07:05:39.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.612+0000 7fa308419640 1 -- 172.21.15.16:0/1992280599 shutdown_connections 2024-08-01T07:05:39.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.612+0000 7fa308419640 1 --2- 172.21.15.16:0/1992280599 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa2ec06e170 0x7fa2ec070630 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:39.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.612+0000 7fa308419640 1 --2- 172.21.15.16:0/1992280599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3000ffcf0 0x7fa300195c00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:39.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.612+0000 7fa308419640 1 --2- 172.21.15.16:0/1992280599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3000feaf0 0x7fa3001956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:39.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.612+0000 7fa308419640 1 -- 172.21.15.16:0/1992280599 >> 172.21.15.16:0/1992280599 conn(0x7fa3000fa280 msgr2=0x7fa300067d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:39.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.612+0000 7fa308419640 1 -- 172.21.15.16:0/1992280599 shutdown_connections 2024-08-01T07:05:39.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.612+0000 7fa308419640 1 -- 172.21.15.16:0/1992280599 wait complete. 2024-08-01T07:05:39.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.696+0000 7fbe60ca3640 1 -- 172.21.15.16:0/172427030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5c0feaa0 msgr2=0x7fbe5c0feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:39.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.696+0000 7fbe60ca3640 1 --2- 172.21.15.16:0/172427030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5c0feaa0 0x7fbe5c0feea0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009880 tx=0x7fbe4c02a4a0 comp rx=0 tx=0).stop 2024-08-01T07:05:39.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.696+0000 7fbe60ca3640 1 -- 172.21.15.16:0/172427030 shutdown_connections 2024-08-01T07:05:39.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.696+0000 7fbe60ca3640 1 --2- 172.21.15.16:0/172427030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe5c0ffca0 0x7fbe5c100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:39.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.696+0000 7fbe60ca3640 1 --2- 172.21.15.16:0/172427030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5c0feaa0 0x7fbe5c0feea0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:39.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.696+0000 7fbe60ca3640 1 -- 172.21.15.16:0/172427030 >> 172.21.15.16:0/172427030 conn(0x7fbe5c0fa250 msgr2=0x7fbe5c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:39.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.696+0000 7fbe60ca3640 1 -- 172.21.15.16:0/172427030 shutdown_connections 2024-08-01T07:05:39.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.696+0000 7fbe60ca3640 1 -- 172.21.15.16:0/172427030 wait complete. 2024-08-01T07:05:39.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.697+0000 7fbe60ca3640 1 Processor -- start 2024-08-01T07:05:39.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.697+0000 7fbe60ca3640 1 -- start start 2024-08-01T07:05:39.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.698+0000 7fbe60ca3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe5c0feaa0 0x7fbe5c102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:39.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.698+0000 7fbe60ca3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5c0ffca0 0x7fbe5c101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:39.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.698+0000 7fbe60ca3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c102f70 con 0x7fbe5c0ffca0 2024-08-01T07:05:39.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.698+0000 7fbe60ca3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c1015f0 con 0x7fbe5c0feaa0 2024-08-01T07:05:39.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.698+0000 7fbe51d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5c0ffca0 0x7fbe5c101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:39.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.698+0000 7fbe51d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5c0ffca0 0x7fbe5c101080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50440/0 (socket says 172.21.15.16:50440) 2024-08-01T07:05:39.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.698+0000 7fbe51d9b640 1 -- 172.21.15.16:0/2200420683 learned_addr learned my addr 172.21.15.16:0/2200420683 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:05:39.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.698+0000 7fbe5a59c640 1 --2- 172.21.15.16:0/2200420683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe5c0feaa0 0x7fbe5c102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:39.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.698+0000 7fbe51d9b640 1 -- 172.21.15.16:0/2200420683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe5c0feaa0 msgr2=0x7fbe5c102a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:39.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.698+0000 7fbe51d9b640 1 --2- 172.21.15.16:0/2200420683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe5c0feaa0 0x7fbe5c102a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:39.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.698+0000 7fbe51d9b640 1 -- 172.21.15.16:0/2200420683 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c009560 con 0x7fbe5c0ffca0 2024-08-01T07:05:39.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.698+0000 7fbe51d9b640 1 --2- 172.21.15.16:0/2200420683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5c0ffca0 0x7fbe5c101080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400c8a0 tx=0x7fbe4400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:39.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.698+0000 7fbe53fff640 1 -- 172.21.15.16:0/2200420683 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe44007b80 con 0x7fbe5c0ffca0 2024-08-01T07:05:39.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.698+0000 7fbe60ca3640 1 -- 172.21.15.16:0/2200420683 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5c1018d0 con 0x7fbe5c0ffca0 2024-08-01T07:05:39.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.699+0000 7fbe53fff640 1 -- 172.21.15.16:0/2200420683 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe44007ce0 con 0x7fbe5c0ffca0 2024-08-01T07:05:39.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.699+0000 7fbe53fff640 1 -- 172.21.15.16:0/2200420683 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe44018810 con 0x7fbe5c0ffca0 2024-08-01T07:05:39.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.699+0000 7fbe60ca3640 1 -- 172.21.15.16:0/2200420683 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5c101ea0 con 0x7fbe5c0ffca0 2024-08-01T07:05:39.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.700+0000 7fbe60ca3640 1 -- 172.21.15.16:0/2200420683 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5c107690 con 0x7fbe5c0ffca0 2024-08-01T07:05:39.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.700+0000 7fbe53fff640 1 -- 172.21.15.16:0/2200420683 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbe44018a80 con 0x7fbe5c0ffca0 2024-08-01T07:05:39.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.701+0000 7fbe53fff640 1 --2- 172.21.15.16:0/2200420683 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fbe4806e170 0x7fbe48070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:39.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.701+0000 7fbe53fff640 1 -- 172.21.15.16:0/2200420683 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fbe4408e410 con 0x7fbe5c0ffca0 2024-08-01T07:05:39.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.701+0000 7fbe5a59c640 1 --2- 172.21.15.16:0/2200420683 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fbe4806e170 0x7fbe48070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:39.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.701+0000 7fbe5a59c640 1 --2- 172.21.15.16:0/2200420683 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fbe4806e170 0x7fbe48070630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009230 tx=0x7fbe4c0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:39.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.705+0000 7fbe53fff640 1 -- 172.21.15.16:0/2200420683 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fbe440575d0 con 0x7fbe5c0ffca0 2024-08-01T07:05:39.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:39 smithi016 ceph-mon[93645]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:05:39.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:39 smithi016 ceph-mon[93645]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:05:39.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:39 smithi016 ceph-mon[93645]: from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:05:39.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:39 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/973874633' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:39.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:39 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/1992280599' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:05:39.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.922+0000 7fbe60ca3640 1 -- 172.21.15.16:0/2200420683 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe5c068bd0 con 0x7fbe4806e170 2024-08-01T07:05:39.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.924+0000 7fbe53fff640 1 -- 172.21.15.16:0/2200420683 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7fbe5c068bd0 con 0x7fbe4806e170 2024-08-01T07:05:39.925 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:05:39.925 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483", 2024-08-01T07:05:39.925 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": true, 2024-08-01T07:05:39.925 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-01T07:05:39.925 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [ 2024-08-01T07:05:39.925 INFO:teuthology.orchestra.run.smithi016.stdout: "mds", 2024-08-01T07:05:39.925 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph-exporter", 2024-08-01T07:05:39.926 INFO:teuthology.orchestra.run.smithi016.stdout: "crash", 2024-08-01T07:05:39.926 INFO:teuthology.orchestra.run.smithi016.stdout: "mon", 2024-08-01T07:05:39.926 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr", 2024-08-01T07:05:39.926 INFO:teuthology.orchestra.run.smithi016.stdout: "osd" 2024-08-01T07:05:39.926 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-08-01T07:05:39.926 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": "18/23 daemons upgraded", 2024-08-01T07:05:39.926 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "Currently upgrading grafana daemons", 2024-08-01T07:05:39.926 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T07:05:39.926 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:05:39.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.926+0000 7fbe60ca3640 1 -- 172.21.15.16:0/2200420683 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fbe4806e170 msgr2=0x7fbe48070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:39.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.926+0000 7fbe60ca3640 1 --2- 172.21.15.16:0/2200420683 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fbe4806e170 0x7fbe48070630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009230 tx=0x7fbe4c0314e0 comp rx=0 tx=0).stop 2024-08-01T07:05:39.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.926+0000 7fbe60ca3640 1 -- 172.21.15.16:0/2200420683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5c0ffca0 msgr2=0x7fbe5c101080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:39.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.926+0000 7fbe60ca3640 1 --2- 172.21.15.16:0/2200420683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5c0ffca0 0x7fbe5c101080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400c8a0 tx=0x7fbe4400cd60 comp rx=0 tx=0).stop 2024-08-01T07:05:39.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.926+0000 7fbe60ca3640 1 -- 172.21.15.16:0/2200420683 shutdown_connections 2024-08-01T07:05:39.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.926+0000 7fbe60ca3640 1 --2- 172.21.15.16:0/2200420683 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fbe4806e170 0x7fbe48070630 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:39.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.926+0000 7fbe60ca3640 1 --2- 172.21.15.16:0/2200420683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5c0ffca0 0x7fbe5c101080 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:39.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.926+0000 7fbe60ca3640 1 --2- 172.21.15.16:0/2200420683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe5c0feaa0 0x7fbe5c102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:39.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.926+0000 7fbe60ca3640 1 -- 172.21.15.16:0/2200420683 >> 172.21.15.16:0/2200420683 conn(0x7fbe5c0fa250 msgr2=0x7fbe5c0684c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:39.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.926+0000 7fbe60ca3640 1 -- 172.21.15.16:0/2200420683 shutdown_connections 2024-08-01T07:05:39.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:39.926+0000 7fbe60ca3640 1 -- 172.21.15.16:0/2200420683 wait complete. 2024-08-01T07:05:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.012+0000 7fe93565d640 1 -- 172.21.15.16:0/569944119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe930100dc0 msgr2=0x7fe930101240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.012+0000 7fe93565d640 1 --2- 172.21.15.16:0/569944119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe930100dc0 0x7fe930101240 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe918009880 tx=0x7fe91802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:05:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.012+0000 7fe93565d640 1 -- 172.21.15.16:0/569944119 shutdown_connections 2024-08-01T07:05:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.012+0000 7fe93565d640 1 --2- 172.21.15.16:0/569944119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe930100dc0 0x7fe930101240 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.012+0000 7fe93565d640 1 --2- 172.21.15.16:0/569944119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9300ffbc0 0x7fe9300fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.012+0000 7fe93565d640 1 -- 172.21.15.16:0/569944119 >> 172.21.15.16:0/569944119 conn(0x7fe9300fb350 msgr2=0x7fe9300fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:40.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.012+0000 7fe93565d640 1 -- 172.21.15.16:0/569944119 shutdown_connections 2024-08-01T07:05:40.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.012+0000 7fe93565d640 1 -- 172.21.15.16:0/569944119 wait complete. 2024-08-01T07:05:40.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.012+0000 7fe93565d640 1 Processor -- start 2024-08-01T07:05:40.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.013+0000 7fe93565d640 1 -- start start 2024-08-01T07:05:40.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.013+0000 7fe93565d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9300ffbc0 0x7fe930074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:40.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.013+0000 7fe93565d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe930100dc0 0x7fe9300728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:40.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.013+0000 7fe93565d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe930072de0 con 0x7fe9300ffbc0 2024-08-01T07:05:40.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.013+0000 7fe93565d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe930072f50 con 0x7fe930100dc0 2024-08-01T07:05:40.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.013+0000 7fe92effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9300ffbc0 0x7fe930074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:40.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.013+0000 7fe92effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9300ffbc0 0x7fe930074200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50452/0 (socket says 172.21.15.16:50452) 2024-08-01T07:05:40.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.013+0000 7fe92effd640 1 -- 172.21.15.16:0/4063324142 learned_addr learned my addr 172.21.15.16:0/4063324142 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:05:40.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.013+0000 7fe9267fc640 1 --2- 172.21.15.16:0/4063324142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe930100dc0 0x7fe9300728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:40.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.013+0000 7fe92effd640 1 -- 172.21.15.16:0/4063324142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe930100dc0 msgr2=0x7fe9300728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:40.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.013+0000 7fe92effd640 1 --2- 172.21.15.16:0/4063324142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe930100dc0 0x7fe9300728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:40.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.013+0000 7fe92effd640 1 -- 172.21.15.16:0/4063324142 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe918009560 con 0x7fe9300ffbc0 2024-08-01T07:05:40.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.014+0000 7fe92effd640 1 --2- 172.21.15.16:0/4063324142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9300ffbc0 0x7fe930074200 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe92000e940 tx=0x7fe92000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:40.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.014+0000 7fe92cff9640 1 -- 172.21.15.16:0/4063324142 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9200096e0 con 0x7fe9300ffbc0 2024-08-01T07:05:40.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.014+0000 7fe92cff9640 1 -- 172.21.15.16:0/4063324142 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9200044f0 con 0x7fe9300ffbc0 2024-08-01T07:05:40.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.014+0000 7fe93565d640 1 -- 172.21.15.16:0/4063324142 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe930073230 con 0x7fe9300ffbc0 2024-08-01T07:05:40.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.014+0000 7fe92cff9640 1 -- 172.21.15.16:0/4063324142 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe920010430 con 0x7fe9300ffbc0 2024-08-01T07:05:40.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.014+0000 7fe93565d640 1 -- 172.21.15.16:0/4063324142 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93019d6d0 con 0x7fe9300ffbc0 2024-08-01T07:05:40.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.015+0000 7fe93565d640 1 -- 172.21.15.16:0/4063324142 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93018f760 con 0x7fe9300ffbc0 2024-08-01T07:05:40.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.015+0000 7fe92cff9640 1 -- 172.21.15.16:0/4063324142 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe920004030 con 0x7fe9300ffbc0 2024-08-01T07:05:40.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.016+0000 7fe92cff9640 1 --2- 172.21.15.16:0/4063324142 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fe91c06e170 0x7fe91c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:05:40.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.016+0000 7fe92cff9640 1 -- 172.21.15.16:0/4063324142 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fe920014070 con 0x7fe9300ffbc0 2024-08-01T07:05:40.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.016+0000 7fe9267fc640 1 --2- 172.21.15.16:0/4063324142 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fe91c06e170 0x7fe91c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:05:40.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.017+0000 7fe9267fc640 1 --2- 172.21.15.16:0/4063324142 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fe91c06e170 0x7fe91c070630 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe918031540 tx=0x7fe918000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:05:40.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.020+0000 7fe92cff9640 1 -- 172.21.15.16:0/4063324142 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe920057990 con 0x7fe9300ffbc0 2024-08-01T07:05:40.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:39 smithi089 ceph-mon[82218]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:05:40.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:39 smithi089 ceph-mon[82218]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:05:40.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:39 smithi089 ceph-mon[82218]: from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:05:40.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:39 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/973874633' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:40.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:39 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/1992280599' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:05:40.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.271+0000 7fe93565d640 1 -- 172.21.15.16:0/4063324142 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe9301087d0 con 0x7fe9300ffbc0 2024-08-01T07:05:40.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.271+0000 7fe92cff9640 1 -- 172.21.15.16:0/4063324142 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe92005b050 con 0x7fe9300ffbc0 2024-08-01T07:05:40.273 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-08-01T07:05:40.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.273+0000 7fe93565d640 1 -- 172.21.15.16:0/4063324142 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fe91c06e170 msgr2=0x7fe91c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:40.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.273+0000 7fe93565d640 1 --2- 172.21.15.16:0/4063324142 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fe91c06e170 0x7fe91c070630 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe918031540 tx=0x7fe918000bc0 comp rx=0 tx=0).stop 2024-08-01T07:05:40.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.273+0000 7fe93565d640 1 -- 172.21.15.16:0/4063324142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9300ffbc0 msgr2=0x7fe930074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:05:40.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.273+0000 7fe93565d640 1 --2- 172.21.15.16:0/4063324142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9300ffbc0 0x7fe930074200 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe92000e940 tx=0x7fe92000ee00 comp rx=0 tx=0).stop 2024-08-01T07:05:40.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.273+0000 7fe93565d640 1 -- 172.21.15.16:0/4063324142 shutdown_connections 2024-08-01T07:05:40.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.273+0000 7fe93565d640 1 --2- 172.21.15.16:0/4063324142 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fe91c06e170 0x7fe91c070630 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:40.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.273+0000 7fe93565d640 1 --2- 172.21.15.16:0/4063324142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe930100dc0 0x7fe9300728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:40.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.273+0000 7fe93565d640 1 --2- 172.21.15.16:0/4063324142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9300ffbc0 0x7fe930074200 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:05:40.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.273+0000 7fe93565d640 1 -- 172.21.15.16:0/4063324142 >> 172.21.15.16:0/4063324142 conn(0x7fe9300fb350 msgr2=0x7fe930104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:05:40.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.273+0000 7fe93565d640 1 -- 172.21.15.16:0/4063324142 shutdown_connections 2024-08-01T07:05:40.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:05:40.273+0000 7fe93565d640 1 -- 172.21.15.16:0/4063324142 wait complete. 2024-08-01T07:05:41.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:40 smithi089 ceph-mon[82218]: pgmap v271: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:05:41.038 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:40 smithi089 ceph-mon[82218]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:05:41.038 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:40 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/4063324142' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:05:41.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:40 smithi016 ceph-mon[93645]: pgmap v271: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:05:41.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:40 smithi016 ceph-mon[93645]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:05:41.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:40 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/4063324142' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:05:42.038 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:42.038 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:42.038 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:42.038 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:41 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:42.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:42.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:42.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:42.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:41 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:42.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:42 smithi016 ceph-mon[93645]: pgmap v272: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:05:43.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:42 smithi089 ceph-mon[82218]: pgmap v272: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:05:45.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:44 smithi089 ceph-mon[82218]: pgmap v273: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:05:45.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:44 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:45.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:44 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:45.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:44 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:05:45.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:44 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:05:45.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:44 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:45.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:44 smithi016 ceph-mon[93645]: pgmap v273: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:05:45.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:44 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:45.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:44 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:45.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:44 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:05:45.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:44 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:05:45.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:44 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:46.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-01T07:05:46.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-01T07:05:46.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:05:46.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.140 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: Upgrade: Finalizing container_image settings 2024-08-01T07:05:46.140 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:46.140 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-08-01T07:05:46.140 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-08-01T07:05:46.140 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-01T07:05:46.140 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-08-01T07:05:46.140 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-08-01T07:05:46.140 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-08-01T07:05:46.140 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-08-01T07:05:46.140 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-08-01T07:05:46.140 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-08-01T07:05:46.140 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-08-01T07:05:46.141 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-08-01T07:05:46.141 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-08-01T07:05:46.141 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-08-01T07:05:46.141 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-08-01T07:05:46.141 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-01T07:05:46.141 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-08-01T07:05:46.141 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-08-01T07:05:46.141 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-08-01T07:05:46.141 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-08-01T07:05:46.141 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-08-01T07:05:46.141 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-08-01T07:05:46.141 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-08-01T07:05:46.141 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-08-01T07:05:46.141 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-01T07:05:46.142 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-01T07:05:46.142 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-01T07:05:46.142 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-01T07:05:46.142 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-01T07:05:46.142 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-01T07:05:46.142 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: Upgrade: Complete! 2024-08-01T07:05:46.142 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-08-01T07:05:46.142 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-08-01T07:05:46.142 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:05:46.142 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:05:46.142 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:05:46.142 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:46.142 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:05:46.143 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:05:46.143 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:05:46.143 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:46.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-01T07:05:46.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-01T07:05:46.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:05:46.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:05:46.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: Upgrade: Finalizing container_image settings 2024-08-01T07:05:46.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:46.151 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-08-01T07:05:46.151 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-08-01T07:05:46.151 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-01T07:05:46.151 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-08-01T07:05:46.151 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-08-01T07:05:46.151 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-08-01T07:05:46.151 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-08-01T07:05:46.151 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-08-01T07:05:46.151 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-08-01T07:05:46.151 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-08-01T07:05:46.151 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-08-01T07:05:46.151 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-08-01T07:05:46.151 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-08-01T07:05:46.151 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-08-01T07:05:46.152 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-01T07:05:46.152 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-08-01T07:05:46.152 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-08-01T07:05:46.152 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-08-01T07:05:46.152 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-08-01T07:05:46.152 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-08-01T07:05:46.152 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-08-01T07:05:46.152 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-08-01T07:05:46.152 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-08-01T07:05:46.152 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-01T07:05:46.152 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-01T07:05:46.152 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-01T07:05:46.152 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-01T07:05:46.153 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-01T07:05:46.153 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-01T07:05:46.153 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: Upgrade: Complete! 2024-08-01T07:05:46.153 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-08-01T07:05:46.153 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-08-01T07:05:46.153 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:05:46.153 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:05:46.153 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:05:46.153 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:46.153 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:05:46.153 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:05:46.153 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:05:46.153 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:47.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:46 smithi089 ceph-mon[82218]: pgmap v274: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:05:47.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:46 smithi016 ceph-mon[93645]: pgmap v274: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:05:48.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:05:48.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:48.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:05:48.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:05:49.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:48 smithi089 ceph-mon[82218]: pgmap v275: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:05:49.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:48 smithi016 ceph-mon[93645]: pgmap v275: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:05:51.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:50 smithi089 ceph-mon[82218]: pgmap v276: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:05:51.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:50 smithi016 ceph-mon[93645]: pgmap v276: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:05:53.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:52 smithi089 ceph-mon[82218]: pgmap v277: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:05:53.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:52 smithi016 ceph-mon[93645]: pgmap v277: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:05:55.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:54 smithi089 ceph-mon[82218]: pgmap v278: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:05:55.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:54 smithi016 ceph-mon[93645]: pgmap v278: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:05:57.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:56 smithi089 ceph-mon[82218]: pgmap v279: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:05:57.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:56 smithi016 ceph-mon[93645]: pgmap v279: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:05:58.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:05:58 smithi016 ceph-mon[93645]: pgmap v280: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:05:59.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:05:58 smithi089 ceph-mon[82218]: pgmap v280: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:06:01.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:00 smithi089 ceph-mon[82218]: pgmap v281: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:06:01.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:00 smithi016 ceph-mon[93645]: pgmap v281: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:06:03.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:02 smithi089 ceph-mon[82218]: pgmap v282: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:06:03.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:06:03.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:02 smithi016 ceph-mon[93645]: pgmap v282: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:06:03.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:06:05.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:04 smithi089 ceph-mon[82218]: pgmap v283: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:06:05.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:04 smithi016 ceph-mon[93645]: pgmap v283: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:06:07.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:06 smithi089 ceph-mon[82218]: pgmap v284: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:06:07.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:06 smithi016 ceph-mon[93645]: pgmap v284: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:06:09.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:08 smithi089 ceph-mon[82218]: pgmap v285: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:06:09.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:08 smithi016 ceph-mon[93645]: pgmap v285: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.371+0000 7f76211fe640 1 -- 172.21.15.16:0/3749081688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f761c0ffb90 msgr2=0x7f761c0fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.371+0000 7f76211fe640 1 --2- 172.21.15.16:0/3749081688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f761c0ffb90 0x7f761c0fff90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f760c009880 tx=0x7f760c02a4a0 comp rx=0 tx=0).stop 2024-08-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.371+0000 7f76211fe640 1 -- 172.21.15.16:0/3749081688 shutdown_connections 2024-08-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.371+0000 7f76211fe640 1 --2- 172.21.15.16:0/3749081688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f761c100d90 0x7f761c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.371+0000 7f76211fe640 1 --2- 172.21.15.16:0/3749081688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f761c0ffb90 0x7f761c0fff90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.371+0000 7f76211fe640 1 -- 172.21.15.16:0/3749081688 >> 172.21.15.16:0/3749081688 conn(0x7f761c0fb320 msgr2=0x7f761c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.371+0000 7f76211fe640 1 -- 172.21.15.16:0/3749081688 shutdown_connections 2024-08-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.371+0000 7f76211fe640 1 -- 172.21.15.16:0/3749081688 wait complete. 2024-08-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.372+0000 7f76211fe640 1 Processor -- start 2024-08-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.372+0000 7f76211fe640 1 -- start start 2024-08-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.372+0000 7f76211fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f761c0ffb90 0x7f761c074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.372+0000 7f76211fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f761c100d90 0x7f761c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.373+0000 7f76211fe640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761c072de0 con 0x7f761c0ffb90 2024-08-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.373+0000 7f76211fe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761c072f50 con 0x7f761c100d90 2024-08-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.373+0000 7f761ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f761c0ffb90 0x7f761c074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.373+0000 7f761ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f761c0ffb90 0x7f761c074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41888/0 (socket says 172.21.15.16:41888) 2024-08-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.373+0000 7f761ad9d640 1 -- 172.21.15.16:0/3141036736 learned_addr learned my addr 172.21.15.16:0/3141036736 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.373+0000 7f761a59c640 1 --2- 172.21.15.16:0/3141036736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f761c100d90 0x7f761c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.373+0000 7f761ad9d640 1 -- 172.21.15.16:0/3141036736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f761c100d90 msgr2=0x7f761c0728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.373+0000 7f761ad9d640 1 --2- 172.21.15.16:0/3141036736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f761c100d90 0x7f761c0728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.373+0000 7f761ad9d640 1 -- 172.21.15.16:0/3141036736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c009560 con 0x7f761c0ffb90 2024-08-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.373+0000 7f761ad9d640 1 --2- 172.21.15.16:0/3141036736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f761c0ffb90 0x7f761c074250 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f760c02a9c0 tx=0x7f760c0054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.373+0000 7f7603fff640 1 -- 172.21.15.16:0/3141036736 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f760c004aa0 con 0x7f761c0ffb90 2024-08-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.374+0000 7f76211fe640 1 -- 172.21.15.16:0/3141036736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f761c0731d0 con 0x7f761c0ffb90 2024-08-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.374+0000 7f7603fff640 1 -- 172.21.15.16:0/3141036736 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f760c004c00 con 0x7f761c0ffb90 2024-08-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.374+0000 7f7603fff640 1 -- 172.21.15.16:0/3141036736 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f760c003a80 con 0x7f761c0ffb90 2024-08-01T07:06:10.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.374+0000 7f76211fe640 1 -- 172.21.15.16:0/3141036736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f761c19d690 con 0x7f761c0ffb90 2024-08-01T07:06:10.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.375+0000 7f76211fe640 1 -- 172.21.15.16:0/3141036736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761c0fff90 con 0x7f761c0ffb90 2024-08-01T07:06:10.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.375+0000 7f7603fff640 1 -- 172.21.15.16:0/3141036736 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f760c003d40 con 0x7f761c0ffb90 2024-08-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.376+0000 7f7603fff640 1 --2- 172.21.15.16:0/3141036736 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f760406e180 0x7f7604070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.376+0000 7f7603fff640 1 -- 172.21.15.16:0/3141036736 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f760c0af420 con 0x7f761c0ffb90 2024-08-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.376+0000 7f761a59c640 1 --2- 172.21.15.16:0/3141036736 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f760406e180 0x7f7604070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.376+0000 7f761a59c640 1 --2- 172.21.15.16:0/3141036736 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f760406e180 0x7f7604070640 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f761c073fd0 tx=0x7f761000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:06:10.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.381+0000 7f7603fff640 1 -- 172.21.15.16:0/3141036736 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f760c078690 con 0x7f761c0ffb90 2024-08-01T07:06:10.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.573+0000 7f76211fe640 1 -- 172.21.15.16:0/3141036736 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f761c0608f0 con 0x7f760406e180 2024-08-01T07:06:10.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.574+0000 7f7603fff640 1 -- 172.21.15.16:0/3141036736 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f761c0608f0 con 0x7f760406e180 2024-08-01T07:06:10.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.576+0000 7f76211fe640 1 -- 172.21.15.16:0/3141036736 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f760406e180 msgr2=0x7f7604070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:10.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.576+0000 7f76211fe640 1 --2- 172.21.15.16:0/3141036736 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f760406e180 0x7f7604070640 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f761c073fd0 tx=0x7f761000b390 comp rx=0 tx=0).stop 2024-08-01T07:06:10.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.576+0000 7f76211fe640 1 -- 172.21.15.16:0/3141036736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f761c0ffb90 msgr2=0x7f761c074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:10.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.576+0000 7f76211fe640 1 --2- 172.21.15.16:0/3141036736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f761c0ffb90 0x7f761c074250 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f760c02a9c0 tx=0x7f760c0054f0 comp rx=0 tx=0).stop 2024-08-01T07:06:10.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.576+0000 7f76211fe640 1 -- 172.21.15.16:0/3141036736 shutdown_connections 2024-08-01T07:06:10.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.576+0000 7f76211fe640 1 --2- 172.21.15.16:0/3141036736 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f760406e180 0x7f7604070640 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:10.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.576+0000 7f76211fe640 1 --2- 172.21.15.16:0/3141036736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f761c100d90 0x7f761c0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:10.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.576+0000 7f76211fe640 1 --2- 172.21.15.16:0/3141036736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f761c0ffb90 0x7f761c074250 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:10.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.576+0000 7f76211fe640 1 -- 172.21.15.16:0/3141036736 >> 172.21.15.16:0/3141036736 conn(0x7f761c0fb320 msgr2=0x7f761c104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:06:10.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.576+0000 7f76211fe640 1 -- 172.21.15.16:0/3141036736 shutdown_connections 2024-08-01T07:06:10.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:10.576+0000 7f76211fe640 1 -- 172.21.15.16:0/3141036736 wait complete. 2024-08-01T07:06:11.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:10 smithi089 ceph-mon[82218]: pgmap v286: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:06:11.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:10 smithi016 ceph-mon[93645]: pgmap v286: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:06:11.224 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -e sha1=f9911e17b12222fbe598fff73cd3ad10d20c5776 -- bash -c 'ceph orch ps' 2024-08-01T07:06:11.483 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:06:11.883 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:11 smithi016 ceph-mon[93645]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:06:12.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:11 smithi089 ceph-mon[82218]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:06:13.050 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:12 smithi016 ceph-mon[93645]: pgmap v287: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:06:13.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:12 smithi089 ceph-mon[82218]: pgmap v287: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:06:13.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.269+0000 7f3518427640 1 -- 172.21.15.16:0/3977115597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3510101f80 msgr2=0x7f3510102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:13.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.269+0000 7f3518427640 1 --2- 172.21.15.16:0/3977115597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3510101f80 0x7f3510102360 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f350c009880 tx=0x7f350c02a4a0 comp rx=0 tx=0).stop 2024-08-01T07:06:13.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.269+0000 7f3518427640 1 -- 172.21.15.16:0/3977115597 shutdown_connections 2024-08-01T07:06:13.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.269+0000 7f3518427640 1 --2- 172.21.15.16:0/3977115597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3510102930 0x7f3510106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:13.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.269+0000 7f3518427640 1 --2- 172.21.15.16:0/3977115597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3510101f80 0x7f3510102360 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:13.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.269+0000 7f3518427640 1 -- 172.21.15.16:0/3977115597 >> 172.21.15.16:0/3977115597 conn(0x7f35100fda20 msgr2=0x7f35100ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:06:13.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.269+0000 7f3518427640 1 -- 172.21.15.16:0/3977115597 shutdown_connections 2024-08-01T07:06:13.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.269+0000 7f3518427640 1 -- 172.21.15.16:0/3977115597 wait complete. 2024-08-01T07:06:13.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.270+0000 7f3518427640 1 Processor -- start 2024-08-01T07:06:13.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.270+0000 7f3518427640 1 -- start start 2024-08-01T07:06:13.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.270+0000 7f3518427640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3510101f80 0x7f351019da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:06:13.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.270+0000 7f3518427640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3510102930 0x7f351019df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:06:13.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.270+0000 7f3518427640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351019e5b0 con 0x7f3510102930 2024-08-01T07:06:13.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.270+0000 7f3518427640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3510197b40 con 0x7f3510101f80 2024-08-01T07:06:13.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.270+0000 7f35159c2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3510102930 0x7f351019df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:06:13.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.270+0000 7f35159c2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3510102930 0x7f351019df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41908/0 (socket says 172.21.15.16:41908) 2024-08-01T07:06:13.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.270+0000 7f35159c2640 1 -- 172.21.15.16:0/3889653297 learned_addr learned my addr 172.21.15.16:0/3889653297 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:06:13.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.270+0000 7f35161c3640 1 --2- 172.21.15.16:0/3889653297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3510101f80 0x7f351019da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:06:13.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.270+0000 7f35159c2640 1 -- 172.21.15.16:0/3889653297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3510101f80 msgr2=0x7f351019da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:13.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.270+0000 7f35159c2640 1 --2- 172.21.15.16:0/3889653297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3510101f80 0x7f351019da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:13.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.270+0000 7f35159c2640 1 -- 172.21.15.16:0/3889653297 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c009560 con 0x7f3510102930 2024-08-01T07:06:13.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.271+0000 7f35159c2640 1 --2- 172.21.15.16:0/3889653297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3510102930 0x7f351019df90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f350400e970 tx=0x7f350400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:06:13.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.271+0000 7f35037fe640 1 -- 172.21.15.16:0/3889653297 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f350400cc90 con 0x7f3510102930 2024-08-01T07:06:13.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.271+0000 7f35037fe640 1 -- 172.21.15.16:0/3889653297 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f350400cdf0 con 0x7f3510102930 2024-08-01T07:06:13.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.271+0000 7f3518427640 1 -- 172.21.15.16:0/3889653297 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3510197e20 con 0x7f3510102930 2024-08-01T07:06:13.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.271+0000 7f35037fe640 1 -- 172.21.15.16:0/3889653297 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3504010430 con 0x7f3510102930 2024-08-01T07:06:13.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.271+0000 7f3518427640 1 -- 172.21.15.16:0/3889653297 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3510198370 con 0x7f3510102930 2024-08-01T07:06:13.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.272+0000 7f3518427640 1 -- 172.21.15.16:0/3889653297 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3510103460 con 0x7f3510102930 2024-08-01T07:06:13.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.273+0000 7f35037fe640 1 -- 172.21.15.16:0/3889653297 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f35040046c0 con 0x7f3510102930 2024-08-01T07:06:13.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.274+0000 7f35037fe640 1 --2- 172.21.15.16:0/3889653297 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f34fc06e170 0x7f34fc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:06:13.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.274+0000 7f35037fe640 1 -- 172.21.15.16:0/3889653297 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f3504014070 con 0x7f3510102930 2024-08-01T07:06:13.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.274+0000 7f35161c3640 1 --2- 172.21.15.16:0/3889653297 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f34fc06e170 0x7f34fc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:06:13.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.274+0000 7f35161c3640 1 --2- 172.21.15.16:0/3889653297 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f34fc06e170 0x7f34fc070630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f350c009230 tx=0x7f350c0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:06:13.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.282+0000 7f35037fe640 1 -- 172.21.15.16:0/3889653297 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f35040579d0 con 0x7f3510102930 2024-08-01T07:06:13.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.471+0000 7f3518427640 1 -- 172.21.15.16:0/3889653297 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f351010a2e0 con 0x7f34fc06e170 2024-08-01T07:06:13.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.481+0000 7f35037fe640 1 -- 172.21.15.16:0/3889653297 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f351010a2e0 con 0x7f34fc06e170 2024-08-01T07:06:13.482 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (60s) 32s ago 18m 16.2M - 0.25.0 c8568f914cd2 5bf0f01a8089 2024-08-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (117s) 32s ago 18m 8460k - 19.1.0-1223-gf9911e17 93d93c74a2cc a847ec3f462f 2024-08-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (107s) 88s ago 17m 8224k - 19.1.0-1223-gf9911e17 93d93c74a2cc f2f5e0a7786f 2024-08-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (7m) 32s ago 18m 6899k - 19.1.0-1223-gf9911e17 93d93c74a2cc 2a96028287a2 2024-08-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (7m) 88s ago 17m 6895k - 19.1.0-1223-gf9911e17 93d93c74a2cc 8a23341bd6c3 2024-08-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (38s) 32s ago 17m 52.9M - 9.4.12 2bacad6d85d8 88e7e24a4a10 2024-08-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (3m) 32s ago 12m 89.6M - 19.1.0-1223-gf9911e17 93d93c74a2cc 2fb78654cbea 2024-08-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (2m) 32s ago 12m 18.4M - 19.1.0-1223-gf9911e17 93d93c74a2cc d3ca5deb5bb6 2024-08-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (2m) 88s ago 12m 86.0M - 19.1.0-1223-gf9911e17 93d93c74a2cc 6e9b9ebf3bc9 2024-08-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (2m) 88s ago 12m 16.1M - 19.1.0-1223-gf9911e17 93d93c74a2cc 98dd666884c1 2024-08-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:8443,9283,8765 running (9m) 32s ago 19m 517M - 19.1.0-1223-gf9911e17 93d93c74a2cc 8701e6315593 2024-08-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (8m) 88s ago 17m 442M - 19.1.0-1223-gf9911e17 93d93c74a2cc c6caa21f436f 2024-08-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (8m) 32s ago 19m 58.1M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc 48e94d076e6f 2024-08-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (7m) 88s ago 17m 43.6M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc c4b83b46ff15 2024-08-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (94s) 32s ago 18m 8497k - 1.5.0 0da6a335fe13 d2aef4eb39e6 2024-08-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (91s) 88s ago 17m 5653k - 1.5.0 0da6a335fe13 318349c489e1 2024-08-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (6m) 32s ago 16m 207M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 4c2115ae6222 2024-08-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (6m) 32s ago 16m 110M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc fc2f7117be30 2024-08-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (5m) 32s ago 15m 144M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 3364752c9365 2024-08-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (4m) 88s ago 15m 117M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 9a18feae4353 2024-08-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (4m) 88s ago 14m 168M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 7c51ba7a636a 2024-08-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (3m) 88s ago 14m 127M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 08ffb10ca1a6 2024-08-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (75s) 32s ago 17m 48.8M - 2.43.0 a07b618ecd1d a411dec2c11d 2024-08-01T07:06:13.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.484+0000 7f3518427640 1 -- 172.21.15.16:0/3889653297 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f34fc06e170 msgr2=0x7f34fc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:13.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.484+0000 7f3518427640 1 --2- 172.21.15.16:0/3889653297 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f34fc06e170 0x7f34fc070630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f350c009230 tx=0x7f350c0058d0 comp rx=0 tx=0).stop 2024-08-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.484+0000 7f3518427640 1 -- 172.21.15.16:0/3889653297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3510102930 msgr2=0x7f351019df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.484+0000 7f3518427640 1 --2- 172.21.15.16:0/3889653297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3510102930 0x7f351019df90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f350400e970 tx=0x7f350400ed70 comp rx=0 tx=0).stop 2024-08-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.484+0000 7f3518427640 1 -- 172.21.15.16:0/3889653297 shutdown_connections 2024-08-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.484+0000 7f3518427640 1 --2- 172.21.15.16:0/3889653297 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f34fc06e170 0x7f34fc070630 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.484+0000 7f3518427640 1 --2- 172.21.15.16:0/3889653297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3510102930 0x7f351019df90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.484+0000 7f3518427640 1 --2- 172.21.15.16:0/3889653297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3510101f80 0x7f351019da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.484+0000 7f3518427640 1 -- 172.21.15.16:0/3889653297 >> 172.21.15.16:0/3889653297 conn(0x7f35100fda20 msgr2=0x7f35100fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.484+0000 7f3518427640 1 -- 172.21.15.16:0/3889653297 shutdown_connections 2024-08-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:13.484+0000 7f3518427640 1 -- 172.21.15.16:0/3889653297 wait complete. 2024-08-01T07:06:14.190 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -e sha1=f9911e17b12222fbe598fff73cd3ad10d20c5776 -- bash -c 'ceph orch upgrade status' 2024-08-01T07:06:14.413 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:06:15.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:14 smithi089 ceph-mon[82218]: pgmap v288: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:06:15.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:14 smithi089 ceph-mon[82218]: from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:06:15.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:14 smithi016 ceph-mon[93645]: pgmap v288: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:06:15.149 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:14 smithi016 ceph-mon[93645]: from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:06:16.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.025+0000 7f847cd40640 1 -- 172.21.15.16:0/3715658726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8478104a30 msgr2=0x7f8478104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:16.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.025+0000 7f847cd40640 1 --2- 172.21.15.16:0/3715658726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8478104a30 0x7f8478104e10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8468009880 tx=0x7f846802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:06:16.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.025+0000 7f847cd40640 1 -- 172.21.15.16:0/3715658726 shutdown_connections 2024-08-01T07:06:16.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.025+0000 7f847cd40640 1 --2- 172.21.15.16:0/3715658726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84780fea30 0x7f84780fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:16.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.025+0000 7f847cd40640 1 --2- 172.21.15.16:0/3715658726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8478104a30 0x7f8478104e10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:16.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.025+0000 7f847cd40640 1 -- 172.21.15.16:0/3715658726 >> 172.21.15.16:0/3715658726 conn(0x7f84780fa730 msgr2=0x7f84780fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:06:16.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.025+0000 7f847cd40640 1 -- 172.21.15.16:0/3715658726 shutdown_connections 2024-08-01T07:06:16.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.025+0000 7f847cd40640 1 -- 172.21.15.16:0/3715658726 wait complete. 2024-08-01T07:06:16.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.026+0000 7f847cd40640 1 Processor -- start 2024-08-01T07:06:16.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.026+0000 7f847cd40640 1 -- start start 2024-08-01T07:06:16.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.027+0000 7f847cd40640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84780fea30 0x7f8478196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:06:16.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.027+0000 7f847cd40640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8478104a30 0x7f8478196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:06:16.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.027+0000 7f847cd40640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8478197490 con 0x7f84780fea30 2024-08-01T07:06:16.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.027+0000 7f847cd40640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8478197600 con 0x7f8478104a30 2024-08-01T07:06:16.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.027+0000 7f847659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84780fea30 0x7f8478196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:06:16.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.027+0000 7f847659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84780fea30 0x7f8478196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41934/0 (socket says 172.21.15.16:41934) 2024-08-01T07:06:16.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.027+0000 7f847659c640 1 -- 172.21.15.16:0/1200874408 learned_addr learned my addr 172.21.15.16:0/1200874408 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:06:16.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.027+0000 7f8475d9b640 1 --2- 172.21.15.16:0/1200874408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8478104a30 0x7f8478196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:06:16.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.027+0000 7f847659c640 1 -- 172.21.15.16:0/1200874408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8478104a30 msgr2=0x7f8478196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:16.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.027+0000 7f847659c640 1 --2- 172.21.15.16:0/1200874408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8478104a30 0x7f8478196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:16.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.027+0000 7f847659c640 1 -- 172.21.15.16:0/1200874408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8468009560 con 0x7f84780fea30 2024-08-01T07:06:16.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.027+0000 7f847659c640 1 --2- 172.21.15.16:0/1200874408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84780fea30 0x7f8478196980 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f846802a9c0 tx=0x7f84680055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:06:16.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.028+0000 7f846f7fe640 1 -- 172.21.15.16:0/1200874408 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8468004aa0 con 0x7f84780fea30 2024-08-01T07:06:16.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.028+0000 7f846f7fe640 1 -- 172.21.15.16:0/1200874408 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8468004c00 con 0x7f84780fea30 2024-08-01T07:06:16.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.028+0000 7f846f7fe640 1 -- 172.21.15.16:0/1200874408 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8468003ab0 con 0x7f84780fea30 2024-08-01T07:06:16.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.028+0000 7f847cd40640 1 -- 172.21.15.16:0/1200874408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847819f9f0 con 0x7f84780fea30 2024-08-01T07:06:16.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.028+0000 7f847cd40640 1 -- 172.21.15.16:0/1200874408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847819fd50 con 0x7f84780fea30 2024-08-01T07:06:16.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.029+0000 7f847cd40640 1 -- 172.21.15.16:0/1200874408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8478100170 con 0x7f84780fea30 2024-08-01T07:06:16.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.029+0000 7f846f7fe640 1 -- 172.21.15.16:0/1200874408 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8468003c10 con 0x7f84780fea30 2024-08-01T07:06:16.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.030+0000 7f846f7fe640 1 --2- 172.21.15.16:0/1200874408 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f846406e170 0x7f8464070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:06:16.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.030+0000 7f846f7fe640 1 -- 172.21.15.16:0/1200874408 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f84680af370 con 0x7f84780fea30 2024-08-01T07:06:16.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.030+0000 7f8475d9b640 1 --2- 172.21.15.16:0/1200874408 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f846406e170 0x7f8464070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:06:16.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.031+0000 7f8475d9b640 1 --2- 172.21.15.16:0/1200874408 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f846406e170 0x7f8464070630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8478068c90 tx=0x7f846000a390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:06:16.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.034+0000 7f846f7fe640 1 -- 172.21.15.16:0/1200874408 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8468078510 con 0x7f84780fea30 2024-08-01T07:06:16.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.227+0000 7f847cd40640 1 -- 172.21.15.16:0/1200874408 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8478068a40 con 0x7f846406e170 2024-08-01T07:06:16.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.228+0000 7f846f7fe640 1 -- 172.21.15.16:0/1200874408 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f8478068a40 con 0x7f846406e170 2024-08-01T07:06:16.230 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:06:16.230 INFO:teuthology.orchestra.run.smithi016.stdout: "target_image": null, 2024-08-01T07:06:16.230 INFO:teuthology.orchestra.run.smithi016.stdout: "in_progress": false, 2024-08-01T07:06:16.230 INFO:teuthology.orchestra.run.smithi016.stdout: "which": "", 2024-08-01T07:06:16.230 INFO:teuthology.orchestra.run.smithi016.stdout: "services_complete": [], 2024-08-01T07:06:16.230 INFO:teuthology.orchestra.run.smithi016.stdout: "progress": null, 2024-08-01T07:06:16.230 INFO:teuthology.orchestra.run.smithi016.stdout: "message": "", 2024-08-01T07:06:16.231 INFO:teuthology.orchestra.run.smithi016.stdout: "is_paused": false 2024-08-01T07:06:16.231 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:06:16.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.230+0000 7f847cd40640 1 -- 172.21.15.16:0/1200874408 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f846406e170 msgr2=0x7f8464070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:16.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.230+0000 7f847cd40640 1 --2- 172.21.15.16:0/1200874408 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f846406e170 0x7f8464070630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8478068c90 tx=0x7f846000a390 comp rx=0 tx=0).stop 2024-08-01T07:06:16.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.230+0000 7f847cd40640 1 -- 172.21.15.16:0/1200874408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84780fea30 msgr2=0x7f8478196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:16.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.230+0000 7f847cd40640 1 --2- 172.21.15.16:0/1200874408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84780fea30 0x7f8478196980 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f846802a9c0 tx=0x7f84680055a0 comp rx=0 tx=0).stop 2024-08-01T07:06:16.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.230+0000 7f847cd40640 1 -- 172.21.15.16:0/1200874408 shutdown_connections 2024-08-01T07:06:16.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.230+0000 7f847cd40640 1 --2- 172.21.15.16:0/1200874408 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f846406e170 0x7f8464070630 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:16.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.230+0000 7f847cd40640 1 --2- 172.21.15.16:0/1200874408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8478104a30 0x7f8478196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:16.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.230+0000 7f847cd40640 1 --2- 172.21.15.16:0/1200874408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84780fea30 0x7f8478196980 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:16.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.230+0000 7f847cd40640 1 -- 172.21.15.16:0/1200874408 >> 172.21.15.16:0/1200874408 conn(0x7f84780fa730 msgr2=0x7f84780fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:06:16.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.231+0000 7f847cd40640 1 -- 172.21.15.16:0/1200874408 shutdown_connections 2024-08-01T07:06:16.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:16.231+0000 7f847cd40640 1 -- 172.21.15.16:0/1200874408 wait complete. 2024-08-01T07:06:16.832 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -e sha1=f9911e17b12222fbe598fff73cd3ad10d20c5776 -- bash -c 'ceph health detail' 2024-08-01T07:06:17.048 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:06:17.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:16 smithi089 ceph-mon[82218]: pgmap v289: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:06:17.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:16 smithi016 ceph-mon[93645]: pgmap v289: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:06:18.133 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:17 smithi016 ceph-mon[93645]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:06:18.133 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:06:18.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:17 smithi089 ceph-mon[82218]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:06:18.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:06:18.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.668+0000 7f7695e31640 1 -- 172.21.15.16:0/2389519488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76900fdf50 msgr2=0x7f76900fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:18.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.668+0000 7f7695e31640 1 --2- 172.21.15.16:0/2389519488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76900fdf50 0x7f76900fe3b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7684009880 tx=0x7f768402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:06:18.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.668+0000 7f7695e31640 1 -- 172.21.15.16:0/2389519488 shutdown_connections 2024-08-01T07:06:18.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.668+0000 7f7695e31640 1 --2- 172.21.15.16:0/2389519488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76900fdf50 0x7f76900fe3b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:18.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.668+0000 7f7695e31640 1 --2- 172.21.15.16:0/2389519488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7690104b30 0x7f7690104f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:18.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.668+0000 7f7695e31640 1 -- 172.21.15.16:0/2389519488 >> 172.21.15.16:0/2389519488 conn(0x7f76900f9e60 msgr2=0x7f76900fc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:06:18.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.668+0000 7f7695e31640 1 -- 172.21.15.16:0/2389519488 shutdown_connections 2024-08-01T07:06:18.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.668+0000 7f7695e31640 1 -- 172.21.15.16:0/2389519488 wait complete. 2024-08-01T07:06:18.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.669+0000 7f7695e31640 1 Processor -- start 2024-08-01T07:06:18.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.669+0000 7f7695e31640 1 -- start start 2024-08-01T07:06:18.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.669+0000 7f7695e31640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76900fdf50 0x7f769019b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:06:18.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.669+0000 7f7695e31640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7690104b30 0x7f769019be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:06:18.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.669+0000 7f7695e31640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769019c440 con 0x7f76900fdf50 2024-08-01T07:06:18.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.669+0000 7f7695e31640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76901959d0 con 0x7f7690104b30 2024-08-01T07:06:18.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.669+0000 7f768f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76900fdf50 0x7f769019b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:06:18.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.670+0000 7f768f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76900fdf50 0x7f769019b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41944/0 (socket says 172.21.15.16:41944) 2024-08-01T07:06:18.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.670+0000 7f768f7fe640 1 -- 172.21.15.16:0/1286620909 learned_addr learned my addr 172.21.15.16:0/1286620909 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:06:18.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.670+0000 7f768effd640 1 --2- 172.21.15.16:0/1286620909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7690104b30 0x7f769019be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:06:18.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.670+0000 7f768f7fe640 1 -- 172.21.15.16:0/1286620909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7690104b30 msgr2=0x7f769019be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:18.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.670+0000 7f768f7fe640 1 --2- 172.21.15.16:0/1286620909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7690104b30 0x7f769019be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:18.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.670+0000 7f768f7fe640 1 -- 172.21.15.16:0/1286620909 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7684009560 con 0x7f76900fdf50 2024-08-01T07:06:18.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.670+0000 7f768f7fe640 1 --2- 172.21.15.16:0/1286620909 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76900fdf50 0x7f769019b8e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f768000d6f0 tx=0x7f768000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:06:18.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.670+0000 7f768cff9640 1 -- 172.21.15.16:0/1286620909 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7680009a30 con 0x7f76900fdf50 2024-08-01T07:06:18.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.670+0000 7f768cff9640 1 -- 172.21.15.16:0/1286620909 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f76800054e0 con 0x7f76900fdf50 2024-08-01T07:06:18.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.670+0000 7f7695e31640 1 -- 172.21.15.16:0/1286620909 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7690195cb0 con 0x7f76900fdf50 2024-08-01T07:06:18.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.670+0000 7f768cff9640 1 -- 172.21.15.16:0/1286620909 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7680010460 con 0x7f76900fdf50 2024-08-01T07:06:18.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.670+0000 7f7695e31640 1 -- 172.21.15.16:0/1286620909 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76901961d0 con 0x7f76900fdf50 2024-08-01T07:06:18.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.671+0000 7f7695e31640 1 -- 172.21.15.16:0/1286620909 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7690101270 con 0x7f76900fdf50 2024-08-01T07:06:18.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.672+0000 7f768cff9640 1 -- 172.21.15.16:0/1286620909 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7680009b90 con 0x7f76900fdf50 2024-08-01T07:06:18.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.672+0000 7f768cff9640 1 --2- 172.21.15.16:0/1286620909 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f767806e170 0x7f7678070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:06:18.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.673+0000 7f768cff9640 1 -- 172.21.15.16:0/1286620909 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f768008ddc0 con 0x7f76900fdf50 2024-08-01T07:06:18.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.673+0000 7f768effd640 1 --2- 172.21.15.16:0/1286620909 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f767806e170 0x7f7678070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:06:18.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.673+0000 7f768effd640 1 --2- 172.21.15.16:0/1286620909 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f767806e170 0x7f7678070630 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7684000c00 tx=0x7f7684005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:06:18.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.677+0000 7f768cff9640 1 -- 172.21.15.16:0/1286620909 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7680057000 con 0x7f76900fdf50 2024-08-01T07:06:18.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.921+0000 7f7695e31640 1 -- 172.21.15.16:0/1286620909 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7690108090 con 0x7f76900fdf50 2024-08-01T07:06:18.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.921+0000 7f768cff9640 1 -- 172.21.15.16:0/1286620909 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7680020090 con 0x7f76900fdf50 2024-08-01T07:06:18.925 INFO:teuthology.orchestra.run.smithi016.stdout:HEALTH_OK 2024-08-01T07:06:18.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.923+0000 7f7695e31640 1 -- 172.21.15.16:0/1286620909 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f767806e170 msgr2=0x7f7678070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:18.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.923+0000 7f7695e31640 1 --2- 172.21.15.16:0/1286620909 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f767806e170 0x7f7678070630 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7684000c00 tx=0x7f7684005a20 comp rx=0 tx=0).stop 2024-08-01T07:06:18.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.923+0000 7f7695e31640 1 -- 172.21.15.16:0/1286620909 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76900fdf50 msgr2=0x7f769019b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:18.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.923+0000 7f7695e31640 1 --2- 172.21.15.16:0/1286620909 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76900fdf50 0x7f769019b8e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f768000d6f0 tx=0x7f768000dbb0 comp rx=0 tx=0).stop 2024-08-01T07:06:18.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.923+0000 7f7695e31640 1 -- 172.21.15.16:0/1286620909 shutdown_connections 2024-08-01T07:06:18.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.923+0000 7f7695e31640 1 --2- 172.21.15.16:0/1286620909 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f767806e170 0x7f7678070630 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:18.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.923+0000 7f7695e31640 1 --2- 172.21.15.16:0/1286620909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7690104b30 0x7f769019be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:18.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.923+0000 7f7695e31640 1 --2- 172.21.15.16:0/1286620909 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76900fdf50 0x7f769019b8e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:18.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.923+0000 7f7695e31640 1 -- 172.21.15.16:0/1286620909 >> 172.21.15.16:0/1286620909 conn(0x7f76900f9e60 msgr2=0x7f76900fafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:06:18.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.923+0000 7f7695e31640 1 -- 172.21.15.16:0/1286620909 shutdown_connections 2024-08-01T07:06:18.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:18.923+0000 7f7695e31640 1 -- 172.21.15.16:0/1286620909 wait complete. 2024-08-01T07:06:19.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:18 smithi089 ceph-mon[82218]: pgmap v290: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:06:19.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:18 smithi016 ceph-mon[93645]: pgmap v290: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:06:19.563 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -e sha1=f9911e17b12222fbe598fff73cd3ad10d20c5776 -- bash -c 'ceph versions' 2024-08-01T07:06:19.776 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:06:20.135 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:19 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/1286620909' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:06:20.136 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:19 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/1286620909' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-01T07:06:21.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:20 smithi089 ceph-mon[82218]: pgmap v291: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:06:21.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:20 smithi016 ceph-mon[93645]: pgmap v291: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:06:21.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.358+0000 7f46718aa640 1 -- 172.21.15.16:0/2353769513 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f466c0ff210 msgr2=0x7f466c10bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:21.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.358+0000 7f46718aa640 1 --2- 172.21.15.16:0/2353769513 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f466c0ff210 0x7f466c10bed0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4660009880 tx=0x7f466002a490 comp rx=0 tx=0).stop 2024-08-01T07:06:21.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.358+0000 7f46718aa640 1 -- 172.21.15.16:0/2353769513 shutdown_connections 2024-08-01T07:06:21.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.358+0000 7f46718aa640 1 --2- 172.21.15.16:0/2353769513 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f466c0ff210 0x7f466c10bed0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:21.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.358+0000 7f46718aa640 1 --2- 172.21.15.16:0/2353769513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f466c0fe860 0x7f466c0fec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:21.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.358+0000 7f46718aa640 1 -- 172.21.15.16:0/2353769513 >> 172.21.15.16:0/2353769513 conn(0x7f466c0fa730 msgr2=0x7f466c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:06:21.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.358+0000 7f46718aa640 1 -- 172.21.15.16:0/2353769513 shutdown_connections 2024-08-01T07:06:21.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.358+0000 7f46718aa640 1 -- 172.21.15.16:0/2353769513 wait complete. 2024-08-01T07:06:21.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.359+0000 7f46718aa640 1 Processor -- start 2024-08-01T07:06:21.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.359+0000 7f46718aa640 1 -- start start 2024-08-01T07:06:21.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.359+0000 7f46718aa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f466c0fe860 0x7f466c197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:06:21.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.359+0000 7f46718aa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f466c0ff210 0x7f466c198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:06:21.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.359+0000 7f46718aa640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c1988f0 con 0x7f466c0ff210 2024-08-01T07:06:21.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.359+0000 7f46718aa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c19b560 con 0x7f466c0fe860 2024-08-01T07:06:21.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.360+0000 7f466a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f466c0ff210 0x7f466c198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:06:21.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.360+0000 7f466a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f466c0ff210 0x7f466c198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33892/0 (socket says 172.21.15.16:33892) 2024-08-01T07:06:21.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.360+0000 7f466a7fc640 1 -- 172.21.15.16:0/3574995365 learned_addr learned my addr 172.21.15.16:0/3574995365 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:06:21.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.360+0000 7f466affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f466c0fe860 0x7f466c197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:06:21.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.360+0000 7f466a7fc640 1 -- 172.21.15.16:0/3574995365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f466c0fe860 msgr2=0x7f466c197cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:21.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.360+0000 7f466a7fc640 1 --2- 172.21.15.16:0/3574995365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f466c0fe860 0x7f466c197cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:21.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.360+0000 7f466a7fc640 1 -- 172.21.15.16:0/3574995365 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4660009560 con 0x7f466c0ff210 2024-08-01T07:06:21.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.360+0000 7f466a7fc640 1 --2- 172.21.15.16:0/3574995365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f466c0ff210 0x7f466c198210 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f466002a9b0 tx=0x7f46600055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:06:21.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.360+0000 7f46708a8640 1 -- 172.21.15.16:0/3574995365 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4660004aa0 con 0x7f466c0ff210 2024-08-01T07:06:21.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.360+0000 7f46718aa640 1 -- 172.21.15.16:0/3574995365 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466c19b7e0 con 0x7f466c0ff210 2024-08-01T07:06:21.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.360+0000 7f46708a8640 1 -- 172.21.15.16:0/3574995365 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4660004c00 con 0x7f466c0ff210 2024-08-01T07:06:21.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.360+0000 7f46708a8640 1 -- 172.21.15.16:0/3574995365 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4660003980 con 0x7f466c0ff210 2024-08-01T07:06:21.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.360+0000 7f46718aa640 1 -- 172.21.15.16:0/3574995365 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466c19bd30 con 0x7f466c0ff210 2024-08-01T07:06:21.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.361+0000 7f46718aa640 1 -- 172.21.15.16:0/3574995365 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466c068d30 con 0x7f466c0ff210 2024-08-01T07:06:21.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.362+0000 7f46708a8640 1 -- 172.21.15.16:0/3574995365 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4660003bf0 con 0x7f466c0ff210 2024-08-01T07:06:21.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.362+0000 7f46708a8640 1 --2- 172.21.15.16:0/3574995365 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f465406e170 0x7f4654070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:06:21.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.363+0000 7f46708a8640 1 -- 172.21.15.16:0/3574995365 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f46600af2e0 con 0x7f466c0ff210 2024-08-01T07:06:21.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.363+0000 7f466affd640 1 --2- 172.21.15.16:0/3574995365 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f465406e170 0x7f4654070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:06:21.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.363+0000 7f466affd640 1 --2- 172.21.15.16:0/3574995365 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f465406e170 0x7f4654070630 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f465c005fd0 tx=0x7f465c009680 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:06:21.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.367+0000 7f46708a8640 1 -- 172.21.15.16:0/3574995365 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f46600784b0 con 0x7f466c0ff210 2024-08-01T07:06:21.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.609+0000 7f46718aa640 1 -- 172.21.15.16:0/3574995365 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f466c106660 con 0x7f466c0ff210 2024-08-01T07:06:21.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.610+0000 7f46708a8640 1 -- 172.21.15.16:0/3574995365 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f466007bb70 con 0x7f466c0ff210 2024-08-01T07:06:21.612 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:06:21.612 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T07:06:21.612 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:06:21.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:06:21.612 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T07:06:21.612 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:06:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:06:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T07:06:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 6 2024-08-01T07:06:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:06:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T07:06:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 4 2024-08-01T07:06:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:06:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T07:06:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 14 2024-08-01T07:06:21.614 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T07:06:21.614 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:06:21.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.612+0000 7f46718aa640 1 -- 172.21.15.16:0/3574995365 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f465406e170 msgr2=0x7f4654070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:21.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.612+0000 7f46718aa640 1 --2- 172.21.15.16:0/3574995365 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f465406e170 0x7f4654070630 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f465c005fd0 tx=0x7f465c009680 comp rx=0 tx=0).stop 2024-08-01T07:06:21.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.612+0000 7f46718aa640 1 -- 172.21.15.16:0/3574995365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f466c0ff210 msgr2=0x7f466c198210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:06:21.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.612+0000 7f46718aa640 1 --2- 172.21.15.16:0/3574995365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f466c0ff210 0x7f466c198210 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f466002a9b0 tx=0x7f46600055a0 comp rx=0 tx=0).stop 2024-08-01T07:06:21.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.612+0000 7f46718aa640 1 -- 172.21.15.16:0/3574995365 shutdown_connections 2024-08-01T07:06:21.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.612+0000 7f46718aa640 1 --2- 172.21.15.16:0/3574995365 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f465406e170 0x7f4654070630 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:21.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.612+0000 7f46718aa640 1 --2- 172.21.15.16:0/3574995365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f466c0ff210 0x7f466c198210 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:21.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.612+0000 7f46718aa640 1 --2- 172.21.15.16:0/3574995365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f466c0fe860 0x7f466c197cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:06:21.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.612+0000 7f46718aa640 1 -- 172.21.15.16:0/3574995365 >> 172.21.15.16:0/3574995365 conn(0x7f466c0fa730 msgr2=0x7f466c0fbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:06:21.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.613+0000 7f46718aa640 1 -- 172.21.15.16:0/3574995365 shutdown_connections 2024-08-01T07:06:21.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:06:21.613+0000 7f46718aa640 1 -- 172.21.15.16:0/3574995365 wait complete. 2024-08-01T07:06:22.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:21 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/3574995365' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:06:22.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:21 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/3574995365' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:06:22.205 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -e sha1=f9911e17b12222fbe598fff73cd3ad10d20c5776 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-08-01T07:06:22.420 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:06:23.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:22 smithi089 ceph-mon[82218]: pgmap v292: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:06:23.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:22 smithi016 ceph-mon[93645]: pgmap v292: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:06:23.994 INFO:teuthology.orchestra.run.smithi016.stdout:wait for servicemap items w/ changing names to refresh 2024-08-01T07:06:24.628 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -e sha1=f9911e17b12222fbe598fff73cd3ad10d20c5776 -- bash -c 'sleep 60' 2024-08-01T07:06:24.843 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:06:24.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:24 smithi016 ceph-mon[93645]: pgmap v293: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:06:25.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:24 smithi089 ceph-mon[82218]: pgmap v293: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:06:27.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:26 smithi089 ceph-mon[82218]: pgmap v294: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:06:27.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:26 smithi016 ceph-mon[93645]: pgmap v294: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:06:29.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:28 smithi089 ceph-mon[82218]: pgmap v295: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:06:29.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:28 smithi016 ceph-mon[93645]: pgmap v295: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:06:31.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:30 smithi089 ceph-mon[82218]: pgmap v296: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:06:31.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:30 smithi016 ceph-mon[93645]: pgmap v296: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:06:33.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:32 smithi089 ceph-mon[82218]: pgmap v297: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:06:33.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:06:33.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:32 smithi016 ceph-mon[93645]: pgmap v297: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:06:33.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:06:35.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:34 smithi089 ceph-mon[82218]: pgmap v298: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:06:35.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:34 smithi016 ceph-mon[93645]: pgmap v298: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:06:37.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:36 smithi089 ceph-mon[82218]: pgmap v299: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:06:37.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:36 smithi016 ceph-mon[93645]: pgmap v299: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:06:39.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:38 smithi089 ceph-mon[82218]: pgmap v300: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:06:39.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:38 smithi016 ceph-mon[93645]: pgmap v300: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:06:41.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:40 smithi016 ceph-mon[93645]: pgmap v301: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:06:41.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:40 smithi089 ceph-mon[82218]: pgmap v301: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:06:43.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:42 smithi016 ceph-mon[93645]: pgmap v302: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:06:43.189 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:42 smithi089 ceph-mon[82218]: pgmap v302: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:06:45.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:44 smithi016 ceph-mon[93645]: pgmap v303: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:06:45.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:44 smithi089 ceph-mon[82218]: pgmap v303: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:06:46.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:06:46.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:06:46.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:06:46.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:45 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:06:46.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:06:46.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:06:46.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:06:46.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:45 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:06:47.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:46 smithi089 ceph-mon[82218]: pgmap v304: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:06:47.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:46 smithi016 ceph-mon[93645]: pgmap v304: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:06:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:06:48.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:06:49.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:48 smithi089 ceph-mon[82218]: pgmap v305: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:06:49.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:48 smithi016 ceph-mon[93645]: pgmap v305: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:06:51.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:50 smithi089 ceph-mon[82218]: pgmap v306: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:06:51.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:50 smithi016 ceph-mon[93645]: pgmap v306: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:06:53.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:52 smithi089 ceph-mon[82218]: pgmap v307: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:06:53.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:52 smithi016 ceph-mon[93645]: pgmap v307: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:06:55.294 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:54 smithi016 ceph-mon[93645]: pgmap v308: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:06:55.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:54 smithi089 ceph-mon[82218]: pgmap v308: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:06:57.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:56 smithi089 ceph-mon[82218]: pgmap v309: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:06:57.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:56 smithi016 ceph-mon[93645]: pgmap v309: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:06:59.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:06:58 smithi089 ceph-mon[82218]: pgmap v310: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:06:59.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:06:58 smithi016 ceph-mon[93645]: pgmap v310: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:07:01.220 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:00 smithi089 ceph-mon[82218]: pgmap v311: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:07:01.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:00 smithi016 ceph-mon[93645]: pgmap v311: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:07:03.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:02 smithi089 ceph-mon[82218]: pgmap v312: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:07:03.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:07:03.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:02 smithi016 ceph-mon[93645]: pgmap v312: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:07:03.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:07:05.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:04 smithi016 ceph-mon[93645]: pgmap v313: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:07:05.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:04 smithi089 ceph-mon[82218]: pgmap v313: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:07:07.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:06 smithi089 ceph-mon[82218]: pgmap v314: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:07:07.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:06 smithi016 ceph-mon[93645]: pgmap v314: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:07:09.250 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:08 smithi089 ceph-mon[82218]: pgmap v315: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:07:09.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:08 smithi016 ceph-mon[93645]: pgmap v315: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:07:11.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:10 smithi089 ceph-mon[82218]: pgmap v316: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:07:11.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:10 smithi016 ceph-mon[93645]: pgmap v316: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:07:13.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:12 smithi089 ceph-mon[82218]: pgmap v317: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:07:13.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:12 smithi016 ceph-mon[93645]: pgmap v317: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:07:15.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:14 smithi089 ceph-mon[82218]: pgmap v318: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:07:15.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:14 smithi016 ceph-mon[93645]: pgmap v318: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:07:17.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:16 smithi089 ceph-mon[82218]: pgmap v319: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:07:17.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:16 smithi016 ceph-mon[93645]: pgmap v319: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:07:18.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:07:18.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:07:19.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:18 smithi089 ceph-mon[82218]: pgmap v320: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:07:19.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:18 smithi016 ceph-mon[93645]: pgmap v320: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:07:21.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:20 smithi089 ceph-mon[82218]: pgmap v321: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:07:21.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:20 smithi016 ceph-mon[93645]: pgmap v321: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:07:23.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:22 smithi089 ceph-mon[82218]: pgmap v322: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:07:23.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:22 smithi016 ceph-mon[93645]: pgmap v322: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:07:25.275 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:24 smithi016 ceph-mon[93645]: pgmap v323: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:07:25.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:24 smithi089 ceph-mon[82218]: pgmap v323: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:07:27.131 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:26 smithi016 ceph-mon[93645]: pgmap v324: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:07:27.161 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -e sha1=f9911e17b12222fbe598fff73cd3ad10d20c5776 -- bash -c 'ceph orch ps' 2024-08-01T07:07:27.386 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:07:27.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:26 smithi089 ceph-mon[82218]: pgmap v324: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:07:29.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.051+0000 7f4861e83640 1 -- 172.21.15.16:0/3109898053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f485c104a30 msgr2=0x7f485c104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:29.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.051+0000 7f4861e83640 1 --2- 172.21.15.16:0/3109898053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f485c104a30 0x7f485c104e10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f484c009880 tx=0x7f484c02a4a0 comp rx=0 tx=0).stop 2024-08-01T07:07:29.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.051+0000 7f4861e83640 1 -- 172.21.15.16:0/3109898053 shutdown_connections 2024-08-01T07:07:29.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.051+0000 7f4861e83640 1 --2- 172.21.15.16:0/3109898053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f485c0fea30 0x7f485c0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:29.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.051+0000 7f4861e83640 1 --2- 172.21.15.16:0/3109898053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f485c104a30 0x7f485c104e10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:29.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.051+0000 7f4861e83640 1 -- 172.21.15.16:0/3109898053 >> 172.21.15.16:0/3109898053 conn(0x7f485c0fa730 msgr2=0x7f485c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:29.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.051+0000 7f4861e83640 1 -- 172.21.15.16:0/3109898053 shutdown_connections 2024-08-01T07:07:29.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.051+0000 7f4861e83640 1 -- 172.21.15.16:0/3109898053 wait complete. 2024-08-01T07:07:29.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.052+0000 7f4861e83640 1 Processor -- start 2024-08-01T07:07:29.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.052+0000 7f4861e83640 1 -- start start 2024-08-01T07:07:29.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.052+0000 7f4861e83640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f485c0fea30 0x7f485c19b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:29.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.052+0000 7f4861e83640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f485c104a30 0x7f485c19bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:29.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.052+0000 7f4861e83640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c19c3b0 con 0x7f485c104a30 2024-08-01T07:07:29.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.052+0000 7f4861e83640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c195940 con 0x7f485c0fea30 2024-08-01T07:07:29.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.052+0000 7f485affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f485c104a30 0x7f485c19bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:29.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.053+0000 7f485affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f485c104a30 0x7f485c19bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33072/0 (socket says 172.21.15.16:33072) 2024-08-01T07:07:29.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.053+0000 7f485affd640 1 -- 172.21.15.16:0/2140379105 learned_addr learned my addr 172.21.15.16:0/2140379105 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:07:29.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.053+0000 7f485b7fe640 1 --2- 172.21.15.16:0/2140379105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f485c0fea30 0x7f485c19b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:29.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.053+0000 7f485affd640 1 -- 172.21.15.16:0/2140379105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f485c0fea30 msgr2=0x7f485c19b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:29.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.053+0000 7f485affd640 1 --2- 172.21.15.16:0/2140379105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f485c0fea30 0x7f485c19b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:29.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.053+0000 7f485affd640 1 -- 172.21.15.16:0/2140379105 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c009560 con 0x7f485c104a30 2024-08-01T07:07:29.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.053+0000 7f485affd640 1 --2- 172.21.15.16:0/2140379105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f485c104a30 0x7f485c19bd90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f484400c8f0 tx=0x7f484400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:29.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.053+0000 7f4858ff9640 1 -- 172.21.15.16:0/2140379105 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4844007b80 con 0x7f485c104a30 2024-08-01T07:07:29.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.053+0000 7f4861e83640 1 -- 172.21.15.16:0/2140379105 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485c195c20 con 0x7f485c104a30 2024-08-01T07:07:29.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.053+0000 7f4858ff9640 1 -- 172.21.15.16:0/2140379105 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f48440054e0 con 0x7f485c104a30 2024-08-01T07:07:29.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.053+0000 7f4858ff9640 1 -- 172.21.15.16:0/2140379105 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f484400f450 con 0x7f485c104a30 2024-08-01T07:07:29.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.053+0000 7f4861e83640 1 -- 172.21.15.16:0/2140379105 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485c196170 con 0x7f485c104a30 2024-08-01T07:07:29.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.054+0000 7f4861e83640 1 -- 172.21.15.16:0/2140379105 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485c100170 con 0x7f485c104a30 2024-08-01T07:07:29.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.055+0000 7f4858ff9640 1 -- 172.21.15.16:0/2140379105 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4844004f60 con 0x7f485c104a30 2024-08-01T07:07:29.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.055+0000 7f4858ff9640 1 --2- 172.21.15.16:0/2140379105 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f484806e170 0x7f4848070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:29.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.055+0000 7f4858ff9640 1 -- 172.21.15.16:0/2140379105 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f484408e110 con 0x7f485c104a30 2024-08-01T07:07:29.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.055+0000 7f485b7fe640 1 --2- 172.21.15.16:0/2140379105 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f484806e170 0x7f4848070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:29.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.056+0000 7f485b7fe640 1 --2- 172.21.15.16:0/2140379105 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f484806e170 0x7f4848070630 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f484c000c00 tx=0x7f484c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:29.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.060+0000 7f4858ff9640 1 -- 172.21.15.16:0/2140379105 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f48440572d0 con 0x7f485c104a30 2024-08-01T07:07:29.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:28 smithi016 ceph-mon[93645]: pgmap v325: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:07:29.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.245+0000 7f4861e83640 1 -- 172.21.15.16:0/2140379105 --> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f485c10bcc0 con 0x7f484806e170 2024-08-01T07:07:29.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.255+0000 7f4858ff9640 1 -- 172.21.15.16:0/2140379105 <== mgr.34104 v2:172.21.15.16:6800/3689482666 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f485c10bcc0 con 0x7f484806e170 2024-08-01T07:07:29.257 INFO:teuthology.orchestra.run.smithi016.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-01T07:07:29.257 INFO:teuthology.orchestra.run.smithi016.stdout:alertmanager.smithi016 smithi016 *:9093,9094 running (2m) 108s ago 19m 16.2M - 0.25.0 c8568f914cd2 5bf0f01a8089 2024-08-01T07:07:29.258 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi016 smithi016 running (3m) 108s ago 19m 8460k - 19.1.0-1223-gf9911e17 93d93c74a2cc a847ec3f462f 2024-08-01T07:07:29.258 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-exporter.smithi089 smithi089 running (3m) 2m ago 18m 8224k - 19.1.0-1223-gf9911e17 93d93c74a2cc f2f5e0a7786f 2024-08-01T07:07:29.258 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi016 smithi016 running (8m) 108s ago 19m 6899k - 19.1.0-1223-gf9911e17 93d93c74a2cc 2a96028287a2 2024-08-01T07:07:29.258 INFO:teuthology.orchestra.run.smithi016.stdout:crash.smithi089 smithi089 running (8m) 2m ago 18m 6895k - 19.1.0-1223-gf9911e17 93d93c74a2cc 8a23341bd6c3 2024-08-01T07:07:29.258 INFO:teuthology.orchestra.run.smithi016.stdout:grafana.smithi016 smithi016 *:3000 running (114s) 108s ago 19m 52.9M - 9.4.12 2bacad6d85d8 88e7e24a4a10 2024-08-01T07:07:29.258 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.bgqkxu smithi016 running (4m) 108s ago 14m 89.6M - 19.1.0-1223-gf9911e17 93d93c74a2cc 2fb78654cbea 2024-08-01T07:07:29.258 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi016.fziqod smithi016 running (3m) 108s ago 14m 18.4M - 19.1.0-1223-gf9911e17 93d93c74a2cc d3ca5deb5bb6 2024-08-01T07:07:29.258 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.jhouje smithi089 running (3m) 2m ago 14m 86.0M - 19.1.0-1223-gf9911e17 93d93c74a2cc 6e9b9ebf3bc9 2024-08-01T07:07:29.258 INFO:teuthology.orchestra.run.smithi016.stdout:mds.cephfs.smithi089.xanuld smithi089 running (3m) 2m ago 14m 16.1M - 19.1.0-1223-gf9911e17 93d93c74a2cc 98dd666884c1 2024-08-01T07:07:29.258 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi016.whigbo smithi016 *:8443,9283,8765 running (10m) 108s ago 20m 517M - 19.1.0-1223-gf9911e17 93d93c74a2cc 8701e6315593 2024-08-01T07:07:29.258 INFO:teuthology.orchestra.run.smithi016.stdout:mgr.smithi089.hfgnsr smithi089 *:8443,9283,8765 running (9m) 2m ago 18m 442M - 19.1.0-1223-gf9911e17 93d93c74a2cc c6caa21f436f 2024-08-01T07:07:29.259 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi016 smithi016 running (9m) 108s ago 20m 58.1M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc 48e94d076e6f 2024-08-01T07:07:29.259 INFO:teuthology.orchestra.run.smithi016.stdout:mon.smithi089 smithi089 running (8m) 2m ago 18m 43.6M 2048M 19.1.0-1223-gf9911e17 93d93c74a2cc c4b83b46ff15 2024-08-01T07:07:29.259 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi016 smithi016 *:9100 running (2m) 108s ago 19m 8497k - 1.5.0 0da6a335fe13 d2aef4eb39e6 2024-08-01T07:07:29.259 INFO:teuthology.orchestra.run.smithi016.stdout:node-exporter.smithi089 smithi089 *:9100 running (2m) 2m ago 18m 5653k - 1.5.0 0da6a335fe13 318349c489e1 2024-08-01T07:07:29.259 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 smithi016 running (7m) 108s ago 17m 207M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 4c2115ae6222 2024-08-01T07:07:29.259 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 smithi016 running (7m) 108s ago 17m 110M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc fc2f7117be30 2024-08-01T07:07:29.259 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 smithi016 running (6m) 108s ago 16m 144M 1217M 19.1.0-1223-gf9911e17 93d93c74a2cc 3364752c9365 2024-08-01T07:07:29.259 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 smithi089 running (6m) 2m ago 16m 117M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 9a18feae4353 2024-08-01T07:07:29.259 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 smithi089 running (5m) 2m ago 16m 168M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 7c51ba7a636a 2024-08-01T07:07:29.259 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 smithi089 running (5m) 2m ago 15m 127M 2239M 19.1.0-1223-gf9911e17 93d93c74a2cc 08ffb10ca1a6 2024-08-01T07:07:29.259 INFO:teuthology.orchestra.run.smithi016.stdout:prometheus.smithi016 smithi016 *:9095 running (2m) 108s ago 19m 48.8M - 2.43.0 a07b618ecd1d a411dec2c11d 2024-08-01T07:07:29.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.257+0000 7f4861e83640 1 -- 172.21.15.16:0/2140379105 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f484806e170 msgr2=0x7f4848070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:29.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.257+0000 7f4861e83640 1 --2- 172.21.15.16:0/2140379105 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f484806e170 0x7f4848070630 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f484c000c00 tx=0x7f484c005a20 comp rx=0 tx=0).stop 2024-08-01T07:07:29.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.257+0000 7f4861e83640 1 -- 172.21.15.16:0/2140379105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f485c104a30 msgr2=0x7f485c19bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:29.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.257+0000 7f4861e83640 1 --2- 172.21.15.16:0/2140379105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f485c104a30 0x7f485c19bd90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f484400c8f0 tx=0x7f484400cdb0 comp rx=0 tx=0).stop 2024-08-01T07:07:29.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.257+0000 7f4861e83640 1 -- 172.21.15.16:0/2140379105 shutdown_connections 2024-08-01T07:07:29.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.257+0000 7f4861e83640 1 --2- 172.21.15.16:0/2140379105 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f484806e170 0x7f4848070630 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:29.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.257+0000 7f4861e83640 1 --2- 172.21.15.16:0/2140379105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f485c104a30 0x7f485c19bd90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:29.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.257+0000 7f4861e83640 1 --2- 172.21.15.16:0/2140379105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f485c0fea30 0x7f485c19b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:29.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.257+0000 7f4861e83640 1 -- 172.21.15.16:0/2140379105 >> 172.21.15.16:0/2140379105 conn(0x7f485c0fa730 msgr2=0x7f485c068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:29.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.257+0000 7f4861e83640 1 -- 172.21.15.16:0/2140379105 shutdown_connections 2024-08-01T07:07:29.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:29.257+0000 7f4861e83640 1 -- 172.21.15.16:0/2140379105 wait complete. 2024-08-01T07:07:29.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:28 smithi089 ceph-mon[82218]: pgmap v325: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:07:29.977 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -e sha1=f9911e17b12222fbe598fff73cd3ad10d20c5776 -- bash -c 'ceph versions' 2024-08-01T07:07:30.196 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:07:31.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:30 smithi089 ceph-mon[82218]: pgmap v326: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:07:31.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:30 smithi089 ceph-mon[82218]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:07:31.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:30 smithi016 ceph-mon[93645]: pgmap v326: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:07:31.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:30 smithi016 ceph-mon[93645]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-01T07:07:32.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.068+0000 7f797378f640 1 -- 172.21.15.16:0/3292308657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f796c100c60 msgr2=0x7f796c101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:32.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.068+0000 7f797378f640 1 --2- 172.21.15.16:0/3292308657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f796c100c60 0x7f796c101040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f79680098b0 tx=0x7f796802a4d0 comp rx=0 tx=0).stop 2024-08-01T07:07:32.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.068+0000 7f797378f640 1 -- 172.21.15.16:0/3292308657 shutdown_connections 2024-08-01T07:07:32.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.068+0000 7f797378f640 1 --2- 172.21.15.16:0/3292308657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f796c101610 0x7f796c109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:32.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.068+0000 7f797378f640 1 --2- 172.21.15.16:0/3292308657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f796c100c60 0x7f796c101040 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:32.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.068+0000 7f797378f640 1 -- 172.21.15.16:0/3292308657 >> 172.21.15.16:0/3292308657 conn(0x7f796c0fa730 msgr2=0x7f796c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:32.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.068+0000 7f797378f640 1 -- 172.21.15.16:0/3292308657 shutdown_connections 2024-08-01T07:07:32.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.068+0000 7f797378f640 1 -- 172.21.15.16:0/3292308657 wait complete. 2024-08-01T07:07:32.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.069+0000 7f797378f640 1 Processor -- start 2024-08-01T07:07:32.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.069+0000 7f797378f640 1 -- start start 2024-08-01T07:07:32.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.069+0000 7f797378f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f796c100c60 0x7f796c19b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:32.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.069+0000 7f797378f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f796c101610 0x7f796c19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:32.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.069+0000 7f797378f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c19c2f0 con 0x7f796c100c60 2024-08-01T07:07:32.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.069+0000 7f797378f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c195910 con 0x7f796c101610 2024-08-01T07:07:32.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.069+0000 7f797152b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f796c100c60 0x7f796c19b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:32.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.069+0000 7f797152b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f796c100c60 0x7f796c19b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33086/0 (socket says 172.21.15.16:33086) 2024-08-01T07:07:32.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.069+0000 7f797152b640 1 -- 172.21.15.16:0/486026220 learned_addr learned my addr 172.21.15.16:0/486026220 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:07:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.069+0000 7f7970d2a640 1 --2- 172.21.15.16:0/486026220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f796c101610 0x7f796c19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.070+0000 7f797152b640 1 -- 172.21.15.16:0/486026220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f796c101610 msgr2=0x7f796c19bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.070+0000 7f797152b640 1 --2- 172.21.15.16:0/486026220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f796c101610 0x7f796c19bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.070+0000 7f797152b640 1 -- 172.21.15.16:0/486026220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7968009560 con 0x7f796c100c60 2024-08-01T07:07:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.070+0000 7f7970d2a640 1 --2- 172.21.15.16:0/486026220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f796c101610 0x7f796c19bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-01T07:07:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.070+0000 7f797152b640 1 --2- 172.21.15.16:0/486026220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f796c100c60 0x7f796c19b820 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7968009230 tx=0x7f79680055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.070+0000 7f79627fc640 1 -- 172.21.15.16:0/486026220 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7968004aa0 con 0x7f796c100c60 2024-08-01T07:07:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.070+0000 7f79627fc640 1 -- 172.21.15.16:0/486026220 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7968004c00 con 0x7f796c100c60 2024-08-01T07:07:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.070+0000 7f797378f640 1 -- 172.21.15.16:0/486026220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c195b90 con 0x7f796c100c60 2024-08-01T07:07:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.070+0000 7f79627fc640 1 -- 172.21.15.16:0/486026220 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79680039f0 con 0x7f796c100c60 2024-08-01T07:07:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.070+0000 7f797378f640 1 -- 172.21.15.16:0/486026220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c196080 con 0x7f796c100c60 2024-08-01T07:07:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.071+0000 7f797378f640 1 -- 172.21.15.16:0/486026220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796c068d30 con 0x7f796c100c60 2024-08-01T07:07:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.072+0000 7f79627fc640 1 -- 172.21.15.16:0/486026220 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7968031c00 con 0x7f796c100c60 2024-08-01T07:07:32.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.072+0000 7f79627fc640 1 --2- 172.21.15.16:0/486026220 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f795806e180 0x7f7958070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:32.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.072+0000 7f79627fc640 1 -- 172.21.15.16:0/486026220 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f79680af4c0 con 0x7f796c100c60 2024-08-01T07:07:32.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.072+0000 7f7970d2a640 1 --2- 172.21.15.16:0/486026220 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f795806e180 0x7f7958070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:32.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.073+0000 7f7970d2a640 1 --2- 172.21.15.16:0/486026220 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f795806e180 0x7f7958070640 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f796c196d80 tx=0x7f795c005d90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:32.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.077+0000 7f79627fc640 1 -- 172.21.15.16:0/486026220 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7968078680 con 0x7f796c100c60 2024-08-01T07:07:32.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.323+0000 7f797378f640 1 -- 172.21.15.16:0/486026220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f796c104380 con 0x7f796c100c60 2024-08-01T07:07:32.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.324+0000 7f79627fc640 1 -- 172.21.15.16:0/486026220 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f796807bd40 con 0x7f796c100c60 2024-08-01T07:07:32.326 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-08-01T07:07:32.327 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": { 2024-08-01T07:07:32.327 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:07:32.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:07:32.327 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": { 2024-08-01T07:07:32.327 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 2 2024-08-01T07:07:32.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:07:32.327 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": { 2024-08-01T07:07:32.327 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 6 2024-08-01T07:07:32.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:07:32.327 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-08-01T07:07:32.327 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 4 2024-08-01T07:07:32.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-08-01T07:07:32.328 INFO:teuthology.orchestra.run.smithi016.stdout: "overall": { 2024-08-01T07:07:32.328 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)": 14 2024-08-01T07:07:32.328 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-08-01T07:07:32.328 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-08-01T07:07:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.326+0000 7f797378f640 1 -- 172.21.15.16:0/486026220 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f795806e180 msgr2=0x7f7958070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.326+0000 7f797378f640 1 --2- 172.21.15.16:0/486026220 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f795806e180 0x7f7958070640 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f796c196d80 tx=0x7f795c005d90 comp rx=0 tx=0).stop 2024-08-01T07:07:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.326+0000 7f797378f640 1 -- 172.21.15.16:0/486026220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f796c100c60 msgr2=0x7f796c19b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.326+0000 7f797378f640 1 --2- 172.21.15.16:0/486026220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f796c100c60 0x7f796c19b820 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7968009230 tx=0x7f79680055a0 comp rx=0 tx=0).stop 2024-08-01T07:07:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.326+0000 7f797378f640 1 -- 172.21.15.16:0/486026220 shutdown_connections 2024-08-01T07:07:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.326+0000 7f797378f640 1 --2- 172.21.15.16:0/486026220 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f795806e180 0x7f7958070640 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.326+0000 7f797378f640 1 --2- 172.21.15.16:0/486026220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f796c101610 0x7f796c19bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.326+0000 7f797378f640 1 --2- 172.21.15.16:0/486026220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f796c100c60 0x7f796c19b820 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.326+0000 7f797378f640 1 -- 172.21.15.16:0/486026220 >> 172.21.15.16:0/486026220 conn(0x7f796c0fa730 msgr2=0x7f796c101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.326+0000 7f797378f640 1 -- 172.21.15.16:0/486026220 shutdown_connections 2024-08-01T07:07:32.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:32.326+0000 7f797378f640 1 -- 172.21.15.16:0/486026220 wait complete. 2024-08-01T07:07:32.971 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -e sha1=f9911e17b12222fbe598fff73cd3ad10d20c5776 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-08-01T07:07:33.188 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:07:33.310 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:32 smithi016 ceph-mon[93645]: pgmap v327: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:07:33.310 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:07:33.310 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:32 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/486026220' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:07:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:32 smithi089 ceph-mon[82218]: pgmap v327: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:07:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:07:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:32 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/486026220' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:07:34.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.733+0000 7fed7446f640 1 -- 172.21.15.16:0/32521788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed6c101610 msgr2=0x7fed6c109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:34.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.733+0000 7fed7446f640 1 --2- 172.21.15.16:0/32521788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed6c101610 0x7fed6c109b00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009880 tx=0x7fed5c02a530 comp rx=0 tx=0).stop 2024-08-01T07:07:34.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.734+0000 7fed7446f640 1 -- 172.21.15.16:0/32521788 shutdown_connections 2024-08-01T07:07:34.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.734+0000 7fed7446f640 1 --2- 172.21.15.16:0/32521788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed6c101610 0x7fed6c109b00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:34.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.734+0000 7fed7446f640 1 --2- 172.21.15.16:0/32521788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed6c100cf0 0x7fed6c1010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:34.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.734+0000 7fed7446f640 1 -- 172.21.15.16:0/32521788 >> 172.21.15.16:0/32521788 conn(0x7fed6c0fa710 msgr2=0x7fed6c0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:34.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.734+0000 7fed7446f640 1 -- 172.21.15.16:0/32521788 shutdown_connections 2024-08-01T07:07:34.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.734+0000 7fed7446f640 1 -- 172.21.15.16:0/32521788 wait complete. 2024-08-01T07:07:34.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.734+0000 7fed7446f640 1 Processor -- start 2024-08-01T07:07:34.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.734+0000 7fed7446f640 1 -- start start 2024-08-01T07:07:34.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.734+0000 7fed7446f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed6c100cf0 0x7fed6c0fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:34.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.734+0000 7fed7446f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed6c101610 0x7fed6c0fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:34.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.734+0000 7fed7446f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c0ff3d0 con 0x7fed6c100cf0 2024-08-01T07:07:34.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.734+0000 7fed7446f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c0ff540 con 0x7fed6c101610 2024-08-01T07:07:34.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.735+0000 7fed7220b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed6c100cf0 0x7fed6c0fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:34.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.735+0000 7fed7220b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed6c100cf0 0x7fed6c0fe950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33104/0 (socket says 172.21.15.16:33104) 2024-08-01T07:07:34.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.735+0000 7fed7220b640 1 -- 172.21.15.16:0/643494910 learned_addr learned my addr 172.21.15.16:0/643494910 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:07:34.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.735+0000 7fed71a0a640 1 --2- 172.21.15.16:0/643494910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed6c101610 0x7fed6c0fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:34.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.735+0000 7fed7220b640 1 -- 172.21.15.16:0/643494910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed6c101610 msgr2=0x7fed6c0fee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:34.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.735+0000 7fed7220b640 1 --2- 172.21.15.16:0/643494910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed6c101610 0x7fed6c0fee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:34.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.735+0000 7fed7220b640 1 -- 172.21.15.16:0/643494910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c009560 con 0x7fed6c100cf0 2024-08-01T07:07:34.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.735+0000 7fed7220b640 1 --2- 172.21.15.16:0/643494910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed6c100cf0 0x7fed6c0fe950 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fed6800d8d0 tx=0x7fed6800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:34.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.735+0000 7fed637fe640 1 -- 172.21.15.16:0/643494910 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed6800bea0 con 0x7fed6c100cf0 2024-08-01T07:07:34.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.735+0000 7fed637fe640 1 -- 172.21.15.16:0/643494910 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed68009c00 con 0x7fed6c100cf0 2024-08-01T07:07:34.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.735+0000 7fed7446f640 1 -- 172.21.15.16:0/643494910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6c1a1ce0 con 0x7fed6c100cf0 2024-08-01T07:07:34.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.735+0000 7fed637fe640 1 -- 172.21.15.16:0/643494910 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed6800f710 con 0x7fed6c100cf0 2024-08-01T07:07:34.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.735+0000 7fed7446f640 1 -- 172.21.15.16:0/643494910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6c1a2040 con 0x7fed6c100cf0 2024-08-01T07:07:34.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.736+0000 7fed7446f640 1 -- 172.21.15.16:0/643494910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6c068d30 con 0x7fed6c100cf0 2024-08-01T07:07:34.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.737+0000 7fed637fe640 1 -- 172.21.15.16:0/643494910 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fed68010460 con 0x7fed6c100cf0 2024-08-01T07:07:34.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.737+0000 7fed637fe640 1 --2- 172.21.15.16:0/643494910 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fed5806e170 0x7fed58070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:34.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.737+0000 7fed637fe640 1 -- 172.21.15.16:0/643494910 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fed6808dea0 con 0x7fed6c100cf0 2024-08-01T07:07:34.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.737+0000 7fed71a0a640 1 --2- 172.21.15.16:0/643494910 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fed5806e170 0x7fed58070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:34.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.738+0000 7fed71a0a640 1 --2- 172.21.15.16:0/643494910 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fed5806e170 0x7fed58070630 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009230 tx=0x7fed5c0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:34.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.742+0000 7fed637fe640 1 -- 172.21.15.16:0/643494910 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fed68057190 con 0x7fed6c100cf0 2024-08-01T07:07:34.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.990+0000 7fed7446f640 1 -- 172.21.15.16:0/643494910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fed6c10cdc0 con 0x7fed6c100cf0 2024-08-01T07:07:34.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.990+0000 7fed637fe640 1 -- 172.21.15.16:0/643494910 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7fed68017280 con 0x7fed6c100cf0 2024-08-01T07:07:34.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.992+0000 7fed7446f640 1 -- 172.21.15.16:0/643494910 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fed5806e170 msgr2=0x7fed58070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:34.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.992+0000 7fed7446f640 1 --2- 172.21.15.16:0/643494910 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fed5806e170 0x7fed58070630 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009230 tx=0x7fed5c0058d0 comp rx=0 tx=0).stop 2024-08-01T07:07:34.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.992+0000 7fed7446f640 1 -- 172.21.15.16:0/643494910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed6c100cf0 msgr2=0x7fed6c0fe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:34.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.992+0000 7fed7446f640 1 --2- 172.21.15.16:0/643494910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed6c100cf0 0x7fed6c0fe950 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fed6800d8d0 tx=0x7fed6800dd90 comp rx=0 tx=0).stop 2024-08-01T07:07:34.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.992+0000 7fed7446f640 1 -- 172.21.15.16:0/643494910 shutdown_connections 2024-08-01T07:07:34.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.992+0000 7fed7446f640 1 --2- 172.21.15.16:0/643494910 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fed5806e170 0x7fed58070630 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:34.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.992+0000 7fed7446f640 1 --2- 172.21.15.16:0/643494910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed6c101610 0x7fed6c0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:34.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.992+0000 7fed7446f640 1 --2- 172.21.15.16:0/643494910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed6c100cf0 0x7fed6c0fe950 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:34.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.992+0000 7fed7446f640 1 -- 172.21.15.16:0/643494910 >> 172.21.15.16:0/643494910 conn(0x7fed6c0fa710 msgr2=0x7fed6c101fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:34.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.992+0000 7fed7446f640 1 -- 172.21.15.16:0/643494910 shutdown_connections 2024-08-01T07:07:34.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:34.993+0000 7fed7446f640 1 -- 172.21.15.16:0/643494910 wait complete. 2024-08-01T07:07:35.003 INFO:teuthology.orchestra.run.smithi016.stdout:true 2024-08-01T07:07:35.305 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:34 smithi016 ceph-mon[93645]: pgmap v328: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:07:35.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:34 smithi089 ceph-mon[82218]: pgmap v328: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:07:35.626 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -e sha1=f9911e17b12222fbe598fff73cd3ad10d20c5776 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-08-01T07:07:35.839 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:07:36.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:35 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/643494910' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:07:36.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:35 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/643494910' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:07:37.382 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:36 smithi016 ceph-mon[93645]: pgmap v329: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:07:37.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:36 smithi089 ceph-mon[82218]: pgmap v329: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:07:37.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.749+0000 7f19de635640 1 -- 172.21.15.16:0/3814489162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19d80ffda0 msgr2=0x7f19d8100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:37.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.749+0000 7f19de635640 1 --2- 172.21.15.16:0/3814489162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19d80ffda0 0x7f19d8100180 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009880 tx=0x7f19c802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:07:37.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.749+0000 7f19de635640 1 -- 172.21.15.16:0/3814489162 shutdown_connections 2024-08-01T07:07:37.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.749+0000 7f19de635640 1 --2- 172.21.15.16:0/3814489162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19d8100750 0x7f19d81047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:37.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.749+0000 7f19de635640 1 --2- 172.21.15.16:0/3814489162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19d80ffda0 0x7f19d8100180 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:37.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.749+0000 7f19de635640 1 -- 172.21.15.16:0/3814489162 >> 172.21.15.16:0/3814489162 conn(0x7f19d80fb840 msgr2=0x7f19d80fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:37.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.749+0000 7f19de635640 1 -- 172.21.15.16:0/3814489162 shutdown_connections 2024-08-01T07:07:37.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.749+0000 7f19de635640 1 -- 172.21.15.16:0/3814489162 wait complete. 2024-08-01T07:07:37.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.750+0000 7f19de635640 1 Processor -- start 2024-08-01T07:07:37.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.750+0000 7f19de635640 1 -- start start 2024-08-01T07:07:37.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.750+0000 7f19de635640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19d80ffda0 0x7f19d819b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:37.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.750+0000 7f19de635640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19d8100750 0x7f19d819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:37.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.750+0000 7f19de635640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d819c360 con 0x7f19d8100750 2024-08-01T07:07:37.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.750+0000 7f19de635640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d81958f0 con 0x7f19d80ffda0 2024-08-01T07:07:37.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.750+0000 7f19d77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19d8100750 0x7f19d819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:37.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.750+0000 7f19d77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19d8100750 0x7f19d819bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33114/0 (socket says 172.21.15.16:33114) 2024-08-01T07:07:37.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.750+0000 7f19d77fe640 1 -- 172.21.15.16:0/4141191289 learned_addr learned my addr 172.21.15.16:0/4141191289 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:07:37.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.750+0000 7f19d7fff640 1 --2- 172.21.15.16:0/4141191289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19d80ffda0 0x7f19d819b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:37.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.751+0000 7f19d77fe640 1 -- 172.21.15.16:0/4141191289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19d80ffda0 msgr2=0x7f19d819b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:37.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.751+0000 7f19d77fe640 1 --2- 172.21.15.16:0/4141191289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19d80ffda0 0x7f19d819b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:37.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.751+0000 7f19d77fe640 1 -- 172.21.15.16:0/4141191289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c8009560 con 0x7f19d8100750 2024-08-01T07:07:37.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.751+0000 7f19d7fff640 1 --2- 172.21.15.16:0/4141191289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19d80ffda0 0x7f19d819b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T07:07:37.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.751+0000 7f19d77fe640 1 --2- 172.21.15.16:0/4141191289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19d8100750 0x7f19d819bd40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00d8d0 tx=0x7f19cc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:37.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.751+0000 7f19d57fa640 1 -- 172.21.15.16:0/4141191289 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19cc00bea0 con 0x7f19d8100750 2024-08-01T07:07:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.751+0000 7f19d57fa640 1 -- 172.21.15.16:0/4141191289 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f19cc009c00 con 0x7f19d8100750 2024-08-01T07:07:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.751+0000 7f19de635640 1 -- 172.21.15.16:0/4141191289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d8195bd0 con 0x7f19d8100750 2024-08-01T07:07:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.751+0000 7f19d57fa640 1 -- 172.21.15.16:0/4141191289 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19cc00f710 con 0x7f19d8100750 2024-08-01T07:07:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.751+0000 7f19de635640 1 -- 172.21.15.16:0/4141191289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d8196120 con 0x7f19d8100750 2024-08-01T07:07:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.752+0000 7f19de635640 1 -- 172.21.15.16:0/4141191289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d8101280 con 0x7f19d8100750 2024-08-01T07:07:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.753+0000 7f19d57fa640 1 -- 172.21.15.16:0/4141191289 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f19cc00f990 con 0x7f19d8100750 2024-08-01T07:07:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.753+0000 7f19d57fa640 1 --2- 172.21.15.16:0/4141191289 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f19c006e170 0x7f19c0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.753+0000 7f19d57fa640 1 -- 172.21.15.16:0/4141191289 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f19cc08e040 con 0x7f19d8100750 2024-08-01T07:07:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.753+0000 7f19d7fff640 1 --2- 172.21.15.16:0/4141191289 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f19c006e170 0x7f19c0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.754+0000 7f19d7fff640 1 --2- 172.21.15.16:0/4141191289 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f19c006e170 0x7f19c0070630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f19c8000c00 tx=0x7f19c8005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:37.758+0000 7f19d57fa640 1 -- 172.21.15.16:0/4141191289 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f19cc057200 con 0x7f19d8100750 2024-08-01T07:07:38.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:38.008+0000 7f19de635640 1 -- 172.21.15.16:0/4141191289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f19d81080b0 con 0x7f19d8100750 2024-08-01T07:07:38.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:38.008+0000 7f19d57fa640 1 -- 172.21.15.16:0/4141191289 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f19cc05a8c0 con 0x7f19d8100750 2024-08-01T07:07:38.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:38.010+0000 7f19de635640 1 -- 172.21.15.16:0/4141191289 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f19c006e170 msgr2=0x7f19c0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:38.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:38.010+0000 7f19de635640 1 --2- 172.21.15.16:0/4141191289 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f19c006e170 0x7f19c0070630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f19c8000c00 tx=0x7f19c8005a20 comp rx=0 tx=0).stop 2024-08-01T07:07:38.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:38.010+0000 7f19de635640 1 -- 172.21.15.16:0/4141191289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19d8100750 msgr2=0x7f19d819bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:38.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:38.010+0000 7f19de635640 1 --2- 172.21.15.16:0/4141191289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19d8100750 0x7f19d819bd40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00d8d0 tx=0x7f19cc00dd90 comp rx=0 tx=0).stop 2024-08-01T07:07:38.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:38.010+0000 7f19de635640 1 -- 172.21.15.16:0/4141191289 shutdown_connections 2024-08-01T07:07:38.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:38.010+0000 7f19de635640 1 --2- 172.21.15.16:0/4141191289 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f19c006e170 0x7f19c0070630 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:38.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:38.010+0000 7f19de635640 1 --2- 172.21.15.16:0/4141191289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19d8100750 0x7f19d819bd40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:38.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:38.010+0000 7f19de635640 1 --2- 172.21.15.16:0/4141191289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19d80ffda0 0x7f19d819b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:38.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:38.010+0000 7f19de635640 1 -- 172.21.15.16:0/4141191289 >> 172.21.15.16:0/4141191289 conn(0x7f19d80fb840 msgr2=0x7f19d80fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:38.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:38.010+0000 7f19de635640 1 -- 172.21.15.16:0/4141191289 shutdown_connections 2024-08-01T07:07:38.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:38.010+0000 7f19de635640 1 -- 172.21.15.16:0/4141191289 wait complete. 2024-08-01T07:07:38.021 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph version 19.1.0-1223-gf9911e17 (f9911e17b12222fbe598fff73cd3ad10d20c5776) squid (rc)" 2024-08-01T07:07:38.704 DEBUG:teuthology.parallel:result is None 2024-08-01T07:07:38.704 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-01T07:07:38.718 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi016.front.sepia.ceph.com 2024-08-01T07:07:38.718 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-01T07:07:38.936 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:07:39.301 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:38 smithi016 ceph-mon[93645]: pgmap v330: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:07:39.301 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:38 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/4141191289' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:07:39.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:38 smithi089 ceph-mon[82218]: pgmap v330: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:07:39.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:38 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/4141191289' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-01T07:07:40.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.519+0000 7f0b45bc1640 1 -- 172.21.15.16:0/3396805830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b400fea20 msgr2=0x7f0b400fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:40.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.519+0000 7f0b45bc1640 1 --2- 172.21.15.16:0/3396805830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b400fea20 0x7f0b400fee80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009880 tx=0x7f0b2802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:07:40.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.519+0000 7f0b45bc1640 1 -- 172.21.15.16:0/3396805830 shutdown_connections 2024-08-01T07:07:40.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.520+0000 7f0b45bc1640 1 --2- 172.21.15.16:0/3396805830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b400fea20 0x7f0b400fee80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:40.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.520+0000 7f0b45bc1640 1 --2- 172.21.15.16:0/3396805830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b40104a20 0x7f0b40104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:40.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.520+0000 7f0b45bc1640 1 -- 172.21.15.16:0/3396805830 >> 172.21.15.16:0/3396805830 conn(0x7f0b400fa700 msgr2=0x7f0b400fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:40.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.520+0000 7f0b45bc1640 1 -- 172.21.15.16:0/3396805830 shutdown_connections 2024-08-01T07:07:40.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.520+0000 7f0b45bc1640 1 -- 172.21.15.16:0/3396805830 wait complete. 2024-08-01T07:07:40.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.520+0000 7f0b45bc1640 1 Processor -- start 2024-08-01T07:07:40.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.520+0000 7f0b45bc1640 1 -- start start 2024-08-01T07:07:40.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.521+0000 7f0b45bc1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b400fea20 0x7f0b400fb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:40.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.521+0000 7f0b45bc1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b40104a20 0x7f0b400fb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:40.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.521+0000 7f0b45bc1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b400fba90 con 0x7f0b400fea20 2024-08-01T07:07:40.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.521+0000 7f0b45bc1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b400fbc00 con 0x7f0b40104a20 2024-08-01T07:07:40.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.521+0000 7f0b3f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b400fea20 0x7f0b400fb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:40.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.521+0000 7f0b3f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b400fea20 0x7f0b400fb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43952/0 (socket says 172.21.15.16:43952) 2024-08-01T07:07:40.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.521+0000 7f0b3f7fe640 1 -- 172.21.15.16:0/2790566359 learned_addr learned my addr 172.21.15.16:0/2790566359 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:07:40.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.521+0000 7f0b36ffd640 1 --2- 172.21.15.16:0/2790566359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b40104a20 0x7f0b400fb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:40.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.521+0000 7f0b3f7fe640 1 -- 172.21.15.16:0/2790566359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b40104a20 msgr2=0x7f0b400fb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:40.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.521+0000 7f0b3f7fe640 1 --2- 172.21.15.16:0/2790566359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b40104a20 0x7f0b400fb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:40.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.521+0000 7f0b3f7fe640 1 -- 172.21.15.16:0/2790566359 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b28009560 con 0x7f0b400fea20 2024-08-01T07:07:40.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.521+0000 7f0b3f7fe640 1 --2- 172.21.15.16:0/2790566359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b400fea20 0x7f0b400fb010 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000c8f0 tx=0x7f0b3000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:40.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.521+0000 7f0b3d7fa640 1 -- 172.21.15.16:0/2790566359 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b30007b80 con 0x7f0b400fea20 2024-08-01T07:07:40.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.522+0000 7f0b45bc1640 1 -- 172.21.15.16:0/2790566359 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b401a1c80 con 0x7f0b400fea20 2024-08-01T07:07:40.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.522+0000 7f0b3d7fa640 1 -- 172.21.15.16:0/2790566359 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b300054e0 con 0x7f0b400fea20 2024-08-01T07:07:40.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.522+0000 7f0b3d7fa640 1 -- 172.21.15.16:0/2790566359 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b3000f450 con 0x7f0b400fea20 2024-08-01T07:07:40.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.522+0000 7f0b45bc1640 1 -- 172.21.15.16:0/2790566359 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b401a1fe0 con 0x7f0b400fea20 2024-08-01T07:07:40.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.523+0000 7f0b45bc1640 1 -- 172.21.15.16:0/2790566359 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b40100160 con 0x7f0b400fea20 2024-08-01T07:07:40.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.523+0000 7f0b3d7fa640 1 -- 172.21.15.16:0/2790566359 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0b30004f60 con 0x7f0b400fea20 2024-08-01T07:07:40.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.524+0000 7f0b3d7fa640 1 --2- 172.21.15.16:0/2790566359 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f0b2c06e170 0x7f0b2c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:40.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.524+0000 7f0b3d7fa640 1 -- 172.21.15.16:0/2790566359 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f0b3008e1b0 con 0x7f0b400fea20 2024-08-01T07:07:40.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.524+0000 7f0b36ffd640 1 --2- 172.21.15.16:0/2790566359 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f0b2c06e170 0x7f0b2c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:40.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.524+0000 7f0b36ffd640 1 --2- 172.21.15.16:0/2790566359 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f0b2c06e170 0x7f0b2c070630 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0b28000c00 tx=0x7f0b28005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:40.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.528+0000 7f0b3d7fa640 1 -- 172.21.15.16:0/2790566359 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0b300572d0 con 0x7f0b400fea20 2024-08-01T07:07:40.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.745+0000 7f0b45bc1640 1 -- 172.21.15.16:0/2790566359 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0b400fc5e0 con 0x7f0b400fea20 2024-08-01T07:07:40.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.746+0000 7f0b3d7fa640 1 -- 172.21.15.16:0/2790566359 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) v1 ==== 76+0+2000 (secure 0 0 0) 0x7f0b3005a990 con 0x7f0b400fea20 2024-08-01T07:07:40.747 INFO:teuthology.orchestra.run.smithi016.stdout:e38 2024-08-01T07:07:40.747 INFO:teuthology.orchestra.run.smithi016.stdout:btime 2024-08-01T07:04:11:596120+0000 2024-08-01T07:07:40.748 INFO:teuthology.orchestra.run.smithi016.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-01T07:07:40.748 INFO:teuthology.orchestra.run.smithi016.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-01T07:07:40.748 INFO:teuthology.orchestra.run.smithi016.stdout:legacy client fscid: 1 2024-08-01T07:07:40.748 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:07:40.748 INFO:teuthology.orchestra.run.smithi016.stdout:Filesystem 'cephfs' (1) 2024-08-01T07:07:40.748 INFO:teuthology.orchestra.run.smithi016.stdout:fs_name cephfs 2024-08-01T07:07:40.748 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 38 2024-08-01T07:07:40.748 INFO:teuthology.orchestra.run.smithi016.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-01T07:07:40.748 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-08-01T06:53:13.411160+0000 2024-08-01T07:07:40.748 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-08-01T07:04:11.596112+0000 2024-08-01T07:07:40.748 INFO:teuthology.orchestra.run.smithi016.stdout:tableserver 0 2024-08-01T07:07:40.748 INFO:teuthology.orchestra.run.smithi016.stdout:root 0 2024-08-01T07:07:40.748 INFO:teuthology.orchestra.run.smithi016.stdout:session_timeout 60 2024-08-01T07:07:40.748 INFO:teuthology.orchestra.run.smithi016.stdout:session_autoclose 300 2024-08-01T07:07:40.749 INFO:teuthology.orchestra.run.smithi016.stdout:max_file_size 1099511627776 2024-08-01T07:07:40.749 INFO:teuthology.orchestra.run.smithi016.stdout:max_xattr_size 65536 2024-08-01T07:07:40.749 INFO:teuthology.orchestra.run.smithi016.stdout:required_client_features {} 2024-08-01T07:07:40.749 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure 0 2024-08-01T07:07:40.749 INFO:teuthology.orchestra.run.smithi016.stdout:last_failure_osd_epoch 94 2024-08-01T07:07:40.749 INFO:teuthology.orchestra.run.smithi016.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-01T07:07:40.749 INFO:teuthology.orchestra.run.smithi016.stdout:max_mds 2 2024-08-01T07:07:40.749 INFO:teuthology.orchestra.run.smithi016.stdout:in 0,1 2024-08-01T07:07:40.749 INFO:teuthology.orchestra.run.smithi016.stdout:up {0=34414,1=34446} 2024-08-01T07:07:40.749 INFO:teuthology.orchestra.run.smithi016.stdout:failed 2024-08-01T07:07:40.749 INFO:teuthology.orchestra.run.smithi016.stdout:damaged 2024-08-01T07:07:40.749 INFO:teuthology.orchestra.run.smithi016.stdout:stopped 2024-08-01T07:07:40.750 INFO:teuthology.orchestra.run.smithi016.stdout:data_pools [3] 2024-08-01T07:07:40.750 INFO:teuthology.orchestra.run.smithi016.stdout:metadata_pool 2 2024-08-01T07:07:40.750 INFO:teuthology.orchestra.run.smithi016.stdout:inline_data disabled 2024-08-01T07:07:40.750 INFO:teuthology.orchestra.run.smithi016.stdout:balancer 2024-08-01T07:07:40.750 INFO:teuthology.orchestra.run.smithi016.stdout:bal_rank_mask -1 2024-08-01T07:07:40.750 INFO:teuthology.orchestra.run.smithi016.stdout:standby_count_wanted 1 2024-08-01T07:07:40.750 INFO:teuthology.orchestra.run.smithi016.stdout:qdb_cluster leader: 34414 members: 34446,34414 2024-08-01T07:07:40.750 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.bgqkxu{0:34414} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.16:6826/4064792079,v1:172.21.15.16:6827/4064792079] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:07:40.750 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.jhouje{0:44357} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6824/3335707325,v1:172.21.15.89:6825/3335707325] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:07:40.750 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi016.fziqod{1:34446} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.16:6828/2186852070,v1:172.21.15.16:6829/2186852070] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:07:40.750 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.cephfs.smithi089.xanuld{1:44387} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/885893699,v1:172.21.15.89:6827/885893699] compat {c=[1],r=[1],i=[1fff]}] 2024-08-01T07:07:40.750 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:07:40.750 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:07:40.751 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 38 2024-08-01T07:07:40.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.748+0000 7f0b45bc1640 1 -- 172.21.15.16:0/2790566359 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f0b2c06e170 msgr2=0x7f0b2c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:40.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.748+0000 7f0b45bc1640 1 --2- 172.21.15.16:0/2790566359 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f0b2c06e170 0x7f0b2c070630 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0b28000c00 tx=0x7f0b28005a20 comp rx=0 tx=0).stop 2024-08-01T07:07:40.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.748+0000 7f0b45bc1640 1 -- 172.21.15.16:0/2790566359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b400fea20 msgr2=0x7f0b400fb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:40.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.748+0000 7f0b45bc1640 1 --2- 172.21.15.16:0/2790566359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b400fea20 0x7f0b400fb010 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000c8f0 tx=0x7f0b3000cdb0 comp rx=0 tx=0).stop 2024-08-01T07:07:40.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.748+0000 7f0b45bc1640 1 -- 172.21.15.16:0/2790566359 shutdown_connections 2024-08-01T07:07:40.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.748+0000 7f0b45bc1640 1 --2- 172.21.15.16:0/2790566359 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f0b2c06e170 0x7f0b2c070630 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:40.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.748+0000 7f0b45bc1640 1 --2- 172.21.15.16:0/2790566359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b40104a20 0x7f0b400fb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:40.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.748+0000 7f0b45bc1640 1 --2- 172.21.15.16:0/2790566359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b400fea20 0x7f0b400fb010 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:40.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.748+0000 7f0b45bc1640 1 -- 172.21.15.16:0/2790566359 >> 172.21.15.16:0/2790566359 conn(0x7f0b400fa700 msgr2=0x7f0b40068c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:40.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.748+0000 7f0b45bc1640 1 -- 172.21.15.16:0/2790566359 shutdown_connections 2024-08-01T07:07:40.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:40.748+0000 7f0b45bc1640 1 -- 172.21.15.16:0/2790566359 wait complete. 2024-08-01T07:07:41.327 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:40 smithi016 ceph-mon[93645]: pgmap v331: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:07:41.327 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:40 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2790566359' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:07:41.380 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-08-01T07:07:41.393 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-01T07:07:41.393 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:40 smithi089 ceph-mon[82218]: pgmap v331: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:07:41.394 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:40 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2790566359' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-01T07:07:41.611 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:07:43.242 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:43 smithi016 ceph-mon[93645]: pgmap v332: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:07:43.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:43 smithi089 ceph-mon[82218]: pgmap v332: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:07:43.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.458+0000 7f74929ea640 1 -- 172.21.15.16:0/1220389731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f748c0fe9f0 msgr2=0x7f748c0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:43.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.458+0000 7f74929ea640 1 --2- 172.21.15.16:0/1220389731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f748c0fe9f0 0x7f748c0fee50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7474009880 tx=0x7f747402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:07:43.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.458+0000 7f74929ea640 1 -- 172.21.15.16:0/1220389731 shutdown_connections 2024-08-01T07:07:43.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.458+0000 7f74929ea640 1 --2- 172.21.15.16:0/1220389731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f748c0fe9f0 0x7f748c0fee50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:43.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.458+0000 7f74929ea640 1 --2- 172.21.15.16:0/1220389731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f748c1049f0 0x7f748c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:43.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.458+0000 7f74929ea640 1 -- 172.21.15.16:0/1220389731 >> 172.21.15.16:0/1220389731 conn(0x7f748c0758a0 msgr2=0x7f748c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:43.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.458+0000 7f74929ea640 1 -- 172.21.15.16:0/1220389731 shutdown_connections 2024-08-01T07:07:43.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.458+0000 7f74929ea640 1 -- 172.21.15.16:0/1220389731 wait complete. 2024-08-01T07:07:43.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.459+0000 7f74929ea640 1 Processor -- start 2024-08-01T07:07:43.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.459+0000 7f74929ea640 1 -- start start 2024-08-01T07:07:43.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.459+0000 7f74929ea640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f748c0fe9f0 0x7f748c196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:43.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.459+0000 7f74929ea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f748c1049f0 0x7f748c196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:43.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.459+0000 7f74929ea640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c1973a0 con 0x7f748c0fe9f0 2024-08-01T07:07:43.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.459+0000 7f74929ea640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c197510 con 0x7f748c1049f0 2024-08-01T07:07:43.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.459+0000 7f748bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f748c0fe9f0 0x7f748c196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:43.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.459+0000 7f748bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f748c0fe9f0 0x7f748c196920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43968/0 (socket says 172.21.15.16:43968) 2024-08-01T07:07:43.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.459+0000 7f748bfff640 1 -- 172.21.15.16:0/777674694 learned_addr learned my addr 172.21.15.16:0/777674694 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:07:43.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.460+0000 7f748bfff640 1 -- 172.21.15.16:0/777674694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f748c1049f0 msgr2=0x7f748c196e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:43.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.460+0000 7f7483fff640 1 --2- 172.21.15.16:0/777674694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f748c1049f0 0x7f748c196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:43.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.460+0000 7f748bfff640 1 --2- 172.21.15.16:0/777674694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f748c1049f0 0x7f748c196e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:43.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.460+0000 7f748bfff640 1 -- 172.21.15.16:0/777674694 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7474009560 con 0x7f748c0fe9f0 2024-08-01T07:07:43.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.460+0000 7f748bfff640 1 --2- 172.21.15.16:0/777674694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f748c0fe9f0 0x7f748c196920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f747c00c8a0 tx=0x7f747c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:43.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.460+0000 7f7489ffb640 1 -- 172.21.15.16:0/777674694 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f747c007b80 con 0x7f748c0fe9f0 2024-08-01T07:07:43.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.460+0000 7f7489ffb640 1 -- 172.21.15.16:0/777674694 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f747c007ce0 con 0x7f748c0fe9f0 2024-08-01T07:07:43.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.460+0000 7f74929ea640 1 -- 172.21.15.16:0/777674694 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748c19f990 con 0x7f748c0fe9f0 2024-08-01T07:07:43.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.460+0000 7f7489ffb640 1 -- 172.21.15.16:0/777674694 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f747c018810 con 0x7f748c0fe9f0 2024-08-01T07:07:43.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.460+0000 7f74929ea640 1 -- 172.21.15.16:0/777674694 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748c19fd40 con 0x7f748c0fe9f0 2024-08-01T07:07:43.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.461+0000 7f74929ea640 1 -- 172.21.15.16:0/777674694 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748c100130 con 0x7f748c0fe9f0 2024-08-01T07:07:43.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.462+0000 7f7489ffb640 1 -- 172.21.15.16:0/777674694 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f747c018970 con 0x7f748c0fe9f0 2024-08-01T07:07:43.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.462+0000 7f7489ffb640 1 --2- 172.21.15.16:0/777674694 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f747806e180 0x7f7478070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:43.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.462+0000 7f7489ffb640 1 -- 172.21.15.16:0/777674694 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f747c08e410 con 0x7f748c0fe9f0 2024-08-01T07:07:43.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.462+0000 7f7483fff640 1 --2- 172.21.15.16:0/777674694 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f747806e180 0x7f7478070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:43.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.463+0000 7f7483fff640 1 --2- 172.21.15.16:0/777674694 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f747806e180 0x7f7478070640 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7474006010 tx=0x7f7474000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:43.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.467+0000 7f7489ffb640 1 -- 172.21.15.16:0/777674694 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f747c057650 con 0x7f748c0fe9f0 2024-08-01T07:07:43.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.681+0000 7f74929ea640 1 -- 172.21.15.16:0/777674694 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f748c1976d0 con 0x7f748c0fe9f0 2024-08-01T07:07:43.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.682+0000 7f7489ffb640 1 -- 172.21.15.16:0/777674694 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+5284 (secure 0 0 0) 0x7f747c05ad10 con 0x7f748c0fe9f0 2024-08-01T07:07:43.684 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:07:43.684 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":38,"btime":"2024-08-01T07:04:11:596120+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T07:04:11.596112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34414,"mds_1":34446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34414":{"gid":34414,"name":"cephfs.smithi016.bgqkxu","rank":0,"incarnation":27,"state":"up:active","state_seq":9,"addr":"172.21.15.16:6827/4064792079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":4064792079},{"type":"v1","addr":"172.21.15.16:6827","nonce":4064792079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34446":{"gid":34446,"name":"cephfs.smithi016.fziqod","rank":1,"incarnation":36,"state":"up:active","state_seq":11,"addr":"172.21.15.16:6829/2186852070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2186852070},{"type":"v1","addr":"172.21.15.16:6829","nonce":2186852070}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44357":{"gid":44357,"name":"cephfs.smithi089.jhouje","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6825/3335707325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3335707325},{"type":"v1","addr":"172.21.15.89:6825","nonce":3335707325}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44387":{"gid":44387,"name":"cephfs.smithi089.xanuld","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6827/885893699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":885893699},{"type":"v1","addr":"172.21.15.89:6827","nonce":885893699}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34414,"qdb_cluster":[34446,34414]},"id":1}]} 2024-08-01T07:07:43.684 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 38 2024-08-01T07:07:43.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.684+0000 7f74929ea640 1 -- 172.21.15.16:0/777674694 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f747806e180 msgr2=0x7f7478070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:43.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.684+0000 7f74929ea640 1 --2- 172.21.15.16:0/777674694 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f747806e180 0x7f7478070640 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7474006010 tx=0x7f7474000bc0 comp rx=0 tx=0).stop 2024-08-01T07:07:43.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.684+0000 7f74929ea640 1 -- 172.21.15.16:0/777674694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f748c0fe9f0 msgr2=0x7f748c196920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:43.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.684+0000 7f74929ea640 1 --2- 172.21.15.16:0/777674694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f748c0fe9f0 0x7f748c196920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f747c00c8a0 tx=0x7f747c00cd60 comp rx=0 tx=0).stop 2024-08-01T07:07:43.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.684+0000 7f74929ea640 1 -- 172.21.15.16:0/777674694 shutdown_connections 2024-08-01T07:07:43.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.684+0000 7f74929ea640 1 --2- 172.21.15.16:0/777674694 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f747806e180 0x7f7478070640 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:43.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.684+0000 7f74929ea640 1 --2- 172.21.15.16:0/777674694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f748c1049f0 0x7f748c196e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:43.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.684+0000 7f74929ea640 1 --2- 172.21.15.16:0/777674694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f748c0fe9f0 0x7f748c196920 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:43.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.684+0000 7f74929ea640 1 -- 172.21.15.16:0/777674694 >> 172.21.15.16:0/777674694 conn(0x7f748c0758a0 msgr2=0x7f748c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:43.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.684+0000 7f74929ea640 1 -- 172.21.15.16:0/777674694 shutdown_connections 2024-08-01T07:07:43.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:43.684+0000 7f74929ea640 1 -- 172.21.15.16:0/777674694 wait complete. 2024-08-01T07:07:44.306 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:44 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/777674694' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-01T07:07:44.330 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 19, 'max_mds': 2, 'flags': 50} 2024-08-01T07:07:44.330 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 20 2024-08-01T07:07:44.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:44 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/777674694' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-01T07:07:44.554 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:07:45.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:45 smithi089 ceph-mon[82218]: pgmap v333: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:07:45.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:45 smithi016 ceph-mon[93645]: pgmap v333: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:07:46.137 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:46 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:07:46.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.225+0000 7f6fb98fe640 1 -- 172.21.15.16:0/1762013270 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fb41049f0 msgr2=0x7f6fb4104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:46.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.225+0000 7f6fb98fe640 1 --2- 172.21.15.16:0/1762013270 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fb41049f0 0x7f6fb4104dd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4009880 tx=0x7f6fa402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:07:46.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.225+0000 7f6fb98fe640 1 -- 172.21.15.16:0/1762013270 shutdown_connections 2024-08-01T07:07:46.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.225+0000 7f6fb98fe640 1 --2- 172.21.15.16:0/1762013270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fb40fe9f0 0x7f6fb40fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:46.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.225+0000 7f6fb98fe640 1 --2- 172.21.15.16:0/1762013270 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fb41049f0 0x7f6fb4104dd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:46.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.225+0000 7f6fb98fe640 1 -- 172.21.15.16:0/1762013270 >> 172.21.15.16:0/1762013270 conn(0x7f6fb40758a0 msgr2=0x7f6fb40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:46.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.225+0000 7f6fb98fe640 1 -- 172.21.15.16:0/1762013270 shutdown_connections 2024-08-01T07:07:46.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.226+0000 7f6fb98fe640 1 -- 172.21.15.16:0/1762013270 wait complete. 2024-08-01T07:07:46.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.226+0000 7f6fb98fe640 1 Processor -- start 2024-08-01T07:07:46.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.226+0000 7f6fb98fe640 1 -- start start 2024-08-01T07:07:46.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.226+0000 7f6fb98fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fb40fe9f0 0x7f6fb40fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:46.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.226+0000 7f6fb98fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fb41049f0 0x7f6fb40fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:46.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.226+0000 7f6fb98fe640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb40fb800 con 0x7f6fb40fe9f0 2024-08-01T07:07:46.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.226+0000 7f6fb98fe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb40fb940 con 0x7f6fb41049f0 2024-08-01T07:07:46.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.227+0000 7f6fb2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fb40fe9f0 0x7f6fb40fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:46.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.227+0000 7f6fb2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fb40fe9f0 0x7f6fb40fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43980/0 (socket says 172.21.15.16:43980) 2024-08-01T07:07:46.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.227+0000 7f6fb2ffd640 1 -- 172.21.15.16:0/2793955308 learned_addr learned my addr 172.21.15.16:0/2793955308 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:07:46.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.227+0000 7f6fb27fc640 1 --2- 172.21.15.16:0/2793955308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fb41049f0 0x7f6fb40fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:46.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.227+0000 7f6fb2ffd640 1 -- 172.21.15.16:0/2793955308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fb41049f0 msgr2=0x7f6fb40fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:46.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.227+0000 7f6fb2ffd640 1 --2- 172.21.15.16:0/2793955308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fb41049f0 0x7f6fb40fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:46.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.227+0000 7f6fb2ffd640 1 -- 172.21.15.16:0/2793955308 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa4009560 con 0x7f6fb40fe9f0 2024-08-01T07:07:46.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.227+0000 7f6fb2ffd640 1 --2- 172.21.15.16:0/2793955308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fb40fe9f0 0x7f6fb40fad80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6fa402a9c0 tx=0x7f6fa40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:46.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.227+0000 7f6fb88fc640 1 -- 172.21.15.16:0/2793955308 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fa40048d0 con 0x7f6fb40fe9f0 2024-08-01T07:07:46.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.227+0000 7f6fb88fc640 1 -- 172.21.15.16:0/2793955308 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6fa4031640 con 0x7f6fb40fe9f0 2024-08-01T07:07:46.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.227+0000 7f6fb98fe640 1 -- 172.21.15.16:0/2793955308 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb40fbbc0 con 0x7f6fb40fe9f0 2024-08-01T07:07:46.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.227+0000 7f6fb88fc640 1 -- 172.21.15.16:0/2793955308 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fa40038d0 con 0x7f6fb40fe9f0 2024-08-01T07:07:46.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.227+0000 7f6fb98fe640 1 -- 172.21.15.16:0/2793955308 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb41a2030 con 0x7f6fb40fe9f0 2024-08-01T07:07:46.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.228+0000 7f6fb98fe640 1 -- 172.21.15.16:0/2793955308 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb4100130 con 0x7f6fb40fe9f0 2024-08-01T07:07:46.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.229+0000 7f6fb88fc640 1 -- 172.21.15.16:0/2793955308 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6fa4004a30 con 0x7f6fb40fe9f0 2024-08-01T07:07:46.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.229+0000 7f6fb88fc640 1 --2- 172.21.15.16:0/2793955308 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f6f9c06e170 0x7f6f9c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:46.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.230+0000 7f6fb88fc640 1 -- 172.21.15.16:0/2793955308 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f6fa40af150 con 0x7f6fb40fe9f0 2024-08-01T07:07:46.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.230+0000 7f6fb27fc640 1 --2- 172.21.15.16:0/2793955308 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f6f9c06e170 0x7f6f9c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:46.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.230+0000 7f6fb27fc640 1 --2- 172.21.15.16:0/2793955308 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f6f9c06e170 0x7f6f9c070630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40fc880 tx=0x7f6fa8005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:46.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.234+0000 7f6fb88fc640 1 -- 172.21.15.16:0/2793955308 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6fa40783a0 con 0x7f6fb40fe9f0 2024-08-01T07:07:46.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:46 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:07:46.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.447+0000 7f6fb98fe640 1 -- 172.21.15.16:0/2793955308 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f6fb40fc350 con 0x7f6fb40fe9f0 2024-08-01T07:07:46.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.447+0000 7f6fb88fc640 1 -- 172.21.15.16:0/2793955308 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v38) v1 ==== 107+0+3373 (secure 0 0 0) 0x7f6fa4040d40 con 0x7f6fb40fe9f0 2024-08-01T07:07:46.449 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:07:46.449 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"btime":"2024-08-01T07:02:30:030904+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T07:02:30.030901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14482,"mds_1":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14482":{"gid":14482,"name":"cephfs.smithi016.fziqod","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.16:6829/2984549955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2984549955},{"type":"v1","addr":"172.21.15.16:6829","nonce":2984549955}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24281":{"gid":24281,"name":"cephfs.smithi089.jhouje","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6825/1878606630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1878606630},{"type":"v1","addr":"172.21.15.89:6825","nonce":1878606630}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14482,"qdb_cluster":[14482,24281]},"id":1}]} 2024-08-01T07:07:46.450 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 20 2024-08-01T07:07:46.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.449+0000 7f6fb98fe640 1 -- 172.21.15.16:0/2793955308 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f6f9c06e170 msgr2=0x7f6f9c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:46.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.449+0000 7f6fb98fe640 1 --2- 172.21.15.16:0/2793955308 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f6f9c06e170 0x7f6f9c070630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40fc880 tx=0x7f6fa8005f90 comp rx=0 tx=0).stop 2024-08-01T07:07:46.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.449+0000 7f6fb98fe640 1 -- 172.21.15.16:0/2793955308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fb40fe9f0 msgr2=0x7f6fb40fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:46.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.449+0000 7f6fb98fe640 1 --2- 172.21.15.16:0/2793955308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fb40fe9f0 0x7f6fb40fad80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6fa402a9c0 tx=0x7f6fa40055a0 comp rx=0 tx=0).stop 2024-08-01T07:07:46.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.450+0000 7f6fb98fe640 1 -- 172.21.15.16:0/2793955308 shutdown_connections 2024-08-01T07:07:46.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.450+0000 7f6fb98fe640 1 --2- 172.21.15.16:0/2793955308 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f6f9c06e170 0x7f6f9c070630 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:46.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.450+0000 7f6fb98fe640 1 --2- 172.21.15.16:0/2793955308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fb41049f0 0x7f6fb40fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:46.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.450+0000 7f6fb98fe640 1 --2- 172.21.15.16:0/2793955308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fb40fe9f0 0x7f6fb40fad80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:46.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.450+0000 7f6fb98fe640 1 -- 172.21.15.16:0/2793955308 >> 172.21.15.16:0/2793955308 conn(0x7f6fb40758a0 msgr2=0x7f6fb40fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:46.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.450+0000 7f6fb98fe640 1 -- 172.21.15.16:0/2793955308 shutdown_connections 2024-08-01T07:07:46.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:46.450+0000 7f6fb98fe640 1 -- 172.21.15.16:0/2793955308 wait complete. 2024-08-01T07:07:47.040 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:47 smithi016 ceph-mon[93645]: pgmap v334: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:07:47.040 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:07:47.040 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:07:47.041 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:07:47.041 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:47 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2793955308' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-08-01T07:07:47.065 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-08-01T07:07:47.066 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 21 2024-08-01T07:07:47.294 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:07:47.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:47 smithi089 ceph-mon[82218]: pgmap v334: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:07:47.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:07:47.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:07:47.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:07:47.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:47 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2793955308' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-08-01T07:07:48.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:07:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:07:49.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.043+0000 7f4893c79640 1 -- 172.21.15.16:0/674518042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f488c0ffda0 msgr2=0x7f488c100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:49.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.043+0000 7f4893c79640 1 --2- 172.21.15.16:0/674518042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f488c0ffda0 0x7f488c100180 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4888009880 tx=0x7f488802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:07:49.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.043+0000 7f4893c79640 1 -- 172.21.15.16:0/674518042 shutdown_connections 2024-08-01T07:07:49.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.043+0000 7f4893c79640 1 --2- 172.21.15.16:0/674518042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f488c100750 0x7f488c1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:49.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.043+0000 7f4893c79640 1 --2- 172.21.15.16:0/674518042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f488c0ffda0 0x7f488c100180 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:49.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.043+0000 7f4893c79640 1 -- 172.21.15.16:0/674518042 >> 172.21.15.16:0/674518042 conn(0x7f488c0fb840 msgr2=0x7f488c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:49.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.043+0000 7f4893c79640 1 -- 172.21.15.16:0/674518042 shutdown_connections 2024-08-01T07:07:49.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.043+0000 7f4893c79640 1 -- 172.21.15.16:0/674518042 wait complete. 2024-08-01T07:07:49.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.043+0000 7f4893c79640 1 Processor -- start 2024-08-01T07:07:49.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.044+0000 7f4893c79640 1 -- start start 2024-08-01T07:07:49.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.044+0000 7f4893c79640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f488c0ffda0 0x7f488c19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:49.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.044+0000 7f4893c79640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f488c100750 0x7f488c19bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:49.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.044+0000 7f4893c79640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c195a10 con 0x7f488c100750 2024-08-01T07:07:49.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.044+0000 7f4893c79640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c195b50 con 0x7f488c0ffda0 2024-08-01T07:07:49.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.044+0000 7f4891214640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f488c100750 0x7f488c19bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:49.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.044+0000 7f4891214640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f488c100750 0x7f488c19bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41246/0 (socket says 172.21.15.16:41246) 2024-08-01T07:07:49.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.044+0000 7f4891214640 1 -- 172.21.15.16:0/4071027140 learned_addr learned my addr 172.21.15.16:0/4071027140 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:07:49.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.044+0000 7f4891a15640 1 --2- 172.21.15.16:0/4071027140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f488c0ffda0 0x7f488c19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:49.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.044+0000 7f4891214640 1 -- 172.21.15.16:0/4071027140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f488c0ffda0 msgr2=0x7f488c19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:49.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.044+0000 7f4891214640 1 --2- 172.21.15.16:0/4071027140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f488c0ffda0 0x7f488c19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:49.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.044+0000 7f4891214640 1 -- 172.21.15.16:0/4071027140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4888009560 con 0x7f488c100750 2024-08-01T07:07:49.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.044+0000 7f4891214640 1 --2- 172.21.15.16:0/4071027140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f488c100750 0x7f488c19bef0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f487c00e970 tx=0x7f487c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:49.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.045+0000 7f4882ffd640 1 -- 172.21.15.16:0/4071027140 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f487c00cc90 con 0x7f488c100750 2024-08-01T07:07:49.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.045+0000 7f4882ffd640 1 -- 172.21.15.16:0/4071027140 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f487c00cdf0 con 0x7f488c100750 2024-08-01T07:07:49.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.045+0000 7f4893c79640 1 -- 172.21.15.16:0/4071027140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488c195e30 con 0x7f488c100750 2024-08-01T07:07:49.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.045+0000 7f4882ffd640 1 -- 172.21.15.16:0/4071027140 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f487c010430 con 0x7f488c100750 2024-08-01T07:07:49.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.045+0000 7f4893c79640 1 -- 172.21.15.16:0/4071027140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488c196380 con 0x7f488c100750 2024-08-01T07:07:49.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.046+0000 7f4893c79640 1 -- 172.21.15.16:0/4071027140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488c101280 con 0x7f488c100750 2024-08-01T07:07:49.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.046+0000 7f4882ffd640 1 -- 172.21.15.16:0/4071027140 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f487c0046c0 con 0x7f488c100750 2024-08-01T07:07:49.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.047+0000 7f4882ffd640 1 --2- 172.21.15.16:0/4071027140 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f487806e170 0x7f4878070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:49.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.047+0000 7f4882ffd640 1 -- 172.21.15.16:0/4071027140 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f487c014070 con 0x7f488c100750 2024-08-01T07:07:49.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.047+0000 7f4891a15640 1 --2- 172.21.15.16:0/4071027140 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f487806e170 0x7f4878070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:49.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.047+0000 7f4891a15640 1 --2- 172.21.15.16:0/4071027140 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f487806e170 0x7f4878070630 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4888009230 tx=0x7f48880058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:49.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.051+0000 7f4882ffd640 1 -- 172.21.15.16:0/4071027140 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f487c0579d0 con 0x7f488c100750 2024-08-01T07:07:49.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:49 smithi016 ceph-mon[93645]: pgmap v335: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:07:49.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.264+0000 7f4893c79640 1 -- 172.21.15.16:0/4071027140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f488c196f70 con 0x7f488c100750 2024-08-01T07:07:49.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.264+0000 7f4882ffd640 1 -- 172.21.15.16:0/4071027140 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v38) v1 ==== 107+0+4926 (secure 0 0 0) 0x7f487c05b090 con 0x7f488c100750 2024-08-01T07:07:49.266 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:07:49.266 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"btime":"2024-08-01T07:02:30:562708+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44305,"name":"cephfs.smithi016.bgqkxu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6827/3015300025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3015300025},{"type":"v1","addr":"172.21.15.16:6827","nonce":3015300025}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44307,"name":"cephfs.smithi089.xanuld","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3851713020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3851713020},{"type":"v1","addr":"172.21.15.89:6827","nonce":3851713020}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T07:02:30.562705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14482,"mds_1":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14482":{"gid":14482,"name":"cephfs.smithi016.fziqod","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.16:6829/2984549955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2984549955},{"type":"v1","addr":"172.21.15.16:6829","nonce":2984549955}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24281":{"gid":24281,"name":"cephfs.smithi089.jhouje","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.89:6825/1878606630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1878606630},{"type":"v1","addr":"172.21.15.89:6825","nonce":1878606630}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14482,"qdb_cluster":[14482]},"id":1}]} 2024-08-01T07:07:49.266 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 21 2024-08-01T07:07:49.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.267+0000 7f4893c79640 1 -- 172.21.15.16:0/4071027140 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f487806e170 msgr2=0x7f4878070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:49.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.267+0000 7f4893c79640 1 --2- 172.21.15.16:0/4071027140 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f487806e170 0x7f4878070630 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4888009230 tx=0x7f48880058d0 comp rx=0 tx=0).stop 2024-08-01T07:07:49.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.267+0000 7f4893c79640 1 -- 172.21.15.16:0/4071027140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f488c100750 msgr2=0x7f488c19bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:49.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.267+0000 7f4893c79640 1 --2- 172.21.15.16:0/4071027140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f488c100750 0x7f488c19bef0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f487c00e970 tx=0x7f487c00ed70 comp rx=0 tx=0).stop 2024-08-01T07:07:49.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.267+0000 7f4893c79640 1 -- 172.21.15.16:0/4071027140 shutdown_connections 2024-08-01T07:07:49.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.267+0000 7f4893c79640 1 --2- 172.21.15.16:0/4071027140 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f487806e170 0x7f4878070630 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:49.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.267+0000 7f4893c79640 1 --2- 172.21.15.16:0/4071027140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f488c100750 0x7f488c19bef0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:49.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.267+0000 7f4893c79640 1 --2- 172.21.15.16:0/4071027140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f488c0ffda0 0x7f488c19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:49.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.267+0000 7f4893c79640 1 -- 172.21.15.16:0/4071027140 >> 172.21.15.16:0/4071027140 conn(0x7f488c0fb840 msgr2=0x7f488c0fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:49.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.267+0000 7f4893c79640 1 -- 172.21.15.16:0/4071027140 shutdown_connections 2024-08-01T07:07:49.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:49.267+0000 7f4893c79640 1 -- 172.21.15.16:0/4071027140 wait complete. 2024-08-01T07:07:49.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:49 smithi089 ceph-mon[82218]: pgmap v335: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:07:49.891 DEBUG:tasks.fs:max_mds reduced in epoch 21 2024-08-01T07:07:49.891 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-08-01T07:07:49.891 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 22 2024-08-01T07:07:50.109 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:07:50.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:50 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/4071027140' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-08-01T07:07:50.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:50 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/4071027140' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-08-01T07:07:51.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:51 smithi089 ceph-mon[82218]: pgmap v336: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-08-01T07:07:51.395 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:51 smithi016 ceph-mon[93645]: pgmap v336: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-08-01T07:07:51.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.765+0000 7f1374886640 1 -- 172.21.15.16:0/373108977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1370100c60 msgr2=0x7f1370101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:51.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.765+0000 7f1374886640 1 --2- 172.21.15.16:0/373108977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1370100c60 0x7f1370101040 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f13600098b0 tx=0x7f136002a4d0 comp rx=0 tx=0).stop 2024-08-01T07:07:51.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.765+0000 7f1374886640 1 -- 172.21.15.16:0/373108977 shutdown_connections 2024-08-01T07:07:51.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.765+0000 7f1374886640 1 --2- 172.21.15.16:0/373108977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1370101610 0x7f1370109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:51.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.765+0000 7f1374886640 1 --2- 172.21.15.16:0/373108977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1370100c60 0x7f1370101040 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:51.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.765+0000 7f1374886640 1 -- 172.21.15.16:0/373108977 >> 172.21.15.16:0/373108977 conn(0x7f13700fa730 msgr2=0x7f13700fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:51.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.766+0000 7f1374886640 1 -- 172.21.15.16:0/373108977 shutdown_connections 2024-08-01T07:07:51.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.766+0000 7f1374886640 1 -- 172.21.15.16:0/373108977 wait complete. 2024-08-01T07:07:51.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.766+0000 7f1374886640 1 Processor -- start 2024-08-01T07:07:51.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.766+0000 7f1374886640 1 -- start start 2024-08-01T07:07:51.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.766+0000 7f1374886640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1370100c60 0x7f137019b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:51.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.766+0000 7f1374886640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1370101610 0x7f137019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:51.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.766+0000 7f1374886640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137019c380 con 0x7f1370101610 2024-08-01T07:07:51.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.767+0000 7f1374886640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1370195910 con 0x7f1370100c60 2024-08-01T07:07:51.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.767+0000 7f1367fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1370101610 0x7f137019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:51.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.767+0000 7f1367fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1370101610 0x7f137019bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41268/0 (socket says 172.21.15.16:41268) 2024-08-01T07:07:51.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.767+0000 7f1367fff640 1 -- 172.21.15.16:0/2199751082 learned_addr learned my addr 172.21.15.16:0/2199751082 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:07:51.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.767+0000 7f136e59c640 1 --2- 172.21.15.16:0/2199751082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1370100c60 0x7f137019b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:51.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.767+0000 7f1367fff640 1 -- 172.21.15.16:0/2199751082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1370100c60 msgr2=0x7f137019b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:51.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.767+0000 7f1367fff640 1 --2- 172.21.15.16:0/2199751082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1370100c60 0x7f137019b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:51.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.767+0000 7f1367fff640 1 -- 172.21.15.16:0/2199751082 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1360009560 con 0x7f1370101610 2024-08-01T07:07:51.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.767+0000 7f1367fff640 1 --2- 172.21.15.16:0/2199751082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1370101610 0x7f137019bd60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f135800e970 tx=0x7f135800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:51.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.767+0000 7f13677fe640 1 -- 172.21.15.16:0/2199751082 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f135800cc90 con 0x7f1370101610 2024-08-01T07:07:51.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.767+0000 7f1374886640 1 -- 172.21.15.16:0/2199751082 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1370195bf0 con 0x7f1370101610 2024-08-01T07:07:51.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.767+0000 7f13677fe640 1 -- 172.21.15.16:0/2199751082 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f135800cdf0 con 0x7f1370101610 2024-08-01T07:07:51.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.767+0000 7f13677fe640 1 -- 172.21.15.16:0/2199751082 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1358018810 con 0x7f1370101610 2024-08-01T07:07:51.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.767+0000 7f1374886640 1 -- 172.21.15.16:0/2199751082 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1370196140 con 0x7f1370101610 2024-08-01T07:07:51.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.768+0000 7f1374886640 1 -- 172.21.15.16:0/2199751082 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1370068d30 con 0x7f1370101610 2024-08-01T07:07:51.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.769+0000 7f13677fe640 1 -- 172.21.15.16:0/2199751082 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1358010c10 con 0x7f1370101610 2024-08-01T07:07:51.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.770+0000 7f13677fe640 1 --2- 172.21.15.16:0/2199751082 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f135c06e170 0x7f135c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:51.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.770+0000 7f136e59c640 1 --2- 172.21.15.16:0/2199751082 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f135c06e170 0x7f135c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:51.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.770+0000 7f13677fe640 1 -- 172.21.15.16:0/2199751082 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f1358014070 con 0x7f1370101610 2024-08-01T07:07:51.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.770+0000 7f136e59c640 1 --2- 172.21.15.16:0/2199751082 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f135c06e170 0x7f135c070630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1360009880 tx=0x7f13600058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:51.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.774+0000 7f13677fe640 1 -- 172.21.15.16:0/2199751082 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1358053df0 con 0x7f1370101610 2024-08-01T07:07:51.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.987+0000 7f1374886640 1 -- 172.21.15.16:0/2199751082 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f1370104380 con 0x7f1370101610 2024-08-01T07:07:51.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.987+0000 7f13677fe640 1 -- 172.21.15.16:0/2199751082 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v38) v1 ==== 107+0+4131 (secure 0 0 0) 0x7f135805b500 con 0x7f1370101610 2024-08-01T07:07:51.989 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:07:51.989 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"btime":"2024-08-01T07:02:56:120125+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44305,"name":"cephfs.smithi016.bgqkxu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6827/3015300025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3015300025},{"type":"v1","addr":"172.21.15.16:6827","nonce":3015300025}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44307,"name":"cephfs.smithi089.xanuld","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3851713020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3851713020},{"type":"v1","addr":"172.21.15.89:6827","nonce":3851713020}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T07:02:55.425341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14482},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14482":{"gid":14482,"name":"cephfs.smithi016.fziqod","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.16:6829/2984549955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2984549955},{"type":"v1","addr":"172.21.15.16:6829","nonce":2984549955}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14482,"qdb_cluster":[14482]},"id":1}]} 2024-08-01T07:07:51.989 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 22 2024-08-01T07:07:51.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.990+0000 7f1374886640 1 -- 172.21.15.16:0/2199751082 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f135c06e170 msgr2=0x7f135c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:51.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.990+0000 7f1374886640 1 --2- 172.21.15.16:0/2199751082 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f135c06e170 0x7f135c070630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1360009880 tx=0x7f13600058d0 comp rx=0 tx=0).stop 2024-08-01T07:07:51.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.990+0000 7f1374886640 1 -- 172.21.15.16:0/2199751082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1370101610 msgr2=0x7f137019bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:51.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.990+0000 7f1374886640 1 --2- 172.21.15.16:0/2199751082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1370101610 0x7f137019bd60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f135800e970 tx=0x7f135800ee30 comp rx=0 tx=0).stop 2024-08-01T07:07:51.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.990+0000 7f1374886640 1 -- 172.21.15.16:0/2199751082 shutdown_connections 2024-08-01T07:07:51.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.990+0000 7f1374886640 1 --2- 172.21.15.16:0/2199751082 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f135c06e170 0x7f135c070630 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:51.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.990+0000 7f1374886640 1 --2- 172.21.15.16:0/2199751082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1370101610 0x7f137019bd60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:51.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.990+0000 7f1374886640 1 --2- 172.21.15.16:0/2199751082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1370100c60 0x7f137019b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:51.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.990+0000 7f1374886640 1 -- 172.21.15.16:0/2199751082 >> 172.21.15.16:0/2199751082 conn(0x7f13700fa730 msgr2=0x7f1370101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:51.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.990+0000 7f1374886640 1 -- 172.21.15.16:0/2199751082 shutdown_connections 2024-08-01T07:07:51.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:51.990+0000 7f1374886640 1 -- 172.21.15.16:0/2199751082 wait complete. 2024-08-01T07:07:52.355 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:52 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2199751082' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-08-01T07:07:52.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:52 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2199751082' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-08-01T07:07:52.636 DEBUG:tasks.fs:max_mds reduced in epoch 22 2024-08-01T07:07:52.637 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-08-01T07:07:52.637 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 23 2024-08-01T07:07:52.851 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:07:53.351 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:53 smithi016 ceph-mon[93645]: pgmap v337: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-01T07:07:53.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:53 smithi089 ceph-mon[82218]: pgmap v337: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-01T07:07:54.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.592+0000 7f13b5e2c640 1 -- 172.21.15.16:0/3848215711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13b00fe410 msgr2=0x7f13b00fe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:54.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.592+0000 7f13b5e2c640 1 --2- 172.21.15.16:0/3848215711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13b00fe410 0x7f13b00fe7f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f13a000a990 tx=0x7f13a002b7d0 comp rx=0 tx=0).stop 2024-08-01T07:07:54.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.592+0000 7f13b5e2c640 1 -- 172.21.15.16:0/3848215711 shutdown_connections 2024-08-01T07:07:54.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.592+0000 7f13b5e2c640 1 --2- 172.21.15.16:0/3848215711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13b00fedc0 0x7f13b0102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:54.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.592+0000 7f13b5e2c640 1 --2- 172.21.15.16:0/3848215711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13b00fe410 0x7f13b00fe7f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:54.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.592+0000 7f13b5e2c640 1 -- 172.21.15.16:0/3848215711 >> 172.21.15.16:0/3848215711 conn(0x7f13b00f9e70 msgr2=0x7f13b00fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:54.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.592+0000 7f13b5e2c640 1 -- 172.21.15.16:0/3848215711 shutdown_connections 2024-08-01T07:07:54.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.592+0000 7f13b5e2c640 1 -- 172.21.15.16:0/3848215711 wait complete. 2024-08-01T07:07:54.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.593+0000 7f13b5e2c640 1 Processor -- start 2024-08-01T07:07:54.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.593+0000 7f13b5e2c640 1 -- start start 2024-08-01T07:07:54.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.593+0000 7f13b5e2c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13b00fe410 0x7f13b019b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:54.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.593+0000 7f13b5e2c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13b00fedc0 0x7f13b019bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:54.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.593+0000 7f13b5e2c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b019c340 con 0x7f13b00fedc0 2024-08-01T07:07:54.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.593+0000 7f13b5e2c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b01958d0 con 0x7f13b00fe410 2024-08-01T07:07:54.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.593+0000 7f13aeffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13b00fedc0 0x7f13b019bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:54.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.593+0000 7f13aeffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13b00fedc0 0x7f13b019bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41272/0 (socket says 172.21.15.16:41272) 2024-08-01T07:07:54.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.593+0000 7f13aeffd640 1 -- 172.21.15.16:0/1829793598 learned_addr learned my addr 172.21.15.16:0/1829793598 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:07:54.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.593+0000 7f13af7fe640 1 --2- 172.21.15.16:0/1829793598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13b00fe410 0x7f13b019b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:54.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.593+0000 7f13aeffd640 1 -- 172.21.15.16:0/1829793598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13b00fe410 msgr2=0x7f13b019b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:54.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.593+0000 7f13aeffd640 1 --2- 172.21.15.16:0/1829793598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13b00fe410 0x7f13b019b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:54.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.594+0000 7f13aeffd640 1 -- 172.21.15.16:0/1829793598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a000a670 con 0x7f13b00fedc0 2024-08-01T07:07:54.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.594+0000 7f13aeffd640 1 --2- 172.21.15.16:0/1829793598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13b00fedc0 0x7f13b019bd20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f13a400c8f0 tx=0x7f13a400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:54.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.594+0000 7f13acff9640 1 -- 172.21.15.16:0/1829793598 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13a4007b80 con 0x7f13b00fedc0 2024-08-01T07:07:54.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.594+0000 7f13b5e2c640 1 -- 172.21.15.16:0/1829793598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b0195bb0 con 0x7f13b00fedc0 2024-08-01T07:07:54.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.594+0000 7f13acff9640 1 -- 172.21.15.16:0/1829793598 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f13a40054e0 con 0x7f13b00fedc0 2024-08-01T07:07:54.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.594+0000 7f13acff9640 1 -- 172.21.15.16:0/1829793598 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13a400f450 con 0x7f13b00fedc0 2024-08-01T07:07:54.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.594+0000 7f13b5e2c640 1 -- 172.21.15.16:0/1829793598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b0196100 con 0x7f13b00fedc0 2024-08-01T07:07:54.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.595+0000 7f13b5e2c640 1 -- 172.21.15.16:0/1829793598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b00ff8f0 con 0x7f13b00fedc0 2024-08-01T07:07:54.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.595+0000 7f13acff9640 1 -- 172.21.15.16:0/1829793598 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f13a4004f60 con 0x7f13b00fedc0 2024-08-01T07:07:54.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.596+0000 7f13acff9640 1 --2- 172.21.15.16:0/1829793598 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f139806e170 0x7f1398070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:54.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.596+0000 7f13acff9640 1 -- 172.21.15.16:0/1829793598 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f13a408dfa0 con 0x7f13b00fedc0 2024-08-01T07:07:54.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.596+0000 7f13af7fe640 1 --2- 172.21.15.16:0/1829793598 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f139806e170 0x7f1398070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:54.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.597+0000 7f13af7fe640 1 --2- 172.21.15.16:0/1829793598 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f139806e170 0x7f1398070630 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f13a0006010 tx=0x7f13a0005d50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:54.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.600+0000 7f13acff9640 1 -- 172.21.15.16:0/1829793598 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f13a4057290 con 0x7f13b00fedc0 2024-08-01T07:07:54.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.813+0000 7f13b5e2c640 1 -- 172.21.15.16:0/1829793598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f13b00fe7f0 con 0x7f13b00fedc0 2024-08-01T07:07:54.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.813+0000 7f13acff9640 1 -- 172.21.15.16:0/1829793598 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v38) v1 ==== 107+0+4910 (secure 0 0 0) 0x7f13a401d090 con 0x7f13b00fedc0 2024-08-01T07:07:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:07:54.815 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":23,"btime":"2024-08-01T07:02:57:125561+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44305,"name":"cephfs.smithi016.bgqkxu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6827/3015300025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3015300025},{"type":"v1","addr":"172.21.15.16:6827","nonce":3015300025}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44307,"name":"cephfs.smithi089.xanuld","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3851713020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3851713020},{"type":"v1","addr":"172.21.15.89:6827","nonce":3851713020}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44311,"name":"cephfs.smithi089.jhouje","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6825/2498996985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2498996985},{"type":"v1","addr":"172.21.15.89:6825","nonce":2498996985}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T07:02:55.425341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14482},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14482":{"gid":14482,"name":"cephfs.smithi016.fziqod","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.16:6829/2984549955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2984549955},{"type":"v1","addr":"172.21.15.16:6829","nonce":2984549955}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14482,"qdb_cluster":[14482]},"id":1}]} 2024-08-01T07:07:54.816 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 23 2024-08-01T07:07:54.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.816+0000 7f13b5e2c640 1 -- 172.21.15.16:0/1829793598 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f139806e170 msgr2=0x7f1398070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:54.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.816+0000 7f13b5e2c640 1 --2- 172.21.15.16:0/1829793598 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f139806e170 0x7f1398070630 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f13a0006010 tx=0x7f13a0005d50 comp rx=0 tx=0).stop 2024-08-01T07:07:54.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.816+0000 7f13b5e2c640 1 -- 172.21.15.16:0/1829793598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13b00fedc0 msgr2=0x7f13b019bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:54.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.816+0000 7f13b5e2c640 1 --2- 172.21.15.16:0/1829793598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13b00fedc0 0x7f13b019bd20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f13a400c8f0 tx=0x7f13a400cdb0 comp rx=0 tx=0).stop 2024-08-01T07:07:54.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.817+0000 7f13b5e2c640 1 -- 172.21.15.16:0/1829793598 shutdown_connections 2024-08-01T07:07:54.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.817+0000 7f13b5e2c640 1 --2- 172.21.15.16:0/1829793598 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f139806e170 0x7f1398070630 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:54.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.817+0000 7f13b5e2c640 1 --2- 172.21.15.16:0/1829793598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13b00fedc0 0x7f13b019bd20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:54.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.817+0000 7f13b5e2c640 1 --2- 172.21.15.16:0/1829793598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13b00fe410 0x7f13b019b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:54.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.817+0000 7f13b5e2c640 1 -- 172.21.15.16:0/1829793598 >> 172.21.15.16:0/1829793598 conn(0x7f13b00f9e70 msgr2=0x7f13b00fb130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:54.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.817+0000 7f13b5e2c640 1 -- 172.21.15.16:0/1829793598 shutdown_connections 2024-08-01T07:07:54.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:54.817+0000 7f13b5e2c640 1 -- 172.21.15.16:0/1829793598 wait complete. 2024-08-01T07:07:55.068 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:55 smithi016 ceph-mon[93645]: pgmap v338: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-01T07:07:55.068 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:55 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/1829793598' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-08-01T07:07:55.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:55 smithi089 ceph-mon[82218]: pgmap v338: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-01T07:07:55.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:55 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/1829793598' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-08-01T07:07:55.435 DEBUG:tasks.fs:max_mds reduced in epoch 23 2024-08-01T07:07:55.435 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-08-01T07:07:55.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 24 2024-08-01T07:07:55.655 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:07:57.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.231+0000 7ff05cc8f640 1 -- 172.21.15.16:0/196575898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff058100750 msgr2=0x7ff0581047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:57.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.231+0000 7ff05cc8f640 1 --2- 172.21.15.16:0/196575898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff058100750 0x7ff0581047a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009880 tx=0x7ff04c02a4a0 comp rx=0 tx=0).stop 2024-08-01T07:07:57.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.231+0000 7ff05cc8f640 1 -- 172.21.15.16:0/196575898 shutdown_connections 2024-08-01T07:07:57.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.231+0000 7ff05cc8f640 1 --2- 172.21.15.16:0/196575898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff058100750 0x7ff0581047a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:57.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.231+0000 7ff05cc8f640 1 --2- 172.21.15.16:0/196575898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0580ffda0 0x7ff058100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:57.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.231+0000 7ff05cc8f640 1 -- 172.21.15.16:0/196575898 >> 172.21.15.16:0/196575898 conn(0x7ff0580fb840 msgr2=0x7ff0580fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:57.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.231+0000 7ff05cc8f640 1 -- 172.21.15.16:0/196575898 shutdown_connections 2024-08-01T07:07:57.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.231+0000 7ff05cc8f640 1 -- 172.21.15.16:0/196575898 wait complete. 2024-08-01T07:07:57.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.232+0000 7ff05cc8f640 1 Processor -- start 2024-08-01T07:07:57.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.232+0000 7ff05cc8f640 1 -- start start 2024-08-01T07:07:57.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.232+0000 7ff05cc8f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0580ffda0 0x7ff05819b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:57.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.232+0000 7ff05cc8f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff058100750 0x7ff05819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:57.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.232+0000 7ff05cc8f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05819c380 con 0x7ff0580ffda0 2024-08-01T07:07:57.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.232+0000 7ff05cc8f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff058195910 con 0x7ff058100750 2024-08-01T07:07:57.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.232+0000 7ff05659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0580ffda0 0x7ff05819b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:57.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.232+0000 7ff05659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0580ffda0 0x7ff05819b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41296/0 (socket says 172.21.15.16:41296) 2024-08-01T07:07:57.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.232+0000 7ff05659c640 1 -- 172.21.15.16:0/2647540995 learned_addr learned my addr 172.21.15.16:0/2647540995 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:07:57.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.232+0000 7ff055d9b640 1 --2- 172.21.15.16:0/2647540995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff058100750 0x7ff05819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:57.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.233+0000 7ff05659c640 1 -- 172.21.15.16:0/2647540995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff058100750 msgr2=0x7ff05819bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:57.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.233+0000 7ff05659c640 1 --2- 172.21.15.16:0/2647540995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff058100750 0x7ff05819bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:57.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.233+0000 7ff05659c640 1 -- 172.21.15.16:0/2647540995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c009560 con 0x7ff0580ffda0 2024-08-01T07:07:57.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.233+0000 7ff05659c640 1 --2- 172.21.15.16:0/2647540995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0580ffda0 0x7ff05819b820 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff04800d8d0 tx=0x7ff04800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:57.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.233+0000 7ff0477fe640 1 -- 172.21.15.16:0/2647540995 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff04800bea0 con 0x7ff0580ffda0 2024-08-01T07:07:57.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.233+0000 7ff0477fe640 1 -- 172.21.15.16:0/2647540995 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff048009c00 con 0x7ff0580ffda0 2024-08-01T07:07:57.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.233+0000 7ff05cc8f640 1 -- 172.21.15.16:0/2647540995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff058195bf0 con 0x7ff0580ffda0 2024-08-01T07:07:57.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.233+0000 7ff0477fe640 1 -- 172.21.15.16:0/2647540995 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff04800f710 con 0x7ff0580ffda0 2024-08-01T07:07:57.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.233+0000 7ff05cc8f640 1 -- 172.21.15.16:0/2647540995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff058196110 con 0x7ff0580ffda0 2024-08-01T07:07:57.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.234+0000 7ff05cc8f640 1 -- 172.21.15.16:0/2647540995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff058101280 con 0x7ff0580ffda0 2024-08-01T07:07:57.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.234+0000 7ff0477fe640 1 -- 172.21.15.16:0/2647540995 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff04800f990 con 0x7ff0580ffda0 2024-08-01T07:07:57.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.235+0000 7ff0477fe640 1 --2- 172.21.15.16:0/2647540995 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff04006e170 0x7ff040070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:07:57.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.235+0000 7ff0477fe640 1 -- 172.21.15.16:0/2647540995 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7ff04808e020 con 0x7ff0580ffda0 2024-08-01T07:07:57.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.235+0000 7ff055d9b640 1 --2- 172.21.15.16:0/2647540995 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff04006e170 0x7ff040070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:07:57.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.236+0000 7ff055d9b640 1 --2- 172.21.15.16:0/2647540995 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff04006e170 0x7ff040070630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff04c000c00 tx=0x7ff04c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:07:57.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.240+0000 7ff0477fe640 1 -- 172.21.15.16:0/2647540995 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff0480571e0 con 0x7ff0580ffda0 2024-08-01T07:07:57.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:57 smithi089 ceph-mon[82218]: pgmap v339: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 4 op/s 2024-08-01T07:07:57.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:57 smithi016 ceph-mon[93645]: pgmap v339: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 4 op/s 2024-08-01T07:07:57.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.452+0000 7ff05cc8f640 1 -- 172.21.15.16:0/2647540995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7ff058100180 con 0x7ff0580ffda0 2024-08-01T07:07:57.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.452+0000 7ff0477fe640 1 -- 172.21.15.16:0/2647540995 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v38) v1 ==== 107+0+4131 (secure 0 0 0) 0x7ff04805a8a0 con 0x7ff0580ffda0 2024-08-01T07:07:57.454 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:07:57.454 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":24,"btime":"2024-08-01T07:03:04:977760+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44307,"name":"cephfs.smithi089.xanuld","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3851713020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3851713020},{"type":"v1","addr":"172.21.15.89:6827","nonce":3851713020}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44311,"name":"cephfs.smithi089.jhouje","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6825/2498996985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2498996985},{"type":"v1","addr":"172.21.15.89:6825","nonce":2498996985}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T07:02:55.425341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14482},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14482":{"gid":14482,"name":"cephfs.smithi016.fziqod","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.16:6829/2984549955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2984549955},{"type":"v1","addr":"172.21.15.16:6829","nonce":2984549955}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14482,"qdb_cluster":[14482]},"id":1}]} 2024-08-01T07:07:57.454 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 24 2024-08-01T07:07:57.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.454+0000 7ff05cc8f640 1 -- 172.21.15.16:0/2647540995 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff04006e170 msgr2=0x7ff040070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:57.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.454+0000 7ff05cc8f640 1 --2- 172.21.15.16:0/2647540995 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff04006e170 0x7ff040070630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff04c000c00 tx=0x7ff04c005a20 comp rx=0 tx=0).stop 2024-08-01T07:07:57.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.454+0000 7ff05cc8f640 1 -- 172.21.15.16:0/2647540995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0580ffda0 msgr2=0x7ff05819b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:07:57.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.454+0000 7ff05cc8f640 1 --2- 172.21.15.16:0/2647540995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0580ffda0 0x7ff05819b820 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff04800d8d0 tx=0x7ff04800dd90 comp rx=0 tx=0).stop 2024-08-01T07:07:57.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.454+0000 7ff05cc8f640 1 -- 172.21.15.16:0/2647540995 shutdown_connections 2024-08-01T07:07:57.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.454+0000 7ff05cc8f640 1 --2- 172.21.15.16:0/2647540995 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7ff04006e170 0x7ff040070630 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:57.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.454+0000 7ff05cc8f640 1 --2- 172.21.15.16:0/2647540995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff058100750 0x7ff05819bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:57.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.454+0000 7ff05cc8f640 1 --2- 172.21.15.16:0/2647540995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0580ffda0 0x7ff05819b820 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:07:57.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.454+0000 7ff05cc8f640 1 -- 172.21.15.16:0/2647540995 >> 172.21.15.16:0/2647540995 conn(0x7ff0580fb840 msgr2=0x7ff0580fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:07:57.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.455+0000 7ff05cc8f640 1 -- 172.21.15.16:0/2647540995 shutdown_connections 2024-08-01T07:07:57.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:07:57.455+0000 7ff05cc8f640 1 -- 172.21.15.16:0/2647540995 wait complete. 2024-08-01T07:07:58.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:58 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2647540995' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-08-01T07:07:58.183 DEBUG:tasks.fs:max_mds reduced in epoch 24 2024-08-01T07:07:58.183 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-08-01T07:07:58.184 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 25 2024-08-01T07:07:58.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:58 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2647540995' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-08-01T07:07:58.401 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:07:59.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:07:59 smithi089 ceph-mon[82218]: pgmap v340: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-08-01T07:07:59.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:07:59 smithi016 ceph-mon[93645]: pgmap v340: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-08-01T07:08:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.023+0000 7fec91628640 1 -- 172.21.15.16:0/2943981531 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec8c1015c0 msgr2=0x7fec8c109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.023+0000 7fec91628640 1 --2- 172.21.15.16:0/2943981531 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec8c1015c0 0x7fec8c109ab0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fec80009880 tx=0x7fec8002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:08:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.023+0000 7fec91628640 1 -- 172.21.15.16:0/2943981531 shutdown_connections 2024-08-01T07:08:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.023+0000 7fec91628640 1 --2- 172.21.15.16:0/2943981531 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec8c1015c0 0x7fec8c109ab0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.023+0000 7fec91628640 1 --2- 172.21.15.16:0/2943981531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec8c100ca0 0x7fec8c101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.023+0000 7fec91628640 1 -- 172.21.15.16:0/2943981531 >> 172.21.15.16:0/2943981531 conn(0x7fec8c075830 msgr2=0x7fec8c0fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.023+0000 7fec91628640 1 -- 172.21.15.16:0/2943981531 shutdown_connections 2024-08-01T07:08:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.023+0000 7fec91628640 1 -- 172.21.15.16:0/2943981531 wait complete. 2024-08-01T07:08:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.023+0000 7fec91628640 1 Processor -- start 2024-08-01T07:08:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.024+0000 7fec91628640 1 -- start start 2024-08-01T07:08:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.024+0000 7fec91628640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec8c100ca0 0x7fec8c19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.024+0000 7fec91628640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec8c1015c0 0x7fec8c19be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.024+0000 7fec91628640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c19c4a0 con 0x7fec8c1015c0 2024-08-01T07:08:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.024+0000 7fec91628640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c195970 con 0x7fec8c100ca0 2024-08-01T07:08:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.024+0000 7fec8a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec8c1015c0 0x7fec8c19be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.024+0000 7fec8a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec8c1015c0 0x7fec8c19be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55116/0 (socket says 172.21.15.16:55116) 2024-08-01T07:08:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.024+0000 7fec8a7fc640 1 -- 172.21.15.16:0/1479632753 learned_addr learned my addr 172.21.15.16:0/1479632753 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:08:00.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.024+0000 7fec8affd640 1 --2- 172.21.15.16:0/1479632753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec8c100ca0 0x7fec8c19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:00.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.024+0000 7fec8a7fc640 1 -- 172.21.15.16:0/1479632753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec8c100ca0 msgr2=0x7fec8c19b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:00.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.024+0000 7fec8a7fc640 1 --2- 172.21.15.16:0/1479632753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec8c100ca0 0x7fec8c19b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:00.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.024+0000 7fec8a7fc640 1 -- 172.21.15.16:0/1479632753 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec80009560 con 0x7fec8c1015c0 2024-08-01T07:08:00.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.024+0000 7fec8affd640 1 --2- 172.21.15.16:0/1479632753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec8c100ca0 0x7fec8c19b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T07:08:00.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.025+0000 7fec8a7fc640 1 --2- 172.21.15.16:0/1479632753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec8c1015c0 0x7fec8c19be50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fec80005940 tx=0x7fec80032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:00.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.025+0000 7fec73fff640 1 -- 172.21.15.16:0/1479632753 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec80005220 con 0x7fec8c1015c0 2024-08-01T07:08:00.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.025+0000 7fec91628640 1 -- 172.21.15.16:0/1479632753 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8c195bf0 con 0x7fec8c1015c0 2024-08-01T07:08:00.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.025+0000 7fec73fff640 1 -- 172.21.15.16:0/1479632753 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec80005380 con 0x7fec8c1015c0 2024-08-01T07:08:00.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.025+0000 7fec73fff640 1 -- 172.21.15.16:0/1479632753 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec80003a50 con 0x7fec8c1015c0 2024-08-01T07:08:00.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.025+0000 7fec91628640 1 -- 172.21.15.16:0/1479632753 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec8c1960e0 con 0x7fec8c1015c0 2024-08-01T07:08:00.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.026+0000 7fec91628640 1 -- 172.21.15.16:0/1479632753 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec8c068440 con 0x7fec8c1015c0 2024-08-01T07:08:00.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.026+0000 7fec73fff640 1 -- 172.21.15.16:0/1479632753 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fec80003cc0 con 0x7fec8c1015c0 2024-08-01T07:08:00.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.027+0000 7fec73fff640 1 --2- 172.21.15.16:0/1479632753 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fec7406e170 0x7fec74070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:00.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.027+0000 7fec73fff640 1 -- 172.21.15.16:0/1479632753 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fec800af060 con 0x7fec8c1015c0 2024-08-01T07:08:00.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.027+0000 7fec8affd640 1 --2- 172.21.15.16:0/1479632753 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fec7406e170 0x7fec74070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:00.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.027+0000 7fec8affd640 1 --2- 172.21.15.16:0/1479632753 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fec7406e170 0x7fec74070630 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00abe0 tx=0x7fec7c00a5c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:00.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.031+0000 7fec73fff640 1 -- 172.21.15.16:0/1479632753 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fec80078180 con 0x7fec8c1015c0 2024-08-01T07:08:00.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.245+0000 7fec91628640 1 -- 172.21.15.16:0/1479632753 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7fec8c1041e0 con 0x7fec8c1015c0 2024-08-01T07:08:00.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.246+0000 7fec73fff640 1 -- 172.21.15.16:0/1479632753 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v38) v1 ==== 107+0+4978 (secure 0 0 0) 0x7fec8007b840 con 0x7fec8c1015c0 2024-08-01T07:08:00.247 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:08:00.247 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"btime":"2024-08-01T07:03:07:991108+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34414,"name":"cephfs.smithi016.bgqkxu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6827/4064792079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":4064792079},{"type":"v1","addr":"172.21.15.16:6827","nonce":4064792079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44307,"name":"cephfs.smithi089.xanuld","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3851713020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3851713020},{"type":"v1","addr":"172.21.15.89:6827","nonce":3851713020}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44311,"name":"cephfs.smithi089.jhouje","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6825/2498996985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2498996985},{"type":"v1","addr":"172.21.15.89:6825","nonce":2498996985}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T07:02:55.425341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14482},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14482":{"gid":14482,"name":"cephfs.smithi016.fziqod","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.16:6829/2984549955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2984549955},{"type":"v1","addr":"172.21.15.16:6829","nonce":2984549955}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14482,"qdb_cluster":[14482]},"id":1}]} 2024-08-01T07:08:00.248 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-08-01T07:08:00.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.248+0000 7fec91628640 1 -- 172.21.15.16:0/1479632753 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fec7406e170 msgr2=0x7fec74070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:00.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.248+0000 7fec91628640 1 --2- 172.21.15.16:0/1479632753 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fec7406e170 0x7fec74070630 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00abe0 tx=0x7fec7c00a5c0 comp rx=0 tx=0).stop 2024-08-01T07:08:00.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.248+0000 7fec91628640 1 -- 172.21.15.16:0/1479632753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec8c1015c0 msgr2=0x7fec8c19be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:00.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.248+0000 7fec91628640 1 --2- 172.21.15.16:0/1479632753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec8c1015c0 0x7fec8c19be50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fec80005940 tx=0x7fec80032bd0 comp rx=0 tx=0).stop 2024-08-01T07:08:00.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.248+0000 7fec91628640 1 -- 172.21.15.16:0/1479632753 shutdown_connections 2024-08-01T07:08:00.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.248+0000 7fec91628640 1 --2- 172.21.15.16:0/1479632753 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fec7406e170 0x7fec74070630 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:00.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.248+0000 7fec91628640 1 --2- 172.21.15.16:0/1479632753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec8c1015c0 0x7fec8c19be50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:00.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.248+0000 7fec91628640 1 --2- 172.21.15.16:0/1479632753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec8c100ca0 0x7fec8c19b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:00.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.248+0000 7fec91628640 1 -- 172.21.15.16:0/1479632753 >> 172.21.15.16:0/1479632753 conn(0x7fec8c075830 msgr2=0x7fec8c101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:00.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.248+0000 7fec91628640 1 -- 172.21.15.16:0/1479632753 shutdown_connections 2024-08-01T07:08:00.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:00.248+0000 7fec91628640 1 -- 172.21.15.16:0/1479632753 wait complete. 2024-08-01T07:08:00.884 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-08-01T07:08:00.884 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-08-01T07:08:00.884 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 26 2024-08-01T07:08:01.119 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:08:01.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:01 smithi016 ceph-mon[93645]: pgmap v341: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-08-01T07:08:01.150 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:01 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/1479632753' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-08-01T07:08:01.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:01 smithi089 ceph-mon[82218]: pgmap v341: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-08-01T07:08:01.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:01 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/1479632753' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-08-01T07:08:02.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.895+0000 7efc8c435640 1 -- 172.21.15.16:0/3624717037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc84100750 msgr2=0x7efc841047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:02.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.895+0000 7efc8c435640 1 --2- 172.21.15.16:0/3624717037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc84100750 0x7efc841047a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efc78009880 tx=0x7efc7802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:08:02.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.895+0000 7efc8c435640 1 -- 172.21.15.16:0/3624717037 shutdown_connections 2024-08-01T07:08:02.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.895+0000 7efc8c435640 1 --2- 172.21.15.16:0/3624717037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc84100750 0x7efc841047a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:02.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.895+0000 7efc8c435640 1 --2- 172.21.15.16:0/3624717037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc840ffda0 0x7efc84100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:02.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.895+0000 7efc8c435640 1 -- 172.21.15.16:0/3624717037 >> 172.21.15.16:0/3624717037 conn(0x7efc840fb840 msgr2=0x7efc840fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:02.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.895+0000 7efc8c435640 1 -- 172.21.15.16:0/3624717037 shutdown_connections 2024-08-01T07:08:02.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.896+0000 7efc8c435640 1 -- 172.21.15.16:0/3624717037 wait complete. 2024-08-01T07:08:02.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.896+0000 7efc8c435640 1 Processor -- start 2024-08-01T07:08:02.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.896+0000 7efc8c435640 1 -- start start 2024-08-01T07:08:02.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.896+0000 7efc8c435640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc840ffda0 0x7efc8419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:02.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.896+0000 7efc8c435640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc84100750 0x7efc8419be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:02.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.896+0000 7efc8c435640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc84195930 con 0x7efc84100750 2024-08-01T07:08:02.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.896+0000 7efc8c435640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc84195a70 con 0x7efc840ffda0 2024-08-01T07:08:02.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.896+0000 7efc899d0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc84100750 0x7efc8419be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:02.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.897+0000 7efc899d0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc84100750 0x7efc8419be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55134/0 (socket says 172.21.15.16:55134) 2024-08-01T07:08:02.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.897+0000 7efc899d0640 1 -- 172.21.15.16:0/1161675507 learned_addr learned my addr 172.21.15.16:0/1161675507 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:08:02.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.897+0000 7efc8a1d1640 1 --2- 172.21.15.16:0/1161675507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc840ffda0 0x7efc8419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:02.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.897+0000 7efc899d0640 1 -- 172.21.15.16:0/1161675507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc840ffda0 msgr2=0x7efc8419b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:02.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.897+0000 7efc899d0640 1 --2- 172.21.15.16:0/1161675507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc840ffda0 0x7efc8419b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:02.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.897+0000 7efc899d0640 1 -- 172.21.15.16:0/1161675507 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc78009560 con 0x7efc84100750 2024-08-01T07:08:02.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.897+0000 7efc8a1d1640 1 --2- 172.21.15.16:0/1161675507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc840ffda0 0x7efc8419b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T07:08:02.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.897+0000 7efc899d0640 1 --2- 172.21.15.16:0/1161675507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc84100750 0x7efc8419be10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efc7802a9c0 tx=0x7efc780055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:02.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.897+0000 7efc837fe640 1 -- 172.21.15.16:0/1161675507 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc78004aa0 con 0x7efc84100750 2024-08-01T07:08:02.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.897+0000 7efc837fe640 1 -- 172.21.15.16:0/1161675507 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc78004c00 con 0x7efc84100750 2024-08-01T07:08:02.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.897+0000 7efc837fe640 1 -- 172.21.15.16:0/1161675507 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc78003ab0 con 0x7efc84100750 2024-08-01T07:08:02.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.897+0000 7efc8c435640 1 -- 172.21.15.16:0/1161675507 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc84195cf0 con 0x7efc84100750 2024-08-01T07:08:02.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.897+0000 7efc8c435640 1 -- 172.21.15.16:0/1161675507 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc841961e0 con 0x7efc84100750 2024-08-01T07:08:02.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.898+0000 7efc8c435640 1 -- 172.21.15.16:0/1161675507 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc84101280 con 0x7efc84100750 2024-08-01T07:08:02.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.899+0000 7efc837fe640 1 -- 172.21.15.16:0/1161675507 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efc78031d20 con 0x7efc84100750 2024-08-01T07:08:02.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.899+0000 7efc837fe640 1 --2- 172.21.15.16:0/1161675507 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7efc6c06e170 0x7efc6c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:02.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.899+0000 7efc837fe640 1 -- 172.21.15.16:0/1161675507 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7efc780af2d0 con 0x7efc84100750 2024-08-01T07:08:02.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.899+0000 7efc8a1d1640 1 --2- 172.21.15.16:0/1161675507 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7efc6c06e170 0x7efc6c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:02.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.900+0000 7efc8a1d1640 1 --2- 172.21.15.16:0/1161675507 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7efc6c06e170 0x7efc6c070630 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efc74005c40 tx=0x7efc7400a410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:02.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:02.904+0000 7efc837fe640 1 -- 172.21.15.16:0/1161675507 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7efc78078510 con 0x7efc84100750 2024-08-01T07:08:03.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:03.118+0000 7efc8c435640 1 -- 172.21.15.16:0/1161675507 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7efc841080b0 con 0x7efc84100750 2024-08-01T07:08:03.120 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:03 smithi016 ceph-mon[93645]: pgmap v342: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:08:03.120 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:03 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:08:03.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:03.119+0000 7efc837fe640 1 -- 172.21.15.16:0/1161675507 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v38) v1 ==== 107+0+4180 (secure 0 0 0) 0x7efc7807bbd0 con 0x7efc84100750 2024-08-01T07:08:03.121 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:08:03.121 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"btime":"2024-08-01T07:03:20:061035+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34414,"name":"cephfs.smithi016.bgqkxu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6827/4064792079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":4064792079},{"type":"v1","addr":"172.21.15.16:6827","nonce":4064792079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44307,"name":"cephfs.smithi089.xanuld","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3851713020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3851713020},{"type":"v1","addr":"172.21.15.89:6827","nonce":3851713020}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44311,"name":"cephfs.smithi089.jhouje","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6825/2498996985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2498996985},{"type":"v1","addr":"172.21.15.89:6825","nonce":2498996985}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T07:03:20.061032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-01T07:08:03.121 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 26 2024-08-01T07:08:03.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:03.121+0000 7efc8c435640 1 -- 172.21.15.16:0/1161675507 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7efc6c06e170 msgr2=0x7efc6c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:03.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:03.121+0000 7efc8c435640 1 --2- 172.21.15.16:0/1161675507 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7efc6c06e170 0x7efc6c070630 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efc74005c40 tx=0x7efc7400a410 comp rx=0 tx=0).stop 2024-08-01T07:08:03.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:03.121+0000 7efc8c435640 1 -- 172.21.15.16:0/1161675507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc84100750 msgr2=0x7efc8419be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:03.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:03.121+0000 7efc8c435640 1 --2- 172.21.15.16:0/1161675507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc84100750 0x7efc8419be10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efc7802a9c0 tx=0x7efc780055a0 comp rx=0 tx=0).stop 2024-08-01T07:08:03.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:03.121+0000 7efc8c435640 1 -- 172.21.15.16:0/1161675507 shutdown_connections 2024-08-01T07:08:03.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:03.121+0000 7efc8c435640 1 --2- 172.21.15.16:0/1161675507 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7efc6c06e170 0x7efc6c070630 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:03.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:03.121+0000 7efc8c435640 1 --2- 172.21.15.16:0/1161675507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc84100750 0x7efc8419be10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:03.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:03.121+0000 7efc8c435640 1 --2- 172.21.15.16:0/1161675507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc840ffda0 0x7efc8419b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:03.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:03.121+0000 7efc8c435640 1 -- 172.21.15.16:0/1161675507 >> 172.21.15.16:0/1161675507 conn(0x7efc840fb840 msgr2=0x7efc840fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:03.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:03.121+0000 7efc8c435640 1 -- 172.21.15.16:0/1161675507 shutdown_connections 2024-08-01T07:08:03.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:03.121+0000 7efc8c435640 1 -- 172.21.15.16:0/1161675507 wait complete. 2024-08-01T07:08:03.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:03 smithi089 ceph-mon[82218]: pgmap v342: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:08:03.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:03 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:08:04.004 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-08-01T07:08:04.004 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-08-01T07:08:04.004 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 27 2024-08-01T07:08:04.227 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:08:04.349 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:04 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/1161675507' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-08-01T07:08:04.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:04 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/1161675507' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-08-01T07:08:05.366 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:05 smithi016 ceph-mon[93645]: pgmap v343: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:08:05.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:05 smithi089 ceph-mon[82218]: pgmap v343: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:08:05.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.812+0000 7f18aa6d0640 1 -- 172.21.15.16:0/1320353715 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18a40ffda0 msgr2=0x7f18a4100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:05.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.812+0000 7f18aa6d0640 1 --2- 172.21.15.16:0/1320353715 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18a40ffda0 0x7f18a4100180 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1894009880 tx=0x7f189402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:08:05.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.812+0000 7f18aa6d0640 1 -- 172.21.15.16:0/1320353715 shutdown_connections 2024-08-01T07:08:05.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.812+0000 7f18aa6d0640 1 --2- 172.21.15.16:0/1320353715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18a4100750 0x7f18a41047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:05.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.812+0000 7f18aa6d0640 1 --2- 172.21.15.16:0/1320353715 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18a40ffda0 0x7f18a4100180 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:05.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.812+0000 7f18aa6d0640 1 -- 172.21.15.16:0/1320353715 >> 172.21.15.16:0/1320353715 conn(0x7f18a40fb840 msgr2=0x7f18a40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:05.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.812+0000 7f18aa6d0640 1 -- 172.21.15.16:0/1320353715 shutdown_connections 2024-08-01T07:08:05.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.812+0000 7f18aa6d0640 1 -- 172.21.15.16:0/1320353715 wait complete. 2024-08-01T07:08:05.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.813+0000 7f18aa6d0640 1 Processor -- start 2024-08-01T07:08:05.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.813+0000 7f18aa6d0640 1 -- start start 2024-08-01T07:08:05.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.813+0000 7f18aa6d0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18a40ffda0 0x7f18a419b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:05.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.813+0000 7f18aa6d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18a4100750 0x7f18a419bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:05.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.813+0000 7f18aa6d0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a419c2d0 con 0x7f18a40ffda0 2024-08-01T07:08:05.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.813+0000 7f18aa6d0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a41958f0 con 0x7f18a4100750 2024-08-01T07:08:05.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.814+0000 7f18a3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18a40ffda0 0x7f18a419b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:05.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.814+0000 7f18a3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18a40ffda0 0x7f18a419b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55152/0 (socket says 172.21.15.16:55152) 2024-08-01T07:08:05.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.814+0000 7f18a3fff640 1 -- 172.21.15.16:0/3603329084 learned_addr learned my addr 172.21.15.16:0/3603329084 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:08:05.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.814+0000 7f18a37fe640 1 --2- 172.21.15.16:0/3603329084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18a4100750 0x7f18a419bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:05.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.814+0000 7f18a3fff640 1 -- 172.21.15.16:0/3603329084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18a4100750 msgr2=0x7f18a419bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:05.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.814+0000 7f18a3fff640 1 --2- 172.21.15.16:0/3603329084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18a4100750 0x7f18a419bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:05.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.814+0000 7f18a3fff640 1 -- 172.21.15.16:0/3603329084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1894009560 con 0x7f18a40ffda0 2024-08-01T07:08:05.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.814+0000 7f18a3fff640 1 --2- 172.21.15.16:0/3603329084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18a40ffda0 0x7f18a419b800 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f189402a9c0 tx=0x7f18940055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:05.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.814+0000 7f18a17fa640 1 -- 172.21.15.16:0/3603329084 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1894004aa0 con 0x7f18a40ffda0 2024-08-01T07:08:05.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.814+0000 7f18aa6d0640 1 -- 172.21.15.16:0/3603329084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a4195b70 con 0x7f18a40ffda0 2024-08-01T07:08:05.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.814+0000 7f18a17fa640 1 -- 172.21.15.16:0/3603329084 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1894004c00 con 0x7f18a40ffda0 2024-08-01T07:08:05.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.814+0000 7f18a17fa640 1 -- 172.21.15.16:0/3603329084 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1894003ab0 con 0x7f18a40ffda0 2024-08-01T07:08:05.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.814+0000 7f18aa6d0640 1 -- 172.21.15.16:0/3603329084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a4196060 con 0x7f18a40ffda0 2024-08-01T07:08:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.815+0000 7f18aa6d0640 1 -- 172.21.15.16:0/3603329084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a4101280 con 0x7f18a40ffda0 2024-08-01T07:08:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.816+0000 7f18a17fa640 1 -- 172.21.15.16:0/3603329084 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1894031d20 con 0x7f18a40ffda0 2024-08-01T07:08:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.816+0000 7f18a17fa640 1 --2- 172.21.15.16:0/3603329084 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f188c06e170 0x7f188c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.816+0000 7f18a17fa640 1 -- 172.21.15.16:0/3603329084 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f18940af390 con 0x7f18a40ffda0 2024-08-01T07:08:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.816+0000 7f18a37fe640 1 --2- 172.21.15.16:0/3603329084 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f188c06e170 0x7f188c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.817+0000 7f18a37fe640 1 --2- 172.21.15.16:0/3603329084 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f188c06e170 0x7f188c070630 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f18a4196d60 tx=0x7f1898005cc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:05.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:05.821+0000 7f18a17fa640 1 -- 172.21.15.16:0/3603329084 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1894078550 con 0x7f18a40ffda0 2024-08-01T07:08:06.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:06.030+0000 7f18aa6d0640 1 -- 172.21.15.16:0/3603329084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f18a41080b0 con 0x7f18a40ffda0 2024-08-01T07:08:06.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:06.031+0000 7f18a17fa640 1 -- 172.21.15.16:0/3603329084 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v38) v1 ==== 107+0+4259 (secure 0 0 0) 0x7f189409ae60 con 0x7f18a40ffda0 2024-08-01T07:08:06.033 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:08:06.033 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":27,"btime":"2024-08-01T07:03:20:065737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44307,"name":"cephfs.smithi089.xanuld","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3851713020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3851713020},{"type":"v1","addr":"172.21.15.89:6827","nonce":3851713020}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44311,"name":"cephfs.smithi089.jhouje","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6825/2498996985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2498996985},{"type":"v1","addr":"172.21.15.89:6825","nonce":2498996985}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T07:03:20.065725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34414},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34414":{"gid":34414,"name":"cephfs.smithi016.bgqkxu","rank":0,"incarnation":27,"state":"up:replay","state_seq":1,"addr":"172.21.15.16:6827/4064792079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":4064792079},{"type":"v1","addr":"172.21.15.16:6827","nonce":4064792079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-01T07:08:06.033 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 27 2024-08-01T07:08:06.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:06.033+0000 7f18aa6d0640 1 -- 172.21.15.16:0/3603329084 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f188c06e170 msgr2=0x7f188c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:06.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:06.033+0000 7f18aa6d0640 1 --2- 172.21.15.16:0/3603329084 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f188c06e170 0x7f188c070630 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f18a4196d60 tx=0x7f1898005cc0 comp rx=0 tx=0).stop 2024-08-01T07:08:06.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:06.033+0000 7f18aa6d0640 1 -- 172.21.15.16:0/3603329084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18a40ffda0 msgr2=0x7f18a419b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:06.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:06.033+0000 7f18aa6d0640 1 --2- 172.21.15.16:0/3603329084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18a40ffda0 0x7f18a419b800 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f189402a9c0 tx=0x7f18940055a0 comp rx=0 tx=0).stop 2024-08-01T07:08:06.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:06.033+0000 7f18aa6d0640 1 -- 172.21.15.16:0/3603329084 shutdown_connections 2024-08-01T07:08:06.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:06.033+0000 7f18aa6d0640 1 --2- 172.21.15.16:0/3603329084 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f188c06e170 0x7f188c070630 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:06.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:06.033+0000 7f18aa6d0640 1 --2- 172.21.15.16:0/3603329084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18a4100750 0x7f18a419bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:06.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:06.033+0000 7f18aa6d0640 1 --2- 172.21.15.16:0/3603329084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18a40ffda0 0x7f18a419b800 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:06.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:06.033+0000 7f18aa6d0640 1 -- 172.21.15.16:0/3603329084 >> 172.21.15.16:0/3603329084 conn(0x7f18a40fb840 msgr2=0x7f18a40fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:06.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:06.033+0000 7f18aa6d0640 1 -- 172.21.15.16:0/3603329084 shutdown_connections 2024-08-01T07:08:06.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:06.033+0000 7f18aa6d0640 1 -- 172.21.15.16:0/3603329084 wait complete. 2024-08-01T07:08:06.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:06 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/3603329084' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-08-01T07:08:06.393 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:06 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/3603329084' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-08-01T07:08:06.830 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-08-01T07:08:06.830 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-08-01T07:08:06.830 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 28 2024-08-01T07:08:07.053 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:08:07.328 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:07 smithi016 ceph-mon[93645]: pgmap v344: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:08:07.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:07 smithi089 ceph-mon[82218]: pgmap v344: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:08:08.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.807+0000 7f53883f6640 1 -- 172.21.15.16:0/117576006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53801015d0 msgr2=0x7f5380109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:08.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.807+0000 7f53883f6640 1 --2- 172.21.15.16:0/117576006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53801015d0 0x7f5380109ac0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5370009880 tx=0x7f537002a530 comp rx=0 tx=0).stop 2024-08-01T07:08:08.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.808+0000 7f53883f6640 1 -- 172.21.15.16:0/117576006 shutdown_connections 2024-08-01T07:08:08.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.808+0000 7f53883f6640 1 --2- 172.21.15.16:0/117576006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53801015d0 0x7f5380109ac0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:08.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.808+0000 7f53883f6640 1 --2- 172.21.15.16:0/117576006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5380100cb0 0x7f5380101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:08.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.808+0000 7f53883f6640 1 -- 172.21.15.16:0/117576006 >> 172.21.15.16:0/117576006 conn(0x7f53800758a0 msgr2=0x7f53800fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:08.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.808+0000 7f53883f6640 1 -- 172.21.15.16:0/117576006 shutdown_connections 2024-08-01T07:08:08.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.808+0000 7f53883f6640 1 -- 172.21.15.16:0/117576006 wait complete. 2024-08-01T07:08:08.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.808+0000 7f53883f6640 1 Processor -- start 2024-08-01T07:08:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.808+0000 7f53883f6640 1 -- start start 2024-08-01T07:08:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.809+0000 7f53883f6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5380100cb0 0x7f53800fe910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.809+0000 7f53883f6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53801015d0 0x7f53800fee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.809+0000 7f53883f6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53800ff390 con 0x7f5380100cb0 2024-08-01T07:08:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.809+0000 7f53883f6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53800ff500 con 0x7f53801015d0 2024-08-01T07:08:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.809+0000 7f5386192640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5380100cb0 0x7f53800fe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.809+0000 7f5386192640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5380100cb0 0x7f53800fe910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39072/0 (socket says 172.21.15.16:39072) 2024-08-01T07:08:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.809+0000 7f5386192640 1 -- 172.21.15.16:0/2352755728 learned_addr learned my addr 172.21.15.16:0/2352755728 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:08:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.809+0000 7f5385991640 1 --2- 172.21.15.16:0/2352755728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53801015d0 0x7f53800fee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.809+0000 7f5386192640 1 -- 172.21.15.16:0/2352755728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53801015d0 msgr2=0x7f53800fee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.809+0000 7f5386192640 1 --2- 172.21.15.16:0/2352755728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53801015d0 0x7f53800fee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.809+0000 7f5386192640 1 -- 172.21.15.16:0/2352755728 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5370009560 con 0x7f5380100cb0 2024-08-01T07:08:08.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.809+0000 7f5386192640 1 --2- 172.21.15.16:0/2352755728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5380100cb0 0x7f53800fe910 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f537c00b420 tx=0x7f537c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:08.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.809+0000 7f53777fe640 1 -- 172.21.15.16:0/2352755728 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f537c011800 con 0x7f5380100cb0 2024-08-01T07:08:08.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.809+0000 7f53777fe640 1 -- 172.21.15.16:0/2352755728 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f537c011e20 con 0x7f5380100cb0 2024-08-01T07:08:08.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.809+0000 7f53883f6640 1 -- 172.21.15.16:0/2352755728 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53801a1dc0 con 0x7f5380100cb0 2024-08-01T07:08:08.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.810+0000 7f53777fe640 1 -- 172.21.15.16:0/2352755728 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f537c00f2e0 con 0x7f5380100cb0 2024-08-01T07:08:08.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.810+0000 7f53883f6640 1 -- 172.21.15.16:0/2352755728 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53801a2120 con 0x7f5380100cb0 2024-08-01T07:08:08.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.811+0000 7f53883f6640 1 -- 172.21.15.16:0/2352755728 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5380068510 con 0x7f5380100cb0 2024-08-01T07:08:08.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.811+0000 7f53777fe640 1 -- 172.21.15.16:0/2352755728 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f537c010380 con 0x7f5380100cb0 2024-08-01T07:08:08.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.812+0000 7f53777fe640 1 --2- 172.21.15.16:0/2352755728 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f536c06e170 0x7f536c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:08.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.812+0000 7f53777fe640 1 -- 172.21.15.16:0/2352755728 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f537c08dab0 con 0x7f5380100cb0 2024-08-01T07:08:08.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.812+0000 7f5385991640 1 --2- 172.21.15.16:0/2352755728 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f536c06e170 0x7f536c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:08.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.812+0000 7f5385991640 1 --2- 172.21.15.16:0/2352755728 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f536c06e170 0x7f536c070630 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5370009230 tx=0x7f53700058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:08.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:08.816+0000 7f53777fe640 1 -- 172.21.15.16:0/2352755728 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f537c056cf0 con 0x7f5380100cb0 2024-08-01T07:08:09.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:09.027+0000 7f53883f6640 1 -- 172.21.15.16:0/2352755728 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f53800ff6c0 con 0x7f5380100cb0 2024-08-01T07:08:09.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:09.028+0000 7f53777fe640 1 -- 172.21.15.16:0/2352755728 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v38) v1 ==== 107+0+4262 (secure 0 0 0) 0x7f53800ff6c0 con 0x7f5380100cb0 2024-08-01T07:08:09.029 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:08:09.030 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":28,"btime":"2024-08-01T07:03:28:965233+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44307,"name":"cephfs.smithi089.xanuld","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3851713020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3851713020},{"type":"v1","addr":"172.21.15.89:6827","nonce":3851713020}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44311,"name":"cephfs.smithi089.jhouje","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6825/2498996985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2498996985},{"type":"v1","addr":"172.21.15.89:6825","nonce":2498996985}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T07:03:28.055300+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34414},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34414":{"gid":34414,"name":"cephfs.smithi016.bgqkxu","rank":0,"incarnation":27,"state":"up:reconnect","state_seq":7,"addr":"172.21.15.16:6827/4064792079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":4064792079},{"type":"v1","addr":"172.21.15.16:6827","nonce":4064792079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-01T07:08:09.030 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 28 2024-08-01T07:08:09.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:09.030+0000 7f53883f6640 1 -- 172.21.15.16:0/2352755728 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f536c06e170 msgr2=0x7f536c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:09.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:09.030+0000 7f53883f6640 1 --2- 172.21.15.16:0/2352755728 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f536c06e170 0x7f536c070630 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5370009230 tx=0x7f53700058d0 comp rx=0 tx=0).stop 2024-08-01T07:08:09.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:09.030+0000 7f53883f6640 1 -- 172.21.15.16:0/2352755728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5380100cb0 msgr2=0x7f53800fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:09.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:09.030+0000 7f53883f6640 1 --2- 172.21.15.16:0/2352755728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5380100cb0 0x7f53800fe910 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f537c00b420 tx=0x7f537c00b8e0 comp rx=0 tx=0).stop 2024-08-01T07:08:09.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:09.030+0000 7f53883f6640 1 -- 172.21.15.16:0/2352755728 shutdown_connections 2024-08-01T07:08:09.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:09.030+0000 7f53883f6640 1 --2- 172.21.15.16:0/2352755728 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f536c06e170 0x7f536c070630 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:09.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:09.030+0000 7f53883f6640 1 --2- 172.21.15.16:0/2352755728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53801015d0 0x7f53800fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:09.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:09.030+0000 7f53883f6640 1 --2- 172.21.15.16:0/2352755728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5380100cb0 0x7f53800fe910 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:09.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:09.030+0000 7f53883f6640 1 -- 172.21.15.16:0/2352755728 >> 172.21.15.16:0/2352755728 conn(0x7f53800758a0 msgr2=0x7f5380101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:09.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:09.030+0000 7f53883f6640 1 -- 172.21.15.16:0/2352755728 shutdown_connections 2024-08-01T07:08:09.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:09.030+0000 7f53883f6640 1 -- 172.21.15.16:0/2352755728 wait complete. 2024-08-01T07:08:09.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:09 smithi089 ceph-mon[82218]: pgmap v345: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:08:09.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:09 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2352755728' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-08-01T07:08:09.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:09 smithi016 ceph-mon[93645]: pgmap v345: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:08:09.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:09 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2352755728' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-08-01T07:08:09.872 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-08-01T07:08:09.872 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-08-01T07:08:09.872 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 29 2024-08-01T07:08:10.097 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:08:11.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:11 smithi016 ceph-mon[93645]: pgmap v346: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:08:11.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:11 smithi089 ceph-mon[82218]: pgmap v346: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:08:11.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.787+0000 7f7435f93640 1 -- 172.21.15.16:0/3593331440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74300ffb40 msgr2=0x7f74300fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:11.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.787+0000 7f7435f93640 1 --2- 172.21.15.16:0/3593331440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74300ffb40 0x7f74300fffa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7418009880 tx=0x7f741802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:08:11.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.787+0000 7f7435f93640 1 -- 172.21.15.16:0/3593331440 shutdown_connections 2024-08-01T07:08:11.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.787+0000 7f7435f93640 1 --2- 172.21.15.16:0/3593331440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74300ffb40 0x7f74300fffa0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:11.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.787+0000 7f7435f93640 1 --2- 172.21.15.16:0/3593331440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7430105bf0 0x7f7430105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.787+0000 7f7435f93640 1 -- 172.21.15.16:0/3593331440 >> 172.21.15.16:0/3593331440 conn(0x7f74300fb860 msgr2=0x7f74300fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.787+0000 7f7435f93640 1 -- 172.21.15.16:0/3593331440 shutdown_connections 2024-08-01T07:08:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.787+0000 7f7435f93640 1 -- 172.21.15.16:0/3593331440 wait complete. 2024-08-01T07:08:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.787+0000 7f7435f93640 1 Processor -- start 2024-08-01T07:08:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.787+0000 7f7435f93640 1 -- start start 2024-08-01T07:08:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.788+0000 7f7435f93640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74300ffb40 0x7f74301959e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.788+0000 7f7435f93640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7430105bf0 0x7f7430195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.788+0000 7f7435f93640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7430196570 con 0x7f7430105bf0 2024-08-01T07:08:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.788+0000 7f7435f93640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74301966e0 con 0x7f74300ffb40 2024-08-01T07:08:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.788+0000 7f7426ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7430105bf0 0x7f7430195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.788+0000 7f7426ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7430105bf0 0x7f7430195f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39082/0 (socket says 172.21.15.16:39082) 2024-08-01T07:08:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.788+0000 7f7426ffd640 1 -- 172.21.15.16:0/3022537809 learned_addr learned my addr 172.21.15.16:0/3022537809 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:08:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.788+0000 7f742f7fe640 1 --2- 172.21.15.16:0/3022537809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74300ffb40 0x7f74301959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.788+0000 7f7426ffd640 1 -- 172.21.15.16:0/3022537809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74300ffb40 msgr2=0x7f74301959e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.788+0000 7f7426ffd640 1 --2- 172.21.15.16:0/3022537809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74300ffb40 0x7f74301959e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.788+0000 7f7426ffd640 1 -- 172.21.15.16:0/3022537809 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7418009560 con 0x7f7430105bf0 2024-08-01T07:08:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.788+0000 7f7426ffd640 1 --2- 172.21.15.16:0/3022537809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7430105bf0 0x7f7430195f20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f741802a9c0 tx=0x7f74180055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.789+0000 7f742d7fa640 1 -- 172.21.15.16:0/3022537809 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7418004aa0 con 0x7f7430105bf0 2024-08-01T07:08:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.789+0000 7f742d7fa640 1 -- 172.21.15.16:0/3022537809 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7418004c00 con 0x7f7430105bf0 2024-08-01T07:08:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.789+0000 7f7435f93640 1 -- 172.21.15.16:0/3022537809 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743019a440 con 0x7f7430105bf0 2024-08-01T07:08:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.789+0000 7f742d7fa640 1 -- 172.21.15.16:0/3022537809 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7418003ab0 con 0x7f7430105bf0 2024-08-01T07:08:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.789+0000 7f7435f93640 1 -- 172.21.15.16:0/3022537809 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743019a9b0 con 0x7f7430105bf0 2024-08-01T07:08:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.790+0000 7f7435f93640 1 -- 172.21.15.16:0/3022537809 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74301011f0 con 0x7f7430105bf0 2024-08-01T07:08:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.790+0000 7f742d7fa640 1 -- 172.21.15.16:0/3022537809 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7418003c10 con 0x7f7430105bf0 2024-08-01T07:08:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.791+0000 7f742d7fa640 1 --2- 172.21.15.16:0/3022537809 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f741c06e170 0x7f741c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.791+0000 7f742d7fa640 1 -- 172.21.15.16:0/3022537809 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f74180af370 con 0x7f7430105bf0 2024-08-01T07:08:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.791+0000 7f742f7fe640 1 --2- 172.21.15.16:0/3022537809 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f741c06e170 0x7f741c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.791+0000 7f742f7fe640 1 --2- 172.21.15.16:0/3022537809 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f741c06e170 0x7f741c070630 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7420005e10 tx=0x7f7420005da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:11.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:11.795+0000 7f742d7fa640 1 -- 172.21.15.16:0/3022537809 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7418078510 con 0x7f7430105bf0 2024-08-01T07:08:12.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:12.007+0000 7f7435f93640 1 -- 172.21.15.16:0/3022537809 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f7430108010 con 0x7f7430105bf0 2024-08-01T07:08:12.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:12.008+0000 7f742d7fa640 1 -- 172.21.15.16:0/3022537809 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v38) v1 ==== 107+0+4259 (secure 0 0 0) 0x7f741807bbd0 con 0x7f7430105bf0 2024-08-01T07:08:12.009 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:08:12.009 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":29,"btime":"2024-08-01T07:03:29:970798+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44307,"name":"cephfs.smithi089.xanuld","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3851713020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3851713020},{"type":"v1","addr":"172.21.15.89:6827","nonce":3851713020}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44311,"name":"cephfs.smithi089.jhouje","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6825/2498996985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2498996985},{"type":"v1","addr":"172.21.15.89:6825","nonce":2498996985}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T07:03:28.973191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34414},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34414":{"gid":34414,"name":"cephfs.smithi016.bgqkxu","rank":0,"incarnation":27,"state":"up:rejoin","state_seq":8,"addr":"172.21.15.16:6827/4064792079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":4064792079},{"type":"v1","addr":"172.21.15.16:6827","nonce":4064792079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-01T07:08:12.010 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 29 2024-08-01T07:08:12.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:12.010+0000 7f7435f93640 1 -- 172.21.15.16:0/3022537809 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f741c06e170 msgr2=0x7f741c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:12.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:12.010+0000 7f7435f93640 1 --2- 172.21.15.16:0/3022537809 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f741c06e170 0x7f741c070630 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7420005e10 tx=0x7f7420005da0 comp rx=0 tx=0).stop 2024-08-01T07:08:12.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:12.010+0000 7f7435f93640 1 -- 172.21.15.16:0/3022537809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7430105bf0 msgr2=0x7f7430195f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:12.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:12.010+0000 7f7435f93640 1 --2- 172.21.15.16:0/3022537809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7430105bf0 0x7f7430195f20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f741802a9c0 tx=0x7f74180055a0 comp rx=0 tx=0).stop 2024-08-01T07:08:12.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:12.010+0000 7f7435f93640 1 -- 172.21.15.16:0/3022537809 shutdown_connections 2024-08-01T07:08:12.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:12.011+0000 7f7435f93640 1 --2- 172.21.15.16:0/3022537809 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f741c06e170 0x7f741c070630 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:12.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:12.011+0000 7f7435f93640 1 --2- 172.21.15.16:0/3022537809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7430105bf0 0x7f7430195f20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:12.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:12.011+0000 7f7435f93640 1 --2- 172.21.15.16:0/3022537809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74300ffb40 0x7f74301959e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:12.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:12.011+0000 7f7435f93640 1 -- 172.21.15.16:0/3022537809 >> 172.21.15.16:0/3022537809 conn(0x7f74300fb860 msgr2=0x7f74300fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:12.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:12.011+0000 7f7435f93640 1 -- 172.21.15.16:0/3022537809 shutdown_connections 2024-08-01T07:08:12.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:12.011+0000 7f7435f93640 1 -- 172.21.15.16:0/3022537809 wait complete. 2024-08-01T07:08:12.318 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:12 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/3022537809' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-08-01T07:08:12.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:12 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/3022537809' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-08-01T07:08:12.617 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-08-01T07:08:12.617 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-08-01T07:08:12.617 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 30 2024-08-01T07:08:12.837 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:08:13.297 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:13 smithi016 ceph-mon[93645]: pgmap v347: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:08:13.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:13 smithi089 ceph-mon[82218]: pgmap v347: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:08:14.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.549+0000 7fc8e4b8c640 1 -- 172.21.15.16:0/4221674522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8e0100750 msgr2=0x7fc8e01047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:14.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.549+0000 7fc8e4b8c640 1 --2- 172.21.15.16:0/4221674522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8e0100750 0x7fc8e01047a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009880 tx=0x7fc8d402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:08:14.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.549+0000 7fc8e4b8c640 1 -- 172.21.15.16:0/4221674522 shutdown_connections 2024-08-01T07:08:14.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.549+0000 7fc8e4b8c640 1 --2- 172.21.15.16:0/4221674522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8e0100750 0x7fc8e01047a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.549+0000 7fc8e4b8c640 1 --2- 172.21.15.16:0/4221674522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8e00ffda0 0x7fc8e0100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.549+0000 7fc8e4b8c640 1 -- 172.21.15.16:0/4221674522 >> 172.21.15.16:0/4221674522 conn(0x7fc8e00fb840 msgr2=0x7fc8e00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.549+0000 7fc8e4b8c640 1 -- 172.21.15.16:0/4221674522 shutdown_connections 2024-08-01T07:08:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.549+0000 7fc8e4b8c640 1 -- 172.21.15.16:0/4221674522 wait complete. 2024-08-01T07:08:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.550+0000 7fc8e4b8c640 1 Processor -- start 2024-08-01T07:08:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.550+0000 7fc8e4b8c640 1 -- start start 2024-08-01T07:08:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.550+0000 7fc8e4b8c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8e00ffda0 0x7fc8e019b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.550+0000 7fc8e4b8c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8e0100750 0x7fc8e019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.550+0000 7fc8e4b8c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e0195930 con 0x7fc8e00ffda0 2024-08-01T07:08:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.550+0000 7fc8e4b8c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e0195a70 con 0x7fc8e0100750 2024-08-01T07:08:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.550+0000 7fc8de59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8e00ffda0 0x7fc8e019b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.550+0000 7fc8de59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8e00ffda0 0x7fc8e019b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39110/0 (socket says 172.21.15.16:39110) 2024-08-01T07:08:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.550+0000 7fc8de59c640 1 -- 172.21.15.16:0/711051224 learned_addr learned my addr 172.21.15.16:0/711051224 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:08:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.550+0000 7fc8ddd9b640 1 --2- 172.21.15.16:0/711051224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8e0100750 0x7fc8e019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.550+0000 7fc8de59c640 1 -- 172.21.15.16:0/711051224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8e0100750 msgr2=0x7fc8e019be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.550+0000 7fc8de59c640 1 --2- 172.21.15.16:0/711051224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8e0100750 0x7fc8e019be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.550+0000 7fc8de59c640 1 -- 172.21.15.16:0/711051224 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d4009560 con 0x7fc8e00ffda0 2024-08-01T07:08:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.550+0000 7fc8de59c640 1 --2- 172.21.15.16:0/711051224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8e00ffda0 0x7fc8e019b8d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc8d000d6f0 tx=0x7fc8d000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.551+0000 7fc8cf7fe640 1 -- 172.21.15.16:0/711051224 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8d0009a30 con 0x7fc8e00ffda0 2024-08-01T07:08:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.551+0000 7fc8e4b8c640 1 -- 172.21.15.16:0/711051224 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e0195d50 con 0x7fc8e00ffda0 2024-08-01T07:08:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.551+0000 7fc8cf7fe640 1 -- 172.21.15.16:0/711051224 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8d00054e0 con 0x7fc8e00ffda0 2024-08-01T07:08:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.551+0000 7fc8cf7fe640 1 -- 172.21.15.16:0/711051224 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8d0010460 con 0x7fc8e00ffda0 2024-08-01T07:08:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.551+0000 7fc8e4b8c640 1 -- 172.21.15.16:0/711051224 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e0196270 con 0x7fc8e00ffda0 2024-08-01T07:08:14.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.552+0000 7fc8e4b8c640 1 -- 172.21.15.16:0/711051224 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e0101280 con 0x7fc8e00ffda0 2024-08-01T07:08:14.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.552+0000 7fc8cf7fe640 1 -- 172.21.15.16:0/711051224 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc8d0009b90 con 0x7fc8e00ffda0 2024-08-01T07:08:14.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.553+0000 7fc8cf7fe640 1 --2- 172.21.15.16:0/711051224 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc8c806e170 0x7fc8c8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:14.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.553+0000 7fc8cf7fe640 1 -- 172.21.15.16:0/711051224 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fc8d008dda0 con 0x7fc8e00ffda0 2024-08-01T07:08:14.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.553+0000 7fc8ddd9b640 1 --2- 172.21.15.16:0/711051224 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc8c806e170 0x7fc8c8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:14.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.553+0000 7fc8ddd9b640 1 --2- 172.21.15.16:0/711051224 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc8c806e170 0x7fc8c8070630 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009230 tx=0x7fc8d40058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:14.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.557+0000 7fc8cf7fe640 1 -- 172.21.15.16:0/711051224 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc8d0057010 con 0x7fc8e00ffda0 2024-08-01T07:08:14.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.772+0000 7fc8e4b8c640 1 -- 172.21.15.16:0/711051224 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fc8e01080b0 con 0x7fc8e00ffda0 2024-08-01T07:08:14.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.773+0000 7fc8cf7fe640 1 -- 172.21.15.16:0/711051224 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v38) v1 ==== 107+0+4268 (secure 0 0 0) 0x7fc8d0017090 con 0x7fc8e00ffda0 2024-08-01T07:08:14.774 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:08:14.775 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":30,"btime":"2024-08-01T07:03:30:995137+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44307,"name":"cephfs.smithi089.xanuld","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3851713020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3851713020},{"type":"v1","addr":"172.21.15.89:6827","nonce":3851713020}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44311,"name":"cephfs.smithi089.jhouje","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6825/2498996985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2498996985},{"type":"v1","addr":"172.21.15.89:6825","nonce":2498996985}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T07:03:30.995134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34414},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34414":{"gid":34414,"name":"cephfs.smithi016.bgqkxu","rank":0,"incarnation":27,"state":"up:active","state_seq":9,"addr":"172.21.15.16:6827/4064792079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":4064792079},{"type":"v1","addr":"172.21.15.16:6827","nonce":4064792079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34414,"qdb_cluster":[34414]},"id":1}]} 2024-08-01T07:08:14.775 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 30 2024-08-01T07:08:14.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.775+0000 7fc8e4b8c640 1 -- 172.21.15.16:0/711051224 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc8c806e170 msgr2=0x7fc8c8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:14.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.775+0000 7fc8e4b8c640 1 --2- 172.21.15.16:0/711051224 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc8c806e170 0x7fc8c8070630 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009230 tx=0x7fc8d40058d0 comp rx=0 tx=0).stop 2024-08-01T07:08:14.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.775+0000 7fc8e4b8c640 1 -- 172.21.15.16:0/711051224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8e00ffda0 msgr2=0x7fc8e019b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:14.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.775+0000 7fc8e4b8c640 1 --2- 172.21.15.16:0/711051224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8e00ffda0 0x7fc8e019b8d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc8d000d6f0 tx=0x7fc8d000dbb0 comp rx=0 tx=0).stop 2024-08-01T07:08:14.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.775+0000 7fc8e4b8c640 1 -- 172.21.15.16:0/711051224 shutdown_connections 2024-08-01T07:08:14.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.775+0000 7fc8e4b8c640 1 --2- 172.21.15.16:0/711051224 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fc8c806e170 0x7fc8c8070630 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:14.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.775+0000 7fc8e4b8c640 1 --2- 172.21.15.16:0/711051224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8e0100750 0x7fc8e019be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:14.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.775+0000 7fc8e4b8c640 1 --2- 172.21.15.16:0/711051224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8e00ffda0 0x7fc8e019b8d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:14.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.775+0000 7fc8e4b8c640 1 -- 172.21.15.16:0/711051224 >> 172.21.15.16:0/711051224 conn(0x7fc8e00fb840 msgr2=0x7fc8e00fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:14.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.775+0000 7fc8e4b8c640 1 -- 172.21.15.16:0/711051224 shutdown_connections 2024-08-01T07:08:14.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:14.775+0000 7fc8e4b8c640 1 -- 172.21.15.16:0/711051224 wait complete. 2024-08-01T07:08:15.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:15 smithi089 ceph-mon[82218]: pgmap v348: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:08:15.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:15 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/711051224' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-08-01T07:08:15.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:15 smithi016 ceph-mon[93645]: pgmap v348: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:08:15.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:15 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/711051224' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-08-01T07:08:15.602 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-08-01T07:08:15.603 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-08-01T07:08:15.603 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 31 2024-08-01T07:08:15.826 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:08:17.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:17 smithi016 ceph-mon[93645]: pgmap v349: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:08:17.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:17 smithi089 ceph-mon[82218]: pgmap v349: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:08:17.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.445+0000 7f9499c29640 1 -- 172.21.15.16:0/4015948799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9494100750 msgr2=0x7f94941047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:17.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.445+0000 7f9499c29640 1 --2- 172.21.15.16:0/4015948799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9494100750 0x7f94941047a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9484009880 tx=0x7f948402a4a0 comp rx=0 tx=0).stop 2024-08-01T07:08:17.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.445+0000 7f9499c29640 1 -- 172.21.15.16:0/4015948799 shutdown_connections 2024-08-01T07:08:17.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.445+0000 7f9499c29640 1 --2- 172.21.15.16:0/4015948799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9494100750 0x7f94941047a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:17.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.445+0000 7f9499c29640 1 --2- 172.21.15.16:0/4015948799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94940ffda0 0x7f9494100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:17.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.445+0000 7f9499c29640 1 -- 172.21.15.16:0/4015948799 >> 172.21.15.16:0/4015948799 conn(0x7f94940fb840 msgr2=0x7f94940fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:17.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.445+0000 7f9499c29640 1 -- 172.21.15.16:0/4015948799 shutdown_connections 2024-08-01T07:08:17.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.445+0000 7f9499c29640 1 -- 172.21.15.16:0/4015948799 wait complete. 2024-08-01T07:08:17.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.445+0000 7f9499c29640 1 Processor -- start 2024-08-01T07:08:17.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.446+0000 7f9499c29640 1 -- start start 2024-08-01T07:08:17.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.446+0000 7f9499c29640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94940ffda0 0x7f949419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:17.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.446+0000 7f9499c29640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9494100750 0x7f949419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:17.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.446+0000 7f9499c29640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949419c380 con 0x7f94940ffda0 2024-08-01T07:08:17.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.446+0000 7f9499c29640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9494195910 con 0x7f9494100750 2024-08-01T07:08:17.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.446+0000 7f94937fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94940ffda0 0x7f949419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:17.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.446+0000 7f94937fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94940ffda0 0x7f949419b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39130/0 (socket says 172.21.15.16:39130) 2024-08-01T07:08:17.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.446+0000 7f94937fe640 1 -- 172.21.15.16:0/2404940885 learned_addr learned my addr 172.21.15.16:0/2404940885 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:08:17.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.446+0000 7f9492ffd640 1 --2- 172.21.15.16:0/2404940885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9494100750 0x7f949419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:17.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.446+0000 7f94937fe640 1 -- 172.21.15.16:0/2404940885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9494100750 msgr2=0x7f949419bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:17.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.446+0000 7f94937fe640 1 --2- 172.21.15.16:0/2404940885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9494100750 0x7f949419bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:17.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.446+0000 7f94937fe640 1 -- 172.21.15.16:0/2404940885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9484009560 con 0x7f94940ffda0 2024-08-01T07:08:17.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.446+0000 7f9492ffd640 1 --2- 172.21.15.16:0/2404940885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9494100750 0x7f949419bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-01T07:08:17.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.447+0000 7f94937fe640 1 --2- 172.21.15.16:0/2404940885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94940ffda0 0x7f949419b820 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f948800d8d0 tx=0x7f948800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:17.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.447+0000 7f9490ff9640 1 -- 172.21.15.16:0/2404940885 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9488009c00 con 0x7f94940ffda0 2024-08-01T07:08:17.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.447+0000 7f9490ff9640 1 -- 172.21.15.16:0/2404940885 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9488009d60 con 0x7f94940ffda0 2024-08-01T07:08:17.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.447+0000 7f9490ff9640 1 -- 172.21.15.16:0/2404940885 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94880049d0 con 0x7f94940ffda0 2024-08-01T07:08:17.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.447+0000 7f9499c29640 1 -- 172.21.15.16:0/2404940885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9494195bf0 con 0x7f94940ffda0 2024-08-01T07:08:17.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.447+0000 7f9499c29640 1 -- 172.21.15.16:0/2404940885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9494196110 con 0x7f94940ffda0 2024-08-01T07:08:17.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.448+0000 7f9499c29640 1 -- 172.21.15.16:0/2404940885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9494101280 con 0x7f94940ffda0 2024-08-01T07:08:17.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.449+0000 7f9490ff9640 1 -- 172.21.15.16:0/2404940885 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9488004c40 con 0x7f94940ffda0 2024-08-01T07:08:17.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.449+0000 7f9490ff9640 1 --2- 172.21.15.16:0/2404940885 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f947c06e170 0x7f947c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:17.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.449+0000 7f9492ffd640 1 --2- 172.21.15.16:0/2404940885 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f947c06e170 0x7f947c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:17.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.449+0000 7f9490ff9640 1 -- 172.21.15.16:0/2404940885 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f948808df70 con 0x7f94940ffda0 2024-08-01T07:08:17.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.450+0000 7f9492ffd640 1 --2- 172.21.15.16:0/2404940885 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f947c06e170 0x7f947c070630 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9484000c00 tx=0x7f9484005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:17.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.454+0000 7f9490ff9640 1 -- 172.21.15.16:0/2404940885 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f94880c2df0 con 0x7f94940ffda0 2024-08-01T07:08:17.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.667+0000 7f9499c29640 1 -- 172.21.15.16:0/2404940885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f9494100180 con 0x7f94940ffda0 2024-08-01T07:08:17.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.668+0000 7f9490ff9640 1 -- 172.21.15.16:0/2404940885 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v38) v1 ==== 107+0+5115 (secure 0 0 0) 0x7f9488017090 con 0x7f94940ffda0 2024-08-01T07:08:17.669 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:08:17.670 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":31,"btime":"2024-08-01T07:03:33:004811+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34446,"name":"cephfs.smithi016.fziqod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6829/2186852070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2186852070},{"type":"v1","addr":"172.21.15.16:6829","nonce":2186852070}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44307,"name":"cephfs.smithi089.xanuld","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3851713020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3851713020},{"type":"v1","addr":"172.21.15.89:6827","nonce":3851713020}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44311,"name":"cephfs.smithi089.jhouje","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6825/2498996985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2498996985},{"type":"v1","addr":"172.21.15.89:6825","nonce":2498996985}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T07:03:30.995134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34414},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34414":{"gid":34414,"name":"cephfs.smithi016.bgqkxu","rank":0,"incarnation":27,"state":"up:active","state_seq":9,"addr":"172.21.15.16:6827/4064792079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":4064792079},{"type":"v1","addr":"172.21.15.16:6827","nonce":4064792079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34414,"qdb_cluster":[34414]},"id":1}]} 2024-08-01T07:08:17.670 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 31 2024-08-01T07:08:17.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.670+0000 7f9499c29640 1 -- 172.21.15.16:0/2404940885 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f947c06e170 msgr2=0x7f947c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:17.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.670+0000 7f9499c29640 1 --2- 172.21.15.16:0/2404940885 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f947c06e170 0x7f947c070630 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9484000c00 tx=0x7f9484005a20 comp rx=0 tx=0).stop 2024-08-01T07:08:17.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.670+0000 7f9499c29640 1 -- 172.21.15.16:0/2404940885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94940ffda0 msgr2=0x7f949419b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:17.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.670+0000 7f9499c29640 1 --2- 172.21.15.16:0/2404940885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94940ffda0 0x7f949419b820 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f948800d8d0 tx=0x7f948800dd90 comp rx=0 tx=0).stop 2024-08-01T07:08:17.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.670+0000 7f9499c29640 1 -- 172.21.15.16:0/2404940885 shutdown_connections 2024-08-01T07:08:17.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.670+0000 7f9499c29640 1 --2- 172.21.15.16:0/2404940885 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f947c06e170 0x7f947c070630 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:17.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.670+0000 7f9499c29640 1 --2- 172.21.15.16:0/2404940885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9494100750 0x7f949419bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:17.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.670+0000 7f9499c29640 1 --2- 172.21.15.16:0/2404940885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94940ffda0 0x7f949419b820 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:17.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.670+0000 7f9499c29640 1 -- 172.21.15.16:0/2404940885 >> 172.21.15.16:0/2404940885 conn(0x7f94940fb840 msgr2=0x7f94940fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:17.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.670+0000 7f9499c29640 1 -- 172.21.15.16:0/2404940885 shutdown_connections 2024-08-01T07:08:17.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:17.670+0000 7f9499c29640 1 -- 172.21.15.16:0/2404940885 wait complete. 2024-08-01T07:08:18.376 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:08:18.376 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:18 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2404940885' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-08-01T07:08:18.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:08:18.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:18 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2404940885' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-08-01T07:08:18.401 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-08-01T07:08:18.401 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-08-01T07:08:18.401 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 32 2024-08-01T07:08:18.619 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:08:19.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:19 smithi089 ceph-mon[82218]: pgmap v350: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:08:19.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:19 smithi016 ceph-mon[93645]: pgmap v350: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:08:20.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.153+0000 7fdb76066640 1 -- 172.21.15.16:0/3092172089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70101610 msgr2=0x7fdb70109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:20.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.153+0000 7fdb76066640 1 --2- 172.21.15.16:0/3092172089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70101610 0x7fdb70109b00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdb640098b0 tx=0x7fdb6402a4d0 comp rx=0 tx=0).stop 2024-08-01T07:08:20.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.153+0000 7fdb76066640 1 -- 172.21.15.16:0/3092172089 shutdown_connections 2024-08-01T07:08:20.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.153+0000 7fdb76066640 1 --2- 172.21.15.16:0/3092172089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70101610 0x7fdb70109b00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:20.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.153+0000 7fdb76066640 1 --2- 172.21.15.16:0/3092172089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb70100c60 0x7fdb70101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:20.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.153+0000 7fdb76066640 1 -- 172.21.15.16:0/3092172089 >> 172.21.15.16:0/3092172089 conn(0x7fdb700fa730 msgr2=0x7fdb700fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:20.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.153+0000 7fdb76066640 1 -- 172.21.15.16:0/3092172089 shutdown_connections 2024-08-01T07:08:20.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.153+0000 7fdb76066640 1 -- 172.21.15.16:0/3092172089 wait complete. 2024-08-01T07:08:20.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.154+0000 7fdb76066640 1 Processor -- start 2024-08-01T07:08:20.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.154+0000 7fdb76066640 1 -- start start 2024-08-01T07:08:20.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.154+0000 7fdb76066640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70100c60 0x7fdb7019b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:20.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.154+0000 7fdb76066640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb70101610 0x7fdb7019bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:20.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.154+0000 7fdb76066640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7019c3e0 con 0x7fdb70100c60 2024-08-01T07:08:20.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.154+0000 7fdb76066640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb70195970 con 0x7fdb70101610 2024-08-01T07:08:20.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.154+0000 7fdb6f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70100c60 0x7fdb7019b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:20.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.154+0000 7fdb6f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70100c60 0x7fdb7019b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46994/0 (socket says 172.21.15.16:46994) 2024-08-01T07:08:20.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.155+0000 7fdb6f7fe640 1 -- 172.21.15.16:0/3152586942 learned_addr learned my addr 172.21.15.16:0/3152586942 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:08:20.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.155+0000 7fdb6effd640 1 --2- 172.21.15.16:0/3152586942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb70101610 0x7fdb7019bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:20.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.155+0000 7fdb6f7fe640 1 -- 172.21.15.16:0/3152586942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb70101610 msgr2=0x7fdb7019bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:20.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.155+0000 7fdb6f7fe640 1 --2- 172.21.15.16:0/3152586942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb70101610 0x7fdb7019bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:20.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.155+0000 7fdb6f7fe640 1 -- 172.21.15.16:0/3152586942 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb64009560 con 0x7fdb70100c60 2024-08-01T07:08:20.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.155+0000 7fdb6f7fe640 1 --2- 172.21.15.16:0/3152586942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70100c60 0x7fdb7019b880 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000d6f0 tx=0x7fdb6000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:20.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.155+0000 7fdb6cff9640 1 -- 172.21.15.16:0/3152586942 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb60009a30 con 0x7fdb70100c60 2024-08-01T07:08:20.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.155+0000 7fdb6cff9640 1 -- 172.21.15.16:0/3152586942 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb600054e0 con 0x7fdb70100c60 2024-08-01T07:08:20.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.155+0000 7fdb76066640 1 -- 172.21.15.16:0/3152586942 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb70195c50 con 0x7fdb70100c60 2024-08-01T07:08:20.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.155+0000 7fdb6cff9640 1 -- 172.21.15.16:0/3152586942 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb60010460 con 0x7fdb70100c60 2024-08-01T07:08:20.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.155+0000 7fdb76066640 1 -- 172.21.15.16:0/3152586942 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb70196170 con 0x7fdb70100c60 2024-08-01T07:08:20.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.156+0000 7fdb76066640 1 -- 172.21.15.16:0/3152586942 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb70068d30 con 0x7fdb70100c60 2024-08-01T07:08:20.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.157+0000 7fdb6cff9640 1 -- 172.21.15.16:0/3152586942 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdb60009b90 con 0x7fdb70100c60 2024-08-01T07:08:20.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.157+0000 7fdb6cff9640 1 --2- 172.21.15.16:0/3152586942 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fdb5806e180 0x7fdb58070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:20.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.157+0000 7fdb6cff9640 1 -- 172.21.15.16:0/3152586942 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fdb6008de50 con 0x7fdb70100c60 2024-08-01T07:08:20.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.157+0000 7fdb6effd640 1 --2- 172.21.15.16:0/3152586942 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fdb5806e180 0x7fdb58070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:20.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.158+0000 7fdb6effd640 1 --2- 172.21.15.16:0/3152586942 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fdb5806e180 0x7fdb58070640 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb64006010 tx=0x7fdb640041a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:20.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.161+0000 7fdb6cff9640 1 -- 172.21.15.16:0/3152586942 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fdb60057010 con 0x7fdb70100c60 2024-08-01T07:08:20.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.375+0000 7fdb76066640 1 -- 172.21.15.16:0/3152586942 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fdb70101040 con 0x7fdb70100c60 2024-08-01T07:08:20.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.376+0000 7fdb6cff9640 1 -- 172.21.15.16:0/3152586942 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v38) v1 ==== 107+0+4336 (secure 0 0 0) 0x7fdb60017090 con 0x7fdb70100c60 2024-08-01T07:08:20.377 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:08:20.377 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":32,"btime":"2024-08-01T07:03:45:393522+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34446,"name":"cephfs.smithi016.fziqod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6829/2186852070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2186852070},{"type":"v1","addr":"172.21.15.16:6829","nonce":2186852070}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44307,"name":"cephfs.smithi089.xanuld","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3851713020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3851713020},{"type":"v1","addr":"172.21.15.89:6827","nonce":3851713020}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T07:03:30.995134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34414},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34414":{"gid":34414,"name":"cephfs.smithi016.bgqkxu","rank":0,"incarnation":27,"state":"up:active","state_seq":9,"addr":"172.21.15.16:6827/4064792079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":4064792079},{"type":"v1","addr":"172.21.15.16:6827","nonce":4064792079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34414,"qdb_cluster":[34414]},"id":1}]} 2024-08-01T07:08:20.378 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 32 2024-08-01T07:08:20.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.378+0000 7fdb76066640 1 -- 172.21.15.16:0/3152586942 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fdb5806e180 msgr2=0x7fdb58070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:20.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.378+0000 7fdb76066640 1 --2- 172.21.15.16:0/3152586942 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fdb5806e180 0x7fdb58070640 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb64006010 tx=0x7fdb640041a0 comp rx=0 tx=0).stop 2024-08-01T07:08:20.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.378+0000 7fdb76066640 1 -- 172.21.15.16:0/3152586942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70100c60 msgr2=0x7fdb7019b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:20.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.378+0000 7fdb76066640 1 --2- 172.21.15.16:0/3152586942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70100c60 0x7fdb7019b880 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000d6f0 tx=0x7fdb6000dbb0 comp rx=0 tx=0).stop 2024-08-01T07:08:20.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.378+0000 7fdb76066640 1 -- 172.21.15.16:0/3152586942 shutdown_connections 2024-08-01T07:08:20.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.378+0000 7fdb76066640 1 --2- 172.21.15.16:0/3152586942 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fdb5806e180 0x7fdb58070640 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:20.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.378+0000 7fdb76066640 1 --2- 172.21.15.16:0/3152586942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb70101610 0x7fdb7019bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:20.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.378+0000 7fdb76066640 1 --2- 172.21.15.16:0/3152586942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb70100c60 0x7fdb7019b880 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:20.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.378+0000 7fdb76066640 1 -- 172.21.15.16:0/3152586942 >> 172.21.15.16:0/3152586942 conn(0x7fdb700fa730 msgr2=0x7fdb70101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:20.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.379+0000 7fdb76066640 1 -- 172.21.15.16:0/3152586942 shutdown_connections 2024-08-01T07:08:20.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:20.379+0000 7fdb76066640 1 -- 172.21.15.16:0/3152586942 wait complete. 2024-08-01T07:08:21.023 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-08-01T07:08:21.024 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-08-01T07:08:21.024 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 33 2024-08-01T07:08:21.242 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:08:21.361 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:21 smithi016 ceph-mon[93645]: pgmap v351: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:08:21.361 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:21 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/3152586942' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-08-01T07:08:21.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:21 smithi089 ceph-mon[82218]: pgmap v351: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:08:21.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:21 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/3152586942' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-08-01T07:08:22.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.860+0000 7f115fbda640 1 -- 172.21.15.16:0/1558802800 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1158101610 msgr2=0x7f1158109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:22.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.860+0000 7f115fbda640 1 --2- 172.21.15.16:0/1558802800 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1158101610 0x7f1158109b00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f11480098b0 tx=0x7f114802a4d0 comp rx=0 tx=0).stop 2024-08-01T07:08:22.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.860+0000 7f115fbda640 1 -- 172.21.15.16:0/1558802800 shutdown_connections 2024-08-01T07:08:22.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.860+0000 7f115fbda640 1 --2- 172.21.15.16:0/1558802800 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1158101610 0x7f1158109b00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:22.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.860+0000 7f115fbda640 1 --2- 172.21.15.16:0/1558802800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1158100c60 0x7f1158101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:22.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.860+0000 7f115fbda640 1 -- 172.21.15.16:0/1558802800 >> 172.21.15.16:0/1558802800 conn(0x7f11580fa730 msgr2=0x7f11580fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:22.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.860+0000 7f115fbda640 1 -- 172.21.15.16:0/1558802800 shutdown_connections 2024-08-01T07:08:22.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.860+0000 7f115fbda640 1 -- 172.21.15.16:0/1558802800 wait complete. 2024-08-01T07:08:22.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.861+0000 7f115fbda640 1 Processor -- start 2024-08-01T07:08:22.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.861+0000 7f115fbda640 1 -- start start 2024-08-01T07:08:22.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.861+0000 7f115fbda640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1158100c60 0x7f115819b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:22.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.861+0000 7f115fbda640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1158101610 0x7f115819bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:22.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.861+0000 7f115fbda640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115819c4c0 con 0x7f1158101610 2024-08-01T07:08:22.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.861+0000 7f115fbda640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1158195a50 con 0x7f1158100c60 2024-08-01T07:08:22.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.862+0000 7f115d175640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1158101610 0x7f115819bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:22.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.862+0000 7f115d175640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1158101610 0x7f115819bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47008/0 (socket says 172.21.15.16:47008) 2024-08-01T07:08:22.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.862+0000 7f115d175640 1 -- 172.21.15.16:0/2077932699 learned_addr learned my addr 172.21.15.16:0/2077932699 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:08:22.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.862+0000 7f115d976640 1 --2- 172.21.15.16:0/2077932699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1158100c60 0x7f115819b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:22.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.862+0000 7f115d175640 1 -- 172.21.15.16:0/2077932699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1158100c60 msgr2=0x7f115819b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:22.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.862+0000 7f115d175640 1 --2- 172.21.15.16:0/2077932699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1158100c60 0x7f115819b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:22.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.862+0000 7f115d175640 1 -- 172.21.15.16:0/2077932699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1148009560 con 0x7f1158101610 2024-08-01T07:08:22.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.862+0000 7f115d175640 1 --2- 172.21.15.16:0/2077932699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1158101610 0x7f115819bea0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1148009230 tx=0x7f11480055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:22.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.862+0000 7f114effd640 1 -- 172.21.15.16:0/2077932699 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1148004aa0 con 0x7f1158101610 2024-08-01T07:08:22.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.862+0000 7f115fbda640 1 -- 172.21.15.16:0/2077932699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1158195cd0 con 0x7f1158101610 2024-08-01T07:08:22.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.862+0000 7f114effd640 1 -- 172.21.15.16:0/2077932699 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1148004c00 con 0x7f1158101610 2024-08-01T07:08:22.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.862+0000 7f114effd640 1 -- 172.21.15.16:0/2077932699 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1148003930 con 0x7f1158101610 2024-08-01T07:08:22.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.862+0000 7f115fbda640 1 -- 172.21.15.16:0/2077932699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11581961c0 con 0x7f1158101610 2024-08-01T07:08:22.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.863+0000 7f115fbda640 1 -- 172.21.15.16:0/2077932699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1158068d30 con 0x7f1158101610 2024-08-01T07:08:22.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.864+0000 7f114effd640 1 -- 172.21.15.16:0/2077932699 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1148003bf0 con 0x7f1158101610 2024-08-01T07:08:22.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.864+0000 7f114effd640 1 --2- 172.21.15.16:0/2077932699 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f114406e180 0x7f1144070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:22.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.865+0000 7f114effd640 1 -- 172.21.15.16:0/2077932699 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f11480af4c0 con 0x7f1158101610 2024-08-01T07:08:22.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.865+0000 7f115d976640 1 --2- 172.21.15.16:0/2077932699 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f114406e180 0x7f1144070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:22.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.865+0000 7f115d976640 1 --2- 172.21.15.16:0/2077932699 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f114406e180 0x7f1144070640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1154009990 tx=0x7f1154009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:22.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:22.869+0000 7f114effd640 1 -- 172.21.15.16:0/2077932699 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1148078680 con 0x7f1158101610 2024-08-01T07:08:23.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:23.082+0000 7f115fbda640 1 -- 172.21.15.16:0/2077932699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f1158104410 con 0x7f1158101610 2024-08-01T07:08:23.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:23.082+0000 7f114effd640 1 -- 172.21.15.16:0/2077932699 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v38) v1 ==== 107+0+5183 (secure 0 0 0) 0x7f114807bd40 con 0x7f1158101610 2024-08-01T07:08:23.084 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:08:23.084 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":33,"btime":"2024-08-01T07:03:50:404100+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34446,"name":"cephfs.smithi016.fziqod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6829/2186852070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2186852070},{"type":"v1","addr":"172.21.15.16:6829","nonce":2186852070}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44307,"name":"cephfs.smithi089.xanuld","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3851713020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3851713020},{"type":"v1","addr":"172.21.15.89:6827","nonce":3851713020}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44357,"name":"cephfs.smithi089.jhouje","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6825/3335707325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3335707325},{"type":"v1","addr":"172.21.15.89:6825","nonce":3335707325}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T07:03:30.995134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34414},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34414":{"gid":34414,"name":"cephfs.smithi016.bgqkxu","rank":0,"incarnation":27,"state":"up:active","state_seq":9,"addr":"172.21.15.16:6827/4064792079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":4064792079},{"type":"v1","addr":"172.21.15.16:6827","nonce":4064792079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34414,"qdb_cluster":[34414]},"id":1}]} 2024-08-01T07:08:23.084 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 33 2024-08-01T07:08:23.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:23.085+0000 7f115fbda640 1 -- 172.21.15.16:0/2077932699 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f114406e180 msgr2=0x7f1144070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:23.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:23.085+0000 7f115fbda640 1 --2- 172.21.15.16:0/2077932699 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f114406e180 0x7f1144070640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1154009990 tx=0x7f1154009110 comp rx=0 tx=0).stop 2024-08-01T07:08:23.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:23.085+0000 7f115fbda640 1 -- 172.21.15.16:0/2077932699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1158101610 msgr2=0x7f115819bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:23.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:23.085+0000 7f115fbda640 1 --2- 172.21.15.16:0/2077932699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1158101610 0x7f115819bea0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1148009230 tx=0x7f11480055a0 comp rx=0 tx=0).stop 2024-08-01T07:08:23.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:23.085+0000 7f115fbda640 1 -- 172.21.15.16:0/2077932699 shutdown_connections 2024-08-01T07:08:23.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:23.085+0000 7f115fbda640 1 --2- 172.21.15.16:0/2077932699 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f114406e180 0x7f1144070640 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:23.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:23.085+0000 7f115fbda640 1 --2- 172.21.15.16:0/2077932699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1158101610 0x7f115819bea0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:23.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:23.085+0000 7f115fbda640 1 --2- 172.21.15.16:0/2077932699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1158100c60 0x7f115819b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:23.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:23.085+0000 7f115fbda640 1 -- 172.21.15.16:0/2077932699 >> 172.21.15.16:0/2077932699 conn(0x7f11580fa730 msgr2=0x7f1158101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:23.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:23.085+0000 7f115fbda640 1 -- 172.21.15.16:0/2077932699 shutdown_connections 2024-08-01T07:08:23.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:23.085+0000 7f115fbda640 1 -- 172.21.15.16:0/2077932699 wait complete. 2024-08-01T07:08:23.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:23 smithi089 ceph-mon[82218]: pgmap v352: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:08:23.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:23 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2077932699' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-08-01T07:08:23.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:23 smithi016 ceph-mon[93645]: pgmap v352: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:08:23.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:23 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2077932699' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-08-01T07:08:23.729 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-08-01T07:08:23.729 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-08-01T07:08:23.729 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 34 2024-08-01T07:08:23.944 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:08:25.349 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:25 smithi016 ceph-mon[93645]: pgmap v353: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:08:25.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:25 smithi089 ceph-mon[82218]: pgmap v353: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:08:25.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.685+0000 7fbafea0e640 1 -- 172.21.15.16:0/3284230674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbaf8100d50 msgr2=0x7fbaf8101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:25.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.685+0000 7fbafea0e640 1 --2- 172.21.15.16:0/3284230674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbaf8100d50 0x7fbaf8101130 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbae8009880 tx=0x7fbae802a530 comp rx=0 tx=0).stop 2024-08-01T07:08:25.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.685+0000 7fbafea0e640 1 -- 172.21.15.16:0/3284230674 shutdown_connections 2024-08-01T07:08:25.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.685+0000 7fbafea0e640 1 --2- 172.21.15.16:0/3284230674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaf8101670 0x7fbaf8109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:25.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.685+0000 7fbafea0e640 1 --2- 172.21.15.16:0/3284230674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbaf8100d50 0x7fbaf8101130 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:25.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.685+0000 7fbafea0e640 1 -- 172.21.15.16:0/3284230674 >> 172.21.15.16:0/3284230674 conn(0x7fbaf80758a0 msgr2=0x7fbaf80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:25.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.685+0000 7fbafea0e640 1 -- 172.21.15.16:0/3284230674 shutdown_connections 2024-08-01T07:08:25.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.685+0000 7fbafea0e640 1 -- 172.21.15.16:0/3284230674 wait complete. 2024-08-01T07:08:25.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.686+0000 7fbafea0e640 1 Processor -- start 2024-08-01T07:08:25.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.686+0000 7fbafea0e640 1 -- start start 2024-08-01T07:08:25.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.686+0000 7fbafea0e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbaf8100d50 0x7fbaf80fe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:25.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.686+0000 7fbafea0e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaf8101670 0x7fbaf80feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:25.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.686+0000 7fbafea0e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf80ff430 con 0x7fbaf8100d50 2024-08-01T07:08:25.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.686+0000 7fbafea0e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf80ff5a0 con 0x7fbaf8101670 2024-08-01T07:08:25.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.686+0000 7fbaf7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbaf8100d50 0x7fbaf80fe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:25.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.686+0000 7fbaf7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbaf8100d50 0x7fbaf80fe9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47020/0 (socket says 172.21.15.16:47020) 2024-08-01T07:08:25.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.686+0000 7fbaf7fff640 1 -- 172.21.15.16:0/598981712 learned_addr learned my addr 172.21.15.16:0/598981712 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:08:25.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.686+0000 7fbaf77fe640 1 --2- 172.21.15.16:0/598981712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaf8101670 0x7fbaf80feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:25.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.687+0000 7fbaf7fff640 1 -- 172.21.15.16:0/598981712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaf8101670 msgr2=0x7fbaf80feef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:25.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.687+0000 7fbaf7fff640 1 --2- 172.21.15.16:0/598981712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaf8101670 0x7fbaf80feef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:25.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.687+0000 7fbaf7fff640 1 -- 172.21.15.16:0/598981712 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae8009560 con 0x7fbaf8100d50 2024-08-01T07:08:25.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.687+0000 7fbaf7fff640 1 --2- 172.21.15.16:0/598981712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbaf8100d50 0x7fbaf80fe9b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbae8006010 tx=0x7fbae8032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:25.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.687+0000 7fbaf57fa640 1 -- 172.21.15.16:0/598981712 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbae80051f0 con 0x7fbaf8100d50 2024-08-01T07:08:25.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.687+0000 7fbaf57fa640 1 -- 172.21.15.16:0/598981712 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbae8005d50 con 0x7fbaf8100d50 2024-08-01T07:08:25.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.687+0000 7fbaf57fa640 1 -- 172.21.15.16:0/598981712 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbae80039e0 con 0x7fbaf8100d50 2024-08-01T07:08:25.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.687+0000 7fbafea0e640 1 -- 172.21.15.16:0/598981712 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf80ff820 con 0x7fbaf8100d50 2024-08-01T07:08:25.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.687+0000 7fbafea0e640 1 -- 172.21.15.16:0/598981712 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf81a1f60 con 0x7fbaf8100d50 2024-08-01T07:08:25.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.688+0000 7fbafea0e640 1 -- 172.21.15.16:0/598981712 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf8068470 con 0x7fbaf8100d50 2024-08-01T07:08:25.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.689+0000 7fbaf57fa640 1 -- 172.21.15.16:0/598981712 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbae802ad50 con 0x7fbaf8100d50 2024-08-01T07:08:25.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.689+0000 7fbaf57fa640 1 --2- 172.21.15.16:0/598981712 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fbae006e180 0x7fbae0070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:25.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.689+0000 7fbaf57fa640 1 -- 172.21.15.16:0/598981712 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fbae80ae850 con 0x7fbaf8100d50 2024-08-01T07:08:25.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.689+0000 7fbaf77fe640 1 --2- 172.21.15.16:0/598981712 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fbae006e180 0x7fbae0070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:25.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.690+0000 7fbaf77fe640 1 --2- 172.21.15.16:0/598981712 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fbae006e180 0x7fbae0070640 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8100130 tx=0x7fbaec00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:25.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.693+0000 7fbaf57fa640 1 -- 172.21.15.16:0/598981712 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fbae8077ac0 con 0x7fbaf8100d50 2024-08-01T07:08:25.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.904+0000 7fbafea0e640 1 -- 172.21.15.16:0/598981712 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7fbaf80ff7f0 con 0x7fbaf8100d50 2024-08-01T07:08:25.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.905+0000 7fbaf57fa640 1 -- 172.21.15.16:0/598981712 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v38) v1 ==== 107+0+4404 (secure 0 0 0) 0x7fbae807b180 con 0x7fbaf8100d50 2024-08-01T07:08:25.907 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:08:25.907 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":34,"btime":"2024-08-01T07:04:01:051676+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34446,"name":"cephfs.smithi016.fziqod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6829/2186852070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2186852070},{"type":"v1","addr":"172.21.15.16:6829","nonce":2186852070}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44357,"name":"cephfs.smithi089.jhouje","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6825/3335707325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3335707325},{"type":"v1","addr":"172.21.15.89:6825","nonce":3335707325}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T07:03:30.995134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34414},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34414":{"gid":34414,"name":"cephfs.smithi016.bgqkxu","rank":0,"incarnation":27,"state":"up:active","state_seq":9,"addr":"172.21.15.16:6827/4064792079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":4064792079},{"type":"v1","addr":"172.21.15.16:6827","nonce":4064792079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34414,"qdb_cluster":[34414]},"id":1}]} 2024-08-01T07:08:25.907 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 34 2024-08-01T07:08:25.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.907+0000 7fbafea0e640 1 -- 172.21.15.16:0/598981712 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fbae006e180 msgr2=0x7fbae0070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:25.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.907+0000 7fbafea0e640 1 --2- 172.21.15.16:0/598981712 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fbae006e180 0x7fbae0070640 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8100130 tx=0x7fbaec00b390 comp rx=0 tx=0).stop 2024-08-01T07:08:25.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.907+0000 7fbafea0e640 1 -- 172.21.15.16:0/598981712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbaf8100d50 msgr2=0x7fbaf80fe9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:25.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.907+0000 7fbafea0e640 1 --2- 172.21.15.16:0/598981712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbaf8100d50 0x7fbaf80fe9b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbae8006010 tx=0x7fbae8032bb0 comp rx=0 tx=0).stop 2024-08-01T07:08:25.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.907+0000 7fbafea0e640 1 -- 172.21.15.16:0/598981712 shutdown_connections 2024-08-01T07:08:25.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.907+0000 7fbafea0e640 1 --2- 172.21.15.16:0/598981712 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fbae006e180 0x7fbae0070640 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:25.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.907+0000 7fbafea0e640 1 --2- 172.21.15.16:0/598981712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaf8101670 0x7fbaf80feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:25.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.907+0000 7fbafea0e640 1 --2- 172.21.15.16:0/598981712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbaf8100d50 0x7fbaf80fe9b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:25.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.907+0000 7fbafea0e640 1 -- 172.21.15.16:0/598981712 >> 172.21.15.16:0/598981712 conn(0x7fbaf80758a0 msgr2=0x7fbaf8101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:25.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.907+0000 7fbafea0e640 1 -- 172.21.15.16:0/598981712 shutdown_connections 2024-08-01T07:08:25.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:25.907+0000 7fbafea0e640 1 -- 172.21.15.16:0/598981712 wait complete. 2024-08-01T07:08:26.281 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:26 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/598981712' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-08-01T07:08:26.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:26 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/598981712' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-08-01T07:08:26.611 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-08-01T07:08:26.611 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-08-01T07:08:26.611 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 35 2024-08-01T07:08:26.825 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:08:27.285 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:27 smithi016 ceph-mon[93645]: pgmap v354: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:08:27.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:27 smithi089 ceph-mon[82218]: pgmap v354: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:08:28.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.457+0000 7fcce615a640 1 -- 172.21.15.16:0/170390126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce0104a30 msgr2=0x7fcce0104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:28.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.457+0000 7fcce615a640 1 --2- 172.21.15.16:0/170390126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce0104a30 0x7fcce0104e10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009880 tx=0x7fccd002a4a0 comp rx=0 tx=0).stop 2024-08-01T07:08:28.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.457+0000 7fcce615a640 1 -- 172.21.15.16:0/170390126 shutdown_connections 2024-08-01T07:08:28.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.457+0000 7fcce615a640 1 --2- 172.21.15.16:0/170390126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcce00fea30 0x7fcce00fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:28.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.457+0000 7fcce615a640 1 --2- 172.21.15.16:0/170390126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce0104a30 0x7fcce0104e10 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:28.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.457+0000 7fcce615a640 1 -- 172.21.15.16:0/170390126 >> 172.21.15.16:0/170390126 conn(0x7fcce00fa730 msgr2=0x7fcce00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:28.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.458+0000 7fcce615a640 1 -- 172.21.15.16:0/170390126 shutdown_connections 2024-08-01T07:08:28.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.458+0000 7fcce615a640 1 -- 172.21.15.16:0/170390126 wait complete. 2024-08-01T07:08:28.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.458+0000 7fcce615a640 1 Processor -- start 2024-08-01T07:08:28.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.458+0000 7fcce615a640 1 -- start start 2024-08-01T07:08:28.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.458+0000 7fcce615a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcce00fea30 0x7fcce019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:28.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.458+0000 7fcce615a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce0104a30 0x7fcce019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:28.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.458+0000 7fcce615a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce019c3b0 con 0x7fcce0104a30 2024-08-01T07:08:28.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.458+0000 7fcce615a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce0195940 con 0x7fcce00fea30 2024-08-01T07:08:28.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.459+0000 7fccd7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce0104a30 0x7fcce019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:28.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.459+0000 7fccd7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce0104a30 0x7fcce019bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47044/0 (socket says 172.21.15.16:47044) 2024-08-01T07:08:28.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.459+0000 7fccd7fff640 1 -- 172.21.15.16:0/2646157530 learned_addr learned my addr 172.21.15.16:0/2646157530 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:08:28.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.459+0000 7fccdf7fe640 1 --2- 172.21.15.16:0/2646157530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcce00fea30 0x7fcce019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:28.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.459+0000 7fccd7fff640 1 -- 172.21.15.16:0/2646157530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcce00fea30 msgr2=0x7fcce019b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:28.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.459+0000 7fccd7fff640 1 --2- 172.21.15.16:0/2646157530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcce00fea30 0x7fcce019b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:28.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.459+0000 7fccd7fff640 1 -- 172.21.15.16:0/2646157530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd0009560 con 0x7fcce0104a30 2024-08-01T07:08:28.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.459+0000 7fccdf7fe640 1 --2- 172.21.15.16:0/2646157530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcce00fea30 0x7fcce019b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-01T07:08:28.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.459+0000 7fccd7fff640 1 --2- 172.21.15.16:0/2646157530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce0104a30 0x7fcce019bd90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fccc800d6f0 tx=0x7fccc800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:28.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.459+0000 7fccdd7fa640 1 -- 172.21.15.16:0/2646157530 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccc8009a30 con 0x7fcce0104a30 2024-08-01T07:08:28.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.459+0000 7fcce615a640 1 -- 172.21.15.16:0/2646157530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce0195c20 con 0x7fcce0104a30 2024-08-01T07:08:28.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.459+0000 7fccdd7fa640 1 -- 172.21.15.16:0/2646157530 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fccc80054e0 con 0x7fcce0104a30 2024-08-01T07:08:28.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.459+0000 7fccdd7fa640 1 -- 172.21.15.16:0/2646157530 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccc8010460 con 0x7fcce0104a30 2024-08-01T07:08:28.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.459+0000 7fcce615a640 1 -- 172.21.15.16:0/2646157530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce0196170 con 0x7fcce0104a30 2024-08-01T07:08:28.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.460+0000 7fcce615a640 1 -- 172.21.15.16:0/2646157530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce0100170 con 0x7fcce0104a30 2024-08-01T07:08:28.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.461+0000 7fccdd7fa640 1 -- 172.21.15.16:0/2646157530 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fccc8009b90 con 0x7fcce0104a30 2024-08-01T07:08:28.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.461+0000 7fccdd7fa640 1 --2- 172.21.15.16:0/2646157530 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fcccc06e170 0x7fcccc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:28.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.462+0000 7fccdd7fa640 1 -- 172.21.15.16:0/2646157530 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fccc808de80 con 0x7fcce0104a30 2024-08-01T07:08:28.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.462+0000 7fccdf7fe640 1 --2- 172.21.15.16:0/2646157530 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fcccc06e170 0x7fcccc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:28.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.462+0000 7fccdf7fe640 1 --2- 172.21.15.16:0/2646157530 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fcccc06e170 0x7fcccc070630 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fccd0006010 tx=0x7fccd0005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:28.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.466+0000 7fccdd7fa640 1 -- 172.21.15.16:0/2646157530 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fccc8057040 con 0x7fcce0104a30 2024-08-01T07:08:28.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.679+0000 7fcce615a640 1 -- 172.21.15.16:0/2646157530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7fcce0107fb0 con 0x7fcce0104a30 2024-08-01T07:08:28.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.679+0000 7fccdd7fa640 1 -- 172.21.15.16:0/2646157530 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v38) v1 ==== 107+0+5248 (secure 0 0 0) 0x7fccc805a700 con 0x7fcce0104a30 2024-08-01T07:08:28.682 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:08:28.682 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":35,"btime":"2024-08-01T07:04:04:063152+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34446,"name":"cephfs.smithi016.fziqod","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6829/2186852070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2186852070},{"type":"v1","addr":"172.21.15.16:6829","nonce":2186852070}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44357,"name":"cephfs.smithi089.jhouje","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6825/3335707325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3335707325},{"type":"v1","addr":"172.21.15.89:6825","nonce":3335707325}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":44387,"name":"cephfs.smithi089.xanuld","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/885893699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":885893699},{"type":"v1","addr":"172.21.15.89:6827","nonce":885893699}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T07:03:30.995134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34414},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34414":{"gid":34414,"name":"cephfs.smithi016.bgqkxu","rank":0,"incarnation":27,"state":"up:active","state_seq":9,"addr":"172.21.15.16:6827/4064792079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":4064792079},{"type":"v1","addr":"172.21.15.16:6827","nonce":4064792079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34414,"qdb_cluster":[34414]},"id":1}]} 2024-08-01T07:08:28.682 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 35 2024-08-01T07:08:28.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.681+0000 7fcce615a640 1 -- 172.21.15.16:0/2646157530 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fcccc06e170 msgr2=0x7fcccc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:28.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.681+0000 7fcce615a640 1 --2- 172.21.15.16:0/2646157530 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fcccc06e170 0x7fcccc070630 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fccd0006010 tx=0x7fccd0005e60 comp rx=0 tx=0).stop 2024-08-01T07:08:28.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.681+0000 7fcce615a640 1 -- 172.21.15.16:0/2646157530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce0104a30 msgr2=0x7fcce019bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:28.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.681+0000 7fcce615a640 1 --2- 172.21.15.16:0/2646157530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce0104a30 0x7fcce019bd90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fccc800d6f0 tx=0x7fccc800dbb0 comp rx=0 tx=0).stop 2024-08-01T07:08:28.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.681+0000 7fcce615a640 1 -- 172.21.15.16:0/2646157530 shutdown_connections 2024-08-01T07:08:28.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.682+0000 7fcce615a640 1 --2- 172.21.15.16:0/2646157530 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fcccc06e170 0x7fcccc070630 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:28.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.682+0000 7fcce615a640 1 --2- 172.21.15.16:0/2646157530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce0104a30 0x7fcce019bd90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:28.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.682+0000 7fcce615a640 1 --2- 172.21.15.16:0/2646157530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcce00fea30 0x7fcce019b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:28.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.682+0000 7fcce615a640 1 -- 172.21.15.16:0/2646157530 >> 172.21.15.16:0/2646157530 conn(0x7fcce00fa730 msgr2=0x7fcce0068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:28.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.682+0000 7fcce615a640 1 -- 172.21.15.16:0/2646157530 shutdown_connections 2024-08-01T07:08:28.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:28.682+0000 7fcce615a640 1 -- 172.21.15.16:0/2646157530 wait complete. 2024-08-01T07:08:29.322 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:29 smithi016 ceph-mon[93645]: pgmap v355: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:08:29.323 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:29 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2646157530' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-08-01T07:08:29.346 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-08-01T07:08:29.346 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-08-01T07:08:29.347 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 36 2024-08-01T07:08:29.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:29 smithi089 ceph-mon[82218]: pgmap v355: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:08:29.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:29 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2646157530' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-08-01T07:08:29.563 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:08:31.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.274+0000 7fa006bf4640 1 -- 172.21.15.16:0/1909832627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa000100750 msgr2=0x7fa0001047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:31.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.274+0000 7fa006bf4640 1 --2- 172.21.15.16:0/1909832627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa000100750 0x7fa0001047a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009880 tx=0x7f9fec02a4a0 comp rx=0 tx=0).stop 2024-08-01T07:08:31.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.274+0000 7fa006bf4640 1 -- 172.21.15.16:0/1909832627 shutdown_connections 2024-08-01T07:08:31.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.274+0000 7fa006bf4640 1 --2- 172.21.15.16:0/1909832627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa000100750 0x7fa0001047a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:31.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.274+0000 7fa006bf4640 1 --2- 172.21.15.16:0/1909832627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0000ffda0 0x7fa000100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:31.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.274+0000 7fa006bf4640 1 -- 172.21.15.16:0/1909832627 >> 172.21.15.16:0/1909832627 conn(0x7fa0000fb840 msgr2=0x7fa0000fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:31.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.274+0000 7fa006bf4640 1 -- 172.21.15.16:0/1909832627 shutdown_connections 2024-08-01T07:08:31.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.274+0000 7fa006bf4640 1 -- 172.21.15.16:0/1909832627 wait complete. 2024-08-01T07:08:31.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.275+0000 7fa006bf4640 1 Processor -- start 2024-08-01T07:08:31.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.275+0000 7fa006bf4640 1 -- start start 2024-08-01T07:08:31.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.275+0000 7fa006bf4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0000ffda0 0x7fa0000727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:31.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.275+0000 7fa006bf4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa000100750 0x7fa000072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:31.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.275+0000 7fa006bf4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa000073230 con 0x7fa0000ffda0 2024-08-01T07:08:31.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.275+0000 7fa006bf4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0000733a0 con 0x7fa000100750 2024-08-01T07:08:31.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.275+0000 7fa004990640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0000ffda0 0x7fa0000727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:31.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.275+0000 7fa004990640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0000ffda0 0x7fa0000727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40164/0 (socket says 172.21.15.16:40164) 2024-08-01T07:08:31.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.275+0000 7fa004990640 1 -- 172.21.15.16:0/421133888 learned_addr learned my addr 172.21.15.16:0/421133888 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:08:31.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.275+0000 7f9ffffff640 1 --2- 172.21.15.16:0/421133888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa000100750 0x7fa000072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:31.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.275+0000 7fa004990640 1 -- 172.21.15.16:0/421133888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa000100750 msgr2=0x7fa000072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:31.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.275+0000 7fa004990640 1 --2- 172.21.15.16:0/421133888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa000100750 0x7fa000072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:31.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.276+0000 7fa004990640 1 -- 172.21.15.16:0/421133888 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec009560 con 0x7fa0000ffda0 2024-08-01T07:08:31.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.276+0000 7f9ffffff640 1 --2- 172.21.15.16:0/421133888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa000100750 0x7fa000072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-01T07:08:31.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.276+0000 7fa004990640 1 --2- 172.21.15.16:0/421133888 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0000ffda0 0x7fa0000727b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400b420 tx=0x7f9ff400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:31.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.276+0000 7f9ffdffb640 1 -- 172.21.15.16:0/421133888 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ff4011800 con 0x7fa0000ffda0 2024-08-01T07:08:31.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.276+0000 7f9ffdffb640 1 -- 172.21.15.16:0/421133888 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ff4011e20 con 0x7fa0000ffda0 2024-08-01T07:08:31.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.276+0000 7fa006bf4640 1 -- 172.21.15.16:0/421133888 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0001a1d90 con 0x7fa0000ffda0 2024-08-01T07:08:31.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.276+0000 7f9ffdffb640 1 -- 172.21.15.16:0/421133888 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ff400f2e0 con 0x7fa0000ffda0 2024-08-01T07:08:31.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.276+0000 7fa006bf4640 1 -- 172.21.15.16:0/421133888 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0001a20f0 con 0x7fa0000ffda0 2024-08-01T07:08:31.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.277+0000 7fa006bf4640 1 -- 172.21.15.16:0/421133888 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa000101280 con 0x7fa0000ffda0 2024-08-01T07:08:31.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.278+0000 7f9ffdffb640 1 -- 172.21.15.16:0/421133888 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9ff4010380 con 0x7fa0000ffda0 2024-08-01T07:08:31.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.278+0000 7f9ffdffb640 1 --2- 172.21.15.16:0/421133888 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9ff006e170 0x7f9ff0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:31.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.278+0000 7f9ffdffb640 1 -- 172.21.15.16:0/421133888 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f9ff408dc10 con 0x7fa0000ffda0 2024-08-01T07:08:31.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.278+0000 7f9ffffff640 1 --2- 172.21.15.16:0/421133888 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9ff006e170 0x7f9ff0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:31.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.279+0000 7f9ffffff640 1 --2- 172.21.15.16:0/421133888 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9ff006e170 0x7f9ff0070630 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9fec006010 tx=0x7f9fec005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:31.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.283+0000 7f9ffdffb640 1 -- 172.21.15.16:0/421133888 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9ff4056dd0 con 0x7fa0000ffda0 2024-08-01T07:08:31.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:31 smithi089 ceph-mon[82218]: pgmap v356: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:08:31.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:31 smithi016 ceph-mon[93645]: pgmap v356: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:08:31.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.500+0000 7fa006bf4640 1 -- 172.21.15.16:0/421133888 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7fa000073560 con 0x7fa0000ffda0 2024-08-01T07:08:31.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.501+0000 7f9ffdffb640 1 -- 172.21.15.16:0/421133888 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v38) v1 ==== 107+0+5265 (secure 0 0 0) 0x7fa000073560 con 0x7fa0000ffda0 2024-08-01T07:08:31.504 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:08:31.504 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":36,"btime":"2024-08-01T07:04:10:584796+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44357,"name":"cephfs.smithi089.jhouje","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6825/3335707325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3335707325},{"type":"v1","addr":"172.21.15.89:6825","nonce":3335707325}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":44387,"name":"cephfs.smithi089.xanuld","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/885893699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":885893699},{"type":"v1","addr":"172.21.15.89:6827","nonce":885893699}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T07:04:10.584765+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34414,"mds_1":34446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34414":{"gid":34414,"name":"cephfs.smithi016.bgqkxu","rank":0,"incarnation":27,"state":"up:active","state_seq":9,"addr":"172.21.15.16:6827/4064792079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":4064792079},{"type":"v1","addr":"172.21.15.16:6827","nonce":4064792079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34446":{"gid":34446,"name":"cephfs.smithi016.fziqod","rank":1,"incarnation":36,"state":"up:starting","state_seq":1,"addr":"172.21.15.16:6829/2186852070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2186852070},{"type":"v1","addr":"172.21.15.16:6829","nonce":2186852070}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34414,"qdb_cluster":[34414]},"id":1}]} 2024-08-01T07:08:31.504 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 36 2024-08-01T07:08:31.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.504+0000 7fa006bf4640 1 -- 172.21.15.16:0/421133888 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9ff006e170 msgr2=0x7f9ff0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:31.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.504+0000 7fa006bf4640 1 --2- 172.21.15.16:0/421133888 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9ff006e170 0x7f9ff0070630 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9fec006010 tx=0x7f9fec005e60 comp rx=0 tx=0).stop 2024-08-01T07:08:31.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.504+0000 7fa006bf4640 1 -- 172.21.15.16:0/421133888 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0000ffda0 msgr2=0x7fa0000727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:31.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.504+0000 7fa006bf4640 1 --2- 172.21.15.16:0/421133888 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0000ffda0 0x7fa0000727b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400b420 tx=0x7f9ff400b8e0 comp rx=0 tx=0).stop 2024-08-01T07:08:31.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.504+0000 7fa006bf4640 1 -- 172.21.15.16:0/421133888 shutdown_connections 2024-08-01T07:08:31.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.504+0000 7fa006bf4640 1 --2- 172.21.15.16:0/421133888 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f9ff006e170 0x7f9ff0070630 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:31.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.504+0000 7fa006bf4640 1 --2- 172.21.15.16:0/421133888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa000100750 0x7fa000072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:31.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.504+0000 7fa006bf4640 1 --2- 172.21.15.16:0/421133888 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0000ffda0 0x7fa0000727b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:31.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.504+0000 7fa006bf4640 1 -- 172.21.15.16:0/421133888 >> 172.21.15.16:0/421133888 conn(0x7fa0000fb840 msgr2=0x7fa0000fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:31.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.504+0000 7fa006bf4640 1 -- 172.21.15.16:0/421133888 shutdown_connections 2024-08-01T07:08:31.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:31.504+0000 7fa006bf4640 1 -- 172.21.15.16:0/421133888 wait complete. 2024-08-01T07:08:32.172 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-08-01T07:08:32.172 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 37 2024-08-01T07:08:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:32 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/421133888' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-08-01T07:08:32.393 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:08:32.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:32 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/421133888' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-08-01T07:08:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:33 smithi089 ceph-mon[82218]: pgmap v357: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:08:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:33 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:08:33.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:33 smithi016 ceph-mon[93645]: pgmap v357: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:08:33.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:33 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:08:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.064+0000 7fa939e8e640 1 -- 172.21.15.16:0/1711752126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9340fe400 msgr2=0x7fa9340fe7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.064+0000 7fa939e8e640 1 --2- 172.21.15.16:0/1711752126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9340fe400 0x7fa9340fe7e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa92400a990 tx=0x7fa92402b7d0 comp rx=0 tx=0).stop 2024-08-01T07:08:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.064+0000 7fa939e8e640 1 -- 172.21.15.16:0/1711752126 shutdown_connections 2024-08-01T07:08:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.064+0000 7fa939e8e640 1 --2- 172.21.15.16:0/1711752126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9340fedb0 0x7fa934102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:34.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.064+0000 7fa939e8e640 1 --2- 172.21.15.16:0/1711752126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9340fe400 0x7fa9340fe7e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:34.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.064+0000 7fa939e8e640 1 -- 172.21.15.16:0/1711752126 >> 172.21.15.16:0/1711752126 conn(0x7fa9340f9ec0 msgr2=0x7fa9340fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:34.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.064+0000 7fa939e8e640 1 -- 172.21.15.16:0/1711752126 shutdown_connections 2024-08-01T07:08:34.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.064+0000 7fa939e8e640 1 -- 172.21.15.16:0/1711752126 wait complete. 2024-08-01T07:08:34.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.065+0000 7fa939e8e640 1 Processor -- start 2024-08-01T07:08:34.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.065+0000 7fa939e8e640 1 -- start start 2024-08-01T07:08:34.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.065+0000 7fa939e8e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9340fe400 0x7fa934193650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:34.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.065+0000 7fa939e8e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9340fedb0 0x7fa934193b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:34.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.065+0000 7fa939e8e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9341940d0 con 0x7fa9340fe400 2024-08-01T07:08:34.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.065+0000 7fa939e8e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa934194240 con 0x7fa9340fedb0 2024-08-01T07:08:34.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.065+0000 7fa9337fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9340fe400 0x7fa934193650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:34.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.065+0000 7fa9337fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9340fe400 0x7fa934193650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40182/0 (socket says 172.21.15.16:40182) 2024-08-01T07:08:34.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.065+0000 7fa9337fe640 1 -- 172.21.15.16:0/1514245898 learned_addr learned my addr 172.21.15.16:0/1514245898 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:08:34.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.065+0000 7fa932ffd640 1 --2- 172.21.15.16:0/1514245898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9340fedb0 0x7fa934193b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:34.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.065+0000 7fa9337fe640 1 -- 172.21.15.16:0/1514245898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9340fedb0 msgr2=0x7fa934193b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:34.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.065+0000 7fa9337fe640 1 --2- 172.21.15.16:0/1514245898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9340fedb0 0x7fa934193b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:34.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.066+0000 7fa9337fe640 1 -- 172.21.15.16:0/1514245898 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92400a670 con 0x7fa9340fe400 2024-08-01T07:08:34.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.066+0000 7fa9337fe640 1 --2- 172.21.15.16:0/1514245898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9340fe400 0x7fa934193650 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa92402bcf0 tx=0x7fa9240048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:34.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.066+0000 7fa930ff9640 1 -- 172.21.15.16:0/1514245898 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa924004420 con 0x7fa9340fe400 2024-08-01T07:08:34.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.066+0000 7fa930ff9640 1 -- 172.21.15.16:0/1514245898 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa924004ac0 con 0x7fa9340fe400 2024-08-01T07:08:34.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.066+0000 7fa939e8e640 1 -- 172.21.15.16:0/1514245898 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9341944c0 con 0x7fa9340fe400 2024-08-01T07:08:34.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.066+0000 7fa930ff9640 1 -- 172.21.15.16:0/1514245898 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa924005270 con 0x7fa9340fe400 2024-08-01T07:08:34.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.066+0000 7fa939e8e640 1 -- 172.21.15.16:0/1514245898 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9341a1ed0 con 0x7fa9340fe400 2024-08-01T07:08:34.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.067+0000 7fa939e8e640 1 -- 172.21.15.16:0/1514245898 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9340ff8e0 con 0x7fa9340fe400 2024-08-01T07:08:34.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.067+0000 7fa930ff9640 1 -- 172.21.15.16:0/1514245898 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa9240054e0 con 0x7fa9340fe400 2024-08-01T07:08:34.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.068+0000 7fa930ff9640 1 --2- 172.21.15.16:0/1514245898 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa91c06e170 0x7fa91c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:34.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.068+0000 7fa930ff9640 1 -- 172.21.15.16:0/1514245898 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7fa9240af630 con 0x7fa9340fe400 2024-08-01T07:08:34.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.068+0000 7fa932ffd640 1 --2- 172.21.15.16:0/1514245898 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa91c06e170 0x7fa91c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:34.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.069+0000 7fa932ffd640 1 --2- 172.21.15.16:0/1514245898 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa91c06e170 0x7fa91c070630 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa934194d80 tx=0x7fa92800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:34.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.072+0000 7fa930ff9640 1 -- 172.21.15.16:0/1514245898 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa9240788a0 con 0x7fa9340fe400 2024-08-01T07:08:34.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.286+0000 7fa939e8e640 1 -- 172.21.15.16:0/1514245898 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7fa9341944c0 con 0x7fa9340fe400 2024-08-01T07:08:34.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.287+0000 7fa930ff9640 1 -- 172.21.15.16:0/1514245898 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v38) v1 ==== 107+0+5269 (secure 0 0 0) 0x7fa9341944c0 con 0x7fa9340fe400 2024-08-01T07:08:34.290 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-08-01T07:08:34.290 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":37,"btime":"2024-08-01T07:04:11:590084+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44357,"name":"cephfs.smithi089.jhouje","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6825/3335707325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3335707325},{"type":"v1","addr":"172.21.15.89:6825","nonce":3335707325}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":44387,"name":"cephfs.smithi089.xanuld","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/885893699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":885893699},{"type":"v1","addr":"172.21.15.89:6827","nonce":885893699}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-01T06:53:13.411160+0000","modified":"2024-08-01T07:04:11.590081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34414,"mds_1":34446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34414":{"gid":34414,"name":"cephfs.smithi016.bgqkxu","rank":0,"incarnation":27,"state":"up:active","state_seq":9,"addr":"172.21.15.16:6827/4064792079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":4064792079},{"type":"v1","addr":"172.21.15.16:6827","nonce":4064792079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34446":{"gid":34446,"name":"cephfs.smithi016.fziqod","rank":1,"incarnation":36,"state":"up:active","state_seq":11,"addr":"172.21.15.16:6829/2186852070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2186852070},{"type":"v1","addr":"172.21.15.16:6829","nonce":2186852070}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34414,"qdb_cluster":[34414,34446]},"id":1}]} 2024-08-01T07:08:34.290 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 37 2024-08-01T07:08:34.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.289+0000 7fa939e8e640 1 -- 172.21.15.16:0/1514245898 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa91c06e170 msgr2=0x7fa91c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:34.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.289+0000 7fa939e8e640 1 --2- 172.21.15.16:0/1514245898 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa91c06e170 0x7fa91c070630 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa934194d80 tx=0x7fa92800b390 comp rx=0 tx=0).stop 2024-08-01T07:08:34.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.289+0000 7fa939e8e640 1 -- 172.21.15.16:0/1514245898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9340fe400 msgr2=0x7fa934193650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:34.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.289+0000 7fa939e8e640 1 --2- 172.21.15.16:0/1514245898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9340fe400 0x7fa934193650 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa92402bcf0 tx=0x7fa9240048d0 comp rx=0 tx=0).stop 2024-08-01T07:08:34.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.289+0000 7fa939e8e640 1 -- 172.21.15.16:0/1514245898 shutdown_connections 2024-08-01T07:08:34.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.289+0000 7fa939e8e640 1 --2- 172.21.15.16:0/1514245898 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7fa91c06e170 0x7fa91c070630 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:34.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.289+0000 7fa939e8e640 1 --2- 172.21.15.16:0/1514245898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9340fedb0 0x7fa934193b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:34.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.289+0000 7fa939e8e640 1 --2- 172.21.15.16:0/1514245898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9340fe400 0x7fa934193650 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:34.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.289+0000 7fa939e8e640 1 -- 172.21.15.16:0/1514245898 >> 172.21.15.16:0/1514245898 conn(0x7fa9340f9ec0 msgr2=0x7fa9340fb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:34.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.289+0000 7fa939e8e640 1 -- 172.21.15.16:0/1514245898 shutdown_connections 2024-08-01T07:08:34.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:34.289+0000 7fa939e8e640 1 -- 172.21.15.16:0/1514245898 wait complete. 2024-08-01T07:08:34.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:34 smithi089 ceph-mon[82218]: pgmap v358: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:08:34.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:34 smithi016 ceph-mon[93645]: pgmap v358: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:08:34.932 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-08-01T07:08:34.944 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-08-01T07:08:34.944 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-08-01T07:08:34.944 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-01T07:08:34.964 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-08-01T07:08:34.964 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-01T07:08:35.025 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph osd blocklist ls 2024-08-01T07:08:35.285 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:08:35.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:35 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/1514245898' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-08-01T07:08:35.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:35 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/1514245898' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-08-01T07:08:36.784 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:36 smithi016 ceph-mon[93645]: pgmap v359: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:08:36.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.973+0000 7f29706f4640 1 -- 172.21.15.16:0/454695888 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29680fea20 msgr2=0x7f29680fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:36.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.973+0000 7f29706f4640 1 --2- 172.21.15.16:0/454695888 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29680fea20 0x7f29680fee80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2958009880 tx=0x7f295802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:08:36.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.973+0000 7f29706f4640 1 -- 172.21.15.16:0/454695888 shutdown_connections 2024-08-01T07:08:36.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.973+0000 7f29706f4640 1 --2- 172.21.15.16:0/454695888 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29680fea20 0x7f29680fee80 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:36.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.973+0000 7f29706f4640 1 --2- 172.21.15.16:0/454695888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2968104a20 0x7f2968104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:36.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.973+0000 7f29706f4640 1 -- 172.21.15.16:0/454695888 >> 172.21.15.16:0/454695888 conn(0x7f29680fa700 msgr2=0x7f29680fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:36.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.973+0000 7f29706f4640 1 -- 172.21.15.16:0/454695888 shutdown_connections 2024-08-01T07:08:36.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.973+0000 7f29706f4640 1 -- 172.21.15.16:0/454695888 wait complete. 2024-08-01T07:08:36.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.974+0000 7f29706f4640 1 Processor -- start 2024-08-01T07:08:36.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.974+0000 7f29706f4640 1 -- start start 2024-08-01T07:08:36.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.974+0000 7f29706f4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29680fea20 0x7f296819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:36.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.974+0000 7f29706f4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2968104a20 0x7f296819ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:36.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.974+0000 7f29706f4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296819b3b0 con 0x7f2968104a20 2024-08-01T07:08:36.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.974+0000 7f29706f4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2968194990 con 0x7f29680fea20 2024-08-01T07:08:36.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.974+0000 7f296dc8f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2968104a20 0x7f296819ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:36.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.974+0000 7f296dc8f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2968104a20 0x7f296819ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40210/0 (socket says 172.21.15.16:40210) 2024-08-01T07:08:36.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.974+0000 7f296dc8f640 1 -- 172.21.15.16:0/2248197692 learned_addr learned my addr 172.21.15.16:0/2248197692 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:08:36.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.975+0000 7f296e490640 1 --2- 172.21.15.16:0/2248197692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29680fea20 0x7f296819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:36.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.975+0000 7f296dc8f640 1 -- 172.21.15.16:0/2248197692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29680fea20 msgr2=0x7f296819a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:36.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.975+0000 7f296dc8f640 1 --2- 172.21.15.16:0/2248197692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29680fea20 0x7f296819a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:36.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.975+0000 7f296dc8f640 1 -- 172.21.15.16:0/2248197692 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2958009560 con 0x7f2968104a20 2024-08-01T07:08:36.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.975+0000 7f296dc8f640 1 --2- 172.21.15.16:0/2248197692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2968104a20 0x7f296819ad90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f295802a9c0 tx=0x7f29580055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:36.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.975+0000 7f295f7fe640 1 -- 172.21.15.16:0/2248197692 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2958004aa0 con 0x7f2968104a20 2024-08-01T07:08:36.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.975+0000 7f295f7fe640 1 -- 172.21.15.16:0/2248197692 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2958004c00 con 0x7f2968104a20 2024-08-01T07:08:36.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.975+0000 7f29706f4640 1 -- 172.21.15.16:0/2248197692 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2968194c10 con 0x7f2968104a20 2024-08-01T07:08:36.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.975+0000 7f295f7fe640 1 -- 172.21.15.16:0/2248197692 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2958003a20 con 0x7f2968104a20 2024-08-01T07:08:36.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.975+0000 7f29706f4640 1 -- 172.21.15.16:0/2248197692 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2968195100 con 0x7f2968104a20 2024-08-01T07:08:36.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.976+0000 7f29706f4640 1 -- 172.21.15.16:0/2248197692 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2968100160 con 0x7f2968104a20 2024-08-01T07:08:36.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.977+0000 7f295f7fe640 1 -- 172.21.15.16:0/2248197692 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2958031c90 con 0x7f2968104a20 2024-08-01T07:08:36.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.977+0000 7f295f7fe640 1 --2- 172.21.15.16:0/2248197692 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f295406e170 0x7f2954070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:36.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.977+0000 7f295f7fe640 1 -- 172.21.15.16:0/2248197692 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f29580af340 con 0x7f2968104a20 2024-08-01T07:08:36.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.977+0000 7f296e490640 1 --2- 172.21.15.16:0/2248197692 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f295406e170 0x7f2954070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:36.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.978+0000 7f296e490640 1 --2- 172.21.15.16:0/2248197692 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f295406e170 0x7f2954070630 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2964009990 tx=0x7f2964009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:36.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:36.982+0000 7f295f7fe640 1 -- 172.21.15.16:0/2248197692 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2958078500 con 0x7f2968104a20 2024-08-01T07:08:37.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:36 smithi089 ceph-mon[82218]: pgmap v359: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:08:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:37.182+0000 7f29706f4640 1 -- 172.21.15.16:0/2248197692 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f29680fef00 con 0x7f2968104a20 2024-08-01T07:08:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:37.182+0000 7f295f7fe640 1 -- 172.21.15.16:0/2248197692 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v96) v1 ==== 81+0+2416 (secure 0 0 0) 0x7f295807bbc0 con 0x7f2968104a20 2024-08-01T07:08:37.185 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6829/2984549955 2024-08-02T07:03:20.060775+0000 2024-08-01T07:08:37.185 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6828/2984549955 2024-08-02T07:03:20.060775+0000 2024-08-01T07:08:37.185 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/603673945 2024-08-02T06:58:17.031331+0000 2024-08-01T07:08:37.185 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6801/4143462722 2024-08-02T06:58:17.031331+0000 2024-08-01T07:08:37.185 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6800/4143462722 2024-08-02T06:58:17.031331+0000 2024-08-01T07:08:37.186 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/90826538 2024-08-02T06:58:17.031331+0000 2024-08-01T07:08:37.186 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/4023169063 2024-08-02T06:58:17.031331+0000 2024-08-01T07:08:37.186 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/3738126 2024-08-02T06:58:17.031331+0000 2024-08-01T07:08:37.186 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/2891102165 2024-08-02T06:55:37.790248+0000 2024-08-01T07:08:37.186 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6800/247151947 2024-08-02T06:47:27.347897+0000 2024-08-01T07:08:37.186 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6801/3674863410 2024-08-02T06:46:56.352049+0000 2024-08-01T07:08:37.186 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6800/1423663197 2024-08-02T06:55:37.790248+0000 2024-08-01T07:08:37.186 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6801/1423663197 2024-08-02T06:55:37.790248+0000 2024-08-01T07:08:37.186 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/3966853485 2024-08-02T06:48:32.522874+0000 2024-08-01T07:08:37.186 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/3369355765 2024-08-02T06:46:56.352049+0000 2024-08-01T07:08:37.186 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.89:0/4250094449 2024-08-02T06:57:04.954715+0000 2024-08-01T07:08:37.186 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/1537399575 2024-08-02T06:55:37.790248+0000 2024-08-01T07:08:37.186 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6800/3674863410 2024-08-02T06:46:56.352049+0000 2024-08-01T07:08:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/1677922124 2024-08-02T06:58:17.031331+0000 2024-08-01T07:08:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6826/1582990915 2024-08-02T06:53:28.594215+0000 2024-08-01T07:08:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/1836104042 2024-08-02T06:48:32.522874+0000 2024-08-01T07:08:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/2028838931 2024-08-02T06:47:27.347897+0000 2024-08-01T07:08:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/320178436 2024-08-02T06:47:27.347897+0000 2024-08-01T07:08:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.89:0/2238189745 2024-08-02T06:57:04.954715+0000 2024-08-01T07:08:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6801/3100338993 2024-08-02T06:48:32.522874+0000 2024-08-01T07:08:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/2595787010 2024-08-02T06:47:27.347897+0000 2024-08-01T07:08:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/2604937406 2024-08-02T06:46:56.352049+0000 2024-08-01T07:08:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6800/3100338993 2024-08-02T06:48:32.522874+0000 2024-08-01T07:08:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/2947838469 2024-08-02T06:48:32.522874+0000 2024-08-01T07:08:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.89:0/1311576172 2024-08-02T06:57:04.954715+0000 2024-08-01T07:08:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/3238885863 2024-08-02T06:58:17.031331+0000 2024-08-01T07:08:37.188 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/2356611709 2024-08-02T06:46:56.352049+0000 2024-08-01T07:08:37.188 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.89:0/2493355411 2024-08-02T06:57:04.954715+0000 2024-08-01T07:08:37.188 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6801/247151947 2024-08-02T06:47:27.347897+0000 2024-08-01T07:08:37.188 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.89:0/1936153243 2024-08-02T06:57:04.954715+0000 2024-08-01T07:08:37.188 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.89:6829/2589785296 2024-08-02T06:57:04.954715+0000 2024-08-01T07:08:37.188 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/1946935911 2024-08-02T06:55:37.790248+0000 2024-08-01T07:08:37.188 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/876907707 2024-08-02T06:55:37.790248+0000 2024-08-01T07:08:37.188 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.89:0/4161305026 2024-08-02T06:57:04.954715+0000 2024-08-01T07:08:37.188 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6827/1582990915 2024-08-02T06:53:28.594215+0000 2024-08-01T07:08:37.188 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.89:6828/2589785296 2024-08-02T06:57:04.954715+0000 2024-08-01T07:08:37.189 INFO:teuthology.orchestra.run.smithi016.stderr:listed 41 entries 2024-08-01T07:08:37.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:37.184+0000 7f29706f4640 1 -- 172.21.15.16:0/2248197692 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f295406e170 msgr2=0x7f2954070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:37.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:37.184+0000 7f29706f4640 1 --2- 172.21.15.16:0/2248197692 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f295406e170 0x7f2954070630 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2964009990 tx=0x7f2964009110 comp rx=0 tx=0).stop 2024-08-01T07:08:37.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:37.184+0000 7f29706f4640 1 -- 172.21.15.16:0/2248197692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2968104a20 msgr2=0x7f296819ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:37.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:37.184+0000 7f29706f4640 1 --2- 172.21.15.16:0/2248197692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2968104a20 0x7f296819ad90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f295802a9c0 tx=0x7f29580055a0 comp rx=0 tx=0).stop 2024-08-01T07:08:37.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:37.184+0000 7f29706f4640 1 -- 172.21.15.16:0/2248197692 shutdown_connections 2024-08-01T07:08:37.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:37.184+0000 7f29706f4640 1 --2- 172.21.15.16:0/2248197692 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f295406e170 0x7f2954070630 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:37.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:37.184+0000 7f29706f4640 1 --2- 172.21.15.16:0/2248197692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2968104a20 0x7f296819ad90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:37.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:37.184+0000 7f29706f4640 1 --2- 172.21.15.16:0/2248197692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29680fea20 0x7f296819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:37.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:37.184+0000 7f29706f4640 1 -- 172.21.15.16:0/2248197692 >> 172.21.15.16:0/2248197692 conn(0x7f29680fa700 msgr2=0x7f29680fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:37.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:37.185+0000 7f29706f4640 1 -- 172.21.15.16:0/2248197692 shutdown_connections 2024-08-01T07:08:37.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:37.185+0000 7f29706f4640 1 -- 172.21.15.16:0/2248197692 wait complete. 2024-08-01T07:08:37.861 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-08-01T07:08:37.861 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-01T07:08:37.880 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid a88427da-4fd1-11ef-bcca-c7b262605968 -- ceph osd blocklist ls 2024-08-01T07:08:37.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:37 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2248197692' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-01T07:08:38.111 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/mon.smithi016/config 2024-08-01T07:08:38.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:37 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2248197692' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-01T07:08:38.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:38 smithi016 ceph-mon[93645]: pgmap v360: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:08:39.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:38 smithi089 ceph-mon[82218]: pgmap v360: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:08:39.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.772+0000 7f1583a8b640 1 -- 172.21.15.16:0/3104798067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f157c104a30 msgr2=0x7f157c104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:39.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.772+0000 7f1583a8b640 1 --2- 172.21.15.16:0/3104798067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f157c104a30 0x7f157c104e10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1578009880 tx=0x7f157802a4a0 comp rx=0 tx=0).stop 2024-08-01T07:08:39.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.772+0000 7f1583a8b640 1 -- 172.21.15.16:0/3104798067 shutdown_connections 2024-08-01T07:08:39.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.772+0000 7f1583a8b640 1 --2- 172.21.15.16:0/3104798067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f157c0fea30 0x7f157c0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:39.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.772+0000 7f1583a8b640 1 --2- 172.21.15.16:0/3104798067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f157c104a30 0x7f157c104e10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:39.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.772+0000 7f1583a8b640 1 -- 172.21.15.16:0/3104798067 >> 172.21.15.16:0/3104798067 conn(0x7f157c0fa730 msgr2=0x7f157c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:39.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.772+0000 7f1583a8b640 1 -- 172.21.15.16:0/3104798067 shutdown_connections 2024-08-01T07:08:39.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.772+0000 7f1583a8b640 1 -- 172.21.15.16:0/3104798067 wait complete. 2024-08-01T07:08:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.772+0000 7f1583a8b640 1 Processor -- start 2024-08-01T07:08:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.772+0000 7f1583a8b640 1 -- start start 2024-08-01T07:08:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.773+0000 7f1583a8b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f157c0fea30 0x7f157c19b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.773+0000 7f1583a8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f157c104a30 0x7f157c19bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.773+0000 7f1583a8b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c19c3b0 con 0x7f157c0fea30 2024-08-01T07:08:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.773+0000 7f1583a8b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c195940 con 0x7f157c104a30 2024-08-01T07:08:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.773+0000 7f1581827640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f157c0fea30 0x7f157c19b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.773+0000 7f1581827640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f157c0fea30 0x7f157c19b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54982/0 (socket says 172.21.15.16:54982) 2024-08-01T07:08:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.773+0000 7f1581827640 1 -- 172.21.15.16:0/2694749925 learned_addr learned my addr 172.21.15.16:0/2694749925 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-08-01T07:08:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.773+0000 7f1581026640 1 --2- 172.21.15.16:0/2694749925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f157c104a30 0x7f157c19bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.773+0000 7f1581827640 1 -- 172.21.15.16:0/2694749925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f157c104a30 msgr2=0x7f157c19bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.773+0000 7f1581827640 1 --2- 172.21.15.16:0/2694749925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f157c104a30 0x7f157c19bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.773+0000 7f1581827640 1 -- 172.21.15.16:0/2694749925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1578009560 con 0x7f157c0fea30 2024-08-01T07:08:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.773+0000 7f1581827640 1 --2- 172.21.15.16:0/2694749925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f157c0fea30 0x7f157c19b850 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1578006010 tx=0x7f15780055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.774+0000 7f1572ffd640 1 -- 172.21.15.16:0/2694749925 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1578004aa0 con 0x7f157c0fea30 2024-08-01T07:08:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.774+0000 7f1572ffd640 1 -- 172.21.15.16:0/2694749925 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1578031470 con 0x7f157c0fea30 2024-08-01T07:08:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.774+0000 7f1583a8b640 1 -- 172.21.15.16:0/2694749925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f157c195bc0 con 0x7f157c0fea30 2024-08-01T07:08:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.774+0000 7f1572ffd640 1 -- 172.21.15.16:0/2694749925 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1578003940 con 0x7f157c0fea30 2024-08-01T07:08:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.774+0000 7f1583a8b640 1 -- 172.21.15.16:0/2694749925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157c1960b0 con 0x7f157c0fea30 2024-08-01T07:08:39.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.775+0000 7f1583a8b640 1 -- 172.21.15.16:0/2694749925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f157c100170 con 0x7f157c0fea30 2024-08-01T07:08:39.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.775+0000 7f1572ffd640 1 -- 172.21.15.16:0/2694749925 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1578031b90 con 0x7f157c0fea30 2024-08-01T07:08:39.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.776+0000 7f1572ffd640 1 --2- 172.21.15.16:0/2694749925 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f156806e180 0x7f1568070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-01T07:08:39.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.776+0000 7f1572ffd640 1 -- 172.21.15.16:0/2694749925 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6876+0+0 (secure 0 0 0) 0x7f15780af300 con 0x7f157c0fea30 2024-08-01T07:08:39.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.776+0000 7f1581026640 1 --2- 172.21.15.16:0/2694749925 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f156806e180 0x7f1568070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-01T07:08:39.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.776+0000 7f1581026640 1 --2- 172.21.15.16:0/2694749925 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f156806e180 0x7f1568070640 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f157c196db0 tx=0x7f156c00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-01T07:08:39.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.780+0000 7f1572ffd640 1 -- 172.21.15.16:0/2694749925 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1578078570 con 0x7f157c0fea30 2024-08-01T07:08:39.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.969+0000 7f1583a8b640 1 -- 172.21.15.16:0/2694749925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f157c0fee90 con 0x7f157c0fea30 2024-08-01T07:08:39.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.970+0000 7f1572ffd640 1 -- 172.21.15.16:0/2694749925 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v96) v1 ==== 81+0+2416 (secure 0 0 0) 0x7f157c0fee90 con 0x7f157c0fea30 2024-08-01T07:08:39.971 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6829/2984549955 2024-08-02T07:03:20.060775+0000 2024-08-01T07:08:39.972 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6828/2984549955 2024-08-02T07:03:20.060775+0000 2024-08-01T07:08:39.972 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/603673945 2024-08-02T06:58:17.031331+0000 2024-08-01T07:08:39.972 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6801/4143462722 2024-08-02T06:58:17.031331+0000 2024-08-01T07:08:39.972 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6800/4143462722 2024-08-02T06:58:17.031331+0000 2024-08-01T07:08:39.972 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/90826538 2024-08-02T06:58:17.031331+0000 2024-08-01T07:08:39.972 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/4023169063 2024-08-02T06:58:17.031331+0000 2024-08-01T07:08:39.972 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/3738126 2024-08-02T06:58:17.031331+0000 2024-08-01T07:08:39.972 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/2891102165 2024-08-02T06:55:37.790248+0000 2024-08-01T07:08:39.972 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6800/247151947 2024-08-02T06:47:27.347897+0000 2024-08-01T07:08:39.972 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6801/3674863410 2024-08-02T06:46:56.352049+0000 2024-08-01T07:08:39.972 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6800/1423663197 2024-08-02T06:55:37.790248+0000 2024-08-01T07:08:39.973 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6801/1423663197 2024-08-02T06:55:37.790248+0000 2024-08-01T07:08:39.973 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/3966853485 2024-08-02T06:48:32.522874+0000 2024-08-01T07:08:39.973 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/3369355765 2024-08-02T06:46:56.352049+0000 2024-08-01T07:08:39.973 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.89:0/4250094449 2024-08-02T06:57:04.954715+0000 2024-08-01T07:08:39.973 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/1537399575 2024-08-02T06:55:37.790248+0000 2024-08-01T07:08:39.973 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6800/3674863410 2024-08-02T06:46:56.352049+0000 2024-08-01T07:08:39.973 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/1677922124 2024-08-02T06:58:17.031331+0000 2024-08-01T07:08:39.973 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6826/1582990915 2024-08-02T06:53:28.594215+0000 2024-08-01T07:08:39.973 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/1836104042 2024-08-02T06:48:32.522874+0000 2024-08-01T07:08:39.973 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/2028838931 2024-08-02T06:47:27.347897+0000 2024-08-01T07:08:39.973 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/320178436 2024-08-02T06:47:27.347897+0000 2024-08-01T07:08:39.973 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.89:0/2238189745 2024-08-02T06:57:04.954715+0000 2024-08-01T07:08:39.973 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6801/3100338993 2024-08-02T06:48:32.522874+0000 2024-08-01T07:08:39.974 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/2595787010 2024-08-02T06:47:27.347897+0000 2024-08-01T07:08:39.974 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/2604937406 2024-08-02T06:46:56.352049+0000 2024-08-01T07:08:39.974 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6800/3100338993 2024-08-02T06:48:32.522874+0000 2024-08-01T07:08:39.974 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/2947838469 2024-08-02T06:48:32.522874+0000 2024-08-01T07:08:39.974 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.89:0/1311576172 2024-08-02T06:57:04.954715+0000 2024-08-01T07:08:39.974 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/3238885863 2024-08-02T06:58:17.031331+0000 2024-08-01T07:08:39.974 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/2356611709 2024-08-02T06:46:56.352049+0000 2024-08-01T07:08:39.974 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.89:0/2493355411 2024-08-02T06:57:04.954715+0000 2024-08-01T07:08:39.974 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6801/247151947 2024-08-02T06:47:27.347897+0000 2024-08-01T07:08:39.974 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.89:0/1936153243 2024-08-02T06:57:04.954715+0000 2024-08-01T07:08:39.974 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.89:6829/2589785296 2024-08-02T06:57:04.954715+0000 2024-08-01T07:08:39.974 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/1946935911 2024-08-02T06:55:37.790248+0000 2024-08-01T07:08:39.974 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:0/876907707 2024-08-02T06:55:37.790248+0000 2024-08-01T07:08:39.975 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.89:0/4161305026 2024-08-02T06:57:04.954715+0000 2024-08-01T07:08:39.975 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6827/1582990915 2024-08-02T06:53:28.594215+0000 2024-08-01T07:08:39.975 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.89:6828/2589785296 2024-08-02T06:57:04.954715+0000 2024-08-01T07:08:39.975 INFO:teuthology.orchestra.run.smithi016.stderr:listed 41 entries 2024-08-01T07:08:39.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.972+0000 7f1583a8b640 1 -- 172.21.15.16:0/2694749925 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f156806e180 msgr2=0x7f1568070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:39.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.972+0000 7f1583a8b640 1 --2- 172.21.15.16:0/2694749925 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f156806e180 0x7f1568070640 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f157c196db0 tx=0x7f156c00b390 comp rx=0 tx=0).stop 2024-08-01T07:08:39.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.972+0000 7f1583a8b640 1 -- 172.21.15.16:0/2694749925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f157c0fea30 msgr2=0x7f157c19b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-01T07:08:39.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.972+0000 7f1583a8b640 1 --2- 172.21.15.16:0/2694749925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f157c0fea30 0x7f157c19b850 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1578006010 tx=0x7f15780055a0 comp rx=0 tx=0).stop 2024-08-01T07:08:39.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.972+0000 7f1583a8b640 1 -- 172.21.15.16:0/2694749925 shutdown_connections 2024-08-01T07:08:39.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.972+0000 7f1583a8b640 1 --2- 172.21.15.16:0/2694749925 >> [v2:172.21.15.16:6800/3689482666,v1:172.21.15.16:6801/3689482666] conn(0x7f156806e180 0x7f1568070640 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:39.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.972+0000 7f1583a8b640 1 --2- 172.21.15.16:0/2694749925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f157c104a30 0x7f157c19bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:39.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.972+0000 7f1583a8b640 1 --2- 172.21.15.16:0/2694749925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f157c0fea30 0x7f157c19b850 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-01T07:08:39.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.972+0000 7f1583a8b640 1 -- 172.21.15.16:0/2694749925 >> 172.21.15.16:0/2694749925 conn(0x7f157c0fa730 msgr2=0x7f157c068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-01T07:08:39.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.972+0000 7f1583a8b640 1 -- 172.21.15.16:0/2694749925 shutdown_connections 2024-08-01T07:08:39.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-08-01T07:08:39.972+0000 7f1583a8b640 1 -- 172.21.15.16:0/2694749925 wait complete. 2024-08-01T07:08:40.747 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi016.front.sepia.ceph.com... 2024-08-01T07:08:40.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-01T07:08:40.748 DEBUG:teuthology.orchestra.run.smithi016:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-01T07:08:40.779 INFO:teuthology.orchestra.run:waiting for 300 2024-08-01T07:08:40.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:40 smithi016 ceph-mon[93645]: pgmap v361: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:08:40.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:40 smithi016 ceph-mon[93645]: from='client.? 172.21.15.16:0/2694749925' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-01T07:08:40.944 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:40 smithi089 ceph-mon[82218]: pgmap v361: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:08:40.944 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:40 smithi089 ceph-mon[82218]: from='client.? 172.21.15.16:0/2694749925' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-01T07:08:43.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:42 smithi089 ceph-mon[82218]: pgmap v362: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:08:43.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:42 smithi016 ceph-mon[93645]: pgmap v362: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:08:45.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:44 smithi089 ceph-mon[82218]: pgmap v363: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:08:45.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:44 smithi016 ceph-mon[93645]: pgmap v363: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:08:47.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:46 smithi089 ceph-mon[82218]: pgmap v364: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:08:47.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:46 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:08:47.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:46 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:08:47.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:46 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:08:47.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:46 smithi016 ceph-mon[93645]: pgmap v364: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:08:47.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:46 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:08:47.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:46 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:08:47.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:46 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:08:48.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:08:48.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:08:48.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:08:48.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:08:48.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:08:48.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:08:48.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:08:48.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:08:49.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:49 smithi089 ceph-mon[82218]: pgmap v365: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:08:49.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:49 smithi016 ceph-mon[93645]: pgmap v365: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:08:51.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:51 smithi089 ceph-mon[82218]: pgmap v366: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:08:51.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:51 smithi016 ceph-mon[93645]: pgmap v366: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:08:53.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:53 smithi089 ceph-mon[82218]: pgmap v367: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:08:53.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:53 smithi016 ceph-mon[93645]: pgmap v367: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:08:55.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:55 smithi089 ceph-mon[82218]: pgmap v368: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:08:55.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:55 smithi016 ceph-mon[93645]: pgmap v368: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:08:57.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:57 smithi089 ceph-mon[82218]: pgmap v369: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:08:57.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:57 smithi016 ceph-mon[93645]: pgmap v369: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:08:59.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:08:59 smithi089 ceph-mon[82218]: pgmap v370: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:08:59.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:08:59 smithi016 ceph-mon[93645]: pgmap v370: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:09:01.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:01 smithi089 ceph-mon[82218]: pgmap v371: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:09:01.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:01 smithi016 ceph-mon[93645]: pgmap v371: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:09:03.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:03 smithi089 ceph-mon[82218]: pgmap v372: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:09:03.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:03 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:09:03.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:03 smithi016 ceph-mon[93645]: pgmap v372: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:09:03.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:03 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:09:05.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:05 smithi089 ceph-mon[82218]: pgmap v373: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:09:05.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:05 smithi016 ceph-mon[93645]: pgmap v373: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:09:07.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:07 smithi089 ceph-mon[82218]: pgmap v374: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:09:07.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:07 smithi016 ceph-mon[93645]: pgmap v374: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:09:09.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:09 smithi089 ceph-mon[82218]: pgmap v375: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:09:09.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:09 smithi016 ceph-mon[93645]: pgmap v375: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:09:11.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:11 smithi089 ceph-mon[82218]: pgmap v376: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:09:11.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:11 smithi016 ceph-mon[93645]: pgmap v376: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:09:13.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:13 smithi089 ceph-mon[82218]: pgmap v377: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:09:13.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:13 smithi016 ceph-mon[93645]: pgmap v377: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:09:15.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:15 smithi089 ceph-mon[82218]: pgmap v378: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-01T07:09:15.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:15 smithi016 ceph-mon[93645]: pgmap v378: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-01T07:09:17.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:17 smithi089 ceph-mon[82218]: pgmap v379: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 4 op/s 2024-08-01T07:09:17.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:17 smithi016 ceph-mon[93645]: pgmap v379: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 4 op/s 2024-08-01T07:09:18.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:09:18.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:09:19.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:19 smithi089 ceph-mon[82218]: pgmap v380: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-08-01T07:09:19.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:19 smithi016 ceph-mon[93645]: pgmap v380: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-08-01T07:09:20.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:20 smithi089 ceph-mon[82218]: pgmap v381: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-08-01T07:09:20.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:20 smithi016 ceph-mon[93645]: pgmap v381: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-08-01T07:09:22.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:22 smithi016 ceph-mon[93645]: pgmap v382: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-01T07:09:22.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:22 smithi089 ceph-mon[82218]: pgmap v382: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-01T07:09:24.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:24 smithi016 ceph-mon[93645]: pgmap v383: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-01T07:09:24.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:24 smithi089 ceph-mon[82218]: pgmap v383: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-01T07:09:26.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:26 smithi089 ceph-mon[82218]: pgmap v384: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:09:26.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:26 smithi016 ceph-mon[93645]: pgmap v384: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:09:28.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:28 smithi089 ceph-mon[82218]: pgmap v385: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:09:28.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:28 smithi016 ceph-mon[93645]: pgmap v385: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:09:30.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:30 smithi089 ceph-mon[82218]: pgmap v386: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:09:30.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:30 smithi016 ceph-mon[93645]: pgmap v386: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:09:32.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:32 smithi089 ceph-mon[82218]: pgmap v387: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:09:32.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:09:32.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:32 smithi016 ceph-mon[93645]: pgmap v387: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:09:32.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:09:34.524 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:34 smithi016 ceph-mon[93645]: pgmap v388: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:09:34.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:34 smithi089 ceph-mon[82218]: pgmap v388: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:09:36.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:36 smithi089 ceph-mon[82218]: pgmap v389: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:09:36.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:36 smithi016 ceph-mon[93645]: pgmap v389: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:09:38.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:38 smithi089 ceph-mon[82218]: pgmap v390: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:09:38.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:38 smithi016 ceph-mon[93645]: pgmap v390: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:09:40.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:40 smithi089 ceph-mon[82218]: pgmap v391: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:09:40.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:40 smithi016 ceph-mon[93645]: pgmap v391: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:09:42.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:42 smithi089 ceph-mon[82218]: pgmap v392: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:09:42.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:42 smithi016 ceph-mon[93645]: pgmap v392: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:09:44.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:44 smithi089 ceph-mon[82218]: pgmap v393: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:09:44.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:44 smithi016 ceph-mon[93645]: pgmap v393: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:09:46.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:46 smithi089 ceph-mon[82218]: pgmap v394: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:09:46.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:46 smithi016 ceph-mon[93645]: pgmap v394: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:09:47.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:09:47.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:09:47.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:09:47.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:09:48.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:48 smithi089 ceph-mon[82218]: pgmap v395: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:09:48.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:09:48.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:09:48.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:09:48.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:09:48.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:09:48.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:48 smithi016 ceph-mon[93645]: pgmap v395: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:09:48.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:09:48.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:09:48.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:09:48.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:09:48.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:09:50.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:50 smithi089 ceph-mon[82218]: pgmap v396: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:09:50.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:50 smithi016 ceph-mon[93645]: pgmap v396: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:09:52.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:52 smithi089 ceph-mon[82218]: pgmap v397: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:09:52.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:52 smithi016 ceph-mon[93645]: pgmap v397: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:09:54.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:54 smithi089 ceph-mon[82218]: pgmap v398: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:09:54.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:54 smithi016 ceph-mon[93645]: pgmap v398: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:09:56.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:56 smithi089 ceph-mon[82218]: pgmap v399: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:09:56.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:56 smithi016 ceph-mon[93645]: pgmap v399: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:09:58.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:09:58 smithi089 ceph-mon[82218]: pgmap v400: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:09:58.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:09:58 smithi016 ceph-mon[93645]: pgmap v400: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:10:00.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:00 smithi089 ceph-mon[82218]: pgmap v401: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:10:00.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:00 smithi089 ceph-mon[82218]: overall HEALTH_OK 2024-08-01T07:10:00.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:00 smithi016 ceph-mon[93645]: pgmap v401: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:10:00.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:00 smithi016 ceph-mon[93645]: overall HEALTH_OK 2024-08-01T07:10:02.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:02 smithi089 ceph-mon[82218]: pgmap v402: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:10:02.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:10:02.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:02 smithi016 ceph-mon[93645]: pgmap v402: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:10:02.899 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:10:04.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:04 smithi089 ceph-mon[82218]: pgmap v403: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:10:04.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:04 smithi016 ceph-mon[93645]: pgmap v403: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:10:06.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:06 smithi089 ceph-mon[82218]: pgmap v404: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:10:06.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:06 smithi016 ceph-mon[93645]: pgmap v404: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:10:08.648 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:08 smithi016 ceph-mon[93645]: pgmap v405: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:10:08.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:08 smithi089 ceph-mon[82218]: pgmap v405: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:10:10.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:10 smithi089 ceph-mon[82218]: pgmap v406: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:10:10.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:10 smithi016 ceph-mon[93645]: pgmap v406: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:10:12.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:12 smithi089 ceph-mon[82218]: pgmap v407: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:10:12.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:12 smithi016 ceph-mon[93645]: pgmap v407: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:10:14.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:14 smithi089 ceph-mon[82218]: pgmap v408: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:10:14.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:14 smithi016 ceph-mon[93645]: pgmap v408: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:10:16.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:16 smithi089 ceph-mon[82218]: pgmap v409: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:10:16.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:16 smithi016 ceph-mon[93645]: pgmap v409: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:10:17.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:10:17.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:10:18.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:18 smithi089 ceph-mon[82218]: pgmap v410: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:10:18.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:18 smithi016 ceph-mon[93645]: pgmap v410: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:10:20.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:20 smithi089 ceph-mon[82218]: pgmap v411: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:10:20.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:20 smithi016 ceph-mon[93645]: pgmap v411: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:10:22.838 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:22 smithi089 ceph-mon[82218]: pgmap v412: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:10:22.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:22 smithi016 ceph-mon[93645]: pgmap v412: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:10:24.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:24 smithi089 ceph-mon[82218]: pgmap v413: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:10:24.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:24 smithi016 ceph-mon[93645]: pgmap v413: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:10:26.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:26 smithi089 ceph-mon[82218]: pgmap v414: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:10:26.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:26 smithi016 ceph-mon[93645]: pgmap v414: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:10:28.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:28 smithi089 ceph-mon[82218]: pgmap v415: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:10:28.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:28 smithi016 ceph-mon[93645]: pgmap v415: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:10:30.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:30 smithi089 ceph-mon[82218]: pgmap v416: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:10:30.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:30 smithi016 ceph-mon[93645]: pgmap v416: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:10:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:32 smithi089 ceph-mon[82218]: pgmap v417: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:10:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:10:32.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:32 smithi016 ceph-mon[93645]: pgmap v417: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:10:32.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:10:34.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:34 smithi089 ceph-mon[82218]: pgmap v418: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:10:34.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:34 smithi016 ceph-mon[93645]: pgmap v418: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:10:37.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:36 smithi089 ceph-mon[82218]: pgmap v419: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:10:37.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:36 smithi016 ceph-mon[93645]: pgmap v419: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:10:38.974 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:38 smithi016 ceph-mon[93645]: pgmap v420: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:10:39.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:38 smithi089 ceph-mon[82218]: pgmap v420: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:10:41.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:40 smithi089 ceph-mon[82218]: pgmap v421: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:10:41.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:40 smithi016 ceph-mon[93645]: pgmap v421: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:10:43.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:42 smithi089 ceph-mon[82218]: pgmap v422: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:10:43.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:42 smithi016 ceph-mon[93645]: pgmap v422: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:10:45.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:44 smithi089 ceph-mon[82218]: pgmap v423: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:10:45.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:44 smithi016 ceph-mon[93645]: pgmap v423: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:10:47.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:46 smithi089 ceph-mon[82218]: pgmap v424: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:10:47.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:46 smithi016 ceph-mon[93645]: pgmap v424: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:10:48.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:10:48.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:10:49.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:48 smithi089 ceph-mon[82218]: pgmap v425: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:10:49.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:10:49.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:10:49.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:10:49.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:10:49.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:48 smithi016 ceph-mon[93645]: pgmap v425: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:10:49.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:10:49.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:10:49.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:10:49.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:10:51.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:50 smithi089 ceph-mon[82218]: pgmap v426: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:10:51.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:50 smithi016 ceph-mon[93645]: pgmap v426: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:10:53.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:52 smithi089 ceph-mon[82218]: pgmap v427: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:10:53.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:52 smithi016 ceph-mon[93645]: pgmap v427: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:10:54.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:54 smithi016 ceph-mon[93645]: pgmap v428: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:10:55.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:54 smithi089 ceph-mon[82218]: pgmap v428: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:10:57.141 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:56 smithi089 ceph-mon[82218]: pgmap v429: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:10:57.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:56 smithi016 ceph-mon[93645]: pgmap v429: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:10:58.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:10:58 smithi089 ceph-mon[82218]: pgmap v430: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:10:59.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:10:58 smithi016 ceph-mon[93645]: pgmap v430: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:11:01.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:00 smithi089 ceph-mon[82218]: pgmap v431: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:11:01.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:00 smithi016 ceph-mon[93645]: pgmap v431: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:11:03.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:02 smithi089 ceph-mon[82218]: pgmap v432: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:11:03.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:11:03.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:02 smithi016 ceph-mon[93645]: pgmap v432: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:11:03.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:11:04.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:04 smithi016 ceph-mon[93645]: pgmap v433: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:11:05.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:04 smithi089 ceph-mon[82218]: pgmap v433: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:11:07.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:06 smithi089 ceph-mon[82218]: pgmap v434: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:11:07.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:06 smithi016 ceph-mon[93645]: pgmap v434: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:11:09.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:08 smithi089 ceph-mon[82218]: pgmap v435: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:11:09.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:08 smithi016 ceph-mon[93645]: pgmap v435: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:11:11.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:10 smithi089 ceph-mon[82218]: pgmap v436: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:11:11.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:10 smithi016 ceph-mon[93645]: pgmap v436: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:11:13.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:12 smithi089 ceph-mon[82218]: pgmap v437: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:11:13.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:12 smithi016 ceph-mon[93645]: pgmap v437: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:11:14.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:14 smithi016 ceph-mon[93645]: pgmap v438: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:11:15.038 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:14 smithi089 ceph-mon[82218]: pgmap v438: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:11:17.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:16 smithi089 ceph-mon[82218]: pgmap v439: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:11:17.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:16 smithi016 ceph-mon[93645]: pgmap v439: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:11:18.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:17 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:11:18.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:17 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:11:19.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:18 smithi089 ceph-mon[82218]: pgmap v440: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:11:19.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:18 smithi016 ceph-mon[93645]: pgmap v440: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:11:21.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:20 smithi089 ceph-mon[82218]: pgmap v441: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:11:21.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:20 smithi016 ceph-mon[93645]: pgmap v441: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:11:23.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:22 smithi089 ceph-mon[82218]: pgmap v442: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:11:23.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:22 smithi016 ceph-mon[93645]: pgmap v442: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:11:24.842 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:24 smithi016 ceph-mon[93645]: pgmap v443: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:11:25.138 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:24 smithi089 ceph-mon[82218]: pgmap v443: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:11:27.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:26 smithi089 ceph-mon[82218]: pgmap v444: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:11:27.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:26 smithi016 ceph-mon[93645]: pgmap v444: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:11:29.071 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:28 smithi089 ceph-mon[82218]: pgmap v445: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:11:29.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:28 smithi016 ceph-mon[93645]: pgmap v445: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:11:31.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:30 smithi089 ceph-mon[82218]: pgmap v446: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:11:31.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:30 smithi016 ceph-mon[93645]: pgmap v446: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:11:33.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:32 smithi089 ceph-mon[82218]: pgmap v447: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:11:33.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:11:33.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:32 smithi016 ceph-mon[93645]: pgmap v447: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:11:33.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:11:34.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:34 smithi016 ceph-mon[93645]: pgmap v448: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:11:35.139 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:34 smithi089 ceph-mon[82218]: pgmap v448: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:11:37.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:36 smithi089 ceph-mon[82218]: pgmap v449: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:11:37.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:36 smithi016 ceph-mon[93645]: pgmap v449: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:11:39.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:38 smithi089 ceph-mon[82218]: pgmap v450: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:11:39.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:38 smithi016 ceph-mon[93645]: pgmap v450: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:11:41.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:40 smithi089 ceph-mon[82218]: pgmap v451: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:11:41.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:40 smithi016 ceph-mon[93645]: pgmap v451: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:11:43.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:42 smithi089 ceph-mon[82218]: pgmap v452: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:11:43.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:42 smithi016 ceph-mon[93645]: pgmap v452: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:11:44.898 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:44 smithi016 ceph-mon[93645]: pgmap v453: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:11:45.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:44 smithi089 ceph-mon[82218]: pgmap v453: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:11:47.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:46 smithi089 ceph-mon[82218]: pgmap v454: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:11:47.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:46 smithi016 ceph-mon[93645]: pgmap v454: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:11:48.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:47 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:11:48.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:47 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:11:49.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:48 smithi089 ceph-mon[82218]: pgmap v455: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:11:49.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:11:49.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:48 smithi016 ceph-mon[93645]: pgmap v455: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:11:49.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:11:50.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:49 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:11:50.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:49 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:11:50.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:49 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:11:50.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:49 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:11:50.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:49 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:11:50.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:49 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:11:51.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:50 smithi089 ceph-mon[82218]: pgmap v456: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:11:51.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:50 smithi016 ceph-mon[93645]: pgmap v456: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:11:53.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:52 smithi089 ceph-mon[82218]: pgmap v457: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:11:53.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:52 smithi016 ceph-mon[93645]: pgmap v457: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:11:55.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:54 smithi089 ceph-mon[82218]: pgmap v458: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:11:55.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:54 smithi016 ceph-mon[93645]: pgmap v458: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:11:57.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:56 smithi089 ceph-mon[82218]: pgmap v459: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:11:57.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:56 smithi016 ceph-mon[93645]: pgmap v459: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:11:59.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:11:58 smithi089 ceph-mon[82218]: pgmap v460: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:11:59.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:11:58 smithi016 ceph-mon[93645]: pgmap v460: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:12:01.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:00 smithi089 ceph-mon[82218]: pgmap v461: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:12:01.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:00 smithi016 ceph-mon[93645]: pgmap v461: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:12:03.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:02 smithi089 ceph-mon[82218]: pgmap v462: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:12:03.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:02 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:12:03.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:02 smithi016 ceph-mon[93645]: pgmap v462: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:12:03.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:02 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:12:05.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:04 smithi089 ceph-mon[82218]: pgmap v463: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:12:05.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:04 smithi016 ceph-mon[93645]: pgmap v463: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:12:07.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:06 smithi089 ceph-mon[82218]: pgmap v464: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:12:07.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:06 smithi016 ceph-mon[93645]: pgmap v464: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:12:09.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:08 smithi089 ceph-mon[82218]: pgmap v465: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:12:09.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:08 smithi016 ceph-mon[93645]: pgmap v465: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:12:11.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:10 smithi089 ceph-mon[82218]: pgmap v466: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:12:11.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:10 smithi016 ceph-mon[93645]: pgmap v466: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:12:13.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:12 smithi089 ceph-mon[82218]: pgmap v467: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:12:13.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:12 smithi016 ceph-mon[93645]: pgmap v467: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:12:15.189 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:14 smithi089 ceph-mon[82218]: pgmap v468: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:12:15.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:14 smithi016 ceph-mon[93645]: pgmap v468: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:12:17.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:17 smithi089 ceph-mon[82218]: pgmap v469: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:12:17.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:17 smithi016 ceph-mon[93645]: pgmap v469: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:12:18.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:12:18.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:12:19.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:19 smithi089 ceph-mon[82218]: pgmap v470: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:12:19.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:19 smithi016 ceph-mon[93645]: pgmap v470: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:12:21.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:21 smithi089 ceph-mon[82218]: pgmap v471: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:12:21.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:21 smithi016 ceph-mon[93645]: pgmap v471: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:12:23.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:23 smithi089 ceph-mon[82218]: pgmap v472: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:12:23.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:23 smithi016 ceph-mon[93645]: pgmap v472: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:12:25.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:25 smithi089 ceph-mon[82218]: pgmap v473: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:12:25.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:25 smithi016 ceph-mon[93645]: pgmap v473: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:12:27.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:27 smithi089 ceph-mon[82218]: pgmap v474: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:12:27.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:27 smithi016 ceph-mon[93645]: pgmap v474: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:12:29.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:29 smithi089 ceph-mon[82218]: pgmap v475: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:12:29.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:29 smithi016 ceph-mon[93645]: pgmap v475: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:12:31.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:31 smithi089 ceph-mon[82218]: pgmap v476: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:12:31.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:31 smithi016 ceph-mon[93645]: pgmap v476: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:12:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:33 smithi089 ceph-mon[82218]: pgmap v477: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:12:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:33 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:12:33.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:33 smithi016 ceph-mon[93645]: pgmap v477: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:12:33.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:33 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:12:35.297 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:35 smithi089 ceph-mon[82218]: pgmap v478: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:12:35.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:35 smithi016 ceph-mon[93645]: pgmap v478: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:12:37.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:37 smithi089 ceph-mon[82218]: pgmap v479: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:12:37.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:37 smithi016 ceph-mon[93645]: pgmap v479: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:12:39.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:39 smithi089 ceph-mon[82218]: pgmap v480: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:12:39.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:39 smithi016 ceph-mon[93645]: pgmap v480: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:12:41.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:41 smithi089 ceph-mon[82218]: pgmap v481: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:12:41.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:41 smithi016 ceph-mon[93645]: pgmap v481: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:12:43.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:43 smithi089 ceph-mon[82218]: pgmap v482: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:12:43.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:43 smithi016 ceph-mon[93645]: pgmap v482: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:12:45.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:45 smithi089 ceph-mon[82218]: pgmap v483: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:12:45.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:45 smithi016 ceph-mon[93645]: pgmap v483: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:12:47.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:47 smithi089 ceph-mon[82218]: pgmap v484: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:12:47.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:47 smithi016 ceph-mon[93645]: pgmap v484: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:12:48.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:48 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:12:48.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:48 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:12:49.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:49 smithi089 ceph-mon[82218]: pgmap v485: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:12:49.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:49 smithi016 ceph-mon[93645]: pgmap v485: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:12:50.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:50 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:12:50.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:50 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:12:50.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:50 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:12:50.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:50 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:12:50.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:50 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-01T07:12:50.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:50 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-01T07:12:50.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:50 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-01T07:12:50.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:50 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' 2024-08-01T07:12:51.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:51 smithi089 ceph-mon[82218]: pgmap v486: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:12:51.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:51 smithi016 ceph-mon[93645]: pgmap v486: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:12:53.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:53 smithi089 ceph-mon[82218]: pgmap v487: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:12:53.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:53 smithi016 ceph-mon[93645]: pgmap v487: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:12:55.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:55 smithi089 ceph-mon[82218]: pgmap v488: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:12:55.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:55 smithi016 ceph-mon[93645]: pgmap v488: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:12:57.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:57 smithi089 ceph-mon[82218]: pgmap v489: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:12:57.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:57 smithi016 ceph-mon[93645]: pgmap v489: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:12:59.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:12:59 smithi089 ceph-mon[82218]: pgmap v490: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:12:59.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:12:59 smithi016 ceph-mon[93645]: pgmap v490: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:13:01.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:01 smithi089 ceph-mon[82218]: pgmap v491: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:13:01.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:01 smithi016 ceph-mon[93645]: pgmap v491: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:13:03.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:03 smithi089 ceph-mon[82218]: pgmap v492: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:13:03.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:03 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:13:03.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:03 smithi016 ceph-mon[93645]: pgmap v492: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:13:03.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:03 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:13:05.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:05 smithi089 ceph-mon[82218]: pgmap v493: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:13:05.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:05 smithi016 ceph-mon[93645]: pgmap v493: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:13:07.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:07 smithi089 ceph-mon[82218]: pgmap v494: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:13:07.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:07 smithi016 ceph-mon[93645]: pgmap v494: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:13:09.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:09 smithi089 ceph-mon[82218]: pgmap v495: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:13:09.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:09 smithi016 ceph-mon[93645]: pgmap v495: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:13:11.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:11 smithi089 ceph-mon[82218]: pgmap v496: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:13:11.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:11 smithi016 ceph-mon[93645]: pgmap v496: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:13:13.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:13 smithi089 ceph-mon[82218]: pgmap v497: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:13:13.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:13 smithi016 ceph-mon[93645]: pgmap v497: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:13:15.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:15 smithi089 ceph-mon[82218]: pgmap v498: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:13:15.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:15 smithi016 ceph-mon[93645]: pgmap v498: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:13:17.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:17 smithi089 ceph-mon[82218]: pgmap v499: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:13:17.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:17 smithi016 ceph-mon[93645]: pgmap v499: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:13:18.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:18 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:13:18.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:18 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:13:19.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:19 smithi089 ceph-mon[82218]: pgmap v500: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:13:19.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:19 smithi016 ceph-mon[93645]: pgmap v500: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:13:21.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:21 smithi089 ceph-mon[82218]: pgmap v501: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:13:21.399 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:21 smithi016 ceph-mon[93645]: pgmap v501: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:13:23.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:23 smithi089 ceph-mon[82218]: pgmap v502: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:13:23.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:23 smithi016 ceph-mon[93645]: pgmap v502: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:13:25.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:25 smithi089 ceph-mon[82218]: pgmap v503: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:13:25.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:25 smithi016 ceph-mon[93645]: pgmap v503: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:13:27.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:27 smithi089 ceph-mon[82218]: pgmap v504: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:13:27.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:27 smithi016 ceph-mon[93645]: pgmap v504: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:13:29.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:29 smithi089 ceph-mon[82218]: pgmap v505: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:13:29.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:29 smithi016 ceph-mon[93645]: pgmap v505: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:13:31.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:31 smithi089 ceph-mon[82218]: pgmap v506: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:13:31.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:31 smithi016 ceph-mon[93645]: pgmap v506: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-01T07:13:32.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:32 smithi089 ceph-mon[82218]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:13:32.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:32 smithi016 ceph-mon[93645]: from='mgr.34104 172.21.15.16:0/444001584' entity='mgr.smithi016.whigbo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-01T07:13:33.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:33 smithi089 ceph-mon[82218]: pgmap v507: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:13:33.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:33 smithi016 ceph-mon[93645]: pgmap v507: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-01T07:13:35.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:35 smithi089 ceph-mon[82218]: pgmap v508: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:13:35.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:35 smithi016 ceph-mon[93645]: pgmap v508: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-01T07:13:37.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:37 smithi016 ceph-mon[93645]: pgmap v509: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:13:37.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:37 smithi089 ceph-mon[82218]: pgmap v509: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-08-01T07:13:39.398 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:39 smithi016 ceph-mon[93645]: pgmap v510: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:13:39.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:39 smithi089 ceph-mon[82218]: pgmap v510: 65 pgs: 65 active+clean; 213 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-01T07:13:39.853 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-08-01T07:13:39.854 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_d99c9769be1521395979e8c23d9073adbf1ff43f/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_d99c9769be1521395979e8c23d9073adbf1ff43f/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-08-01T07:13:39.856 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-08-01T07:13:39.867 INFO:tasks.cephadm:Teardown begin 2024-08-01T07:13:39.867 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_d99c9769be1521395979e8c23d9073adbf1ff43f/qa/tasks/cephadm.py", line 2236, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_d99c9769be1521395979e8c23d9073adbf1ff43f/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_d99c9769be1521395979e8c23d9073adbf1ff43f/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-08-01T07:13:39.869 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-01T07:13:39.903 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-01T07:13:39.936 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-08-01T07:13:39.936 DEBUG:teuthology.orchestra.run.smithi016:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-01T07:13:39.961 DEBUG:teuthology.orchestra.run.smithi089:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-01T07:13:39.994 INFO:tasks.cephadm:Stopping all daemons... 2024-08-01T07:13:39.994 INFO:tasks.cephadm.mon.smithi016:Stopping mon.smithi016... 2024-08-01T07:13:39.994 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mon.smithi016 2024-08-01T07:13:40.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:40 smithi016 systemd[1]: Stopping Ceph mon.smithi016 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T07:13:40.561 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:40 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016[93641]: 2024-08-01T07:13:40.307+0000 7f9e234b5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi016 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-01T07:13:40.562 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:40 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016[93641]: 2024-08-01T07:13:40.307+0000 7f9e234b5640 -1 mon.smithi016@0(leader) e3 *** Got Signal Terminated *** 2024-08-01T07:13:40.562 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:40 smithi016 podman[156450]: 2024-08-01 07:13:40.532864833 +0000 UTC m=+0.321060317 container stop 48e94d076e6f3843438402bc47874c7db338d79e1acc4bfbd770192fbb72d75a (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_CLEAN=True, RELEASE=squid-f9911e1, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-08-01T07:13:40.562 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:40 smithi016 podman[156450]: 2024-08-01 07:13:40.560993122 +0000 UTC m=+0.349188603 container died 48e94d076e6f3843438402bc47874c7db338d79e1acc4bfbd770192fbb72d75a (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016, org.label-schema.license=GPLv2, RELEASE=squid-f9911e1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-01T07:13:41.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:41 smithi016 podman[156450]: 2024-08-01 07:13:41.05886737 +0000 UTC m=+0.847062851 container cleanup 48e94d076e6f3843438402bc47874c7db338d79e1acc4bfbd770192fbb72d75a (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f9911e1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-08-01T07:13:41.148 INFO:journalctl@ceph.mon.smithi016.smithi016.stdout:Aug 01 07:13:41 smithi016 bash[156450]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi016 2024-08-01T07:13:41.492 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mon.smithi016.service' 2024-08-01T07:13:41.546 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-01T07:13:41.547 INFO:tasks.cephadm.mon.smithi016:Stopped mon.smithi016 2024-08-01T07:13:41.547 INFO:tasks.cephadm.mon.smithi089:Stopping mon.smithi089... 2024-08-01T07:13:41.547 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mon.smithi089 2024-08-01T07:13:41.863 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:41 smithi089 systemd[1]: Stopping Ceph mon.smithi089 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T07:13:42.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:41 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi089[82214]: 2024-08-01T07:13:41.861+0000 7f6eb477f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi089 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-01T07:13:42.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:41 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi089[82214]: 2024-08-01T07:13:41.861+0000 7f6eb477f640 -1 mon.smithi089@1(peon) e3 *** Got Signal Terminated *** 2024-08-01T07:13:42.137 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:41 smithi089 podman[123304]: 2024-08-01 07:13:41.912625879 +0000 UTC m=+0.168040727 container died c4b83b46ff15614fdd6c5c3aecde6a009aa23cde74f6233017609eb0d18b923f (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi089, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-f9911e1) 2024-08-01T07:13:42.564 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:42 smithi089 podman[123304]: 2024-08-01 07:13:42.345332249 +0000 UTC m=+0.600747094 container cleanup c4b83b46ff15614fdd6c5c3aecde6a009aa23cde74f6233017609eb0d18b923f (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi089, org.label-schema.build-date=20240724, ceph=True, RELEASE=squid-f9911e1, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-01T07:13:42.564 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:42 smithi089 bash[123304]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi089 2024-08-01T07:13:42.813 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mon.smithi089.service' 2024-08-01T07:13:42.835 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:42 smithi089 podman[123319]: 2024-08-01 07:13:42.563704745 +0000 UTC m=+0.649049635 container remove c4b83b46ff15614fdd6c5c3aecde6a009aa23cde74f6233017609eb0d18b923f (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-mon-smithi089, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-f9911e1, ceph=True, org.label-schema.schema-version=1.0) 2024-08-01T07:13:42.835 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:42 smithi089 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mon.smithi089.service: Deactivated successfully. 2024-08-01T07:13:42.835 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:42 smithi089 systemd[1]: Stopped Ceph mon.smithi089 for a88427da-4fd1-11ef-bcca-c7b262605968. 2024-08-01T07:13:42.835 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Aug 01 07:13:42 smithi089 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@mon.smithi089.service: Consumed 7.689s CPU time. 2024-08-01T07:13:42.861 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-01T07:13:42.861 INFO:tasks.cephadm.mon.smithi089:Stopped mon.smithi089 2024-08-01T07:13:42.861 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-08-01T07:13:42.861 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.0 2024-08-01T07:13:43.148 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 07:13:42 smithi016 systemd[1]: Stopping Ceph osd.0 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T07:13:43.648 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 07:13:43 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0[102223]: 2024-08-01T07:13:43.154+0000 7f48aed18640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-01T07:13:43.649 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 07:13:43 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0[102223]: 2024-08-01T07:13:43.154+0000 7f48aed18640 -1 osd.0 96 *** Got signal Terminated *** 2024-08-01T07:13:43.649 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 07:13:43 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0[102223]: 2024-08-01T07:13:43.154+0000 7f48aed18640 -1 osd.0 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-01T07:13:48.808 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 07:13:48 smithi016 podman[156583]: 2024-08-01 07:13:48.526137264 +0000 UTC m=+5.469943403 container died 4c2115ae6222ddbb3b2a6c1b56f92ee03797acda5593988ac09de2f2824313c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f9911e1, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-08-01T07:13:49.148 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 07:13:48 smithi016 podman[156583]: 2024-08-01 07:13:48.880674139 +0000 UTC m=+5.824480289 container cleanup 4c2115ae6222ddbb3b2a6c1b56f92ee03797acda5593988ac09de2f2824313c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-f9911e1, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240724) 2024-08-01T07:13:49.148 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 07:13:48 smithi016 bash[156583]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0 2024-08-01T07:13:49.517 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 07:13:49 smithi016 podman[156612]: 2024-08-01 07:13:49.174133778 +0000 UTC m=+0.642559758 container remove 4c2115ae6222ddbb3b2a6c1b56f92ee03797acda5593988ac09de2f2824313c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240724, RELEASE=squid-f9911e1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-08-01T07:13:49.898 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 07:13:49 smithi016 podman[156701]: 2024-08-01 07:13:49.516769744 +0000 UTC m=+0.101675554 container create 31f303fe4e0e04dd5902da49aae186ea9e64b2bc693310fd7914b9bdc05d3ef6 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, RELEASE=squid-f9911e1, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.36.0) 2024-08-01T07:13:49.898 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 07:13:49 smithi016 podman[156701]: 2024-08-01 07:13:49.43313367 +0000 UTC m=+0.018039496 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:13:50.398 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 07:13:49 smithi016 podman[156701]: 2024-08-01 07:13:49.903708056 +0000 UTC m=+0.488613870 container init 31f303fe4e0e04dd5902da49aae186ea9e64b2bc693310fd7914b9bdc05d3ef6 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, RELEASE=squid-f9911e1, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-01T07:13:50.399 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 07:13:49 smithi016 podman[156701]: 2024-08-01 07:13:49.907491255 +0000 UTC m=+0.492397062 container start 31f303fe4e0e04dd5902da49aae186ea9e64b2bc693310fd7914b9bdc05d3ef6 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f9911e1, org.label-schema.schema-version=1.0) 2024-08-01T07:13:50.399 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 07:13:49 smithi016 podman[156701]: 2024-08-01 07:13:49.969585177 +0000 UTC m=+0.554490993 container attach 31f303fe4e0e04dd5902da49aae186ea9e64b2bc693310fd7914b9bdc05d3ef6 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, RELEASE=squid-f9911e1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-01T07:13:50.399 INFO:journalctl@ceph.osd.0.smithi016.stdout:Aug 01 07:13:50 smithi016 podman[156701]: 2024-08-01 07:13:50.109159518 +0000 UTC m=+0.694065326 container died 31f303fe4e0e04dd5902da49aae186ea9e64b2bc693310fd7914b9bdc05d3ef6 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-0-deactivate, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f9911e1) 2024-08-01T07:13:50.753 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.0.service' 2024-08-01T07:13:50.798 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-01T07:13:50.799 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-08-01T07:13:50.799 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-08-01T07:13:50.799 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.1 2024-08-01T07:13:51.148 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:13:50 smithi016 systemd[1]: Stopping Ceph osd.1 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T07:13:51.648 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:13:51 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1[107602]: 2024-08-01T07:13:51.177+0000 7f083e23e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-01T07:13:51.648 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:13:51 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1[107602]: 2024-08-01T07:13:51.177+0000 7f083e23e640 -1 osd.1 96 *** Got signal Terminated *** 2024-08-01T07:13:51.648 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:13:51 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1[107602]: 2024-08-01T07:13:51.177+0000 7f083e23e640 -1 osd.1 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-01T07:13:56.855 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:13:56 smithi016 podman[156804]: 2024-08-01 07:13:56.563021119 +0000 UTC m=+5.529447100 container died fc2f7117be303477779000e706315ce62d8cdef35c11716db163182a12f8d8d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f9911e1, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-08-01T07:13:57.148 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:13:56 smithi016 podman[156804]: 2024-08-01 07:13:56.943658994 +0000 UTC m=+5.910084975 container cleanup fc2f7117be303477779000e706315ce62d8cdef35c11716db163182a12f8d8d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f9911e1, org.label-schema.vendor=CentOS) 2024-08-01T07:13:57.148 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:13:56 smithi016 bash[156804]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1 2024-08-01T07:13:57.541 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:13:57 smithi016 podman[156818]: 2024-08-01 07:13:57.186969771 +0000 UTC m=+0.622775370 container remove fc2f7117be303477779000e706315ce62d8cdef35c11716db163182a12f8d8d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-f9911e1, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-01T07:13:57.850 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:13:57 smithi016 podman[156909]: 2024-08-01 07:13:57.443226144 +0000 UTC m=+0.018010062 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:13:57.850 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:13:57 smithi016 podman[156909]: 2024-08-01 07:13:57.600868485 +0000 UTC m=+0.175652399 container create 8186721593db35fecdfa280925b09e24c9badc776a2c184c96765b7281fc915a (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-f9911e1) 2024-08-01T07:13:57.850 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:13:57 smithi016 podman[156909]: 2024-08-01 07:13:57.849332797 +0000 UTC m=+0.424116714 container init 8186721593db35fecdfa280925b09e24c9badc776a2c184c96765b7281fc915a (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-f9911e1, ceph=True, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-01T07:13:58.148 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:13:57 smithi016 podman[156909]: 2024-08-01 07:13:57.853406549 +0000 UTC m=+0.428190456 container start 8186721593db35fecdfa280925b09e24c9badc776a2c184c96765b7281fc915a (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-f9911e1, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-08-01T07:13:58.148 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:13:57 smithi016 podman[156909]: 2024-08-01 07:13:57.932369279 +0000 UTC m=+0.507153195 container attach 8186721593db35fecdfa280925b09e24c9badc776a2c184c96765b7281fc915a (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, RELEASE=squid-f9911e1, GIT_CLEAN=True) 2024-08-01T07:13:58.148 INFO:journalctl@ceph.osd.1.smithi016.stdout:Aug 01 07:13:58 smithi016 podman[156909]: 2024-08-01 07:13:58.048398505 +0000 UTC m=+0.623182412 container died 8186721593db35fecdfa280925b09e24c9badc776a2c184c96765b7281fc915a (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-f9911e1, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0) 2024-08-01T07:13:58.622 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.1.service' 2024-08-01T07:13:58.670 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-01T07:13:58.670 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-08-01T07:13:58.670 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-08-01T07:13:58.671 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.2 2024-08-01T07:13:58.898 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:13:58 smithi016 systemd[1]: Stopping Ceph osd.2 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T07:13:59.398 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:13:58 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2[113113]: 2024-08-01T07:13:58.979+0000 7f0330f56640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-01T07:13:59.399 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:13:58 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2[113113]: 2024-08-01T07:13:58.979+0000 7f0330f56640 -1 osd.2 96 *** Got signal Terminated *** 2024-08-01T07:13:59.399 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:13:58 smithi016 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2[113113]: 2024-08-01T07:13:58.979+0000 7f0330f56640 -1 osd.2 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-01T07:14:04.648 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:14:04 smithi016 podman[157014]: 2024-08-01 07:14:04.393216855 +0000 UTC m=+5.529713026 container died 3364752c936536d9fda25aad9db8e1cc04e1d13f7586308060728bed71d0801c (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-f9911e1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, org.label-schema.vendor=CentOS) 2024-08-01T07:14:05.016 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:14:04 smithi016 podman[157014]: 2024-08-01 07:14:04.83904199 +0000 UTC m=+5.975538161 container cleanup 3364752c936536d9fda25aad9db8e1cc04e1d13f7586308060728bed71d0801c (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-f9911e1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-01T07:14:05.016 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:14:04 smithi016 bash[157014]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2 2024-08-01T07:14:05.398 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:14:05 smithi016 podman[157029]: 2024-08-01 07:14:05.015553324 +0000 UTC m=+0.617951760 container remove 3364752c936536d9fda25aad9db8e1cc04e1d13f7586308060728bed71d0801c (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-f9911e1, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-01T07:14:05.786 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:14:05 smithi016 podman[157122]: 2024-08-01 07:14:05.424670605 +0000 UTC m=+0.102391338 container create ee59f92aebfeeafd0373939441355375d5e526c4b677389c4b0bd8cf0bad6a3b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f9911e1) 2024-08-01T07:14:05.787 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:14:05 smithi016 podman[157122]: 2024-08-01 07:14:05.340554956 +0000 UTC m=+0.018275706 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:14:05.787 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:14:05 smithi016 podman[157122]: 2024-08-01 07:14:05.78560485 +0000 UTC m=+0.463325596 container init ee59f92aebfeeafd0373939441355375d5e526c4b677389c4b0bd8cf0bad6a3b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f9911e1, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0) 2024-08-01T07:14:06.149 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:14:05 smithi016 podman[157122]: 2024-08-01 07:14:05.78928565 +0000 UTC m=+0.467006384 container start ee59f92aebfeeafd0373939441355375d5e526c4b677389c4b0bd8cf0bad6a3b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-deactivate, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-f9911e1, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-01T07:14:06.149 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:14:05 smithi016 podman[157122]: 2024-08-01 07:14:05.877201065 +0000 UTC m=+0.554921810 container attach ee59f92aebfeeafd0373939441355375d5e526c4b677389c4b0bd8cf0bad6a3b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, RELEASE=squid-f9911e1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0) 2024-08-01T07:14:06.149 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:14:05 smithi016 podman[157122]: 2024-08-01 07:14:05.987520749 +0000 UTC m=+0.665241492 container died ee59f92aebfeeafd0373939441355375d5e526c4b677389c4b0bd8cf0bad6a3b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-f9911e1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-01T07:14:06.523 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:14:06 smithi016 podman[157146]: 2024-08-01 07:14:06.505938214 +0000 UTC m=+0.512789322 container remove ee59f92aebfeeafd0373939441355375d5e526c4b677389c4b0bd8cf0bad6a3b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f9911e1, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-08-01T07:14:06.524 INFO:journalctl@ceph.osd.2.smithi016.stdout:Aug 01 07:14:06 smithi016 systemd[1]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.2.service: Deactivated successfully. 2024-08-01T07:14:06.527 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.2.service' 2024-08-01T07:14:06.571 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-01T07:14:06.571 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-08-01T07:14:06.571 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-08-01T07:14:06.571 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.3 2024-08-01T07:14:06.874 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:14:06 smithi089 systemd[1]: Stopping Ceph osd.3 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T07:14:07.137 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:14:06 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3[91627]: 2024-08-01T07:14:06.873+0000 7f9264b00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-01T07:14:07.137 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:14:06 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3[91627]: 2024-08-01T07:14:06.873+0000 7f9264b00640 -1 osd.3 96 *** Got signal Terminated *** 2024-08-01T07:14:07.137 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:14:06 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3[91627]: 2024-08-01T07:14:06.873+0000 7f9264b00640 -1 osd.3 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-01T07:14:09.887 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:09 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[96778]: 2024-08-01T07:14:09.429+0000 7f1eeab69640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.652940+0000 front 2024-08-01T07:13:43.652952+0000 (oldest deadline 2024-08-01T07:14:08.952878+0000) 2024-08-01T07:14:10.457 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:14:10 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3[91627]: 2024-08-01T07:14:10.196+0000 7f9261906640 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:45.459898+0000 front 2024-08-01T07:13:45.459917+0000 (oldest deadline 2024-08-01T07:14:10.060403+0000) 2024-08-01T07:14:10.887 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:10 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[96778]: 2024-08-01T07:14:10.456+0000 7f1eeab69640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.652940+0000 front 2024-08-01T07:13:43.652952+0000 (oldest deadline 2024-08-01T07:14:08.952878+0000) 2024-08-01T07:14:10.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:10 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:10.673+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.903539+0000 front 2024-08-01T07:13:43.903567+0000 (oldest deadline 2024-08-01T07:14:09.803480+0000) 2024-08-01T07:14:11.637 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:14:11 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3[91627]: 2024-08-01T07:14:11.229+0000 7f9261906640 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:45.459898+0000 front 2024-08-01T07:13:45.459917+0000 (oldest deadline 2024-08-01T07:14:10.060403+0000) 2024-08-01T07:14:11.637 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:11 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[96778]: 2024-08-01T07:14:11.407+0000 7f1eeab69640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.652940+0000 front 2024-08-01T07:13:43.652952+0000 (oldest deadline 2024-08-01T07:14:08.952878+0000) 2024-08-01T07:14:12.042 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:11 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:11.646+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.903539+0000 front 2024-08-01T07:13:43.903567+0000 (oldest deadline 2024-08-01T07:14:09.803480+0000) 2024-08-01T07:14:12.571 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:12 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[96778]: 2024-08-01T07:14:12.436+0000 7f1eeab69640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.652940+0000 front 2024-08-01T07:13:43.652952+0000 (oldest deadline 2024-08-01T07:14:08.952878+0000) 2024-08-01T07:14:12.571 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:14:12 smithi089 podman[123440]: 2024-08-01 07:14:12.296051865 +0000 UTC m=+5.526189921 container died 9a18feae4353cd48f65d81e135c61642a658db8b6acf03891d25ad4d0f14d16f (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-f9911e1, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2) 2024-08-01T07:14:12.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:12 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:12.655+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.903539+0000 front 2024-08-01T07:13:43.903567+0000 (oldest deadline 2024-08-01T07:14:09.803480+0000) 2024-08-01T07:14:12.887 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:14:12 smithi089 podman[123440]: 2024-08-01 07:14:12.665078602 +0000 UTC m=+5.895216652 container cleanup 9a18feae4353cd48f65d81e135c61642a658db8b6acf03891d25ad4d0f14d16f (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-f9911e1, org.label-schema.build-date=20240724, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-01T07:14:12.887 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:14:12 smithi089 bash[123440]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3 2024-08-01T07:14:13.331 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:14:12 smithi089 podman[123456]: 2024-08-01 07:14:12.983760934 +0000 UTC m=+0.687000533 container remove 9a18feae4353cd48f65d81e135c61642a658db8b6acf03891d25ad4d0f14d16f (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3, RELEASE=squid-f9911e1, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2) 2024-08-01T07:14:13.613 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:13 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[96778]: 2024-08-01T07:14:13.452+0000 7f1eeab69640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.652940+0000 front 2024-08-01T07:13:43.652952+0000 (oldest deadline 2024-08-01T07:14:08.952878+0000) 2024-08-01T07:14:13.613 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:14:13 smithi089 podman[123544]: 2024-08-01 07:14:13.233181258 +0000 UTC m=+0.016542580 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:14:13.613 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:14:13 smithi089 podman[123544]: 2024-08-01 07:14:13.359739535 +0000 UTC m=+0.143100900 container create 1b0b033f06c679ef85a72bb5650b8fc9e45f141fcfb27c2390851dd7c2a7095b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, RELEASE=squid-f9911e1, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux ) 2024-08-01T07:14:13.614 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:14:13 smithi089 podman[123544]: 2024-08-01 07:14:13.61266726 +0000 UTC m=+0.396028586 container init 1b0b033f06c679ef85a72bb5650b8fc9e45f141fcfb27c2390851dd7c2a7095b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-f9911e1, ceph=True, maintainer=Guillaume Abrioux ) 2024-08-01T07:14:13.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:13 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:13.629+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.903539+0000 front 2024-08-01T07:13:43.903567+0000 (oldest deadline 2024-08-01T07:14:09.803480+0000) 2024-08-01T07:14:13.887 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:14:13 smithi089 podman[123544]: 2024-08-01 07:14:13.616302352 +0000 UTC m=+0.399663675 container start 1b0b033f06c679ef85a72bb5650b8fc9e45f141fcfb27c2390851dd7c2a7095b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-f9911e1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, org.label-schema.license=GPLv2) 2024-08-01T07:14:13.887 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:14:13 smithi089 podman[123544]: 2024-08-01 07:14:13.712345423 +0000 UTC m=+0.495706759 container attach 1b0b033f06c679ef85a72bb5650b8fc9e45f141fcfb27c2390851dd7c2a7095b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-f9911e1, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-01T07:14:13.887 INFO:journalctl@ceph.osd.3.smithi089.stdout:Aug 01 07:14:13 smithi089 podman[123544]: 2024-08-01 07:14:13.810079057 +0000 UTC m=+0.593440381 container died 1b0b033f06c679ef85a72bb5650b8fc9e45f141fcfb27c2390851dd7c2a7095b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-f9911e1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-08-01T07:14:14.530 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.3.service' 2024-08-01T07:14:14.569 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-01T07:14:14.570 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-08-01T07:14:14.570 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-08-01T07:14:14.570 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.4 2024-08-01T07:14:14.790 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:14 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[96778]: 2024-08-01T07:14:14.468+0000 7f1eeab69640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.652940+0000 front 2024-08-01T07:13:43.652952+0000 (oldest deadline 2024-08-01T07:14:08.952878+0000) 2024-08-01T07:14:14.791 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:14 smithi089 systemd[1]: Stopping Ceph osd.4 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T07:14:14.791 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:14 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:14.585+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.903539+0000 front 2024-08-01T07:13:43.903567+0000 (oldest deadline 2024-08-01T07:14:09.803480+0000) 2024-08-01T07:14:15.137 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:14 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[96778]: 2024-08-01T07:14:14.927+0000 7f1ef1d6b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-01T07:14:15.137 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:14 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[96778]: 2024-08-01T07:14:14.927+0000 7f1ef1d6b640 -1 osd.4 96 *** Got signal Terminated *** 2024-08-01T07:14:15.137 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:14 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[96778]: 2024-08-01T07:14:14.927+0000 7f1ef1d6b640 -1 osd.4 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-01T07:14:15.732 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:15 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[96778]: 2024-08-01T07:14:15.450+0000 7f1eeab69640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.652940+0000 front 2024-08-01T07:13:43.652952+0000 (oldest deadline 2024-08-01T07:14:08.952878+0000) 2024-08-01T07:14:15.732 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:15 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:15.573+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.903539+0000 front 2024-08-01T07:13:43.903567+0000 (oldest deadline 2024-08-01T07:14:09.803480+0000) 2024-08-01T07:14:16.887 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:16 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[96778]: 2024-08-01T07:14:16.434+0000 7f1eeab69640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.652940+0000 front 2024-08-01T07:13:43.652952+0000 (oldest deadline 2024-08-01T07:14:08.952878+0000) 2024-08-01T07:14:16.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:16 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:16.554+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.903539+0000 front 2024-08-01T07:13:43.903567+0000 (oldest deadline 2024-08-01T07:14:09.803480+0000) 2024-08-01T07:14:17.887 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:17 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[96778]: 2024-08-01T07:14:17.483+0000 7f1eeab69640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.652940+0000 front 2024-08-01T07:13:43.652952+0000 (oldest deadline 2024-08-01T07:14:08.952878+0000) 2024-08-01T07:14:17.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:17 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:17.532+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.903539+0000 front 2024-08-01T07:13:43.903567+0000 (oldest deadline 2024-08-01T07:14:09.803480+0000) 2024-08-01T07:14:18.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:18 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:18.517+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.903539+0000 front 2024-08-01T07:13:43.903567+0000 (oldest deadline 2024-08-01T07:14:09.803480+0000) 2024-08-01T07:14:18.887 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:18 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[96778]: 2024-08-01T07:14:18.510+0000 7f1eeab69640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.652940+0000 front 2024-08-01T07:13:43.652952+0000 (oldest deadline 2024-08-01T07:14:08.952878+0000) 2024-08-01T07:14:18.887 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:18 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[96778]: 2024-08-01T07:14:18.510+0000 7f1eeab69640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.16:6814 osd.1 since back 2024-08-01T07:13:52.453951+0000 front 2024-08-01T07:13:52.453987+0000 (oldest deadline 2024-08-01T07:14:17.753751+0000) 2024-08-01T07:14:19.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:19 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:19.531+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.903539+0000 front 2024-08-01T07:13:43.903567+0000 (oldest deadline 2024-08-01T07:14:09.803480+0000) 2024-08-01T07:14:19.887 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:19 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[96778]: 2024-08-01T07:14:19.538+0000 7f1eeab69640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.652940+0000 front 2024-08-01T07:13:43.652952+0000 (oldest deadline 2024-08-01T07:14:08.952878+0000) 2024-08-01T07:14:19.887 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:19 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4[96778]: 2024-08-01T07:14:19.538+0000 7f1eeab69640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.16:6814 osd.1 since back 2024-08-01T07:13:52.453951+0000 front 2024-08-01T07:13:52.453987+0000 (oldest deadline 2024-08-01T07:14:17.753751+0000) 2024-08-01T07:14:20.687 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:20 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:20.565+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.903539+0000 front 2024-08-01T07:13:43.903567+0000 (oldest deadline 2024-08-01T07:14:09.803480+0000) 2024-08-01T07:14:20.687 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:20 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:20.565+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6814 osd.1 since back 2024-08-01T07:13:55.604619+0000 front 2024-08-01T07:13:55.604722+0000 (oldest deadline 2024-08-01T07:14:19.704528+0000) 2024-08-01T07:14:20.687 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:20 smithi089 podman[123649]: 2024-08-01 07:14:20.416621684 +0000 UTC m=+5.612846920 container died 7c51ba7a636a9d5e5e384f01f1fefe4bc16bfd7b9d6ad67a22054803444f2b05 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-f9911e1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240724) 2024-08-01T07:14:21.088 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:20 smithi089 podman[123649]: 2024-08-01 07:14:20.786123063 +0000 UTC m=+5.982348300 container cleanup 7c51ba7a636a9d5e5e384f01f1fefe4bc16bfd7b9d6ad67a22054803444f2b05 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240724, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-f9911e1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=) 2024-08-01T07:14:21.088 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:20 smithi089 bash[123649]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4 2024-08-01T07:14:21.387 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:21 smithi089 podman[123678]: 2024-08-01 07:14:21.087923911 +0000 UTC m=+0.665147262 container remove 7c51ba7a636a9d5e5e384f01f1fefe4bc16bfd7b9d6ad67a22054803444f2b05 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f9911e1, io.buildah.version=1.36.0) 2024-08-01T07:14:21.683 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:21 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:21.547+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.903539+0000 front 2024-08-01T07:13:43.903567+0000 (oldest deadline 2024-08-01T07:14:09.803480+0000) 2024-08-01T07:14:21.684 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:21 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:21.547+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6814 osd.1 since back 2024-08-01T07:13:55.604619+0000 front 2024-08-01T07:13:55.604722+0000 (oldest deadline 2024-08-01T07:14:19.704528+0000) 2024-08-01T07:14:21.684 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:21 smithi089 podman[123766]: 2024-08-01 07:14:21.322413083 +0000 UTC m=+0.017842117 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:14:21.684 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:21 smithi089 podman[123766]: 2024-08-01 07:14:21.438738059 +0000 UTC m=+0.134167128 container create 83ae41ffe050da32bea748a3e22b1c67eec877793647ae95252452acfd90beaf (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-f9911e1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240724, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-08-01T07:14:21.684 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:21 smithi089 podman[123766]: 2024-08-01 07:14:21.683289214 +0000 UTC m=+0.378718236 container init 83ae41ffe050da32bea748a3e22b1c67eec877793647ae95252452acfd90beaf (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-f9911e1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0) 2024-08-01T07:14:22.137 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:21 smithi089 podman[123766]: 2024-08-01 07:14:21.68676175 +0000 UTC m=+0.382190784 container start 83ae41ffe050da32bea748a3e22b1c67eec877793647ae95252452acfd90beaf (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-f9911e1, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-08-01T07:14:22.137 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:21 smithi089 podman[123766]: 2024-08-01 07:14:21.783225263 +0000 UTC m=+0.478654301 container attach 83ae41ffe050da32bea748a3e22b1c67eec877793647ae95252452acfd90beaf (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-deactivate, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f9911e1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-08-01T07:14:22.137 INFO:journalctl@ceph.osd.4.smithi089.stdout:Aug 01 07:14:21 smithi089 podman[123766]: 2024-08-01 07:14:21.878784508 +0000 UTC m=+0.574213542 container died 83ae41ffe050da32bea748a3e22b1c67eec877793647ae95252452acfd90beaf (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-f9911e1, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-01T07:14:22.561 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.4.service' 2024-08-01T07:14:22.600 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-01T07:14:22.600 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-08-01T07:14:22.600 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-08-01T07:14:22.600 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.5 2024-08-01T07:14:22.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:22 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:22.525+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.903539+0000 front 2024-08-01T07:13:43.903567+0000 (oldest deadline 2024-08-01T07:14:09.803480+0000) 2024-08-01T07:14:22.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:22 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:22.525+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6814 osd.1 since back 2024-08-01T07:13:55.604619+0000 front 2024-08-01T07:13:55.604722+0000 (oldest deadline 2024-08-01T07:14:19.704528+0000) 2024-08-01T07:14:22.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:22 smithi089 systemd[1]: Stopping Ceph osd.5 for a88427da-4fd1-11ef-bcca-c7b262605968... 2024-08-01T07:14:23.387 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:22 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:22.931+0000 7f9119ad5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-01T07:14:23.387 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:22 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:22.931+0000 7f9119ad5640 -1 osd.5 96 *** Got signal Terminated *** 2024-08-01T07:14:23.387 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:22 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:22.931+0000 7f9119ad5640 -1 osd.5 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-01T07:14:23.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:23 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:23.568+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.903539+0000 front 2024-08-01T07:13:43.903567+0000 (oldest deadline 2024-08-01T07:14:09.803480+0000) 2024-08-01T07:14:23.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:23 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:23.568+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6814 osd.1 since back 2024-08-01T07:13:55.604619+0000 front 2024-08-01T07:13:55.604722+0000 (oldest deadline 2024-08-01T07:14:19.704528+0000) 2024-08-01T07:14:24.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:24 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:24.519+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.903539+0000 front 2024-08-01T07:13:43.903567+0000 (oldest deadline 2024-08-01T07:14:09.803480+0000) 2024-08-01T07:14:24.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:24 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:24.519+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6814 osd.1 since back 2024-08-01T07:13:55.604619+0000 front 2024-08-01T07:13:55.604722+0000 (oldest deadline 2024-08-01T07:14:19.704528+0000) 2024-08-01T07:14:25.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:25 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:25.500+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.903539+0000 front 2024-08-01T07:13:43.903567+0000 (oldest deadline 2024-08-01T07:14:09.803480+0000) 2024-08-01T07:14:25.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:25 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:25.500+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6814 osd.1 since back 2024-08-01T07:13:55.604619+0000 front 2024-08-01T07:13:55.604722+0000 (oldest deadline 2024-08-01T07:14:19.704528+0000) 2024-08-01T07:14:26.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:26 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:26.472+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.903539+0000 front 2024-08-01T07:13:43.903567+0000 (oldest deadline 2024-08-01T07:14:09.803480+0000) 2024-08-01T07:14:26.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:26 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:26.472+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6814 osd.1 since back 2024-08-01T07:13:55.604619+0000 front 2024-08-01T07:13:55.604722+0000 (oldest deadline 2024-08-01T07:14:19.704528+0000) 2024-08-01T07:14:27.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:27 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:27.520+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6806 osd.0 since back 2024-08-01T07:13:43.903539+0000 front 2024-08-01T07:13:43.903567+0000 (oldest deadline 2024-08-01T07:14:09.803480+0000) 2024-08-01T07:14:27.887 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:27 smithi089 ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5[102078]: 2024-08-01T07:14:27.520+0000 7f91128d3640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.16:6814 osd.1 since back 2024-08-01T07:13:55.604619+0000 front 2024-08-01T07:13:55.604722+0000 (oldest deadline 2024-08-01T07:14:19.704528+0000) 2024-08-01T07:14:28.750 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:28 smithi089 podman[123871]: 2024-08-01 07:14:28.473738661 +0000 UTC m=+5.653917744 container died 08ffb10ca1a626d9dd8dcf55a6db923d1c546a3f939f1ae40dd8ff056578cc35 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240724, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-f9911e1, org.label-schema.license=GPLv2) 2024-08-01T07:14:29.100 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:28 smithi089 podman[123871]: 2024-08-01 07:14:28.840148284 +0000 UTC m=+6.020327366 container cleanup 08ffb10ca1a626d9dd8dcf55a6db923d1c546a3f939f1ae40dd8ff056578cc35 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f9911e1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240724) 2024-08-01T07:14:29.100 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:28 smithi089 bash[123871]: ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5 2024-08-01T07:14:29.387 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:29 smithi089 podman[123893]: 2024-08-01 07:14:29.099818702 +0000 UTC m=+0.620672260 container remove 08ffb10ca1a626d9dd8dcf55a6db923d1c546a3f939f1ae40dd8ff056578cc35 (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240724, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-f9911e1, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-01T07:14:29.740 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:29 smithi089 podman[123982]: 2024-08-01 07:14:29.371601461 +0000 UTC m=+0.017090371 image pull 93d93c74a2cc6f07ff8c0848a01017c27414830696330be353461f8545597967 quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483 2024-08-01T07:14:29.740 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:29 smithi089 podman[123982]: 2024-08-01 07:14:29.509129541 +0000 UTC m=+0.154618492 container create 015b211cfcfb9effb934f7d146176120846df1b25f4e3077734686cc4ddd356b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, RELEASE=squid-f9911e1, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-01T07:14:29.740 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:29 smithi089 podman[123982]: 2024-08-01 07:14:29.739896204 +0000 UTC m=+0.385385127 container init 015b211cfcfb9effb934f7d146176120846df1b25f4e3077734686cc4ddd356b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, RELEASE=squid-f9911e1, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240724, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-01T07:14:30.137 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:29 smithi089 podman[123982]: 2024-08-01 07:14:29.74318871 +0000 UTC m=+0.388677627 container start 015b211cfcfb9effb934f7d146176120846df1b25f4e3077734686cc4ddd356b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f9911e1, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-01T07:14:30.137 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:29 smithi089 podman[123982]: 2024-08-01 07:14:29.836770784 +0000 UTC m=+0.482259703 container attach 015b211cfcfb9effb934f7d146176120846df1b25f4e3077734686cc4ddd356b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240724, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, RELEASE=squid-f9911e1) 2024-08-01T07:14:30.137 INFO:journalctl@ceph.osd.5.smithi089.stdout:Aug 01 07:14:29 smithi089 podman[123982]: 2024-08-01 07:14:29.935763756 +0000 UTC m=+0.581252674 container died 015b211cfcfb9effb934f7d146176120846df1b25f4e3077734686cc4ddd356b (image=quay.ceph.io/ceph-ci/ceph@sha256:0190f631ac6750a6092012483b23089df6a4e4f17cd9c82e8b6d0c32325e1483, name=ceph-a88427da-4fd1-11ef-bcca-c7b262605968-osd-5-deactivate, io.buildah.version=1.36.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-f9911e1, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240724, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-01T07:14:30.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a88427da-4fd1-11ef-bcca-c7b262605968@osd.5.service' 2024-08-01T07:14:30.559 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-01T07:14:30.559 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-08-01T07:14:30.560 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a88427da-4fd1-11ef-bcca-c7b262605968 --force --keep-logs 2024-08-01T07:14:30.726 INFO:teuthology.orchestra.run.smithi016.stdout:Deleting cluster with fsid: a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T07:14:35.116 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi016.stderr:ceph-fuse[77340]: fuse finished with error 0 and tester_r 0 2024-08-01T07:14:53.170 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a88427da-4fd1-11ef-bcca-c7b262605968 --force --keep-logs 2024-08-01T07:14:53.328 INFO:teuthology.orchestra.run.smithi089.stdout:Deleting cluster with fsid: a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T07:15:08.704 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-01T07:15:08.739 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-01T07:15:08.767 INFO:tasks.cephadm:Archiving crash dumps... 2024-08-01T07:15:08.769 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-07-31_21:24:16-fs-squid-distro-default-smithi/7829256/remote/smithi016/crash 2024-08-01T07:15:08.770 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/crash -- . 2024-08-01T07:15:08.808 INFO:teuthology.orchestra.run.smithi016.stderr:tar: /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/crash: Cannot open: No such file or directory 2024-08-01T07:15:08.808 INFO:teuthology.orchestra.run.smithi016.stderr:tar: Error is not recoverable: exiting now 2024-08-01T07:15:08.810 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-07-31_21:24:16-fs-squid-distro-default-smithi/7829256/remote/smithi089/crash 2024-08-01T07:15:08.811 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/crash -- . 2024-08-01T07:15:08.834 INFO:teuthology.orchestra.run.smithi089.stderr:tar: /var/lib/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/crash: Cannot open: No such file or directory 2024-08-01T07:15:08.835 INFO:teuthology.orchestra.run.smithi089.stderr:tar: Error is not recoverable: exiting now 2024-08-01T07:15:08.836 INFO:tasks.cephadm:Checking cluster log for badness... 2024-08-01T07:15:08.836 DEBUG:teuthology.orchestra.run.smithi016:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-08-01T07:15:08.886 INFO:tasks.cephadm:Compressing logs... 2024-08-01T07:15:08.886 DEBUG:teuthology.orchestra.run.smithi016:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-01T07:15:08.929 DEBUG:teuthology.orchestra.run.smithi089:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-01T07:15:08.953 INFO:teuthology.orchestra.run.smithi016.stderr:find: ‘/var/log/rbd-target-api’gzip -5: No such file or directory --verbose 2024-08-01T07:15:08.954 INFO:teuthology.orchestra.run.smithi016.stderr: -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mds.cephfs.smithi016.bgqkxu.log 2024-08-01T07:15:08.954 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph.log 2024-08-01T07:15:08.954 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mds.cephfs.smithi016.bgqkxu.log: gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mds.cephfs.smithi016.fziqod.log 2024-08-01T07:15:08.958 INFO:teuthology.orchestra.run.smithi089.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-08-01T07:15:08.958 INFO:teuthology.orchestra.run.smithi089.stderr:: No such file or directory 2024-08-01T07:15:08.959 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph.log 2024-08-01T07:15:08.959 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.log: gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph.audit.log 2024-08-01T07:15:08.959 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-osd.5.log 2024-08-01T07:15:08.959 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-osd.3.log 2024-08-01T07:15:08.959 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-osd.4.log 2024-08-01T07:15:08.959 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mgr.smithi089.hfgnsr.log 2024-08-01T07:15:08.959 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mds.cephfs.smithi089.xanuld.log 2024-08-01T07:15:08.959 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mgr.smithi089.hfgnsr.log: gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph.cephadm.log 2024-08-01T07:15:08.959 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mds.cephfs.smithi089.xanuld.log: 88.6% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph.log.gz 2024-08-01T07:15:08.960 INFO:teuthology.orchestra.run.smithi089.stderr: 91.9% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph.audit.log.gz 2024-08-01T07:15:08.962 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-osd.2.log 2024-08-01T07:15:08.962 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mds.cephfs.smithi016.fziqod.log: gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph.audit.log 2024-08-01T07:15:08.963 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mon.smithi016.log 2024-08-01T07:15:08.963 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-osd.2.log: /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-osd.1.log 2024-08-01T07:15:08.963 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mon.smithi016.log: gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-osd.0.log 2024-08-01T07:15:08.963 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph.cephadm.log 2024-08-01T07:15:08.963 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-osd.0.log: 88.5% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph.log.gz 2024-08-01T07:15:08.963 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mgr.smithi016.whigbo.log 2024-08-01T07:15:08.963 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph.cephadm.log: 86.8% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph.cephadm.log.gz 2024-08-01T07:15:08.963 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-client.ceph-exporter.smithi016.log 2024-08-01T07:15:08.963 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mgr.smithi016.whigbo.log: 91.7% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph.audit.log.gz 2024-08-01T07:15:08.963 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-volume.log 2024-08-01T07:15:08.964 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-client.ceph-exporter.smithi016.log: 94.2% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-client.ceph-exporter.smithi016.log.gz 2024-08-01T07:15:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-08-01T07:15:08.967 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mon.smithi089.log 2024-08-01T07:15:08.967 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-volume.log 2024-08-01T07:15:08.968 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mon.smithi089.log: 85.8% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph.cephadm.log.gz 2024-08-01T07:15:08.973 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-client.ceph-exporter.smithi089.log 2024-08-01T07:15:08.978 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-01T07:15:08.982 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mds.cephfs.smithi089.jhouje.log 2024-08-01T07:15:08.992 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-client.ceph-exporter.smithi089.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-01T07:15:08.992 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mds.cephfs.smithi089.jhouje.log: 94.1% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-client.ceph-exporter.smithi089.log.gz 2024-08-01T07:15:08.997 INFO:teuthology.orchestra.run.smithi089.stderr: 91.1% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-volume.log.gz 2024-08-01T07:15:09.000 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-01T07:15:09.006 INFO:teuthology.orchestra.run.smithi089.stderr: 89.4% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mgr.smithi089.hfgnsr.log.gz 2024-08-01T07:15:09.013 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 91.1% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-volume.log.gz 2024-08-01T07:15:09.044 INFO:teuthology.orchestra.run.smithi089.stderr: 94.6% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mds.cephfs.smithi089.xanuld.log.gz 2024-08-01T07:15:09.046 INFO:teuthology.orchestra.run.smithi016.stderr: 90.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-01T07:15:09.286 INFO:teuthology.orchestra.run.smithi089.stderr: 92.5% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mon.smithi089.log.gz 2024-08-01T07:15:09.399 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mgr.smithi016.whigbo.log.gz 2024-08-01T07:15:09.990 INFO:teuthology.orchestra.run.smithi016.stderr: 90.4% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mon.smithi016.log.gz 2024-08-01T07:15:14.901 INFO:teuthology.orchestra.run.smithi089.stderr: 93.7% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-osd.5.log.gz 2024-08-01T07:15:15.086 INFO:teuthology.orchestra.run.smithi016.stderr: 93.5% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-osd.1.log.gz 2024-08-01T07:15:15.240 INFO:teuthology.orchestra.run.smithi089.stderr: 93.6% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-osd.3.log.gz 2024-08-01T07:15:16.165 INFO:teuthology.orchestra.run.smithi089.stderr: 93.0% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-osd.4.log.gz 2024-08-01T07:15:16.216 INFO:teuthology.orchestra.run.smithi016.stderr: 93.3% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-osd.2.log.gz 2024-08-01T07:15:16.700 INFO:teuthology.orchestra.run.smithi089.stderr: 94.8% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mds.cephfs.smithi089.jhouje.log.gz 2024-08-01T07:15:17.535 INFO:teuthology.orchestra.run.smithi016.stderr: 93.0% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-osd.0.log.gz 2024-08-01T07:15:22.869 INFO:teuthology.orchestra.run.smithi089.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-08-01T07:15:22.869 INFO:teuthology.orchestra.run.smithi089.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-08-01T07:15:22.870 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-08-01T07:15:22.870 INFO:teuthology.orchestra.run.smithi089.stderr:real 0m13.927s 2024-08-01T07:15:22.870 INFO:teuthology.orchestra.run.smithi089.stderr:user 0m40.320s 2024-08-01T07:15:22.870 INFO:teuthology.orchestra.run.smithi089.stderr:sys 0m1.173s 2024-08-01T07:15:24.600 INFO:teuthology.orchestra.run.smithi016.stderr: 94.8% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mds.cephfs.smithi016.bgqkxu.log.gz 2024-08-01T07:15:26.056 INFO:teuthology.orchestra.run.smithi016.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-08-01T07:16:40.213 INFO:teuthology.orchestra.run.smithi016.stderr: 92.8% -- replaced with /var/log/ceph/a88427da-4fd1-11ef-bcca-c7b262605968/ceph-mds.cephfs.smithi016.fziqod.log.gz 2024-08-01T07:16:40.214 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-08-01T07:16:40.215 INFO:teuthology.orchestra.run.smithi016.stderr:real 1m31.271s 2024-08-01T07:16:40.215 INFO:teuthology.orchestra.run.smithi016.stderr:user 2m22.926s 2024-08-01T07:16:40.215 INFO:teuthology.orchestra.run.smithi016.stderr:sys 0m4.190s 2024-08-01T07:16:40.215 INFO:tasks.cephadm:Archiving logs... 2024-08-01T07:16:40.216 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-07-31_21:24:16-fs-squid-distro-default-smithi/7829256/remote/smithi016/log 2024-08-01T07:16:40.217 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-01T07:16:59.424 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-07-31_21:24:16-fs-squid-distro-default-smithi/7829256/remote/smithi089/log 2024-08-01T07:16:59.425 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-01T07:17:04.830 INFO:tasks.cephadm:Removing cluster... 2024-08-01T07:17:04.831 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a88427da-4fd1-11ef-bcca-c7b262605968 --force 2024-08-01T07:17:04.995 INFO:teuthology.orchestra.run.smithi016.stdout:Deleting cluster with fsid: a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T07:17:05.420 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a88427da-4fd1-11ef-bcca-c7b262605968 --force 2024-08-01T07:17:05.575 INFO:teuthology.orchestra.run.smithi089.stdout:Deleting cluster with fsid: a88427da-4fd1-11ef-bcca-c7b262605968 2024-08-01T07:17:05.867 INFO:tasks.cephadm:Removing cephadm ... 2024-08-01T07:17:05.868 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-01T07:17:05.885 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-01T07:17:05.900 INFO:tasks.cephadm:Teardown complete 2024-08-01T07:17:05.901 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-01T07:17:05.912 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_d99c9769be1521395979e8c23d9073adbf1ff43f/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_d99c9769be1521395979e8c23d9073adbf1ff43f/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-08-01T07:17:05.913 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-01T07:17:05.914 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-01T07:17:05.928 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-01T07:17:06.013 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-01T07:17:06.023 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-01T07:17:06.024 DEBUG:teuthology.orchestra.run.smithi016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-01T07:17:06.027 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-01T07:17:06.039 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: ntpq: command not found 2024-08-01T07:17:06.041 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-08-01T07:17:06.044 INFO:teuthology.orchestra.run.smithi016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-01T07:17:06.044 INFO:teuthology.orchestra.run.smithi016.stdout:=============================================================================== 2024-08-01T07:17:06.044 INFO:teuthology.orchestra.run.smithi016.stdout:^* hv01.front.sepia.ceph.com 3 7 377 19 +415us[ +409us] +/- 57ms 2024-08-01T07:17:06.045 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv02.front.sepia.ceph.com 3 8 377 85 -919us[ -924us] +/- 69ms 2024-08-01T07:17:06.045 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 +636us[ +630us] +/- 78ms 2024-08-01T07:17:06.045 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-01T07:17:06.045 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-01T07:17:06.046 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-08-01T07:17:06.046 INFO:teuthology.orchestra.run.smithi089.stdout:^* hv01.front.sepia.ceph.com 3 6 377 20 +338us[ +350us] +/- 57ms 2024-08-01T07:17:06.046 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 22 -1000us[ -988us] +/- 70ms 2024-08-01T07:17:06.046 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 +597us[ +609us] +/- 78ms 2024-08-01T07:17:06.046 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-01T07:17:06.046 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-01T07:17:06.057 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-01T07:17:06.058 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-01T07:17:06.070 DEBUG:teuthology.orchestra.run.smithi016:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-01T07:17:06.169 DEBUG:teuthology.orchestra.run.smithi089:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-01T07:17:06.243 DEBUG:teuthology.orchestra.run.smithi016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-01T07:17:06.273 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-01T07:17:06.273 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-01T07:17:06.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-01T07:17:06.302 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-01T07:17:06.313 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-01T07:17:06.368 INFO:teuthology.task.internal:Duration was 2320.689195 seconds 2024-08-01T07:17:06.369 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-01T07:17:06.380 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-01T07:17:06.380 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-01T07:17:06.383 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-01T07:17:06.420 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-01T07:17:06.421 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-01T07:17:06.691 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-01T07:17:06.691 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi016.front.sepia.ceph.com 2024-08-01T07:17:06.691 DEBUG:teuthology.orchestra.run.smithi016:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-01T07:17:06.753 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2024-08-01T07:17:06.753 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-01T07:17:06.787 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-01T07:17:06.788 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-01T07:17:06.795 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-01T07:17:06.854 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-01T07:17:06.854 DEBUG:teuthology.orchestra.run.smithi016:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-01T07:17:06.863 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-01T07:17:07.571 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-01T07:17:07.583 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-01T07:17:07.584 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-01T07:17:07.609 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-01T07:17:07.636 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-01T07:17:07.647 DEBUG:teuthology.orchestra.run.smithi016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-01T07:17:07.652 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-01T07:17:07.674 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = core 2024-08-01T07:17:07.700 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2024-08-01T07:17:07.732 DEBUG:teuthology.orchestra.run.smithi016:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-01T07:17:07.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-01T07:17:07.759 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-01T07:17:07.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-01T07:17:07.787 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-01T07:17:07.798 INFO:teuthology.task.internal:Transferring archived files... 2024-08-01T07:17:07.800 DEBUG:teuthology.misc:Transferring archived files from smithi016:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-07-31_21:24:16-fs-squid-distro-default-smithi/7829256/remote/smithi016 2024-08-01T07:17:07.800 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-01T07:17:07.855 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-07-31_21:24:16-fs-squid-distro-default-smithi/7829256/remote/smithi089 2024-08-01T07:17:07.855 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-01T07:17:07.894 INFO:teuthology.task.internal:Removing archive directory... 2024-08-01T07:17:07.894 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-01T07:17:07.896 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-01T07:17:07.943 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-01T07:17:07.956 INFO:teuthology.task.internal:Not uploading archives. 2024-08-01T07:17:07.957 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-01T07:17:07.968 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-01T07:17:07.968 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-01T07:17:07.970 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-01T07:17:07.983 INFO:teuthology.orchestra.run.smithi016.stdout: 265307 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Aug 1 07:17 /home/ubuntu/cephtest 2024-08-01T07:17:07.983 INFO:teuthology.orchestra.run.smithi016.stdout: 655641 4 d--------- 2 ubuntu ubuntu 4096 Aug 1 06:53 /home/ubuntu/cephtest/mnt.0 2024-08-01T07:17:07.985 INFO:teuthology.orchestra.run.smithi016.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-08-01T07:17:07.985 INFO:teuthology.orchestra.run.smithi016.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-08-01T07:17:07.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-01T07:17:07.988 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_d99c9769be1521395979e8c23d9073adbf1ff43f/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_d99c9769be1521395979e8c23d9073adbf1ff43f/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi016 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-08-01T07:17:07.989 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-01T07:17:08.001 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-01T07:17:08.014 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-08-01T07:17:08.017 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2320.689194917679 failure_reason: reached maximum tries (51) after waiting for 300 seconds flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-08-01T07:17:08.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-01T07:17:08.109 INFO:teuthology.run:FAIL